-- Logs begin at Wed 2022-08-10 16:26:40 UTC, end at Wed 2022-08-10 18:32:56 UTC. -- Aug 10 17:38:05.519144 n-d-852296-2 systemd[1]: Starting Devstack devstack@n-api.service... Aug 10 17:38:05.528365 n-d-852296-2 devstack@n-api.service[113417]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 10 17:38:05.529963 n-d-852296-2 devstack@n-api.service[113417]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 10 17:38:05 2022] *** Aug 10 17:38:05.529963 n-d-852296-2 devstack@n-api.service[113417]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 10 17:38:05.529963 n-d-852296-2 devstack@n-api.service[113417]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 10 17:38:05.529963 n-d-852296-2 devstack@n-api.service[113417]: nodename: n-d-852296-2 Aug 10 17:38:05.529963 n-d-852296-2 devstack@n-api.service[113417]: machine: x86_64 Aug 10 17:38:05.529963 n-d-852296-2 devstack@n-api.service[113417]: clock source: unix Aug 10 17:38:05.529963 n-d-852296-2 devstack@n-api.service[113417]: pcre jit disabled Aug 10 17:38:05.529963 n-d-852296-2 devstack@n-api.service[113417]: detected number of CPU cores: 4 Aug 10 17:38:05.529963 n-d-852296-2 devstack@n-api.service[113417]: current working directory: / Aug 10 17:38:05.530600 n-d-852296-2 devstack@n-api.service[113417]: detected binary path: /usr/bin/uwsgi-core Aug 10 17:38:05.530600 n-d-852296-2 devstack@n-api.service[113417]: your processes number limit is 47680 Aug 10 17:38:05.530600 n-d-852296-2 devstack@n-api.service[113417]: your memory page size is 4096 bytes Aug 10 17:38:05.530600 n-d-852296-2 devstack@n-api.service[113417]: detected max file descriptor number: 2048 Aug 10 17:38:05.530600 n-d-852296-2 devstack@n-api.service[113417]: lock engine: pthread robust mutexes Aug 10 17:38:05.530600 n-d-852296-2 devstack@n-api.service[113417]: thunder lock: enabled Aug 10 17:38:05.530600 n-d-852296-2 devstack@n-api.service[113417]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 10 17:38:05.530600 n-d-852296-2 devstack@n-api.service[113417]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 10 17:38:05.570256 n-d-852296-2 devstack@n-api.service[113417]: Python main interpreter initialized at 0x56547872a9c0 Aug 10 17:38:05.570256 n-d-852296-2 devstack@n-api.service[113417]: python threads support enabled Aug 10 17:38:05.570256 n-d-852296-2 devstack@n-api.service[113417]: your server socket listen backlog is limited to 100 connections Aug 10 17:38:05.570256 n-d-852296-2 devstack@n-api.service[113417]: your mercy for graceful operations on workers is 90 seconds Aug 10 17:38:05.570648 n-d-852296-2 devstack@n-api.service[113417]: mapped 403077 bytes (393 KB) for 2 cores Aug 10 17:38:05.570648 n-d-852296-2 devstack@n-api.service[113417]: *** Operational MODE: preforking *** Aug 10 17:38:05.570924 n-d-852296-2 devstack@n-api.service[113417]: *** uWSGI is running in multiple interpreter mode *** Aug 10 17:38:05.570924 n-d-852296-2 devstack@n-api.service[113417]: spawned uWSGI master process (pid: 113417) Aug 10 17:38:05.571123 n-d-852296-2 systemd[1]: Started Devstack devstack@n-api.service. Aug 10 17:38:05.576272 n-d-852296-2 devstack@n-api.service[113417]: spawned uWSGI worker 1 (pid: 113418, cores: 1) Aug 10 17:38:05.576272 n-d-852296-2 devstack@n-api.service[113417]: spawned uWSGI worker 2 (pid: 113419, cores: 1) Aug 10 17:38:05.576272 n-d-852296-2 devstack@n-api.service[113417]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 10 17:38:06.232615 n-d-852296-2 devstack@n-api.service[113418]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 10 17:38:06.248514 n-d-852296-2 devstack@n-api.service[113419]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 10 17:38:07.313291 n-d-852296-2 devstack@n-api.service[113418]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 17:38:07.313291 n-d-852296-2 devstack@n-api.service[113418]: from cryptography.utils import int_from_bytes Aug 10 17:38:07.314621 n-d-852296-2 devstack@n-api.service[113418]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 17:38:07.314621 n-d-852296-2 devstack@n-api.service[113418]: from cryptography.utils import int_from_bytes Aug 10 17:38:07.322999 n-d-852296-2 devstack@n-api.service[113419]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 17:38:07.322999 n-d-852296-2 devstack@n-api.service[113419]: from cryptography.utils import int_from_bytes Aug 10 17:38:07.323493 n-d-852296-2 devstack@n-api.service[113419]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 17:38:07.323493 n-d-852296-2 devstack@n-api.service[113419]: from cryptography.utils import int_from_bytes Aug 10 17:38:09.803943 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 10 17:38:09.804611 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 10 17:38:09.804764 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 10 17:38:09.805117 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 10 17:38:09.805370 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 10 17:38:09.805757 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.806084 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.806411 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.806730 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.807060 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.807369 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.807688 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.807787 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 10 17:38:09.808146 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 10 17:38:09.808233 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.808364 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.808563 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 10 17:38:09.808679 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.808893 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 10 17:38:09.808987 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.809152 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 10 17:38:09.809245 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-852296-2 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.809520 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.809621 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.809827 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.809913 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.810134 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.810275 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.810449 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.810541 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.810752 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.810846 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.811071 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.811156 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.811385 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.811480 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.811705 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.811885 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.812039 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.812327 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.812465 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.812638 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.812750 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.812948 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.813067 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-852296-2 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.813299 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.813479 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.813677 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.813808 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.813944 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.814081 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.814247 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.814417 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.814554 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.814722 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.814867 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.815047 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.815185 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.815356 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.815674 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.815784 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-852296-2 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.815985 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.816080 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.816324 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.816446 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.816639 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.816726 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.816976 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.817068 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.817289 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.817383 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.817664 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.817764 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.817924 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.818018 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.818238 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.818331 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.818563 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.818650 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.818873 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.818981 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.819189 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.819284 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-852296-2 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.819506 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.819647 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.819826 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.819920 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.820126 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.820213 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.820458 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.820656 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.820765 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.820969 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.821081 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.821279 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.821371 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.821600 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.821695 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.821908 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.821994 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.822213 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.822317 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.822532 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.822622 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.822849 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.822945 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.823164 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.823264 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.823414 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.823513 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.823663 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.823764 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.823978 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.824074 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.824318 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.824408 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.824624 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.824721 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.824929 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.825022 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.825235 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.825342 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.825535 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.825621 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.825836 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.825928 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.826139 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.826231 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.826448 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.826540 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.826750 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.826842 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.827007 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.827099 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.827260 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.827364 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.827628 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.827725 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.827938 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.828029 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.828222 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.828347 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.828579 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.828679 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.50 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.829421 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.50 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.829519 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.829752 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.829865 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.830064 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.830150 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.830378 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.830463 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.830712 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.830818 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.831023 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.831117 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.831343 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.831436 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.831648 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.831740 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.831955 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.832043 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.832273 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.832361 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.832594 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.832686 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.832929 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.833016 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.50 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.833228 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.50 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.833322 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.833475 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.833567 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.833776 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.833884 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.834081 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.834204 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.834398 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.834512 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.834704 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.834830 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.835011 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.835152 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.835316 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.835461 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.835613 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.835767 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.835918 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.836073 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.836223 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.836424 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.836547 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.836758 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.836854 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.837092 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.837191 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.837340 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.837434 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.837644 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.837730 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.837949 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.838037 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.838268 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.838355 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.838574 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.838668 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.838886 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.838986 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.839195 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.839280 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.839498 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.839591 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.839802 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.839934 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.840107 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.840201 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.840439 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.840531 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.840742 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.840827 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.841045 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.841131 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.841347 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.841444 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.841654 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.841745 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.841953 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.842037 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.842284 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.842383 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.842592 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.842689 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.842904 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.842988 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.843208 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.843301 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.843507 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.843592 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.843809 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.843903 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.844116 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.844215 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.845094 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.845210 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.845399 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.845487 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.845703 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.845803 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.846006 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.846093 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.846309 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.846399 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.846613 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.846713 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.846919 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.847006 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.847222 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.847307 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.847521 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.847647 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.847836 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.847930 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.848156 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.848293 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.848489 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.848588 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.848797 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.848883 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.849100 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.849187 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.849420 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.849508 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.849743 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.849828 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.850053 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.850149 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.850358 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.850444 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.850662 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.850757 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.850968 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.851067 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.851273 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.851365 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.851572 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.851658 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.851890 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.851985 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.852213 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.852318 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.852547 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.852645 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.852854 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.852952 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.853156 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.853248 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.853461 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.853546 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:38:09.853778 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.853871 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.854094 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.854179 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.854422 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.854516 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.854738 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.854832 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.855051 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.855137 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.855367 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.855454 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.855676 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.855771 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.855990 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.856076 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.856342 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.856451 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.856658 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.856750 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.856971 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.857058 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.857283 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.857379 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.857595 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.857682 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.857914 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.858001 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.858232 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.858319 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.858547 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.858633 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.858856 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.858941 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.859165 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.859278 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.859469 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.859607 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.859780 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.859875 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.860135 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.860305 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.860466 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.860559 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.860782 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.860892 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.861090 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.861192 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.861398 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.861563 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.861705 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.861910 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.862011 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.862228 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.862323 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.862555 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.862642 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.862876 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.862973 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.863189 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.863275 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.863501 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.863594 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.863812 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.863914 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.864118 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.864204 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.864449 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.864545 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.864758 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.864871 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.865083 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.865177 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.865388 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.865483 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.865689 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.865786 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.865996 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.866091 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.866298 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.866385 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.866613 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.866712 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.866936 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.867045 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.867239 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.867338 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.867559 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.867658 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.867863 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.867949 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.868179 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.868308 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.868511 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.868600 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.868819 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.868905 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.869121 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.869207 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.869427 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.869520 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.869735 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.869821 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.870037 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.870121 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.870346 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.870431 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.870652 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.870740 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.870953 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.871044 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.871275 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.871360 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.871578 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.871664 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.871882 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.872053 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.872194 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.872331 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.872526 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.872613 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.872836 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.872939 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.873146 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.873232 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.873452 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.873537 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.873769 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.873865 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.874078 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.874163 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.874383 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.874467 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.874707 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.874802 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.875021 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.875114 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.875325 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.875409 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.876165 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.876296 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.876530 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.876625 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.876845 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.877008 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.877204 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.877329 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.877487 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.877645 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.877734 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.877959 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.878055 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.878273 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.878364 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.878588 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.878676 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.878912 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.878998 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.879216 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.879301 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.879518 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.879604 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.879823 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.879910 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.880126 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.880225 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.880470 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.880558 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.880777 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.880865 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.881082 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.881209 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.881386 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.881472 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.881688 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.881775 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.882051 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.882143 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.882358 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.882453 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.882668 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.882769 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.882975 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.883107 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.883286 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.883382 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.883591 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.883677 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.883897 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.883993 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.884205 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.884327 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.884538 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.884624 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.884846 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.884933 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.885154 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.885249 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.885466 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.885552 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.885770 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.885855 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.886081 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.886168 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.886390 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.886475 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.886696 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.886782 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.887018 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.887112 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.887327 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.887413 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.887648 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.887742 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.887951 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.888038 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.888281 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.888484 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.888620 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.888707 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.888946 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.889034 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.889262 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.889362 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.889570 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.889672 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.889877 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.889976 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.890190 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.890281 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.890498 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.890599 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.890808 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.890895 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.891116 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.891244 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.894541 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.894710 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.894710 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.894927 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.895033 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.895139 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.895243 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.895357 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.895463 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.895567 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.895671 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.895776 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.895880 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.895997 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.896109 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.896216 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.896499 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.896617 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.896738 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.896855 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.896963 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.897076 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.897182 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.897286 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.897399 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.897513 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.897618 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.897731 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.897836 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.897941 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.898053 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.898159 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.898263 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.898642 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.898763 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.898869 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.898988 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.899093 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.899210 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.899323 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.899513 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.899646 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.899753 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.899858 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.899970 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.900083 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.900188 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.900323 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.900434 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.900551 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.900631 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.900700 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.900767 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.900841 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.900908 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.900981 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.901048 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.901114 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.901114 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.901888 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.901983 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.902113 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.902221 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.902325 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.902509 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.902625 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.902755 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.902840 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.902919 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.903018 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.903100 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.903178 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.903296 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.903390 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.903496 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.903592 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.903799 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.903886 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.904103 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.904199 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.904427 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.904535 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.904749 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.904878 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.905056 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.905142 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.905358 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.905453 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.905674 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.905771 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.905994 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.906344 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.906565 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.906652 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.906881 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.906996 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.907272 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.907359 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.907603 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.907733 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.907911 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.908058 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.908233 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.908395 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.908569 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.908705 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.908874 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.909016 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.909186 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.909326 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.909513 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.909637 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.909862 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.909957 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.910175 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.910272 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.910481 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.910581 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.910825 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.910914 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.911151 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.911248 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.911457 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.911544 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.911769 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.911884 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.912080 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.912176 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.912416 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.912686 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.912829 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.913017 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.913104 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.913331 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.913420 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.913641 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.913729 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.913951 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.914046 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.914262 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.914349 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.914574 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.914668 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.914897 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.914993 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.915209 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.915296 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.915519 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.915614 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.915827 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.915921 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.916130 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.916217 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.916455 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.916604 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.916765 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.916931 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.917070 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.917449 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.917543 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.917760 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.917861 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.918068 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.918165 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.918370 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.918481 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.918670 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.918806 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.918969 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.919133 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.919272 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.919465 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.919583 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.919794 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.919890 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.920153 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.920270 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.920490 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.920580 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.920804 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.920893 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.921111 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.921199 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.921413 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.921542 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.921713 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.921801 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.922015 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.922106 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.922353 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.922458 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.922671 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.922773 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.922983 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.923245 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.923345 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.923575 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.923664 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.923896 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.923996 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.924335 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.924439 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.924531 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.924606 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.924841 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.924936 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.925146 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.925307 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.925448 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.925544 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.925749 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.925837 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.926055 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.926142 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.926358 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.926442 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.926656 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.926744 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.926963 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.927048 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.927272 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.927358 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.927577 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.927673 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.927888 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.927974 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.928188 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.928318 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.928517 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.928629 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.928879 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.928990 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.929126 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.929261 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.929430 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.929588 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.929730 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.929908 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.930025 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.930186 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.930321 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.930489 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.930629 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.930822 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.930918 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.931131 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.931226 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.931435 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.931522 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.931746 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.931845 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.932057 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.932151 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.932381 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.932470 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.932684 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.932788 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.932986 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.933079 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.933288 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.933373 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.933651 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.933886 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.933978 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.934057 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.934216 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.934318 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.934516 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.934613 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.934815 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.934900 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.935116 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.935202 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.935417 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.935514 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.935715 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.935802 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.936017 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.936107 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.936350 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.936495 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.936662 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.936749 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.936962 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.937049 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.937262 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.937356 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.937561 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.937665 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.937863 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.937993 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.938743 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.938845 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.939302 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.939525 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.939525 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.939743 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.939928 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.940017 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.940097 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.940263 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.940364 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.940604 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.940729 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.940801 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.940916 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.941002 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.941070 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.941146 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.941339 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.941472 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.941640 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.941849 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.941997 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.942302 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.942394 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.942475 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.942554 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.942734 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.942896 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.943037 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.943201 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.943344 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.943513 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.943648 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.943831 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.943954 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.944180 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.944358 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.944557 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.944642 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.944818 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.944966 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.945081 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.945169 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.945397 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.945496 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.945704 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.945799 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.946015 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.946284 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.946446 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.946547 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.946637 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.946723 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.946908 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.946996 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.947218 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.947323 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.947525 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.947613 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.947844 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.947934 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.948166 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.948289 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.948512 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.948600 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.948814 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.948900 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.949121 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.949218 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.949428 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.949522 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.949734 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.949825 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.950040 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.950135 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.950345 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.950434 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.950653 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.950747 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.951005 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.951096 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.951311 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.951398 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.951619 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.951709 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.951925 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.952019 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.952234 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.952394 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.952568 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.952667 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.952873 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.952968 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.953175 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.953261 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.953496 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.953585 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.953828 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.954450 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.954659 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.954776 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.954965 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.955237 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.955324 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.955554 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.955641 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.955856 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.955942 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.956166 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.956307 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.956503 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.956621 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.956817 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.956930 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.957129 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.957225 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.957464 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.957555 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.957775 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.957862 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.958087 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.958225 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.958398 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.958494 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.958713 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.958810 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.959021 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.959107 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.959349 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.959444 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.959669 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.959776 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.959976 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.960063 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.960312 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.960401 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.960614 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.960720 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.960922 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.961009 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.961240 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.961326 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.961542 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.961687 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.961842 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.962014 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.962185 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.962333 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.962507 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.962641 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.962808 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.962952 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.963125 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.963265 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.963537 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.963625 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.963844 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.963930 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.964146 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.964260 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.964582 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.964671 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.964888 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.964984 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.965194 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.965290 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.965512 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.965608 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.965818 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.965911 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.966124 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.966221 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.966425 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.966550 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.966733 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.966831 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.967040 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.967140 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.967346 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.967432 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.967654 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.967740 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.967960 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.968055 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.968299 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.968402 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.968591 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.968677 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.968911 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.969008 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.969230 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.969331 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.969561 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.969789 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.969876 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.970217 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.970304 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.970534 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.970622 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.970851 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.970938 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.971177 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.971274 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.971496 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.971582 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.971799 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.971886 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.972102 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.972205 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.972465 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.972552 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.972778 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.972865 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.973096 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.973193 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.973417 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.973505 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.973719 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.973806 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.974028 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.974124 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.974333 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.974426 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.974634 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.974720 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.974937 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.975031 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.975237 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.975324 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.975556 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.975644 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.975857 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.975987 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.976177 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.976337 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.976512 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.976651 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.976831 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.976977 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.977150 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.977303 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.977455 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.977611 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.977774 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.977919 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.978081 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.978233 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.978388 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.978564 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.978689 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.978874 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.978991 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.979199 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.979330 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.979508 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.979633 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.979830 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.979949 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.980188 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.980302 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.980483 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.980628 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.980791 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.980937 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.981097 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.981266 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.981420 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.981590 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.981725 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.981903 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.982051 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.982218 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.982366 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.982539 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.982693 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.982840 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.983018 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.983140 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.983325 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.983446 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.983648 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.983735 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.983959 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.984056 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.984305 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.984396 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.984614 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.984701 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.984925 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.985084 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.985232 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.985329 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.985526 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.985615 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.985846 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.985934 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.986148 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.986243 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.986466 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.986552 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.986896 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.987006 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.987089 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.987169 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.987361 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.987522 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.987661 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.987842 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.988002 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.988161 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.988347 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.988512 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.988673 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.988821 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.988981 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.989125 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.989301 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.989436 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.989616 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.989769 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.989929 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.990076 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.990246 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.990380 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.990556 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.990688 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.990868 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.990992 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.991184 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.991281 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.991497 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.991605 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.991804 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.991928 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.992116 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.992233 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.992450 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.992576 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.992765 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.992887 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.993193 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.993316 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.993499 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.993641 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.993802 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.993952 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.994167 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.994256 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.994472 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.994567 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.994797 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.994892 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.995115 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.995204 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.995435 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.995531 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.995739 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.995871 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.996044 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.996131 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.996380 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.996470 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.996696 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.996796 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.997011 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.997098 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.997326 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.997413 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.997641 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.997737 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.997951 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.998038 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.998265 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.998352 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.998575 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.998674 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.998888 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.998975 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.999241 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.999596 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.999696 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.999785 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:09.999873 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.000076 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.000164 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.000416 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.000529 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.001264 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.001366 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.001578 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.001848 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.001948 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.002182 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.002269 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.002491 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.002578 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.002799 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.002895 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.003106 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.003194 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.003417 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.003504 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.003728 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.003894 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.004048 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.004136 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.004400 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.004537 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.004714 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.004810 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.005024 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.005111 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.005333 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.005419 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.005644 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.005731 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.005979 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.006156 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.006358 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.006457 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.006677 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.006771 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.007022 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.007139 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.007363 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.007464 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.007701 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.007795 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.008019 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.008107 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.008374 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.008477 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.008691 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.008776 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.008992 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.009087 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.009298 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.009393 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.009600 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.009686 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.009901 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.009987 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.010217 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.010303 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.010523 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.010609 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.010824 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.010911 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.011139 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.011229 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.011445 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.011530 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.011776 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.011974 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.012115 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.012352 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.012476 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.012671 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.012996 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.013099 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.013312 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.013407 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.013625 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.013710 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.013933 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.014028 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.014256 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.014343 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.014562 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.014651 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.014867 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.014963 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.015180 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.015266 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.015490 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.015584 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.015792 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.015897 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.016094 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.016182 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.017038 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.017138 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.017354 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.017492 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.017660 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.017749 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.017974 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.018061 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.018279 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.018367 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.018603 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.018689 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.018908 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.018996 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.019213 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.019501 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.019590 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.019812 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.019898 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.020118 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.020214 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.020446 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.020535 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.020750 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.020838 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.021053 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.021141 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.021362 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.021458 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.021665 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.021759 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.021973 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.022068 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.022274 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.022373 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.022580 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.022668 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.022880 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.023005 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.023187 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.023283 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.023491 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.023578 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.023800 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.023888 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.024103 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.024190 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.024432 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.024529 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.024746 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.024834 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.025051 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.025139 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.025370 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.025472 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.025676 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.025762 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.025982 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.026068 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.026286 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.026382 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.026596 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.026682 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.026902 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.027137 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.027268 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.027470 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.027567 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.027789 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.027884 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.028099 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.028195 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.028447 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.028537 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.028760 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.028846 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.029064 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.029160 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.029367 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.029462 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.029690 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.029786 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.030000 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.030096 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.030306 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.030391 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.030612 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.030697 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.030920 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.031015 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.031490 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.031578 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.031797 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.031915 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.032183 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.032341 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.032520 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.032609 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.032828 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.032923 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.033138 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.033226 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.033446 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.033533 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.033753 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.033840 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.034059 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.034313 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.034402 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.034650 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.034738 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.034972 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.035069 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.035286 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.035384 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.035599 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.035686 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.035913 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.036001 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.036218 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.036372 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.036549 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.036636 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.036856 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.036942 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.037163 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.037250 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.037471 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.037557 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.037783 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.037878 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.038096 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.038182 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.038410 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.038507 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.038712 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.038805 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.039027 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.039120 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.039339 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.039436 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.039658 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.039745 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.039971 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.040058 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.040306 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.040410 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.040695 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.040798 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.040936 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.041026 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.041244 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.041333 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.041560 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.041648 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.041868 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.041963 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.042195 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.042284 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.042511 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.042599 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.042830 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.042918 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.043150 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.043238 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.043453 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.043547 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.043755 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.043852 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.044057 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.044144 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.044395 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.044485 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.044712 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.044813 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.045019 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.045106 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.045318 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.045405 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.045618 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.045714 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.045924 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.046094 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.046225 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.046409 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.046514 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.046732 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.046828 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.047054 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.047149 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.047365 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.047461 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.047717 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.047885 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.048021 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.048109 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.048350 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.048461 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.048652 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.048783 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.048951 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.049112 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.049252 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.049445 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.049543 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.049793 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.049880 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.050127 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.050223 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.050426 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.050519 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.050727 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.050813 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.051026 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.051122 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.051340 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.051427 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.051714 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.051816 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.051972 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.052071 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.052305 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.052407 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.052615 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.052702 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.052922 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.053011 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.053224 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.053312 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.053527 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.053612 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.053850 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.053935 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.054206 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.054299 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.054462 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.054549 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.054785 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.054872 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.055089 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.055175 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.055395 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.055491 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.055704 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.055792 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.056009 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.056096 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.056342 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.056445 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.056650 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.056737 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.056971 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.057065 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.057293 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.057390 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.057594 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.057681 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.057897 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.057982 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.058204 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.058300 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.058508 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.058604 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.058824 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.058910 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.059178 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.059518 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.059863 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.060185 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.060538 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.060872 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.061198 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.061521 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.061837 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.062147 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.062483 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.062797 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.063112 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.063897 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.063996 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.064348 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.064453 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.064658 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.064826 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.064973 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.065170 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.065326 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.065658 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.065791 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.066043 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.066237 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.066326 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.066578 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.066708 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.066915 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.067074 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.067239 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.067327 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.067552 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.067682 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.067882 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.067978 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.068191 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.068309 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.068532 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.068633 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.068844 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.068933 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.069159 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.069249 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.069473 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.069573 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.069790 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.069878 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.070105 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.070203 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.070446 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.070554 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.070755 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.070843 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.071071 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.071271 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.071402 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.071505 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.071729 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.071817 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.072037 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.072123 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.072310 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=113418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 10 17:38:10.072402 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.072703 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.073053 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.073370 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.073716 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.074048 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.074363 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.074678 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.074987 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:38:10.075234 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=113419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 10 17:38:10.227027 n-d-852296-2 devstack@n-api.service[113418]: INFO dbcounter [None req-fc6ea5f7-62da-4299-8bec-268fdbcab875 None None] Registered counter for database nova_api Aug 10 17:38:10.234603 n-d-852296-2 devstack@n-api.service[113419]: INFO dbcounter [None req-72166c2c-971b-4ee0-889b-68fc9d4aa1c5 None None] Registered counter for database nova_api Aug 10 17:38:10.247309 n-d-852296-2 devstack@n-api.service[113418]: DEBUG oslo_db.sqlalchemy.engines [None req-fc6ea5f7-62da-4299-8bec-268fdbcab875 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=113418) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 17:38:10.254682 n-d-852296-2 devstack@n-api.service[113418]: DEBUG dbcounter [-] [113418] Writer thread running {{(pid=113418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 17:38:10.256394 n-d-852296-2 devstack@n-api.service[113419]: DEBUG oslo_db.sqlalchemy.engines [None req-72166c2c-971b-4ee0-889b-68fc9d4aa1c5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=113419) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 17:38:10.263078 n-d-852296-2 devstack@n-api.service[113419]: DEBUG dbcounter [-] [113419] Writer thread running {{(pid=113419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 17:38:10.310572 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.context [None req-fc6ea5f7-62da-4299-8bec-268fdbcab875 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),eb80cdf1-5ac7-4611-abc6-59802fe86dfd(cell1) {{(pid=113418) load_cells /opt/stack/nova/nova/context.py:464}} Aug 10 17:38:10.315158 n-d-852296-2 devstack@n-api.service[113418]: DEBUG oslo_concurrency.lockutils [None req-fc6ea5f7-62da-4299-8bec-268fdbcab875 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=113418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:38:10.315626 n-d-852296-2 devstack@n-api.service[113418]: DEBUG oslo_concurrency.lockutils [None req-fc6ea5f7-62da-4299-8bec-268fdbcab875 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=113418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:38:10.317205 n-d-852296-2 devstack@n-api.service[113418]: DEBUG oslo_concurrency.lockutils [None req-fc6ea5f7-62da-4299-8bec-268fdbcab875 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=113418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:38:10.317931 n-d-852296-2 devstack@n-api.service[113418]: DEBUG oslo_concurrency.lockutils [None req-fc6ea5f7-62da-4299-8bec-268fdbcab875 None None] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=113418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:38:10.318371 n-d-852296-2 devstack@n-api.service[113418]: DEBUG oslo_concurrency.lockutils [None req-fc6ea5f7-62da-4299-8bec-268fdbcab875 None None] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:38:10.320375 n-d-852296-2 devstack@n-api.service[113418]: DEBUG oslo_concurrency.lockutils [None req-fc6ea5f7-62da-4299-8bec-268fdbcab875 None None] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=113418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:38:10.320993 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.context [None req-72166c2c-971b-4ee0-889b-68fc9d4aa1c5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),eb80cdf1-5ac7-4611-abc6-59802fe86dfd(cell1) {{(pid=113419) load_cells /opt/stack/nova/nova/context.py:464}} Aug 10 17:38:10.322469 n-d-852296-2 devstack@n-api.service[113418]: INFO dbcounter [None req-fc6ea5f7-62da-4299-8bec-268fdbcab875 None None] Registered counter for database nova_cell0 Aug 10 17:38:10.324995 n-d-852296-2 devstack@n-api.service[113419]: DEBUG oslo_concurrency.lockutils [None req-72166c2c-971b-4ee0-889b-68fc9d4aa1c5 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=113419) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:38:10.325474 n-d-852296-2 devstack@n-api.service[113419]: DEBUG oslo_concurrency.lockutils [None req-72166c2c-971b-4ee0-889b-68fc9d4aa1c5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=113419) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:38:10.327153 n-d-852296-2 devstack@n-api.service[113419]: DEBUG oslo_concurrency.lockutils [None req-72166c2c-971b-4ee0-889b-68fc9d4aa1c5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=113419) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:38:10.327883 n-d-852296-2 devstack@n-api.service[113419]: DEBUG oslo_concurrency.lockutils [None req-72166c2c-971b-4ee0-889b-68fc9d4aa1c5 None None] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=113419) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:38:10.327984 n-d-852296-2 devstack@n-api.service[113418]: INFO dbcounter [None req-fc6ea5f7-62da-4299-8bec-268fdbcab875 None None] Registered counter for database nova_cell1 Aug 10 17:38:10.328390 n-d-852296-2 devstack@n-api.service[113419]: DEBUG oslo_concurrency.lockutils [None req-72166c2c-971b-4ee0-889b-68fc9d4aa1c5 None None] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113419) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:38:10.330790 n-d-852296-2 devstack@n-api.service[113419]: DEBUG oslo_concurrency.lockutils [None req-72166c2c-971b-4ee0-889b-68fc9d4aa1c5 None None] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=113419) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:38:10.332861 n-d-852296-2 devstack@n-api.service[113419]: INFO dbcounter [None req-72166c2c-971b-4ee0-889b-68fc9d4aa1c5 None None] Registered counter for database nova_cell0 Aug 10 17:38:10.335976 n-d-852296-2 devstack@n-api.service[113418]: DEBUG oslo_db.sqlalchemy.engines [None req-fc6ea5f7-62da-4299-8bec-268fdbcab875 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=113418) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 17:38:10.337775 n-d-852296-2 devstack@n-api.service[113418]: DEBUG oslo_db.sqlalchemy.engines [None req-fc6ea5f7-62da-4299-8bec-268fdbcab875 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=113418) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 17:38:10.338754 n-d-852296-2 devstack@n-api.service[113419]: INFO dbcounter [None req-72166c2c-971b-4ee0-889b-68fc9d4aa1c5 None None] Registered counter for database nova_cell1 Aug 10 17:38:10.343259 n-d-852296-2 devstack@n-api.service[113418]: DEBUG dbcounter [-] [113418] Writer thread running {{(pid=113418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 17:38:10.347220 n-d-852296-2 devstack@n-api.service[113419]: DEBUG oslo_db.sqlalchemy.engines [None req-72166c2c-971b-4ee0-889b-68fc9d4aa1c5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=113419) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 17:38:10.349004 n-d-852296-2 devstack@n-api.service[113418]: DEBUG dbcounter [-] [113418] Writer thread running {{(pid=113418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 17:38:10.349677 n-d-852296-2 devstack@n-api.service[113419]: DEBUG oslo_db.sqlalchemy.engines [None req-72166c2c-971b-4ee0-889b-68fc9d4aa1c5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=113419) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 17:38:10.354255 n-d-852296-2 devstack@n-api.service[113419]: DEBUG dbcounter [-] [113419] Writer thread running {{(pid=113419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 17:38:10.489898 n-d-852296-2 devstack@n-api.service[113418]: INFO dbcounter [None req-fc6ea5f7-62da-4299-8bec-268fdbcab875 None None] Registered counter for database nova_cell0 Aug 10 17:38:10.493422 n-d-852296-2 devstack@n-api.service[113419]: DEBUG dbcounter [-] [113419] Writer thread running {{(pid=113419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 17:38:10.499256 n-d-852296-2 devstack@n-api.service[113418]: DEBUG oslo_db.sqlalchemy.engines [None req-fc6ea5f7-62da-4299-8bec-268fdbcab875 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=113418) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 17:38:10.504480 n-d-852296-2 devstack@n-api.service[113419]: INFO dbcounter [None req-72166c2c-971b-4ee0-889b-68fc9d4aa1c5 None None] Registered counter for database nova_cell0 Aug 10 17:38:10.507349 n-d-852296-2 devstack@n-api.service[113418]: DEBUG dbcounter [-] [113418] Writer thread running {{(pid=113418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 17:38:10.513840 n-d-852296-2 devstack@n-api.service[113419]: DEBUG oslo_db.sqlalchemy.engines [None req-72166c2c-971b-4ee0-889b-68fc9d4aa1c5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=113419) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 17:38:10.518691 n-d-852296-2 devstack@n-api.service[113419]: DEBUG dbcounter [-] [113419] Writer thread running {{(pid=113419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 17:38:10.958971 n-d-852296-2 devstack@n-api.service[113418]: WARNING keystonemiddleware.auth_token [None req-fc6ea5f7-62da-4299-8bec-268fdbcab875 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 17:38:10.961898 n-d-852296-2 devstack@n-api.service[113419]: WARNING keystonemiddleware.auth_token [None req-72166c2c-971b-4ee0-889b-68fc9d4aa1c5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 17:38:10.966395 n-d-852296-2 devstack@n-api.service[113418]: WARNING keystonemiddleware.auth_token [None req-fc6ea5f7-62da-4299-8bec-268fdbcab875 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 17:38:10.969048 n-d-852296-2 devstack@n-api.service[113419]: WARNING keystonemiddleware.auth_token [None req-72166c2c-971b-4ee0-889b-68fc9d4aa1c5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 17:38:11.308036 n-d-852296-2 devstack@n-api.service[113419]: WARNING keystonemiddleware.auth_token [None req-72166c2c-971b-4ee0-889b-68fc9d4aa1c5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 17:38:11.315773 n-d-852296-2 devstack@n-api.service[113419]: WARNING keystonemiddleware.auth_token [None req-72166c2c-971b-4ee0-889b-68fc9d4aa1c5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 17:38:11.317387 n-d-852296-2 devstack@n-api.service[113418]: WARNING keystonemiddleware.auth_token [None req-fc6ea5f7-62da-4299-8bec-268fdbcab875 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 17:38:11.321012 n-d-852296-2 devstack@n-api.service[113419]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56547872a9c0 pid: 113419 (default app) Aug 10 17:38:11.323088 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi [None req-72166c2c-971b-4ee0-889b-68fc9d4aa1c5 None None] Calling method '>' {{(pid=113419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:38:11.323475 n-d-852296-2 devstack@n-api.service[113418]: WARNING keystonemiddleware.auth_token [None req-fc6ea5f7-62da-4299-8bec-268fdbcab875 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 17:38:11.324305 n-d-852296-2 devstack@n-api.service[113419]: INFO nova.api.openstack.requestlog [None req-72166c2c-971b-4ee0-889b-68fc9d4aa1c5 None None] 10.222.0.50 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001722 Aug 10 17:38:11.324710 n-d-852296-2 devstack@n-api.service[113419]: [pid: 113419|app: 0|req: 1/1] 10.222.0.50 () {50 vars in 788 bytes} [Wed Aug 10 17:38:11 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:38:11.328821 n-d-852296-2 devstack@n-api.service[113418]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56547872a9c0 pid: 113418 (default app) Aug 10 17:39:33.376029 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi [None req-72166c2c-971b-4ee0-889b-68fc9d4aa1c5 None None] Calling method '>' {{(pid=113419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:39:33.377705 n-d-852296-2 devstack@n-api.service[113419]: INFO nova.api.openstack.requestlog [None req-72166c2c-971b-4ee0-889b-68fc9d4aa1c5 None None] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002017 Aug 10 17:39:33.378936 n-d-852296-2 devstack@n-api.service[113419]: [pid: 113419|app: 0|req: 2/2] 10.222.0.50 () {54 vars in 931 bytes} [Wed Aug 10 17:39:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:39:33.396988 n-d-852296-2 devstack@n-api.service[113418]: DEBUG dbcounter [-] [113418] Writing DB stats nova_api:SELECT=3 {{(pid=113418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:39:33.397944 n-d-852296-2 devstack@n-api.service[113418]: DEBUG dbcounter [-] [113418] Writing DB stats nova_cell1:SELECT=3 {{(pid=113418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:39:33.398858 n-d-852296-2 devstack@n-api.service[113418]: DEBUG dbcounter [-] [113418] Writing DB stats nova_cell0:SELECT=3 {{(pid=113418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:39:33.399881 n-d-852296-2 devstack@n-api.service[113418]: DEBUG dbcounter [-] [113418] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=113418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:39:34.280150 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi [None req-24bc2380-eb1d-48c9-8366-05ad90146a3d admin admin] Calling method '>' {{(pid=113418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:39:34.312863 n-d-852296-2 devstack@n-api.service[113418]: INFO nova.api.openstack.requestlog [None req-24bc2380-eb1d-48c9-8366-05ad90146a3d admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.926396 Aug 10 17:39:34.324307 n-d-852296-2 devstack@n-api.service[113418]: [pid: 113418|app: 0|req: 1/3] 10.222.0.50 () {60 vars in 1292 bytes} [Wed Aug 10 17:39:33 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:39:36.542056 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi [None req-72166c2c-971b-4ee0-889b-68fc9d4aa1c5 None None] Calling method '>' {{(pid=113419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:39:36.543202 n-d-852296-2 devstack@n-api.service[113419]: INFO nova.api.openstack.requestlog [None req-72166c2c-971b-4ee0-889b-68fc9d4aa1c5 None None] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001570 Aug 10 17:39:36.543853 n-d-852296-2 devstack@n-api.service[113419]: [pid: 113419|app: 0|req: 3/4] 10.222.0.50 () {54 vars in 931 bytes} [Wed Aug 10 17:39:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:39:36.996829 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi [None req-e271b8e3-6b8b-47df-911c-57fc192ef308 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 1, "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 1, "id": "c1", "name": "cirros256"}} {{(pid=113418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:39:37.025042 n-d-852296-2 devstack@n-api.service[113418]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:39:37.025042 n-d-852296-2 devstack@n-api.service[113418]: warnings.warn(msg) Aug 10 17:39:37.179015 n-d-852296-2 devstack@n-api.service[113418]: INFO nova.api.openstack.requestlog [None req-e271b8e3-6b8b-47df-911c-57fc192ef308 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.627568 Aug 10 17:39:37.179778 n-d-852296-2 devstack@n-api.service[113418]: [pid: 113418|app: 0|req: 2/5] 10.222.0.50 () {64 vars in 1283 bytes} [Wed Aug 10 17:39:36 2022] POST /compute/v2.1/flavors => generated 407 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 17:39:37.410537 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi [None req-59888849-eb69-4f2f-a4de-064b821457d2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=113419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:39:37.414952 n-d-852296-2 devstack@n-api.service[113419]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:39:37.414952 n-d-852296-2 devstack@n-api.service[113419]: warnings.warn(msg) Aug 10 17:39:37.417638 n-d-852296-2 devstack@n-api.service[113419]: DEBUG dbcounter [-] [113419] Writing DB stats nova_api:SELECT=3 {{(pid=113419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:39:37.418439 n-d-852296-2 devstack@n-api.service[113419]: DEBUG dbcounter [-] [113419] Writing DB stats nova_cell0:SELECT=3 {{(pid=113419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:39:37.419402 n-d-852296-2 devstack@n-api.service[113419]: DEBUG dbcounter [-] [113419] Writing DB stats nova_cell1:SELECT=3 {{(pid=113419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:39:37.420950 n-d-852296-2 devstack@n-api.service[113419]: DEBUG dbcounter [-] [113419] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=113419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:39:37.655370 n-d-852296-2 devstack@n-api.service[113419]: INFO nova.api.openstack.requestlog [None req-59888849-eb69-4f2f-a4de-064b821457d2 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.465017 Aug 10 17:39:37.656558 n-d-852296-2 devstack@n-api.service[113419]: [pid: 113419|app: 0|req: 4/6] 10.222.0.50 () {64 vars in 1336 bytes} [Wed Aug 10 17:39:37 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:39:39.965854 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi [None req-e271b8e3-6b8b-47df-911c-57fc192ef308 admin admin] Calling method '>' {{(pid=113418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:39:39.966956 n-d-852296-2 devstack@n-api.service[113418]: INFO nova.api.openstack.requestlog [None req-e271b8e3-6b8b-47df-911c-57fc192ef308 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001551 Aug 10 17:39:39.967991 n-d-852296-2 devstack@n-api.service[113418]: [pid: 113418|app: 0|req: 3/7] 10.222.0.50 () {54 vars in 931 bytes} [Wed Aug 10 17:39:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:39:40.713008 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi [None req-4378bcbf-92e9-4223-88e4-559cc74ffb7f admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "vcpus": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "ds512M", "ram": 512, "swap": 0, "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=113419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:39:40.732639 n-d-852296-2 devstack@n-api.service[113419]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:39:40.732639 n-d-852296-2 devstack@n-api.service[113419]: warnings.warn(msg) Aug 10 17:39:40.815586 n-d-852296-2 devstack@n-api.service[113419]: INFO nova.api.openstack.requestlog [None req-4378bcbf-92e9-4223-88e4-559cc74ffb7f admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.840496 Aug 10 17:39:40.830292 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi [None req-dc3772ac-6925-4e8a-bc94-bf1a0ae72782 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=113418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:39:40.833857 n-d-852296-2 devstack@n-api.service[113418]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:39:40.833857 n-d-852296-2 devstack@n-api.service[113418]: warnings.warn(msg) Aug 10 17:39:40.835243 n-d-852296-2 devstack@n-api.service[113419]: [pid: 113419|app: 0|req: 5/8] 10.222.0.50 () {64 vars in 1283 bytes} [Wed Aug 10 17:39:39 2022] POST /compute/v2.1/flavors => generated 404 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 17:39:40.925224 n-d-852296-2 devstack@n-api.service[113418]: INFO nova.api.openstack.requestlog [None req-dc3772ac-6925-4e8a-bc94-bf1a0ae72782 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.099636 Aug 10 17:39:40.935425 n-d-852296-2 devstack@n-api.service[113418]: [pid: 113418|app: 0|req: 4/9] 10.222.0.50 () {64 vars in 1336 bytes} [Wed Aug 10 17:39:40 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:39:43.425616 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi [None req-4378bcbf-92e9-4223-88e4-559cc74ffb7f admin admin] Calling method '>' {{(pid=113419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:39:43.430031 n-d-852296-2 devstack@n-api.service[113419]: INFO nova.api.openstack.requestlog [None req-4378bcbf-92e9-4223-88e4-559cc74ffb7f admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Aug 10 17:39:43.430031 n-d-852296-2 devstack@n-api.service[113419]: [pid: 113419|app: 0|req: 6/10] 10.222.0.50 () {54 vars in 931 bytes} [Wed Aug 10 17:39:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:39:43.934124 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi [None req-1d56b372-8d6e-4d6c-b043-b2c27cf3702b admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 10, "os-flavor-access:is_public": true, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "id": "d2", "vcpus": 1, "swap": 0}} {{(pid=113418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:39:44.038389 n-d-852296-2 devstack@n-api.service[113418]: INFO nova.api.openstack.requestlog [None req-1d56b372-8d6e-4d6c-b043-b2c27cf3702b admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.604921 Aug 10 17:39:44.039651 n-d-852296-2 devstack@n-api.service[113418]: [pid: 113418|app: 0|req: 5/11] 10.222.0.50 () {64 vars in 1283 bytes} [Wed Aug 10 17:39:43 2022] POST /compute/v2.1/flavors => generated 404 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 17:39:44.051847 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi [None req-2af914b9-6d31-416e-b402-0f84fcddc46d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=113419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:39:44.139266 n-d-852296-2 devstack@n-api.service[113419]: INFO nova.api.openstack.requestlog [None req-2af914b9-6d31-416e-b402-0f84fcddc46d admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.090118 Aug 10 17:39:44.149175 n-d-852296-2 devstack@n-api.service[113419]: [pid: 113419|app: 0|req: 7/12] 10.222.0.50 () {64 vars in 1336 bytes} [Wed Aug 10 17:39:44 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:39:46.580202 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi [None req-1d56b372-8d6e-4d6c-b043-b2c27cf3702b admin admin] Calling method '>' {{(pid=113418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:39:46.581237 n-d-852296-2 devstack@n-api.service[113418]: INFO nova.api.openstack.requestlog [None req-1d56b372-8d6e-4d6c-b043-b2c27cf3702b admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 Aug 10 17:39:46.581647 n-d-852296-2 devstack@n-api.service[113418]: [pid: 113418|app: 0|req: 6/13] 10.222.0.50 () {54 vars in 931 bytes} [Wed Aug 10 17:39:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:39:46.974531 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi [None req-3a51779e-9d33-4448-a6df-a3ed0692384b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "id": "d3", "rxtx_factor": 1.0, "swap": 0, "vcpus": 2, "os-flavor-access:is_public": true, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048}} {{(pid=113419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:39:47.040415 n-d-852296-2 devstack@n-api.service[113419]: INFO nova.api.openstack.requestlog [None req-3a51779e-9d33-4448-a6df-a3ed0692384b admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.452326 Aug 10 17:39:47.040898 n-d-852296-2 devstack@n-api.service[113419]: [pid: 113419|app: 0|req: 8/14] 10.222.0.50 () {64 vars in 1283 bytes} [Wed Aug 10 17:39:46 2022] POST /compute/v2.1/flavors => generated 404 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 17:39:47.053684 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi [None req-37928790-c068-498a-8d7c-6e7b8ca06377 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=113418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:39:47.172936 n-d-852296-2 devstack@n-api.service[113418]: INFO nova.api.openstack.requestlog [None req-37928790-c068-498a-8d7c-6e7b8ca06377 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.119857 Aug 10 17:39:47.172936 n-d-852296-2 devstack@n-api.service[113418]: [pid: 113418|app: 0|req: 7/15] 10.222.0.50 () {64 vars in 1336 bytes} [Wed Aug 10 17:39:47 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:39:49.512105 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi [None req-3a51779e-9d33-4448-a6df-a3ed0692384b admin admin] Calling method '>' {{(pid=113419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:39:49.513207 n-d-852296-2 devstack@n-api.service[113419]: INFO nova.api.openstack.requestlog [None req-3a51779e-9d33-4448-a6df-a3ed0692384b admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001563 Aug 10 17:39:49.514199 n-d-852296-2 devstack@n-api.service[113419]: [pid: 113419|app: 0|req: 9/16] 10.222.0.50 () {54 vars in 931 bytes} [Wed Aug 10 17:39:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:39:50.061683 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi [None req-cd962d6a-1e97-4005-a98d-f4053a49eff6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "name": "ds4G", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 20, "ram": 4096, "id": "d4", "swap": 0}} {{(pid=113418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:39:50.138350 n-d-852296-2 devstack@n-api.service[113418]: INFO nova.api.openstack.requestlog [None req-cd962d6a-1e97-4005-a98d-f4053a49eff6 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.617882 Aug 10 17:39:50.139085 n-d-852296-2 devstack@n-api.service[113418]: [pid: 113418|app: 0|req: 8/17] 10.222.0.50 () {64 vars in 1283 bytes} [Wed Aug 10 17:39:49 2022] POST /compute/v2.1/flavors => generated 404 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 17:39:50.150971 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi [None req-1e3daced-e130-459b-b157-2a5df6c68add admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=113419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:39:50.221956 n-d-852296-2 devstack@n-api.service[113419]: INFO nova.api.openstack.requestlog [None req-1e3daced-e130-459b-b157-2a5df6c68add admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.074565 Aug 10 17:39:50.222537 n-d-852296-2 devstack@n-api.service[113419]: [pid: 113419|app: 0|req: 10/18] 10.222.0.50 () {64 vars in 1336 bytes} [Wed Aug 10 17:39:50 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:39:52.545778 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi [None req-cd962d6a-1e97-4005-a98d-f4053a49eff6 admin admin] Calling method '>' {{(pid=113418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:39:52.547475 n-d-852296-2 devstack@n-api.service[113418]: INFO nova.api.openstack.requestlog [None req-cd962d6a-1e97-4005-a98d-f4053a49eff6 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002392 Aug 10 17:39:52.553485 n-d-852296-2 devstack@n-api.service[113418]: [pid: 113418|app: 0|req: 9/19] 10.222.0.50 () {54 vars in 931 bytes} [Wed Aug 10 17:39:52 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:39:53.098631 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi [None req-8fc3367c-7dc0-4904-a9ee-872899904151 admin admin] Calling method '>' {{(pid=113419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:39:53.125623 n-d-852296-2 devstack@n-api.service[113419]: INFO nova.api.openstack.requestlog [None req-8fc3367c-7dc0-4904-a9ee-872899904151 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.570200 Aug 10 17:39:53.140955 n-d-852296-2 devstack@n-api.service[113419]: [pid: 113419|app: 0|req: 11/20] 10.222.0.50 () {60 vars in 1292 bytes} [Wed Aug 10 17:39:52 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 17:39:55.391691 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi [None req-cd962d6a-1e97-4005-a98d-f4053a49eff6 admin admin] Calling method '>' {{(pid=113418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:39:55.392725 n-d-852296-2 devstack@n-api.service[113418]: INFO nova.api.openstack.requestlog [None req-cd962d6a-1e97-4005-a98d-f4053a49eff6 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Aug 10 17:39:55.393127 n-d-852296-2 devstack@n-api.service[113418]: [pid: 113418|app: 0|req: 10/21] 10.222.0.50 () {54 vars in 931 bytes} [Wed Aug 10 17:39:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:39:55.856391 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi [None req-43b0186a-6468-42e8-9e11-30d3d4686128 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "m1.tiny", "swap": 0, "os-flavor-access:is_public": true, "vcpus": 1, "id": "1"}} {{(pid=113419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:39:55.944040 n-d-852296-2 devstack@n-api.service[113419]: INFO nova.api.openstack.requestlog [None req-43b0186a-6468-42e8-9e11-30d3d4686128 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.542840 Aug 10 17:39:55.944702 n-d-852296-2 devstack@n-api.service[113419]: [pid: 113419|app: 0|req: 12/22] 10.222.0.50 () {64 vars in 1283 bytes} [Wed Aug 10 17:39:55 2022] POST /compute/v2.1/flavors => generated 402 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 17:39:55.958490 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi [None req-0137d9cb-bfc1-4347-b857-7859b309f3d5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=113418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:39:56.050598 n-d-852296-2 devstack@n-api.service[113418]: INFO nova.api.openstack.requestlog [None req-0137d9cb-bfc1-4347-b857-7859b309f3d5 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.096164 Aug 10 17:39:56.051049 n-d-852296-2 devstack@n-api.service[113418]: [pid: 113418|app: 0|req: 11/23] 10.222.0.50 () {64 vars in 1333 bytes} [Wed Aug 10 17:39:55 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:39:58.311805 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi [None req-43b0186a-6468-42e8-9e11-30d3d4686128 admin admin] Calling method '>' {{(pid=113419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:39:58.312870 n-d-852296-2 devstack@n-api.service[113419]: INFO nova.api.openstack.requestlog [None req-43b0186a-6468-42e8-9e11-30d3d4686128 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002023 Aug 10 17:39:58.313272 n-d-852296-2 devstack@n-api.service[113419]: [pid: 113419|app: 0|req: 13/24] 10.222.0.50 () {54 vars in 931 bytes} [Wed Aug 10 17:39:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:39:58.761298 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi [None req-b8508381-84ef-4060-8491-b2e48770e779 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "disk": 20, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "id": "2", "os-flavor-access:is_public": true, "vcpus": 1, "swap": 0}} {{(pid=113418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:39:58.863409 n-d-852296-2 devstack@n-api.service[113418]: INFO nova.api.openstack.requestlog [None req-b8508381-84ef-4060-8491-b2e48770e779 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.542709 Aug 10 17:39:58.863990 n-d-852296-2 devstack@n-api.service[113418]: [pid: 113418|app: 0|req: 12/25] 10.222.0.50 () {64 vars in 1283 bytes} [Wed Aug 10 17:39:58 2022] POST /compute/v2.1/flavors => generated 405 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 17:39:58.877441 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi [None req-625a702a-fd72-4206-9290-fd2d75e89007 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=113419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:39:58.980803 n-d-852296-2 devstack@n-api.service[113419]: INFO nova.api.openstack.requestlog [None req-625a702a-fd72-4206-9290-fd2d75e89007 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.108191 Aug 10 17:39:58.981389 n-d-852296-2 devstack@n-api.service[113419]: [pid: 113419|app: 0|req: 14/26] 10.222.0.50 () {64 vars in 1333 bytes} [Wed Aug 10 17:39:58 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:40:01.221295 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi [None req-b8508381-84ef-4060-8491-b2e48770e779 admin admin] Calling method '>' {{(pid=113418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:40:01.222346 n-d-852296-2 devstack@n-api.service[113418]: INFO nova.api.openstack.requestlog [None req-b8508381-84ef-4060-8491-b2e48770e779 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Aug 10 17:40:01.222759 n-d-852296-2 devstack@n-api.service[113418]: [pid: 113418|app: 0|req: 13/27] 10.222.0.50 () {54 vars in 931 bytes} [Wed Aug 10 17:40:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:40:01.632644 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi [None req-9b16f260-41d8-4139-ad78-89d19eeb7494 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "id": "3", "vcpus": 2, "rxtx_factor": 1.0, "disk": 40}} {{(pid=113419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:40:01.721100 n-d-852296-2 devstack@n-api.service[113419]: INFO nova.api.openstack.requestlog [None req-9b16f260-41d8-4139-ad78-89d19eeb7494 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.491881 Aug 10 17:40:01.721740 n-d-852296-2 devstack@n-api.service[113419]: [pid: 113419|app: 0|req: 15/28] 10.222.0.50 () {64 vars in 1283 bytes} [Wed Aug 10 17:40:01 2022] POST /compute/v2.1/flavors => generated 406 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 17:40:01.734382 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi [None req-0c816a12-b44d-4498-855f-db4eae70eeeb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=113418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:40:01.850346 n-d-852296-2 devstack@n-api.service[113418]: INFO nova.api.openstack.requestlog [None req-0c816a12-b44d-4498-855f-db4eae70eeeb admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.120230 Aug 10 17:40:01.850967 n-d-852296-2 devstack@n-api.service[113418]: [pid: 113418|app: 0|req: 14/29] 10.222.0.50 () {64 vars in 1333 bytes} [Wed Aug 10 17:40:01 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:40:04.135822 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi [None req-9b16f260-41d8-4139-ad78-89d19eeb7494 admin admin] Calling method '>' {{(pid=113419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:40:04.136934 n-d-852296-2 devstack@n-api.service[113419]: INFO nova.api.openstack.requestlog [None req-9b16f260-41d8-4139-ad78-89d19eeb7494 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001653 Aug 10 17:40:04.137546 n-d-852296-2 devstack@n-api.service[113419]: [pid: 113419|app: 0|req: 16/30] 10.222.0.50 () {54 vars in 931 bytes} [Wed Aug 10 17:40:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:40:04.567139 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi [None req-86ce1501-1816-4263-8aa3-1006a28aa7ea admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80, "ram": 8192, "rxtx_factor": 1.0, "name": "m1.large", "os-flavor-access:is_public": true, "id": "4", "vcpus": 4, "swap": 0}} {{(pid=113418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:40:04.572980 n-d-852296-2 devstack@n-api.service[113418]: DEBUG dbcounter [-] [113418] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=113418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:40:04.697538 n-d-852296-2 devstack@n-api.service[113418]: INFO nova.api.openstack.requestlog [None req-86ce1501-1816-4263-8aa3-1006a28aa7ea admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.551702 Aug 10 17:40:04.698044 n-d-852296-2 devstack@n-api.service[113418]: [pid: 113418|app: 0|req: 15/31] 10.222.0.50 () {64 vars in 1283 bytes} [Wed Aug 10 17:40:04 2022] POST /compute/v2.1/flavors => generated 405 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 17:40:04.711347 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi [None req-1a4d0d59-90cd-46bc-a5d8-28d5a90aef2d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=113419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:40:04.818742 n-d-852296-2 devstack@n-api.service[113419]: INFO nova.api.openstack.requestlog [None req-1a4d0d59-90cd-46bc-a5d8-28d5a90aef2d admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.111152 Aug 10 17:40:04.819397 n-d-852296-2 devstack@n-api.service[113419]: [pid: 113419|app: 0|req: 17/32] 10.222.0.50 () {64 vars in 1333 bytes} [Wed Aug 10 17:40:04 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:40:07.144468 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi [None req-86ce1501-1816-4263-8aa3-1006a28aa7ea admin admin] Calling method '>' {{(pid=113418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:40:07.144468 n-d-852296-2 devstack@n-api.service[113418]: INFO nova.api.openstack.requestlog [None req-86ce1501-1816-4263-8aa3-1006a28aa7ea admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001542 Aug 10 17:40:07.144468 n-d-852296-2 devstack@n-api.service[113418]: [pid: 113418|app: 0|req: 16/33] 10.222.0.50 () {54 vars in 931 bytes} [Wed Aug 10 17:40:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:40:07.589765 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi [None req-fbf5c4e1-ab2e-4f2a-a8cb-d2aa98414fd6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "disk": 160, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "5", "name": "m1.xlarge"}} {{(pid=113419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:40:07.663711 n-d-852296-2 devstack@n-api.service[113419]: DEBUG dbcounter [-] [113419] Writing DB stats nova_api:SELECT=46,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=113419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:40:07.670008 n-d-852296-2 devstack@n-api.service[113419]: INFO nova.api.openstack.requestlog [None req-fbf5c4e1-ab2e-4f2a-a8cb-d2aa98414fd6 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.518251 Aug 10 17:40:07.670941 n-d-852296-2 devstack@n-api.service[113419]: [pid: 113419|app: 0|req: 18/34] 10.222.0.50 () {64 vars in 1283 bytes} [Wed Aug 10 17:40:07 2022] POST /compute/v2.1/flavors => generated 408 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 17:40:07.683426 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi [None req-218ccad6-0981-4481-8301-550da3494d6c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=113418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:40:07.782077 n-d-852296-2 devstack@n-api.service[113418]: INFO nova.api.openstack.requestlog [None req-218ccad6-0981-4481-8301-550da3494d6c admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.102379 Aug 10 17:40:07.782779 n-d-852296-2 devstack@n-api.service[113418]: [pid: 113418|app: 0|req: 17/35] 10.222.0.50 () {64 vars in 1333 bytes} [Wed Aug 10 17:40:07 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:40:32.758877 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi [None req-fbf5c4e1-ab2e-4f2a-a8cb-d2aa98414fd6 admin admin] Calling method '>' {{(pid=113419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:40:32.764444 n-d-852296-2 devstack@n-api.service[113419]: INFO nova.api.openstack.requestlog [None req-fbf5c4e1-ab2e-4f2a-a8cb-d2aa98414fd6 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Aug 10 17:40:32.764444 n-d-852296-2 devstack@n-api.service[113419]: [pid: 113419|app: 0|req: 19/36] 10.222.0.50 () {54 vars in 931 bytes} [Wed Aug 10 17:40:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:40:33.153022 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi [None req-1647709f-cb45-43d6-bc08-64929732b354 admin admin] Calling method '>' {{(pid=113418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:40:33.172354 n-d-852296-2 devstack@n-api.service[113418]: INFO nova.api.openstack.requestlog [None req-1647709f-cb45-43d6-bc08-64929732b354 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.405711 Aug 10 17:40:33.172901 n-d-852296-2 devstack@n-api.service[113418]: [pid: 113418|app: 0|req: 18/37] 10.222.0.50 () {60 vars in 1292 bytes} [Wed Aug 10 17:40:32 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:40:34.255307 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi [None req-fbf5c4e1-ab2e-4f2a-a8cb-d2aa98414fd6 admin admin] Calling method '>' {{(pid=113419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:40:34.256352 n-d-852296-2 devstack@n-api.service[113419]: INFO nova.api.openstack.requestlog [None req-fbf5c4e1-ab2e-4f2a-a8cb-d2aa98414fd6 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Aug 10 17:40:34.256758 n-d-852296-2 devstack@n-api.service[113419]: [pid: 113419|app: 0|req: 20/38] 10.222.0.50 () {56 vars in 1074 bytes} [Wed Aug 10 17:40:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:40:34.801156 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi [None req-9bb03cbb-ce48-456e-847b-7dd9bb834166 admin admin] Calling method '>' {{(pid=113418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:40:34.806884 n-d-852296-2 devstack@n-api.service[113418]: INFO nova.api.openstack.wsgi [None req-9bb03cbb-ce48-456e-847b-7dd9bb834166 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 10 17:40:34.811211 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi [None req-9bb03cbb-ce48-456e-847b-7dd9bb834166 admin admin] Request method failure captured: Aug 10 17:40:34.811211 n-d-852296-2 devstack@n-api.service[113418]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 10 17:40:34.811211 n-d-852296-2 devstack@n-api.service[113418]: Accept: application/json Aug 10 17:40:34.811211 n-d-852296-2 devstack@n-api.service[113418]: Accept-Encoding: gzip, deflate Aug 10 17:40:34.811211 n-d-852296-2 devstack@n-api.service[113418]: Connection: keep-alive Aug 10 17:40:34.811211 n-d-852296-2 devstack@n-api.service[113418]: Content-Length: 0 Aug 10 17:40:34.811211 n-d-852296-2 devstack@n-api.service[113418]: Host: 10.222.0.50 Aug 10 17:40:34.811211 n-d-852296-2 devstack@n-api.service[113418]: Openstack-Api-Version: compute 2.90 Aug 10 17:40:34.811211 n-d-852296-2 devstack@n-api.service[113418]: Openstack-System-Scope: None Aug 10 17:40:34.811211 n-d-852296-2 devstack@n-api.service[113418]: User-Agent: python-novaclient Aug 10 17:40:34.811211 n-d-852296-2 devstack@n-api.service[113418]: X-Auth-Token: gAAAAABi8-2SQunuO5q1JytAXzE2Z8pwrqJOCPoIM21K3y1S655zvpXPZ6kSjIus9c6ogW8i0O5n88SnbPWmN_6NR_uBfq7PS4JXxB3YM4Z0GXHRN51VS1tuTXmlwRzKS82TTMWTuFauDLW1qd7GQTPTPHsQf8EG-Ts04_YFGYXFxDJjfeGyX0s Aug 10 17:40:34.811211 n-d-852296-2 devstack@n-api.service[113418]: X-Domain-Id: None Aug 10 17:40:34.811211 n-d-852296-2 devstack@n-api.service[113418]: X-Domain-Name: None Aug 10 17:40:34.811211 n-d-852296-2 devstack@n-api.service[113418]: X-Identity-Status: Confirmed Aug 10 17:40:34.811211 n-d-852296-2 devstack@n-api.service[113418]: X-Is-Admin-Project: True Aug 10 17:40:34.811211 n-d-852296-2 devstack@n-api.service[113418]: X-Openstack-Nova-Api-Version: 2.90 Aug 10 17:40:34.811211 n-d-852296-2 devstack@n-api.service[113418]: X-Project-Domain-Id: default Aug 10 17:40:34.811211 n-d-852296-2 devstack@n-api.service[113418]: X-Project-Domain-Name: Default Aug 10 17:40:34.811211 n-d-852296-2 devstack@n-api.service[113418]: X-Project-Id: de82af5b02764b529d7ffc4d95b6343f Aug 10 17:40:34.811211 n-d-852296-2 devstack@n-api.service[113418]: X-Project-Name: admin Aug 10 17:40:34.811211 n-d-852296-2 devstack@n-api.service[113418]: X-Role: reader,member,admin Aug 10 17:40:34.811211 n-d-852296-2 devstack@n-api.service[113418]: X-Roles: reader,member,admin Aug 10 17:40:34.812953 n-d-852296-2 devstack@n-api.service[113418]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/de82af5b02764b529d7ffc4d95b6343f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/de82af5b02764b529d7ffc4d95b6343f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/de82af5b02764b529d7ffc4d95b6343f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_de82af5b02764b529d7ffc4d95b6343f", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:40:34.812953 n-d-852296-2 devstack@n-api.service[113418]: X-Tenant: admin Aug 10 17:40:34.812953 n-d-852296-2 devstack@n-api.service[113418]: X-Tenant-Id: de82af5b02764b529d7ffc4d95b6343f Aug 10 17:40:34.812953 n-d-852296-2 devstack@n-api.service[113418]: X-Tenant-Name: admin Aug 10 17:40:34.812953 n-d-852296-2 devstack@n-api.service[113418]: X-User: admin Aug 10 17:40:34.812953 n-d-852296-2 devstack@n-api.service[113418]: X-User-Domain-Id: default Aug 10 17:40:34.812953 n-d-852296-2 devstack@n-api.service[113418]: X-User-Domain-Name: Default Aug 10 17:40:34.812953 n-d-852296-2 devstack@n-api.service[113418]: X-User-Id: e4b4229a3d284eec9a42f4e7d8d06b6c Aug 10 17:40:34.812953 n-d-852296-2 devstack@n-api.service[113418]: X-User-Name: admin Aug 10 17:40:34.812953 n-d-852296-2 devstack@n-api.service[113418]: method: > Aug 10 17:40:34.812953 n-d-852296-2 devstack@n-api.service[113418]: exception: Flavor 42 could not be found. Aug 10 17:40:34.812953 n-d-852296-2 devstack@n-api.service[113418]: action_args: {'id': '42'} Aug 10 17:40:34.812953 n-d-852296-2 devstack@n-api.service[113418]: {{(pid=113418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:40:34.812953 n-d-852296-2 devstack@n-api.service[113418]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:40:34.814040 n-d-852296-2 devstack@n-api.service[113418]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 10 17:40:34.814040 n-d-852296-2 devstack@n-api.service[113418]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 10 17:40:34.814040 n-d-852296-2 devstack@n-api.service[113418]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 10 17:40:34.814040 n-d-852296-2 devstack@n-api.service[113418]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 10 17:40:34.814040 n-d-852296-2 devstack@n-api.service[113418]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 17:40:34.814040 n-d-852296-2 devstack@n-api.service[113418]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 17:40:34.814040 n-d-852296-2 devstack@n-api.service[113418]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 10 17:40:34.814040 n-d-852296-2 devstack@n-api.service[113418]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 10 17:40:34.814040 n-d-852296-2 devstack@n-api.service[113418]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 10 17:40:34.814040 n-d-852296-2 devstack@n-api.service[113418]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:40:34.814040 n-d-852296-2 devstack@n-api.service[113418]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 10 17:40:34.814040 n-d-852296-2 devstack@n-api.service[113418]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 10 17:40:34.814040 n-d-852296-2 devstack@n-api.service[113418]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 10 17:40:34.814040 n-d-852296-2 devstack@n-api.service[113418]: ERROR nova.api.openstack.wsgi Aug 10 17:40:34.814040 n-d-852296-2 devstack@n-api.service[113418]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:40:34.814040 n-d-852296-2 devstack@n-api.service[113418]: ERROR nova.api.openstack.wsgi Aug 10 17:40:34.814040 n-d-852296-2 devstack@n-api.service[113418]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:40:34.814040 n-d-852296-2 devstack@n-api.service[113418]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:40:34.814040 n-d-852296-2 devstack@n-api.service[113418]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:40:34.815565 n-d-852296-2 devstack@n-api.service[113418]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:40:34.815565 n-d-852296-2 devstack@n-api.service[113418]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:40:34.815565 n-d-852296-2 devstack@n-api.service[113418]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:40:34.815565 n-d-852296-2 devstack@n-api.service[113418]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:40:34.815565 n-d-852296-2 devstack@n-api.service[113418]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 10 17:40:34.815565 n-d-852296-2 devstack@n-api.service[113418]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:40:34.815565 n-d-852296-2 devstack@n-api.service[113418]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 10 17:40:34.815565 n-d-852296-2 devstack@n-api.service[113418]: ERROR nova.api.openstack.wsgi Aug 10 17:40:34.815565 n-d-852296-2 devstack@n-api.service[113418]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:40:34.815565 n-d-852296-2 devstack@n-api.service[113418]: ERROR nova.api.openstack.wsgi Aug 10 17:40:34.815565 n-d-852296-2 devstack@n-api.service[113418]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:40:34.815565 n-d-852296-2 devstack@n-api.service[113418]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:40:34.815565 n-d-852296-2 devstack@n-api.service[113418]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:40:34.815565 n-d-852296-2 devstack@n-api.service[113418]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:40:34.815565 n-d-852296-2 devstack@n-api.service[113418]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:40:34.815565 n-d-852296-2 devstack@n-api.service[113418]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 10 17:40:34.815565 n-d-852296-2 devstack@n-api.service[113418]: ERROR nova.api.openstack.wsgi Aug 10 17:40:34.815565 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi [None req-9bb03cbb-ce48-456e-847b-7dd9bb834166 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=113418) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:40:34.816890 n-d-852296-2 devstack@n-api.service[113418]: INFO nova.api.openstack.requestlog [None req-9bb03cbb-ce48-456e-847b-7dd9bb834166 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.410996 Aug 10 17:40:34.816890 n-d-852296-2 devstack@n-api.service[113418]: [pid: 113418|app: 0|req: 19/39] 10.222.0.50 () {60 vars in 1190 bytes} [Wed Aug 10 17:40:34 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 412 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 10 17:40:34.822480 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi [None req-887bfc50-4bc2-444e-830d-e9c13b304579 admin admin] Calling method '>' {{(pid=113419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:40:34.846015 n-d-852296-2 devstack@n-api.service[113419]: INFO nova.api.openstack.requestlog [None req-887bfc50-4bc2-444e-830d-e9c13b304579 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026982 Aug 10 17:40:34.846595 n-d-852296-2 devstack@n-api.service[113419]: [pid: 113419|app: 0|req: 21/40] 10.222.0.50 () {60 vars in 1210 bytes} [Wed Aug 10 17:40:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:40:34.860825 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi [None req-baed2729-7786-42a0-98fc-77d0ba2dd18c admin admin] Calling method '>' {{(pid=113418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:40:34.885129 n-d-852296-2 devstack@n-api.service[113418]: INFO nova.api.openstack.requestlog [None req-baed2729-7786-42a0-98fc-77d0ba2dd18c admin admin] 10.222.0.50 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028521 Aug 10 17:40:34.885675 n-d-852296-2 devstack@n-api.service[113418]: [pid: 113418|app: 0|req: 20/41] 10.222.0.50 () {60 vars in 1210 bytes} [Wed Aug 10 17:40:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:40:34.895782 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi [None req-89359314-50de-4783-9181-f2497e025797 admin admin] Calling method '>' {{(pid=113419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:40:34.901613 n-d-852296-2 devstack@n-api.service[113419]: INFO nova.api.openstack.wsgi [None req-89359314-50de-4783-9181-f2497e025797 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 10 17:40:34.905518 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi [None req-89359314-50de-4783-9181-f2497e025797 admin admin] Request method failure captured: Aug 10 17:40:34.905518 n-d-852296-2 devstack@n-api.service[113419]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 10 17:40:34.905518 n-d-852296-2 devstack@n-api.service[113419]: Accept: application/json Aug 10 17:40:34.905518 n-d-852296-2 devstack@n-api.service[113419]: Accept-Encoding: gzip, deflate Aug 10 17:40:34.905518 n-d-852296-2 devstack@n-api.service[113419]: Connection: keep-alive Aug 10 17:40:34.905518 n-d-852296-2 devstack@n-api.service[113419]: Content-Length: 0 Aug 10 17:40:34.905518 n-d-852296-2 devstack@n-api.service[113419]: Host: 10.222.0.50 Aug 10 17:40:34.905518 n-d-852296-2 devstack@n-api.service[113419]: Openstack-Api-Version: compute 2.90 Aug 10 17:40:34.905518 n-d-852296-2 devstack@n-api.service[113419]: Openstack-System-Scope: None Aug 10 17:40:34.905518 n-d-852296-2 devstack@n-api.service[113419]: User-Agent: python-novaclient Aug 10 17:40:34.905518 n-d-852296-2 devstack@n-api.service[113419]: X-Auth-Token: gAAAAABi8-2SQunuO5q1JytAXzE2Z8pwrqJOCPoIM21K3y1S655zvpXPZ6kSjIus9c6ogW8i0O5n88SnbPWmN_6NR_uBfq7PS4JXxB3YM4Z0GXHRN51VS1tuTXmlwRzKS82TTMWTuFauDLW1qd7GQTPTPHsQf8EG-Ts04_YFGYXFxDJjfeGyX0s Aug 10 17:40:34.905518 n-d-852296-2 devstack@n-api.service[113419]: X-Domain-Id: None Aug 10 17:40:34.905518 n-d-852296-2 devstack@n-api.service[113419]: X-Domain-Name: None Aug 10 17:40:34.905518 n-d-852296-2 devstack@n-api.service[113419]: X-Identity-Status: Confirmed Aug 10 17:40:34.905518 n-d-852296-2 devstack@n-api.service[113419]: X-Is-Admin-Project: True Aug 10 17:40:34.905518 n-d-852296-2 devstack@n-api.service[113419]: X-Openstack-Nova-Api-Version: 2.90 Aug 10 17:40:34.905518 n-d-852296-2 devstack@n-api.service[113419]: X-Project-Domain-Id: default Aug 10 17:40:34.905518 n-d-852296-2 devstack@n-api.service[113419]: X-Project-Domain-Name: Default Aug 10 17:40:34.905518 n-d-852296-2 devstack@n-api.service[113419]: X-Project-Id: de82af5b02764b529d7ffc4d95b6343f Aug 10 17:40:34.905518 n-d-852296-2 devstack@n-api.service[113419]: X-Project-Name: admin Aug 10 17:40:34.905518 n-d-852296-2 devstack@n-api.service[113419]: X-Role: reader,member,admin Aug 10 17:40:34.905518 n-d-852296-2 devstack@n-api.service[113419]: X-Roles: reader,member,admin Aug 10 17:40:34.906987 n-d-852296-2 devstack@n-api.service[113419]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/de82af5b02764b529d7ffc4d95b6343f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/de82af5b02764b529d7ffc4d95b6343f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/de82af5b02764b529d7ffc4d95b6343f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_de82af5b02764b529d7ffc4d95b6343f", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:40:34.906987 n-d-852296-2 devstack@n-api.service[113419]: X-Tenant: admin Aug 10 17:40:34.906987 n-d-852296-2 devstack@n-api.service[113419]: X-Tenant-Id: de82af5b02764b529d7ffc4d95b6343f Aug 10 17:40:34.906987 n-d-852296-2 devstack@n-api.service[113419]: X-Tenant-Name: admin Aug 10 17:40:34.906987 n-d-852296-2 devstack@n-api.service[113419]: X-User: admin Aug 10 17:40:34.906987 n-d-852296-2 devstack@n-api.service[113419]: X-User-Domain-Id: default Aug 10 17:40:34.906987 n-d-852296-2 devstack@n-api.service[113419]: X-User-Domain-Name: Default Aug 10 17:40:34.906987 n-d-852296-2 devstack@n-api.service[113419]: X-User-Id: e4b4229a3d284eec9a42f4e7d8d06b6c Aug 10 17:40:34.906987 n-d-852296-2 devstack@n-api.service[113419]: X-User-Name: admin Aug 10 17:40:34.906987 n-d-852296-2 devstack@n-api.service[113419]: method: > Aug 10 17:40:34.906987 n-d-852296-2 devstack@n-api.service[113419]: exception: Flavor 42 could not be found. Aug 10 17:40:34.906987 n-d-852296-2 devstack@n-api.service[113419]: action_args: {'id': '42'} Aug 10 17:40:34.906987 n-d-852296-2 devstack@n-api.service[113419]: {{(pid=113419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:40:34.906987 n-d-852296-2 devstack@n-api.service[113419]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:40:34.908031 n-d-852296-2 devstack@n-api.service[113419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 10 17:40:34.908031 n-d-852296-2 devstack@n-api.service[113419]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 10 17:40:34.908031 n-d-852296-2 devstack@n-api.service[113419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 10 17:40:34.908031 n-d-852296-2 devstack@n-api.service[113419]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 10 17:40:34.908031 n-d-852296-2 devstack@n-api.service[113419]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 17:40:34.908031 n-d-852296-2 devstack@n-api.service[113419]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 17:40:34.908031 n-d-852296-2 devstack@n-api.service[113419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 10 17:40:34.908031 n-d-852296-2 devstack@n-api.service[113419]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 10 17:40:34.908031 n-d-852296-2 devstack@n-api.service[113419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 10 17:40:34.908031 n-d-852296-2 devstack@n-api.service[113419]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:40:34.908031 n-d-852296-2 devstack@n-api.service[113419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 10 17:40:34.908031 n-d-852296-2 devstack@n-api.service[113419]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 10 17:40:34.908031 n-d-852296-2 devstack@n-api.service[113419]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 10 17:40:34.908031 n-d-852296-2 devstack@n-api.service[113419]: ERROR nova.api.openstack.wsgi Aug 10 17:40:34.908031 n-d-852296-2 devstack@n-api.service[113419]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:40:34.908031 n-d-852296-2 devstack@n-api.service[113419]: ERROR nova.api.openstack.wsgi Aug 10 17:40:34.908031 n-d-852296-2 devstack@n-api.service[113419]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:40:34.908031 n-d-852296-2 devstack@n-api.service[113419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:40:34.908031 n-d-852296-2 devstack@n-api.service[113419]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:40:34.910231 n-d-852296-2 devstack@n-api.service[113419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:40:34.910231 n-d-852296-2 devstack@n-api.service[113419]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:40:34.910231 n-d-852296-2 devstack@n-api.service[113419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:40:34.910231 n-d-852296-2 devstack@n-api.service[113419]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:40:34.910231 n-d-852296-2 devstack@n-api.service[113419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 10 17:40:34.910231 n-d-852296-2 devstack@n-api.service[113419]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:40:34.910231 n-d-852296-2 devstack@n-api.service[113419]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 10 17:40:34.910231 n-d-852296-2 devstack@n-api.service[113419]: ERROR nova.api.openstack.wsgi Aug 10 17:40:34.910231 n-d-852296-2 devstack@n-api.service[113419]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:40:34.910231 n-d-852296-2 devstack@n-api.service[113419]: ERROR nova.api.openstack.wsgi Aug 10 17:40:34.910231 n-d-852296-2 devstack@n-api.service[113419]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:40:34.910231 n-d-852296-2 devstack@n-api.service[113419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:40:34.910231 n-d-852296-2 devstack@n-api.service[113419]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:40:34.910231 n-d-852296-2 devstack@n-api.service[113419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:40:34.910231 n-d-852296-2 devstack@n-api.service[113419]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:40:34.910231 n-d-852296-2 devstack@n-api.service[113419]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 10 17:40:34.910231 n-d-852296-2 devstack@n-api.service[113419]: ERROR nova.api.openstack.wsgi Aug 10 17:40:34.910231 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi [None req-89359314-50de-4783-9181-f2497e025797 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=113419) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:40:34.911560 n-d-852296-2 devstack@n-api.service[113419]: INFO nova.api.openstack.requestlog [None req-89359314-50de-4783-9181-f2497e025797 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015103 Aug 10 17:40:34.911560 n-d-852296-2 devstack@n-api.service[113419]: [pid: 113419|app: 0|req: 22/42] 10.222.0.50 () {60 vars in 1190 bytes} [Wed Aug 10 17:40:34 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 10 17:40:35.875534 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi [None req-baed2729-7786-42a0-98fc-77d0ba2dd18c admin admin] Calling method '>' {{(pid=113418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:40:35.876602 n-d-852296-2 devstack@n-api.service[113418]: INFO nova.api.openstack.requestlog [None req-baed2729-7786-42a0-98fc-77d0ba2dd18c admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Aug 10 17:40:35.877006 n-d-852296-2 devstack@n-api.service[113418]: [pid: 113418|app: 0|req: 21/43] 10.222.0.50 () {56 vars in 1074 bytes} [Wed Aug 10 17:40:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:40:36.402160 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi [None req-31670d52-92df-4752-9f20-e15d48b99da4 admin admin] Calling method '>' {{(pid=113419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:40:36.410475 n-d-852296-2 devstack@n-api.service[113419]: INFO nova.api.openstack.wsgi [None req-31670d52-92df-4752-9f20-e15d48b99da4 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 10 17:40:36.411970 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi [None req-31670d52-92df-4752-9f20-e15d48b99da4 admin admin] Request method failure captured: Aug 10 17:40:36.411970 n-d-852296-2 devstack@n-api.service[113419]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 10 17:40:36.411970 n-d-852296-2 devstack@n-api.service[113419]: Accept: application/json Aug 10 17:40:36.411970 n-d-852296-2 devstack@n-api.service[113419]: Accept-Encoding: gzip, deflate Aug 10 17:40:36.411970 n-d-852296-2 devstack@n-api.service[113419]: Connection: keep-alive Aug 10 17:40:36.411970 n-d-852296-2 devstack@n-api.service[113419]: Content-Length: 0 Aug 10 17:40:36.411970 n-d-852296-2 devstack@n-api.service[113419]: Host: 10.222.0.50 Aug 10 17:40:36.411970 n-d-852296-2 devstack@n-api.service[113419]: Openstack-Api-Version: compute 2.90 Aug 10 17:40:36.411970 n-d-852296-2 devstack@n-api.service[113419]: Openstack-System-Scope: None Aug 10 17:40:36.411970 n-d-852296-2 devstack@n-api.service[113419]: User-Agent: python-novaclient Aug 10 17:40:36.411970 n-d-852296-2 devstack@n-api.service[113419]: X-Auth-Token: gAAAAABi8-2T0iu59rBnESbSWPTnFSvi3RIJw1C8LFKQYWHZn9nr9hRx8KSJY-vK4R1LxgbKfV55v6aznGkEOlPGzHBdmKChn0NKahM4U1uXPVdWbN8PmoxvgZ5IPr5bcMFvP_3kPkweDJ0hdgppFCsDEdDITVnbHdVkyoSfJogY8yuR44rn41I Aug 10 17:40:36.411970 n-d-852296-2 devstack@n-api.service[113419]: X-Domain-Id: None Aug 10 17:40:36.411970 n-d-852296-2 devstack@n-api.service[113419]: X-Domain-Name: None Aug 10 17:40:36.411970 n-d-852296-2 devstack@n-api.service[113419]: X-Identity-Status: Confirmed Aug 10 17:40:36.411970 n-d-852296-2 devstack@n-api.service[113419]: X-Is-Admin-Project: True Aug 10 17:40:36.411970 n-d-852296-2 devstack@n-api.service[113419]: X-Openstack-Nova-Api-Version: 2.90 Aug 10 17:40:36.411970 n-d-852296-2 devstack@n-api.service[113419]: X-Project-Domain-Id: default Aug 10 17:40:36.411970 n-d-852296-2 devstack@n-api.service[113419]: X-Project-Domain-Name: Default Aug 10 17:40:36.411970 n-d-852296-2 devstack@n-api.service[113419]: X-Project-Id: de82af5b02764b529d7ffc4d95b6343f Aug 10 17:40:36.411970 n-d-852296-2 devstack@n-api.service[113419]: X-Project-Name: admin Aug 10 17:40:36.411970 n-d-852296-2 devstack@n-api.service[113419]: X-Role: reader,member,admin Aug 10 17:40:36.411970 n-d-852296-2 devstack@n-api.service[113419]: X-Roles: reader,member,admin Aug 10 17:40:36.413572 n-d-852296-2 devstack@n-api.service[113419]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/de82af5b02764b529d7ffc4d95b6343f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/de82af5b02764b529d7ffc4d95b6343f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/de82af5b02764b529d7ffc4d95b6343f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_de82af5b02764b529d7ffc4d95b6343f", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:40:36.413572 n-d-852296-2 devstack@n-api.service[113419]: X-Tenant: admin Aug 10 17:40:36.413572 n-d-852296-2 devstack@n-api.service[113419]: X-Tenant-Id: de82af5b02764b529d7ffc4d95b6343f Aug 10 17:40:36.413572 n-d-852296-2 devstack@n-api.service[113419]: X-Tenant-Name: admin Aug 10 17:40:36.413572 n-d-852296-2 devstack@n-api.service[113419]: X-User: admin Aug 10 17:40:36.413572 n-d-852296-2 devstack@n-api.service[113419]: X-User-Domain-Id: default Aug 10 17:40:36.413572 n-d-852296-2 devstack@n-api.service[113419]: X-User-Domain-Name: Default Aug 10 17:40:36.413572 n-d-852296-2 devstack@n-api.service[113419]: X-User-Id: e4b4229a3d284eec9a42f4e7d8d06b6c Aug 10 17:40:36.413572 n-d-852296-2 devstack@n-api.service[113419]: X-User-Name: admin Aug 10 17:40:36.413572 n-d-852296-2 devstack@n-api.service[113419]: method: > Aug 10 17:40:36.413572 n-d-852296-2 devstack@n-api.service[113419]: exception: Flavor 84 could not be found. Aug 10 17:40:36.413572 n-d-852296-2 devstack@n-api.service[113419]: action_args: {'id': '84'} Aug 10 17:40:36.413572 n-d-852296-2 devstack@n-api.service[113419]: {{(pid=113419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:40:36.413572 n-d-852296-2 devstack@n-api.service[113419]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:40:36.414433 n-d-852296-2 devstack@n-api.service[113419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 10 17:40:36.414433 n-d-852296-2 devstack@n-api.service[113419]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 10 17:40:36.414433 n-d-852296-2 devstack@n-api.service[113419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 10 17:40:36.414433 n-d-852296-2 devstack@n-api.service[113419]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 10 17:40:36.414433 n-d-852296-2 devstack@n-api.service[113419]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 17:40:36.414433 n-d-852296-2 devstack@n-api.service[113419]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 17:40:36.414433 n-d-852296-2 devstack@n-api.service[113419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 10 17:40:36.414433 n-d-852296-2 devstack@n-api.service[113419]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 10 17:40:36.414433 n-d-852296-2 devstack@n-api.service[113419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 10 17:40:36.414433 n-d-852296-2 devstack@n-api.service[113419]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:40:36.414433 n-d-852296-2 devstack@n-api.service[113419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 10 17:40:36.414433 n-d-852296-2 devstack@n-api.service[113419]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 10 17:40:36.414433 n-d-852296-2 devstack@n-api.service[113419]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 10 17:40:36.414433 n-d-852296-2 devstack@n-api.service[113419]: ERROR nova.api.openstack.wsgi Aug 10 17:40:36.414433 n-d-852296-2 devstack@n-api.service[113419]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:40:36.414433 n-d-852296-2 devstack@n-api.service[113419]: ERROR nova.api.openstack.wsgi Aug 10 17:40:36.414433 n-d-852296-2 devstack@n-api.service[113419]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:40:36.414433 n-d-852296-2 devstack@n-api.service[113419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:40:36.414433 n-d-852296-2 devstack@n-api.service[113419]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:40:36.415670 n-d-852296-2 devstack@n-api.service[113419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:40:36.415670 n-d-852296-2 devstack@n-api.service[113419]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:40:36.415670 n-d-852296-2 devstack@n-api.service[113419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:40:36.415670 n-d-852296-2 devstack@n-api.service[113419]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:40:36.415670 n-d-852296-2 devstack@n-api.service[113419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 10 17:40:36.415670 n-d-852296-2 devstack@n-api.service[113419]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:40:36.415670 n-d-852296-2 devstack@n-api.service[113419]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 10 17:40:36.415670 n-d-852296-2 devstack@n-api.service[113419]: ERROR nova.api.openstack.wsgi Aug 10 17:40:36.415670 n-d-852296-2 devstack@n-api.service[113419]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:40:36.415670 n-d-852296-2 devstack@n-api.service[113419]: ERROR nova.api.openstack.wsgi Aug 10 17:40:36.415670 n-d-852296-2 devstack@n-api.service[113419]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:40:36.415670 n-d-852296-2 devstack@n-api.service[113419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:40:36.415670 n-d-852296-2 devstack@n-api.service[113419]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:40:36.415670 n-d-852296-2 devstack@n-api.service[113419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:40:36.415670 n-d-852296-2 devstack@n-api.service[113419]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:40:36.415670 n-d-852296-2 devstack@n-api.service[113419]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 10 17:40:36.415670 n-d-852296-2 devstack@n-api.service[113419]: ERROR nova.api.openstack.wsgi Aug 10 17:40:36.415670 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi [None req-31670d52-92df-4752-9f20-e15d48b99da4 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=113419) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:40:36.416990 n-d-852296-2 devstack@n-api.service[113419]: INFO nova.api.openstack.requestlog [None req-31670d52-92df-4752-9f20-e15d48b99da4 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.399740 Aug 10 17:40:36.416990 n-d-852296-2 devstack@n-api.service[113419]: [pid: 113419|app: 0|req: 23/44] 10.222.0.50 () {60 vars in 1190 bytes} [Wed Aug 10 17:40:36 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 401 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 10 17:40:36.423036 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi [None req-da3590a8-ba42-4a0a-aa0d-d41b1fb02832 admin admin] Calling method '>' {{(pid=113418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:40:36.437959 n-d-852296-2 devstack@n-api.service[113418]: INFO nova.api.openstack.requestlog [None req-da3590a8-ba42-4a0a-aa0d-d41b1fb02832 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018470 Aug 10 17:40:36.438497 n-d-852296-2 devstack@n-api.service[113418]: [pid: 113418|app: 0|req: 22/45] 10.222.0.50 () {60 vars in 1210 bytes} [Wed Aug 10 17:40:36 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:40:36.447908 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi [None req-2a08013c-42a9-406e-8d5e-759bdedf2b96 admin admin] Calling method '>' {{(pid=113419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:40:36.463375 n-d-852296-2 devstack@n-api.service[113419]: INFO nova.api.openstack.requestlog [None req-2a08013c-42a9-406e-8d5e-759bdedf2b96 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019002 Aug 10 17:40:36.463914 n-d-852296-2 devstack@n-api.service[113419]: [pid: 113419|app: 0|req: 24/46] 10.222.0.50 () {60 vars in 1210 bytes} [Wed Aug 10 17:40:36 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:40:36.475079 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi [None req-ec87807b-d26c-4ed9-b72c-3e5c0043295c admin admin] Calling method '>' {{(pid=113418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:40:36.480416 n-d-852296-2 devstack@n-api.service[113418]: INFO nova.api.openstack.wsgi [None req-ec87807b-d26c-4ed9-b72c-3e5c0043295c admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 10 17:40:36.482044 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi [None req-ec87807b-d26c-4ed9-b72c-3e5c0043295c admin admin] Request method failure captured: Aug 10 17:40:36.482044 n-d-852296-2 devstack@n-api.service[113418]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 10 17:40:36.482044 n-d-852296-2 devstack@n-api.service[113418]: Accept: application/json Aug 10 17:40:36.482044 n-d-852296-2 devstack@n-api.service[113418]: Accept-Encoding: gzip, deflate Aug 10 17:40:36.482044 n-d-852296-2 devstack@n-api.service[113418]: Connection: keep-alive Aug 10 17:40:36.482044 n-d-852296-2 devstack@n-api.service[113418]: Content-Length: 0 Aug 10 17:40:36.482044 n-d-852296-2 devstack@n-api.service[113418]: Host: 10.222.0.50 Aug 10 17:40:36.482044 n-d-852296-2 devstack@n-api.service[113418]: Openstack-Api-Version: compute 2.90 Aug 10 17:40:36.482044 n-d-852296-2 devstack@n-api.service[113418]: Openstack-System-Scope: None Aug 10 17:40:36.482044 n-d-852296-2 devstack@n-api.service[113418]: User-Agent: python-novaclient Aug 10 17:40:36.482044 n-d-852296-2 devstack@n-api.service[113418]: X-Auth-Token: gAAAAABi8-2T0iu59rBnESbSWPTnFSvi3RIJw1C8LFKQYWHZn9nr9hRx8KSJY-vK4R1LxgbKfV55v6aznGkEOlPGzHBdmKChn0NKahM4U1uXPVdWbN8PmoxvgZ5IPr5bcMFvP_3kPkweDJ0hdgppFCsDEdDITVnbHdVkyoSfJogY8yuR44rn41I Aug 10 17:40:36.482044 n-d-852296-2 devstack@n-api.service[113418]: X-Domain-Id: None Aug 10 17:40:36.482044 n-d-852296-2 devstack@n-api.service[113418]: X-Domain-Name: None Aug 10 17:40:36.482044 n-d-852296-2 devstack@n-api.service[113418]: X-Identity-Status: Confirmed Aug 10 17:40:36.482044 n-d-852296-2 devstack@n-api.service[113418]: X-Is-Admin-Project: True Aug 10 17:40:36.482044 n-d-852296-2 devstack@n-api.service[113418]: X-Openstack-Nova-Api-Version: 2.90 Aug 10 17:40:36.482044 n-d-852296-2 devstack@n-api.service[113418]: X-Project-Domain-Id: default Aug 10 17:40:36.482044 n-d-852296-2 devstack@n-api.service[113418]: X-Project-Domain-Name: Default Aug 10 17:40:36.482044 n-d-852296-2 devstack@n-api.service[113418]: X-Project-Id: de82af5b02764b529d7ffc4d95b6343f Aug 10 17:40:36.482044 n-d-852296-2 devstack@n-api.service[113418]: X-Project-Name: admin Aug 10 17:40:36.482044 n-d-852296-2 devstack@n-api.service[113418]: X-Role: reader,member,admin Aug 10 17:40:36.482044 n-d-852296-2 devstack@n-api.service[113418]: X-Roles: reader,member,admin Aug 10 17:40:36.483621 n-d-852296-2 devstack@n-api.service[113418]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/de82af5b02764b529d7ffc4d95b6343f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/de82af5b02764b529d7ffc4d95b6343f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/de82af5b02764b529d7ffc4d95b6343f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_de82af5b02764b529d7ffc4d95b6343f", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:40:36.483621 n-d-852296-2 devstack@n-api.service[113418]: X-Tenant: admin Aug 10 17:40:36.483621 n-d-852296-2 devstack@n-api.service[113418]: X-Tenant-Id: de82af5b02764b529d7ffc4d95b6343f Aug 10 17:40:36.483621 n-d-852296-2 devstack@n-api.service[113418]: X-Tenant-Name: admin Aug 10 17:40:36.483621 n-d-852296-2 devstack@n-api.service[113418]: X-User: admin Aug 10 17:40:36.483621 n-d-852296-2 devstack@n-api.service[113418]: X-User-Domain-Id: default Aug 10 17:40:36.483621 n-d-852296-2 devstack@n-api.service[113418]: X-User-Domain-Name: Default Aug 10 17:40:36.483621 n-d-852296-2 devstack@n-api.service[113418]: X-User-Id: e4b4229a3d284eec9a42f4e7d8d06b6c Aug 10 17:40:36.483621 n-d-852296-2 devstack@n-api.service[113418]: X-User-Name: admin Aug 10 17:40:36.483621 n-d-852296-2 devstack@n-api.service[113418]: method: > Aug 10 17:40:36.483621 n-d-852296-2 devstack@n-api.service[113418]: exception: Flavor 84 could not be found. Aug 10 17:40:36.483621 n-d-852296-2 devstack@n-api.service[113418]: action_args: {'id': '84'} Aug 10 17:40:36.483621 n-d-852296-2 devstack@n-api.service[113418]: {{(pid=113418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:40:36.483621 n-d-852296-2 devstack@n-api.service[113418]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:40:36.484718 n-d-852296-2 devstack@n-api.service[113418]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 10 17:40:36.484718 n-d-852296-2 devstack@n-api.service[113418]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 10 17:40:36.484718 n-d-852296-2 devstack@n-api.service[113418]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 10 17:40:36.484718 n-d-852296-2 devstack@n-api.service[113418]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 10 17:40:36.484718 n-d-852296-2 devstack@n-api.service[113418]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 17:40:36.484718 n-d-852296-2 devstack@n-api.service[113418]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 17:40:36.484718 n-d-852296-2 devstack@n-api.service[113418]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 10 17:40:36.484718 n-d-852296-2 devstack@n-api.service[113418]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 10 17:40:36.484718 n-d-852296-2 devstack@n-api.service[113418]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 10 17:40:36.484718 n-d-852296-2 devstack@n-api.service[113418]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:40:36.484718 n-d-852296-2 devstack@n-api.service[113418]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 10 17:40:36.484718 n-d-852296-2 devstack@n-api.service[113418]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 10 17:40:36.484718 n-d-852296-2 devstack@n-api.service[113418]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 10 17:40:36.484718 n-d-852296-2 devstack@n-api.service[113418]: ERROR nova.api.openstack.wsgi Aug 10 17:40:36.484718 n-d-852296-2 devstack@n-api.service[113418]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:40:36.484718 n-d-852296-2 devstack@n-api.service[113418]: ERROR nova.api.openstack.wsgi Aug 10 17:40:36.484718 n-d-852296-2 devstack@n-api.service[113418]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:40:36.484718 n-d-852296-2 devstack@n-api.service[113418]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:40:36.484718 n-d-852296-2 devstack@n-api.service[113418]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:40:36.486126 n-d-852296-2 devstack@n-api.service[113418]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:40:36.486126 n-d-852296-2 devstack@n-api.service[113418]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:40:36.486126 n-d-852296-2 devstack@n-api.service[113418]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:40:36.486126 n-d-852296-2 devstack@n-api.service[113418]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:40:36.486126 n-d-852296-2 devstack@n-api.service[113418]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 10 17:40:36.486126 n-d-852296-2 devstack@n-api.service[113418]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:40:36.486126 n-d-852296-2 devstack@n-api.service[113418]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 10 17:40:36.486126 n-d-852296-2 devstack@n-api.service[113418]: ERROR nova.api.openstack.wsgi Aug 10 17:40:36.486126 n-d-852296-2 devstack@n-api.service[113418]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:40:36.486126 n-d-852296-2 devstack@n-api.service[113418]: ERROR nova.api.openstack.wsgi Aug 10 17:40:36.486126 n-d-852296-2 devstack@n-api.service[113418]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:40:36.486126 n-d-852296-2 devstack@n-api.service[113418]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:40:36.486126 n-d-852296-2 devstack@n-api.service[113418]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:40:36.486126 n-d-852296-2 devstack@n-api.service[113418]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:40:36.486126 n-d-852296-2 devstack@n-api.service[113418]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:40:36.486126 n-d-852296-2 devstack@n-api.service[113418]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 10 17:40:36.486126 n-d-852296-2 devstack@n-api.service[113418]: ERROR nova.api.openstack.wsgi Aug 10 17:40:36.486126 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi [None req-ec87807b-d26c-4ed9-b72c-3e5c0043295c admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=113418) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:40:36.487374 n-d-852296-2 devstack@n-api.service[113418]: INFO nova.api.openstack.requestlog [None req-ec87807b-d26c-4ed9-b72c-3e5c0043295c admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011942 Aug 10 17:40:36.487374 n-d-852296-2 devstack@n-api.service[113418]: [pid: 113418|app: 0|req: 23/47] 10.222.0.50 () {60 vars in 1190 bytes} [Wed Aug 10 17:40:36 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 10 17:40:37.471556 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi [None req-2a08013c-42a9-406e-8d5e-759bdedf2b96 admin admin] Calling method '>' {{(pid=113419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:40:37.472630 n-d-852296-2 devstack@n-api.service[113419]: INFO nova.api.openstack.requestlog [None req-2a08013c-42a9-406e-8d5e-759bdedf2b96 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Aug 10 17:40:37.473029 n-d-852296-2 devstack@n-api.service[113419]: [pid: 113419|app: 0|req: 25/48] 10.222.0.50 () {56 vars in 1074 bytes} [Wed Aug 10 17:40:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:40:38.007656 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi [None req-68f70c52-a853-40f5-b52c-fe674a74f527 admin admin] Calling method '>' {{(pid=113418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:40:38.013924 n-d-852296-2 devstack@n-api.service[113418]: INFO nova.api.openstack.wsgi [None req-68f70c52-a853-40f5-b52c-fe674a74f527 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 10 17:40:38.015401 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi [None req-68f70c52-a853-40f5-b52c-fe674a74f527 admin admin] Request method failure captured: Aug 10 17:40:38.015401 n-d-852296-2 devstack@n-api.service[113418]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 10 17:40:38.015401 n-d-852296-2 devstack@n-api.service[113418]: Accept: application/json Aug 10 17:40:38.015401 n-d-852296-2 devstack@n-api.service[113418]: Accept-Encoding: gzip, deflate Aug 10 17:40:38.015401 n-d-852296-2 devstack@n-api.service[113418]: Connection: keep-alive Aug 10 17:40:38.015401 n-d-852296-2 devstack@n-api.service[113418]: Content-Length: 0 Aug 10 17:40:38.015401 n-d-852296-2 devstack@n-api.service[113418]: Host: 10.222.0.50 Aug 10 17:40:38.015401 n-d-852296-2 devstack@n-api.service[113418]: Openstack-Api-Version: compute 2.90 Aug 10 17:40:38.015401 n-d-852296-2 devstack@n-api.service[113418]: Openstack-System-Scope: None Aug 10 17:40:38.015401 n-d-852296-2 devstack@n-api.service[113418]: User-Agent: python-novaclient Aug 10 17:40:38.015401 n-d-852296-2 devstack@n-api.service[113418]: X-Auth-Token: gAAAAABi8-2V2k1ASenb01teJJtQSCmo1tshvIrO8F1yGZGXHh2GJbjJmxhQKptFAXjTkftHzvCcY_iR9_Sth8fNRP1seQVam0-7nx51e_KMOjih3ysqKotdk9c6_UStiQdswd4HdtpLGnvxEdJ4cho16nWAZoFKAsM9-q5HRBtdizDwbhLiJWQ Aug 10 17:40:38.015401 n-d-852296-2 devstack@n-api.service[113418]: X-Domain-Id: None Aug 10 17:40:38.015401 n-d-852296-2 devstack@n-api.service[113418]: X-Domain-Name: None Aug 10 17:40:38.015401 n-d-852296-2 devstack@n-api.service[113418]: X-Identity-Status: Confirmed Aug 10 17:40:38.015401 n-d-852296-2 devstack@n-api.service[113418]: X-Is-Admin-Project: True Aug 10 17:40:38.015401 n-d-852296-2 devstack@n-api.service[113418]: X-Openstack-Nova-Api-Version: 2.90 Aug 10 17:40:38.015401 n-d-852296-2 devstack@n-api.service[113418]: X-Project-Domain-Id: default Aug 10 17:40:38.015401 n-d-852296-2 devstack@n-api.service[113418]: X-Project-Domain-Name: Default Aug 10 17:40:38.015401 n-d-852296-2 devstack@n-api.service[113418]: X-Project-Id: de82af5b02764b529d7ffc4d95b6343f Aug 10 17:40:38.015401 n-d-852296-2 devstack@n-api.service[113418]: X-Project-Name: admin Aug 10 17:40:38.015401 n-d-852296-2 devstack@n-api.service[113418]: X-Role: reader,member,admin Aug 10 17:40:38.015401 n-d-852296-2 devstack@n-api.service[113418]: X-Roles: reader,member,admin Aug 10 17:40:38.017062 n-d-852296-2 devstack@n-api.service[113418]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/de82af5b02764b529d7ffc4d95b6343f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/de82af5b02764b529d7ffc4d95b6343f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/de82af5b02764b529d7ffc4d95b6343f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_de82af5b02764b529d7ffc4d95b6343f", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:40:38.017062 n-d-852296-2 devstack@n-api.service[113418]: X-Tenant: admin Aug 10 17:40:38.017062 n-d-852296-2 devstack@n-api.service[113418]: X-Tenant-Id: de82af5b02764b529d7ffc4d95b6343f Aug 10 17:40:38.017062 n-d-852296-2 devstack@n-api.service[113418]: X-Tenant-Name: admin Aug 10 17:40:38.017062 n-d-852296-2 devstack@n-api.service[113418]: X-User: admin Aug 10 17:40:38.017062 n-d-852296-2 devstack@n-api.service[113418]: X-User-Domain-Id: default Aug 10 17:40:38.017062 n-d-852296-2 devstack@n-api.service[113418]: X-User-Domain-Name: Default Aug 10 17:40:38.017062 n-d-852296-2 devstack@n-api.service[113418]: X-User-Id: e4b4229a3d284eec9a42f4e7d8d06b6c Aug 10 17:40:38.017062 n-d-852296-2 devstack@n-api.service[113418]: X-User-Name: admin Aug 10 17:40:38.017062 n-d-852296-2 devstack@n-api.service[113418]: method: > Aug 10 17:40:38.017062 n-d-852296-2 devstack@n-api.service[113418]: exception: Flavor 451 could not be found. Aug 10 17:40:38.017062 n-d-852296-2 devstack@n-api.service[113418]: action_args: {'id': '451'} Aug 10 17:40:38.017062 n-d-852296-2 devstack@n-api.service[113418]: {{(pid=113418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:40:38.017062 n-d-852296-2 devstack@n-api.service[113418]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:40:38.017924 n-d-852296-2 devstack@n-api.service[113418]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 10 17:40:38.017924 n-d-852296-2 devstack@n-api.service[113418]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 10 17:40:38.017924 n-d-852296-2 devstack@n-api.service[113418]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 10 17:40:38.017924 n-d-852296-2 devstack@n-api.service[113418]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 10 17:40:38.017924 n-d-852296-2 devstack@n-api.service[113418]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 17:40:38.017924 n-d-852296-2 devstack@n-api.service[113418]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 17:40:38.017924 n-d-852296-2 devstack@n-api.service[113418]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 10 17:40:38.017924 n-d-852296-2 devstack@n-api.service[113418]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 10 17:40:38.017924 n-d-852296-2 devstack@n-api.service[113418]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 10 17:40:38.017924 n-d-852296-2 devstack@n-api.service[113418]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:40:38.017924 n-d-852296-2 devstack@n-api.service[113418]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 10 17:40:38.017924 n-d-852296-2 devstack@n-api.service[113418]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 10 17:40:38.017924 n-d-852296-2 devstack@n-api.service[113418]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 10 17:40:38.017924 n-d-852296-2 devstack@n-api.service[113418]: ERROR nova.api.openstack.wsgi Aug 10 17:40:38.017924 n-d-852296-2 devstack@n-api.service[113418]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:40:38.017924 n-d-852296-2 devstack@n-api.service[113418]: ERROR nova.api.openstack.wsgi Aug 10 17:40:38.017924 n-d-852296-2 devstack@n-api.service[113418]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:40:38.017924 n-d-852296-2 devstack@n-api.service[113418]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:40:38.017924 n-d-852296-2 devstack@n-api.service[113418]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:40:38.018991 n-d-852296-2 devstack@n-api.service[113418]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:40:38.018991 n-d-852296-2 devstack@n-api.service[113418]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:40:38.018991 n-d-852296-2 devstack@n-api.service[113418]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:40:38.018991 n-d-852296-2 devstack@n-api.service[113418]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:40:38.018991 n-d-852296-2 devstack@n-api.service[113418]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 10 17:40:38.018991 n-d-852296-2 devstack@n-api.service[113418]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:40:38.018991 n-d-852296-2 devstack@n-api.service[113418]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 10 17:40:38.018991 n-d-852296-2 devstack@n-api.service[113418]: ERROR nova.api.openstack.wsgi Aug 10 17:40:38.018991 n-d-852296-2 devstack@n-api.service[113418]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:40:38.018991 n-d-852296-2 devstack@n-api.service[113418]: ERROR nova.api.openstack.wsgi Aug 10 17:40:38.018991 n-d-852296-2 devstack@n-api.service[113418]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:40:38.018991 n-d-852296-2 devstack@n-api.service[113418]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:40:38.018991 n-d-852296-2 devstack@n-api.service[113418]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:40:38.018991 n-d-852296-2 devstack@n-api.service[113418]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:40:38.018991 n-d-852296-2 devstack@n-api.service[113418]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:40:38.018991 n-d-852296-2 devstack@n-api.service[113418]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 10 17:40:38.018991 n-d-852296-2 devstack@n-api.service[113418]: ERROR nova.api.openstack.wsgi Aug 10 17:40:38.018991 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi [None req-68f70c52-a853-40f5-b52c-fe674a74f527 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=113418) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:40:38.020001 n-d-852296-2 devstack@n-api.service[113418]: INFO nova.api.openstack.requestlog [None req-68f70c52-a853-40f5-b52c-fe674a74f527 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.402580 Aug 10 17:40:38.020001 n-d-852296-2 devstack@n-api.service[113418]: [pid: 113418|app: 0|req: 24/49] 10.222.0.50 () {60 vars in 1193 bytes} [Wed Aug 10 17:40:37 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 404 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 10 17:40:38.026496 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi [None req-8228cad3-4a23-4de5-b090-ec8bb12cdaa7 admin admin] Calling method '>' {{(pid=113419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:40:38.042319 n-d-852296-2 devstack@n-api.service[113419]: INFO nova.api.openstack.requestlog [None req-8228cad3-4a23-4de5-b090-ec8bb12cdaa7 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019303 Aug 10 17:40:38.042878 n-d-852296-2 devstack@n-api.service[113419]: [pid: 113419|app: 0|req: 26/50] 10.222.0.50 () {60 vars in 1210 bytes} [Wed Aug 10 17:40:38 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:40:38.052463 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi [None req-6ca62fb5-0bb7-40c9-b142-0366bc3d2ce8 admin admin] Calling method '>' {{(pid=113418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:40:38.067778 n-d-852296-2 devstack@n-api.service[113418]: INFO nova.api.openstack.requestlog [None req-6ca62fb5-0bb7-40c9-b142-0366bc3d2ce8 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018885 Aug 10 17:40:38.068323 n-d-852296-2 devstack@n-api.service[113418]: [pid: 113418|app: 0|req: 25/51] 10.222.0.50 () {60 vars in 1210 bytes} [Wed Aug 10 17:40:38 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:40:38.078267 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi [None req-8938c84d-9ebe-4f48-8807-300671f513a1 admin admin] Calling method '>' {{(pid=113419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:40:38.083554 n-d-852296-2 devstack@n-api.service[113419]: INFO nova.api.openstack.wsgi [None req-8938c84d-9ebe-4f48-8807-300671f513a1 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 10 17:40:38.085078 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi [None req-8938c84d-9ebe-4f48-8807-300671f513a1 admin admin] Request method failure captured: Aug 10 17:40:38.085078 n-d-852296-2 devstack@n-api.service[113419]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 10 17:40:38.085078 n-d-852296-2 devstack@n-api.service[113419]: Accept: application/json Aug 10 17:40:38.085078 n-d-852296-2 devstack@n-api.service[113419]: Accept-Encoding: gzip, deflate Aug 10 17:40:38.085078 n-d-852296-2 devstack@n-api.service[113419]: Connection: keep-alive Aug 10 17:40:38.085078 n-d-852296-2 devstack@n-api.service[113419]: Content-Length: 0 Aug 10 17:40:38.085078 n-d-852296-2 devstack@n-api.service[113419]: Host: 10.222.0.50 Aug 10 17:40:38.085078 n-d-852296-2 devstack@n-api.service[113419]: Openstack-Api-Version: compute 2.90 Aug 10 17:40:38.085078 n-d-852296-2 devstack@n-api.service[113419]: Openstack-System-Scope: None Aug 10 17:40:38.085078 n-d-852296-2 devstack@n-api.service[113419]: User-Agent: python-novaclient Aug 10 17:40:38.085078 n-d-852296-2 devstack@n-api.service[113419]: X-Auth-Token: gAAAAABi8-2V2k1ASenb01teJJtQSCmo1tshvIrO8F1yGZGXHh2GJbjJmxhQKptFAXjTkftHzvCcY_iR9_Sth8fNRP1seQVam0-7nx51e_KMOjih3ysqKotdk9c6_UStiQdswd4HdtpLGnvxEdJ4cho16nWAZoFKAsM9-q5HRBtdizDwbhLiJWQ Aug 10 17:40:38.085078 n-d-852296-2 devstack@n-api.service[113419]: X-Domain-Id: None Aug 10 17:40:38.085078 n-d-852296-2 devstack@n-api.service[113419]: X-Domain-Name: None Aug 10 17:40:38.085078 n-d-852296-2 devstack@n-api.service[113419]: X-Identity-Status: Confirmed Aug 10 17:40:38.085078 n-d-852296-2 devstack@n-api.service[113419]: X-Is-Admin-Project: True Aug 10 17:40:38.085078 n-d-852296-2 devstack@n-api.service[113419]: X-Openstack-Nova-Api-Version: 2.90 Aug 10 17:40:38.085078 n-d-852296-2 devstack@n-api.service[113419]: X-Project-Domain-Id: default Aug 10 17:40:38.085078 n-d-852296-2 devstack@n-api.service[113419]: X-Project-Domain-Name: Default Aug 10 17:40:38.085078 n-d-852296-2 devstack@n-api.service[113419]: X-Project-Id: de82af5b02764b529d7ffc4d95b6343f Aug 10 17:40:38.085078 n-d-852296-2 devstack@n-api.service[113419]: X-Project-Name: admin Aug 10 17:40:38.085078 n-d-852296-2 devstack@n-api.service[113419]: X-Role: reader,member,admin Aug 10 17:40:38.085078 n-d-852296-2 devstack@n-api.service[113419]: X-Roles: reader,member,admin Aug 10 17:40:38.086748 n-d-852296-2 devstack@n-api.service[113419]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/de82af5b02764b529d7ffc4d95b6343f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/de82af5b02764b529d7ffc4d95b6343f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/de82af5b02764b529d7ffc4d95b6343f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_de82af5b02764b529d7ffc4d95b6343f", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:40:38.086748 n-d-852296-2 devstack@n-api.service[113419]: X-Tenant: admin Aug 10 17:40:38.086748 n-d-852296-2 devstack@n-api.service[113419]: X-Tenant-Id: de82af5b02764b529d7ffc4d95b6343f Aug 10 17:40:38.086748 n-d-852296-2 devstack@n-api.service[113419]: X-Tenant-Name: admin Aug 10 17:40:38.086748 n-d-852296-2 devstack@n-api.service[113419]: X-User: admin Aug 10 17:40:38.086748 n-d-852296-2 devstack@n-api.service[113419]: X-User-Domain-Id: default Aug 10 17:40:38.086748 n-d-852296-2 devstack@n-api.service[113419]: X-User-Domain-Name: Default Aug 10 17:40:38.086748 n-d-852296-2 devstack@n-api.service[113419]: X-User-Id: e4b4229a3d284eec9a42f4e7d8d06b6c Aug 10 17:40:38.086748 n-d-852296-2 devstack@n-api.service[113419]: X-User-Name: admin Aug 10 17:40:38.086748 n-d-852296-2 devstack@n-api.service[113419]: method: > Aug 10 17:40:38.086748 n-d-852296-2 devstack@n-api.service[113419]: exception: Flavor 451 could not be found. Aug 10 17:40:38.086748 n-d-852296-2 devstack@n-api.service[113419]: action_args: {'id': '451'} Aug 10 17:40:38.086748 n-d-852296-2 devstack@n-api.service[113419]: {{(pid=113419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:40:38.086748 n-d-852296-2 devstack@n-api.service[113419]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:40:38.087710 n-d-852296-2 devstack@n-api.service[113419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 10 17:40:38.087710 n-d-852296-2 devstack@n-api.service[113419]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 10 17:40:38.087710 n-d-852296-2 devstack@n-api.service[113419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 10 17:40:38.087710 n-d-852296-2 devstack@n-api.service[113419]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 10 17:40:38.087710 n-d-852296-2 devstack@n-api.service[113419]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 17:40:38.087710 n-d-852296-2 devstack@n-api.service[113419]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 17:40:38.087710 n-d-852296-2 devstack@n-api.service[113419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 10 17:40:38.087710 n-d-852296-2 devstack@n-api.service[113419]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 10 17:40:38.087710 n-d-852296-2 devstack@n-api.service[113419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 10 17:40:38.087710 n-d-852296-2 devstack@n-api.service[113419]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:40:38.087710 n-d-852296-2 devstack@n-api.service[113419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 10 17:40:38.087710 n-d-852296-2 devstack@n-api.service[113419]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 10 17:40:38.087710 n-d-852296-2 devstack@n-api.service[113419]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 10 17:40:38.087710 n-d-852296-2 devstack@n-api.service[113419]: ERROR nova.api.openstack.wsgi Aug 10 17:40:38.087710 n-d-852296-2 devstack@n-api.service[113419]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:40:38.087710 n-d-852296-2 devstack@n-api.service[113419]: ERROR nova.api.openstack.wsgi Aug 10 17:40:38.087710 n-d-852296-2 devstack@n-api.service[113419]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:40:38.087710 n-d-852296-2 devstack@n-api.service[113419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:40:38.087710 n-d-852296-2 devstack@n-api.service[113419]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:40:38.089044 n-d-852296-2 devstack@n-api.service[113419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:40:38.089044 n-d-852296-2 devstack@n-api.service[113419]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:40:38.089044 n-d-852296-2 devstack@n-api.service[113419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:40:38.089044 n-d-852296-2 devstack@n-api.service[113419]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:40:38.089044 n-d-852296-2 devstack@n-api.service[113419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 10 17:40:38.089044 n-d-852296-2 devstack@n-api.service[113419]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:40:38.089044 n-d-852296-2 devstack@n-api.service[113419]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 10 17:40:38.089044 n-d-852296-2 devstack@n-api.service[113419]: ERROR nova.api.openstack.wsgi Aug 10 17:40:38.089044 n-d-852296-2 devstack@n-api.service[113419]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:40:38.089044 n-d-852296-2 devstack@n-api.service[113419]: ERROR nova.api.openstack.wsgi Aug 10 17:40:38.089044 n-d-852296-2 devstack@n-api.service[113419]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:40:38.089044 n-d-852296-2 devstack@n-api.service[113419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:40:38.089044 n-d-852296-2 devstack@n-api.service[113419]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:40:38.089044 n-d-852296-2 devstack@n-api.service[113419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:40:38.089044 n-d-852296-2 devstack@n-api.service[113419]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:40:38.089044 n-d-852296-2 devstack@n-api.service[113419]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 10 17:40:38.089044 n-d-852296-2 devstack@n-api.service[113419]: ERROR nova.api.openstack.wsgi Aug 10 17:40:38.089044 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi [None req-8938c84d-9ebe-4f48-8807-300671f513a1 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=113419) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:40:38.090330 n-d-852296-2 devstack@n-api.service[113419]: INFO nova.api.openstack.requestlog [None req-8938c84d-9ebe-4f48-8807-300671f513a1 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012395 Aug 10 17:40:38.090330 n-d-852296-2 devstack@n-api.service[113419]: [pid: 113419|app: 0|req: 27/52] 10.222.0.50 () {60 vars in 1193 bytes} [Wed Aug 10 17:40:38 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 10 17:40:39.073576 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi [None req-6ca62fb5-0bb7-40c9-b142-0366bc3d2ce8 admin admin] Calling method '>' {{(pid=113418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:40:39.074590 n-d-852296-2 devstack@n-api.service[113418]: INFO nova.api.openstack.requestlog [None req-6ca62fb5-0bb7-40c9-b142-0366bc3d2ce8 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Aug 10 17:40:39.074992 n-d-852296-2 devstack@n-api.service[113418]: [pid: 113418|app: 0|req: 26/53] 10.222.0.50 () {56 vars in 1074 bytes} [Wed Aug 10 17:40:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:40:39.614747 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi [None req-ebe890c7-bce2-423a-8228-35e4e2fab5c0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=113419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:40:39.725991 n-d-852296-2 devstack@n-api.service[113419]: INFO nova.api.openstack.requestlog [None req-ebe890c7-bce2-423a-8228-35e4e2fab5c0 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.513366 Aug 10 17:40:39.726502 n-d-852296-2 devstack@n-api.service[113419]: [pid: 113419|app: 0|req: 28/54] 10.222.0.50 () {64 vars in 1235 bytes} [Wed Aug 10 17:40:39 2022] POST /compute/v2.1/flavors => generated 404 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 17:40:40.703359 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi [None req-6ca62fb5-0bb7-40c9-b142-0366bc3d2ce8 admin admin] Calling method '>' {{(pid=113418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:40:40.704408 n-d-852296-2 devstack@n-api.service[113418]: INFO nova.api.openstack.requestlog [None req-6ca62fb5-0bb7-40c9-b142-0366bc3d2ce8 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Aug 10 17:40:40.704816 n-d-852296-2 devstack@n-api.service[113418]: [pid: 113418|app: 0|req: 27/55] 10.222.0.50 () {56 vars in 1074 bytes} [Wed Aug 10 17:40:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:40:41.239153 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi [None req-adb66407-be88-4b97-ae73-43c5f9d554f2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=113419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:40:41.308154 n-d-852296-2 devstack@n-api.service[113419]: INFO nova.api.openstack.requestlog [None req-adb66407-be88-4b97-ae73-43c5f9d554f2 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.463881 Aug 10 17:40:41.308735 n-d-852296-2 devstack@n-api.service[113419]: [pid: 113419|app: 0|req: 29/56] 10.222.0.50 () {64 vars in 1235 bytes} [Wed Aug 10 17:40:40 2022] POST /compute/v2.1/flavors => generated 405 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 17:40:42.286018 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi [None req-6ca62fb5-0bb7-40c9-b142-0366bc3d2ce8 admin admin] Calling method '>' {{(pid=113418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:40:42.287052 n-d-852296-2 devstack@n-api.service[113418]: INFO nova.api.openstack.requestlog [None req-6ca62fb5-0bb7-40c9-b142-0366bc3d2ce8 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Aug 10 17:40:42.287448 n-d-852296-2 devstack@n-api.service[113418]: [pid: 113418|app: 0|req: 28/57] 10.222.0.50 () {56 vars in 1074 bytes} [Wed Aug 10 17:40:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:40:42.825346 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi [None req-aabb3107-685e-4412-b0d0-5d9a4d464f53 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=113419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:40:42.931706 n-d-852296-2 devstack@n-api.service[113419]: INFO nova.api.openstack.requestlog [None req-aabb3107-685e-4412-b0d0-5d9a4d464f53 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.506774 Aug 10 17:40:42.932299 n-d-852296-2 devstack@n-api.service[113419]: [pid: 113419|app: 0|req: 30/58] 10.222.0.50 () {64 vars in 1235 bytes} [Wed Aug 10 17:40:42 2022] POST /compute/v2.1/flavors => generated 407 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 17:40:43.898918 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi [None req-6ca62fb5-0bb7-40c9-b142-0366bc3d2ce8 admin admin] Calling method '>' {{(pid=113418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:40:43.899977 n-d-852296-2 devstack@n-api.service[113418]: INFO nova.api.openstack.requestlog [None req-6ca62fb5-0bb7-40c9-b142-0366bc3d2ce8 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Aug 10 17:40:43.900592 n-d-852296-2 devstack@n-api.service[113418]: [pid: 113418|app: 0|req: 29/59] 10.222.0.50 () {56 vars in 1074 bytes} [Wed Aug 10 17:40:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:40:44.448571 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi [None req-21fd56a0-d3ff-4e37-89c6-814f434ae2ff admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=113419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:40:44.525626 n-d-852296-2 devstack@n-api.service[113419]: INFO nova.api.openstack.requestlog [None req-21fd56a0-d3ff-4e37-89c6-814f434ae2ff admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.485623 Aug 10 17:40:44.526416 n-d-852296-2 devstack@n-api.service[113419]: [pid: 113419|app: 0|req: 31/60] 10.222.0.50 () {64 vars in 1235 bytes} [Wed Aug 10 17:40:44 2022] POST /compute/v2.1/flavors => generated 409 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 17:40:45.495446 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi [None req-6ca62fb5-0bb7-40c9-b142-0366bc3d2ce8 admin admin] Calling method '>' {{(pid=113418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:40:45.496591 n-d-852296-2 devstack@n-api.service[113418]: INFO nova.api.openstack.requestlog [None req-6ca62fb5-0bb7-40c9-b142-0366bc3d2ce8 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001512 Aug 10 17:40:45.496967 n-d-852296-2 devstack@n-api.service[113418]: [pid: 113418|app: 0|req: 30/61] 10.222.0.50 () {56 vars in 1074 bytes} [Wed Aug 10 17:40:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:40:46.014502 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi [None req-c8d9d646-2ae3-4ef0-98fe-9f9d850b6e64 admin admin] Calling method '>' {{(pid=113419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:40:46.035817 n-d-852296-2 devstack@n-api.service[113419]: INFO nova.api.openstack.requestlog [None req-c8d9d646-2ae3-4ef0-98fe-9f9d850b6e64 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.401304 Aug 10 17:40:46.036391 n-d-852296-2 devstack@n-api.service[113419]: [pid: 113419|app: 0|req: 32/62] 10.222.0.50 () {60 vars in 1202 bytes} [Wed Aug 10 17:40:45 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:41:38.494024 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi [None req-6ca62fb5-0bb7-40c9-b142-0366bc3d2ce8 admin admin] Calling method '>' {{(pid=113418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:41:38.495121 n-d-852296-2 devstack@n-api.service[113418]: INFO nova.api.openstack.requestlog [None req-6ca62fb5-0bb7-40c9-b142-0366bc3d2ce8 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001520 Aug 10 17:41:38.495562 n-d-852296-2 devstack@n-api.service[113418]: [pid: 113418|app: 0|req: 31/63] 10.222.0.50 () {54 vars in 931 bytes} [Wed Aug 10 17:41:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:41:38.506537 n-d-852296-2 devstack@n-api.service[113419]: DEBUG dbcounter [-] [113419] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=4 {{(pid=113419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:41:38.913144 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi [None req-f51d6217-8c50-4fc1-aa9f-2b0f96697a9c admin admin] Calling method '>' {{(pid=113419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:41:38.936232 n-d-852296-2 devstack@n-api.service[113419]: INFO nova.api.openstack.requestlog [None req-f51d6217-8c50-4fc1-aa9f-2b0f96697a9c admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.434037 Aug 10 17:41:38.936739 n-d-852296-2 devstack@n-api.service[113419]: [pid: 113419|app: 0|req: 33/64] 10.222.0.50 () {60 vars in 1292 bytes} [Wed Aug 10 17:41:38 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:41:38.958038 n-d-852296-2 devstack@n-api.service[113418]: DEBUG dbcounter [-] [113418] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=22,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=113418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:41:38.961837 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi [None req-872c58f7-7032-405b-9e70-40a2c24ae107 admin admin] Calling method '>' {{(pid=113418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:41:38.969692 n-d-852296-2 devstack@n-api.service[113418]: INFO nova.api.openstack.requestlog [None req-872c58f7-7032-405b-9e70-40a2c24ae107 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013092 Aug 10 17:41:38.976754 n-d-852296-2 devstack@n-api.service[113418]: [pid: 113418|app: 0|req: 32/65] 10.222.0.50 () {60 vars in 1283 bytes} [Wed Aug 10 17:41:38 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:41:38.982451 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi [None req-f6bb58a2-1800-4079-a7c5-9cbb3e201888 admin admin] Calling method '>' {{(pid=113419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:41:38.990343 n-d-852296-2 devstack@n-api.service[113419]: INFO nova.api.openstack.requestlog [None req-f6bb58a2-1800-4079-a7c5-9cbb3e201888 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011882 Aug 10 17:41:38.990894 n-d-852296-2 devstack@n-api.service[113419]: [pid: 113419|app: 0|req: 34/66] 10.222.0.50 () {60 vars in 1286 bytes} [Wed Aug 10 17:41:38 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:41:39.003624 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi [None req-61aac07e-8921-45f8-b4e8-0f8cde9a2159 admin admin] Calling method '>' {{(pid=113418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:41:39.012437 n-d-852296-2 devstack@n-api.service[113418]: INFO nova.api.openstack.requestlog [None req-61aac07e-8921-45f8-b4e8-0f8cde9a2159 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012303 Aug 10 17:41:39.013069 n-d-852296-2 devstack@n-api.service[113418]: [pid: 113418|app: 0|req: 33/67] 10.222.0.50 () {60 vars in 1286 bytes} [Wed Aug 10 17:41:38 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:41:39.024851 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi [None req-33ec54d5-e88c-490a-9f2b-04dfaf7c9893 admin admin] Calling method '>' {{(pid=113419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:41:39.032839 n-d-852296-2 devstack@n-api.service[113419]: INFO nova.api.openstack.requestlog [None req-33ec54d5-e88c-490a-9f2b-04dfaf7c9893 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011668 Aug 10 17:41:39.033367 n-d-852296-2 devstack@n-api.service[113419]: [pid: 113419|app: 0|req: 35/68] 10.222.0.50 () {60 vars in 1283 bytes} [Wed Aug 10 17:41:39 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:47:14.075947 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi [None req-61aac07e-8921-45f8-b4e8-0f8cde9a2159 admin admin] Calling method '>' {{(pid=113418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:47:14.076978 n-d-852296-2 devstack@n-api.service[113418]: INFO nova.api.openstack.requestlog [None req-61aac07e-8921-45f8-b4e8-0f8cde9a2159 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Aug 10 17:47:14.077401 n-d-852296-2 devstack@n-api.service[113418]: [pid: 113418|app: 0|req: 34/69] 10.222.0.50 () {56 vars in 1074 bytes} [Wed Aug 10 17:47:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:47:14.217511 n-d-852296-2 devstack@n-api.service[113419]: DEBUG dbcounter [-] [113419] Writing DB stats nova_api:SELECT=6 {{(pid=113419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:47:14.365373 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi [None req-e81226e4-68d3-474e-85c2-06978dae2b70 admin admin] Calling method '>' {{(pid=113419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:47:14.367803 n-d-852296-2 devstack@n-api.service[113419]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:47:14.367803 n-d-852296-2 devstack@n-api.service[113419]: warnings.warn(msg) Aug 10 17:47:14.368986 n-d-852296-2 devstack@n-api.service[113419]: DEBUG oslo_concurrency.lockutils [None req-e81226e4-68d3-474e-85c2-06978dae2b70 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=113419) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:47:14.369453 n-d-852296-2 devstack@n-api.service[113419]: DEBUG oslo_concurrency.lockutils [None req-e81226e4-68d3-474e-85c2-06978dae2b70 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=113419) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:47:14.369875 n-d-852296-2 devstack@n-api.service[113419]: DEBUG oslo_concurrency.lockutils [None req-e81226e4-68d3-474e-85c2-06978dae2b70 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113419) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:47:14.370574 n-d-852296-2 devstack@n-api.service[113419]: DEBUG oslo_concurrency.lockutils [None req-e81226e4-68d3-474e-85c2-06978dae2b70 admin admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=113419) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:47:14.371018 n-d-852296-2 devstack@n-api.service[113419]: DEBUG oslo_concurrency.lockutils [None req-e81226e4-68d3-474e-85c2-06978dae2b70 admin admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113419) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:47:14.371462 n-d-852296-2 devstack@n-api.service[113419]: DEBUG oslo_concurrency.lockutils [None req-e81226e4-68d3-474e-85c2-06978dae2b70 admin admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113419) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:47:14.412042 n-d-852296-2 devstack@n-api.service[113419]: INFO nova.api.openstack.requestlog [None req-e81226e4-68d3-474e-85c2-06978dae2b70 admin admin] 10.222.0.50 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.90 time: 0.196135 Aug 10 17:47:14.412620 n-d-852296-2 devstack@n-api.service[113419]: [pid: 113419|app: 0|req: 36/70] 10.222.0.50 () {60 vars in 1193 bytes} [Wed Aug 10 17:47:14 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:47:15.244330 n-d-852296-2 devstack@n-api.service[113418]: DEBUG nova.api.openstack.wsgi [None req-61aac07e-8921-45f8-b4e8-0f8cde9a2159 admin admin] Calling method '>' {{(pid=113418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:47:15.245398 n-d-852296-2 devstack@n-api.service[113418]: INFO nova.api.openstack.requestlog [None req-61aac07e-8921-45f8-b4e8-0f8cde9a2159 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001581 Aug 10 17:47:15.245830 n-d-852296-2 devstack@n-api.service[113418]: [pid: 113418|app: 0|req: 35/71] 10.222.0.50 () {56 vars in 1074 bytes} [Wed Aug 10 17:47:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:47:15.443121 n-d-852296-2 devstack@n-api.service[113419]: DEBUG nova.api.openstack.wsgi [None req-90eaeb63-31b1-4dce-b323-537594cb34a7 admin admin] Calling method '>' {{(pid=113419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:47:15.445501 n-d-852296-2 devstack@n-api.service[113419]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:47:15.445501 n-d-852296-2 devstack@n-api.service[113419]: warnings.warn(msg) Aug 10 17:47:15.446595 n-d-852296-2 devstack@n-api.service[113419]: DEBUG oslo_concurrency.lockutils [None req-90eaeb63-31b1-4dce-b323-537594cb34a7 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=113419) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:47:15.447065 n-d-852296-2 devstack@n-api.service[113419]: DEBUG oslo_concurrency.lockutils [None req-90eaeb63-31b1-4dce-b323-537594cb34a7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113419) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:47:15.447543 n-d-852296-2 devstack@n-api.service[113419]: DEBUG oslo_concurrency.lockutils [None req-90eaeb63-31b1-4dce-b323-537594cb34a7 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113419) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:47:15.448273 n-d-852296-2 devstack@n-api.service[113419]: DEBUG oslo_concurrency.lockutils [None req-90eaeb63-31b1-4dce-b323-537594cb34a7 admin admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=113419) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:47:15.448711 n-d-852296-2 devstack@n-api.service[113419]: DEBUG oslo_concurrency.lockutils [None req-90eaeb63-31b1-4dce-b323-537594cb34a7 admin admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113419) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:47:15.449123 n-d-852296-2 devstack@n-api.service[113419]: DEBUG oslo_concurrency.lockutils [None req-90eaeb63-31b1-4dce-b323-537594cb34a7 admin admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113419) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:47:15.472229 n-d-852296-2 devstack@n-api.service[113419]: INFO nova.api.openstack.requestlog [None req-90eaeb63-31b1-4dce-b323-537594cb34a7 admin admin] 10.222.0.50 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.90 time: 0.081720 Aug 10 17:47:15.472730 n-d-852296-2 devstack@n-api.service[113419]: [pid: 113419|app: 0|req: 37/72] 10.222.0.50 () {60 vars in 1193 bytes} [Wed Aug 10 17:47:15 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:48:03.408142 n-d-852296-2 devstack@n-api.service[113417]: Wed Aug 10 17:48:03 2022 - graceful shutdown triggered... Aug 10 17:48:03.408702 n-d-852296-2 devstack@n-api.service[113418]: Gracefully killing worker 1 (pid: 113418)... Aug 10 17:48:03.409079 n-d-852296-2 devstack@n-api.service[113419]: Gracefully killing worker 2 (pid: 113419)... Aug 10 17:48:03.411806 n-d-852296-2 systemd[1]: Stopping Devstack devstack@n-api.service... Aug 10 17:48:04.408470 n-d-852296-2 devstack@n-api.service[113417]: worker 1 buried after 1 seconds Aug 10 17:48:04.408470 n-d-852296-2 devstack@n-api.service[113417]: worker 2 buried after 1 seconds Aug 10 17:48:04.408470 n-d-852296-2 devstack@n-api.service[113417]: goodbye to uWSGI. Aug 10 17:48:04.409982 n-d-852296-2 systemd[1]: devstack@n-api.service: Succeeded. Aug 10 17:48:04.410652 n-d-852296-2 systemd[1]: Stopped Devstack devstack@n-api.service. Aug 10 17:48:04.413905 n-d-852296-2 systemd[1]: Starting Devstack devstack@n-api.service... Aug 10 17:48:04.433852 n-d-852296-2 devstack@n-api.service[129399]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 10 17:48:04.449438 n-d-852296-2 devstack@n-api.service[129399]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 10 17:48:04 2022] *** Aug 10 17:48:04.449438 n-d-852296-2 devstack@n-api.service[129399]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 10 17:48:04.449438 n-d-852296-2 devstack@n-api.service[129399]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 10 17:48:04.449438 n-d-852296-2 devstack@n-api.service[129399]: nodename: n-d-852296-2 Aug 10 17:48:04.449438 n-d-852296-2 devstack@n-api.service[129399]: machine: x86_64 Aug 10 17:48:04.449438 n-d-852296-2 devstack@n-api.service[129399]: clock source: unix Aug 10 17:48:04.449438 n-d-852296-2 devstack@n-api.service[129399]: pcre jit disabled Aug 10 17:48:04.449438 n-d-852296-2 devstack@n-api.service[129399]: detected number of CPU cores: 4 Aug 10 17:48:04.449438 n-d-852296-2 devstack@n-api.service[129399]: current working directory: / Aug 10 17:48:04.449438 n-d-852296-2 devstack@n-api.service[129399]: detected binary path: /usr/bin/uwsgi-core Aug 10 17:48:04.449438 n-d-852296-2 devstack@n-api.service[129399]: your processes number limit is 47680 Aug 10 17:48:04.450391 n-d-852296-2 devstack@n-api.service[129399]: your memory page size is 4096 bytes Aug 10 17:48:04.450391 n-d-852296-2 devstack@n-api.service[129399]: detected max file descriptor number: 2048 Aug 10 17:48:04.450391 n-d-852296-2 devstack@n-api.service[129399]: lock engine: pthread robust mutexes Aug 10 17:48:04.450391 n-d-852296-2 devstack@n-api.service[129399]: thunder lock: enabled Aug 10 17:48:04.450391 n-d-852296-2 devstack@n-api.service[129399]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 10 17:48:04.450391 n-d-852296-2 devstack@n-api.service[129399]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 10 17:48:04.494530 n-d-852296-2 devstack@n-api.service[129399]: Python main interpreter initialized at 0x561f8ae929c0 Aug 10 17:48:04.494530 n-d-852296-2 devstack@n-api.service[129399]: python threads support enabled Aug 10 17:48:04.494530 n-d-852296-2 devstack@n-api.service[129399]: your server socket listen backlog is limited to 100 connections Aug 10 17:48:04.494530 n-d-852296-2 devstack@n-api.service[129399]: your mercy for graceful operations on workers is 90 seconds Aug 10 17:48:04.495024 n-d-852296-2 devstack@n-api.service[129399]: mapped 403077 bytes (393 KB) for 2 cores Aug 10 17:48:04.495024 n-d-852296-2 devstack@n-api.service[129399]: *** Operational MODE: preforking *** Aug 10 17:48:04.495250 n-d-852296-2 devstack@n-api.service[129399]: *** uWSGI is running in multiple interpreter mode *** Aug 10 17:48:04.495250 n-d-852296-2 devstack@n-api.service[129399]: spawned uWSGI master process (pid: 129399) Aug 10 17:48:04.495469 n-d-852296-2 systemd[1]: Started Devstack devstack@n-api.service. Aug 10 17:48:04.497198 n-d-852296-2 devstack@n-api.service[129399]: spawned uWSGI worker 1 (pid: 129409, cores: 1) Aug 10 17:48:04.497198 n-d-852296-2 devstack@n-api.service[129399]: spawned uWSGI worker 2 (pid: 129410, cores: 1) Aug 10 17:48:04.497198 n-d-852296-2 devstack@n-api.service[129399]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 10 17:48:05.178234 n-d-852296-2 devstack@n-api.service[129410]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 10 17:48:05.208430 n-d-852296-2 devstack@n-api.service[129409]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 10 17:48:06.344280 n-d-852296-2 devstack@n-api.service[129410]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 17:48:06.344280 n-d-852296-2 devstack@n-api.service[129410]: from cryptography.utils import int_from_bytes Aug 10 17:48:06.344889 n-d-852296-2 devstack@n-api.service[129410]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 17:48:06.344889 n-d-852296-2 devstack@n-api.service[129410]: from cryptography.utils import int_from_bytes Aug 10 17:48:06.415170 n-d-852296-2 devstack@n-api.service[129409]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 17:48:06.415170 n-d-852296-2 devstack@n-api.service[129409]: from cryptography.utils import int_from_bytes Aug 10 17:48:06.415786 n-d-852296-2 devstack@n-api.service[129409]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 17:48:06.415786 n-d-852296-2 devstack@n-api.service[129409]: from cryptography.utils import int_from_bytes Aug 10 17:48:08.656261 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 10 17:48:08.656845 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 10 17:48:08.657044 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 10 17:48:08.657407 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 10 17:48:08.657659 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 10 17:48:08.658045 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.658366 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.658688 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.659003 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.659328 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.659637 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.659952 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.660285 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.660611 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.660869 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.661181 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.661506 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-852296-2 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.661824 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.662124 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.662429 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.663005 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.663305 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.663622 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.663935 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.664465 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.664904 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.665207 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.665513 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.665845 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.666153 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.666462 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.666777 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.667080 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.667451 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.667762 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.668160 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-852296-2 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.668552 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.668867 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.669176 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.669585 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.669900 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.670324 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.670649 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.670971 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.671273 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.671604 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.671919 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.672237 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.672576 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.672876 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.673183 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.673489 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.673803 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.674105 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.674426 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.674655 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.674960 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.675277 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.675595 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.675912 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.676160 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.676430 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.676748 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.677064 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.677453 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.677706 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.678010 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.678313 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.678617 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.678922 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.679224 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.679529 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.679850 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.680158 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.680495 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.680801 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.681116 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.681511 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.50 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.681758 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.50 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.682064 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.682397 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.682710 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.683017 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.683332 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.683650 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.683954 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.684307 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.684640 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.684956 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.685287 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.685591 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.686375 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.686678 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.686982 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.687296 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.687600 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.687904 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.688207 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.688527 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.688831 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.689136 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.689435 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.689735 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.690039 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.690342 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.690642 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.690943 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.691244 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.691558 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.691879 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.692180 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.692506 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.692809 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.693111 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.693426 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.693726 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.694026 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.694372 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.694697 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.695000 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.695314 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.695620 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.695924 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.696237 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.696554 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.696857 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.697170 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.697476 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.697779 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.698079 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.698381 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.698678 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.698978 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.699280 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.699576 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.699873 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.700188 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.700528 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.700831 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.701135 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.702035 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.702356 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.702767 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.703012 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.703352 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.703667 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.703999 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.704357 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.704749 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.704990 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.705300 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.705625 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.705935 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.706244 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.706552 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.706868 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.707185 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.707509 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.707826 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.708142 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.708483 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.708795 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.709111 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.709434 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.709753 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.710062 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.710402 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.710745 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.711054 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.711377 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.711696 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.712009 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.712360 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.712671 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.712991 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.713321 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.713631 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.713944 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.714252 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.714563 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.714872 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.715180 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.715490 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.715821 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.716132 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.716472 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.716784 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.717149 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.717433 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.717742 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.718051 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.718351 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.718655 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.718954 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.719259 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.719558 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.719874 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.720198 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.720521 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.720851 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.721150 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.721457 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.721764 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.722075 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.722374 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.722682 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.722987 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.723288 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.723609 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.723915 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.724217 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.724557 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.724859 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.725158 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.725468 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.725773 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.726079 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.726387 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.726696 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.727014 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.727323 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.727633 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.727964 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.728307 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.728615 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.728936 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.729330 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.729569 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.729868 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.730173 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.730474 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.730774 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.731073 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.731376 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.731674 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.731977 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.732294 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.732620 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.732921 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.733239 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.733537 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.733835 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.734133 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.734434 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.734769 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.735069 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.735406 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.735735 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.736049 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.736389 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.736699 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.737012 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.737318 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.737625 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.737922 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.738246 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.738534 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.738842 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.739156 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.739465 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.739784 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.740089 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.740425 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.740731 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.741042 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.741374 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.741701 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.742022 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.742339 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.742649 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.742961 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.743265 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.743571 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.743877 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.744183 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.744519 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.744821 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.745133 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.745435 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.745749 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.746053 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.746364 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.746661 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.746968 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.747289 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.747666 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.747921 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.748870 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.749205 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.749516 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.749825 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.750133 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.750437 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.750739 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.751045 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.751354 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.751659 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.751965 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.752291 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.752603 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.752907 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.753206 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.753503 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.753811 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.754127 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.754433 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.754749 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.755067 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.755365 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.755665 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.755981 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.756305 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.756606 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.756906 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.757206 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.757543 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.757847 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.758147 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.758455 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.758786 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.759076 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.759383 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.759689 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.759994 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.760326 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.760638 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.760941 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.761248 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.761553 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.761858 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.762162 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.762483 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.762789 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.763095 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.763400 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.763698 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.764145 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.764496 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.765069 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.765407 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.765722 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.766041 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.766360 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.766678 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.767009 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.767333 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.767675 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.767980 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.768309 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.768615 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.768916 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.769226 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.769528 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.769830 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.770134 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.770438 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.770738 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.771037 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.771337 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.771637 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.771944 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.772268 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.772572 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.772874 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.773192 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.773494 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.773794 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.774092 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.774392 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.774727 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.775025 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.775357 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.775678 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.776014 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.776341 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.776645 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.776965 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.777264 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.777562 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.777859 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.778162 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.778464 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.778759 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.779067 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.779371 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.780207 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.780534 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.780836 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.781140 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.781440 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.781750 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.782052 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.782350 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.782648 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.782956 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.783257 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.783554 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.783857 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.784154 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.784560 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.784864 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.785163 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.785460 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.785765 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.786068 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.786366 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.786680 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.786984 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.787282 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.787844 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.788437 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.788740 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.789042 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.789349 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.789667 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.789975 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.790274 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.790575 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.790900 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.791173 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.791473 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.791778 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.792078 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.792401 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.792698 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.793000 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.793304 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.793616 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.793918 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.794217 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.794516 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.794813 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.795222 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.795524 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.795875 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.796186 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.796510 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.796823 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.797131 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.797439 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.797747 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.798046 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.798358 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.798664 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.798972 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.799274 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.799576 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.799893 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.800201 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.800533 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.800849 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.801166 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.801488 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.801788 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.802091 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.802405 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.802706 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.803012 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.803315 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.803625 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.803931 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.804238 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.804565 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.804871 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.805173 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.805478 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.805782 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.806081 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.806401 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.806706 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.807006 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.807985 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.807985 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.807985 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.808289 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.808634 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.808945 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.809253 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.809595 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.809862 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.810169 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.810483 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.811335 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.811637 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.812055 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.812388 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.812698 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.813008 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.813311 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.813617 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.813925 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.814246 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.814548 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.814848 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.815086 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 10 17:48:08.815522 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.815666 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 10 17:48:08.815775 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.815775 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.815947 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 10 17:48:08.816044 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.816230 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 10 17:48:08.816471 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.816592 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 10 17:48:08.816780 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.816888 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.817083 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.817206 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.817492 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.817602 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.817801 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.817905 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.818110 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.818217 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.818430 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.818529 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.818747 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.818856 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.819067 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.819171 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.819370 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.819467 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.819660 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.819798 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.819977 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.820094 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.820307 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.820513 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-852296-2 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.820668 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.820810 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.820964 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.821120 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.821277 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.821431 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.821573 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.821725 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.821876 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.822031 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.822175 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.822326 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.822489 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.822634 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.822797 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.822960 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.823143 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.823299 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.823452 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.823610 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.823780 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.823940 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.824084 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.824302 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.824448 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.824595 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.824750 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.824894 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.825045 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.825196 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.825349 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.825508 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.825678 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.825839 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.826000 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.826158 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.826394 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.826574 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.826727 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-852296-2 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.826874 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.827050 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.827203 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.827354 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.827520 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.828153 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.828298 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.828491 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.828662 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.828811 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.828985 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.829114 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.829305 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.829431 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.829635 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.829766 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.829998 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.830098 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.830268 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.830374 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.830662 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.830793 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.830933 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.831046 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.831232 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.831360 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.831534 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.831672 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.831834 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.831942 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.832136 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.832239 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.832486 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.832583 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.832794 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.832902 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.833112 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.833208 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.833426 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.833523 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.833682 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.833779 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.833999 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.834096 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.834327 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.834424 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.834654 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.834757 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.834971 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.835079 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.835227 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.835322 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.835481 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.835580 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.835806 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.835985 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.836132 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.836229 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.836472 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.836577 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.836774 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.836868 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.837076 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.837177 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.837379 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.837478 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.837685 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.837793 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.837986 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.838090 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.838286 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.838382 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.838586 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.838682 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.838902 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.839005 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.839201 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.839305 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.839518 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.839616 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.839824 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.839986 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.840132 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.840235 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.840437 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.840544 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.50 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.840784 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.840895 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.50 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.841072 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.841185 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.841373 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.841471 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.841697 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.841817 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.842046 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.842188 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.842368 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.842684 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.842827 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.842994 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.843089 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.843305 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.843410 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.843622 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.843718 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.843931 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.844042 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.844279 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.844408 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.844574 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.844678 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.844881 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.844996 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.845194 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.845292 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.845502 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.845620 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.845812 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.845931 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.846136 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.846359 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.846466 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.846691 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.846802 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.847007 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.847112 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.847320 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.847424 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.847630 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.847735 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.847942 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.848041 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.848267 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.848378 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.848583 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.848706 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.848893 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.848998 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.849203 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.849299 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.849510 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.849622 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.849816 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.849919 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.850126 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.850222 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.850492 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.850650 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.850788 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.851012 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.851152 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.851254 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.851358 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.851448 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.851653 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.851751 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.851965 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.852073 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.852316 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.852429 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.852629 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.852739 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.852941 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.853060 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.853250 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.853347 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.853570 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.853687 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.853876 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.853973 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.854182 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.854328 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.854490 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.854596 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.854798 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.854893 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.855106 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.855200 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.855412 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.855507 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.855716 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.855818 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.856027 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.856136 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.856360 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.856470 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.856673 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.856772 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.856982 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.857093 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.857291 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.857396 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.857632 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.857776 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.857922 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.858179 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.858280 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.858596 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.858732 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.858911 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.859041 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.859221 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.859368 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.859549 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.859671 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.859879 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.860074 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.860220 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.860380 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.860514 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.860648 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.860824 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.860942 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.861152 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:48:08.861268 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.861488 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.861594 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.861792 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.861898 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.862098 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.862202 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.862397 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.862509 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.862716 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.862827 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.863020 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.863124 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.863321 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.863418 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.863644 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.863744 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.863950 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.864054 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.864388 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.864488 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.864711 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.864836 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.865031 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.865136 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.865349 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.865453 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.865675 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.865779 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.866000 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.866103 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.866333 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.866430 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.866659 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.866764 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.866962 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.867111 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.867266 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.867445 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.867577 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.867675 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.867884 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.868033 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.868178 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.868358 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.868503 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.868597 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.868796 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.868899 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.869103 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.869217 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.869403 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.869531 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.869710 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.869852 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.870012 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.870185 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.870337 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.870512 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.870639 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.870830 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.870937 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.871147 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.871373 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.871487 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.871579 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.871777 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.871890 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.872095 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.872190 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.872420 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.872519 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.872722 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.872838 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.873030 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.873652 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.873867 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.874113 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.874220 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.874459 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.874609 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.874768 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.874934 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.875069 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.875240 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.875373 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.875586 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.875692 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.875910 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.876015 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.876233 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.876401 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.876578 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.876683 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.876902 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.876998 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.877208 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.877311 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.877524 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:08.877626 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.108329 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.108476 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.109428 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.109518 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.109518 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.109723 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.109812 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.109905 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.109995 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.110090 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.110165 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.110247 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.110329 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.110423 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.110504 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.110579 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.110662 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.110818 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.110922 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.110994 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.111062 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.111130 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.111197 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.111274 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.111344 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.111442 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.111511 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.111580 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.111657 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.111728 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.111798 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.111866 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.111935 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.112012 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.112097 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.112201 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.112313 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.112386 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.112456 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.112540 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.112621 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.112720 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.112791 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.112861 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.112931 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.113010 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.113082 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.113152 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.113222 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.113396 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.113623 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.113706 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.113777 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.113896 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.113971 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.114042 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.114122 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.114221 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.114297 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.114372 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.114442 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.114512 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.114619 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.114693 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.114763 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.114833 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.114903 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.114972 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.115051 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.115150 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.115221 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.115291 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.115291 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.115455 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.115529 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.115599 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.115669 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.115741 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.115819 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.115891 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.115962 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.116039 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.116166 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.116239 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.116332 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.116402 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.116472 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.116556 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.116674 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.116776 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.116851 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.116974 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.117075 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.117190 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.117252 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.117347 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.117423 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.117494 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.117617 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.117693 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.117766 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.117836 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.117934 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.118008 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.118088 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.118181 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.118258 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.118329 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.118399 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.118469 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.118548 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.118647 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.118750 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.118875 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.118952 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.119025 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.119096 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.119183 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.119297 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.119413 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.119487 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.119559 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.119639 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.119738 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.119812 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.119884 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.119956 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.120027 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.120106 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.120180 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.120286 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.120363 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.120435 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.120506 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.120591 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.120666 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.120738 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.120808 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.120880 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.120880 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.121120 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.121240 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.121338 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.121441 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.121530 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.121648 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.121747 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.121820 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.121916 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.121991 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.122062 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.122186 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.122265 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.122337 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.122408 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.122480 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.122577 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.122690 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.122765 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.122837 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.122907 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.122978 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.123048 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.123151 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.123228 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.123300 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.123369 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.123481 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.123608 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.123687 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.123759 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.123832 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.123903 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.123962 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.124133 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.124272 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.124352 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.124470 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.124546 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.124619 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.124619 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.124827 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.124900 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.125008 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.125083 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.125181 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.125324 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.125404 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.125464 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.125551 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.125685 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.125771 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.125852 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.125926 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.126026 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.126122 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.126202 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.126421 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.126541 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.126622 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.126782 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.126899 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.127021 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.127131 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.127284 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.127409 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.127475 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.127561 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.127720 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.127911 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.127993 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.128054 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.128112 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.128182 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.128281 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.128397 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.128540 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.128683 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.128830 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.128947 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.129073 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.129245 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.129424 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.129569 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.129690 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.129807 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.129932 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.130050 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.130217 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.130389 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.130550 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.130710 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.130936 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.131081 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.131201 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.131318 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.131533 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.131671 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.131846 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.132013 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.132133 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.132297 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.132419 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.132563 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.132880 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.133012 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.133184 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.133362 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.133509 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.133626 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.140703 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.140810 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.140904 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.140999 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.141081 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.141157 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.141237 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.141237 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 10 17:48:09.141418 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.141418 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.141418 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.141418 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.141418 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.141418 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.141418 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.141418 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.141876 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.141876 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.141876 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.141876 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.141876 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.141876 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.141876 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.141876 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.142394 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.142394 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.142394 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.142394 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.142394 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.142394 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.142394 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.142394 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.143052 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.143052 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.143052 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.143052 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.143052 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.143052 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.143052 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.143052 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.143615 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.143615 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.143615 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.143615 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.143615 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.143615 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.143615 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.143615 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.144074 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.144074 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.144074 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.144074 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.144074 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.144074 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.144074 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.144074 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.144561 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.144561 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.144561 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.144561 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.144561 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.144561 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.144561 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.144561 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.145134 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.145134 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.145134 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.145134 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.145134 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.145134 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.145134 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.145134 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.145861 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.145861 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.145861 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.145861 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.145861 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.145861 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.145861 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.145861 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.146464 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.146464 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.146464 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.146648 n-d-852296-2 devstack@n-api.service[129410]: INFO dbcounter [None req-d49a6c93-2a94-46a6-85a7-e04d59575662 None None] Registered counter for database nova_api Aug 10 17:48:09.146726 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.146726 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.146726 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.146726 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.146726 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.146726 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.146726 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.146726 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.149600 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.149600 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.149600 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.149600 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.149600 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.149600 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.149600 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.149600 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.151602 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.152122 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.152635 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.153040 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.153438 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.154320 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.155969 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.156297 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.156708 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.158695 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.158695 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.158695 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.158695 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.159336 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.159699 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.160151 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.161045 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.161045 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.161274 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.161518 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.161919 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.162174 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.162898 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.163328 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.163808 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.164521 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.164921 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.166198 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.166368 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_db.sqlalchemy.engines [None req-d49a6c93-2a94-46a6-85a7-e04d59575662 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129410) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 17:48:09.166518 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.166518 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.166823 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.167060 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.167373 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.167863 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.168382 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.168938 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.169477 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.170003 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.170536 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.171041 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.171518 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.172067 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.172603 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.173107 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.173612 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.174093 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.174288 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writer thread running {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 17:48:09.174989 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.175601 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.176089 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.176690 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.177177 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.177691 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.178198 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.178684 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.179171 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.179655 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.180134 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.180740 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.181228 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.181705 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.182205 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.182688 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.183161 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.183661 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.184139 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.184833 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.185316 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.186081 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.186687 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.187220 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.187707 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.188098 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.188604 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.189057 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.189505 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.189950 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.190497 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.191068 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.191506 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.191942 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.192410 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.192855 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.193306 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.193768 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.194214 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.194655 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.195274 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.195853 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.196335 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.196903 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.197464 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.197915 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.198479 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.199034 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.199484 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.199933 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.200416 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.200873 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.201929 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.202541 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.203058 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.203516 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.203982 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.204484 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.204937 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.205502 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.206061 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.206519 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.207068 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.207529 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.208029 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.208725 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.209188 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.209638 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.210115 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.210590 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.211045 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.211487 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.211935 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.212400 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.212844 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.213320 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.213838 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.214296 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.214746 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.215210 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.215768 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.216325 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.216916 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.217600 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.218122 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.218685 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.219168 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.219667 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.220128 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.220624 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.221075 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.221519 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.221963 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.222423 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.222904 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.223346 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.223804 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.224291 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.224757 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.225227 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.226493 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.227081 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.227544 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.228003 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.228506 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.229064 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.229509 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.229950 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.230395 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.230842 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.231166 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.231533 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.232141 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.232141 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.233201 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.233531 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.233840 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.234289 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.234612 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.235054 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.235156 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.context [None req-d49a6c93-2a94-46a6-85a7-e04d59575662 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),eb80cdf1-5ac7-4611-abc6-59802fe86dfd(cell1) {{(pid=129410) load_cells /opt/stack/nova/nova/context.py:464}} Aug 10 17:48:09.235372 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.236336 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.236336 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.241885 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.241885 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.241885 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.241885 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.241885 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.241885 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.241885 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.241885 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.242356 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.242356 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.242465 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d49a6c93-2a94-46a6-85a7-e04d59575662 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:48:09.242569 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.242637 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d49a6c93-2a94-46a6-85a7-e04d59575662 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:48:09.242700 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.242700 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.242700 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.242700 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.242700 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.242957 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d49a6c93-2a94-46a6-85a7-e04d59575662 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:48:09.243019 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.243019 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.243127 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d49a6c93-2a94-46a6-85a7-e04d59575662 None None] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:48:09.243198 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.243198 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.243308 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d49a6c93-2a94-46a6-85a7-e04d59575662 None None] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:48:09.243440 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.243901 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.244222 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.244567 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.244881 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.245198 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d49a6c93-2a94-46a6-85a7-e04d59575662 None None] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:48:09.245287 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.245525 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.245882 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.246211 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.246576 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.246893 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.247247 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.247372 n-d-852296-2 devstack@n-api.service[129410]: INFO dbcounter [None req-d49a6c93-2a94-46a6-85a7-e04d59575662 None None] Registered counter for database nova_cell0 Aug 10 17:48:09.248315 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.248315 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.248522 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.248983 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.249248 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.249569 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.249974 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.250201 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.250589 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.250853 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.251171 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.251486 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.251825 n-d-852296-2 devstack@n-api.service[129410]: INFO dbcounter [None req-d49a6c93-2a94-46a6-85a7-e04d59575662 None None] Registered counter for database nova_cell1 Aug 10 17:48:09.251977 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.252239 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.252577 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.252893 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.253238 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.253636 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.254213 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.254539 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.254858 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.255180 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.255834 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.256049 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.256414 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.256790 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.257116 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.257440 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.257760 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.258090 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.258396 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.258702 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.259031 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.259329 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.259480 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_db.sqlalchemy.engines [None req-d49a6c93-2a94-46a6-85a7-e04d59575662 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129410) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 17:48:09.259622 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.259954 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.260276 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.260603 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.260944 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.261199 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.261761 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.262371 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.262538 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.262877 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.266098 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.266098 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.266098 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.266098 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.266098 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.266098 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.266789 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writer thread running {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 17:48:09.266871 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.266871 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.266871 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.266871 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.267218 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.267291 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_db.sqlalchemy.engines [None req-d49a6c93-2a94-46a6-85a7-e04d59575662 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129410) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 17:48:09.267686 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.268001 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.268325 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.268639 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.270668 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.270668 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.270668 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.270668 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.270668 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.270668 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.271090 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.271090 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.271383 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.271743 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.272051 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.272402 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.272711 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.273023 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.273354 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.273662 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.273965 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.274288 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.274593 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.274942 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.275262 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.275572 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.275905 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.276214 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.276550 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.276910 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.277243 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.277813 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.278141 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.278461 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.278797 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.279123 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.280131 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.280503 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.280962 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.281289 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.281603 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.281911 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.282263 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.282580 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.282904 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.283199 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.283523 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.283823 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.284143 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.284468 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.284785 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.285082 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.285392 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.285699 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.286017 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.286356 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.286677 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.287045 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.287356 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.287987 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.288320 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.288997 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.289090 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.289413 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.289729 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.290245 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.290747 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.291222 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.291819 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.292322 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.292811 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.293302 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.293797 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.294287 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.294780 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.295510 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.296026 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.296410 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.296749 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.297145 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.297476 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.297803 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.298449 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.298762 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.299074 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.299389 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.299710 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.300022 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.300348 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.303861 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.303861 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.303861 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.303861 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.303861 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.303861 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.303861 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.303861 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.304548 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.304548 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.304548 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.304548 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.304548 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.304548 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.305399 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.305399 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.305539 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.305783 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.306097 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.306498 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.306830 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.307146 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.307470 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.307783 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.308404 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.308547 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.308841 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.309162 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.309483 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.309788 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.310121 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.310433 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.310770 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.311086 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.311480 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.311800 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.312112 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.312471 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.312800 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.313107 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.313434 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.313796 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.314116 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.314435 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.314771 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.315077 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.315387 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.315702 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.316006 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.316346 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.316660 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.316975 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.317286 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.317598 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.317913 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.318228 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.318554 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.318877 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.319186 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.319536 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.319864 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.320208 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.320544 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.320887 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.321213 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.321524 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.321834 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.322137 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:48:09.322379 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 10 17:48:09.412771 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writer thread running {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 17:48:09.421901 n-d-852296-2 devstack@n-api.service[129410]: INFO dbcounter [None req-d49a6c93-2a94-46a6-85a7-e04d59575662 None None] Registered counter for database nova_cell0 Aug 10 17:48:09.428803 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_db.sqlalchemy.engines [None req-d49a6c93-2a94-46a6-85a7-e04d59575662 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129410) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 17:48:09.433301 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writer thread running {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 17:48:09.475587 n-d-852296-2 devstack@n-api.service[129409]: INFO dbcounter [None req-3c858579-997a-4fd9-b764-4ee3b417f229 None None] Registered counter for database nova_api Aug 10 17:48:09.495471 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_db.sqlalchemy.engines [None req-3c858579-997a-4fd9-b764-4ee3b417f229 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129409) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 17:48:09.504178 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writer thread running {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 17:48:09.564235 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.context [None req-3c858579-997a-4fd9-b764-4ee3b417f229 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),eb80cdf1-5ac7-4611-abc6-59802fe86dfd(cell1) {{(pid=129409) load_cells /opt/stack/nova/nova/context.py:464}} Aug 10 17:48:09.568388 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-3c858579-997a-4fd9-b764-4ee3b417f229 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:48:09.568906 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-3c858579-997a-4fd9-b764-4ee3b417f229 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:48:09.570519 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-3c858579-997a-4fd9-b764-4ee3b417f229 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:48:09.571261 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-3c858579-997a-4fd9-b764-4ee3b417f229 None None] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:48:09.571712 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-3c858579-997a-4fd9-b764-4ee3b417f229 None None] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:48:09.573803 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-3c858579-997a-4fd9-b764-4ee3b417f229 None None] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:48:09.575935 n-d-852296-2 devstack@n-api.service[129409]: INFO dbcounter [None req-3c858579-997a-4fd9-b764-4ee3b417f229 None None] Registered counter for database nova_cell0 Aug 10 17:48:09.580813 n-d-852296-2 devstack@n-api.service[129409]: INFO dbcounter [None req-3c858579-997a-4fd9-b764-4ee3b417f229 None None] Registered counter for database nova_cell1 Aug 10 17:48:09.589036 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_db.sqlalchemy.engines [None req-3c858579-997a-4fd9-b764-4ee3b417f229 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129409) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 17:48:09.592628 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_db.sqlalchemy.engines [None req-3c858579-997a-4fd9-b764-4ee3b417f229 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129409) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 17:48:09.600788 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writer thread running {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 17:48:09.602232 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writer thread running {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 17:48:09.748141 n-d-852296-2 devstack@n-api.service[129409]: INFO dbcounter [None req-3c858579-997a-4fd9-b764-4ee3b417f229 None None] Registered counter for database nova_cell0 Aug 10 17:48:09.756970 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_db.sqlalchemy.engines [None req-3c858579-997a-4fd9-b764-4ee3b417f229 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129409) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 17:48:09.757503 n-d-852296-2 devstack@n-api.service[129410]: WARNING keystonemiddleware.auth_token [None req-d49a6c93-2a94-46a6-85a7-e04d59575662 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 17:48:09.761565 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writer thread running {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 17:48:09.765137 n-d-852296-2 devstack@n-api.service[129410]: WARNING keystonemiddleware.auth_token [None req-d49a6c93-2a94-46a6-85a7-e04d59575662 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 17:48:10.082541 n-d-852296-2 devstack@n-api.service[129409]: WARNING keystonemiddleware.auth_token [None req-3c858579-997a-4fd9-b764-4ee3b417f229 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 17:48:10.089816 n-d-852296-2 devstack@n-api.service[129409]: WARNING keystonemiddleware.auth_token [None req-3c858579-997a-4fd9-b764-4ee3b417f229 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 17:48:10.108268 n-d-852296-2 devstack@n-api.service[129410]: WARNING keystonemiddleware.auth_token [None req-d49a6c93-2a94-46a6-85a7-e04d59575662 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 17:48:10.114241 n-d-852296-2 devstack@n-api.service[129410]: WARNING keystonemiddleware.auth_token [None req-d49a6c93-2a94-46a6-85a7-e04d59575662 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 17:48:10.120431 n-d-852296-2 devstack@n-api.service[129410]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561f8ae929c0 pid: 129410 (default app) Aug 10 17:48:10.431207 n-d-852296-2 devstack@n-api.service[129409]: WARNING keystonemiddleware.auth_token [None req-3c858579-997a-4fd9-b764-4ee3b417f229 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 17:48:10.437671 n-d-852296-2 devstack@n-api.service[129409]: WARNING keystonemiddleware.auth_token [None req-3c858579-997a-4fd9-b764-4ee3b417f229 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 17:48:10.443838 n-d-852296-2 devstack@n-api.service[129409]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561f8ae929c0 pid: 129409 (default app) Aug 10 17:48:52.123972 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_api:SELECT=3 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:48:52.127370 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_cell1:SELECT=3 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:48:52.127370 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_cell0:SELECT=3 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:48:52.128220 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_cell0:SELECT=3 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:48:53.687385 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_api:SELECT=3 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:48:53.688525 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_cell1:SELECT=3 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:48:53.689291 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_cell0:SELECT=3 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:48:53.690047 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_cell0:SELECT=3 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:48:54.018534 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-f7251e84-b9e5-4647-bbbe-17c1dd79257a tempest-AggregatesAdminTestV241-1954446134 tempest-AggregatesAdminTestV241-1954446134-project-admin] Calling method '.version_select at 0x7fb3489f6e50>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:48:54.022730 n-d-852296-2 devstack@n-api.service[129410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:48:54.022730 n-d-852296-2 devstack@n-api.service[129410]: warnings.warn(msg) Aug 10 17:48:54.031923 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-f7251e84-b9e5-4647-bbbe-17c1dd79257a tempest-AggregatesAdminTestV241-1954446134 tempest-AggregatesAdminTestV241-1954446134-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),eb80cdf1-5ac7-4611-abc6-59802fe86dfd(cell1) {{(pid=129410) load_cells /opt/stack/nova/nova/compute/api.py:306}} Aug 10 17:48:54.035291 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-f7251e84-b9e5-4647-bbbe-17c1dd79257a tempest-AggregatesAdminTestV241-1954446134 tempest-AggregatesAdminTestV241-1954446134-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:48:54.035291 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-f7251e84-b9e5-4647-bbbe-17c1dd79257a tempest-AggregatesAdminTestV241-1954446134 tempest-AggregatesAdminTestV241-1954446134-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:48:54.035291 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-f7251e84-b9e5-4647-bbbe-17c1dd79257a tempest-AggregatesAdminTestV241-1954446134 tempest-AggregatesAdminTestV241-1954446134-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:48:54.062019 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-f7251e84-b9e5-4647-bbbe-17c1dd79257a tempest-AggregatesAdminTestV241-1954446134 tempest-AggregatesAdminTestV241-1954446134-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:48:54.062504 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-f7251e84-b9e5-4647-bbbe-17c1dd79257a tempest-AggregatesAdminTestV241-1954446134 tempest-AggregatesAdminTestV241-1954446134-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:48:54.063362 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-f7251e84-b9e5-4647-bbbe-17c1dd79257a tempest-AggregatesAdminTestV241-1954446134 tempest-AggregatesAdminTestV241-1954446134-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:48:54.081227 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-f7251e84-b9e5-4647-bbbe-17c1dd79257a tempest-AggregatesAdminTestV241-1954446134 tempest-AggregatesAdminTestV241-1954446134-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:48:54.081227 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-f7251e84-b9e5-4647-bbbe-17c1dd79257a tempest-AggregatesAdminTestV241-1954446134 tempest-AggregatesAdminTestV241-1954446134-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:48:54.081227 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-f7251e84-b9e5-4647-bbbe-17c1dd79257a tempest-AggregatesAdminTestV241-1954446134 tempest-AggregatesAdminTestV241-1954446134-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:48:54.089161 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-f7251e84-b9e5-4647-bbbe-17c1dd79257a tempest-AggregatesAdminTestV241-1954446134 tempest-AggregatesAdminTestV241-1954446134-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1423 microversion: 2.41 time: 1.980937 Aug 10 17:48:54.090629 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 1/1] 10.222.0.50 () {60 vars in 1208 bytes} [Wed Aug 10 17:48:52 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1423 bytes in 1984 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:48:54.594106 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-113116ea-2f3f-4abc-b387-9767e195a5f1 tempest-AZAdminNegativeTestJSON-1406456218 tempest-AZAdminNegativeTestJSON-1406456218-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:48:54.595335 n-d-852296-2 devstack@n-api.service[129410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:48:54.595335 n-d-852296-2 devstack@n-api.service[129410]: warnings.warn(msg) Aug 10 17:48:54.598323 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-113116ea-2f3f-4abc-b387-9767e195a5f1 tempest-AZAdminNegativeTestJSON-1406456218 tempest-AZAdminNegativeTestJSON-1406456218-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': 'f86d72077d714536895c46a77225fb14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757d57b8db5341a3a4161e3d5fcf50c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:48:54.602919 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-113116ea-2f3f-4abc-b387-9767e195a5f1 tempest-AZAdminNegativeTestJSON-1406456218 tempest-AZAdminNegativeTestJSON-1406456218-project] Request method failure captured: Aug 10 17:48:54.602919 n-d-852296-2 devstack@n-api.service[129410]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Aug 10 17:48:54.602919 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 17:48:54.602919 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 17:48:54.602919 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 17:48:54.602919 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 0 Aug 10 17:48:54.602919 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 17:48:54.602919 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 17:48:54.602919 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 17:48:54.602919 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 17:48:54.602919 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8--CDUpvPghL73b_Zm_RkClwA7zX7Sm042kWjLbrb7hXbGxv44Ee_u2RV-sZo0nQc8skudOcnsUpoVBkdLoj9LeaAQogMQbnlTD8Uh6ipWx_0INYEqCWAbfWlWhQt6wR-zAV-4tV5xRUuyzo3UG8TToO1M844IPDKlr4YzNaWH0NZgY Aug 10 17:48:54.602919 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 17:48:54.602919 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 17:48:54.602919 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 17:48:54.602919 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 17:48:54.602919 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 17:48:54.602919 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 17:48:54.602919 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: 757d57b8db5341a3a4161e3d5fcf50c6 Aug 10 17:48:54.602919 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-AZAdminNegativeTestJSON-1406456218 Aug 10 17:48:54.602919 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 17:48:54.602919 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 17:48:54.604096 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/757d57b8db5341a3a4161e3d5fcf50c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/757d57b8db5341a3a4161e3d5fcf50c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/757d57b8db5341a3a4161e3d5fcf50c6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_757d57b8db5341a3a4161e3d5fcf50c6", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:48:54.604096 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-AZAdminNegativeTestJSON-1406456218 Aug 10 17:48:54.604096 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: 757d57b8db5341a3a4161e3d5fcf50c6 Aug 10 17:48:54.604096 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-1406456218 Aug 10 17:48:54.604096 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-AZAdminNegativeTestJSON-1406456218-project Aug 10 17:48:54.604096 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 17:48:54.604096 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 17:48:54.604096 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: f86d72077d714536895c46a77225fb14 Aug 10 17:48:54.604096 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-AZAdminNegativeTestJSON-1406456218-project Aug 10 17:48:54.604096 n-d-852296-2 devstack@n-api.service[129410]: method: > Aug 10 17:48:54.604096 n-d-852296-2 devstack@n-api.service[129410]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Aug 10 17:48:54.604096 n-d-852296-2 devstack@n-api.service[129410]: action_args: {} Aug 10 17:48:54.604783 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:48:54.604783 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:48:54.604783 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:48:54.604783 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:48:54.604783 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:48:54.604783 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:48:54.604783 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:48:54.604783 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:48:54.604783 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Aug 10 17:48:54.604783 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Aug 10 17:48:54.604783 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 10 17:48:54.604783 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 10 17:48:54.604783 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 10 17:48:54.604783 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 10 17:48:54.604783 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 10 17:48:54.604783 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 10 17:48:54.604783 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 10 17:48:54.604783 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise self.value Aug 10 17:48:54.604783 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 10 17:48:54.606324 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 10 17:48:54.606324 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 10 17:48:54.606324 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 10 17:48:54.606324 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 10 17:48:54.606324 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 10 17:48:54.606324 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Aug 10 17:48:54.606324 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:48:54.606324 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:48:54.606324 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:48:54.606324 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:48:54.606324 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:48:54.606324 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:48:54.606324 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 10 17:48:54.606324 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 10 17:48:54.606324 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Aug 10 17:48:54.606324 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:48:54.606324 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-113116ea-2f3f-4abc-b387-9767e195a5f1 tempest-AZAdminNegativeTestJSON-1406456218 tempest-AZAdminNegativeTestJSON-1406456218-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:48:54.607223 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-113116ea-2f3f-4abc-b387-9767e195a5f1 tempest-AZAdminNegativeTestJSON-1406456218 tempest-AZAdminNegativeTestJSON-1406456218-project] 10.222.0.50 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.515172 Aug 10 17:48:54.612156 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 2/2] 10.222.0.50 () {58 vars in 1185 bytes} [Wed Aug 10 17:48:54 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 518 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:48:54.860011 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-7adee625-58d6-400b-bc87-68d3fa18f8d7 tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] Calling method '.version_select at 0x7fb3491db0d0>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:48:54.860892 n-d-852296-2 devstack@n-api.service[129410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:48:54.860892 n-d-852296-2 devstack@n-api.service[129410]: warnings.warn(msg) Aug 10 17:48:54.862316 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-7adee625-58d6-400b-bc87-68d3fa18f8d7 tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:48:54.862807 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-7adee625-58d6-400b-bc87-68d3fa18f8d7 tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:48:54.874670 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-7adee625-58d6-400b-bc87-68d3fa18f8d7 tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:48:54.900604 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-7adee625-58d6-400b-bc87-68d3fa18f8d7 tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:48:54.901649 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-7adee625-58d6-400b-bc87-68d3fa18f8d7 tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:48:54.902655 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-7adee625-58d6-400b-bc87-68d3fa18f8d7 tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:48:54.929153 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-7adee625-58d6-400b-bc87-68d3fa18f8d7 tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:48:54.929681 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-7adee625-58d6-400b-bc87-68d3fa18f8d7 tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:48:54.932798 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-7adee625-58d6-400b-bc87-68d3fa18f8d7 tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:48:54.949849 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-7adee625-58d6-400b-bc87-68d3fa18f8d7 tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 0.333927 Aug 10 17:48:54.950636 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 3/3] 10.222.0.50 () {58 vars in 1167 bytes} [Wed Aug 10 17:48:54 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:48:54.960828 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-1c110e4f-7545-44f9-a5b6-df837e832191 tempest-AggregatesAdminTestV241-1954446134 tempest-AggregatesAdminTestV241-1954446134-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-969745061"}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:48:54.996870 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-8c62fd00-8463-4d25-a75e-3787decc9a3b tempest-AggregatesAdminNegativeTestJSON-734955950 tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:48:54.997272 n-d-852296-2 devstack@n-api.service[129410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:48:54.997272 n-d-852296-2 devstack@n-api.service[129410]: warnings.warn(msg) Aug 10 17:48:54.999692 n-d-852296-2 devstack@n-api.service[129409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:48:54.999692 n-d-852296-2 devstack@n-api.service[129409]: warnings.warn(msg) Aug 10 17:48:55.001092 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-8c62fd00-8463-4d25-a75e-3787decc9a3b tempest-AggregatesAdminNegativeTestJSON-734955950 tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:48:55.001587 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-8c62fd00-8463-4d25-a75e-3787decc9a3b tempest-AggregatesAdminNegativeTestJSON-734955950 tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:48:55.001957 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.objects.aggregate [None req-1c110e4f-7545-44f9-a5b6-df837e832191 tempest-AggregatesAdminTestV241-1954446134 tempest-AggregatesAdminTestV241-1954446134-project-admin] Generated uuid 17538bfa-53f8-482a-b246-eb6583b6d0a2 for aggregate {{(pid=129410) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 10 17:48:55.002048 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-8c62fd00-8463-4d25-a75e-3787decc9a3b tempest-AggregatesAdminNegativeTestJSON-734955950 tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:48:55.002733 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-8c62fd00-8463-4d25-a75e-3787decc9a3b tempest-AggregatesAdminNegativeTestJSON-734955950 tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:48:55.003183 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-8c62fd00-8463-4d25-a75e-3787decc9a3b tempest-AggregatesAdminNegativeTestJSON-734955950 tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:48:55.003601 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-8c62fd00-8463-4d25-a75e-3787decc9a3b tempest-AggregatesAdminNegativeTestJSON-734955950 tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:48:55.061788 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-8c62fd00-8463-4d25-a75e-3787decc9a3b tempest-AggregatesAdminNegativeTestJSON-734955950 tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 1.380085 Aug 10 17:48:55.070518 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1/4] 10.222.0.50 () {58 vars in 1176 bytes} [Wed Aug 10 17:48:53 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 1382 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:48:55.208958 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-1c110e4f-7545-44f9-a5b6-df837e832191 tempest-AggregatesAdminTestV241-1954446134 tempest-AggregatesAdminTestV241-1954446134-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.41 time: 0.257171 Aug 10 17:48:55.210187 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 4/5] 10.222.0.50 () {62 vars in 1205 bytes} [Wed Aug 10 17:48:54 2022] POST /compute/v2.1/os-aggregates => generated 245 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 17:48:55.577554 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-1551f580-e7db-4999-849a-f67d9ce1415c tempest-FlavorsExtraSpecsTestJSON-208156752 tempest-FlavorsExtraSpecsTestJSON-208156752-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-834045208", "ram": 512, "vcpus": 1, "disk": 10, "id": 897764264, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:48:55.601186 n-d-852296-2 devstack@n-api.service[129409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:48:55.601186 n-d-852296-2 devstack@n-api.service[129409]: warnings.warn(msg) Aug 10 17:48:55.725319 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-36335db0-4e94-4d8f-9808-dcce6fb00f4a tempest-AZAdminV2TestJSON-432364701 tempest-AZAdminV2TestJSON-432364701-project-admin] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:48:55.728650 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-36335db0-4e94-4d8f-9808-dcce6fb00f4a tempest-AZAdminV2TestJSON-432364701 tempest-AZAdminV2TestJSON-432364701-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:48:55.729412 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-36335db0-4e94-4d8f-9808-dcce6fb00f4a tempest-AZAdminV2TestJSON-432364701 tempest-AZAdminV2TestJSON-432364701-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:48:55.730724 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-36335db0-4e94-4d8f-9808-dcce6fb00f4a tempest-AZAdminV2TestJSON-432364701 tempest-AZAdminV2TestJSON-432364701-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:48:55.731486 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-36335db0-4e94-4d8f-9808-dcce6fb00f4a tempest-AZAdminV2TestJSON-432364701 tempest-AZAdminV2TestJSON-432364701-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:48:55.732302 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-36335db0-4e94-4d8f-9808-dcce6fb00f4a tempest-AZAdminV2TestJSON-432364701 tempest-AZAdminV2TestJSON-432364701-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:48:55.732889 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-36335db0-4e94-4d8f-9808-dcce6fb00f4a tempest-AZAdminV2TestJSON-432364701 tempest-AZAdminV2TestJSON-432364701-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:48:55.773820 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-1551f580-e7db-4999-849a-f67d9ce1415c tempest-FlavorsExtraSpecsTestJSON-208156752 tempest-FlavorsExtraSpecsTestJSON-208156752-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.709984 Aug 10 17:48:55.782496 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 2/6] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 17:48:55 2022] POST /compute/v2.1/flavors => generated 412 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:48:55.796416 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-00a0f159-4b90-4ded-9f05-201054297784 tempest-AggregatesAdminTestV241-1954446134 tempest-AggregatesAdminTestV241-1954446134-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-163157077"}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:48:55.837119 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-36335db0-4e94-4d8f-9808-dcce6fb00f4a tempest-AZAdminV2TestJSON-432364701 tempest-AZAdminV2TestJSON-432364701-project-admin] 10.222.0.50 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.613994 Aug 10 17:48:55.837708 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 5/7] 10.222.0.50 () {58 vars in 1164 bytes} [Wed Aug 10 17:48:55 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 17:48:55.843736 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-0ef00f13-40b9-4a9b-a74a-bd1b019a23b2 tempest-FlavorsExtraSpecsTestJSON-208156752 tempest-FlavorsExtraSpecsTestJSON-208156752-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:48:55.848114 n-d-852296-2 devstack@n-api.service[129410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:48:55.848114 n-d-852296-2 devstack@n-api.service[129410]: warnings.warn(msg) Aug 10 17:48:55.921898 n-d-852296-2 devstack@n-api.service[129409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:48:55.921898 n-d-852296-2 devstack@n-api.service[129409]: warnings.warn(msg) Aug 10 17:48:55.988922 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-0ef00f13-40b9-4a9b-a74a-bd1b019a23b2 tempest-FlavorsExtraSpecsTestJSON-208156752 tempest-FlavorsExtraSpecsTestJSON-208156752-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors/897764264/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.149542 Aug 10 17:48:55.996961 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 6/8] 10.222.0.50 () {60 vars in 1221 bytes} [Wed Aug 10 17:48:55 2022] POST /compute/v2.1/flavors/897764264/os-extra_specs => generated 66 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 17:48:56.005446 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-5b3b834b-3c01-4387-943e-02e7b776b374 tempest-AZAdminV2TestJSON-432364701 tempest-AZAdminV2TestJSON-432364701-project-admin] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:48:56.008028 n-d-852296-2 devstack@n-api.service[129410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:48:56.008028 n-d-852296-2 devstack@n-api.service[129410]: warnings.warn(msg) Aug 10 17:48:56.010097 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-5b3b834b-3c01-4387-943e-02e7b776b374 tempest-AZAdminV2TestJSON-432364701 tempest-AZAdminV2TestJSON-432364701-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:48:56.011829 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-5b3b834b-3c01-4387-943e-02e7b776b374 tempest-AZAdminV2TestJSON-432364701 tempest-AZAdminV2TestJSON-432364701-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:48:56.016531 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-5b3b834b-3c01-4387-943e-02e7b776b374 tempest-AZAdminV2TestJSON-432364701 tempest-AZAdminV2TestJSON-432364701-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:48:56.019557 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-5b3b834b-3c01-4387-943e-02e7b776b374 tempest-AZAdminV2TestJSON-432364701 tempest-AZAdminV2TestJSON-432364701-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:48:56.021357 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-5b3b834b-3c01-4387-943e-02e7b776b374 tempest-AZAdminV2TestJSON-432364701 tempest-AZAdminV2TestJSON-432364701-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:48:56.021803 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-5b3b834b-3c01-4387-943e-02e7b776b374 tempest-AZAdminV2TestJSON-432364701 tempest-AZAdminV2TestJSON-432364701-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:48:56.050217 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-5b3b834b-3c01-4387-943e-02e7b776b374 tempest-AZAdminV2TestJSON-432364701 tempest-AZAdminV2TestJSON-432364701-project-admin] 10.222.0.50 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.051447 Aug 10 17:48:56.051384 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 7/9] 10.222.0.50 () {58 vars in 1185 bytes} [Wed Aug 10 17:48:55 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:48:56.151193 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-00a0f159-4b90-4ded-9f05-201054297784 tempest-AggregatesAdminTestV241-1954446134 tempest-AggregatesAdminTestV241-1954446134-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-aggregates/1" status: 200 len: 298 microversion: 2.41 time: 0.366746 Aug 10 17:48:56.153298 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 3/10] 10.222.0.50 () {62 vars in 1210 bytes} [Wed Aug 10 17:48:55 2022] PUT /compute/v2.1/os-aggregates/1 => generated 298 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 17:48:56.165226 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-869b962b-1394-47ec-b4d8-086b1406f9bf tempest-AggregatesAdminTestV241-1954446134 tempest-AggregatesAdminTestV241-1954446134-project-admin] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:48:56.166211 n-d-852296-2 devstack@n-api.service[129409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:48:56.166211 n-d-852296-2 devstack@n-api.service[129409]: warnings.warn(msg) Aug 10 17:48:56.176144 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-869b962b-1394-47ec-b4d8-086b1406f9bf tempest-AggregatesAdminTestV241-1954446134 tempest-AggregatesAdminTestV241-1954446134-project-admin] 10.222.0.50 "GET /compute/v2.1/os-aggregates/1" status: 200 len: 298 microversion: 2.41 time: 0.014934 Aug 10 17:48:56.194723 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 4/11] 10.222.0.50 () {60 vars in 1190 bytes} [Wed Aug 10 17:48:56 2022] GET /compute/v2.1/os-aggregates/1 => generated 298 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 17:48:56.220400 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-19f60e38-951a-449d-bc8a-326557c1a8f6 tempest-AggregatesAdminTestV241-1954446134 tempest-AggregatesAdminTestV241-1954446134-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-852296-2"}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:48:56.231668 n-d-852296-2 devstack@n-api.service[129409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:48:56.231668 n-d-852296-2 devstack@n-api.service[129409]: warnings.warn(msg) Aug 10 17:48:56.254304 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-19f60e38-951a-449d-bc8a-326557c1a8f6 tempest-AggregatesAdminTestV241-1954446134 tempest-AggregatesAdminTestV241-1954446134-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:48:56.254932 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-19f60e38-951a-449d-bc8a-326557c1a8f6 tempest-AggregatesAdminTestV241-1954446134 tempest-AggregatesAdminTestV241-1954446134-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:48:56.255369 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-19f60e38-951a-449d-bc8a-326557c1a8f6 tempest-AggregatesAdminTestV241-1954446134 tempest-AggregatesAdminTestV241-1954446134-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:48:56.352507 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-207999ea-78df-42e6-bdbf-44ce4e619531 tempest-FlavorsExtraSpecsTestJSON-1168463817 tempest-FlavorsExtraSpecsTestJSON-1168463817-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:48:56.383268 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-207999ea-78df-42e6-bdbf-44ce4e619531 tempest-FlavorsExtraSpecsTestJSON-1168463817 tempest-FlavorsExtraSpecsTestJSON-1168463817-project] 10.222.0.50 "GET /compute/v2.1/flavors/897764264/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.330560 Aug 10 17:48:56.384174 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 8/12] 10.222.0.50 () {58 vars in 1200 bytes} [Wed Aug 10 17:48:56 2022] GET /compute/v2.1/flavors/897764264/os-extra_specs => generated 66 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 17:48:56.400850 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-0e61ef75-ebb3-4813-b6dc-0cfccc9a6e7b tempest-FlavorsExtraSpecsTestJSON-208156752 tempest-FlavorsExtraSpecsTestJSON-208156752-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:48:56.415674 n-d-852296-2 devstack@n-api.service[129410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:48:56.415674 n-d-852296-2 devstack@n-api.service[129410]: warnings.warn(msg) Aug 10 17:48:56.456869 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-0e61ef75-ebb3-4813-b6dc-0cfccc9a6e7b tempest-FlavorsExtraSpecsTestJSON-208156752 tempest-FlavorsExtraSpecsTestJSON-208156752-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors/897764264/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.063098 Aug 10 17:48:56.460321 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 9/13] 10.222.0.50 () {60 vars in 1221 bytes} [Wed Aug 10 17:48:56 2022] POST /compute/v2.1/flavors/897764264/os-extra_specs => generated 66 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 17:48:56.473540 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-e3d696ba-4013-45cf-aa48-7b47924b8c89 tempest-FlavorsExtraSpecsTestJSON-1168463817 tempest-FlavorsExtraSpecsTestJSON-1168463817-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:48:56.484959 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-e3d696ba-4013-45cf-aa48-7b47924b8c89 tempest-FlavorsExtraSpecsTestJSON-1168463817 tempest-FlavorsExtraSpecsTestJSON-1168463817-project] 10.222.0.50 "GET /compute/v2.1/flavors/897764264/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.021202 Aug 10 17:48:56.485839 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 10/14] 10.222.0.50 () {58 vars in 1242 bytes} [Wed Aug 10 17:48:56 2022] GET /compute/v2.1/flavors/897764264/os-extra_specs/hw:numa_nodes => generated 22 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 17:48:56.498909 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-82623a13-cc2a-4ff1-b54a-1ac49db2eed5 tempest-FlavorsExtraSpecsTestJSON-208156752 tempest-FlavorsExtraSpecsTestJSON-208156752-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:48:56.525029 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-82623a13-cc2a-4ff1-b54a-1ac49db2eed5 tempest-FlavorsExtraSpecsTestJSON-208156752 tempest-FlavorsExtraSpecsTestJSON-208156752-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors/897764264/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.030215 Aug 10 17:48:56.527243 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 11/15] 10.222.0.50 () {60 vars in 1221 bytes} [Wed Aug 10 17:48:56 2022] POST /compute/v2.1/flavors/897764264/os-extra_specs => generated 66 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 10 17:48:56.545500 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-4b85668a-cda0-4f2e-8843-e75c8a0227cd tempest-FlavorsExtraSpecsTestJSON-208156752 tempest-FlavorsExtraSpecsTestJSON-208156752-project-admin] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:48:56.559361 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-4b85668a-cda0-4f2e-8843-e75c8a0227cd tempest-FlavorsExtraSpecsTestJSON-208156752 tempest-FlavorsExtraSpecsTestJSON-208156752-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/897764264/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.017438 Aug 10 17:48:56.560296 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 12/16] 10.222.0.50 () {58 vars in 1200 bytes} [Wed Aug 10 17:48:56 2022] GET /compute/v2.1/flavors/897764264/os-extra_specs => generated 66 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 17:48:56.569767 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-429f9df8-1561-44d9-bf75-f2ab678d5b95 tempest-FlavorsExtraSpecsTestJSON-208156752 tempest-FlavorsExtraSpecsTestJSON-208156752-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:48:56.572454 n-d-852296-2 devstack@n-api.service[129410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:48:56.572454 n-d-852296-2 devstack@n-api.service[129410]: warnings.warn(msg) Aug 10 17:48:56.738726 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-429f9df8-1561-44d9-bf75-f2ab678d5b95 tempest-FlavorsExtraSpecsTestJSON-208156752 tempest-FlavorsExtraSpecsTestJSON-208156752-project-admin] 10.222.0.50 "PUT /compute/v2.1/flavors/897764264/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.172740 Aug 10 17:48:56.739459 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 13/17] 10.222.0.50 () {60 vars in 1262 bytes} [Wed Aug 10 17:48:56 2022] PUT /compute/v2.1/flavors/897764264/os-extra_specs/hw:numa_nodes => generated 22 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 17:48:56.748476 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-de77b549-ff15-4066-829f-c9978b37b338 tempest-FlavorsExtraSpecsTestJSON-208156752 tempest-FlavorsExtraSpecsTestJSON-208156752-project-admin] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:48:56.757446 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-de77b549-ff15-4066-829f-c9978b37b338 tempest-FlavorsExtraSpecsTestJSON-208156752 tempest-FlavorsExtraSpecsTestJSON-208156752-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/897764264/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.012740 Aug 10 17:48:56.758479 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 14/18] 10.222.0.50 () {58 vars in 1200 bytes} [Wed Aug 10 17:48:56 2022] GET /compute/v2.1/flavors/897764264/os-extra_specs => generated 66 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 17:48:56.783877 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-a7f4940d-83f7-40ee-affd-ee6adc37a4e4 tempest-FlavorsExtraSpecsTestJSON-208156752 tempest-FlavorsExtraSpecsTestJSON-208156752-project-admin] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:48:56.783877 n-d-852296-2 devstack@n-api.service[129410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:48:56.783877 n-d-852296-2 devstack@n-api.service[129410]: warnings.warn(msg) Aug 10 17:48:56.925859 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-a7f4940d-83f7-40ee-affd-ee6adc37a4e4 tempest-FlavorsExtraSpecsTestJSON-208156752 tempest-FlavorsExtraSpecsTestJSON-208156752-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/897764264/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.161463 Aug 10 17:48:56.927001 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 15/19] 10.222.0.50 () {58 vars in 1245 bytes} [Wed Aug 10 17:48:56 2022] DELETE /compute/v2.1/flavors/897764264/os-extra_specs/hw:numa_nodes => generated 0 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Aug 10 17:48:56.940339 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-9a7f5d39-b4c6-48fe-8d48-9e88e022b5da tempest-FlavorsExtraSpecsTestJSON-208156752 tempest-FlavorsExtraSpecsTestJSON-208156752-project-admin] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:48:57.092794 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-9a7f5d39-b4c6-48fe-8d48-9e88e022b5da tempest-FlavorsExtraSpecsTestJSON-208156752 tempest-FlavorsExtraSpecsTestJSON-208156752-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/897764264/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.159519 Aug 10 17:48:57.094319 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 16/20] 10.222.0.50 () {58 vars in 1245 bytes} [Wed Aug 10 17:48:56 2022] DELETE /compute/v2.1/flavors/897764264/os-extra_specs/hw:cpu_policy => generated 0 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 10 17:48:57.118337 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-e7f33f90-0ffc-4f03-8113-1928eb032985 tempest-FlavorsExtraSpecsTestJSON-208156752 tempest-FlavorsExtraSpecsTestJSON-208156752-project-admin] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:48:57.131225 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-e7f33f90-0ffc-4f03-8113-1928eb032985 tempest-FlavorsExtraSpecsTestJSON-208156752 tempest-FlavorsExtraSpecsTestJSON-208156752-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/897764264/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.032697 Aug 10 17:48:57.131540 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 17/21] 10.222.0.50 () {58 vars in 1200 bytes} [Wed Aug 10 17:48:57 2022] GET /compute/v2.1/flavors/897764264/os-extra_specs => generated 19 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 10 17:48:57.163851 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-e3969c9e-b23a-4f11-857c-00b6fbaa587f tempest-FlavorsExtraSpecsTestJSON-208156752 tempest-FlavorsExtraSpecsTestJSON-208156752-project-admin] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:48:57.164666 n-d-852296-2 devstack@n-api.service[129410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:48:57.164666 n-d-852296-2 devstack@n-api.service[129410]: warnings.warn(msg) Aug 10 17:48:57.279035 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-e3969c9e-b23a-4f11-857c-00b6fbaa587f tempest-FlavorsExtraSpecsTestJSON-208156752 tempest-FlavorsExtraSpecsTestJSON-208156752-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/897764264" status: 202 len: 0 microversion: 2.1 time: 0.118946 Aug 10 17:48:57.283126 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 18/22] 10.222.0.50 () {58 vars in 1158 bytes} [Wed Aug 10 17:48:57 2022] DELETE /compute/v2.1/flavors/897764264 => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 17:48:57.288263 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-ffefe782-8c4c-4196-93e2-3774c871d1bb tempest-FlavorsExtraSpecsTestJSON-208156752 tempest-FlavorsExtraSpecsTestJSON-208156752-project-admin] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:48:57.293337 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3,nova_api:SAVEPOINT=9,nova_api:RELEASE=9,nova_api:UPDATE=1,nova_api:DELETE=5 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:48:57.319175 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-ffefe782-8c4c-4196-93e2-3774c871d1bb tempest-FlavorsExtraSpecsTestJSON-208156752 tempest-FlavorsExtraSpecsTestJSON-208156752-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.034918 Aug 10 17:48:57.334486 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 19/23] 10.222.0.50 () {58 vars in 1146 bytes} [Wed Aug 10 17:48:57 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:48:57.394173 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-19f60e38-951a-449d-bc8a-326557c1a8f6 tempest-AggregatesAdminTestV241-1954446134 tempest-AggregatesAdminTestV241-1954446134-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 313 microversion: 2.41 time: 1.187316 Aug 10 17:48:57.394747 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 5/24] 10.222.0.50 () {62 vars in 1232 bytes} [Wed Aug 10 17:48:56 2022] POST /compute/v2.1/os-aggregates/1/action => generated 313 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 17:48:57.407067 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-98c0b4b5-90ff-42ba-b1c4-5e178fb46d97 tempest-AggregatesAdminTestV241-1954446134 tempest-AggregatesAdminTestV241-1954446134-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-852296-2"}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:48:57.409764 n-d-852296-2 devstack@n-api.service[129410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:48:57.409764 n-d-852296-2 devstack@n-api.service[129410]: warnings.warn(msg) Aug 10 17:48:57.418741 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-98c0b4b5-90ff-42ba-b1c4-5e178fb46d97 tempest-AggregatesAdminTestV241-1954446134 tempest-AggregatesAdminTestV241-1954446134-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:48:57.419161 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-98c0b4b5-90ff-42ba-b1c4-5e178fb46d97 tempest-AggregatesAdminTestV241-1954446134 tempest-AggregatesAdminTestV241-1954446134-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:48:57.419595 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-98c0b4b5-90ff-42ba-b1c4-5e178fb46d97 tempest-AggregatesAdminTestV241-1954446134 tempest-AggregatesAdminTestV241-1954446134-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:48:59.065676 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-98c0b4b5-90ff-42ba-b1c4-5e178fb46d97 tempest-AggregatesAdminTestV241-1954446134 tempest-AggregatesAdminTestV241-1954446134-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 298 microversion: 2.41 time: 1.661501 Aug 10 17:48:59.066710 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 20/25] 10.222.0.50 () {62 vars in 1232 bytes} [Wed Aug 10 17:48:57 2022] POST /compute/v2.1/os-aggregates/1/action => generated 298 bytes in 1665 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 17:48:59.086222 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-1d397f45-b178-4b9c-803f-2abc54f9c1c8 tempest-AggregatesAdminTestV241-1954446134 tempest-AggregatesAdminTestV241-1954446134-project-admin] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:48:59.087850 n-d-852296-2 devstack@n-api.service[129410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:48:59.087850 n-d-852296-2 devstack@n-api.service[129410]: warnings.warn(msg) Aug 10 17:48:59.204562 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-1d397f45-b178-4b9c-803f-2abc54f9c1c8 tempest-AggregatesAdminTestV241-1954446134 tempest-AggregatesAdminTestV241-1954446134-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.41 time: 0.129202 Aug 10 17:48:59.205444 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 21/26] 10.222.0.50 () {60 vars in 1193 bytes} [Wed Aug 10 17:48:59 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:48:59.227761 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-c5200164-ab74-4ddd-93ac-c644aff00135 tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1002053055", "name": "tempest-test_aggregate-1662424544"}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:48:59.252310 n-d-852296-2 devstack@n-api.service[129410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:48:59.252310 n-d-852296-2 devstack@n-api.service[129410]: warnings.warn(msg) Aug 10 17:48:59.253819 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.objects.aggregate [None req-c5200164-ab74-4ddd-93ac-c644aff00135 tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] Generated uuid 9703d004-1c2e-4088-9923-aeb1b323b7d1 for aggregate {{(pid=129410) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 10 17:48:59.348549 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-d33534e2-6d49-499e-91a6-df53707d6bcb tempest-FlavorsAdminTestJSON-1446121410 tempest-FlavorsAdminTestJSON-1446121410-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-790735244", "id": 356499452, "os-flavor-access:is_public": "True"}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:48:59.352318 n-d-852296-2 devstack@n-api.service[129409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:48:59.352318 n-d-852296-2 devstack@n-api.service[129409]: warnings.warn(msg) Aug 10 17:48:59.398469 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-c5200164-ab74-4ddd-93ac-c644aff00135 tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.174885 Aug 10 17:48:59.399458 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 22/27] 10.222.0.50 () {60 vars in 1165 bytes} [Wed Aug 10 17:48:59 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:48:59.411679 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-774be6ef-28a4-403f-bb7d-0e190af2fe5a tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:48:59.412919 n-d-852296-2 devstack@n-api.service[129410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:48:59.412919 n-d-852296-2 devstack@n-api.service[129410]: warnings.warn(msg) Aug 10 17:48:59.425212 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-774be6ef-28a4-403f-bb7d-0e190af2fe5a tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] 10.222.0.50 "GET /compute/v2.1/os-aggregates" status: 200 len: 303 microversion: 2.1 time: 0.017099 Aug 10 17:48:59.425883 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 23/28] 10.222.0.50 () {58 vars in 1143 bytes} [Wed Aug 10 17:48:59 2022] GET /compute/v2.1/os-aggregates => generated 303 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:48:59.443778 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-5db91118-a72a-4d8b-b316-324b48d421d3 tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-852296-2"}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:48:59.446253 n-d-852296-2 devstack@n-api.service[129410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:48:59.446253 n-d-852296-2 devstack@n-api.service[129410]: warnings.warn(msg) Aug 10 17:48:59.455099 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-5db91118-a72a-4d8b-b316-324b48d421d3 tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:48:59.455768 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-5db91118-a72a-4d8b-b316-324b48d421d3 tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:48:59.456204 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-5db91118-a72a-4d8b-b316-324b48d421d3 tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:48:59.513677 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-d33534e2-6d49-499e-91a6-df53707d6bcb tempest-FlavorsAdminTestJSON-1446121410 tempest-FlavorsAdminTestJSON-1446121410-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 426 microversion: 2.1 time: 0.957728 Aug 10 17:48:59.514369 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 6/29] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 17:48:58 2022] POST /compute/v2.1/flavors => generated 426 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:48:59.528396 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-f8c3b006-196d-4a84-abda-68ede8f160c5 tempest-FlavorsAdminTestJSON-1446121410 tempest-FlavorsAdminTestJSON-1446121410-project-admin] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:48:59.529145 n-d-852296-2 devstack@n-api.service[129409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:48:59.529145 n-d-852296-2 devstack@n-api.service[129409]: warnings.warn(msg) Aug 10 17:48:59.658399 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-f8c3b006-196d-4a84-abda-68ede8f160c5 tempest-FlavorsAdminTestJSON-1446121410 tempest-FlavorsAdminTestJSON-1446121410-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/356499452" status: 202 len: 0 microversion: 2.1 time: 0.134274 Aug 10 17:48:59.659309 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 7/30] 10.222.0.50 () {58 vars in 1158 bytes} [Wed Aug 10 17:48:59 2022] DELETE /compute/v2.1/flavors/356499452 => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 17:48:59.673025 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-0797bd9c-0b20-4339-81a7-832d45b71ea2 tempest-FlavorsAdminTestJSON-1446121410 tempest-FlavorsAdminTestJSON-1446121410-project-admin] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:48:59.736081 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-0797bd9c-0b20-4339-81a7-832d45b71ea2 tempest-FlavorsAdminTestJSON-1446121410 tempest-FlavorsAdminTestJSON-1446121410-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.064913 Aug 10 17:48:59.740425 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 8/31] 10.222.0.50 () {58 vars in 1146 bytes} [Wed Aug 10 17:48:59 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:48:59.778365 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-4b4f044f-9470-4a9e-9215-0c945aa89d71 tempest-FlavorsAdminTestJSON-1446121410 tempest-FlavorsAdminTestJSON-1446121410-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-624543180", "id": 1066311574, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:48:59.840653 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-5db91118-a72a-4d8b-b316-324b48d421d3 tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 315 microversion: 2.1 time: 0.400547 Aug 10 17:48:59.841483 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 24/32] 10.222.0.50 () {60 vars in 1191 bytes} [Wed Aug 10 17:48:59 2022] POST /compute/v2.1/os-aggregates/2/action => generated 315 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:48:59.927125 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-4b4f044f-9470-4a9e-9215-0c945aa89d71 tempest-FlavorsAdminTestJSON-1446121410 tempest-FlavorsAdminTestJSON-1446121410-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.153474 Aug 10 17:48:59.927939 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 9/33] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 17:48:59 2022] POST /compute/v2.1/flavors => generated 416 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:48:59.943925 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-02c3ced2-2b1f-4958-bb63-6de895b9d45e tempest-FlavorsAdminTestJSON-1446121410 tempest-FlavorsAdminTestJSON-1446121410-project-admin] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:48:59.972944 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-02c3ced2-2b1f-4958-bb63-6de895b9d45e tempest-FlavorsAdminTestJSON-1446121410 tempest-FlavorsAdminTestJSON-1446121410-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 5397 microversion: 2.1 time: 0.025062 Aug 10 17:48:59.972944 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 25/34] 10.222.0.50 () {58 vars in 1146 bytes} [Wed Aug 10 17:48:59 2022] GET /compute/v2.1/flavors/detail => generated 5397 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:48:59.989330 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-6eb9eff3-567a-4bc0-8de5-7d3ca990480b tempest-FlavorsAdminTestJSON-1446121410 tempest-FlavorsAdminTestJSON-1446121410-project-admin] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:00.174671 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-6eb9eff3-567a-4bc0-8de5-7d3ca990480b tempest-FlavorsAdminTestJSON-1446121410 tempest-FlavorsAdminTestJSON-1446121410-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/1066311574" status: 202 len: 0 microversion: 2.1 time: 0.188259 Aug 10 17:49:00.178811 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 10/35] 10.222.0.50 () {58 vars in 1161 bytes} [Wed Aug 10 17:48:59 2022] DELETE /compute/v2.1/flavors/1066311574 => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 17:49:00.185392 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-f71c7df2-acf2-4c52-b659-8e4483d2fe9e tempest-FlavorsAdminTestJSON-1446121410 tempest-FlavorsAdminTestJSON-1446121410-project-admin] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:00.216021 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-f71c7df2-acf2-4c52-b659-8e4483d2fe9e tempest-FlavorsAdminTestJSON-1446121410 tempest-FlavorsAdminTestJSON-1446121410-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.035461 Aug 10 17:49:00.216598 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 26/36] 10.222.0.50 () {58 vars in 1146 bytes} [Wed Aug 10 17:49:00 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:49:00.236163 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-55911ed9-445b-448b-ada7-3b227cd5ca4c tempest-FlavorsAdminTestJSON-1446121410 tempest-FlavorsAdminTestJSON-1446121410-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1770695455", "id": 276715353, "os-flavor-access:is_public": "True"}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:49:00.455021 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-55911ed9-445b-448b-ada7-3b227cd5ca4c tempest-FlavorsAdminTestJSON-1446121410 tempest-FlavorsAdminTestJSON-1446121410-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 426 microversion: 2.1 time: 0.222625 Aug 10 17:49:00.457044 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 11/37] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 17:49:00 2022] POST /compute/v2.1/flavors => generated 426 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:49:00.481767 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-caaa9d21-202b-4973-b23f-f279420e4367 tempest-FlavorsAdminTestJSON-1446121410 tempest-FlavorsAdminTestJSON-1446121410-project-admin] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:00.605523 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-caaa9d21-202b-4973-b23f-f279420e4367 tempest-FlavorsAdminTestJSON-1446121410 tempest-FlavorsAdminTestJSON-1446121410-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/276715353" status: 202 len: 0 microversion: 2.1 time: 0.124237 Aug 10 17:49:00.605523 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 12/38] 10.222.0.50 () {58 vars in 1158 bytes} [Wed Aug 10 17:49:00 2022] DELETE /compute/v2.1/flavors/276715353 => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 17:49:00.609696 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-39340a0f-02bb-4bb0-ad30-d5a1da820bf6 tempest-FlavorsAdminTestJSON-1446121410 tempest-FlavorsAdminTestJSON-1446121410-project-admin] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:00.629665 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-39340a0f-02bb-4bb0-ad30-d5a1da820bf6 tempest-FlavorsAdminTestJSON-1446121410 tempest-FlavorsAdminTestJSON-1446121410-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023618 Aug 10 17:49:00.630247 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 13/39] 10.222.0.50 () {58 vars in 1146 bytes} [Wed Aug 10 17:49:00 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:49:00.653477 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-52dbbceb-b9aa-4ffb-bdd7-47835a2e9a26 tempest-FlavorsAdminTestJSON-1446121410 tempest-FlavorsAdminTestJSON-1446121410-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-794666175", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:49:00.825696 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-52dbbceb-b9aa-4ffb-bdd7-47835a2e9a26 tempest-FlavorsAdminTestJSON-1446121410 tempest-FlavorsAdminTestJSON-1446121410-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.175784 Aug 10 17:49:00.826653 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 14/40] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 17:49:00 2022] POST /compute/v2.1/flavors => generated 506 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:49:00.845694 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-124c8dc2-b940-482b-9112-4b9f3ed76624 tempest-FlavorsAdminTestJSON-1446121410 tempest-FlavorsAdminTestJSON-1446121410-project-admin] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:01.004059 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-124c8dc2-b940-482b-9112-4b9f3ed76624 tempest-FlavorsAdminTestJSON-1446121410 tempest-FlavorsAdminTestJSON-1446121410-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/2c85dadb-3760-4cf8-a6f2-aa8bf8d28e29" status: 202 len: 0 microversion: 2.1 time: 0.169673 Aug 10 17:49:01.004948 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 15/41] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 10 17:49:00 2022] DELETE /compute/v2.1/flavors/2c85dadb-3760-4cf8-a6f2-aa8bf8d28e29 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 17:49:01.014875 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-ad5ebafd-393d-46b7-a95c-348f16b0e1ce tempest-FlavorsAdminTestJSON-1446121410 tempest-FlavorsAdminTestJSON-1446121410-project-admin] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:01.042429 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-ad5ebafd-393d-46b7-a95c-348f16b0e1ce tempest-FlavorsAdminTestJSON-1446121410 tempest-FlavorsAdminTestJSON-1446121410-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.032916 Aug 10 17:49:01.043364 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 16/42] 10.222.0.50 () {58 vars in 1146 bytes} [Wed Aug 10 17:49:01 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:49:01.062590 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-63b862dd-31a6-41a3-8b24-5e3ff3c9f0df tempest-FlavorsAdminTestJSON-1446121410 tempest-FlavorsAdminTestJSON-1446121410-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-77917668", "id": "0244c1bc-c908-4d0e-80a2-49c7a24cca2c", "os-flavor-access:is_public": "True"}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:49:01.137754 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-30714353-4e53-4c33-abf5-4935c4ae62cb tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-1145824830", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "availability_zone": "tempest-test_az-1002053055"}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:49:01.157346 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-30714353-4e53-4c33-abf5-4935c4ae62cb tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:01.158526 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-30714353-4e53-4c33-abf5-4935c4ae62cb tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:01.159852 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-30714353-4e53-4c33-abf5-4935c4ae62cb tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:01.162095 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-30714353-4e53-4c33-abf5-4935c4ae62cb tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:01.166240 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-30714353-4e53-4c33-abf5-4935c4ae62cb tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:01.171573 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-30714353-4e53-4c33-abf5-4935c4ae62cb tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:01.272094 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-63b862dd-31a6-41a3-8b24-5e3ff3c9f0df tempest-FlavorsAdminTestJSON-1446121410 tempest-FlavorsAdminTestJSON-1446121410-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 505 microversion: 2.1 time: 0.213577 Aug 10 17:49:01.274092 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 17/43] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 17:49:01 2022] POST /compute/v2.1/flavors => generated 505 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:49:01.293647 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-155d9cd0-c037-4e86-b579-b5ebdda2c21b tempest-FlavorsAdminTestJSON-1446121410 tempest-FlavorsAdminTestJSON-1446121410-project-admin] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:01.445941 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-155d9cd0-c037-4e86-b579-b5ebdda2c21b tempest-FlavorsAdminTestJSON-1446121410 tempest-FlavorsAdminTestJSON-1446121410-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/0244c1bc-c908-4d0e-80a2-49c7a24cca2c" status: 202 len: 0 microversion: 2.1 time: 0.157919 Aug 10 17:49:01.448222 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 18/44] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 10 17:49:01 2022] DELETE /compute/v2.1/flavors/0244c1bc-c908-4d0e-80a2-49c7a24cca2c => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 17:49:01.456817 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-7d7bf4bd-da51-4d91-8080-03af18fb1c8d tempest-FlavorsAdminTestJSON-1446121410 tempest-FlavorsAdminTestJSON-1446121410-project-admin] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:01.500424 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-7d7bf4bd-da51-4d91-8080-03af18fb1c8d tempest-FlavorsAdminTestJSON-1446121410 tempest-FlavorsAdminTestJSON-1446121410-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.047646 Aug 10 17:49:01.502379 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 19/45] 10.222.0.50 () {58 vars in 1146 bytes} [Wed Aug 10 17:49:01 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:49:01.523763 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-1ebeac2f-be33-48b9-a20e-d4e2efe72052 tempest-FlavorsAdminTestJSON-1446121410 tempest-FlavorsAdminTestJSON-1446121410-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-608375333", "id": 308860467, "os-flavor-access:is_public": "True"}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:49:01.680352 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-1ebeac2f-be33-48b9-a20e-d4e2efe72052 tempest-FlavorsAdminTestJSON-1446121410 tempest-FlavorsAdminTestJSON-1446121410-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 0.161829 Aug 10 17:49:01.681108 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 20/46] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 17:49:01 2022] POST /compute/v2.1/flavors => generated 410 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:49:01.693550 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-5ee18d88-8272-4751-87e1-7381bb14569c tempest-FlavorsAdminTestJSON-1446121410 tempest-FlavorsAdminTestJSON-1446121410-project-admin] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:01.708214 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-5ee18d88-8272-4751-87e1-7381bb14569c tempest-FlavorsAdminTestJSON-1446121410 tempest-FlavorsAdminTestJSON-1446121410-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/308860467" status: 200 len: 410 microversion: 2.1 time: 0.018594 Aug 10 17:49:01.708818 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 21/47] 10.222.0.50 () {58 vars in 1155 bytes} [Wed Aug 10 17:49:01 2022] GET /compute/v2.1/flavors/308860467 => generated 410 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:49:01.814144 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.network.neutron [None req-30714353-4e53-4c33-abf5-4935c4ae62cb tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] validate_networks() for None {{(pid=129410) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 17:49:01.945365 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-400dd845-5fd0-4e50-aba0-616ec3990951 tempest-FlavorsAdminTestJSON-2015828218 tempest-FlavorsAdminTestJSON-2015828218-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:01.977302 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-400dd845-5fd0-4e50-aba0-616ec3990951 tempest-FlavorsAdminTestJSON-2015828218 tempest-FlavorsAdminTestJSON-2015828218-project] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 5391 microversion: 2.1 time: 0.259900 Aug 10 17:49:01.992116 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 22/48] 10.222.0.50 () {58 vars in 1146 bytes} [Wed Aug 10 17:49:01 2022] GET /compute/v2.1/flavors/detail => generated 5391 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:49:01.998552 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-75d19902-d39f-4b92-9a00-e734941e09c5 tempest-FlavorsAdminTestJSON-1446121410 tempest-FlavorsAdminTestJSON-1446121410-project-admin] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:02.012663 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=8,nova_api:UPDATE=1,nova_api:DELETE=17 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:49:02.102605 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-75d19902-d39f-4b92-9a00-e734941e09c5 tempest-FlavorsAdminTestJSON-1446121410 tempest-FlavorsAdminTestJSON-1446121410-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/308860467" status: 202 len: 0 microversion: 2.1 time: 0.108539 Aug 10 17:49:02.103563 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 23/49] 10.222.0.50 () {58 vars in 1158 bytes} [Wed Aug 10 17:49:01 2022] DELETE /compute/v2.1/flavors/308860467 => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 17:49:02.112922 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-9183e097-4d43-4cd8-90c5-5780a42abe2e tempest-FlavorsAdminTestJSON-1446121410 tempest-FlavorsAdminTestJSON-1446121410-project-admin] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:02.133571 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-9183e097-4d43-4cd8-90c5-5780a42abe2e tempest-FlavorsAdminTestJSON-1446121410 tempest-FlavorsAdminTestJSON-1446121410-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024501 Aug 10 17:49:02.148119 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 24/50] 10.222.0.50 () {58 vars in 1146 bytes} [Wed Aug 10 17:49:02 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:49:02.154277 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-930bda2f-1312-4a97-bbee-abc8774cadb9 tempest-FlavorsAdminTestJSON-1446121410 tempest-FlavorsAdminTestJSON-1446121410-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-2109151913", "id": 150508719, "os-flavor-access:is_public": "False"}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:49:02.247499 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.virt.hardware [None req-30714353-4e53-4c33-abf5-4935c4ae62cb tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Flavor limits 0:0:0 {{(pid=129410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 17:49:02.247927 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.virt.hardware [None req-30714353-4e53-4c33-abf5-4935c4ae62cb tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Image limits 0:0:0 {{(pid=129410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 17:49:02.248480 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.virt.hardware [None req-30714353-4e53-4c33-abf5-4935c4ae62cb tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Flavor pref 0:0:0 {{(pid=129410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 17:49:02.249004 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.virt.hardware [None req-30714353-4e53-4c33-abf5-4935c4ae62cb tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Image pref 0:0:0 {{(pid=129410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 17:49:02.260197 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.virt.hardware [None req-30714353-4e53-4c33-abf5-4935c4ae62cb tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 17:49:02.262987 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-30714353-4e53-4c33-abf5-4935c4ae62cb tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:02.263469 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-30714353-4e53-4c33-abf5-4935c4ae62cb tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:02.263906 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-30714353-4e53-4c33-abf5-4935c4ae62cb tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:02.264664 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-30714353-4e53-4c33-abf5-4935c4ae62cb tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:02.265117 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-30714353-4e53-4c33-abf5-4935c4ae62cb tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:02.265544 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-30714353-4e53-4c33-abf5-4935c4ae62cb tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:02.299491 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.quota [None req-30714353-4e53-4c33-abf5-4935c4ae62cb tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Getting quotas for project dcc21714f4484762aa8797d16cd3f70b. Resources: {'instances', 'ram', 'cores'} {{(pid=129410) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:49:02.309540 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.quota [None req-30714353-4e53-4c33-abf5-4935c4ae62cb tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Getting quotas for user d069b0c285c649b0967d0a0e3fdb24ee and project dcc21714f4484762aa8797d16cd3f70b. Resources: {'instances', 'ram', 'cores'} {{(pid=129410) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:49:02.325008 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-30714353-4e53-4c33-abf5-4935c4ae62cb tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Going to run 1 instances... {{(pid=129410) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 17:49:02.329075 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-30714353-4e53-4c33-abf5-4935c4ae62cb tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] [instance: 419ed54a-a752-46bf-b399-b93ace51b625] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a735ff26-463a-4ffe-a981-ab9d9baa494f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129410) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 17:49:02.374384 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-930bda2f-1312-4a97-bbee-abc8774cadb9 tempest-FlavorsAdminTestJSON-1446121410 tempest-FlavorsAdminTestJSON-1446121410-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.217726 Aug 10 17:49:02.374384 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 25/51] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 17:49:02 2022] POST /compute/v2.1/flavors => generated 427 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:49:02.382283 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-f8478308-88e3-4c62-ab28-a0b571e8c0b7 tempest-FlavorsAdminTestJSON-2015828218 tempest-FlavorsAdminTestJSON-2015828218-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "150508719"}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:49:02.401584 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-f8478308-88e3-4c62-ab28-a0b571e8c0b7 tempest-FlavorsAdminTestJSON-2015828218 tempest-FlavorsAdminTestJSON-2015828218-project] HTTP exception thrown: Flavor 150508719 could not be found. Aug 10 17:49:02.406111 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-f8478308-88e3-4c62-ab28-a0b571e8c0b7 tempest-FlavorsAdminTestJSON-2015828218 tempest-FlavorsAdminTestJSON-2015828218-project] Request method failure captured: Aug 10 17:49:02.406111 n-d-852296-2 devstack@n-api.service[129409]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 17:49:02.406111 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 17:49:02.406111 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 17:49:02.406111 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 17:49:02.406111 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 106 Aug 10 17:49:02.406111 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 17:49:02.406111 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 17:49:02.406111 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 17:49:02.406111 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 17:49:02.406111 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8--I-bRgnVCx0Hi-F-Nk5HyjmN8o_j850tsaMMKsvY8qrY2BFVkYZTMTBQqMx5Gtu191gQWwyrDBgTUfJ2wFl5-9ymvAL6OUMgn_2x5T7ZO62l000YczNyCUZiukfP3CkUeupdGR9VovCQogc08sl2C4lhZQKV8vv388EtFIeYwnXmU Aug 10 17:49:02.406111 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 17:49:02.406111 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 17:49:02.406111 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 17:49:02.406111 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 17:49:02.406111 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 17:49:02.406111 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 17:49:02.406111 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: 6050cc8bd15146088f0c7bb3d36bf723 Aug 10 17:49:02.406111 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-FlavorsAdminTestJSON-2015828218 Aug 10 17:49:02.406111 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 17:49:02.406111 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 17:49:02.410055 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6050cc8bd15146088f0c7bb3d36bf723"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6050cc8bd15146088f0c7bb3d36bf723"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6050cc8bd15146088f0c7bb3d36bf723"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6050cc8bd15146088f0c7bb3d36bf723", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:49:02.410055 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-FlavorsAdminTestJSON-2015828218 Aug 10 17:49:02.410055 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: 6050cc8bd15146088f0c7bb3d36bf723 Aug 10 17:49:02.410055 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-2015828218 Aug 10 17:49:02.410055 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-FlavorsAdminTestJSON-2015828218-project Aug 10 17:49:02.410055 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 17:49:02.410055 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 17:49:02.410055 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: 35b2a995253f4f069006a9c42f2c2f28 Aug 10 17:49:02.410055 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-FlavorsAdminTestJSON-2015828218-project Aug 10 17:49:02.410055 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:49:02.410055 n-d-852296-2 devstack@n-api.service[129409]: {"server": {"name": "test", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "150508719"}} Aug 10 17:49:02.410055 n-d-852296-2 devstack@n-api.service[129409]: method: > Aug 10 17:49:02.410055 n-d-852296-2 devstack@n-api.service[129409]: exception: Flavor 150508719 could not be found. Aug 10 17:49:02.411112 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'body': {'server': {'name': 'test', 'imageRef': 'a735ff26-463a-4ffe-a981-ab9d9baa494f', 'flavorRef': '150508719'}}} Aug 10 17:49:02.411112 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:49:02.411112 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:49:02.411112 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Aug 10 17:49:02.411112 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Aug 10 17:49:02.411112 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 10 17:49:02.411112 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 10 17:49:02.411112 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 17:49:02.411112 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 17:49:02.411112 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 10 17:49:02.411112 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 10 17:49:02.411112 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 10 17:49:02.411112 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:49:02.411112 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 10 17:49:02.411112 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 10 17:49:02.411112 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 150508719 could not be found. Aug 10 17:49:02.411112 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:49:02.411112 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:49:02.411112 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:49:02.411112 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:49:02.412496 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:49:02.412496 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:49:02.412496 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:49:02.412496 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:49:02.412496 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:49:02.412496 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:49:02.412496 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:49:02.412496 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:49:02.412496 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:49:02.412496 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:49:02.412496 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:49:02.412496 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:49:02.412496 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 17:49:02.412496 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 10 17:49:02.412496 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 10 17:49:02.412496 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 150508719 could not be found. Aug 10 17:49:02.412496 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:49:02.412496 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:49:02.412496 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:49:02.412496 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:49:02.412496 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:49:02.413565 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:49:02.413565 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:49:02.413565 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:49:02.413565 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 150508719 could not be found. Aug 10 17:49:02.413565 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:49:02.413565 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-f8478308-88e3-4c62-ab28-a0b571e8c0b7 tempest-FlavorsAdminTestJSON-2015828218 tempest-FlavorsAdminTestJSON-2015828218-project] Returning 400 to user: Flavor 150508719 could not be found. {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:49:02.413565 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-f8478308-88e3-4c62-ab28-a0b571e8c0b7 tempest-FlavorsAdminTestJSON-2015828218 tempest-FlavorsAdminTestJSON-2015828218-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 400 len: 80 microversion: 2.1 time: 0.029696 Aug 10 17:49:02.413565 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 26/52] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 17:49:02 2022] POST /compute/v2.1/servers => generated 80 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 10 17:49:02.419858 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-1ad31c90-3ab1-4f8b-91fe-8fef6d549068 tempest-FlavorsAdminTestJSON-1446121410 tempest-FlavorsAdminTestJSON-1446121410-project-admin] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:02.558985 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-30714353-4e53-4c33-abf5-4935c4ae62cb tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.155713 Aug 10 17:49:02.558985 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 27/53] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 17:49:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 2158 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 10 17:49:02.565967 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-3cb13fce-ffa3-4e10-852d-185a8d9fd0b5 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:02.567054 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-3cb13fce-ffa3-4e10-852d-185a8d9fd0b5 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] [instance: 419ed54a-a752-46bf-b399-b93ace51b625] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:49:02.646854 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-1ad31c90-3ab1-4f8b-91fe-8fef6d549068 tempest-FlavorsAdminTestJSON-1446121410 tempest-FlavorsAdminTestJSON-1446121410-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/150508719" status: 202 len: 0 microversion: 2.1 time: 0.231473 Aug 10 17:49:02.648093 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 27/54] 10.222.0.50 () {58 vars in 1158 bytes} [Wed Aug 10 17:49:02 2022] DELETE /compute/v2.1/flavors/150508719 => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 17:49:02.659953 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-6fc2c760-3ebf-47f6-af86-b7712110271b tempest-FlavorsAdminTestJSON-1446121410 tempest-FlavorsAdminTestJSON-1446121410-project-admin] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:02.696926 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-6fc2c760-3ebf-47f6-af86-b7712110271b tempest-FlavorsAdminTestJSON-1446121410 tempest-FlavorsAdminTestJSON-1446121410-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.044162 Aug 10 17:49:02.711879 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 28/55] 10.222.0.50 () {58 vars in 1146 bytes} [Wed Aug 10 17:49:02 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:49:02.719514 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-7330dd1b-01f5-484e-a7c1-c391ec00ce38 tempest-FlavorsAdminTestJSON-1446121410 tempest-FlavorsAdminTestJSON-1446121410-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-751101233", "id": 325591333, "os-flavor-access:is_public": "False"}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:49:02.795606 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-3cb13fce-ffa3-4e10-852d-185a8d9fd0b5 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd069b0c285c649b0967d0a0e3fdb24ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc21714f4484762aa8797d16cd3f70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:49:02.809546 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-3cb13fce-ffa3-4e10-852d-185a8d9fd0b5 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] 10.222.0.50 "GET /compute/v2.1/servers/419ed54a-a752-46bf-b399-b93ace51b625" status: 200 len: 1243 microversion: 2.1 time: 0.247668 Aug 10 17:49:02.810386 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 28/56] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:49:02 2022] GET /compute/v2.1/servers/419ed54a-a752-46bf-b399-b93ace51b625 => generated 1243 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:49:02.835649 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-7330dd1b-01f5-484e-a7c1-c391ec00ce38 tempest-FlavorsAdminTestJSON-1446121410 tempest-FlavorsAdminTestJSON-1446121410-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.122275 Aug 10 17:49:02.836775 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 29/57] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 17:49:02 2022] POST /compute/v2.1/flavors => generated 411 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:49:02.849240 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-94413394-3488-485f-a5e1-4e68906713bd tempest-FlavorsAdminTestJSON-1446121410 tempest-FlavorsAdminTestJSON-1446121410-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-818992114", "id": 172335828, "os-flavor-access:is_public": "True"}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:49:02.852580 n-d-852296-2 devstack@n-api.service[129410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:49:02.852580 n-d-852296-2 devstack@n-api.service[129410]: warnings.warn(msg) Aug 10 17:49:03.071140 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-94413394-3488-485f-a5e1-4e68906713bd tempest-FlavorsAdminTestJSON-1446121410 tempest-FlavorsAdminTestJSON-1446121410-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 0.225479 Aug 10 17:49:03.078803 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 29/58] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 17:49:02 2022] POST /compute/v2.1/flavors => generated 410 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:49:03.089505 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-72851f85-9eaa-4522-835b-a37bc02526b1 tempest-FlavorsAdminTestJSON-1446121410 tempest-FlavorsAdminTestJSON-1446121410-project-admin] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:03.146178 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-72851f85-9eaa-4522-835b-a37bc02526b1 tempest-FlavorsAdminTestJSON-1446121410 tempest-FlavorsAdminTestJSON-1446121410-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 414 microversion: 2.1 time: 0.045703 Aug 10 17:49:03.146178 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 30/59] 10.222.0.50 () {58 vars in 1169 bytes} [Wed Aug 10 17:49:03 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 414 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:49:03.164332 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-06d0add6-de01-45af-be59-1ebb0e133384 tempest-FlavorsAdminTestJSON-1446121410 tempest-FlavorsAdminTestJSON-1446121410-project-admin] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:03.186359 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-06d0add6-de01-45af-be59-1ebb0e133384 tempest-FlavorsAdminTestJSON-1446121410 tempest-FlavorsAdminTestJSON-1446121410-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 414 microversion: 2.1 time: 0.026188 Aug 10 17:49:03.200373 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-5ec4304c-7ccc-41c3-a5f4-c2b39d9240bf tempest-FlavorsAdminTestJSON-1446121410 tempest-FlavorsAdminTestJSON-1446121410-project-admin] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:03.222284 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 30/60] 10.222.0.50 () {58 vars in 1177 bytes} [Wed Aug 10 17:49:03 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 414 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:49:03.222507 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-5ec4304c-7ccc-41c3-a5f4-c2b39d9240bf tempest-FlavorsAdminTestJSON-1446121410 tempest-FlavorsAdminTestJSON-1446121410-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 414 microversion: 2.1 time: 0.014782 Aug 10 17:49:03.222507 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 31/61] 10.222.0.50 () {58 vars in 1171 bytes} [Wed Aug 10 17:49:03 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 414 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:49:03.227895 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-e794cdc3-7364-492d-b999-08e205d7c42f tempest-FlavorsAdminTestJSON-1446121410 tempest-FlavorsAdminTestJSON-1446121410-project-admin] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:03.247159 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-e794cdc3-7364-492d-b999-08e205d7c42f tempest-FlavorsAdminTestJSON-1446121410 tempest-FlavorsAdminTestJSON-1446121410-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 414 microversion: 2.1 time: 0.023001 Aug 10 17:49:03.248036 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 31/62] 10.222.0.50 () {58 vars in 1169 bytes} [Wed Aug 10 17:49:03 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 414 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:49:03.279064 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-3050baf9-875b-44c4-91dc-a185926c31af tempest-FlavorsAdminTestJSON-1446121410 tempest-FlavorsAdminTestJSON-1446121410-project-admin] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:03.310279 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-3050baf9-875b-44c4-91dc-a185926c31af tempest-FlavorsAdminTestJSON-1446121410 tempest-FlavorsAdminTestJSON-1446121410-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5391 microversion: 2.1 time: 0.034805 Aug 10 17:49:03.324207 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 32/63] 10.222.0.50 () {58 vars in 1169 bytes} [Wed Aug 10 17:49:03 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5391 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:49:03.341138 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-737de99b-7799-41b7-a1d3-0916f5d23695 tempest-FlavorsAdminTestJSON-1446121410 tempest-FlavorsAdminTestJSON-1446121410-project-admin] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:03.398205 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-737de99b-7799-41b7-a1d3-0916f5d23695 tempest-FlavorsAdminTestJSON-1446121410 tempest-FlavorsAdminTestJSON-1446121410-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5391 microversion: 2.1 time: 0.059083 Aug 10 17:49:03.409348 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 32/64] 10.222.0.50 () {58 vars in 1175 bytes} [Wed Aug 10 17:49:03 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5391 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:49:03.419044 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-97f505ef-a130-42ac-b000-8e206aed1b83 tempest-FlavorsAdminTestJSON-1446121410 tempest-FlavorsAdminTestJSON-1446121410-project-admin] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:03.461823 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-97f505ef-a130-42ac-b000-8e206aed1b83 tempest-FlavorsAdminTestJSON-1446121410 tempest-FlavorsAdminTestJSON-1446121410-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5391 microversion: 2.1 time: 0.047757 Aug 10 17:49:03.477380 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 33/65] 10.222.0.50 () {58 vars in 1173 bytes} [Wed Aug 10 17:49:03 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5391 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:49:03.482336 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-f116c392-f6b6-4a3f-a8c4-4919e5d1f2f3 tempest-FlavorsAdminTestJSON-1446121410 tempest-FlavorsAdminTestJSON-1446121410-project-admin] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:03.543830 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-f116c392-f6b6-4a3f-a8c4-4919e5d1f2f3 tempest-FlavorsAdminTestJSON-1446121410 tempest-FlavorsAdminTestJSON-1446121410-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5391 microversion: 2.1 time: 0.064043 Aug 10 17:49:03.544735 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 33/66] 10.222.0.50 () {58 vars in 1169 bytes} [Wed Aug 10 17:49:03 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5391 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:49:03.563560 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-d4e5b233-53fc-4789-a1e1-132ef637aabb tempest-FlavorsAdminTestJSON-1446121410 tempest-FlavorsAdminTestJSON-1446121410-project-admin] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:03.742212 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-d4e5b233-53fc-4789-a1e1-132ef637aabb tempest-FlavorsAdminTestJSON-1446121410 tempest-FlavorsAdminTestJSON-1446121410-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/172335828" status: 202 len: 0 microversion: 2.1 time: 0.182848 Aug 10 17:49:03.745524 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 34/67] 10.222.0.50 () {58 vars in 1158 bytes} [Wed Aug 10 17:49:03 2022] DELETE /compute/v2.1/flavors/172335828 => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 17:49:03.758088 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-96e5587c-fb99-4810-815f-e03f8f97ddbf tempest-FlavorsAdminTestJSON-1446121410 tempest-FlavorsAdminTestJSON-1446121410-project-admin] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:03.784659 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-96e5587c-fb99-4810-815f-e03f8f97ddbf tempest-FlavorsAdminTestJSON-1446121410 tempest-FlavorsAdminTestJSON-1446121410-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.034488 Aug 10 17:49:03.785259 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 34/68] 10.222.0.50 () {58 vars in 1146 bytes} [Wed Aug 10 17:49:03 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:49:03.802942 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-130d1b79-66c5-4b2a-8f53-3b57008ffa28 tempest-FlavorsAdminTestJSON-1446121410 tempest-FlavorsAdminTestJSON-1446121410-project-admin] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:03.848002 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-725a33a0-3a2f-4a57-be92-7e42a405428e tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:03.848002 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-725a33a0-3a2f-4a57-be92-7e42a405428e tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] [instance: 419ed54a-a752-46bf-b399-b93ace51b625] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:49:03.885106 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-725a33a0-3a2f-4a57-be92-7e42a405428e tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd069b0c285c649b0967d0a0e3fdb24ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc21714f4484762aa8797d16cd3f70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:49:03.892985 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-725a33a0-3a2f-4a57-be92-7e42a405428e tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] 10.222.0.50 "GET /compute/v2.1/servers/419ed54a-a752-46bf-b399-b93ace51b625" status: 200 len: 1243 microversion: 2.1 time: 0.066064 Aug 10 17:49:03.893571 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 35/69] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:49:03 2022] GET /compute/v2.1/servers/419ed54a-a752-46bf-b399-b93ace51b625 => generated 1243 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:49:04.028608 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-130d1b79-66c5-4b2a-8f53-3b57008ffa28 tempest-FlavorsAdminTestJSON-1446121410 tempest-FlavorsAdminTestJSON-1446121410-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/325591333" status: 202 len: 0 microversion: 2.1 time: 0.229223 Aug 10 17:49:04.030939 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 35/70] 10.222.0.50 () {58 vars in 1158 bytes} [Wed Aug 10 17:49:03 2022] DELETE /compute/v2.1/flavors/325591333 => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 17:49:04.039777 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-d0dcf93e-f3e3-4da6-a551-8368f735e084 tempest-FlavorsAdminTestJSON-1446121410 tempest-FlavorsAdminTestJSON-1446121410-project-admin] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:04.092373 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-d0dcf93e-f3e3-4da6-a551-8368f735e084 tempest-FlavorsAdminTestJSON-1446121410 tempest-FlavorsAdminTestJSON-1446121410-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.036033 Aug 10 17:49:04.092373 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 36/71] 10.222.0.50 () {58 vars in 1146 bytes} [Wed Aug 10 17:49:04 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:49:04.111076 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-31ac95ad-fdbc-4b3b-99c2-ab9ecf0ce920 tempest-FlavorsAdminTestJSON-1446121410 tempest-FlavorsAdminTestJSON-1446121410-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-766330250", "id": 561393581, "os-flavor-access:is_public": "False"}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:49:04.228139 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-31ac95ad-fdbc-4b3b-99c2-ab9ecf0ce920 tempest-FlavorsAdminTestJSON-1446121410 tempest-FlavorsAdminTestJSON-1446121410-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.119021 Aug 10 17:49:04.228788 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 36/72] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 17:49:04 2022] POST /compute/v2.1/flavors => generated 411 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:49:04.243002 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-2d5cdd43-7514-4d25-9819-10efb4173581 tempest-FlavorsAdminTestJSON-1446121410 tempest-FlavorsAdminTestJSON-1446121410-project-admin] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:04.301680 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-2d5cdd43-7514-4d25-9819-10efb4173581 tempest-FlavorsAdminTestJSON-1446121410 tempest-FlavorsAdminTestJSON-1446121410-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.063556 Aug 10 17:49:04.303227 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 37/73] 10.222.0.50 () {58 vars in 1146 bytes} [Wed Aug 10 17:49:04 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:49:04.321065 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-32ecb812-0ff5-4847-bef6-93b22e607620 tempest-FlavorsAdminTestJSON-2015828218 tempest-FlavorsAdminTestJSON-2015828218-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:04.420411 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-32ecb812-0ff5-4847-bef6-93b22e607620 tempest-FlavorsAdminTestJSON-2015828218 tempest-FlavorsAdminTestJSON-2015828218-project] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.102046 Aug 10 17:49:04.421257 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 37/74] 10.222.0.50 () {58 vars in 1146 bytes} [Wed Aug 10 17:49:04 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:49:04.442828 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-2cfe45b6-e4fd-4f2e-8834-72082c04932a tempest-FlavorsAdminTestJSON-1446121410 tempest-FlavorsAdminTestJSON-1446121410-project-admin] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:04.445153 n-d-852296-2 devstack@n-api.service[129410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:49:04.445153 n-d-852296-2 devstack@n-api.service[129410]: warnings.warn(msg) Aug 10 17:49:04.619840 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-2cfe45b6-e4fd-4f2e-8834-72082c04932a tempest-FlavorsAdminTestJSON-1446121410 tempest-FlavorsAdminTestJSON-1446121410-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/561393581" status: 202 len: 0 microversion: 2.1 time: 0.183801 Aug 10 17:49:04.621498 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 38/75] 10.222.0.50 () {58 vars in 1158 bytes} [Wed Aug 10 17:49:04 2022] DELETE /compute/v2.1/flavors/561393581 => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 17:49:04.629560 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-64021446-6d3b-427d-b055-e683e43502ce tempest-FlavorsAdminTestJSON-1446121410 tempest-FlavorsAdminTestJSON-1446121410-project-admin] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:04.663715 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-64021446-6d3b-427d-b055-e683e43502ce tempest-FlavorsAdminTestJSON-1446121410 tempest-FlavorsAdminTestJSON-1446121410-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.037811 Aug 10 17:49:04.664926 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 38/76] 10.222.0.50 () {58 vars in 1146 bytes} [Wed Aug 10 17:49:04 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:49:04.686056 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-78c70067-46ce-45b8-8740-5f89a3577c9c tempest-FlavorsAdminTestJSON-1446121410 tempest-FlavorsAdminTestJSON-1446121410-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1865715739", "id": 1237311010, "os-flavor-access:is_public": "True"}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:49:04.689288 n-d-852296-2 devstack@n-api.service[129410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:49:04.689288 n-d-852296-2 devstack@n-api.service[129410]: warnings.warn(msg) Aug 10 17:49:04.832621 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-78c70067-46ce-45b8-8740-5f89a3577c9c tempest-FlavorsAdminTestJSON-1446121410 tempest-FlavorsAdminTestJSON-1446121410-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.151421 Aug 10 17:49:04.833584 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 39/77] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 17:49:04 2022] POST /compute/v2.1/flavors => generated 414 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:49:04.845657 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-2748b6cb-2fae-4ad8-b730-79ad8d5506b4 tempest-FlavorsAdminTestJSON-2015828218 tempest-FlavorsAdminTestJSON-2015828218-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:04.888897 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-2748b6cb-2fae-4ad8-b730-79ad8d5506b4 tempest-FlavorsAdminTestJSON-2015828218 tempest-FlavorsAdminTestJSON-2015828218-project] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.045815 Aug 10 17:49:04.891387 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 39/78] 10.222.0.50 () {58 vars in 1146 bytes} [Wed Aug 10 17:49:04 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:49:04.913716 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-501f453d-4d0c-4961-a2f0-a341360f2d6b tempest-FlavorsAdminTestJSON-1446121410 tempest-FlavorsAdminTestJSON-1446121410-project-admin] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:04.917206 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-f0963c6c-d6c4-4ae7-bb5d-b8dc384b1e3c tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:04.917206 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-f0963c6c-d6c4-4ae7-bb5d-b8dc384b1e3c tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] [instance: 419ed54a-a752-46bf-b399-b93ace51b625] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:49:04.929094 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_api:SELECT=84,nova_api:DELETE=8,nova_api:INSERT=8 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:49:05.013158 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_cell0:SELECT=2 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:49:05.083295 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-501f453d-4d0c-4961-a2f0-a341360f2d6b tempest-FlavorsAdminTestJSON-1446121410 tempest-FlavorsAdminTestJSON-1446121410-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/1237311010" status: 202 len: 0 microversion: 2.1 time: 0.177228 Aug 10 17:49:05.087787 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 40/79] 10.222.0.50 () {58 vars in 1161 bytes} [Wed Aug 10 17:49:04 2022] DELETE /compute/v2.1/flavors/1237311010 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 17:49:05.096975 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-f12ff547-d533-4909-9c7d-ac575a056303 tempest-FlavorsAdminTestJSON-1446121410 tempest-FlavorsAdminTestJSON-1446121410-project-admin] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:05.188039 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-f12ff547-d533-4909-9c7d-ac575a056303 tempest-FlavorsAdminTestJSON-1446121410 tempest-FlavorsAdminTestJSON-1446121410-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.084710 Aug 10 17:49:05.189385 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 41/80] 10.222.0.50 () {58 vars in 1146 bytes} [Wed Aug 10 17:49:05 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:49:06.041028 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-f0963c6c-d6c4-4ae7-bb5d-b8dc384b1e3c tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd069b0c285c649b0967d0a0e3fdb24ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc21714f4484762aa8797d16cd3f70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:49:06.060519 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-f0963c6c-d6c4-4ae7-bb5d-b8dc384b1e3c tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] 10.222.0.50 "GET /compute/v2.1/servers/419ed54a-a752-46bf-b399-b93ace51b625" status: 200 len: 1243 microversion: 2.1 time: 1.149817 Aug 10 17:49:06.063372 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 40/81] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:49:04 2022] GET /compute/v2.1/servers/419ed54a-a752-46bf-b399-b93ace51b625 => generated 1243 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:49:07.085371 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-aa7f58ea-cade-452c-a744-f6448fec3e4b tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:07.086925 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-aa7f58ea-cade-452c-a744-f6448fec3e4b tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] [instance: 419ed54a-a752-46bf-b399-b93ace51b625] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:49:07.101854 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-aa7f58ea-cade-452c-a744-f6448fec3e4b tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:07.102356 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-aa7f58ea-cade-452c-a744-f6448fec3e4b tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:07.102796 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-aa7f58ea-cade-452c-a744-f6448fec3e4b tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:07.103503 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-aa7f58ea-cade-452c-a744-f6448fec3e4b tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:07.129638 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-aa7f58ea-cade-452c-a744-f6448fec3e4b tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:07.131323 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-aa7f58ea-cade-452c-a744-f6448fec3e4b tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:07.451296 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-f0963c6c-d6c4-4ae7-bb5d-b8dc384b1e3c tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:07.453424 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-f0963c6c-d6c4-4ae7-bb5d-b8dc384b1e3c tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] 10.222.0.50 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002985 Aug 10 17:49:07.454087 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 41/82] 10.222.0.50 () {56 vars in 886 bytes} [Wed Aug 10 17:49:07 2022] GET /compute/ => generated 377 bytes in 4 msecs (HTTP/1.1 200) 3 headers in 91 bytes (2 switches on core 0) Aug 10 17:49:07.509200 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-aa7f58ea-cade-452c-a744-f6448fec3e4b tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd069b0c285c649b0967d0a0e3fdb24ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc21714f4484762aa8797d16cd3f70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:49:07.527038 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-aa7f58ea-cade-452c-a744-f6448fec3e4b tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] 10.222.0.50 "GET /compute/v2.1/servers/419ed54a-a752-46bf-b399-b93ace51b625" status: 200 len: 1243 microversion: 2.1 time: 0.445691 Aug 10 17:49:07.528465 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 42/83] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:49:07 2022] GET /compute/v2.1/servers/419ed54a-a752-46bf-b399-b93ace51b625 => generated 1243 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:49:07.618983 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_cell1:SELECT=6 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:49:07.847678 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-410f3cb2-7f00-4903-a5c0-4a8c55a33905 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1873345422", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452"}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:49:07.963018 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.network.neutron [None req-410f3cb2-7f00-4903-a5c0-4a8c55a33905 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] validate_networks() for None {{(pid=129409) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 17:49:08.274590 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.virt.hardware [None req-410f3cb2-7f00-4903-a5c0-4a8c55a33905 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Flavor limits 0:0:0 {{(pid=129409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 17:49:08.275019 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.virt.hardware [None req-410f3cb2-7f00-4903-a5c0-4a8c55a33905 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Image limits 0:0:0 {{(pid=129409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 17:49:08.275612 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.virt.hardware [None req-410f3cb2-7f00-4903-a5c0-4a8c55a33905 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Flavor pref 0:0:0 {{(pid=129409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 17:49:08.276186 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.virt.hardware [None req-410f3cb2-7f00-4903-a5c0-4a8c55a33905 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Image pref 0:0:0 {{(pid=129409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 17:49:08.276956 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.virt.hardware [None req-410f3cb2-7f00-4903-a5c0-4a8c55a33905 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 17:49:08.309429 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-410f3cb2-7f00-4903-a5c0-4a8c55a33905 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:08.309944 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-410f3cb2-7f00-4903-a5c0-4a8c55a33905 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:08.310390 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-410f3cb2-7f00-4903-a5c0-4a8c55a33905 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:08.311169 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-410f3cb2-7f00-4903-a5c0-4a8c55a33905 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:08.311623 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-410f3cb2-7f00-4903-a5c0-4a8c55a33905 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:08.312046 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-410f3cb2-7f00-4903-a5c0-4a8c55a33905 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:08.378554 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-410f3cb2-7f00-4903-a5c0-4a8c55a33905 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Getting quotas for project d5b721d6dfb14d3d8780094fc4e72890. Resources: {'instances', 'ram', 'cores'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:49:08.386088 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-410f3cb2-7f00-4903-a5c0-4a8c55a33905 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Getting quotas for user 9f242fdc47104b98882cb29c8ca5caae and project d5b721d6dfb14d3d8780094fc4e72890. Resources: {'instances', 'ram', 'cores'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:49:08.400864 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-410f3cb2-7f00-4903-a5c0-4a8c55a33905 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Going to run 1 instances... {{(pid=129409) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 17:49:08.405399 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-410f3cb2-7f00-4903-a5c0-4a8c55a33905 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] [instance: 8e4a95fa-1d4a-4dca-9ba6-73a55f57d771] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a735ff26-463a-4ffe-a981-ab9d9baa494f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 17:49:08.553420 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-c956cb58-e3e4-4d83-a3be-e0078b57193d tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:08.554942 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-c956cb58-e3e4-4d83-a3be-e0078b57193d tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] [instance: 419ed54a-a752-46bf-b399-b93ace51b625] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:49:08.564035 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-c956cb58-e3e4-4d83-a3be-e0078b57193d tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:08.564588 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-c956cb58-e3e4-4d83-a3be-e0078b57193d tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:08.565037 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-c956cb58-e3e4-4d83-a3be-e0078b57193d tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:08.565755 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-c956cb58-e3e4-4d83-a3be-e0078b57193d tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:08.566212 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-c956cb58-e3e4-4d83-a3be-e0078b57193d tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:08.566817 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-c956cb58-e3e4-4d83-a3be-e0078b57193d tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:08.570472 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-410f3cb2-7f00-4903-a5c0-4a8c55a33905 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.961285 Aug 10 17:49:08.572007 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 42/84] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 17:49:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 964 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 17:49:08.602807 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-bbcdb22a-4a40-423a-a627-1bce551a95a5 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:08.603530 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-bbcdb22a-4a40-423a-a627-1bce551a95a5 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] [instance: 8e4a95fa-1d4a-4dca-9ba6-73a55f57d771] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:49:08.724563 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-bbcdb22a-4a40-423a-a627-1bce551a95a5 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f242fdc47104b98882cb29c8ca5caae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b721d6dfb14d3d8780094fc4e72890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:49:08.734121 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-bbcdb22a-4a40-423a-a627-1bce551a95a5 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] 10.222.0.50 "GET /compute/v2.1/servers/8e4a95fa-1d4a-4dca-9ba6-73a55f57d771" status: 200 len: 1220 microversion: 2.1 time: 0.149239 Aug 10 17:49:08.746844 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 43/85] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:49:08 2022] GET /compute/v2.1/servers/8e4a95fa-1d4a-4dca-9ba6-73a55f57d771 => generated 1220 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:49:08.925927 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-c956cb58-e3e4-4d83-a3be-e0078b57193d tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd069b0c285c649b0967d0a0e3fdb24ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc21714f4484762aa8797d16cd3f70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:49:08.946522 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-c956cb58-e3e4-4d83-a3be-e0078b57193d tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] 10.222.0.50 "GET /compute/v2.1/servers/419ed54a-a752-46bf-b399-b93ace51b625" status: 200 len: 1291 microversion: 2.1 time: 0.393636 Aug 10 17:49:08.949986 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 43/86] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:49:08 2022] GET /compute/v2.1/servers/419ed54a-a752-46bf-b399-b93ace51b625 => generated 1291 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:49:09.427025 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-14a04e96-b172-4ae2-bc15-a5f8b489ad33 tempest-FlavorsV261TestJSON-1546897239 tempest-FlavorsV261TestJSON-1546897239-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-55264155", "id": 922839777, "os-flavor-access:is_public": "True"}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:49:09.430871 n-d-852296-2 devstack@n-api.service[129409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:49:09.430871 n-d-852296-2 devstack@n-api.service[129409]: warnings.warn(msg) Aug 10 17:49:09.572205 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-14a04e96-b172-4ae2-bc15-a5f8b489ad33 tempest-FlavorsV261TestJSON-1546897239 tempest-FlavorsV261TestJSON-1546897239-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 463 microversion: 2.61 time: 0.460574 Aug 10 17:49:09.577614 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 44/87] 10.222.0.50 () {62 vars in 1188 bytes} [Wed Aug 10 17:49:09 2022] POST /compute/v2.1/flavors => generated 463 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 17:49:09.597924 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-1b186110-0d16-4a0b-a379-295e7e99ed5b tempest-ServersWithSpecificFlavorTestJSON-1791066950 tempest-ServersWithSpecificFlavorTestJSON-1791066950-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:09.610467 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-1b186110-0d16-4a0b-a379-295e7e99ed5b tempest-ServersWithSpecificFlavorTestJSON-1791066950 tempest-ServersWithSpecificFlavorTestJSON-1791066950-project] 10.222.0.50 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.319933 Aug 10 17:49:09.625210 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 44/88] 10.222.0.50 () {58 vars in 1137 bytes} [Wed Aug 10 17:49:09 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:49:09.803018 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-33de8ea8-66a8-4667-8c8a-36b032dbe8cc tempest-FlavorsV261TestJSON-269350480 tempest-FlavorsV261TestJSON-269350480-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:09.821220 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-33de8ea8-66a8-4667-8c8a-36b032dbe8cc tempest-FlavorsV261TestJSON-269350480 tempest-FlavorsV261TestJSON-269350480-project] 10.222.0.50 "GET /compute/v2.1/flavors/922839777" status: 200 len: 463 microversion: 2.61 time: 0.234519 Aug 10 17:49:09.821884 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 45/89] 10.222.0.50 () {60 vars in 1196 bytes} [Wed Aug 10 17:49:09 2022] GET /compute/v2.1/flavors/922839777 => generated 463 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 17:49:09.837145 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-6a388078-5810-42dc-95f3-38849ee62010 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:09.838401 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-6a388078-5810-42dc-95f3-38849ee62010 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] [instance: 8e4a95fa-1d4a-4dca-9ba6-73a55f57d771] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:49:09.955802 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-6a388078-5810-42dc-95f3-38849ee62010 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f242fdc47104b98882cb29c8ca5caae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b721d6dfb14d3d8780094fc4e72890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:49:09.967467 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-6a388078-5810-42dc-95f3-38849ee62010 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] 10.222.0.50 "GET /compute/v2.1/servers/8e4a95fa-1d4a-4dca-9ba6-73a55f57d771" status: 200 len: 1220 microversion: 2.1 time: 0.133353 Aug 10 17:49:09.969792 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 46/90] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:49:09 2022] GET /compute/v2.1/servers/8e4a95fa-1d4a-4dca-9ba6-73a55f57d771 => generated 1220 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:49:09.985931 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-d701699d-7551-4807-b6bd-88fb9575c896 tempest-FlavorsV261TestJSON-1546897239 tempest-FlavorsV261TestJSON-1546897239-project-admin] Action: 'update', calling method: .version_select at 0x7fb348dbf4c0>, body: {"flavor": {"description": "new"}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:49:10.016584 n-d-852296-2 devstack@n-api.service[129409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:49:10.016584 n-d-852296-2 devstack@n-api.service[129409]: warnings.warn(msg) Aug 10 17:49:10.061729 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-e3d7386d-3c23-4015-bff0-b0e9a8dbf566 tempest-ServersWithSpecificFlavorTestJSON-814160199 tempest-ServersWithSpecificFlavorTestJSON-814160199-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-541753301", "id": 2055881514, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:49:10.064798 n-d-852296-2 devstack@n-api.service[129410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:49:10.064798 n-d-852296-2 devstack@n-api.service[129410]: warnings.warn(msg) Aug 10 17:49:10.185445 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-d701699d-7551-4807-b6bd-88fb9575c896 tempest-FlavorsV261TestJSON-1546897239 tempest-FlavorsV261TestJSON-1546897239-project-admin] 10.222.0.50 "PUT /compute/v2.1/flavors/922839777" status: 200 len: 464 microversion: 2.61 time: 0.214461 Aug 10 17:49:10.193924 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 47/91] 10.222.0.50 () {62 vars in 1216 bytes} [Wed Aug 10 17:49:09 2022] PUT /compute/v2.1/flavors/922839777 => generated 464 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 17:49:10.194014 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-e3d7386d-3c23-4015-bff0-b0e9a8dbf566 tempest-ServersWithSpecificFlavorTestJSON-814160199 tempest-ServersWithSpecificFlavorTestJSON-814160199-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 424 microversion: 2.1 time: 0.564628 Aug 10 17:49:10.209428 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 45/92] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 17:49:09 2022] POST /compute/v2.1/flavors => generated 424 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:49:10.222260 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-561b3f1e-7df1-42e0-aa21-9a0d39a05bb6 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:10.222260 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-561b3f1e-7df1-42e0-aa21-9a0d39a05bb6 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] [instance: 419ed54a-a752-46bf-b399-b93ace51b625] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:49:10.224277 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-d842000a-1be8-44cc-a248-6f2e84ef6664 tempest-FlavorsV261TestJSON-269350480 tempest-FlavorsV261TestJSON-269350480-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:10.244626 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-561b3f1e-7df1-42e0-aa21-9a0d39a05bb6 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:10.245614 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-561b3f1e-7df1-42e0-aa21-9a0d39a05bb6 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:10.252324 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-561b3f1e-7df1-42e0-aa21-9a0d39a05bb6 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:10.259658 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-561b3f1e-7df1-42e0-aa21-9a0d39a05bb6 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:10.261123 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-561b3f1e-7df1-42e0-aa21-9a0d39a05bb6 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:10.262283 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-561b3f1e-7df1-42e0-aa21-9a0d39a05bb6 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:10.315919 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-d842000a-1be8-44cc-a248-6f2e84ef6664 tempest-FlavorsV261TestJSON-269350480 tempest-FlavorsV261TestJSON-269350480-project] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 6699 microversion: 2.61 time: 0.105383 Aug 10 17:49:10.316572 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 46/93] 10.222.0.50 () {60 vars in 1187 bytes} [Wed Aug 10 17:49:10 2022] GET /compute/v2.1/flavors/detail => generated 6699 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:49:10.338171 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-9060e9f0-c670-49ba-9b59-720ee4a39d99 tempest-ServersWithSpecificFlavorTestJSON-814160199 tempest-ServersWithSpecificFlavorTestJSON-814160199-project-admin] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:10.362417 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-9060e9f0-c670-49ba-9b59-720ee4a39d99 tempest-ServersWithSpecificFlavorTestJSON-814160199 tempest-ServersWithSpecificFlavorTestJSON-814160199-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.037550 Aug 10 17:49:10.365146 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 47/94] 10.222.0.50 () {58 vars in 1182 bytes} [Wed Aug 10 17:49:10 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 17:49:10.390099 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-748b0565-5281-4e53-8f87-c751e565b244 tempest-FlavorsV261TestJSON-269350480 tempest-FlavorsV261TestJSON-269350480-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:10.419802 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-748b0565-5281-4e53-8f87-c751e565b244 tempest-FlavorsV261TestJSON-269350480 tempest-FlavorsV261TestJSON-269350480-project] 10.222.0.50 "GET /compute/v2.1/flavors" status: 200 len: 3416 microversion: 2.61 time: 0.045077 Aug 10 17:49:10.421460 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 48/95] 10.222.0.50 () {60 vars in 1166 bytes} [Wed Aug 10 17:49:10 2022] GET /compute/v2.1/flavors => generated 3416 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:49:10.435476 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-798001f1-6a60-41eb-9178-93eac4513b55 tempest-ServersWithSpecificFlavorTestJSON-814160199 tempest-ServersWithSpecificFlavorTestJSON-814160199-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-128227752", "id": 729594390, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:49:10.621932 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-798001f1-6a60-41eb-9178-93eac4513b55 tempest-ServersWithSpecificFlavorTestJSON-814160199 tempest-ServersWithSpecificFlavorTestJSON-814160199-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 421 microversion: 2.1 time: 0.199082 Aug 10 17:49:10.632398 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 49/96] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 17:49:10 2022] POST /compute/v2.1/flavors => generated 421 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:49:10.634226 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-8335a669-3c81-4a53-b689-5507c488ce01 tempest-FlavorsV261TestJSON-1546897239 tempest-FlavorsV261TestJSON-1546897239-project-admin] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:10.634998 n-d-852296-2 devstack@n-api.service[129410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:49:10.634998 n-d-852296-2 devstack@n-api.service[129410]: warnings.warn(msg) Aug 10 17:49:10.755400 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-8335a669-3c81-4a53-b689-5507c488ce01 tempest-FlavorsV261TestJSON-1546897239 tempest-FlavorsV261TestJSON-1546897239-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/922839777" status: 202 len: 0 microversion: 2.61 time: 0.124591 Aug 10 17:49:10.760148 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 50/97] 10.222.0.50 () {60 vars in 1199 bytes} [Wed Aug 10 17:49:10 2022] DELETE /compute/v2.1/flavors/922839777 => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 10 17:49:10.772159 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-5e991ab9-57f7-4c28-a8aa-2033717aa288 tempest-ServersWithSpecificFlavorTestJSON-814160199 tempest-ServersWithSpecificFlavorTestJSON-814160199-project-admin] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:10.792172 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-5e991ab9-57f7-4c28-a8aa-2033717aa288 tempest-ServersWithSpecificFlavorTestJSON-814160199 tempest-ServersWithSpecificFlavorTestJSON-814160199-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.030012 Aug 10 17:49:10.794208 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 51/98] 10.222.0.50 () {58 vars in 1182 bytes} [Wed Aug 10 17:49:10 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 17:49:10.806138 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-561b3f1e-7df1-42e0-aa21-9a0d39a05bb6 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd069b0c285c649b0967d0a0e3fdb24ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc21714f4484762aa8797d16cd3f70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:49:10.811704 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-77247e49-8191-45b0-9d4a-da01ec00b3b1 tempest-FlavorsV261TestJSON-1546897239 tempest-FlavorsV261TestJSON-1546897239-project-admin] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:10.838946 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-77247e49-8191-45b0-9d4a-da01ec00b3b1 tempest-FlavorsV261TestJSON-1546897239 tempest-FlavorsV261TestJSON-1546897239-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 6696 microversion: 2.61 time: 0.041452 Aug 10 17:49:10.839536 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-561b3f1e-7df1-42e0-aa21-9a0d39a05bb6 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] 10.222.0.50 "GET /compute/v2.1/servers/419ed54a-a752-46bf-b399-b93ace51b625" status: 200 len: 1297 microversion: 2.1 time: 0.648009 Aug 10 17:49:10.840300 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 52/99] 10.222.0.50 () {60 vars in 1187 bytes} [Wed Aug 10 17:49:10 2022] GET /compute/v2.1/flavors/detail => generated 6696 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:49:10.840405 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 48/100] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:49:10 2022] GET /compute/v2.1/servers/419ed54a-a752-46bf-b399-b93ace51b625 => generated 1297 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:49:10.845136 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-4c8a7f9f-0c5e-4cf4-8f3e-6d15ff291038 tempest-ServersWithSpecificFlavorTestJSON-1791066950 tempest-ServersWithSpecificFlavorTestJSON-1791066950-project] Action: 'create', calling method: .version_select at 0x7fb346d07160>, body: {"keypair": {"name": "tempest-keypair-1512200958", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG9OL3s50s6Xj9uDXumxkvxaLgIRBjsWNRCtsMoc5JxK+TGEddyRBZIJ4monVXODo0HGnHDwm2l4xKp/YUQR1475x9m+RHjC6iEZ14QsA1LL/QwG/2dg2XertvVYzt0moQ=="}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:49:10.892156 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_api:DELETE=10,nova_api:SELECT=82,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:49:10.906881 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-4c8a7f9f-0c5e-4cf4-8f3e-6d15ff291038 tempest-ServersWithSpecificFlavorTestJSON-1791066950 tempest-ServersWithSpecificFlavorTestJSON-1791066950-project] Getting quotas for project 825ec49be4754fabada85a4eea4ef713. Resources: {'key_pairs'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:49:10.914259 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-4c8a7f9f-0c5e-4cf4-8f3e-6d15ff291038 tempest-ServersWithSpecificFlavorTestJSON-1791066950 tempest-ServersWithSpecificFlavorTestJSON-1791066950-project] Getting quotas for user 8a79fadc55914179bfc3c4ebbbe0235f and project 825ec49be4754fabada85a4eea4ef713. Resources: {'key_pairs'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:49:10.992136 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-1254a600-8274-4562-9dad-b59112a7f6bf tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:10.993031 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-1254a600-8274-4562-9dad-b59112a7f6bf tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] [instance: 8e4a95fa-1d4a-4dca-9ba6-73a55f57d771] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:49:11.050289 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-1254a600-8274-4562-9dad-b59112a7f6bf tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f242fdc47104b98882cb29c8ca5caae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b721d6dfb14d3d8780094fc4e72890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:49:11.059326 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-1254a600-8274-4562-9dad-b59112a7f6bf tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] 10.222.0.50 "GET /compute/v2.1/servers/8e4a95fa-1d4a-4dca-9ba6-73a55f57d771" status: 200 len: 1220 microversion: 2.1 time: 0.071219 Aug 10 17:49:11.059947 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 53/101] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:49:10 2022] GET /compute/v2.1/servers/8e4a95fa-1d4a-4dca-9ba6-73a55f57d771 => generated 1220 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:49:11.137590 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-4c8a7f9f-0c5e-4cf4-8f3e-6d15ff291038 tempest-ServersWithSpecificFlavorTestJSON-1791066950 tempest-ServersWithSpecificFlavorTestJSON-1791066950-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.296101 Aug 10 17:49:11.138555 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 49/102] 10.222.0.50 () {60 vars in 1159 bytes} [Wed Aug 10 17:49:10 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:49:11.874419 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-b3e63e57-7060-412e-9b99-56c8ba40d00c tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:11.875149 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-b3e63e57-7060-412e-9b99-56c8ba40d00c tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] [instance: 419ed54a-a752-46bf-b399-b93ace51b625] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:49:11.904646 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b3e63e57-7060-412e-9b99-56c8ba40d00c tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:11.905435 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b3e63e57-7060-412e-9b99-56c8ba40d00c tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:11.905570 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b3e63e57-7060-412e-9b99-56c8ba40d00c tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:11.909376 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b3e63e57-7060-412e-9b99-56c8ba40d00c tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:11.917220 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b3e63e57-7060-412e-9b99-56c8ba40d00c tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:11.917992 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b3e63e57-7060-412e-9b99-56c8ba40d00c tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:12.082831 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-ec046356-53a1-4e42-8874-3220fbab99b8 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:12.083562 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-ec046356-53a1-4e42-8874-3220fbab99b8 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] [instance: 8e4a95fa-1d4a-4dca-9ba6-73a55f57d771] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:49:12.096566 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-ec046356-53a1-4e42-8874-3220fbab99b8 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:12.097286 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-ec046356-53a1-4e42-8874-3220fbab99b8 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:12.098033 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-ec046356-53a1-4e42-8874-3220fbab99b8 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:12.099245 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-ec046356-53a1-4e42-8874-3220fbab99b8 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:12.109093 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-ec046356-53a1-4e42-8874-3220fbab99b8 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:12.109942 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-ec046356-53a1-4e42-8874-3220fbab99b8 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:12.279399 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_cell0:SELECT=8 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:49:12.342541 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-ec046356-53a1-4e42-8874-3220fbab99b8 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f242fdc47104b98882cb29c8ca5caae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b721d6dfb14d3d8780094fc4e72890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:49:12.362802 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-ec046356-53a1-4e42-8874-3220fbab99b8 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] 10.222.0.50 "GET /compute/v2.1/servers/8e4a95fa-1d4a-4dca-9ba6-73a55f57d771" status: 200 len: 1216 microversion: 2.1 time: 0.282510 Aug 10 17:49:12.364621 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 50/103] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:49:12 2022] GET /compute/v2.1/servers/8e4a95fa-1d4a-4dca-9ba6-73a55f57d771 => generated 1216 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:49:12.493410 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-b3e63e57-7060-412e-9b99-56c8ba40d00c tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd069b0c285c649b0967d0a0e3fdb24ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc21714f4484762aa8797d16cd3f70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:49:12.502947 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-b3e63e57-7060-412e-9b99-56c8ba40d00c tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] 10.222.0.50 "GET /compute/v2.1/servers/419ed54a-a752-46bf-b399-b93ace51b625" status: 200 len: 1339 microversion: 2.1 time: 0.633120 Aug 10 17:49:12.505174 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 54/104] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:49:11 2022] GET /compute/v2.1/servers/419ed54a-a752-46bf-b399-b93ace51b625 => generated 1339 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:49:13.390022 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-bf7a0364-b08a-4c27-b8aa-4adea570eee6 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:13.391799 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-bf7a0364-b08a-4c27-b8aa-4adea570eee6 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] [instance: 8e4a95fa-1d4a-4dca-9ba6-73a55f57d771] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:49:13.402877 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-bf7a0364-b08a-4c27-b8aa-4adea570eee6 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:13.406193 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-bf7a0364-b08a-4c27-b8aa-4adea570eee6 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:13.406963 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-bf7a0364-b08a-4c27-b8aa-4adea570eee6 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:13.410340 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-bf7a0364-b08a-4c27-b8aa-4adea570eee6 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:13.411142 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-bf7a0364-b08a-4c27-b8aa-4adea570eee6 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:13.412862 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-bf7a0364-b08a-4c27-b8aa-4adea570eee6 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:13.580112 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-bf7a0364-b08a-4c27-b8aa-4adea570eee6 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f242fdc47104b98882cb29c8ca5caae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b721d6dfb14d3d8780094fc4e72890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:49:13.601950 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-bf7a0364-b08a-4c27-b8aa-4adea570eee6 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] 10.222.0.50 "GET /compute/v2.1/servers/8e4a95fa-1d4a-4dca-9ba6-73a55f57d771" status: 200 len: 1272 microversion: 2.1 time: 0.217430 Aug 10 17:49:13.603499 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 55/105] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:49:13 2022] GET /compute/v2.1/servers/8e4a95fa-1d4a-4dca-9ba6-73a55f57d771 => generated 1272 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:49:13.610965 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-9be9e3d2-2b10-4b27-be51-e29299d3ee28 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:13.611691 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-9be9e3d2-2b10-4b27-be51-e29299d3ee28 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] [instance: 419ed54a-a752-46bf-b399-b93ace51b625] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:49:13.619924 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-9be9e3d2-2b10-4b27-be51-e29299d3ee28 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:13.620799 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-9be9e3d2-2b10-4b27-be51-e29299d3ee28 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:13.636854 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-9be9e3d2-2b10-4b27-be51-e29299d3ee28 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:13.636854 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-9be9e3d2-2b10-4b27-be51-e29299d3ee28 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:13.636854 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-9be9e3d2-2b10-4b27-be51-e29299d3ee28 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:13.636854 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-9be9e3d2-2b10-4b27-be51-e29299d3ee28 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:14.078669 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-9be9e3d2-2b10-4b27-be51-e29299d3ee28 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd069b0c285c649b0967d0a0e3fdb24ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc21714f4484762aa8797d16cd3f70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:49:14.086251 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-9be9e3d2-2b10-4b27-be51-e29299d3ee28 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] 10.222.0.50 "GET /compute/v2.1/servers/419ed54a-a752-46bf-b399-b93ace51b625" status: 200 len: 1339 microversion: 2.1 time: 0.480312 Aug 10 17:49:14.086814 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 56/106] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:49:13 2022] GET /compute/v2.1/servers/419ed54a-a752-46bf-b399-b93ace51b625 => generated 1339 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:49:14.272737 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-3a95c8b6-29a1-4f7c-b8a9-e73303b601b9 tempest-FlavorMetadataValidation-313339081 tempest-FlavorMetadataValidation-313339081-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-2061015767", "id": 1282196401, "os-flavor-access:is_public": "True"}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:49:14.282764 n-d-852296-2 devstack@n-api.service[129409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:49:14.282764 n-d-852296-2 devstack@n-api.service[129409]: warnings.warn(msg) Aug 10 17:49:14.430956 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-3a95c8b6-29a1-4f7c-b8a9-e73303b601b9 tempest-FlavorMetadataValidation-313339081 tempest-FlavorMetadataValidation-313339081-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 471 microversion: 2.86 time: 1.056288 Aug 10 17:49:14.433141 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 51/107] 10.222.0.50 () {62 vars in 1188 bytes} [Wed Aug 10 17:49:13 2022] POST /compute/v2.1/flavors => generated 471 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 17:49:14.446957 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-9e47b31a-3384-4f8b-8431-509b64ab6aea tempest-FlavorMetadataValidation-313339081 tempest-FlavorMetadataValidation-313339081-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:49:14.450382 n-d-852296-2 devstack@n-api.service[129410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:49:14.450382 n-d-852296-2 devstack@n-api.service[129410]: warnings.warn(msg) Aug 10 17:49:14.624812 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-ff6cc3ad-3067-4ec0-bab8-a36848b64629 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:14.625764 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-ff6cc3ad-3067-4ec0-bab8-a36848b64629 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] [instance: 8e4a95fa-1d4a-4dca-9ba6-73a55f57d771] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:49:14.655132 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-ff6cc3ad-3067-4ec0-bab8-a36848b64629 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:14.655132 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-ff6cc3ad-3067-4ec0-bab8-a36848b64629 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:14.655132 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-ff6cc3ad-3067-4ec0-bab8-a36848b64629 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:14.655132 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-ff6cc3ad-3067-4ec0-bab8-a36848b64629 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:14.655490 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-ff6cc3ad-3067-4ec0-bab8-a36848b64629 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:14.655490 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-ff6cc3ad-3067-4ec0-bab8-a36848b64629 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:14.763836 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-ff6cc3ad-3067-4ec0-bab8-a36848b64629 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f242fdc47104b98882cb29c8ca5caae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b721d6dfb14d3d8780094fc4e72890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:49:14.776272 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-ff6cc3ad-3067-4ec0-bab8-a36848b64629 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] 10.222.0.50 "GET /compute/v2.1/servers/8e4a95fa-1d4a-4dca-9ba6-73a55f57d771" status: 200 len: 1290 microversion: 2.1 time: 0.156392 Aug 10 17:49:14.777064 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 52/108] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:49:14 2022] GET /compute/v2.1/servers/8e4a95fa-1d4a-4dca-9ba6-73a55f57d771 => generated 1290 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:49:14.923958 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-9e47b31a-3384-4f8b-8431-509b64ab6aea tempest-FlavorMetadataValidation-313339081 tempest-FlavorMetadataValidation-313339081-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors/1282196401/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.481467 Aug 10 17:49:14.926271 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 57/109] 10.222.0.50 () {62 vars in 1265 bytes} [Wed Aug 10 17:49:14 2022] POST /compute/v2.1/flavors/1282196401/os-extra_specs => generated 62 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:49:14.936504 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-5322427c-87ab-448c-be00-916634d0c550 tempest-FlavorMetadataValidation-313339081 tempest-FlavorMetadataValidation-313339081-project-admin] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:14.937438 n-d-852296-2 devstack@n-api.service[129409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:49:14.937438 n-d-852296-2 devstack@n-api.service[129409]: warnings.warn(msg) Aug 10 17:49:15.066352 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-5322427c-87ab-448c-be00-916634d0c550 tempest-FlavorMetadataValidation-313339081 tempest-FlavorMetadataValidation-313339081-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/1282196401" status: 202 len: 0 microversion: 2.86 time: 0.134225 Aug 10 17:49:15.071327 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 53/110] 10.222.0.50 () {60 vars in 1202 bytes} [Wed Aug 10 17:49:14 2022] DELETE /compute/v2.1/flavors/1282196401 => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 10 17:49:15.080018 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-711dd518-0226-4f03-b335-a7f75c858ed7 tempest-FlavorMetadataValidation-313339081 tempest-FlavorMetadataValidation-313339081-project-admin] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:15.121391 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-8b1b31ba-9e9d-49f7-9703-046aaad10c09 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:15.122054 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-8b1b31ba-9e9d-49f7-9703-046aaad10c09 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] [instance: 419ed54a-a752-46bf-b399-b93ace51b625] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:49:15.137656 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-8b1b31ba-9e9d-49f7-9703-046aaad10c09 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:15.138195 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-8b1b31ba-9e9d-49f7-9703-046aaad10c09 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:15.138629 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-8b1b31ba-9e9d-49f7-9703-046aaad10c09 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:15.139359 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-8b1b31ba-9e9d-49f7-9703-046aaad10c09 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:15.139766 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-8b1b31ba-9e9d-49f7-9703-046aaad10c09 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:15.140202 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-8b1b31ba-9e9d-49f7-9703-046aaad10c09 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:15.147456 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-711dd518-0226-4f03-b335-a7f75c858ed7 tempest-FlavorMetadataValidation-313339081 tempest-FlavorMetadataValidation-313339081-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 6680 microversion: 2.86 time: 0.071917 Aug 10 17:49:15.189708 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 58/111] 10.222.0.50 () {60 vars in 1187 bytes} [Wed Aug 10 17:49:15 2022] GET /compute/v2.1/flavors/detail => generated 6680 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:49:15.688575 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-8b1b31ba-9e9d-49f7-9703-046aaad10c09 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd069b0c285c649b0967d0a0e3fdb24ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc21714f4484762aa8797d16cd3f70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:49:15.696256 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-8b1b31ba-9e9d-49f7-9703-046aaad10c09 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] 10.222.0.50 "GET /compute/v2.1/servers/419ed54a-a752-46bf-b399-b93ace51b625" status: 200 len: 1339 microversion: 2.1 time: 0.589021 Aug 10 17:49:15.696868 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 54/112] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:49:15 2022] GET /compute/v2.1/servers/419ed54a-a752-46bf-b399-b93ace51b625 => generated 1339 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:49:15.799893 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-34197897-2c38-426e-b1d5-d4705373841d tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:15.801257 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-34197897-2c38-426e-b1d5-d4705373841d tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] [instance: 8e4a95fa-1d4a-4dca-9ba6-73a55f57d771] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:49:15.809116 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-34197897-2c38-426e-b1d5-d4705373841d tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:15.810971 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-34197897-2c38-426e-b1d5-d4705373841d tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:15.811642 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-34197897-2c38-426e-b1d5-d4705373841d tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:15.812610 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-34197897-2c38-426e-b1d5-d4705373841d tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:15.813271 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-34197897-2c38-426e-b1d5-d4705373841d tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:15.813910 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-34197897-2c38-426e-b1d5-d4705373841d tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:15.965840 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-34197897-2c38-426e-b1d5-d4705373841d tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f242fdc47104b98882cb29c8ca5caae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b721d6dfb14d3d8780094fc4e72890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:49:15.977459 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-34197897-2c38-426e-b1d5-d4705373841d tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] 10.222.0.50 "GET /compute/v2.1/servers/8e4a95fa-1d4a-4dca-9ba6-73a55f57d771" status: 200 len: 1278 microversion: 2.1 time: 0.181414 Aug 10 17:49:15.996890 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 55/113] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:49:15 2022] GET /compute/v2.1/servers/8e4a95fa-1d4a-4dca-9ba6-73a55f57d771 => generated 1278 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:49:16.721479 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-34310994-953a-4c00-b69e-198bae18c6d7 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:16.722968 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-34310994-953a-4c00-b69e-198bae18c6d7 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] [instance: 419ed54a-a752-46bf-b399-b93ace51b625] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:49:16.734570 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-34310994-953a-4c00-b69e-198bae18c6d7 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:16.739173 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-34310994-953a-4c00-b69e-198bae18c6d7 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:16.739943 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-34310994-953a-4c00-b69e-198bae18c6d7 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:16.741118 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-34310994-953a-4c00-b69e-198bae18c6d7 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:16.745670 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-34310994-953a-4c00-b69e-198bae18c6d7 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:16.746534 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-34310994-953a-4c00-b69e-198bae18c6d7 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:16.819255 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [req-6b06df38-c1d6-483e-a9e0-432a0102896a req-961bd554-190a-4d95-9d4e-772089ee457f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "419ed54a-a752-46bf-b399-b93ace51b625", "tag": "4ff3b60c-7a85-4f60-95b2-b4bb72e21d10"}]} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:49:16.842724 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-6b06df38-c1d6-483e-a9e0-432a0102896a req-961bd554-190a-4d95-9d4e-772089ee457f service nova] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:16.846642 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-6b06df38-c1d6-483e-a9e0-432a0102896a req-961bd554-190a-4d95-9d4e-772089ee457f service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:16.850802 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-6b06df38-c1d6-483e-a9e0-432a0102896a req-961bd554-190a-4d95-9d4e-772089ee457f service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:16.951457 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.compute.server_external_events [req-6b06df38-c1d6-483e-a9e0-432a0102896a req-961bd554-190a-4d95-9d4e-772089ee457f service nova] Creating event network-changed:4ff3b60c-7a85-4f60-95b2-b4bb72e21d10 for instance 419ed54a-a752-46bf-b399-b93ace51b625 on n-h2-852296-2 Aug 10 17:49:16.963978 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-6b06df38-c1d6-483e-a9e0-432a0102896a req-961bd554-190a-4d95-9d4e-772089ee457f service nova] Acquiring lock "compute-rpcapi-router" {{(pid=129410) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 10 17:49:16.963978 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-6b06df38-c1d6-483e-a9e0-432a0102896a req-961bd554-190a-4d95-9d4e-772089ee457f service nova] Acquired lock "compute-rpcapi-router" {{(pid=129410) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 10 17:49:16.963978 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-f6f14d1a-f9a3-4472-b789-fee1ad64d3f4 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:16.963978 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-f6f14d1a-f9a3-4472-b789-fee1ad64d3f4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:16.963978 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-f6f14d1a-f9a3-4472-b789-fee1ad64d3f4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:16.965065 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-f6f14d1a-f9a3-4472-b789-fee1ad64d3f4 None None] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:16.965065 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-f6f14d1a-f9a3-4472-b789-fee1ad64d3f4 None None] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:16.966797 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-f6f14d1a-f9a3-4472-b789-fee1ad64d3f4 None None] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:17.000796 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.compute.rpcapi [None req-f6f14d1a-f9a3-4472-b789-fee1ad64d3f4 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 10 17:49:17.003794 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-f6f14d1a-f9a3-4472-b789-fee1ad64d3f4 None None] Releasing lock "compute-rpcapi-router" {{(pid=129410) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 10 17:49:17.048404 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-f6f14d1a-f9a3-4472-b789-fee1ad64d3f4 None None] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.279438 Aug 10 17:49:17.049935 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 59/114] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 10 17:49:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:49:17.060435 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-58597f99-ea7f-40df-9a8a-7751079b88a0 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:17.062389 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-58597f99-ea7f-40df-9a8a-7751079b88a0 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] [instance: 8e4a95fa-1d4a-4dca-9ba6-73a55f57d771] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:49:17.083366 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-58597f99-ea7f-40df-9a8a-7751079b88a0 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:17.085679 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-58597f99-ea7f-40df-9a8a-7751079b88a0 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:17.087122 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-58597f99-ea7f-40df-9a8a-7751079b88a0 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:17.089781 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-58597f99-ea7f-40df-9a8a-7751079b88a0 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:17.090849 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-58597f99-ea7f-40df-9a8a-7751079b88a0 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:17.096009 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-58597f99-ea7f-40df-9a8a-7751079b88a0 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:17.406852 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-58597f99-ea7f-40df-9a8a-7751079b88a0 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f242fdc47104b98882cb29c8ca5caae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b721d6dfb14d3d8780094fc4e72890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:49:17.421894 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-58597f99-ea7f-40df-9a8a-7751079b88a0 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] 10.222.0.50 "GET /compute/v2.1/servers/8e4a95fa-1d4a-4dca-9ba6-73a55f57d771" status: 200 len: 1320 microversion: 2.1 time: 0.370034 Aug 10 17:49:17.442421 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 60/115] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:49:17 2022] GET /compute/v2.1/servers/8e4a95fa-1d4a-4dca-9ba6-73a55f57d771 => generated 1320 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:49:17.544286 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-34310994-953a-4c00-b69e-198bae18c6d7 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd069b0c285c649b0967d0a0e3fdb24ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc21714f4484762aa8797d16cd3f70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:49:17.554798 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-34310994-953a-4c00-b69e-198bae18c6d7 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] 10.222.0.50 "GET /compute/v2.1/servers/419ed54a-a752-46bf-b399-b93ace51b625" status: 200 len: 1339 microversion: 2.1 time: 0.838358 Aug 10 17:49:17.575109 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 56/116] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:49:16 2022] GET /compute/v2.1/servers/419ed54a-a752-46bf-b399-b93ace51b625 => generated 1339 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:49:17.637303 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-f08fe596-849e-477a-b61c-87cc1dabbf8f tempest-ServersWithSpecificFlavorTestJSON-1791066950 tempest-ServersWithSpecificFlavorTestJSON-1791066950-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1678622785", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "729594390", "adminPass": "***", "networks": [{"uuid": "dd292d07-730d-4e36-9863-80d36907e43c"}], "security_groups": [{"name": "tempest-securitygroup--9623761"}], "key_name": "tempest-keypair-1512200958", "user_data": "}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:49:18.444037 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-e9502f6a-a9ff-4a51-a82a-d2363f6a6c10 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:18.444677 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-e9502f6a-a9ff-4a51-a82a-d2363f6a6c10 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] [instance: 8e4a95fa-1d4a-4dca-9ba6-73a55f57d771] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:49:18.451970 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_cell0:SELECT=2 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:49:18.454473 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e9502f6a-a9ff-4a51-a82a-d2363f6a6c10 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:18.454961 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e9502f6a-a9ff-4a51-a82a-d2363f6a6c10 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:18.455405 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e9502f6a-a9ff-4a51-a82a-d2363f6a6c10 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:18.456103 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e9502f6a-a9ff-4a51-a82a-d2363f6a6c10 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:18.456583 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e9502f6a-a9ff-4a51-a82a-d2363f6a6c10 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:18.457002 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e9502f6a-a9ff-4a51-a82a-d2363f6a6c10 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:18.752149 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-e9502f6a-a9ff-4a51-a82a-d2363f6a6c10 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f242fdc47104b98882cb29c8ca5caae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b721d6dfb14d3d8780094fc4e72890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:49:18.763207 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-e9502f6a-a9ff-4a51-a82a-d2363f6a6c10 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] 10.222.0.50 "GET /compute/v2.1/servers/8e4a95fa-1d4a-4dca-9ba6-73a55f57d771" status: 200 len: 1320 microversion: 2.1 time: 0.322896 Aug 10 17:49:18.778040 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 57/117] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:49:18 2022] GET /compute/v2.1/servers/8e4a95fa-1d4a-4dca-9ba6-73a55f57d771 => generated 1320 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:49:18.788942 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-d4e6b332-4398-46a7-8358-91af9074078c tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:18.790052 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-d4e6b332-4398-46a7-8358-91af9074078c tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] [instance: 419ed54a-a752-46bf-b399-b93ace51b625] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:49:18.798094 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-d4e6b332-4398-46a7-8358-91af9074078c tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:18.798574 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-d4e6b332-4398-46a7-8358-91af9074078c tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:18.799162 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-d4e6b332-4398-46a7-8358-91af9074078c tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:18.800166 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-d4e6b332-4398-46a7-8358-91af9074078c tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:18.800775 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-d4e6b332-4398-46a7-8358-91af9074078c tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:18.801371 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-d4e6b332-4398-46a7-8358-91af9074078c tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:18.975148 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-d4e6b332-4398-46a7-8358-91af9074078c tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd069b0c285c649b0967d0a0e3fdb24ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc21714f4484762aa8797d16cd3f70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:49:18.987698 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-d4e6b332-4398-46a7-8358-91af9074078c tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] 10.222.0.50 "GET /compute/v2.1/servers/419ed54a-a752-46bf-b399-b93ace51b625" status: 200 len: 1339 microversion: 2.1 time: 0.208236 Aug 10 17:49:18.988328 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 58/118] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:49:18 2022] GET /compute/v2.1/servers/419ed54a-a752-46bf-b399-b93ace51b625 => generated 1339 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:49:20.168711 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-972ecf5d-9dd5-45d8-9068-fb903b3e54f9 tempest-FlavorsV255TestJSON-376416680 tempest-FlavorsV255TestJSON-376416680-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-675228439", "id": 16538706, "os-flavor-access:is_public": "True"}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:49:20.174857 n-d-852296-2 devstack@n-api.service[129409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:49:20.174857 n-d-852296-2 devstack@n-api.service[129409]: warnings.warn(msg) Aug 10 17:49:20.421184 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-972ecf5d-9dd5-45d8-9068-fb903b3e54f9 tempest-FlavorsV255TestJSON-376416680 tempest-FlavorsV255TestJSON-376416680-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 442 microversion: 2.55 time: 0.745612 Aug 10 17:49:20.430813 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 59/119] 10.222.0.50 () {62 vars in 1188 bytes} [Wed Aug 10 17:49:19 2022] POST /compute/v2.1/flavors => generated 442 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 17:49:20.437987 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-fc994974-8792-40d6-a694-35ddf89c5d55 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:20.439038 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-fc994974-8792-40d6-a694-35ddf89c5d55 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] [instance: 8e4a95fa-1d4a-4dca-9ba6-73a55f57d771] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:49:20.454257 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-fc994974-8792-40d6-a694-35ddf89c5d55 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:20.454808 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-fc994974-8792-40d6-a694-35ddf89c5d55 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:20.463795 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-fc994974-8792-40d6-a694-35ddf89c5d55 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:20.463795 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-fc994974-8792-40d6-a694-35ddf89c5d55 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:20.463795 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-fc994974-8792-40d6-a694-35ddf89c5d55 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:20.463795 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-fc994974-8792-40d6-a694-35ddf89c5d55 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:20.654352 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-fc994974-8792-40d6-a694-35ddf89c5d55 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f242fdc47104b98882cb29c8ca5caae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b721d6dfb14d3d8780094fc4e72890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:49:20.663585 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-fc994974-8792-40d6-a694-35ddf89c5d55 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] 10.222.0.50 "GET /compute/v2.1/servers/8e4a95fa-1d4a-4dca-9ba6-73a55f57d771" status: 200 len: 1320 microversion: 2.1 time: 0.231034 Aug 10 17:49:20.665179 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 60/120] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:49:20 2022] GET /compute/v2.1/servers/8e4a95fa-1d4a-4dca-9ba6-73a55f57d771 => generated 1320 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:49:20.674678 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-64e36225-2c11-46eb-8512-91d675063c77 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:20.675516 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-64e36225-2c11-46eb-8512-91d675063c77 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] [instance: 419ed54a-a752-46bf-b399-b93ace51b625] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:49:20.701384 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-64e36225-2c11-46eb-8512-91d675063c77 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:20.702066 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-64e36225-2c11-46eb-8512-91d675063c77 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:20.702647 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-64e36225-2c11-46eb-8512-91d675063c77 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:20.703520 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-64e36225-2c11-46eb-8512-91d675063c77 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:20.704119 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-64e36225-2c11-46eb-8512-91d675063c77 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:20.706186 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-64e36225-2c11-46eb-8512-91d675063c77 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:20.929855 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_cell0:SELECT=16 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:49:20.967829 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-64e36225-2c11-46eb-8512-91d675063c77 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd069b0c285c649b0967d0a0e3fdb24ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc21714f4484762aa8797d16cd3f70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:49:20.976014 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-64e36225-2c11-46eb-8512-91d675063c77 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] 10.222.0.50 "GET /compute/v2.1/servers/419ed54a-a752-46bf-b399-b93ace51b625" status: 200 len: 1339 microversion: 2.1 time: 0.304976 Aug 10 17:49:20.976623 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 61/121] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:49:20 2022] GET /compute/v2.1/servers/419ed54a-a752-46bf-b399-b93ace51b625 => generated 1339 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:49:21.055980 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_cell0:SELECT=12 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:49:21.438397 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-4144dff9-da14-4206-859f-fcf6613a4830 tempest-FlavorsV255TestJSON-501622936 tempest-FlavorsV255TestJSON-501622936-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:21.468787 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-4144dff9-da14-4206-859f-fcf6613a4830 tempest-FlavorsV255TestJSON-501622936 tempest-FlavorsV255TestJSON-501622936-project] 10.222.0.50 "GET /compute/v2.1/flavors/16538706" status: 200 len: 442 microversion: 2.55 time: 0.490597 Aug 10 17:49:21.471403 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 62/122] 10.222.0.50 () {60 vars in 1193 bytes} [Wed Aug 10 17:49:20 2022] GET /compute/v2.1/flavors/16538706 => generated 442 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 17:49:21.637413 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-42c333b8-c123-41d8-95f9-4938ae5d0337 tempest-HypervisorAdminV253TestBase-1591553679 tempest-HypervisorAdminV253TestBase-1591553679-project-admin] Calling method '.version_select at 0x7fb346ca0e50>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:21.640330 n-d-852296-2 devstack@n-api.service[129409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:49:21.640330 n-d-852296-2 devstack@n-api.service[129409]: warnings.warn(msg) Aug 10 17:49:21.647625 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-42c333b8-c123-41d8-95f9-4938ae5d0337 tempest-HypervisorAdminV253TestBase-1591553679 tempest-HypervisorAdminV253TestBase-1591553679-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),eb80cdf1-5ac7-4611-abc6-59802fe86dfd(cell1) {{(pid=129409) load_cells /opt/stack/nova/nova/compute/api.py:306}} Aug 10 17:49:21.649856 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-42c333b8-c123-41d8-95f9-4938ae5d0337 tempest-HypervisorAdminV253TestBase-1591553679 tempest-HypervisorAdminV253TestBase-1591553679-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:21.654753 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-42c333b8-c123-41d8-95f9-4938ae5d0337 tempest-HypervisorAdminV253TestBase-1591553679 tempest-HypervisorAdminV253TestBase-1591553679-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:21.655486 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-42c333b8-c123-41d8-95f9-4938ae5d0337 tempest-HypervisorAdminV253TestBase-1591553679 tempest-HypervisorAdminV253TestBase-1591553679-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:21.686063 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-42c333b8-c123-41d8-95f9-4938ae5d0337 tempest-HypervisorAdminV253TestBase-1591553679 tempest-HypervisorAdminV253TestBase-1591553679-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:21.686063 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-42c333b8-c123-41d8-95f9-4938ae5d0337 tempest-HypervisorAdminV253TestBase-1591553679 tempest-HypervisorAdminV253TestBase-1591553679-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:21.686063 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-42c333b8-c123-41d8-95f9-4938ae5d0337 tempest-HypervisorAdminV253TestBase-1591553679 tempest-HypervisorAdminV253TestBase-1591553679-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:21.741998 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-42c333b8-c123-41d8-95f9-4938ae5d0337 tempest-HypervisorAdminV253TestBase-1591553679 tempest-HypervisorAdminV253TestBase-1591553679-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:21.746048 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-42c333b8-c123-41d8-95f9-4938ae5d0337 tempest-HypervisorAdminV253TestBase-1591553679 tempest-HypervisorAdminV253TestBase-1591553679-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:21.746741 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-42c333b8-c123-41d8-95f9-4938ae5d0337 tempest-HypervisorAdminV253TestBase-1591553679 tempest-HypervisorAdminV253TestBase-1591553679-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:21.760196 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-42c333b8-c123-41d8-95f9-4938ae5d0337 tempest-HypervisorAdminV253TestBase-1591553679 tempest-HypervisorAdminV253TestBase-1591553679-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:21.761505 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-42c333b8-c123-41d8-95f9-4938ae5d0337 tempest-HypervisorAdminV253TestBase-1591553679 tempest-HypervisorAdminV253TestBase-1591553679-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:21.762369 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-42c333b8-c123-41d8-95f9-4938ae5d0337 tempest-HypervisorAdminV253TestBase-1591553679 tempest-HypervisorAdminV253TestBase-1591553679-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:21.803411 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-42c333b8-c123-41d8-95f9-4938ae5d0337 tempest-HypervisorAdminV253TestBase-1591553679 tempest-HypervisorAdminV253TestBase-1591553679-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:21.812060 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-42c333b8-c123-41d8-95f9-4938ae5d0337 tempest-HypervisorAdminV253TestBase-1591553679 tempest-HypervisorAdminV253TestBase-1591553679-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:21.812060 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-42c333b8-c123-41d8-95f9-4938ae5d0337 tempest-HypervisorAdminV253TestBase-1591553679 tempest-HypervisorAdminV253TestBase-1591553679-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:21.820095 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-42c333b8-c123-41d8-95f9-4938ae5d0337 tempest-HypervisorAdminV253TestBase-1591553679 tempest-HypervisorAdminV253TestBase-1591553679-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1757 microversion: 2.53 time: 0.346958 Aug 10 17:49:21.840598 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 63/123] 10.222.0.50 () {60 vars in 1243 bytes} [Wed Aug 10 17:49:21 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1757 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:49:21.847918 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-89d5d3a1-27f7-4134-9583-66d4e46623b0 tempest-FlavorsV255TestJSON-376416680 tempest-FlavorsV255TestJSON-376416680-project-admin] Action: 'update', calling method: , body: {"flavor": {"description": "new"}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:49:21.859517 n-d-852296-2 devstack@n-api.service[129409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:49:21.859517 n-d-852296-2 devstack@n-api.service[129409]: warnings.warn(msg) Aug 10 17:49:21.991898 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-89d5d3a1-27f7-4134-9583-66d4e46623b0 tempest-FlavorsV255TestJSON-376416680 tempest-FlavorsV255TestJSON-376416680-project-admin] 10.222.0.50 "PUT /compute/v2.1/flavors/16538706" status: 200 len: 443 microversion: 2.55 time: 0.149690 Aug 10 17:49:21.993371 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 64/124] 10.222.0.50 () {62 vars in 1213 bytes} [Wed Aug 10 17:49:21 2022] PUT /compute/v2.1/flavors/16538706 => generated 443 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 17:49:22.001623 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-b2cbe5c8-af26-4251-8366-be2e39b468b8 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:22.003139 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-b2cbe5c8-af26-4251-8366-be2e39b468b8 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] [instance: 8e4a95fa-1d4a-4dca-9ba6-73a55f57d771] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:49:22.013101 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-b2cbe5c8-af26-4251-8366-be2e39b468b8 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:22.014381 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-b2cbe5c8-af26-4251-8366-be2e39b468b8 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:22.015147 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-b2cbe5c8-af26-4251-8366-be2e39b468b8 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:22.016959 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-b2cbe5c8-af26-4251-8366-be2e39b468b8 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:22.018059 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-b2cbe5c8-af26-4251-8366-be2e39b468b8 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:22.018987 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-b2cbe5c8-af26-4251-8366-be2e39b468b8 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:22.328990 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-b2cbe5c8-af26-4251-8366-be2e39b468b8 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f242fdc47104b98882cb29c8ca5caae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b721d6dfb14d3d8780094fc4e72890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:49:22.341030 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-b2cbe5c8-af26-4251-8366-be2e39b468b8 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] 10.222.0.50 "GET /compute/v2.1/servers/8e4a95fa-1d4a-4dca-9ba6-73a55f57d771" status: 200 len: 1320 microversion: 2.1 time: 0.345751 Aug 10 17:49:22.341927 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 65/125] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:49:21 2022] GET /compute/v2.1/servers/8e4a95fa-1d4a-4dca-9ba6-73a55f57d771 => generated 1320 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:49:22.346350 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-7c5f4a19-fb76-45f7-b429-d857d8bb4acb tempest-HypervisorAdminV253TestBase-1591553679 tempest-HypervisorAdminV253TestBase-1591553679-project-admin] Calling method '.version_select at 0x7fb346d3c430>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:22.348924 n-d-852296-2 devstack@n-api.service[129409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:49:22.348924 n-d-852296-2 devstack@n-api.service[129409]: warnings.warn(msg) Aug 10 17:49:22.350033 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7c5f4a19-fb76-45f7-b429-d857d8bb4acb tempest-HypervisorAdminV253TestBase-1591553679 tempest-HypervisorAdminV253TestBase-1591553679-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:22.350511 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7c5f4a19-fb76-45f7-b429-d857d8bb4acb tempest-HypervisorAdminV253TestBase-1591553679 tempest-HypervisorAdminV253TestBase-1591553679-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:22.350948 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7c5f4a19-fb76-45f7-b429-d857d8bb4acb tempest-HypervisorAdminV253TestBase-1591553679 tempest-HypervisorAdminV253TestBase-1591553679-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:22.379443 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7c5f4a19-fb76-45f7-b429-d857d8bb4acb tempest-HypervisorAdminV253TestBase-1591553679 tempest-HypervisorAdminV253TestBase-1591553679-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:22.380028 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7c5f4a19-fb76-45f7-b429-d857d8bb4acb tempest-HypervisorAdminV253TestBase-1591553679 tempest-HypervisorAdminV253TestBase-1591553679-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:22.380488 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7c5f4a19-fb76-45f7-b429-d857d8bb4acb tempest-HypervisorAdminV253TestBase-1591553679 tempest-HypervisorAdminV253TestBase-1591553679-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:22.423321 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7c5f4a19-fb76-45f7-b429-d857d8bb4acb tempest-HypervisorAdminV253TestBase-1591553679 tempest-HypervisorAdminV253TestBase-1591553679-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:22.424557 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7c5f4a19-fb76-45f7-b429-d857d8bb4acb tempest-HypervisorAdminV253TestBase-1591553679 tempest-HypervisorAdminV253TestBase-1591553679-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:22.425326 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7c5f4a19-fb76-45f7-b429-d857d8bb4acb tempest-HypervisorAdminV253TestBase-1591553679 tempest-HypervisorAdminV253TestBase-1591553679-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:22.469474 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7c5f4a19-fb76-45f7-b429-d857d8bb4acb tempest-HypervisorAdminV253TestBase-1591553679 tempest-HypervisorAdminV253TestBase-1591553679-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:22.471123 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7c5f4a19-fb76-45f7-b429-d857d8bb4acb tempest-HypervisorAdminV253TestBase-1591553679 tempest-HypervisorAdminV253TestBase-1591553679-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:22.473149 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7c5f4a19-fb76-45f7-b429-d857d8bb4acb tempest-HypervisorAdminV253TestBase-1591553679 tempest-HypervisorAdminV253TestBase-1591553679-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:22.542365 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7c5f4a19-fb76-45f7-b429-d857d8bb4acb tempest-HypervisorAdminV253TestBase-1591553679 tempest-HypervisorAdminV253TestBase-1591553679-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:22.545317 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7c5f4a19-fb76-45f7-b429-d857d8bb4acb tempest-HypervisorAdminV253TestBase-1591553679 tempest-HypervisorAdminV253TestBase-1591553679-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:22.548541 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7c5f4a19-fb76-45f7-b429-d857d8bb4acb tempest-HypervisorAdminV253TestBase-1591553679 tempest-HypervisorAdminV253TestBase-1591553679-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:22.566558 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-7c5f4a19-fb76-45f7-b429-d857d8bb4acb tempest-HypervisorAdminV253TestBase-1591553679 tempest-HypervisorAdminV253TestBase-1591553679-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 449 microversion: 2.53 time: 0.223332 Aug 10 17:49:22.567758 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 66/126] 10.222.0.50 () {60 vars in 1222 bytes} [Wed Aug 10 17:49:22 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 449 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 17:49:22.581358 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-6c1c69e1-63b7-4118-94c8-6c7653ec9805 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:22.582191 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-6c1c69e1-63b7-4118-94c8-6c7653ec9805 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] [instance: 419ed54a-a752-46bf-b399-b93ace51b625] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:49:22.589604 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-6c1c69e1-63b7-4118-94c8-6c7653ec9805 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:22.590664 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-6c1c69e1-63b7-4118-94c8-6c7653ec9805 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:22.591371 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-6c1c69e1-63b7-4118-94c8-6c7653ec9805 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:22.592691 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-6c1c69e1-63b7-4118-94c8-6c7653ec9805 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:22.594074 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-6c1c69e1-63b7-4118-94c8-6c7653ec9805 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:22.594897 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-6c1c69e1-63b7-4118-94c8-6c7653ec9805 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:22.622013 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_cell1:SELECT=100 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:49:22.993810 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-6c1c69e1-63b7-4118-94c8-6c7653ec9805 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd069b0c285c649b0967d0a0e3fdb24ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc21714f4484762aa8797d16cd3f70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:49:23.012040 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-6c1c69e1-63b7-4118-94c8-6c7653ec9805 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] 10.222.0.50 "GET /compute/v2.1/servers/419ed54a-a752-46bf-b399-b93ace51b625" status: 200 len: 1339 microversion: 2.1 time: 0.437077 Aug 10 17:49:23.012040 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 67/127] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:49:22 2022] GET /compute/v2.1/servers/419ed54a-a752-46bf-b399-b93ace51b625 => generated 1339 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:49:23.019141 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-c8da1bc7-a09e-4f1b-b9bc-ddc6cbab27d4 tempest-FlavorsV255TestJSON-501622936 tempest-FlavorsV255TestJSON-501622936-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:23.079954 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-c8da1bc7-a09e-4f1b-b9bc-ddc6cbab27d4 tempest-FlavorsV255TestJSON-501622936 tempest-FlavorsV255TestJSON-501622936-project] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 6585 microversion: 2.55 time: 0.068788 Aug 10 17:49:23.081621 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 68/128] 10.222.0.50 () {60 vars in 1187 bytes} [Wed Aug 10 17:49:23 2022] GET /compute/v2.1/flavors/detail => generated 6585 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:49:23.096309 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-d6a179d3-a629-4819-a1d7-b1e86b92baf2 tempest-HypervisorAdminV253TestBase-1591553679 tempest-HypervisorAdminV253TestBase-1591553679-project-admin] Calling method '.version_select at 0x7fb346dd6ca0>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:23.103292 n-d-852296-2 devstack@n-api.service[129409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:49:23.103292 n-d-852296-2 devstack@n-api.service[129409]: warnings.warn(msg) Aug 10 17:49:23.106889 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-d6a179d3-a629-4819-a1d7-b1e86b92baf2 tempest-HypervisorAdminV253TestBase-1591553679 tempest-HypervisorAdminV253TestBase-1591553679-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:23.108376 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-d6a179d3-a629-4819-a1d7-b1e86b92baf2 tempest-HypervisorAdminV253TestBase-1591553679 tempest-HypervisorAdminV253TestBase-1591553679-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:23.109941 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-d6a179d3-a629-4819-a1d7-b1e86b92baf2 tempest-HypervisorAdminV253TestBase-1591553679 tempest-HypervisorAdminV253TestBase-1591553679-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:23.153539 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-d6a179d3-a629-4819-a1d7-b1e86b92baf2 tempest-HypervisorAdminV253TestBase-1591553679 tempest-HypervisorAdminV253TestBase-1591553679-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:23.156849 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-d6a179d3-a629-4819-a1d7-b1e86b92baf2 tempest-HypervisorAdminV253TestBase-1591553679 tempest-HypervisorAdminV253TestBase-1591553679-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:23.178413 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-d6a179d3-a629-4819-a1d7-b1e86b92baf2 tempest-HypervisorAdminV253TestBase-1591553679 tempest-HypervisorAdminV253TestBase-1591553679-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:23.178413 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-d6a179d3-a629-4819-a1d7-b1e86b92baf2 tempest-HypervisorAdminV253TestBase-1591553679 tempest-HypervisorAdminV253TestBase-1591553679-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/2344e76d-8e08-442d-b865-557105885f6f" status: 200 len: 792 microversion: 2.53 time: 0.090046 Aug 10 17:49:23.180869 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 69/129] 10.222.0.50 () {60 vars in 1298 bytes} [Wed Aug 10 17:49:23 2022] GET /compute/v2.1/os-hypervisors/2344e76d-8e08-442d-b865-557105885f6f => generated 792 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 17:49:23.192037 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-b879e120-0227-495f-8a6b-a074a78c86ff tempest-FlavorsV255TestJSON-501622936 tempest-FlavorsV255TestJSON-501622936-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:23.226192 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-b879e120-0227-495f-8a6b-a074a78c86ff tempest-FlavorsV255TestJSON-501622936 tempest-FlavorsV255TestJSON-501622936-project] 10.222.0.50 "GET /compute/v2.1/flavors" status: 200 len: 3675 microversion: 2.55 time: 0.042758 Aug 10 17:49:23.235191 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 70/130] 10.222.0.50 () {60 vars in 1166 bytes} [Wed Aug 10 17:49:23 2022] GET /compute/v2.1/flavors => generated 3675 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:49:23.259498 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-fea75d7e-7092-47e3-8534-716f658a6979 tempest-FlavorsV255TestJSON-376416680 tempest-FlavorsV255TestJSON-376416680-project-admin] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:23.261774 n-d-852296-2 devstack@n-api.service[129409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:49:23.261774 n-d-852296-2 devstack@n-api.service[129409]: warnings.warn(msg) Aug 10 17:49:23.502709 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-fea75d7e-7092-47e3-8534-716f658a6979 tempest-FlavorsV255TestJSON-376416680 tempest-FlavorsV255TestJSON-376416680-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/16538706" status: 202 len: 0 microversion: 2.55 time: 0.249482 Aug 10 17:49:23.503470 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 71/131] 10.222.0.50 () {60 vars in 1196 bytes} [Wed Aug 10 17:49:23 2022] DELETE /compute/v2.1/flavors/16538706 => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 10 17:49:23.513748 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-a6b51a7e-4641-4b6c-82c1-e2e1145ba407 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:23.514364 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-a6b51a7e-4641-4b6c-82c1-e2e1145ba407 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] [instance: 8e4a95fa-1d4a-4dca-9ba6-73a55f57d771] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:49:23.528566 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a6b51a7e-4641-4b6c-82c1-e2e1145ba407 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:23.529324 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a6b51a7e-4641-4b6c-82c1-e2e1145ba407 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:23.529506 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a6b51a7e-4641-4b6c-82c1-e2e1145ba407 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:23.530174 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a6b51a7e-4641-4b6c-82c1-e2e1145ba407 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:23.530619 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a6b51a7e-4641-4b6c-82c1-e2e1145ba407 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:23.531356 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a6b51a7e-4641-4b6c-82c1-e2e1145ba407 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:23.735275 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-a6b51a7e-4641-4b6c-82c1-e2e1145ba407 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f242fdc47104b98882cb29c8ca5caae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b721d6dfb14d3d8780094fc4e72890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:49:23.745238 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-a6b51a7e-4641-4b6c-82c1-e2e1145ba407 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] 10.222.0.50 "GET /compute/v2.1/servers/8e4a95fa-1d4a-4dca-9ba6-73a55f57d771" status: 200 len: 1320 microversion: 2.1 time: 0.237102 Aug 10 17:49:23.756810 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 72/132] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:49:23 2022] GET /compute/v2.1/servers/8e4a95fa-1d4a-4dca-9ba6-73a55f57d771 => generated 1320 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:49:23.756810 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [req-db5cafca-cc58-4da9-9cb3-5b4c920bb6bb req-3df25fcd-200d-4b5e-86d1-68d5a2b22f05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e4a95fa-1d4a-4dca-9ba6-73a55f57d771", "tag": "18e16820-18a5-43c6-bacc-f7df72695ae4"}]} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:49:23.764300 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-db5cafca-cc58-4da9-9cb3-5b4c920bb6bb req-3df25fcd-200d-4b5e-86d1-68d5a2b22f05 service nova] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:23.769014 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-db5cafca-cc58-4da9-9cb3-5b4c920bb6bb req-3df25fcd-200d-4b5e-86d1-68d5a2b22f05 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:23.769014 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-db5cafca-cc58-4da9-9cb3-5b4c920bb6bb req-3df25fcd-200d-4b5e-86d1-68d5a2b22f05 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:23.799404 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.compute.server_external_events [req-db5cafca-cc58-4da9-9cb3-5b4c920bb6bb req-3df25fcd-200d-4b5e-86d1-68d5a2b22f05 service nova] Creating event network-changed:18e16820-18a5-43c6-bacc-f7df72695ae4 for instance 8e4a95fa-1d4a-4dca-9ba6-73a55f57d771 on n-h1-852296-2 Aug 10 17:49:23.799989 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-db5cafca-cc58-4da9-9cb3-5b4c920bb6bb req-3df25fcd-200d-4b5e-86d1-68d5a2b22f05 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=129409) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 10 17:49:23.800410 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-db5cafca-cc58-4da9-9cb3-5b4c920bb6bb req-3df25fcd-200d-4b5e-86d1-68d5a2b22f05 service nova] Acquired lock "compute-rpcapi-router" {{(pid=129409) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 10 17:49:23.801586 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-b037c38c-6b32-4034-b42f-e217551201ee None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:23.802044 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-b037c38c-6b32-4034-b42f-e217551201ee None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:23.802463 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-b037c38c-6b32-4034-b42f-e217551201ee None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:23.803322 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-b037c38c-6b32-4034-b42f-e217551201ee None None] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:23.803774 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-b037c38c-6b32-4034-b42f-e217551201ee None None] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:23.804191 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-b037c38c-6b32-4034-b42f-e217551201ee None None] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:23.813529 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.compute.rpcapi [None req-b037c38c-6b32-4034-b42f-e217551201ee None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 10 17:49:23.816654 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-b037c38c-6b32-4034-b42f-e217551201ee None None] Releasing lock "compute-rpcapi-router" {{(pid=129409) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 10 17:49:23.850120 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-b037c38c-6b32-4034-b42f-e217551201ee None None] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099430 Aug 10 17:49:23.850803 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 73/133] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 10 17:49:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:49:23.858105 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-18736e52-92c7-4a60-a2ca-7a9df557ddc8 tempest-FlavorsV255TestJSON-376416680 tempest-FlavorsV255TestJSON-376416680-project-admin] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:23.937937 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-18736e52-92c7-4a60-a2ca-7a9df557ddc8 tempest-FlavorsV255TestJSON-376416680 tempest-FlavorsV255TestJSON-376416680-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 6152 microversion: 2.55 time: 0.085816 Aug 10 17:49:23.940949 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 74/134] 10.222.0.50 () {60 vars in 1187 bytes} [Wed Aug 10 17:49:23 2022] GET /compute/v2.1/flavors/detail => generated 6152 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:49:24.032871 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-c9d5d175-1fb0-42e1-8b77-c93553bf99aa tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:24.033662 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-c9d5d175-1fb0-42e1-8b77-c93553bf99aa tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] [instance: 419ed54a-a752-46bf-b399-b93ace51b625] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:49:24.052274 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c9d5d175-1fb0-42e1-8b77-c93553bf99aa tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:24.052894 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c9d5d175-1fb0-42e1-8b77-c93553bf99aa tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:24.053345 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c9d5d175-1fb0-42e1-8b77-c93553bf99aa tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:24.054090 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c9d5d175-1fb0-42e1-8b77-c93553bf99aa tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:24.054542 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c9d5d175-1fb0-42e1-8b77-c93553bf99aa tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:24.054965 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c9d5d175-1fb0-42e1-8b77-c93553bf99aa tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:24.494759 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-c9d5d175-1fb0-42e1-8b77-c93553bf99aa tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd069b0c285c649b0967d0a0e3fdb24ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc21714f4484762aa8797d16cd3f70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:49:24.514600 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-c9d5d175-1fb0-42e1-8b77-c93553bf99aa tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] 10.222.0.50 "GET /compute/v2.1/servers/419ed54a-a752-46bf-b399-b93ace51b625" status: 200 len: 1339 microversion: 2.1 time: 0.486366 Aug 10 17:49:24.521270 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 75/135] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:49:24 2022] GET /compute/v2.1/servers/419ed54a-a752-46bf-b399-b93ace51b625 => generated 1339 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:49:24.771656 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-08dce052-7818-4b8a-aabe-ba0019a160a1 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:24.772288 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-08dce052-7818-4b8a-aabe-ba0019a160a1 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] [instance: 8e4a95fa-1d4a-4dca-9ba6-73a55f57d771] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:49:24.787666 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-08dce052-7818-4b8a-aabe-ba0019a160a1 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:24.788678 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-08dce052-7818-4b8a-aabe-ba0019a160a1 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:24.789305 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-08dce052-7818-4b8a-aabe-ba0019a160a1 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:24.790250 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-08dce052-7818-4b8a-aabe-ba0019a160a1 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:24.793446 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-08dce052-7818-4b8a-aabe-ba0019a160a1 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:24.794285 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-08dce052-7818-4b8a-aabe-ba0019a160a1 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:25.792988 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-08dce052-7818-4b8a-aabe-ba0019a160a1 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f242fdc47104b98882cb29c8ca5caae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b721d6dfb14d3d8780094fc4e72890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:49:25.808950 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-08dce052-7818-4b8a-aabe-ba0019a160a1 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] 10.222.0.50 "GET /compute/v2.1/servers/8e4a95fa-1d4a-4dca-9ba6-73a55f57d771" status: 200 len: 1320 microversion: 2.1 time: 1.041562 Aug 10 17:49:25.810309 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 76/136] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:49:24 2022] GET /compute/v2.1/servers/8e4a95fa-1d4a-4dca-9ba6-73a55f57d771 => generated 1320 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:49:25.899663 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.network.neutron [None req-f08fe596-849e-477a-b61c-87cc1dabbf8f tempest-ServersWithSpecificFlavorTestJSON-1791066950 tempest-ServersWithSpecificFlavorTestJSON-1791066950-project] validate_networks() for [('dd292d07-730d-4e36-9863-80d36907e43c', None, None, None, None, None)] {{(pid=129410) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 17:49:26.053153 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-b1a339b6-a1f5-4c83-9d89-b8e528e3e6c4 tempest-InstanceUsageAuditLogTestJSON-1281785234 tempest-InstanceUsageAuditLogTestJSON-1281785234-project-admin] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:26.054592 n-d-852296-2 devstack@n-api.service[129409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:49:26.054592 n-d-852296-2 devstack@n-api.service[129409]: warnings.warn(msg) Aug 10 17:49:26.085286 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-b1a339b6-a1f5-4c83-9d89-b8e528e3e6c4 tempest-InstanceUsageAuditLogTestJSON-1281785234 tempest-InstanceUsageAuditLogTestJSON-1281785234-project-admin] 10.222.0.50 "GET /compute/v2.1/os-instance_usage_audit_log/2022-08-10 17:49:25" status: 200 len: 318 microversion: 2.1 time: 0.273735 Aug 10 17:49:26.094584 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 77/137] 10.222.0.50 () {58 vars in 1251 bytes} [Wed Aug 10 17:49:25 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-08-10%2017%3A49%3A25 => generated 318 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:49:26.116429 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-ecdba929-e8cd-4778-a6ae-adaa5693e4f6 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:26.116969 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-ecdba929-e8cd-4778-a6ae-adaa5693e4f6 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] [instance: 419ed54a-a752-46bf-b399-b93ace51b625] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:49:26.169805 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-ecdba929-e8cd-4778-a6ae-adaa5693e4f6 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:26.169805 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-ecdba929-e8cd-4778-a6ae-adaa5693e4f6 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:26.169805 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-ecdba929-e8cd-4778-a6ae-adaa5693e4f6 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:26.169805 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-ecdba929-e8cd-4778-a6ae-adaa5693e4f6 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:26.170064 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-ecdba929-e8cd-4778-a6ae-adaa5693e4f6 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:26.170064 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-ecdba929-e8cd-4778-a6ae-adaa5693e4f6 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:26.518689 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-ecdba929-e8cd-4778-a6ae-adaa5693e4f6 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd069b0c285c649b0967d0a0e3fdb24ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc21714f4484762aa8797d16cd3f70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:49:26.518689 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-ecdba929-e8cd-4778-a6ae-adaa5693e4f6 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] 10.222.0.50 "GET /compute/v2.1/servers/419ed54a-a752-46bf-b399-b93ace51b625" status: 200 len: 1339 microversion: 2.1 time: 0.405333 Aug 10 17:49:26.518689 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 78/138] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:49:26 2022] GET /compute/v2.1/servers/419ed54a-a752-46bf-b399-b93ace51b625 => generated 1339 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:49:26.518689 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-f1102f57-3d9b-4863-83d2-c04e68a9133d tempest-InstanceUsageAuditLogTestJSON-1281785234 tempest-InstanceUsageAuditLogTestJSON-1281785234-project-admin] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:26.520177 n-d-852296-2 devstack@n-api.service[129409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:49:26.520177 n-d-852296-2 devstack@n-api.service[129409]: warnings.warn(msg) Aug 10 17:49:26.560912 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-f1102f57-3d9b-4863-83d2-c04e68a9133d tempest-InstanceUsageAuditLogTestJSON-1281785234 tempest-InstanceUsageAuditLogTestJSON-1281785234-project-admin] 10.222.0.50 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.056446 Aug 10 17:49:26.562090 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 79/139] 10.222.0.50 () {58 vars in 1185 bytes} [Wed Aug 10 17:49:26 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:49:26.877210 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-6f018465-c631-4321-9692-eeab37a7cacc tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:26.877210 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-6f018465-c631-4321-9692-eeab37a7cacc tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] [instance: 8e4a95fa-1d4a-4dca-9ba6-73a55f57d771] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:49:26.877210 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=3,nova_api:DELETE=6,nova_api:UPDATE=1 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:49:26.877210 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-6f018465-c631-4321-9692-eeab37a7cacc tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:26.879106 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-6f018465-c631-4321-9692-eeab37a7cacc tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:26.879106 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-6f018465-c631-4321-9692-eeab37a7cacc tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:26.879106 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-6f018465-c631-4321-9692-eeab37a7cacc tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:26.879106 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-6f018465-c631-4321-9692-eeab37a7cacc tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:26.880193 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-6f018465-c631-4321-9692-eeab37a7cacc tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:26.992862 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-6f018465-c631-4321-9692-eeab37a7cacc tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f242fdc47104b98882cb29c8ca5caae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b721d6dfb14d3d8780094fc4e72890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:49:27.000485 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-6f018465-c631-4321-9692-eeab37a7cacc tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] 10.222.0.50 "GET /compute/v2.1/servers/8e4a95fa-1d4a-4dca-9ba6-73a55f57d771" status: 200 len: 1320 microversion: 2.1 time: 0.173351 Aug 10 17:49:27.001147 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 80/140] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:49:26 2022] GET /compute/v2.1/servers/8e4a95fa-1d4a-4dca-9ba6-73a55f57d771 => generated 1320 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:49:27.065503 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [None req-f08fe596-849e-477a-b61c-87cc1dabbf8f tempest-ServersWithSpecificFlavorTestJSON-1791066950 tempest-ServersWithSpecificFlavorTestJSON-1791066950-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-91615598-0fe4-45b3-96ca-b500adecddc8) Aug 10 17:49:27.065503 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:49:27.065503 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:49:27.065503 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:49:27.065503 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:49:27.065503 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:49:27.065503 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:49:27.065503 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:49:27.065503 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:49:27.065503 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:49:27.065503 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 17:49:27.065503 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 17:49:27.065503 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 17:49:27.065503 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 17:49:27.065503 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 17:49:27.065503 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 17:49:27.067095 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 17:49:27.067095 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 17:49:27.067095 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 17:49:27.067095 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 17:49:27.067095 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 17:49:27.067095 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 17:49:27.067095 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 17:49:27.067095 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 17:49:27.067095 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 17:49:27.067095 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 17:49:27.067095 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 17:49:27.067095 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:49:27.067095 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:49:27.067095 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 17:49:27.067095 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 17:49:27.067095 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:49:27.067095 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:49:27.067095 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:49:27.068610 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:49:27.068610 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:49:27.068610 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:49:27.068610 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:49:27.068610 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:49:27.068610 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:49:27.068610 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:49:27.068610 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 17:49:27.068610 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 17:49:27.068610 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 17:49:27.068610 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 17:49:27.068610 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 17:49:27.068610 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 17:49:27.068610 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 17:49:27.068610 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 17:49:27.068610 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 17:49:27.068610 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 17:49:27.068610 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 17:49:27.069868 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 17:49:27.069868 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 17:49:27.069868 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 17:49:27.069868 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 17:49:27.069868 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 17:49:27.069868 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 17:49:27.069868 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 17:49:27.069868 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 17:49:27.069868 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 17:49:27.069868 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 17:49:27.069868 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 17:49:27.069868 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 17:49:27.069868 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 17:49:27.069868 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 17:49:27.069868 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 17:49:27.071012 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-91615598-0fe4-45b3-96ca-b500adecddc8) Aug 10 17:49:27.071012 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:49:27.071012 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-f08fe596-849e-477a-b61c-87cc1dabbf8f tempest-ServersWithSpecificFlavorTestJSON-1791066950 tempest-ServersWithSpecificFlavorTestJSON-1791066950-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:49:27.071012 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 17:49:27.071012 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-f08fe596-849e-477a-b61c-87cc1dabbf8f tempest-ServersWithSpecificFlavorTestJSON-1791066950 tempest-ServersWithSpecificFlavorTestJSON-1791066950-project] Request method failure captured: Aug 10 17:49:27.071012 n-d-852296-2 devstack@n-api.service[129410]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 17:49:27.071012 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 17:49:27.071012 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 17:49:27.071012 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 17:49:27.071012 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 502 Aug 10 17:49:27.071012 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 17:49:27.071012 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 17:49:27.071012 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 17:49:27.071012 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 17:49:27.071012 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8--JJMgNVUEPy_cRzeueHkSBQIIyUzZwPVTkpZLoHioBi4Dt7AJ9amFS2Hipg0-H_tx99lSFSypxdeV_LhZ6Tv5bQ12vcTa3WkhtsJlREj9GWdwHr1lCm8rZGd1KpbzKFbv2uoFvSy2vmdv9L-0jB3Jk8AQkD26vVnnkWRe9SxZQb-g Aug 10 17:49:27.071012 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 17:49:27.071012 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 17:49:27.071012 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 17:49:27.071012 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 17:49:27.071012 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 17:49:27.071012 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 17:49:27.071012 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: 825ec49be4754fabada85a4eea4ef713 Aug 10 17:49:27.071012 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1791066950 Aug 10 17:49:27.071012 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 17:49:27.071012 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 17:49:27.073432 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/825ec49be4754fabada85a4eea4ef713"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/825ec49be4754fabada85a4eea4ef713"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/825ec49be4754fabada85a4eea4ef713"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_825ec49be4754fabada85a4eea4ef713", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:49:27.073432 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1791066950 Aug 10 17:49:27.073432 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: 825ec49be4754fabada85a4eea4ef713 Aug 10 17:49:27.073432 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1791066950 Aug 10 17:49:27.073432 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1791066950-project Aug 10 17:49:27.073432 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 17:49:27.073432 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 17:49:27.073432 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: 8a79fadc55914179bfc3c4ebbbe0235f Aug 10 17:49:27.073432 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1791066950-project Aug 10 17:49:27.073432 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 17:49:27.074362 n-d-852296-2 devstack@n-api.service[129410]: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1678622785", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "729594390", "adminPass": "password", "networks": [{"uuid": "dd292d07-730d-4e36-9863-80d36907e43c"}], "security_groups": [{"name": "tempest-securitygroup--9623761"}], "key_name": "tempest-keypair-1512200958", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} Aug 10 17:49:27.074362 n-d-852296-2 devstack@n-api.service[129410]: method: > Aug 10 17:49:27.074362 n-d-852296-2 devstack@n-api.service[129410]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:49:27.074362 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 17:49:27.074362 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'body': {'server': {'name': 'tempest-ServersWithSpecificFlavorTestJSON-server-1678622785', 'imageRef': 'a735ff26-463a-4ffe-a981-ab9d9baa494f', 'flavorRef': '729594390', 'adminPass': 'password', 'networks': [{'uuid': 'dd292d07-730d-4e36-9863-80d36907e43c'}], 'security_groups': [{'name': 'tempest-securitygroup--9623761'}], 'key_name': 'tempest-keypair-1512200958', 'user_data': 'IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo='}}} Aug 10 17:49:27.074362 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:49:27.074362 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:49:27.074362 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:49:27.074362 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:49:27.074362 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:49:27.074362 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:49:27.074362 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:49:27.075177 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:49:27.075177 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:49:27.075177 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:49:27.075177 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 17:49:27.075177 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 17:49:27.075177 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 17:49:27.075177 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 17:49:27.075177 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 17:49:27.075177 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 17:49:27.075177 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 17:49:27.075177 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 17:49:27.075177 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 17:49:27.075177 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 17:49:27.075177 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 17:49:27.075177 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 17:49:27.075177 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 17:49:27.075177 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 17:49:27.075177 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 17:49:27.075177 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 17:49:27.078731 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 17:49:27.078731 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:49:27.078731 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:49:27.078731 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 17:49:27.078731 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 17:49:27.078731 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:49:27.078731 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:49:27.078731 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:49:27.078731 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:49:27.078731 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:49:27.078731 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:49:27.078731 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:49:27.078731 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:49:27.078731 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:49:27.078731 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:49:27.078731 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 17:49:27.078731 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 17:49:27.078731 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 17:49:27.079898 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 17:49:27.079898 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 17:49:27.079898 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 17:49:27.079898 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 17:49:27.079898 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 17:49:27.079898 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 17:49:27.079898 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 17:49:27.079898 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 17:49:27.079898 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 17:49:27.079898 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 17:49:27.079898 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 17:49:27.079898 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 17:49:27.079898 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 17:49:27.079898 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 17:49:27.079898 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 17:49:27.079898 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 17:49:27.079898 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 17:49:27.080878 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 17:49:27.080878 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 17:49:27.080878 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 17:49:27.080878 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 17:49:27.080878 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 17:49:27.080878 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 17:49:27.080878 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-91615598-0fe4-45b3-96ca-b500adecddc8) Aug 10 17:49:27.080878 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:49:27.080878 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:49:27.080878 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:49:27.080878 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:49:27.080878 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:49:27.080878 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:49:27.080878 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:49:27.080878 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:49:27.080878 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 10 17:49:27.080878 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 10 17:49:27.081959 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:49:27.081959 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:49:27.081959 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:49:27.081959 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:49:27.081959 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:49:27.081959 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:49:27.081959 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:49:27.081959 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:49:27.081959 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:49:27.081959 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:49:27.081959 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:49:27.081959 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:49:27.081959 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:49:27.081959 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-f08fe596-849e-477a-b61c-87cc1dabbf8f tempest-ServersWithSpecificFlavorTestJSON-1791066950 tempest-ServersWithSpecificFlavorTestJSON-1791066950-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:49:27.081959 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:49:27.083368 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-f08fe596-849e-477a-b61c-87cc1dabbf8f tempest-ServersWithSpecificFlavorTestJSON-1791066950 tempest-ServersWithSpecificFlavorTestJSON-1791066950-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 9.439941 Aug 10 17:49:27.083368 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 61/141] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 17:49:17 2022] POST /compute/v2.1/servers => generated 214 bytes in 9442 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 10 17:49:27.100423 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-f3a42735-1195-4a24-ac40-23e3586a339a tempest-ServersWithSpecificFlavorTestJSON-1791066950 tempest-ServersWithSpecificFlavorTestJSON-1791066950-project] Calling method '.version_select at 0x7fb346ca0040>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:27.372728 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-f3a42735-1195-4a24-ac40-23e3586a339a tempest-ServersWithSpecificFlavorTestJSON-1791066950 tempest-ServersWithSpecificFlavorTestJSON-1791066950-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1512200958" status: 202 len: 0 microversion: 2.1 time: 0.280572 Aug 10 17:49:27.374938 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 81/142] 10.222.0.50 () {58 vars in 1221 bytes} [Wed Aug 10 17:49:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1512200958 => generated 0 bytes in 286 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 17:49:27.530022 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_cell0:SELECT=2 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:49:27.531041 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_cell1:SELECT=68 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:49:27.536538 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-94cb9adf-e41d-44ea-a6ba-ad214ee14c35 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:27.537860 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-94cb9adf-e41d-44ea-a6ba-ad214ee14c35 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] [instance: 419ed54a-a752-46bf-b399-b93ace51b625] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:49:27.554820 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-94cb9adf-e41d-44ea-a6ba-ad214ee14c35 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:27.555341 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-94cb9adf-e41d-44ea-a6ba-ad214ee14c35 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:27.555783 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-94cb9adf-e41d-44ea-a6ba-ad214ee14c35 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:27.557068 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-94cb9adf-e41d-44ea-a6ba-ad214ee14c35 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:27.557840 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-94cb9adf-e41d-44ea-a6ba-ad214ee14c35 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:27.558428 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-94cb9adf-e41d-44ea-a6ba-ad214ee14c35 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:27.863187 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-94cb9adf-e41d-44ea-a6ba-ad214ee14c35 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd069b0c285c649b0967d0a0e3fdb24ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc21714f4484762aa8797d16cd3f70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:49:27.874676 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-94cb9adf-e41d-44ea-a6ba-ad214ee14c35 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] 10.222.0.50 "GET /compute/v2.1/servers/419ed54a-a752-46bf-b399-b93ace51b625" status: 200 len: 1339 microversion: 2.1 time: 0.345444 Aug 10 17:49:27.894311 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 62/143] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:49:27 2022] GET /compute/v2.1/servers/419ed54a-a752-46bf-b399-b93ace51b625 => generated 1339 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:49:28.023060 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-ac06bc29-6ba8-481b-96a0-981fcbce6f0d tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:28.024031 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-ac06bc29-6ba8-481b-96a0-981fcbce6f0d tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] [instance: 8e4a95fa-1d4a-4dca-9ba6-73a55f57d771] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:49:28.031126 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-ac06bc29-6ba8-481b-96a0-981fcbce6f0d tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:28.031763 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-ac06bc29-6ba8-481b-96a0-981fcbce6f0d tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:28.032323 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-ac06bc29-6ba8-481b-96a0-981fcbce6f0d tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:28.033159 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-ac06bc29-6ba8-481b-96a0-981fcbce6f0d tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:28.033712 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-ac06bc29-6ba8-481b-96a0-981fcbce6f0d tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:28.034307 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-ac06bc29-6ba8-481b-96a0-981fcbce6f0d tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:28.586620 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-ac06bc29-6ba8-481b-96a0-981fcbce6f0d tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f242fdc47104b98882cb29c8ca5caae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b721d6dfb14d3d8780094fc4e72890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:49:28.596490 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-ac06bc29-6ba8-481b-96a0-981fcbce6f0d tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] 10.222.0.50 "GET /compute/v2.1/servers/8e4a95fa-1d4a-4dca-9ba6-73a55f57d771" status: 200 len: 1320 microversion: 2.1 time: 0.578259 Aug 10 17:49:28.603710 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 82/144] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:49:28 2022] GET /compute/v2.1/servers/8e4a95fa-1d4a-4dca-9ba6-73a55f57d771 => generated 1320 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:49:28.902178 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-ab322263-a23a-4477-8b48-ed35b96600e2 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:28.903362 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-ab322263-a23a-4477-8b48-ed35b96600e2 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] [instance: 419ed54a-a752-46bf-b399-b93ace51b625] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:49:28.928028 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-ab322263-a23a-4477-8b48-ed35b96600e2 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:28.928555 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-ab322263-a23a-4477-8b48-ed35b96600e2 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:28.929006 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-ab322263-a23a-4477-8b48-ed35b96600e2 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:28.929771 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-ab322263-a23a-4477-8b48-ed35b96600e2 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:28.930711 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-ab322263-a23a-4477-8b48-ed35b96600e2 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:28.930847 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-ab322263-a23a-4477-8b48-ed35b96600e2 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:29.186421 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-ab322263-a23a-4477-8b48-ed35b96600e2 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd069b0c285c649b0967d0a0e3fdb24ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc21714f4484762aa8797d16cd3f70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:49:29.204233 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-ab322263-a23a-4477-8b48-ed35b96600e2 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] 10.222.0.50 "GET /compute/v2.1/servers/419ed54a-a752-46bf-b399-b93ace51b625" status: 200 len: 1339 microversion: 2.1 time: 0.306949 Aug 10 17:49:29.206022 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 63/145] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:49:28 2022] GET /compute/v2.1/servers/419ed54a-a752-46bf-b399-b93ace51b625 => generated 1339 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:49:29.236529 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-1d09e078-6001-431a-906b-b7f6cfcbc704 tempest-ServersWithSpecificFlavorTestJSON-814160199 tempest-ServersWithSpecificFlavorTestJSON-814160199-project-admin] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:29.237958 n-d-852296-2 devstack@n-api.service[129409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:49:29.237958 n-d-852296-2 devstack@n-api.service[129409]: warnings.warn(msg) Aug 10 17:49:29.453893 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-1d09e078-6001-431a-906b-b7f6cfcbc704 tempest-ServersWithSpecificFlavorTestJSON-814160199 tempest-ServersWithSpecificFlavorTestJSON-814160199-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/729594390" status: 202 len: 0 microversion: 2.1 time: 0.221281 Aug 10 17:49:29.456154 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 83/146] 10.222.0.50 () {58 vars in 1158 bytes} [Wed Aug 10 17:49:29 2022] DELETE /compute/v2.1/flavors/729594390 => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 17:49:29.467442 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-b3cb4958-5c63-477b-9e7a-0975dbe8af63 tempest-ServersWithSpecificFlavorTestJSON-814160199 tempest-ServersWithSpecificFlavorTestJSON-814160199-project-admin] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:29.526898 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-b3cb4958-5c63-477b-9e7a-0975dbe8af63 tempest-ServersWithSpecificFlavorTestJSON-814160199 tempest-ServersWithSpecificFlavorTestJSON-814160199-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 5405 microversion: 2.1 time: 0.066051 Aug 10 17:49:29.527443 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 64/147] 10.222.0.50 () {58 vars in 1146 bytes} [Wed Aug 10 17:49:29 2022] GET /compute/v2.1/flavors/detail => generated 5405 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:49:29.545247 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-4ef0a101-c0c4-4415-8e67-d9c7a05d2253 tempest-ServersWithSpecificFlavorTestJSON-814160199 tempest-ServersWithSpecificFlavorTestJSON-814160199-project-admin] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:29.618064 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-5fdc99d4-e929-4695-af98-600383bcd228 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:29.619265 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-5fdc99d4-e929-4695-af98-600383bcd228 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] [instance: 8e4a95fa-1d4a-4dca-9ba6-73a55f57d771] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:49:29.625594 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-5fdc99d4-e929-4695-af98-600383bcd228 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:29.626074 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-5fdc99d4-e929-4695-af98-600383bcd228 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:29.626510 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-5fdc99d4-e929-4695-af98-600383bcd228 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:29.627202 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-5fdc99d4-e929-4695-af98-600383bcd228 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:29.627656 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-5fdc99d4-e929-4695-af98-600383bcd228 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:29.628080 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-5fdc99d4-e929-4695-af98-600383bcd228 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:29.723940 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-4ef0a101-c0c4-4415-8e67-d9c7a05d2253 tempest-ServersWithSpecificFlavorTestJSON-814160199 tempest-ServersWithSpecificFlavorTestJSON-814160199-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/2055881514" status: 202 len: 0 microversion: 2.1 time: 0.182261 Aug 10 17:49:29.726158 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 84/148] 10.222.0.50 () {58 vars in 1161 bytes} [Wed Aug 10 17:49:29 2022] DELETE /compute/v2.1/flavors/2055881514 => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 17:49:29.736299 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-88c62599-e72f-430e-b2eb-bde6f72426cf tempest-ServersWithSpecificFlavorTestJSON-814160199 tempest-ServersWithSpecificFlavorTestJSON-814160199-project-admin] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:29.791977 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-88c62599-e72f-430e-b2eb-bde6f72426cf tempest-ServersWithSpecificFlavorTestJSON-814160199 tempest-ServersWithSpecificFlavorTestJSON-814160199-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.054422 Aug 10 17:49:29.793925 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 85/149] 10.222.0.50 () {58 vars in 1146 bytes} [Wed Aug 10 17:49:29 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:49:29.915164 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-5fdc99d4-e929-4695-af98-600383bcd228 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f242fdc47104b98882cb29c8ca5caae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b721d6dfb14d3d8780094fc4e72890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:49:29.924154 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-5fdc99d4-e929-4695-af98-600383bcd228 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] 10.222.0.50 "GET /compute/v2.1/servers/8e4a95fa-1d4a-4dca-9ba6-73a55f57d771" status: 200 len: 1320 microversion: 2.1 time: 0.309953 Aug 10 17:49:29.928304 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 65/150] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:49:29 2022] GET /compute/v2.1/servers/8e4a95fa-1d4a-4dca-9ba6-73a55f57d771 => generated 1320 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:49:30.230507 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-c96c90c2-b51a-4212-ae95-4e74b9b99687 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:30.231426 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-c96c90c2-b51a-4212-ae95-4e74b9b99687 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] [instance: 419ed54a-a752-46bf-b399-b93ace51b625] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:49:30.261267 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c96c90c2-b51a-4212-ae95-4e74b9b99687 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:30.263120 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c96c90c2-b51a-4212-ae95-4e74b9b99687 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:30.264793 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c96c90c2-b51a-4212-ae95-4e74b9b99687 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:30.265924 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c96c90c2-b51a-4212-ae95-4e74b9b99687 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:30.267812 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c96c90c2-b51a-4212-ae95-4e74b9b99687 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:30.270407 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c96c90c2-b51a-4212-ae95-4e74b9b99687 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:30.624562 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-c96c90c2-b51a-4212-ae95-4e74b9b99687 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd069b0c285c649b0967d0a0e3fdb24ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc21714f4484762aa8797d16cd3f70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:49:30.642612 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-c96c90c2-b51a-4212-ae95-4e74b9b99687 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] 10.222.0.50 "GET /compute/v2.1/servers/419ed54a-a752-46bf-b399-b93ace51b625" status: 200 len: 1339 microversion: 2.1 time: 0.419208 Aug 10 17:49:30.647636 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 86/151] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:49:30 2022] GET /compute/v2.1/servers/419ed54a-a752-46bf-b399-b93ace51b625 => generated 1339 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:49:30.949995 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-25f63cf6-d5cc-40e2-a445-dd62179fd98c tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:30.951252 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-25f63cf6-d5cc-40e2-a445-dd62179fd98c tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] [instance: 8e4a95fa-1d4a-4dca-9ba6-73a55f57d771] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:49:30.969882 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-25f63cf6-d5cc-40e2-a445-dd62179fd98c tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:30.969882 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-25f63cf6-d5cc-40e2-a445-dd62179fd98c tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:30.969882 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-25f63cf6-d5cc-40e2-a445-dd62179fd98c tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:30.969882 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-25f63cf6-d5cc-40e2-a445-dd62179fd98c tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:30.970208 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-25f63cf6-d5cc-40e2-a445-dd62179fd98c tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:30.970208 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-25f63cf6-d5cc-40e2-a445-dd62179fd98c tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:31.227793 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-25f63cf6-d5cc-40e2-a445-dd62179fd98c tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f242fdc47104b98882cb29c8ca5caae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b721d6dfb14d3d8780094fc4e72890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:49:31.248473 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-25f63cf6-d5cc-40e2-a445-dd62179fd98c tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] 10.222.0.50 "GET /compute/v2.1/servers/8e4a95fa-1d4a-4dca-9ba6-73a55f57d771" status: 200 len: 1320 microversion: 2.1 time: 0.299878 Aug 10 17:49:31.249699 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 66/152] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:49:30 2022] GET /compute/v2.1/servers/8e4a95fa-1d4a-4dca-9ba6-73a55f57d771 => generated 1320 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:49:31.668088 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-e2ba3db5-1746-454b-b0c3-dedcfcfca1b3 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:31.668827 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-e2ba3db5-1746-454b-b0c3-dedcfcfca1b3 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] [instance: 419ed54a-a752-46bf-b399-b93ace51b625] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:49:31.676955 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e2ba3db5-1746-454b-b0c3-dedcfcfca1b3 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:31.684927 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e2ba3db5-1746-454b-b0c3-dedcfcfca1b3 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:31.684927 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e2ba3db5-1746-454b-b0c3-dedcfcfca1b3 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:31.684927 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e2ba3db5-1746-454b-b0c3-dedcfcfca1b3 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:31.684927 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e2ba3db5-1746-454b-b0c3-dedcfcfca1b3 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:31.685283 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e2ba3db5-1746-454b-b0c3-dedcfcfca1b3 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:31.824079 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-e2ba3db5-1746-454b-b0c3-dedcfcfca1b3 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd069b0c285c649b0967d0a0e3fdb24ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc21714f4484762aa8797d16cd3f70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:49:31.832193 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-e2ba3db5-1746-454b-b0c3-dedcfcfca1b3 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] 10.222.0.50 "GET /compute/v2.1/servers/419ed54a-a752-46bf-b399-b93ace51b625" status: 200 len: 1339 microversion: 2.1 time: 0.168685 Aug 10 17:49:31.832838 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 87/153] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:49:31 2022] GET /compute/v2.1/servers/419ed54a-a752-46bf-b399-b93ace51b625 => generated 1339 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:49:32.269715 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-6a4b1da6-4772-4470-b37d-fbcd07ec6a38 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:32.270444 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-6a4b1da6-4772-4470-b37d-fbcd07ec6a38 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] [instance: 8e4a95fa-1d4a-4dca-9ba6-73a55f57d771] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:49:32.278123 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-6a4b1da6-4772-4470-b37d-fbcd07ec6a38 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:32.278800 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-6a4b1da6-4772-4470-b37d-fbcd07ec6a38 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:32.279324 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-6a4b1da6-4772-4470-b37d-fbcd07ec6a38 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:32.280110 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-6a4b1da6-4772-4470-b37d-fbcd07ec6a38 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:32.280728 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-6a4b1da6-4772-4470-b37d-fbcd07ec6a38 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:32.281259 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-6a4b1da6-4772-4470-b37d-fbcd07ec6a38 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:32.437876 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-6a4b1da6-4772-4470-b37d-fbcd07ec6a38 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f242fdc47104b98882cb29c8ca5caae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b721d6dfb14d3d8780094fc4e72890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:49:32.445805 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-6a4b1da6-4772-4470-b37d-fbcd07ec6a38 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] 10.222.0.50 "GET /compute/v2.1/servers/8e4a95fa-1d4a-4dca-9ba6-73a55f57d771" status: 200 len: 1320 microversion: 2.1 time: 0.179831 Aug 10 17:49:32.446391 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 67/154] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:49:32 2022] GET /compute/v2.1/servers/8e4a95fa-1d4a-4dca-9ba6-73a55f57d771 => generated 1320 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:49:32.854502 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-9061b370-5850-4e5c-9745-5ba2c0c7fc51 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:32.855250 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-9061b370-5850-4e5c-9745-5ba2c0c7fc51 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] [instance: 419ed54a-a752-46bf-b399-b93ace51b625] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:49:32.862513 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-9061b370-5850-4e5c-9745-5ba2c0c7fc51 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:32.862996 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-9061b370-5850-4e5c-9745-5ba2c0c7fc51 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:32.863622 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-9061b370-5850-4e5c-9745-5ba2c0c7fc51 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:32.864522 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-9061b370-5850-4e5c-9745-5ba2c0c7fc51 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:32.864974 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-9061b370-5850-4e5c-9745-5ba2c0c7fc51 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:32.865391 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-9061b370-5850-4e5c-9745-5ba2c0c7fc51 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:33.014373 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-9061b370-5850-4e5c-9745-5ba2c0c7fc51 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd069b0c285c649b0967d0a0e3fdb24ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc21714f4484762aa8797d16cd3f70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:49:33.022373 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-9061b370-5850-4e5c-9745-5ba2c0c7fc51 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] 10.222.0.50 "GET /compute/v2.1/servers/419ed54a-a752-46bf-b399-b93ace51b625" status: 200 len: 1339 microversion: 2.1 time: 0.172120 Aug 10 17:49:33.028440 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 88/155] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:49:32 2022] GET /compute/v2.1/servers/419ed54a-a752-46bf-b399-b93ace51b625 => generated 1339 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:49:33.470663 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-f86de954-23c1-4d88-af53-791819f3c821 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:33.471503 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-f86de954-23c1-4d88-af53-791819f3c821 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] [instance: 8e4a95fa-1d4a-4dca-9ba6-73a55f57d771] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:49:33.481549 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-f86de954-23c1-4d88-af53-791819f3c821 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:33.482199 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-f86de954-23c1-4d88-af53-791819f3c821 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:33.483529 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-f86de954-23c1-4d88-af53-791819f3c821 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:33.485968 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-f86de954-23c1-4d88-af53-791819f3c821 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:33.487565 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-f86de954-23c1-4d88-af53-791819f3c821 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:33.488130 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-f86de954-23c1-4d88-af53-791819f3c821 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:33.780849 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-f86de954-23c1-4d88-af53-791819f3c821 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f242fdc47104b98882cb29c8ca5caae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b721d6dfb14d3d8780094fc4e72890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:49:33.790726 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-f86de954-23c1-4d88-af53-791819f3c821 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] 10.222.0.50 "GET /compute/v2.1/servers/8e4a95fa-1d4a-4dca-9ba6-73a55f57d771" status: 200 len: 1320 microversion: 2.1 time: 0.323596 Aug 10 17:49:33.791611 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 68/156] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:49:33 2022] GET /compute/v2.1/servers/8e4a95fa-1d4a-4dca-9ba6-73a55f57d771 => generated 1320 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:49:34.046509 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-18ba868f-4095-4eae-a5e0-43ac4130631a tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:34.047120 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-18ba868f-4095-4eae-a5e0-43ac4130631a tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] [instance: 419ed54a-a752-46bf-b399-b93ace51b625] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:49:34.049087 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_cell0:SELECT=2 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:49:34.054114 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-18ba868f-4095-4eae-a5e0-43ac4130631a tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:34.055902 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-18ba868f-4095-4eae-a5e0-43ac4130631a tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:34.056702 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-18ba868f-4095-4eae-a5e0-43ac4130631a tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:34.057627 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-18ba868f-4095-4eae-a5e0-43ac4130631a tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:34.058934 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-18ba868f-4095-4eae-a5e0-43ac4130631a tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:34.059504 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-18ba868f-4095-4eae-a5e0-43ac4130631a tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:34.256145 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-18ba868f-4095-4eae-a5e0-43ac4130631a tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd069b0c285c649b0967d0a0e3fdb24ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc21714f4484762aa8797d16cd3f70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:49:34.272380 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-18ba868f-4095-4eae-a5e0-43ac4130631a tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] 10.222.0.50 "GET /compute/v2.1/servers/419ed54a-a752-46bf-b399-b93ace51b625" status: 200 len: 1339 microversion: 2.1 time: 0.228656 Aug 10 17:49:34.273475 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 89/157] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:49:34 2022] GET /compute/v2.1/servers/419ed54a-a752-46bf-b399-b93ace51b625 => generated 1339 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:49:34.818525 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-b4119017-1665-47a4-a196-26935a757033 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:34.819277 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-b4119017-1665-47a4-a196-26935a757033 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] [instance: 8e4a95fa-1d4a-4dca-9ba6-73a55f57d771] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:49:34.833952 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-b4119017-1665-47a4-a196-26935a757033 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:34.835587 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-b4119017-1665-47a4-a196-26935a757033 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:34.837878 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-b4119017-1665-47a4-a196-26935a757033 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:34.840525 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-b4119017-1665-47a4-a196-26935a757033 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:34.843536 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-b4119017-1665-47a4-a196-26935a757033 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:34.844170 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-b4119017-1665-47a4-a196-26935a757033 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:34.992793 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [req-82772366-22af-46cb-b623-84bc5164e2f7 req-3404642e-64fa-439a-977c-17d1d4b78417 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "419ed54a-a752-46bf-b399-b93ace51b625", "name": "network-vif-plugged", "status": "completed", "tag": "4ff3b60c-7a85-4f60-95b2-b4bb72e21d10"}]} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:49:35.015307 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-82772366-22af-46cb-b623-84bc5164e2f7 req-3404642e-64fa-439a-977c-17d1d4b78417 service nova] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:35.017815 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-82772366-22af-46cb-b623-84bc5164e2f7 req-3404642e-64fa-439a-977c-17d1d4b78417 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:35.018453 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-82772366-22af-46cb-b623-84bc5164e2f7 req-3404642e-64fa-439a-977c-17d1d4b78417 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:35.049571 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.compute.server_external_events [req-82772366-22af-46cb-b623-84bc5164e2f7 req-3404642e-64fa-439a-977c-17d1d4b78417 service nova] Creating event network-vif-plugged:4ff3b60c-7a85-4f60-95b2-b4bb72e21d10 for instance 419ed54a-a752-46bf-b399-b93ace51b625 on n-h2-852296-2 Aug 10 17:49:35.063192 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [req-82772366-22af-46cb-b623-84bc5164e2f7 req-3404642e-64fa-439a-977c-17d1d4b78417 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.430000 Aug 10 17:49:35.066983 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 69/158] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 10 17:49:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:49:35.117773 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-b4119017-1665-47a4-a196-26935a757033 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f242fdc47104b98882cb29c8ca5caae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b721d6dfb14d3d8780094fc4e72890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:49:35.134524 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-b4119017-1665-47a4-a196-26935a757033 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] 10.222.0.50 "GET /compute/v2.1/servers/8e4a95fa-1d4a-4dca-9ba6-73a55f57d771" status: 200 len: 1320 microversion: 2.1 time: 0.320744 Aug 10 17:49:35.135625 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 90/159] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:49:34 2022] GET /compute/v2.1/servers/8e4a95fa-1d4a-4dca-9ba6-73a55f57d771 => generated 1320 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:49:35.293516 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-8d54eff4-cd34-4f58-b6c5-27bae1c4e7ac tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:35.294225 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-8d54eff4-cd34-4f58-b6c5-27bae1c4e7ac tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] [instance: 419ed54a-a752-46bf-b399-b93ace51b625] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:49:35.314290 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-8d54eff4-cd34-4f58-b6c5-27bae1c4e7ac tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:35.317866 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-8d54eff4-cd34-4f58-b6c5-27bae1c4e7ac tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:35.317866 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-8d54eff4-cd34-4f58-b6c5-27bae1c4e7ac tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:35.317866 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-8d54eff4-cd34-4f58-b6c5-27bae1c4e7ac tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:35.317866 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-8d54eff4-cd34-4f58-b6c5-27bae1c4e7ac tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:35.318175 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-8d54eff4-cd34-4f58-b6c5-27bae1c4e7ac tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:35.798270 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-8d54eff4-cd34-4f58-b6c5-27bae1c4e7ac tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd069b0c285c649b0967d0a0e3fdb24ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc21714f4484762aa8797d16cd3f70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:49:35.811013 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-8d54eff4-cd34-4f58-b6c5-27bae1c4e7ac tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] 10.222.0.50 "GET /compute/v2.1/servers/419ed54a-a752-46bf-b399-b93ace51b625" status: 200 len: 1339 microversion: 2.1 time: 0.522228 Aug 10 17:49:35.812085 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 70/160] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:49:35 2022] GET /compute/v2.1/servers/419ed54a-a752-46bf-b399-b93ace51b625 => generated 1339 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:49:36.158164 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-4baad0de-96c3-4fb5-9e26-54f794354894 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:36.159679 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-4baad0de-96c3-4fb5-9e26-54f794354894 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] [instance: 8e4a95fa-1d4a-4dca-9ba6-73a55f57d771] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:49:36.170620 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-4baad0de-96c3-4fb5-9e26-54f794354894 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:36.171410 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-4baad0de-96c3-4fb5-9e26-54f794354894 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:36.172566 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-4baad0de-96c3-4fb5-9e26-54f794354894 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:36.175665 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-4baad0de-96c3-4fb5-9e26-54f794354894 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:36.175665 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-4baad0de-96c3-4fb5-9e26-54f794354894 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:36.181718 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-4baad0de-96c3-4fb5-9e26-54f794354894 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:36.468657 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-4baad0de-96c3-4fb5-9e26-54f794354894 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f242fdc47104b98882cb29c8ca5caae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b721d6dfb14d3d8780094fc4e72890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:49:36.497412 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-4baad0de-96c3-4fb5-9e26-54f794354894 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] 10.222.0.50 "GET /compute/v2.1/servers/8e4a95fa-1d4a-4dca-9ba6-73a55f57d771" status: 200 len: 1320 microversion: 2.1 time: 0.343793 Aug 10 17:49:36.504159 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 91/161] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:49:36 2022] GET /compute/v2.1/servers/8e4a95fa-1d4a-4dca-9ba6-73a55f57d771 => generated 1320 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:49:36.832296 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-9c4373e9-36a0-4fde-9120-12fe0f16125f tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:36.832912 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-9c4373e9-36a0-4fde-9120-12fe0f16125f tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] [instance: 419ed54a-a752-46bf-b399-b93ace51b625] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:49:36.834795 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_cell0:SELECT=8 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:49:36.848586 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-9c4373e9-36a0-4fde-9120-12fe0f16125f tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:36.849122 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-9c4373e9-36a0-4fde-9120-12fe0f16125f tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:36.849569 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-9c4373e9-36a0-4fde-9120-12fe0f16125f tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:36.850288 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-9c4373e9-36a0-4fde-9120-12fe0f16125f tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:36.850744 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-9c4373e9-36a0-4fde-9120-12fe0f16125f tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:36.851175 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-9c4373e9-36a0-4fde-9120-12fe0f16125f tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:36.936817 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-7675c2ad-3883-4ed5-8256-b034ed4cabf6 tempest-HypervisorAdminNegativeUnderV252Test-1852798977 tempest-HypervisorAdminNegativeUnderV252Test-1852798977-project-admin] Calling method '.version_select at 0x7fb346a72550>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:36.936817 n-d-852296-2 devstack@n-api.service[129410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:49:36.936817 n-d-852296-2 devstack@n-api.service[129410]: warnings.warn(msg) Aug 10 17:49:36.936817 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-7675c2ad-3883-4ed5-8256-b034ed4cabf6 tempest-HypervisorAdminNegativeUnderV252Test-1852798977 tempest-HypervisorAdminNegativeUnderV252Test-1852798977-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:36.936817 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-7675c2ad-3883-4ed5-8256-b034ed4cabf6 tempest-HypervisorAdminNegativeUnderV252Test-1852798977 tempest-HypervisorAdminNegativeUnderV252Test-1852798977-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:36.937750 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-7675c2ad-3883-4ed5-8256-b034ed4cabf6 tempest-HypervisorAdminNegativeUnderV252Test-1852798977 tempest-HypervisorAdminNegativeUnderV252Test-1852798977-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:36.954067 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-7675c2ad-3883-4ed5-8256-b034ed4cabf6 tempest-HypervisorAdminNegativeUnderV252Test-1852798977 tempest-HypervisorAdminNegativeUnderV252Test-1852798977-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:36.954556 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-7675c2ad-3883-4ed5-8256-b034ed4cabf6 tempest-HypervisorAdminNegativeUnderV252Test-1852798977 tempest-HypervisorAdminNegativeUnderV252Test-1852798977-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:36.962495 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-7675c2ad-3883-4ed5-8256-b034ed4cabf6 tempest-HypervisorAdminNegativeUnderV252Test-1852798977 tempest-HypervisorAdminNegativeUnderV252Test-1852798977-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:36.991745 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-7675c2ad-3883-4ed5-8256-b034ed4cabf6 tempest-HypervisorAdminNegativeUnderV252Test-1852798977 tempest-HypervisorAdminNegativeUnderV252Test-1852798977-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:36.992237 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-7675c2ad-3883-4ed5-8256-b034ed4cabf6 tempest-HypervisorAdminNegativeUnderV252Test-1852798977 tempest-HypervisorAdminNegativeUnderV252Test-1852798977-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:36.994039 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-7675c2ad-3883-4ed5-8256-b034ed4cabf6 tempest-HypervisorAdminNegativeUnderV252Test-1852798977 tempest-HypervisorAdminNegativeUnderV252Test-1852798977-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:37.012214 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-7675c2ad-3883-4ed5-8256-b034ed4cabf6 tempest-HypervisorAdminNegativeUnderV252Test-1852798977 tempest-HypervisorAdminNegativeUnderV252Test-1852798977-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.462201 Aug 10 17:49:37.015279 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 71/162] 10.222.0.50 () {58 vars in 1146 bytes} [Wed Aug 10 17:49:36 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:49:37.114274 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-9c4373e9-36a0-4fde-9120-12fe0f16125f tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd069b0c285c649b0967d0a0e3fdb24ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc21714f4484762aa8797d16cd3f70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:49:37.124089 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-9c4373e9-36a0-4fde-9120-12fe0f16125f tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] 10.222.0.50 "GET /compute/v2.1/servers/419ed54a-a752-46bf-b399-b93ace51b625" status: 200 len: 1339 microversion: 2.1 time: 0.295971 Aug 10 17:49:37.128053 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 92/163] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:49:36 2022] GET /compute/v2.1/servers/419ed54a-a752-46bf-b399-b93ace51b625 => generated 1339 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:49:37.158550 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [req-74028348-c9bc-4fc0-9bc4-6601df92c060 req-b95e306d-d7cb-49b5-9b5c-fbfb744aaeda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e4a95fa-1d4a-4dca-9ba6-73a55f57d771", "name": "network-vif-plugged", "status": "completed", "tag": "18e16820-18a5-43c6-bacc-f7df72695ae4"}]} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:49:37.183232 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-74028348-c9bc-4fc0-9bc4-6601df92c060 req-b95e306d-d7cb-49b5-9b5c-fbfb744aaeda service nova] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:37.184563 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-74028348-c9bc-4fc0-9bc4-6601df92c060 req-b95e306d-d7cb-49b5-9b5c-fbfb744aaeda service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:37.185101 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-74028348-c9bc-4fc0-9bc4-6601df92c060 req-b95e306d-d7cb-49b5-9b5c-fbfb744aaeda service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:37.208208 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.compute.server_external_events [req-74028348-c9bc-4fc0-9bc4-6601df92c060 req-b95e306d-d7cb-49b5-9b5c-fbfb744aaeda service nova] Creating event network-vif-plugged:18e16820-18a5-43c6-bacc-f7df72695ae4 for instance 8e4a95fa-1d4a-4dca-9ba6-73a55f57d771 on n-h1-852296-2 Aug 10 17:49:37.218680 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [req-74028348-c9bc-4fc0-9bc4-6601df92c060 req-b95e306d-d7cb-49b5-9b5c-fbfb744aaeda service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063815 Aug 10 17:49:37.219693 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 93/164] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 10 17:49:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:49:37.467273 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-74f809f8-ce11-4bda-aefa-9fa1aa758e5d tempest-HypervisorAdminNegativeUnderV252Test-1514355650 tempest-HypervisorAdminNegativeUnderV252Test-1514355650-project] Calling method '.version_select at 0x7fb346a72d30>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:37.468262 n-d-852296-2 devstack@n-api.service[129410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:49:37.468262 n-d-852296-2 devstack@n-api.service[129410]: warnings.warn(msg) Aug 10 17:49:37.469569 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-74f809f8-ce11-4bda-aefa-9fa1aa758e5d tempest-HypervisorAdminNegativeUnderV252Test-1514355650 tempest-HypervisorAdminNegativeUnderV252Test-1514355650-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': 'aa2b26ebf5584b5dbd2137eb4d8d46d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7992b40a98484e538b8d731404825633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:49:37.471748 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-74f809f8-ce11-4bda-aefa-9fa1aa758e5d tempest-HypervisorAdminNegativeUnderV252Test-1514355650 tempest-HypervisorAdminNegativeUnderV252Test-1514355650-project] Request method failure captured: Aug 10 17:49:37.471748 n-d-852296-2 devstack@n-api.service[129410]: request: GET /compute/v2.1/os-hypervisors/n-h2-852296-2/search HTTP/1.1 Aug 10 17:49:37.471748 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 17:49:37.471748 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 17:49:37.471748 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 17:49:37.471748 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 0 Aug 10 17:49:37.471748 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 17:49:37.471748 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 17:49:37.471748 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 17:49:37.471748 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 17:49:37.471748 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8--uM3WdOpdUygpsEug4pVCqEYP6_IqK9_b7ib1vpu2TRgCMPg6mFP_VkUsEzcz5ATyfcJSukmKx-UgDW_sBQa4eyRXhyCFtyyYIq49FeDpvAu8YCfZVPq9Tmgp9Xd_1bwCFA3BSl8frXapsRFf8VumwjEWI_NE4vqx2douWVxA5M5E Aug 10 17:49:37.471748 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 17:49:37.471748 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 17:49:37.471748 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 17:49:37.471748 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 17:49:37.471748 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 17:49:37.471748 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 17:49:37.471748 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: 7992b40a98484e538b8d731404825633 Aug 10 17:49:37.471748 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1514355650 Aug 10 17:49:37.471748 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 17:49:37.471748 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 17:49:37.473308 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7992b40a98484e538b8d731404825633"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/7992b40a98484e538b8d731404825633"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7992b40a98484e538b8d731404825633"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_7992b40a98484e538b8d731404825633", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:49:37.473308 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1514355650 Aug 10 17:49:37.473308 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: 7992b40a98484e538b8d731404825633 Aug 10 17:49:37.473308 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1514355650 Aug 10 17:49:37.473308 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1514355650-project Aug 10 17:49:37.473308 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 17:49:37.473308 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 17:49:37.473308 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: aa2b26ebf5584b5dbd2137eb4d8d46d1 Aug 10 17:49:37.473308 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1514355650-project Aug 10 17:49:37.473308 n-d-852296-2 devstack@n-api.service[129410]: method: Aug 10 17:49:37.473308 n-d-852296-2 devstack@n-api.service[129410]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Aug 10 17:49:37.473308 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'id': 'n-h2-852296-2'} Aug 10 17:49:37.474118 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:49:37.474118 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:49:37.474118 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:49:37.474118 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:49:37.474118 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:49:37.474118 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:49:37.474118 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 17:49:37.474118 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 17:49:37.474118 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:49:37.474118 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:49:37.474118 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Aug 10 17:49:37.474118 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Aug 10 17:49:37.474118 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 10 17:49:37.474118 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 10 17:49:37.474118 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 10 17:49:37.474118 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 10 17:49:37.474118 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 10 17:49:37.474118 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 10 17:49:37.474118 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 10 17:49:37.475332 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise self.value Aug 10 17:49:37.475332 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 10 17:49:37.475332 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 10 17:49:37.475332 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 10 17:49:37.475332 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 10 17:49:37.475332 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 10 17:49:37.475332 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 10 17:49:37.475332 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Aug 10 17:49:37.475332 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:49:37.475332 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:49:37.475332 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:49:37.475332 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:49:37.475332 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:49:37.475332 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:49:37.475332 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 10 17:49:37.475332 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 10 17:49:37.475332 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Aug 10 17:49:37.475332 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:49:37.482831 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-74f809f8-ce11-4bda-aefa-9fa1aa758e5d tempest-HypervisorAdminNegativeUnderV252Test-1514355650 tempest-HypervisorAdminNegativeUnderV252Test-1514355650-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:49:37.484037 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-74f809f8-ce11-4bda-aefa-9fa1aa758e5d tempest-HypervisorAdminNegativeUnderV252Test-1514355650 tempest-HypervisorAdminNegativeUnderV252Test-1514355650-project] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/n-h2-852296-2/search" status: 403 len: 117 microversion: 2.1 time: 0.462095 Aug 10 17:49:37.485013 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 72/165] 10.222.0.50 () {58 vars in 1209 bytes} [Wed Aug 10 17:49:37 2022] GET /compute/v2.1/os-hypervisors/n-h2-852296-2/search => generated 117 bytes in 464 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:49:37.496951 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-e753c721-a9a7-4891-b581-71acabfd26d9 tempest-KeyPairsV210TestJSON-1410218000 tempest-KeyPairsV210TestJSON-1410218000-project-admin] Action: 'create', calling method: .version_select at 0x7fb346e3e8b0>, body: {"keypair": {"name": "tempest-keypair-1778494494", "type": "ssh", "user_id": "34433df58cf14fe486381128112ec644", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIrNO2ckWm43nosLjLZImL3lC3Z34zNQYgbbCGgs2GjlkFBJ1dqwazRAMCQCDy/BKOL7b7rUOPqpLyoabN8G72dKPtqZcjYWnL3uNzzIX4//c2Py3uRsrDxZFZDtYo/Bgw=="}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:49:37.507573 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-ee34f676-b166-485c-a18a-73f28a750117 tempest-HypervisorAdminNegativeUnderV252Test-1852798977 tempest-HypervisorAdminNegativeUnderV252Test-1852798977-project-admin] Calling method '.version_select at 0x7fb346a57a60>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:37.514862 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-ee34f676-b166-485c-a18a-73f28a750117 tempest-HypervisorAdminNegativeUnderV252Test-1852798977 tempest-HypervisorAdminNegativeUnderV252Test-1852798977-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:37.515589 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-ee34f676-b166-485c-a18a-73f28a750117 tempest-HypervisorAdminNegativeUnderV252Test-1852798977 tempest-HypervisorAdminNegativeUnderV252Test-1852798977-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:37.516188 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-ee34f676-b166-485c-a18a-73f28a750117 tempest-HypervisorAdminNegativeUnderV252Test-1852798977 tempest-HypervisorAdminNegativeUnderV252Test-1852798977-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:37.548771 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-e753c721-a9a7-4891-b581-71acabfd26d9 tempest-KeyPairsV210TestJSON-1410218000 tempest-KeyPairsV210TestJSON-1410218000-project-admin] Getting quotas for project 3fbe307acd984ed6a44c47d42cbda2d2. Resources: {'key_pairs'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:49:37.554591 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-e753c721-a9a7-4891-b581-71acabfd26d9 tempest-KeyPairsV210TestJSON-1410218000 tempest-KeyPairsV210TestJSON-1410218000-project-admin] Getting quotas for user 8203fb9e733b40299bbd65a1df14363a and project 3fbe307acd984ed6a44c47d42cbda2d2. Resources: {'key_pairs'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:49:37.554990 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-ee34f676-b166-485c-a18a-73f28a750117 tempest-HypervisorAdminNegativeUnderV252Test-1852798977 tempest-HypervisorAdminNegativeUnderV252Test-1852798977-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 10 17:49:37.561462 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-ee34f676-b166-485c-a18a-73f28a750117 tempest-HypervisorAdminNegativeUnderV252Test-1852798977 tempest-HypervisorAdminNegativeUnderV252Test-1852798977-project-admin] Request method failure captured: Aug 10 17:49:37.561462 n-d-852296-2 devstack@n-api.service[129410]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Aug 10 17:49:37.561462 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 17:49:37.561462 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 17:49:37.561462 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 17:49:37.561462 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 0 Aug 10 17:49:37.561462 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 17:49:37.561462 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 17:49:37.561462 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 17:49:37.561462 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 17:49:37.561462 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8--w0YGCnLQ6tPTtZtOyPgNe5QahUTIoMfWl-qantn_tVGyVGKHk5diwcF5iSK-pfglSKqQlPAGG_5IHHySZtXIOI1uXWK2NlK_AGkiGq0kDz-Ig8DH-2bUwVtzSYiQvpNQtVR7Gj4wg5diTygsh54ABja4SyuF74GMCDvGJ8hKrPao Aug 10 17:49:37.561462 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 17:49:37.561462 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 17:49:37.561462 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 17:49:37.561462 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 17:49:37.561462 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 17:49:37.561462 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 17:49:37.561462 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: 6f6a418276bb4f02a38eb64ab5db6ecc Aug 10 17:49:37.561462 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1852798977 Aug 10 17:49:37.561462 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member,admin Aug 10 17:49:37.561462 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member,admin Aug 10 17:49:37.562679 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6f6a418276bb4f02a38eb64ab5db6ecc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6f6a418276bb4f02a38eb64ab5db6ecc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6f6a418276bb4f02a38eb64ab5db6ecc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6f6a418276bb4f02a38eb64ab5db6ecc", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:49:37.562679 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1852798977 Aug 10 17:49:37.562679 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: 6f6a418276bb4f02a38eb64ab5db6ecc Aug 10 17:49:37.562679 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1852798977 Aug 10 17:49:37.562679 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1852798977-project-admin Aug 10 17:49:37.562679 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 17:49:37.562679 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 17:49:37.562679 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: 19c5b2ced6594a72a0ded6418685b45f Aug 10 17:49:37.562679 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1852798977-project-admin Aug 10 17:49:37.562679 n-d-852296-2 devstack@n-api.service[129410]: method: Aug 10 17:49:37.562679 n-d-852296-2 devstack@n-api.service[129410]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 10 17:49:37.562679 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'id': 'nonexistent_hypervisor_name'} Aug 10 17:49:37.563332 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:49:37.563332 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:49:37.563332 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:49:37.563332 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:49:37.563332 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:49:37.563332 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:49:37.563332 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 17:49:37.563332 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 17:49:37.563332 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:49:37.563332 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:49:37.563332 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Aug 10 17:49:37.563332 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Aug 10 17:49:37.563332 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Aug 10 17:49:37.563332 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 10 17:49:37.563332 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 10 17:49:37.563332 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:49:37.563332 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:49:37.563332 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:49:37.563332 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:49:37.563332 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:49:37.564415 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:49:37.564415 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:49:37.564415 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:49:37.564415 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 10 17:49:37.564415 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:49:37.569752 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-ee34f676-b166-485c-a18a-73f28a750117 tempest-HypervisorAdminNegativeUnderV252Test-1852798977 tempest-HypervisorAdminNegativeUnderV252Test-1852798977-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:49:37.570446 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-ee34f676-b166-485c-a18a-73f28a750117 tempest-HypervisorAdminNegativeUnderV252Test-1852798977 tempest-HypervisorAdminNegativeUnderV252Test-1852798977-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.079421 Aug 10 17:49:37.571030 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 73/166] 10.222.0.50 () {58 vars in 1251 bytes} [Wed Aug 10 17:49:37 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 17:49:37.584881 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-6e6e541d-6a40-47d0-bc45-e3503096651c tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:37.585526 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-6e6e541d-6a40-47d0-bc45-e3503096651c tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] [instance: 8e4a95fa-1d4a-4dca-9ba6-73a55f57d771] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:49:37.605955 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-6e6e541d-6a40-47d0-bc45-e3503096651c tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:37.609883 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-6e6e541d-6a40-47d0-bc45-e3503096651c tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:37.609883 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-6e6e541d-6a40-47d0-bc45-e3503096651c tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:37.609883 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-6e6e541d-6a40-47d0-bc45-e3503096651c tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:37.609883 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-6e6e541d-6a40-47d0-bc45-e3503096651c tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:37.610212 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-6e6e541d-6a40-47d0-bc45-e3503096651c tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:37.751298 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-e753c721-a9a7-4891-b581-71acabfd26d9 tempest-KeyPairsV210TestJSON-1410218000 tempest-KeyPairsV210TestJSON-1410218000-project-admin] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.498051 Aug 10 17:49:37.752083 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 94/167] 10.222.0.50 () {62 vars in 1200 bytes} [Wed Aug 10 17:49:37 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 500 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 10 17:49:37.767904 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-4c82af7d-df91-4a5f-b0cb-f4263534b444 tempest-HypervisorAdminNegativeUnderV252Test-1852798977 tempest-HypervisorAdminNegativeUnderV252Test-1852798977-project-admin] Calling method '.version_select at 0x7fb346bd9160>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:37.767904 n-d-852296-2 devstack@n-api.service[129409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:49:37.767904 n-d-852296-2 devstack@n-api.service[129409]: warnings.warn(msg) Aug 10 17:49:37.767904 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-4c82af7d-df91-4a5f-b0cb-f4263534b444 tempest-HypervisorAdminNegativeUnderV252Test-1852798977 tempest-HypervisorAdminNegativeUnderV252Test-1852798977-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:37.767904 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-4c82af7d-df91-4a5f-b0cb-f4263534b444 tempest-HypervisorAdminNegativeUnderV252Test-1852798977 tempest-HypervisorAdminNegativeUnderV252Test-1852798977-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:37.768368 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-4c82af7d-df91-4a5f-b0cb-f4263534b444 tempest-HypervisorAdminNegativeUnderV252Test-1852798977 tempest-HypervisorAdminNegativeUnderV252Test-1852798977-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:37.787669 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-4c82af7d-df91-4a5f-b0cb-f4263534b444 tempest-HypervisorAdminNegativeUnderV252Test-1852798977 tempest-HypervisorAdminNegativeUnderV252Test-1852798977-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:37.788519 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-4c82af7d-df91-4a5f-b0cb-f4263534b444 tempest-HypervisorAdminNegativeUnderV252Test-1852798977 tempest-HypervisorAdminNegativeUnderV252Test-1852798977-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:37.788954 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-4c82af7d-df91-4a5f-b0cb-f4263534b444 tempest-HypervisorAdminNegativeUnderV252Test-1852798977 tempest-HypervisorAdminNegativeUnderV252Test-1852798977-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:37.806900 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-4c82af7d-df91-4a5f-b0cb-f4263534b444 tempest-HypervisorAdminNegativeUnderV252Test-1852798977 tempest-HypervisorAdminNegativeUnderV252Test-1852798977-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:37.806900 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-4c82af7d-df91-4a5f-b0cb-f4263534b444 tempest-HypervisorAdminNegativeUnderV252Test-1852798977 tempest-HypervisorAdminNegativeUnderV252Test-1852798977-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:37.806900 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-4c82af7d-df91-4a5f-b0cb-f4263534b444 tempest-HypervisorAdminNegativeUnderV252Test-1852798977 tempest-HypervisorAdminNegativeUnderV252Test-1852798977-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:37.818296 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-4c82af7d-df91-4a5f-b0cb-f4263534b444 tempest-HypervisorAdminNegativeUnderV252Test-1852798977 tempest-HypervisorAdminNegativeUnderV252Test-1852798977-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.064373 Aug 10 17:49:37.827076 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 95/168] 10.222.0.50 () {58 vars in 1146 bytes} [Wed Aug 10 17:49:37 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:49:37.835180 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-94fa2a8d-c941-4dee-8ddf-47911e004007 tempest-KeyPairsV210TestJSON-1410218000 tempest-KeyPairsV210TestJSON-1410218000-project-admin] Action: 'create', calling method: .version_select at 0x7fb346bf6310>, body: {"keypair": {"name": "tempest-keypair-1470173099", "type": "ssh", "user_id": "34433df58cf14fe486381128112ec644", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK9U91CupsE6y3geyQq4TMHCAC/ALnfwnMRbVxdkAjhjYqq4Y1FnJtmJXvE+cknFUnC6l2rYyUO8U3vBURL08KOEBr1WYBbldS/vzsvGSJSW1H7RHdwEB0m6MDlvfuMjkg=="}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:49:37.859500 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-94fa2a8d-c941-4dee-8ddf-47911e004007 tempest-KeyPairsV210TestJSON-1410218000 tempest-KeyPairsV210TestJSON-1410218000-project-admin] Getting quotas for project 3fbe307acd984ed6a44c47d42cbda2d2. Resources: {'key_pairs'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:49:37.870208 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-94fa2a8d-c941-4dee-8ddf-47911e004007 tempest-KeyPairsV210TestJSON-1410218000 tempest-KeyPairsV210TestJSON-1410218000-project-admin] Getting quotas for user 8203fb9e733b40299bbd65a1df14363a and project 3fbe307acd984ed6a44c47d42cbda2d2. Resources: {'key_pairs'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:49:38.045055 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-94fa2a8d-c941-4dee-8ddf-47911e004007 tempest-KeyPairsV210TestJSON-1410218000 tempest-KeyPairsV210TestJSON-1410218000-project-admin] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.216074 Aug 10 17:49:38.045805 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 96/169] 10.222.0.50 () {62 vars in 1200 bytes} [Wed Aug 10 17:49:37 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 218 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 10 17:49:38.051771 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-4fd5844e-9369-4a94-8c5d-e2eaed2e0f46 tempest-HypervisorAdminNegativeUnderV252Test-1514355650 tempest-HypervisorAdminNegativeUnderV252Test-1514355650-project] Calling method '.version_select at 0x7fb346ca0040>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:38.052856 n-d-852296-2 devstack@n-api.service[129409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:49:38.052856 n-d-852296-2 devstack@n-api.service[129409]: warnings.warn(msg) Aug 10 17:49:38.053853 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-4fd5844e-9369-4a94-8c5d-e2eaed2e0f46 tempest-HypervisorAdminNegativeUnderV252Test-1514355650 tempest-HypervisorAdminNegativeUnderV252Test-1514355650-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': 'aa2b26ebf5584b5dbd2137eb4d8d46d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7992b40a98484e538b8d731404825633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:49:38.056682 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-4fd5844e-9369-4a94-8c5d-e2eaed2e0f46 tempest-HypervisorAdminNegativeUnderV252Test-1514355650 tempest-HypervisorAdminNegativeUnderV252Test-1514355650-project] Request method failure captured: Aug 10 17:49:38.056682 n-d-852296-2 devstack@n-api.service[129409]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Aug 10 17:49:38.056682 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 17:49:38.056682 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 17:49:38.056682 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 17:49:38.056682 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 0 Aug 10 17:49:38.056682 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 17:49:38.056682 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 17:49:38.056682 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 17:49:38.056682 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 17:49:38.056682 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8--uM3WdOpdUygpsEug4pVCqEYP6_IqK9_b7ib1vpu2TRgCMPg6mFP_VkUsEzcz5ATyfcJSukmKx-UgDW_sBQa4eyRXhyCFtyyYIq49FeDpvAu8YCfZVPq9Tmgp9Xd_1bwCFA3BSl8frXapsRFf8VumwjEWI_NE4vqx2douWVxA5M5E Aug 10 17:49:38.056682 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 17:49:38.056682 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 17:49:38.056682 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 17:49:38.056682 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 17:49:38.056682 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 17:49:38.056682 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 17:49:38.056682 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: 7992b40a98484e538b8d731404825633 Aug 10 17:49:38.056682 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1514355650 Aug 10 17:49:38.056682 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 17:49:38.056682 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 17:49:38.057957 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7992b40a98484e538b8d731404825633"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/7992b40a98484e538b8d731404825633"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7992b40a98484e538b8d731404825633"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_7992b40a98484e538b8d731404825633", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:49:38.057957 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1514355650 Aug 10 17:49:38.057957 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: 7992b40a98484e538b8d731404825633 Aug 10 17:49:38.057957 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1514355650 Aug 10 17:49:38.057957 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1514355650-project Aug 10 17:49:38.057957 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 17:49:38.057957 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 17:49:38.057957 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: aa2b26ebf5584b5dbd2137eb4d8d46d1 Aug 10 17:49:38.057957 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1514355650-project Aug 10 17:49:38.057957 n-d-852296-2 devstack@n-api.service[129409]: method: Aug 10 17:49:38.057957 n-d-852296-2 devstack@n-api.service[129409]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Aug 10 17:49:38.057957 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'id': '1'} Aug 10 17:49:38.058648 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:49:38.058648 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:49:38.058648 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:49:38.058648 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:49:38.058648 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:49:38.058648 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:49:38.058648 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 17:49:38.058648 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 17:49:38.058648 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:49:38.058648 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:49:38.058648 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Aug 10 17:49:38.058648 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Aug 10 17:49:38.058648 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 10 17:49:38.058648 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 10 17:49:38.058648 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 10 17:49:38.058648 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 10 17:49:38.058648 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 10 17:49:38.058648 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 10 17:49:38.058648 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 10 17:49:38.060647 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise self.value Aug 10 17:49:38.060647 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 10 17:49:38.060647 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 10 17:49:38.060647 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 10 17:49:38.060647 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 10 17:49:38.060647 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 10 17:49:38.060647 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 10 17:49:38.060647 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Aug 10 17:49:38.060647 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:49:38.060647 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:49:38.060647 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:49:38.060647 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:49:38.060647 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:49:38.060647 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:49:38.060647 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 10 17:49:38.060647 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 10 17:49:38.060647 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Aug 10 17:49:38.060647 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:49:38.063486 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-4fd5844e-9369-4a94-8c5d-e2eaed2e0f46 tempest-HypervisorAdminNegativeUnderV252Test-1514355650 tempest-HypervisorAdminNegativeUnderV252Test-1514355650-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:49:38.063486 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-4fd5844e-9369-4a94-8c5d-e2eaed2e0f46 tempest-HypervisorAdminNegativeUnderV252Test-1514355650 tempest-HypervisorAdminNegativeUnderV252Test-1514355650-project] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.011063 Aug 10 17:49:38.063486 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 97/170] 10.222.0.50 () {58 vars in 1176 bytes} [Wed Aug 10 17:49:38 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:49:38.138354 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-6e6e541d-6a40-47d0-bc45-e3503096651c tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f242fdc47104b98882cb29c8ca5caae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b721d6dfb14d3d8780094fc4e72890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:49:38.146337 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-6e6e541d-6a40-47d0-bc45-e3503096651c tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] 10.222.0.50 "GET /compute/v2.1/servers/8e4a95fa-1d4a-4dca-9ba6-73a55f57d771" status: 200 len: 1320 microversion: 2.1 time: 0.573740 Aug 10 17:49:38.160624 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 74/171] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:49:37 2022] GET /compute/v2.1/servers/8e4a95fa-1d4a-4dca-9ba6-73a55f57d771 => generated 1320 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:49:38.165661 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-e3eb1744-c40f-46b1-961d-07bb3696faa2 tempest-KeyPairsV210TestJSON-1410218000 tempest-KeyPairsV210TestJSON-1410218000-project-admin] Calling method '.version_select at 0x7fb346a83940>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:38.175164 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-e3eb1744-c40f-46b1-961d-07bb3696faa2 tempest-KeyPairsV210TestJSON-1410218000 tempest-KeyPairsV210TestJSON-1410218000-project-admin] 10.222.0.50 "GET /compute/v2.1/os-keypairs/tempest-keypair-1778494494?user_id=34433df58cf14fe486381128112ec644" status: 200 len: 512 microversion: 2.10 time: 0.013393 Aug 10 17:49:38.179068 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 75/172] 10.222.0.50 () {60 vars in 1340 bytes} [Wed Aug 10 17:49:38 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1778494494?user_id=34433df58cf14fe486381128112ec644 => generated 512 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 17:49:38.184407 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-98528c54-3133-443f-bb71-6f13d1a417e5 tempest-HypervisorAdminNegativeUnderV252Test-1852798977 tempest-HypervisorAdminNegativeUnderV252Test-1852798977-project-admin] Calling method '.version_select at 0x7fb346a72310>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:38.189157 n-d-852296-2 devstack@n-api.service[129410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:49:38.189157 n-d-852296-2 devstack@n-api.service[129410]: warnings.warn(msg) Aug 10 17:49:38.194162 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-98528c54-3133-443f-bb71-6f13d1a417e5 tempest-HypervisorAdminNegativeUnderV252Test-1852798977 tempest-HypervisorAdminNegativeUnderV252Test-1852798977-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:38.194693 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-98528c54-3133-443f-bb71-6f13d1a417e5 tempest-HypervisorAdminNegativeUnderV252Test-1852798977 tempest-HypervisorAdminNegativeUnderV252Test-1852798977-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:38.195170 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-98528c54-3133-443f-bb71-6f13d1a417e5 tempest-HypervisorAdminNegativeUnderV252Test-1852798977 tempest-HypervisorAdminNegativeUnderV252Test-1852798977-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:38.205740 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-98528c54-3133-443f-bb71-6f13d1a417e5 tempest-HypervisorAdminNegativeUnderV252Test-1852798977 tempest-HypervisorAdminNegativeUnderV252Test-1852798977-project-admin] HTTP exception thrown: No hypervisor matching '0cbf2d38-2d80-483c-9785-b2b5e24c72e1' could be found. Aug 10 17:49:38.207441 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-98528c54-3133-443f-bb71-6f13d1a417e5 tempest-HypervisorAdminNegativeUnderV252Test-1852798977 tempest-HypervisorAdminNegativeUnderV252Test-1852798977-project-admin] Request method failure captured: Aug 10 17:49:38.207441 n-d-852296-2 devstack@n-api.service[129410]: request: GET /compute/v2.1/os-hypervisors/0cbf2d38-2d80-483c-9785-b2b5e24c72e1/servers HTTP/1.1 Aug 10 17:49:38.207441 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 17:49:38.207441 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 17:49:38.207441 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 17:49:38.207441 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 0 Aug 10 17:49:38.207441 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 17:49:38.207441 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 17:49:38.207441 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 17:49:38.207441 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 17:49:38.207441 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8--w0YGCnLQ6tPTtZtOyPgNe5QahUTIoMfWl-qantn_tVGyVGKHk5diwcF5iSK-pfglSKqQlPAGG_5IHHySZtXIOI1uXWK2NlK_AGkiGq0kDz-Ig8DH-2bUwVtzSYiQvpNQtVR7Gj4wg5diTygsh54ABja4SyuF74GMCDvGJ8hKrPao Aug 10 17:49:38.207441 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 17:49:38.207441 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 17:49:38.207441 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 17:49:38.207441 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 17:49:38.207441 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 17:49:38.207441 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 17:49:38.207441 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: 6f6a418276bb4f02a38eb64ab5db6ecc Aug 10 17:49:38.207441 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1852798977 Aug 10 17:49:38.207441 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member,admin Aug 10 17:49:38.207441 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member,admin Aug 10 17:49:38.208941 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6f6a418276bb4f02a38eb64ab5db6ecc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6f6a418276bb4f02a38eb64ab5db6ecc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6f6a418276bb4f02a38eb64ab5db6ecc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6f6a418276bb4f02a38eb64ab5db6ecc", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:49:38.208941 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1852798977 Aug 10 17:49:38.208941 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: 6f6a418276bb4f02a38eb64ab5db6ecc Aug 10 17:49:38.208941 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1852798977 Aug 10 17:49:38.208941 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1852798977-project-admin Aug 10 17:49:38.208941 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 17:49:38.208941 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 17:49:38.208941 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: 19c5b2ced6594a72a0ded6418685b45f Aug 10 17:49:38.208941 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1852798977-project-admin Aug 10 17:49:38.208941 n-d-852296-2 devstack@n-api.service[129410]: method: Aug 10 17:49:38.208941 n-d-852296-2 devstack@n-api.service[129410]: exception: No hypervisor matching '0cbf2d38-2d80-483c-9785-b2b5e24c72e1' could be found. Aug 10 17:49:38.208941 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'id': '0cbf2d38-2d80-483c-9785-b2b5e24c72e1'} Aug 10 17:49:38.209595 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:49:38.209595 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:49:38.209595 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:49:38.209595 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:49:38.209595 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:49:38.209595 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:49:38.209595 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 17:49:38.209595 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 17:49:38.209595 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:49:38.209595 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:49:38.209595 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Aug 10 17:49:38.209595 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Aug 10 17:49:38.209595 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Aug 10 17:49:38.209595 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 10 17:49:38.209595 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '0cbf2d38-2d80-483c-9785-b2b5e24c72e1' could be found. Aug 10 17:49:38.209595 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:49:38.209595 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:49:38.209595 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:49:38.209595 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:49:38.210551 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:49:38.210551 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:49:38.210551 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:49:38.210551 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:49:38.210551 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '0cbf2d38-2d80-483c-9785-b2b5e24c72e1' could be found. Aug 10 17:49:38.210551 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:49:38.213222 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-98528c54-3133-443f-bb71-6f13d1a417e5 tempest-HypervisorAdminNegativeUnderV252Test-1852798977 tempest-HypervisorAdminNegativeUnderV252Test-1852798977-project-admin] Returning 404 to user: No hypervisor matching '0cbf2d38-2d80-483c-9785-b2b5e24c72e1' could be found. {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:49:38.215079 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-98528c54-3133-443f-bb71-6f13d1a417e5 tempest-HypervisorAdminNegativeUnderV252Test-1852798977 tempest-HypervisorAdminNegativeUnderV252Test-1852798977-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/0cbf2d38-2d80-483c-9785-b2b5e24c72e1/servers" status: 404 len: 123 microversion: 2.1 time: 0.034729 Aug 10 17:49:38.216075 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 76/173] 10.222.0.50 () {58 vars in 1281 bytes} [Wed Aug 10 17:49:38 2022] GET /compute/v2.1/os-hypervisors/0cbf2d38-2d80-483c-9785-b2b5e24c72e1/servers => generated 123 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:49:38.229708 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-13b09b63-ca30-4ca5-83ac-51458c66e4b0 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:38.234752 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-13b09b63-ca30-4ca5-83ac-51458c66e4b0 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] [instance: 419ed54a-a752-46bf-b399-b93ace51b625] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:49:38.250346 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-13b09b63-ca30-4ca5-83ac-51458c66e4b0 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:38.252005 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-13b09b63-ca30-4ca5-83ac-51458c66e4b0 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:38.253563 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-13b09b63-ca30-4ca5-83ac-51458c66e4b0 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:38.258378 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-13b09b63-ca30-4ca5-83ac-51458c66e4b0 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:38.259801 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-13b09b63-ca30-4ca5-83ac-51458c66e4b0 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:38.264832 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-13b09b63-ca30-4ca5-83ac-51458c66e4b0 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:38.277870 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-84112338-a006-453c-993b-481b89fcadb9 tempest-QuotaClassesAdmin257Test-342022798 tempest-QuotaClassesAdmin257Test-342022798-project-admin] Calling method '.version_select at 0x7fb346b8d820>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:38.278896 n-d-852296-2 devstack@n-api.service[129409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:49:38.278896 n-d-852296-2 devstack@n-api.service[129409]: warnings.warn(msg) Aug 10 17:49:38.303715 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-84112338-a006-453c-993b-481b89fcadb9 tempest-QuotaClassesAdmin257Test-342022798 tempest-QuotaClassesAdmin257Test-342022798-project-admin] 10.222.0.50 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.242680 Aug 10 17:49:38.313144 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 98/174] 10.222.0.50 () {60 vars in 1226 bytes} [Wed Aug 10 17:49:38 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 17:49:38.318308 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-5583e16b-0484-42f0-a6cc-d96b9e1a5a3f tempest-KeyPairsV210TestJSON-1410218000 tempest-KeyPairsV210TestJSON-1410218000-project-admin] Action: 'create', calling method: .version_select at 0x7fb346bd9670>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-455451321", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL3TmOv/b37BKhYdbH1mc2lfMl8vtAdN6VxN4yxOE/XA32C2Pd2wXzsb4GlWC/GvwAV+OllxcegN8ogHXrKxyyBV0qkNUlpujMnwv4bdC0/oOXvgitHXEoddUBrZbpnUNA=="}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:49:38.350679 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-5583e16b-0484-42f0-a6cc-d96b9e1a5a3f tempest-KeyPairsV210TestJSON-1410218000 tempest-KeyPairsV210TestJSON-1410218000-project-admin] Getting quotas for project 3fbe307acd984ed6a44c47d42cbda2d2. Resources: {'key_pairs'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:49:38.355860 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-5583e16b-0484-42f0-a6cc-d96b9e1a5a3f tempest-KeyPairsV210TestJSON-1410218000 tempest-KeyPairsV210TestJSON-1410218000-project-admin] Getting quotas for user 8203fb9e733b40299bbd65a1df14363a and project 3fbe307acd984ed6a44c47d42cbda2d2. Resources: {'key_pairs'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:49:38.519103 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-5583e16b-0484-42f0-a6cc-d96b9e1a5a3f tempest-KeyPairsV210TestJSON-1410218000 tempest-KeyPairsV210TestJSON-1410218000-project-admin] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.10 time: 0.204438 Aug 10 17:49:38.519888 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 99/175] 10.222.0.50 () {62 vars in 1200 bytes} [Wed Aug 10 17:49:38 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 206 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 10 17:49:38.531904 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-cac32943-1ac9-4484-9482-32e50ff6a870 tempest-QuotaClassesAdmin257Test-342022798 tempest-QuotaClassesAdmin257Test-342022798-project-admin] Action: 'update', calling method: .version_select at 0x7fb346cb6d30>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:49:38.535612 n-d-852296-2 devstack@n-api.service[129409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:49:38.535612 n-d-852296-2 devstack@n-api.service[129409]: warnings.warn(msg) Aug 10 17:49:38.654972 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-13b09b63-ca30-4ca5-83ac-51458c66e4b0 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd069b0c285c649b0967d0a0e3fdb24ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc21714f4484762aa8797d16cd3f70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:49:38.664012 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-13b09b63-ca30-4ca5-83ac-51458c66e4b0 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] 10.222.0.50 "GET /compute/v2.1/servers/419ed54a-a752-46bf-b399-b93ace51b625" status: 200 len: 1339 microversion: 2.1 time: 0.446628 Aug 10 17:49:38.665115 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 77/176] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:49:38 2022] GET /compute/v2.1/servers/419ed54a-a752-46bf-b399-b93ace51b625 => generated 1339 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:49:38.669881 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-1e3b78ac-f774-4d66-8ec6-a65548899e45 tempest-KeyPairsV210TestJSON-1410218000 tempest-KeyPairsV210TestJSON-1410218000-project-admin] Calling method '.version_select at 0x7fb346a838b0>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:38.673793 n-d-852296-2 devstack@n-api.service[129410]: WARNING oslo_db.sqlalchemy.utils [None req-1e3b78ac-f774-4d66-8ec6-a65548899e45 tempest-KeyPairsV210TestJSON-1410218000 tempest-KeyPairsV210TestJSON-1410218000-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Aug 10 17:49:38.700691 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-1e3b78ac-f774-4d66-8ec6-a65548899e45 tempest-KeyPairsV210TestJSON-1410218000 tempest-KeyPairsV210TestJSON-1410218000-project-admin] 10.222.0.50 "GET /compute/v2.1/os-keypairs?user_id=34433df58cf14fe486381128112ec644" status: 200 len: 726 microversion: 2.10 time: 0.034710 Aug 10 17:49:38.708507 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 78/177] 10.222.0.50 () {60 vars in 1259 bytes} [Wed Aug 10 17:49:38 2022] GET /compute/v2.1/os-keypairs?user_id=34433df58cf14fe486381128112ec644 => generated 726 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 17:49:38.717047 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-1f98e383-5330-4276-8b3c-ab0b62f0d9f5 tempest-KeyPairsV210TestJSON-1410218000 tempest-KeyPairsV210TestJSON-1410218000-project-admin] Calling method '.version_select at 0x7fb346a36f70>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:38.744657 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=4,nova_api:INSERT=4,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:49:38.858985 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-1f98e383-5330-4276-8b3c-ab0b62f0d9f5 tempest-KeyPairsV210TestJSON-1410218000 tempest-KeyPairsV210TestJSON-1410218000-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-455451321" status: 204 len: 0 microversion: 2.10 time: 0.145783 Aug 10 17:49:38.859806 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 79/178] 10.222.0.50 () {60 vars in 1322 bytes} [Wed Aug 10 17:49:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-455451321 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 10 17:49:38.867861 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-f8b0fa83-b12b-4984-b1cf-a95dfecd017c tempest-KeyPairsV210TestJSON-1410218000 tempest-KeyPairsV210TestJSON-1410218000-project-admin] Calling method '.version_select at 0x7fb346a36e50>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:38.990286 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-f8b0fa83-b12b-4984-b1cf-a95dfecd017c tempest-KeyPairsV210TestJSON-1410218000 tempest-KeyPairsV210TestJSON-1410218000-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1470173099?user_id=34433df58cf14fe486381128112ec644" status: 204 len: 0 microversion: 2.10 time: 0.125702 Aug 10 17:49:38.991581 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 80/179] 10.222.0.50 () {60 vars in 1343 bytes} [Wed Aug 10 17:49:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1470173099?user_id=34433df58cf14fe486381128112ec644 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 10 17:49:39.005512 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-d2f09288-ea54-4faf-abee-3ce732346117 tempest-KeyPairsV210TestJSON-1410218000 tempest-KeyPairsV210TestJSON-1410218000-project-admin] Calling method '.version_select at 0x7fb346a83700>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:39.032552 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_api:SELECT=82,nova_api:DELETE=7,nova_api:INSERT=7,nova_api:UPDATE=4 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:49:39.135890 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-d2f09288-ea54-4faf-abee-3ce732346117 tempest-KeyPairsV210TestJSON-1410218000 tempest-KeyPairsV210TestJSON-1410218000-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1778494494?user_id=34433df58cf14fe486381128112ec644" status: 204 len: 0 microversion: 2.10 time: 0.136086 Aug 10 17:49:39.141133 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 81/180] 10.222.0.50 () {60 vars in 1343 bytes} [Wed Aug 10 17:49:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1778494494?user_id=34433df58cf14fe486381128112ec644 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 10 17:49:39.168834 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-d08499b7-3b56-41a1-97fc-655c44873665 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:39.169769 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-d08499b7-3b56-41a1-97fc-655c44873665 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] [instance: 8e4a95fa-1d4a-4dca-9ba6-73a55f57d771] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:49:39.178396 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d08499b7-3b56-41a1-97fc-655c44873665 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:39.179713 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d08499b7-3b56-41a1-97fc-655c44873665 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:39.181531 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d08499b7-3b56-41a1-97fc-655c44873665 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:39.182307 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d08499b7-3b56-41a1-97fc-655c44873665 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:39.183113 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d08499b7-3b56-41a1-97fc-655c44873665 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:39.183747 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d08499b7-3b56-41a1-97fc-655c44873665 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:39.527172 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-d08499b7-3b56-41a1-97fc-655c44873665 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f242fdc47104b98882cb29c8ca5caae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b721d6dfb14d3d8780094fc4e72890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:49:39.558124 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-d08499b7-3b56-41a1-97fc-655c44873665 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] 10.222.0.50 "GET /compute/v2.1/servers/8e4a95fa-1d4a-4dca-9ba6-73a55f57d771" status: 200 len: 1320 microversion: 2.1 time: 0.390494 Aug 10 17:49:39.574222 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 82/181] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:49:39 2022] GET /compute/v2.1/servers/8e4a95fa-1d4a-4dca-9ba6-73a55f57d771 => generated 1320 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:49:39.598624 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-cac32943-1ac9-4484-9482-32e50ff6a870 tempest-QuotaClassesAdmin257Test-342022798 tempest-QuotaClassesAdmin257Test-342022798-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 1.077453 Aug 10 17:49:39.599207 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 100/182] 10.222.0.50 () {62 vars in 1247 bytes} [Wed Aug 10 17:49:38 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 17:49:39.612387 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-ed95a0dd-2fef-4908-9308-b3c6d3cc2528 tempest-QuotaClassesAdmin257Test-342022798 tempest-QuotaClassesAdmin257Test-342022798-project-admin] Calling method '.version_select at 0x7fb346a2d820>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:39.613485 n-d-852296-2 devstack@n-api.service[129410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:49:39.613485 n-d-852296-2 devstack@n-api.service[129410]: warnings.warn(msg) Aug 10 17:49:39.633190 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-ed95a0dd-2fef-4908-9308-b3c6d3cc2528 tempest-QuotaClassesAdmin257Test-342022798 tempest-QuotaClassesAdmin257Test-342022798-project-admin] 10.222.0.50 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.027269 Aug 10 17:49:39.640460 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 83/183] 10.222.0.50 () {60 vars in 1226 bytes} [Wed Aug 10 17:49:39 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 17:49:39.645510 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-b42bcc9c-f5e5-490e-b09b-e3260dae41d2 tempest-QuotaClassesAdmin257Test-342022798 tempest-QuotaClassesAdmin257Test-342022798-project-admin] Action: 'update', calling method: .version_select at 0x7fb346c21040>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:49:39.686680 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-8378377c-f8d7-4fb7-93bd-70766ac9be0c tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:39.687290 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-8378377c-f8d7-4fb7-93bd-70766ac9be0c tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] [instance: 419ed54a-a752-46bf-b399-b93ace51b625] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:49:39.694500 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-8378377c-f8d7-4fb7-93bd-70766ac9be0c tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:39.694990 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-8378377c-f8d7-4fb7-93bd-70766ac9be0c tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:39.695422 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-8378377c-f8d7-4fb7-93bd-70766ac9be0c tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:39.696166 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-8378377c-f8d7-4fb7-93bd-70766ac9be0c tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:39.697691 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-8378377c-f8d7-4fb7-93bd-70766ac9be0c tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:39.698119 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-8378377c-f8d7-4fb7-93bd-70766ac9be0c tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:40.197588 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-8378377c-f8d7-4fb7-93bd-70766ac9be0c tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd069b0c285c649b0967d0a0e3fdb24ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc21714f4484762aa8797d16cd3f70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:49:40.205952 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-8378377c-f8d7-4fb7-93bd-70766ac9be0c tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] 10.222.0.50 "GET /compute/v2.1/servers/419ed54a-a752-46bf-b399-b93ace51b625" status: 200 len: 1489 microversion: 2.1 time: 0.523161 Aug 10 17:49:40.206532 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 84/184] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:49:39 2022] GET /compute/v2.1/servers/419ed54a-a752-46bf-b399-b93ace51b625 => generated 1489 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:49:40.240139 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-c4da433f-8a1c-43d8-b644-7f7ab1394a5c tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:40.241626 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-c4da433f-8a1c-43d8-b644-7f7ab1394a5c tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] [instance: 419ed54a-a752-46bf-b399-b93ace51b625] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:49:40.248593 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-c4da433f-8a1c-43d8-b644-7f7ab1394a5c tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:40.249366 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-c4da433f-8a1c-43d8-b644-7f7ab1394a5c tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:40.249992 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-c4da433f-8a1c-43d8-b644-7f7ab1394a5c tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:40.250949 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-c4da433f-8a1c-43d8-b644-7f7ab1394a5c tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:40.251611 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-c4da433f-8a1c-43d8-b644-7f7ab1394a5c tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:40.252261 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-c4da433f-8a1c-43d8-b644-7f7ab1394a5c tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:40.771806 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-b42bcc9c-f5e5-490e-b09b-e3260dae41d2 tempest-QuotaClassesAdmin257Test-342022798 tempest-QuotaClassesAdmin257Test-342022798-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 1.129970 Aug 10 17:49:40.781293 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 101/185] 10.222.0.50 () {62 vars in 1247 bytes} [Wed Aug 10 17:49:39 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 17:49:40.787635 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-320d2cad-720f-45ac-9fed-b5dd6de1e89d tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:40.788384 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-320d2cad-720f-45ac-9fed-b5dd6de1e89d tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] [instance: 8e4a95fa-1d4a-4dca-9ba6-73a55f57d771] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:49:40.795993 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-320d2cad-720f-45ac-9fed-b5dd6de1e89d tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:40.796702 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-320d2cad-720f-45ac-9fed-b5dd6de1e89d tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:40.797320 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-320d2cad-720f-45ac-9fed-b5dd6de1e89d tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:40.798009 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-320d2cad-720f-45ac-9fed-b5dd6de1e89d tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:40.798459 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-320d2cad-720f-45ac-9fed-b5dd6de1e89d tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:40.798875 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-320d2cad-720f-45ac-9fed-b5dd6de1e89d tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:40.818618 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_cell1:SELECT=100 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:49:40.987878 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-320d2cad-720f-45ac-9fed-b5dd6de1e89d tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f242fdc47104b98882cb29c8ca5caae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b721d6dfb14d3d8780094fc4e72890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:49:40.999824 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-320d2cad-720f-45ac-9fed-b5dd6de1e89d tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] 10.222.0.50 "GET /compute/v2.1/servers/8e4a95fa-1d4a-4dca-9ba6-73a55f57d771" status: 200 len: 1470 microversion: 2.1 time: 0.216239 Aug 10 17:49:41.013218 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 102/186] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:49:40 2022] GET /compute/v2.1/servers/8e4a95fa-1d4a-4dca-9ba6-73a55f57d771 => generated 1470 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:49:41.148319 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-c4da433f-8a1c-43d8-b644-7f7ab1394a5c tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/419ed54a-a752-46bf-b399-b93ace51b625" status: 200 len: 1640 microversion: 2.1 time: 0.914276 Aug 10 17:49:41.164496 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 85/187] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:49:40 2022] GET /compute/v2.1/servers/419ed54a-a752-46bf-b399-b93ace51b625 => generated 1640 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:49:41.170604 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-e2708af2-b193-4078-a4e5-a9df09e8dbc5 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:41.171269 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-e2708af2-b193-4078-a4e5-a9df09e8dbc5 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] [instance: 419ed54a-a752-46bf-b399-b93ace51b625] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:49:41.177411 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e2708af2-b193-4078-a4e5-a9df09e8dbc5 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:41.178000 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e2708af2-b193-4078-a4e5-a9df09e8dbc5 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:41.178444 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e2708af2-b193-4078-a4e5-a9df09e8dbc5 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:41.179140 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e2708af2-b193-4078-a4e5-a9df09e8dbc5 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:41.179573 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e2708af2-b193-4078-a4e5-a9df09e8dbc5 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:41.180032 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e2708af2-b193-4078-a4e5-a9df09e8dbc5 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:41.210676 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-e2708af2-b193-4078-a4e5-a9df09e8dbc5 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] [instance: 419ed54a-a752-46bf-b399-b93ace51b625] Going to try to terminate instance {{(pid=129410) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 17:49:41.606135 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:49:41.984747 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-3d1a71c1-3ea2-409c-8a12-47a0dc1a56ca tempest-DeleteServersAdminTestJSON-841828601 tempest-DeleteServersAdminTestJSON-841828601-project-admin] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:41.985896 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-3d1a71c1-3ea2-409c-8a12-47a0dc1a56ca tempest-DeleteServersAdminTestJSON-841828601 tempest-DeleteServersAdminTestJSON-841828601-project-admin] [instance: 8e4a95fa-1d4a-4dca-9ba6-73a55f57d771] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:49:41.996867 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-3d1a71c1-3ea2-409c-8a12-47a0dc1a56ca tempest-DeleteServersAdminTestJSON-841828601 tempest-DeleteServersAdminTestJSON-841828601-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:41.997938 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-3d1a71c1-3ea2-409c-8a12-47a0dc1a56ca tempest-DeleteServersAdminTestJSON-841828601 tempest-DeleteServersAdminTestJSON-841828601-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:41.998734 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-3d1a71c1-3ea2-409c-8a12-47a0dc1a56ca tempest-DeleteServersAdminTestJSON-841828601 tempest-DeleteServersAdminTestJSON-841828601-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:41.999731 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-3d1a71c1-3ea2-409c-8a12-47a0dc1a56ca tempest-DeleteServersAdminTestJSON-841828601 tempest-DeleteServersAdminTestJSON-841828601-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:42.000648 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-3d1a71c1-3ea2-409c-8a12-47a0dc1a56ca tempest-DeleteServersAdminTestJSON-841828601 tempest-DeleteServersAdminTestJSON-841828601-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:42.001365 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-3d1a71c1-3ea2-409c-8a12-47a0dc1a56ca tempest-DeleteServersAdminTestJSON-841828601 tempest-DeleteServersAdminTestJSON-841828601-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:42.065929 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-e2708af2-b193-4078-a4e5-a9df09e8dbc5 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] 10.222.0.50 "DELETE /compute/v2.1/servers/419ed54a-a752-46bf-b399-b93ace51b625" status: 204 len: 0 microversion: 2.1 time: 0.898879 Aug 10 17:49:42.066706 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 86/188] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 10 17:49:41 2022] DELETE /compute/v2.1/servers/419ed54a-a752-46bf-b399-b93ace51b625 => generated 0 bytes in 900 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 10 17:49:42.075696 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-3b5c48e7-776f-4d59-a396-567c6cf59c66 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:42.076370 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-3b5c48e7-776f-4d59-a396-567c6cf59c66 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] [instance: 419ed54a-a752-46bf-b399-b93ace51b625] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:49:42.087922 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-3d1a71c1-3ea2-409c-8a12-47a0dc1a56ca tempest-DeleteServersAdminTestJSON-841828601 tempest-DeleteServersAdminTestJSON-841828601-project-admin] [instance: 8e4a95fa-1d4a-4dca-9ba6-73a55f57d771] Going to try to terminate instance {{(pid=129409) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 17:49:42.088988 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-3b5c48e7-776f-4d59-a396-567c6cf59c66 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:42.090689 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-3b5c48e7-776f-4d59-a396-567c6cf59c66 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:42.091138 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-3b5c48e7-776f-4d59-a396-567c6cf59c66 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:42.091851 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-3b5c48e7-776f-4d59-a396-567c6cf59c66 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:42.092404 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-3b5c48e7-776f-4d59-a396-567c6cf59c66 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:42.092784 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-3b5c48e7-776f-4d59-a396-567c6cf59c66 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:42.623974 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-3b5c48e7-776f-4d59-a396-567c6cf59c66 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd069b0c285c649b0967d0a0e3fdb24ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc21714f4484762aa8797d16cd3f70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:49:42.632419 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-3b5c48e7-776f-4d59-a396-567c6cf59c66 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] 10.222.0.50 "GET /compute/v2.1/servers/419ed54a-a752-46bf-b399-b93ace51b625" status: 200 len: 1495 microversion: 2.1 time: 0.561435 Aug 10 17:49:42.648863 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 87/189] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:49:42 2022] GET /compute/v2.1/servers/419ed54a-a752-46bf-b399-b93ace51b625 => generated 1495 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:49:43.055573 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-3d1a71c1-3ea2-409c-8a12-47a0dc1a56ca tempest-DeleteServersAdminTestJSON-841828601 tempest-DeleteServersAdminTestJSON-841828601-project-admin] 10.222.0.50 "DELETE /compute/v2.1/servers/8e4a95fa-1d4a-4dca-9ba6-73a55f57d771" status: 204 len: 0 microversion: 2.1 time: 2.037439 Aug 10 17:49:43.057044 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 103/190] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 10 17:49:41 2022] DELETE /compute/v2.1/servers/8e4a95fa-1d4a-4dca-9ba6-73a55f57d771 => generated 0 bytes in 2040 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 10 17:49:43.066676 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-751d2b7d-ef22-4c51-acd0-40894d51a370 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:43.067707 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-751d2b7d-ef22-4c51-acd0-40894d51a370 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] [instance: 8e4a95fa-1d4a-4dca-9ba6-73a55f57d771] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:49:43.076862 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-751d2b7d-ef22-4c51-acd0-40894d51a370 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:43.078364 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-751d2b7d-ef22-4c51-acd0-40894d51a370 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:43.084144 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-751d2b7d-ef22-4c51-acd0-40894d51a370 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:43.087616 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-751d2b7d-ef22-4c51-acd0-40894d51a370 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:43.088888 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-751d2b7d-ef22-4c51-acd0-40894d51a370 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:43.089563 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-751d2b7d-ef22-4c51-acd0-40894d51a370 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:43.255928 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-751d2b7d-ef22-4c51-acd0-40894d51a370 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f242fdc47104b98882cb29c8ca5caae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b721d6dfb14d3d8780094fc4e72890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:49:43.263881 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-751d2b7d-ef22-4c51-acd0-40894d51a370 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] 10.222.0.50 "GET /compute/v2.1/servers/8e4a95fa-1d4a-4dca-9ba6-73a55f57d771" status: 200 len: 1476 microversion: 2.1 time: 0.202396 Aug 10 17:49:43.264571 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 88/191] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:49:43 2022] GET /compute/v2.1/servers/8e4a95fa-1d4a-4dca-9ba6-73a55f57d771 => generated 1476 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:49:43.655587 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-da810031-dc07-4c7f-a9c3-de8522530938 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:43.656484 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-da810031-dc07-4c7f-a9c3-de8522530938 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] [instance: 419ed54a-a752-46bf-b399-b93ace51b625] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:49:43.663782 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-da810031-dc07-4c7f-a9c3-de8522530938 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:43.664539 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-da810031-dc07-4c7f-a9c3-de8522530938 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:43.668786 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-da810031-dc07-4c7f-a9c3-de8522530938 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:43.672354 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-da810031-dc07-4c7f-a9c3-de8522530938 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:43.676974 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-da810031-dc07-4c7f-a9c3-de8522530938 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:43.677422 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-da810031-dc07-4c7f-a9c3-de8522530938 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:44.159844 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-da810031-dc07-4c7f-a9c3-de8522530938 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd069b0c285c649b0967d0a0e3fdb24ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc21714f4484762aa8797d16cd3f70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:49:44.175033 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-da810031-dc07-4c7f-a9c3-de8522530938 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] 10.222.0.50 "GET /compute/v2.1/servers/419ed54a-a752-46bf-b399-b93ace51b625" status: 200 len: 1495 microversion: 2.1 time: 0.523524 Aug 10 17:49:44.176963 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 104/192] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:49:43 2022] GET /compute/v2.1/servers/419ed54a-a752-46bf-b399-b93ace51b625 => generated 1495 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:49:44.285370 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-b96dd288-c009-4c73-9120-3480926967d6 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:44.287366 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-b96dd288-c009-4c73-9120-3480926967d6 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] [instance: 8e4a95fa-1d4a-4dca-9ba6-73a55f57d771] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:49:44.295307 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b96dd288-c009-4c73-9120-3480926967d6 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:44.295890 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b96dd288-c009-4c73-9120-3480926967d6 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:44.296349 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b96dd288-c009-4c73-9120-3480926967d6 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:44.297215 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b96dd288-c009-4c73-9120-3480926967d6 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:44.297814 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b96dd288-c009-4c73-9120-3480926967d6 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:44.298591 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b96dd288-c009-4c73-9120-3480926967d6 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:44.638785 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-b96dd288-c009-4c73-9120-3480926967d6 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f242fdc47104b98882cb29c8ca5caae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b721d6dfb14d3d8780094fc4e72890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:49:44.647803 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-b96dd288-c009-4c73-9120-3480926967d6 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] 10.222.0.50 "GET /compute/v2.1/servers/8e4a95fa-1d4a-4dca-9ba6-73a55f57d771" status: 200 len: 1476 microversion: 2.1 time: 0.366770 Aug 10 17:49:44.648417 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 89/193] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:49:44 2022] GET /compute/v2.1/servers/8e4a95fa-1d4a-4dca-9ba6-73a55f57d771 => generated 1476 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:49:44.833743 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [req-fe6737a7-c726-467d-890e-e52891841cec req-38c6a3fc-d9f9-4bb0-a52f-8bfaa21ca7c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "419ed54a-a752-46bf-b399-b93ace51b625", "name": "network-vif-deleted", "tag": "4ff3b60c-7a85-4f60-95b2-b4bb72e21d10"}]} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:49:44.866306 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-fe6737a7-c726-467d-890e-e52891841cec req-38c6a3fc-d9f9-4bb0-a52f-8bfaa21ca7c7 service nova] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:44.867545 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-fe6737a7-c726-467d-890e-e52891841cec req-38c6a3fc-d9f9-4bb0-a52f-8bfaa21ca7c7 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:44.869875 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-fe6737a7-c726-467d-890e-e52891841cec req-38c6a3fc-d9f9-4bb0-a52f-8bfaa21ca7c7 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:44.931750 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.compute.server_external_events [req-fe6737a7-c726-467d-890e-e52891841cec req-38c6a3fc-d9f9-4bb0-a52f-8bfaa21ca7c7 service nova] Creating event network-vif-deleted:4ff3b60c-7a85-4f60-95b2-b4bb72e21d10 for instance 419ed54a-a752-46bf-b399-b93ace51b625 on n-h2-852296-2 Aug 10 17:49:44.949629 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [req-fe6737a7-c726-467d-890e-e52891841cec req-38c6a3fc-d9f9-4bb0-a52f-8bfaa21ca7c7 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119413 Aug 10 17:49:44.953238 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 105/194] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 10 17:49:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:49:45.203058 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-e74662a3-19f7-4f7c-8709-a07051bbf016 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:45.203683 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-e74662a3-19f7-4f7c-8709-a07051bbf016 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] [instance: 419ed54a-a752-46bf-b399-b93ace51b625] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:49:45.214092 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e74662a3-19f7-4f7c-8709-a07051bbf016 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:45.219651 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e74662a3-19f7-4f7c-8709-a07051bbf016 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:45.222601 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e74662a3-19f7-4f7c-8709-a07051bbf016 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:45.225983 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e74662a3-19f7-4f7c-8709-a07051bbf016 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:45.231067 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e74662a3-19f7-4f7c-8709-a07051bbf016 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:45.235468 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e74662a3-19f7-4f7c-8709-a07051bbf016 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:45.432945 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-e74662a3-19f7-4f7c-8709-a07051bbf016 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd069b0c285c649b0967d0a0e3fdb24ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc21714f4484762aa8797d16cd3f70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:49:45.447245 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-e74662a3-19f7-4f7c-8709-a07051bbf016 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] 10.222.0.50 "GET /compute/v2.1/servers/419ed54a-a752-46bf-b399-b93ace51b625" status: 200 len: 1324 microversion: 2.1 time: 0.247743 Aug 10 17:49:45.449226 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 90/195] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:49:45 2022] GET /compute/v2.1/servers/419ed54a-a752-46bf-b399-b93ace51b625 => generated 1324 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:49:45.670069 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-811a71b9-6e3d-4be5-9b18-cb86a1491d4b tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:45.670764 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-811a71b9-6e3d-4be5-9b18-cb86a1491d4b tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] [instance: 8e4a95fa-1d4a-4dca-9ba6-73a55f57d771] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:49:45.679419 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-811a71b9-6e3d-4be5-9b18-cb86a1491d4b tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:45.679914 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-811a71b9-6e3d-4be5-9b18-cb86a1491d4b tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:45.690889 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-811a71b9-6e3d-4be5-9b18-cb86a1491d4b tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:45.690889 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-811a71b9-6e3d-4be5-9b18-cb86a1491d4b tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:45.690889 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-811a71b9-6e3d-4be5-9b18-cb86a1491d4b tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:45.690889 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-811a71b9-6e3d-4be5-9b18-cb86a1491d4b tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:45.985072 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-811a71b9-6e3d-4be5-9b18-cb86a1491d4b tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f242fdc47104b98882cb29c8ca5caae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b721d6dfb14d3d8780094fc4e72890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:49:45.994748 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-811a71b9-6e3d-4be5-9b18-cb86a1491d4b tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] 10.222.0.50 "GET /compute/v2.1/servers/8e4a95fa-1d4a-4dca-9ba6-73a55f57d771" status: 200 len: 1476 microversion: 2.1 time: 0.329157 Aug 10 17:49:45.995394 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 106/196] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:49:45 2022] GET /compute/v2.1/servers/8e4a95fa-1d4a-4dca-9ba6-73a55f57d771 => generated 1476 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:49:46.471667 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-b51e3e18-7769-4d45-82dd-64d1b2cc80e6 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:46.472427 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-b51e3e18-7769-4d45-82dd-64d1b2cc80e6 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] [instance: 419ed54a-a752-46bf-b399-b93ace51b625] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:49:46.481881 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-b51e3e18-7769-4d45-82dd-64d1b2cc80e6 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:46.491853 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-b51e3e18-7769-4d45-82dd-64d1b2cc80e6 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:46.494121 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-b51e3e18-7769-4d45-82dd-64d1b2cc80e6 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:46.494894 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-b51e3e18-7769-4d45-82dd-64d1b2cc80e6 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:46.496086 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-87d8bb12-4e2f-4758-a998-5d042f210146 tempest-ServicesAdminTestJSON-1729119187 tempest-ServicesAdminTestJSON-1729119187-project-admin] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:46.498701 n-d-852296-2 devstack@n-api.service[129410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:49:46.498701 n-d-852296-2 devstack@n-api.service[129410]: warnings.warn(msg) Aug 10 17:49:46.499841 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-87d8bb12-4e2f-4758-a998-5d042f210146 tempest-ServicesAdminTestJSON-1729119187 tempest-ServicesAdminTestJSON-1729119187-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:46.500386 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-87d8bb12-4e2f-4758-a998-5d042f210146 tempest-ServicesAdminTestJSON-1729119187 tempest-ServicesAdminTestJSON-1729119187-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:46.500824 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-87d8bb12-4e2f-4758-a998-5d042f210146 tempest-ServicesAdminTestJSON-1729119187 tempest-ServicesAdminTestJSON-1729119187-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:46.501869 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-b51e3e18-7769-4d45-82dd-64d1b2cc80e6 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:46.502328 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-b51e3e18-7769-4d45-82dd-64d1b2cc80e6 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:46.503781 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-87d8bb12-4e2f-4758-a998-5d042f210146 tempest-ServicesAdminTestJSON-1729119187 tempest-ServicesAdminTestJSON-1729119187-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:46.504154 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-87d8bb12-4e2f-4758-a998-5d042f210146 tempest-ServicesAdminTestJSON-1729119187 tempest-ServicesAdminTestJSON-1729119187-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:46.509169 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-87d8bb12-4e2f-4758-a998-5d042f210146 tempest-ServicesAdminTestJSON-1729119187 tempest-ServicesAdminTestJSON-1729119187-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:46.602639 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-87d8bb12-4e2f-4758-a998-5d042f210146 tempest-ServicesAdminTestJSON-1729119187 tempest-ServicesAdminTestJSON-1729119187-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services" status: 200 len: 966 microversion: 2.1 time: 0.569567 Aug 10 17:49:46.604060 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-b51e3e18-7769-4d45-82dd-64d1b2cc80e6 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:46.604791 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-b51e3e18-7769-4d45-82dd-64d1b2cc80e6 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:46.605428 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-b51e3e18-7769-4d45-82dd-64d1b2cc80e6 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:46.606094 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.objects.instance [None req-b51e3e18-7769-4d45-82dd-64d1b2cc80e6 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lazy-loading 'fault' on Instance uuid 419ed54a-a752-46bf-b399-b93ace51b625 {{(pid=129409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:49:46.608810 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 91/197] 10.222.0.50 () {58 vars in 1137 bytes} [Wed Aug 10 17:49:46 2022] GET /compute/v2.1/os-services => generated 966 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:49:46.622300 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-aba61e28-2ec7-42ac-bd6a-c216864908b8 tempest-ServicesAdminTestJSON-1729119187 tempest-ServicesAdminTestJSON-1729119187-project-admin] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:46.625350 n-d-852296-2 devstack@n-api.service[129410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:49:46.625350 n-d-852296-2 devstack@n-api.service[129410]: warnings.warn(msg) Aug 10 17:49:46.632794 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-aba61e28-2ec7-42ac-bd6a-c216864908b8 tempest-ServicesAdminTestJSON-1729119187 tempest-ServicesAdminTestJSON-1729119187-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:46.636538 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-aba61e28-2ec7-42ac-bd6a-c216864908b8 tempest-ServicesAdminTestJSON-1729119187 tempest-ServicesAdminTestJSON-1729119187-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:46.637147 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-aba61e28-2ec7-42ac-bd6a-c216864908b8 tempest-ServicesAdminTestJSON-1729119187 tempest-ServicesAdminTestJSON-1729119187-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:46.638162 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-aba61e28-2ec7-42ac-bd6a-c216864908b8 tempest-ServicesAdminTestJSON-1729119187 tempest-ServicesAdminTestJSON-1729119187-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:46.644004 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-aba61e28-2ec7-42ac-bd6a-c216864908b8 tempest-ServicesAdminTestJSON-1729119187 tempest-ServicesAdminTestJSON-1729119187-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:46.650758 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-aba61e28-2ec7-42ac-bd6a-c216864908b8 tempest-ServicesAdminTestJSON-1729119187 tempest-ServicesAdminTestJSON-1729119187-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:46.694115 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-aba61e28-2ec7-42ac-bd6a-c216864908b8 tempest-ServicesAdminTestJSON-1729119187 tempest-ServicesAdminTestJSON-1729119187-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services?host=n-d-852296-2" status: 200 len: 578 microversion: 2.1 time: 0.083953 Aug 10 17:49:46.703887 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 92/198] 10.222.0.50 () {58 vars in 1172 bytes} [Wed Aug 10 17:49:46 2022] GET /compute/v2.1/os-services?host=n-d-852296-2 => generated 578 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:49:46.714733 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-47fb2b52-701b-4325-8a01-e4e67856d662 tempest-ServicesAdminTestJSON-1729119187 tempest-ServicesAdminTestJSON-1729119187-project-admin] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:46.714733 n-d-852296-2 devstack@n-api.service[129410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:49:46.714733 n-d-852296-2 devstack@n-api.service[129410]: warnings.warn(msg) Aug 10 17:49:46.715021 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-b51e3e18-7769-4d45-82dd-64d1b2cc80e6 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd069b0c285c649b0967d0a0e3fdb24ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc21714f4484762aa8797d16cd3f70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:49:46.715458 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-47fb2b52-701b-4325-8a01-e4e67856d662 tempest-ServicesAdminTestJSON-1729119187 tempest-ServicesAdminTestJSON-1729119187-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:46.715458 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-47fb2b52-701b-4325-8a01-e4e67856d662 tempest-ServicesAdminTestJSON-1729119187 tempest-ServicesAdminTestJSON-1729119187-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:46.715458 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-47fb2b52-701b-4325-8a01-e4e67856d662 tempest-ServicesAdminTestJSON-1729119187 tempest-ServicesAdminTestJSON-1729119187-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:46.715707 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-47fb2b52-701b-4325-8a01-e4e67856d662 tempest-ServicesAdminTestJSON-1729119187 tempest-ServicesAdminTestJSON-1729119187-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:46.715948 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-47fb2b52-701b-4325-8a01-e4e67856d662 tempest-ServicesAdminTestJSON-1729119187 tempest-ServicesAdminTestJSON-1729119187-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:46.718210 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-47fb2b52-701b-4325-8a01-e4e67856d662 tempest-ServicesAdminTestJSON-1729119187 tempest-ServicesAdminTestJSON-1729119187-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:46.725836 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-b51e3e18-7769-4d45-82dd-64d1b2cc80e6 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] 10.222.0.50 "GET /compute/v2.1/servers/419ed54a-a752-46bf-b399-b93ace51b625" status: 200 len: 1329 microversion: 2.1 time: 0.257285 Aug 10 17:49:46.726553 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 107/199] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:49:46 2022] GET /compute/v2.1/servers/419ed54a-a752-46bf-b399-b93ace51b625 => generated 1329 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:49:46.766172 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-47fb2b52-701b-4325-8a01-e4e67856d662 tempest-ServicesAdminTestJSON-1729119187 tempest-ServicesAdminTestJSON-1729119187-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 402 microversion: 2.1 time: 0.060676 Aug 10 17:49:46.770046 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 93/200] 10.222.0.50 () {58 vars in 1176 bytes} [Wed Aug 10 17:49:46 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 402 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:49:46.780581 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-8eccedda-a540-4b08-8dc2-6ff89e89ac9e tempest-ServicesAdminTestJSON-1729119187 tempest-ServicesAdminTestJSON-1729119187-project-admin] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:46.783494 n-d-852296-2 devstack@n-api.service[129409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:49:46.783494 n-d-852296-2 devstack@n-api.service[129409]: warnings.warn(msg) Aug 10 17:49:46.787158 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-8eccedda-a540-4b08-8dc2-6ff89e89ac9e tempest-ServicesAdminTestJSON-1729119187 tempest-ServicesAdminTestJSON-1729119187-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:46.787712 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-8eccedda-a540-4b08-8dc2-6ff89e89ac9e tempest-ServicesAdminTestJSON-1729119187 tempest-ServicesAdminTestJSON-1729119187-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:46.797200 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-8eccedda-a540-4b08-8dc2-6ff89e89ac9e tempest-ServicesAdminTestJSON-1729119187 tempest-ServicesAdminTestJSON-1729119187-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:46.797200 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-8eccedda-a540-4b08-8dc2-6ff89e89ac9e tempest-ServicesAdminTestJSON-1729119187 tempest-ServicesAdminTestJSON-1729119187-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:46.797200 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-8eccedda-a540-4b08-8dc2-6ff89e89ac9e tempest-ServicesAdminTestJSON-1729119187 tempest-ServicesAdminTestJSON-1729119187-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:46.797200 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-8eccedda-a540-4b08-8dc2-6ff89e89ac9e tempest-ServicesAdminTestJSON-1729119187 tempest-ServicesAdminTestJSON-1729119187-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:46.846182 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-8eccedda-a540-4b08-8dc2-6ff89e89ac9e tempest-ServicesAdminTestJSON-1729119187 tempest-ServicesAdminTestJSON-1729119187-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services" status: 200 len: 966 microversion: 2.1 time: 0.067027 Aug 10 17:49:46.846182 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 108/201] 10.222.0.50 () {58 vars in 1137 bytes} [Wed Aug 10 17:49:46 2022] GET /compute/v2.1/os-services => generated 966 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:49:47.015809 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-49792983-b78b-4619-a2a2-143741f288dd tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:47.016481 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-49792983-b78b-4619-a2a2-143741f288dd tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] [instance: 8e4a95fa-1d4a-4dca-9ba6-73a55f57d771] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:49:47.022842 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-49792983-b78b-4619-a2a2-143741f288dd tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:47.025313 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-49792983-b78b-4619-a2a2-143741f288dd tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:47.025966 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-49792983-b78b-4619-a2a2-143741f288dd tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:47.027334 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-49792983-b78b-4619-a2a2-143741f288dd tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:47.031111 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-49792983-b78b-4619-a2a2-143741f288dd tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:47.031739 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-49792983-b78b-4619-a2a2-143741f288dd tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:47.175090 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-49792983-b78b-4619-a2a2-143741f288dd tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f242fdc47104b98882cb29c8ca5caae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b721d6dfb14d3d8780094fc4e72890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:49:47.175090 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-49792983-b78b-4619-a2a2-143741f288dd tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] 10.222.0.50 "GET /compute/v2.1/servers/8e4a95fa-1d4a-4dca-9ba6-73a55f57d771" status: 200 len: 1434 microversion: 2.1 time: 0.149247 Aug 10 17:49:47.175090 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 94/202] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:49:47 2022] GET /compute/v2.1/servers/8e4a95fa-1d4a-4dca-9ba6-73a55f57d771 => generated 1434 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:49:47.199986 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [req-42ac735a-9c48-4d9c-b7e9-bbe30795cddf req-0596d710-8ac1-4aad-a2fa-5313041d9d85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e4a95fa-1d4a-4dca-9ba6-73a55f57d771", "name": "network-vif-deleted", "tag": "18e16820-18a5-43c6-bacc-f7df72695ae4"}]} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:49:47.218283 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-42ac735a-9c48-4d9c-b7e9-bbe30795cddf req-0596d710-8ac1-4aad-a2fa-5313041d9d85 service nova] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:47.218283 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-42ac735a-9c48-4d9c-b7e9-bbe30795cddf req-0596d710-8ac1-4aad-a2fa-5313041d9d85 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:47.219436 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-42ac735a-9c48-4d9c-b7e9-bbe30795cddf req-0596d710-8ac1-4aad-a2fa-5313041d9d85 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:47.238137 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.compute.server_external_events [req-42ac735a-9c48-4d9c-b7e9-bbe30795cddf req-0596d710-8ac1-4aad-a2fa-5313041d9d85 service nova] Creating event network-vif-deleted:18e16820-18a5-43c6-bacc-f7df72695ae4 for instance 8e4a95fa-1d4a-4dca-9ba6-73a55f57d771 on n-h1-852296-2 Aug 10 17:49:47.245499 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [req-42ac735a-9c48-4d9c-b7e9-bbe30795cddf req-0596d710-8ac1-4aad-a2fa-5313041d9d85 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050700 Aug 10 17:49:47.246395 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 109/203] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 10 17:49:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:49:47.748305 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-1025c33a-5dbd-4cb0-a4e8-46e061cc58c2 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:47.749490 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-1025c33a-5dbd-4cb0-a4e8-46e061cc58c2 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] [instance: 419ed54a-a752-46bf-b399-b93ace51b625] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:49:47.761771 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-1025c33a-5dbd-4cb0-a4e8-46e061cc58c2 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:47.761771 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-1025c33a-5dbd-4cb0-a4e8-46e061cc58c2 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:47.761771 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-1025c33a-5dbd-4cb0-a4e8-46e061cc58c2 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:47.761771 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-1025c33a-5dbd-4cb0-a4e8-46e061cc58c2 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:47.762031 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-1025c33a-5dbd-4cb0-a4e8-46e061cc58c2 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:47.762031 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-1025c33a-5dbd-4cb0-a4e8-46e061cc58c2 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:47.772396 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-1025c33a-5dbd-4cb0-a4e8-46e061cc58c2 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] HTTP exception thrown: Instance 419ed54a-a752-46bf-b399-b93ace51b625 could not be found. Aug 10 17:49:47.778255 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-1025c33a-5dbd-4cb0-a4e8-46e061cc58c2 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Request method failure captured: Aug 10 17:49:47.778255 n-d-852296-2 devstack@n-api.service[129410]: request: GET /compute/v2.1/servers/419ed54a-a752-46bf-b399-b93ace51b625 HTTP/1.1 Aug 10 17:49:47.778255 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 17:49:47.778255 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 17:49:47.778255 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 17:49:47.778255 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 0 Aug 10 17:49:47.778255 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 17:49:47.778255 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 17:49:47.778255 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 17:49:47.778255 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 17:49:47.778255 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8--C1WLKSpAzCQq_ZVF31VRa8CFFECW_tCOqDA0zpb6eyfERe0CHGjLDZE2S8svcm6xoIKSiOdtgetdSRN-UfnSUgjYI8XUg8u1ZK760QqchH7eKQR8SxEJ2FksHFZQBki2FvdVn5BdCFF1kX5LwkBDDk666fIRi1p7elQYdzlDAE2k Aug 10 17:49:47.778255 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 17:49:47.778255 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 17:49:47.778255 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 17:49:47.778255 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 17:49:47.778255 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 17:49:47.778255 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 17:49:47.778255 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: dcc21714f4484762aa8797d16cd3f70b Aug 10 17:49:47.778255 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-AggregatesAdminTestJSON-1989475572 Aug 10 17:49:47.778255 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 17:49:47.778255 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 17:49:47.779718 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/dcc21714f4484762aa8797d16cd3f70b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/dcc21714f4484762aa8797d16cd3f70b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/dcc21714f4484762aa8797d16cd3f70b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_dcc21714f4484762aa8797d16cd3f70b", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:49:47.779718 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-AggregatesAdminTestJSON-1989475572 Aug 10 17:49:47.779718 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: dcc21714f4484762aa8797d16cd3f70b Aug 10 17:49:47.779718 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1989475572 Aug 10 17:49:47.779718 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-AggregatesAdminTestJSON-1989475572-project Aug 10 17:49:47.779718 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 17:49:47.779718 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 17:49:47.779718 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: d069b0c285c649b0967d0a0e3fdb24ee Aug 10 17:49:47.779718 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-AggregatesAdminTestJSON-1989475572-project Aug 10 17:49:47.779718 n-d-852296-2 devstack@n-api.service[129410]: method: > Aug 10 17:49:47.779718 n-d-852296-2 devstack@n-api.service[129410]: exception: Instance 419ed54a-a752-46bf-b399-b93ace51b625 could not be found. Aug 10 17:49:47.779718 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'id': '419ed54a-a752-46bf-b399-b93ace51b625'} Aug 10 17:49:47.780541 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:49:47.780541 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:49:47.780541 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 17:49:47.780541 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 17:49:47.780541 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 17:49:47.780541 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 17:49:47.780541 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 17:49:47.780541 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 17:49:47.780541 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 17:49:47.780541 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 17:49:47.780541 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 419ed54a-a752-46bf-b399-b93ace51b625 could not be found. Aug 10 17:49:47.780541 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:49:47.780541 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:49:47.780541 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:49:47.780541 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:49:47.780541 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:49:47.780541 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:49:47.780541 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:49:47.780541 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:49:47.780541 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:49:47.781831 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:49:47.781831 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 17:49:47.781831 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 17:49:47.781831 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 17:49:47.781831 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 17:49:47.781831 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 17:49:47.781831 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:49:47.781831 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 419ed54a-a752-46bf-b399-b93ace51b625 could not be found. Aug 10 17:49:47.781831 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:49:47.781831 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:49:47.781831 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:49:47.781831 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:49:47.781831 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:49:47.781831 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:49:47.781831 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:49:47.781831 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:49:47.781831 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 419ed54a-a752-46bf-b399-b93ace51b625 could not be found. Aug 10 17:49:47.781831 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:49:47.782982 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-1025c33a-5dbd-4cb0-a4e8-46e061cc58c2 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Returning 404 to user: Instance 419ed54a-a752-46bf-b399-b93ace51b625 could not be found. {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:49:47.784296 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-1025c33a-5dbd-4cb0-a4e8-46e061cc58c2 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] 10.222.0.50 "GET /compute/v2.1/servers/419ed54a-a752-46bf-b399-b93ace51b625" status: 404 len: 111 microversion: 2.1 time: 0.039334 Aug 10 17:49:47.785907 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 95/204] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:49:47 2022] GET /compute/v2.1/servers/419ed54a-a752-46bf-b399-b93ace51b625 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:49:47.795946 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-c39d58fc-d381-4171-8b6c-7bc8c67f5b98 tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-852296-2"}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:49:47.799657 n-d-852296-2 devstack@n-api.service[129409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:49:47.799657 n-d-852296-2 devstack@n-api.service[129409]: warnings.warn(msg) Aug 10 17:49:47.826568 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c39d58fc-d381-4171-8b6c-7bc8c67f5b98 tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:47.827160 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c39d58fc-d381-4171-8b6c-7bc8c67f5b98 tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:47.827664 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c39d58fc-d381-4171-8b6c-7bc8c67f5b98 tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:48.185297 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-c60813ec-da73-4cf8-84a1-bc6bf1700da7 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:48.185899 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-c60813ec-da73-4cf8-84a1-bc6bf1700da7 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] [instance: 8e4a95fa-1d4a-4dca-9ba6-73a55f57d771] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:49:48.194360 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-c60813ec-da73-4cf8-84a1-bc6bf1700da7 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:48.194863 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-c60813ec-da73-4cf8-84a1-bc6bf1700da7 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:48.195387 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-c60813ec-da73-4cf8-84a1-bc6bf1700da7 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:48.196263 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-c60813ec-da73-4cf8-84a1-bc6bf1700da7 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:48.197509 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-c60813ec-da73-4cf8-84a1-bc6bf1700da7 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:48.198728 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-c60813ec-da73-4cf8-84a1-bc6bf1700da7 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:48.244159 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-c60813ec-da73-4cf8-84a1-bc6bf1700da7 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:48.244894 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-c60813ec-da73-4cf8-84a1-bc6bf1700da7 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:48.245480 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-c60813ec-da73-4cf8-84a1-bc6bf1700da7 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:48.246076 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.objects.instance [None req-c60813ec-da73-4cf8-84a1-bc6bf1700da7 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lazy-loading 'fault' on Instance uuid 8e4a95fa-1d4a-4dca-9ba6-73a55f57d771 {{(pid=129410) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:49:48.317762 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-c60813ec-da73-4cf8-84a1-bc6bf1700da7 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f242fdc47104b98882cb29c8ca5caae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b721d6dfb14d3d8780094fc4e72890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:49:48.329034 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-c60813ec-da73-4cf8-84a1-bc6bf1700da7 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] 10.222.0.50 "GET /compute/v2.1/servers/8e4a95fa-1d4a-4dca-9ba6-73a55f57d771" status: 200 len: 1310 microversion: 2.1 time: 0.148897 Aug 10 17:49:48.332184 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 96/205] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:49:48 2022] GET /compute/v2.1/servers/8e4a95fa-1d4a-4dca-9ba6-73a55f57d771 => generated 1310 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:49:48.442305 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-c39d58fc-d381-4171-8b6c-7bc8c67f5b98 tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 300 microversion: 2.1 time: 0.650989 Aug 10 17:49:48.451698 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 110/206] 10.222.0.50 () {60 vars in 1191 bytes} [Wed Aug 10 17:49:47 2022] POST /compute/v2.1/os-aggregates/2/action => generated 300 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:49:48.457416 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-e11406c2-86f3-4373-bd37-49081d07fe79 tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:48.458333 n-d-852296-2 devstack@n-api.service[129409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:49:48.458333 n-d-852296-2 devstack@n-api.service[129409]: warnings.warn(msg) Aug 10 17:49:48.576105 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-e11406c2-86f3-4373-bd37-49081d07fe79 tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.122397 Aug 10 17:49:48.576905 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 111/207] 10.222.0.50 () {58 vars in 1152 bytes} [Wed Aug 10 17:49:48 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 10 17:49:48.594924 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-e6a6c5df-4fd9-41df-8c6a-317ea80975ef tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1033128810"}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:49:48.598782 n-d-852296-2 devstack@n-api.service[129409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:49:48.598782 n-d-852296-2 devstack@n-api.service[129409]: warnings.warn(msg) Aug 10 17:49:48.600527 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.objects.aggregate [None req-e6a6c5df-4fd9-41df-8c6a-317ea80975ef tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] Generated uuid a621b0da-2a7a-4541-ad1f-7b5a05164b41 for aggregate {{(pid=129409) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 10 17:49:48.612308 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-6aa94ce8-de26-4ca1-a57e-fc00c18ab39f tempest-LiveAutoBlockMigrationV225Test-1294760569 tempest-LiveAutoBlockMigrationV225Test-1294760569-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1085263694", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "65f0edf1-6c38-4348-ba86-cccd27e183bd"}]}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:49:48.745378 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-e6a6c5df-4fd9-41df-8c6a-317ea80975ef tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.155041 Aug 10 17:49:48.751683 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 112/208] 10.222.0.50 () {60 vars in 1164 bytes} [Wed Aug 10 17:49:48 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:49:48.757700 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-535937de-7d7a-4861-8f1f-e8bb498ac952 tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-852296-2"}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:49:48.761549 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.network.neutron [None req-6aa94ce8-de26-4ca1-a57e-fc00c18ab39f tempest-LiveAutoBlockMigrationV225Test-1294760569 tempest-LiveAutoBlockMigrationV225Test-1294760569-project] validate_networks() for [('65f0edf1-6c38-4348-ba86-cccd27e183bd', None, None, None, None, None)] {{(pid=129410) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 17:49:48.764042 n-d-852296-2 devstack@n-api.service[129409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:49:48.764042 n-d-852296-2 devstack@n-api.service[129409]: warnings.warn(msg) Aug 10 17:49:48.785021 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-535937de-7d7a-4861-8f1f-e8bb498ac952 tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:48.787761 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-535937de-7d7a-4861-8f1f-e8bb498ac952 tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:48.788293 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-535937de-7d7a-4861-8f1f-e8bb498ac952 tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:49.123320 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [None req-6aa94ce8-de26-4ca1-a57e-fc00c18ab39f tempest-LiveAutoBlockMigrationV225Test-1294760569 tempest-LiveAutoBlockMigrationV225Test-1294760569-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-1719e3ba-c733-460f-ab8d-cc3e19a48aa6) Aug 10 17:49:49.123320 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:49:49.123320 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:49:49.123320 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:49:49.123320 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:49:49.123320 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:49:49.123320 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:49:49.123320 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:49:49.123320 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:49:49.123320 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:49:49.123320 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 17:49:49.123320 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 17:49:49.123320 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 17:49:49.123320 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 17:49:49.123320 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 17:49:49.123320 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 17:49:49.124482 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 17:49:49.124482 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 17:49:49.124482 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 17:49:49.124482 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 17:49:49.124482 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 17:49:49.124482 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 17:49:49.124482 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 17:49:49.124482 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 17:49:49.124482 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 17:49:49.124482 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 17:49:49.124482 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 17:49:49.124482 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:49:49.124482 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:49:49.124482 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 17:49:49.124482 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 17:49:49.124482 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:49:49.124482 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:49:49.124482 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:49:49.125636 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:49:49.125636 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:49:49.125636 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:49:49.125636 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:49:49.125636 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:49:49.125636 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:49:49.125636 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:49:49.125636 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 17:49:49.125636 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 17:49:49.125636 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 17:49:49.125636 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 17:49:49.125636 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 17:49:49.125636 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 17:49:49.125636 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 17:49:49.125636 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 17:49:49.125636 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 17:49:49.125636 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 17:49:49.125636 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 17:49:49.126790 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 17:49:49.126790 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 17:49:49.126790 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 17:49:49.126790 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 17:49:49.126790 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 17:49:49.126790 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 17:49:49.126790 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 17:49:49.126790 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 17:49:49.126790 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 17:49:49.126790 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 17:49:49.126790 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 17:49:49.126790 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 17:49:49.126790 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 17:49:49.126790 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 17:49:49.126790 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 17:49:49.127706 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-1719e3ba-c733-460f-ab8d-cc3e19a48aa6) Aug 10 17:49:49.127706 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:49:49.127706 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-6aa94ce8-de26-4ca1-a57e-fc00c18ab39f tempest-LiveAutoBlockMigrationV225Test-1294760569 tempest-LiveAutoBlockMigrationV225Test-1294760569-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:49:49.127706 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 17:49:49.130018 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-6aa94ce8-de26-4ca1-a57e-fc00c18ab39f tempest-LiveAutoBlockMigrationV225Test-1294760569 tempest-LiveAutoBlockMigrationV225Test-1294760569-project] Request method failure captured: Aug 10 17:49:49.130018 n-d-852296-2 devstack@n-api.service[129410]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 17:49:49.130018 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 17:49:49.130018 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 17:49:49.130018 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 17:49:49.130018 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 216 Aug 10 17:49:49.130018 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 17:49:49.130018 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 17:49:49.130018 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 17:49:49.130018 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 17:49:49.130018 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8--rUpQnQMRCcxoeoEEfTZB9bNgVG1LtvLGpdIGsID2pqNy7Yz0btlbySW2s05YZQP69IS5fxYZQ-jPa-PuRzZfIUwlDBjarRUPCbYXiuLNF1PUgDRGkB2Jfpb6O1Pd21aPA9R68lGSAqcVayeh1ErXuIM5RIKbttfyrdx7XjnnLOis Aug 10 17:49:49.130018 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 17:49:49.130018 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 17:49:49.130018 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 17:49:49.130018 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 17:49:49.130018 n-d-852296-2 devstack@n-api.service[129410]: X-Openstack-Nova-Api-Version: 2.25 Aug 10 17:49:49.130018 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 17:49:49.130018 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 17:49:49.130018 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: c39984bbc0b549c9bc10d0a5b0e4ca62 Aug 10 17:49:49.130018 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1294760569 Aug 10 17:49:49.130018 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 17:49:49.130018 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 17:49:49.131395 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c39984bbc0b549c9bc10d0a5b0e4ca62"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c39984bbc0b549c9bc10d0a5b0e4ca62"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c39984bbc0b549c9bc10d0a5b0e4ca62"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c39984bbc0b549c9bc10d0a5b0e4ca62", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:49:49.131395 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1294760569 Aug 10 17:49:49.131395 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: c39984bbc0b549c9bc10d0a5b0e4ca62 Aug 10 17:49:49.131395 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1294760569 Aug 10 17:49:49.131395 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-LiveAutoBlockMigrationV225Test-1294760569-project Aug 10 17:49:49.131395 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 17:49:49.131395 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 17:49:49.131395 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: 030a617b52ad4ef3be53a43d812eb8b9 Aug 10 17:49:49.131395 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1294760569-project Aug 10 17:49:49.131395 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 17:49:49.131395 n-d-852296-2 devstack@n-api.service[129410]: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1085263694", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "65f0edf1-6c38-4348-ba86-cccd27e183bd"}]}} Aug 10 17:49:49.132052 n-d-852296-2 devstack@n-api.service[129410]: method: > Aug 10 17:49:49.132052 n-d-852296-2 devstack@n-api.service[129410]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:49:49.132052 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 17:49:49.132052 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'body': {'server': {'name': 'tempest-LiveAutoBlockMigrationV225Test-server-1085263694', 'imageRef': 'a735ff26-463a-4ffe-a981-ab9d9baa494f', 'flavorRef': '452', 'networks': [{'uuid': '65f0edf1-6c38-4348-ba86-cccd27e183bd'}]}}} Aug 10 17:49:49.132052 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:49:49.132052 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:49:49.132052 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:49:49.132052 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:49:49.132052 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:49:49.132052 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:49:49.132052 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:49:49.132052 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:49:49.132052 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:49:49.132052 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:49:49.132052 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 17:49:49.132052 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 17:49:49.132052 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 17:49:49.132052 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 17:49:49.132052 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 17:49:49.133374 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 17:49:49.133374 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 17:49:49.133374 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 17:49:49.133374 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 17:49:49.133374 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 17:49:49.133374 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 17:49:49.133374 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 17:49:49.133374 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 17:49:49.133374 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 17:49:49.133374 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 17:49:49.133374 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 17:49:49.133374 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 17:49:49.133374 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:49:49.133374 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:49:49.133374 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 17:49:49.133374 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 17:49:49.133374 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:49:49.133374 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:49:49.134790 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:49:49.134790 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:49:49.134790 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:49:49.134790 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:49:49.134790 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:49:49.134790 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:49:49.134790 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:49:49.134790 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:49:49.134790 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 17:49:49.134790 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 17:49:49.134790 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 17:49:49.134790 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 17:49:49.134790 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 17:49:49.134790 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 17:49:49.134790 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 17:49:49.134790 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 17:49:49.134790 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 17:49:49.134790 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 17:49:49.136094 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 17:49:49.136094 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 17:49:49.136094 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 17:49:49.136094 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 17:49:49.136094 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 17:49:49.136094 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 17:49:49.136094 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 17:49:49.136094 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 17:49:49.136094 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 17:49:49.136094 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 17:49:49.136094 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 17:49:49.136094 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 17:49:49.136094 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 17:49:49.136094 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 17:49:49.136094 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 17:49:49.136094 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 17:49:49.137274 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-1719e3ba-c733-460f-ab8d-cc3e19a48aa6) Aug 10 17:49:49.137274 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:49:49.137274 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:49:49.137274 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:49:49.137274 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:49:49.137274 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:49:49.137274 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:49:49.137274 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:49:49.137274 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:49:49.137274 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 10 17:49:49.137274 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 10 17:49:49.137274 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:49:49.137274 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:49:49.137274 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:49:49.137274 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:49:49.137274 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:49:49.137274 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:49:49.137274 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:49:49.137274 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:49:49.138586 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:49:49.138586 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:49:49.138586 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:49:49.138586 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:49:49.138586 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:49:49.138586 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-6aa94ce8-de26-4ca1-a57e-fc00c18ab39f tempest-LiveAutoBlockMigrationV225Test-1294760569 tempest-LiveAutoBlockMigrationV225Test-1294760569-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:49:49.138586 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:49:49.139897 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-6aa94ce8-de26-4ca1-a57e-fc00c18ab39f tempest-LiveAutoBlockMigrationV225Test-1294760569 tempest-LiveAutoBlockMigrationV225Test-1294760569-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.25 time: 0.802602 Aug 10 17:49:49.153316 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 97/209] 10.222.0.50 () {62 vars in 1188 bytes} [Wed Aug 10 17:49:48 2022] POST /compute/v2.1/servers => generated 214 bytes in 820 msecs (HTTP/1.1 500) 9 headers in 393 bytes (1 switches on core 0) Aug 10 17:49:49.353364 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-92567c1f-e98a-4ac9-81fd-e7142a84a85e tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:49.354110 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-92567c1f-e98a-4ac9-81fd-e7142a84a85e tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] [instance: 8e4a95fa-1d4a-4dca-9ba6-73a55f57d771] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:49:49.360444 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-92567c1f-e98a-4ac9-81fd-e7142a84a85e tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:49.360918 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-92567c1f-e98a-4ac9-81fd-e7142a84a85e tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:49.361343 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-92567c1f-e98a-4ac9-81fd-e7142a84a85e tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:49.362027 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-92567c1f-e98a-4ac9-81fd-e7142a84a85e tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:49.362472 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-92567c1f-e98a-4ac9-81fd-e7142a84a85e tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:49.362887 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-92567c1f-e98a-4ac9-81fd-e7142a84a85e tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:49.376542 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-92567c1f-e98a-4ac9-81fd-e7142a84a85e tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] HTTP exception thrown: Instance 8e4a95fa-1d4a-4dca-9ba6-73a55f57d771 could not be found. Aug 10 17:49:49.378170 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-92567c1f-e98a-4ac9-81fd-e7142a84a85e tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Request method failure captured: Aug 10 17:49:49.378170 n-d-852296-2 devstack@n-api.service[129410]: request: GET /compute/v2.1/servers/8e4a95fa-1d4a-4dca-9ba6-73a55f57d771 HTTP/1.1 Aug 10 17:49:49.378170 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 17:49:49.378170 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 17:49:49.378170 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 17:49:49.378170 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 0 Aug 10 17:49:49.378170 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 17:49:49.378170 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 17:49:49.378170 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 17:49:49.378170 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 17:49:49.378170 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8--PSosbYFYBsYw53_ADT3pIQ5DhUK8RE9RQl1-lBh9FKh7PTmZEPoLK2iELsncTnxsMkZyGzpgbygYlXVB1pvYxIR3wpMh6-_qAYg8Mrb4CFQbrvftW6NnNmR3ozUeo6GQUHyLrpWR4L3weWKYB7E0bMLf2tdQm4vEhBlmT0h-gZ2Y Aug 10 17:49:49.378170 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 17:49:49.378170 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 17:49:49.378170 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 17:49:49.378170 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 17:49:49.378170 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 17:49:49.378170 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 17:49:49.378170 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: d5b721d6dfb14d3d8780094fc4e72890 Aug 10 17:49:49.378170 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-DeleteServersAdminTestJSON-496690079 Aug 10 17:49:49.378170 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 17:49:49.378170 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 17:49:49.379600 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d5b721d6dfb14d3d8780094fc4e72890"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d5b721d6dfb14d3d8780094fc4e72890"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d5b721d6dfb14d3d8780094fc4e72890"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d5b721d6dfb14d3d8780094fc4e72890", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:49:49.379600 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-DeleteServersAdminTestJSON-496690079 Aug 10 17:49:49.379600 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: d5b721d6dfb14d3d8780094fc4e72890 Aug 10 17:49:49.379600 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-496690079 Aug 10 17:49:49.379600 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-DeleteServersAdminTestJSON-496690079-project Aug 10 17:49:49.379600 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 17:49:49.379600 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 17:49:49.379600 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: 9f242fdc47104b98882cb29c8ca5caae Aug 10 17:49:49.379600 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-DeleteServersAdminTestJSON-496690079-project Aug 10 17:49:49.379600 n-d-852296-2 devstack@n-api.service[129410]: method: > Aug 10 17:49:49.379600 n-d-852296-2 devstack@n-api.service[129410]: exception: Instance 8e4a95fa-1d4a-4dca-9ba6-73a55f57d771 could not be found. Aug 10 17:49:49.379600 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'id': '8e4a95fa-1d4a-4dca-9ba6-73a55f57d771'} Aug 10 17:49:49.380446 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:49:49.380446 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:49:49.380446 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 17:49:49.380446 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 17:49:49.380446 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 17:49:49.380446 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 17:49:49.380446 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 17:49:49.380446 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 17:49:49.380446 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 17:49:49.380446 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 17:49:49.380446 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e4a95fa-1d4a-4dca-9ba6-73a55f57d771 could not be found. Aug 10 17:49:49.380446 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:49:49.380446 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:49:49.380446 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:49:49.380446 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:49:49.380446 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:49:49.380446 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:49:49.380446 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:49:49.380446 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:49:49.380446 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:49:49.381567 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:49:49.381567 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 17:49:49.381567 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 17:49:49.381567 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 17:49:49.381567 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 17:49:49.381567 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 17:49:49.381567 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:49:49.381567 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e4a95fa-1d4a-4dca-9ba6-73a55f57d771 could not be found. Aug 10 17:49:49.381567 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:49:49.381567 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:49:49.381567 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:49:49.381567 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:49:49.381567 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:49:49.381567 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:49:49.381567 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:49:49.381567 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:49:49.381567 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e4a95fa-1d4a-4dca-9ba6-73a55f57d771 could not be found. Aug 10 17:49:49.381567 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:49:49.382574 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-92567c1f-e98a-4ac9-81fd-e7142a84a85e tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Returning 404 to user: Instance 8e4a95fa-1d4a-4dca-9ba6-73a55f57d771 could not be found. {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:49:49.382574 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-92567c1f-e98a-4ac9-81fd-e7142a84a85e tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] 10.222.0.50 "GET /compute/v2.1/servers/8e4a95fa-1d4a-4dca-9ba6-73a55f57d771" status: 404 len: 111 microversion: 2.1 time: 0.031241 Aug 10 17:49:49.382574 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 98/210] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:49:49 2022] GET /compute/v2.1/servers/8e4a95fa-1d4a-4dca-9ba6-73a55f57d771 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 17:49:49.480517 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-535937de-7d7a-4861-8f1f-e8bb498ac952 tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 242 microversion: 2.1 time: 0.716716 Aug 10 17:49:49.480517 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 113/211] 10.222.0.50 () {60 vars in 1191 bytes} [Wed Aug 10 17:49:48 2022] POST /compute/v2.1/os-aggregates/3/action => generated 242 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:49:49.483050 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-77bd091a-0207-48a6-bd9c-a1eb72e99e66 tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:49.483804 n-d-852296-2 devstack@n-api.service[129410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:49:49.483804 n-d-852296-2 devstack@n-api.service[129410]: warnings.warn(msg) Aug 10 17:49:49.491736 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-77bd091a-0207-48a6-bd9c-a1eb72e99e66 tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] 10.222.0.50 "GET /compute/v2.1/os-aggregates/3" status: 200 len: 242 microversion: 2.1 time: 0.012814 Aug 10 17:49:49.492338 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 99/212] 10.222.0.50 () {58 vars in 1149 bytes} [Wed Aug 10 17:49:49 2022] GET /compute/v2.1/os-aggregates/3 => generated 242 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:49:49.503716 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-62e88de0-0a23-440b-842c-fb8d0590e62a tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-852296-2"}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:49:49.506308 n-d-852296-2 devstack@n-api.service[129409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:49:49.506308 n-d-852296-2 devstack@n-api.service[129409]: warnings.warn(msg) Aug 10 17:49:49.533635 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-62e88de0-0a23-440b-842c-fb8d0590e62a tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:49.534129 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-62e88de0-0a23-440b-842c-fb8d0590e62a tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:49.534562 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-62e88de0-0a23-440b-842c-fb8d0590e62a tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:49.646197 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-a2799481-917c-4302-9793-9e87bbe2ffae tempest-LiveAutoBlockMigrationV225Test-1294760569 tempest-LiveAutoBlockMigrationV225Test-1294760569-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-679086252", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "65f0edf1-6c38-4348-ba86-cccd27e183bd"}]}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:49:49.709124 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_cell0:SELECT=2 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:49:49.781494 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.network.neutron [None req-a2799481-917c-4302-9793-9e87bbe2ffae tempest-LiveAutoBlockMigrationV225Test-1294760569 tempest-LiveAutoBlockMigrationV225Test-1294760569-project] validate_networks() for [('65f0edf1-6c38-4348-ba86-cccd27e183bd', None, None, None, None, None)] {{(pid=129410) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 17:49:50.422027 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-62e88de0-0a23-440b-842c-fb8d0590e62a tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 227 microversion: 2.1 time: 0.921856 Aug 10 17:49:50.423437 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 114/213] 10.222.0.50 () {60 vars in 1191 bytes} [Wed Aug 10 17:49:49 2022] POST /compute/v2.1/os-aggregates/3/action => generated 227 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:49:50.431575 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-a8a7e9be-2d06-4325-adce-be5e830e6a69 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1080518671", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452"}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:49:50.444895 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [None req-a2799481-917c-4302-9793-9e87bbe2ffae tempest-LiveAutoBlockMigrationV225Test-1294760569 tempest-LiveAutoBlockMigrationV225Test-1294760569-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-b46f164f-8e1e-4601-9970-b49a13d8f2a3) Aug 10 17:49:50.444895 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:49:50.444895 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:49:50.444895 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:49:50.444895 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:49:50.444895 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:49:50.444895 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:49:50.444895 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:49:50.444895 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:49:50.444895 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:49:50.444895 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 17:49:50.444895 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 17:49:50.444895 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 17:49:50.444895 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 17:49:50.444895 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 17:49:50.444895 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 17:49:50.447007 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 17:49:50.447007 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 17:49:50.447007 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 17:49:50.447007 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 17:49:50.447007 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 17:49:50.447007 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 17:49:50.447007 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 17:49:50.447007 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 17:49:50.447007 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 17:49:50.447007 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 17:49:50.447007 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 17:49:50.447007 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:49:50.447007 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:49:50.447007 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 17:49:50.447007 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 17:49:50.447007 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:49:50.447007 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:49:50.447007 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:49:50.448185 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:49:50.448185 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:49:50.448185 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:49:50.448185 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:49:50.448185 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:49:50.448185 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:49:50.448185 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:49:50.448185 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 17:49:50.448185 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 17:49:50.448185 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 17:49:50.448185 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 17:49:50.448185 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 17:49:50.448185 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 17:49:50.448185 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 17:49:50.448185 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 17:49:50.448185 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 17:49:50.448185 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 17:49:50.448185 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 17:49:50.449712 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 17:49:50.449712 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 17:49:50.449712 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 17:49:50.449712 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 17:49:50.449712 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 17:49:50.449712 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 17:49:50.449712 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 17:49:50.449712 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 17:49:50.449712 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 17:49:50.449712 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 17:49:50.449712 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 17:49:50.449712 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 17:49:50.449712 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 17:49:50.449712 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 17:49:50.449712 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 17:49:50.450511 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-b46f164f-8e1e-4601-9970-b49a13d8f2a3) Aug 10 17:49:50.450511 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:49:50.450511 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-a2799481-917c-4302-9793-9e87bbe2ffae tempest-LiveAutoBlockMigrationV225Test-1294760569 tempest-LiveAutoBlockMigrationV225Test-1294760569-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:49:50.450511 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 17:49:50.452378 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-a2799481-917c-4302-9793-9e87bbe2ffae tempest-LiveAutoBlockMigrationV225Test-1294760569 tempest-LiveAutoBlockMigrationV225Test-1294760569-project] Request method failure captured: Aug 10 17:49:50.452378 n-d-852296-2 devstack@n-api.service[129410]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 17:49:50.452378 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 17:49:50.452378 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 17:49:50.452378 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 17:49:50.452378 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 215 Aug 10 17:49:50.452378 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 17:49:50.452378 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 17:49:50.452378 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 17:49:50.452378 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 17:49:50.452378 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8--rUpQnQMRCcxoeoEEfTZB9bNgVG1LtvLGpdIGsID2pqNy7Yz0btlbySW2s05YZQP69IS5fxYZQ-jPa-PuRzZfIUwlDBjarRUPCbYXiuLNF1PUgDRGkB2Jfpb6O1Pd21aPA9R68lGSAqcVayeh1ErXuIM5RIKbttfyrdx7XjnnLOis Aug 10 17:49:50.452378 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 17:49:50.452378 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 17:49:50.452378 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 17:49:50.452378 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 17:49:50.452378 n-d-852296-2 devstack@n-api.service[129410]: X-Openstack-Nova-Api-Version: 2.25 Aug 10 17:49:50.452378 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 17:49:50.452378 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 17:49:50.452378 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: c39984bbc0b549c9bc10d0a5b0e4ca62 Aug 10 17:49:50.452378 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1294760569 Aug 10 17:49:50.452378 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 17:49:50.452378 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 17:49:50.453783 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c39984bbc0b549c9bc10d0a5b0e4ca62"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c39984bbc0b549c9bc10d0a5b0e4ca62"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c39984bbc0b549c9bc10d0a5b0e4ca62"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c39984bbc0b549c9bc10d0a5b0e4ca62", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:49:50.453783 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1294760569 Aug 10 17:49:50.453783 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: c39984bbc0b549c9bc10d0a5b0e4ca62 Aug 10 17:49:50.453783 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1294760569 Aug 10 17:49:50.453783 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-LiveAutoBlockMigrationV225Test-1294760569-project Aug 10 17:49:50.453783 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 17:49:50.453783 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 17:49:50.453783 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: 030a617b52ad4ef3be53a43d812eb8b9 Aug 10 17:49:50.453783 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1294760569-project Aug 10 17:49:50.453783 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 17:49:50.453783 n-d-852296-2 devstack@n-api.service[129410]: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-679086252", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "65f0edf1-6c38-4348-ba86-cccd27e183bd"}]}} Aug 10 17:49:50.454407 n-d-852296-2 devstack@n-api.service[129410]: method: > Aug 10 17:49:50.454407 n-d-852296-2 devstack@n-api.service[129410]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:49:50.454407 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 17:49:50.454407 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'body': {'server': {'name': 'tempest-LiveAutoBlockMigrationV225Test-server-679086252', 'imageRef': 'a735ff26-463a-4ffe-a981-ab9d9baa494f', 'flavorRef': '452', 'networks': [{'uuid': '65f0edf1-6c38-4348-ba86-cccd27e183bd'}]}}} Aug 10 17:49:50.454407 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:49:50.454407 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:49:50.454407 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:49:50.454407 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:49:50.454407 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:49:50.454407 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:49:50.454407 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:49:50.454407 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:49:50.454407 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:49:50.454407 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:49:50.454407 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 17:49:50.454407 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 17:49:50.454407 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 17:49:50.454407 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 17:49:50.454407 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 17:49:50.455965 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 17:49:50.455965 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 17:49:50.455965 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 17:49:50.455965 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 17:49:50.455965 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 17:49:50.455965 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 17:49:50.455965 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 17:49:50.455965 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 17:49:50.455965 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 17:49:50.455965 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 17:49:50.455965 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 17:49:50.455965 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 17:49:50.455965 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:49:50.455965 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:49:50.455965 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 17:49:50.455965 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 17:49:50.455965 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:49:50.455965 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:49:50.456961 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:49:50.456961 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:49:50.456961 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:49:50.456961 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:49:50.456961 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:49:50.456961 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:49:50.456961 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:49:50.456961 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:49:50.456961 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 17:49:50.456961 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 17:49:50.456961 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 17:49:50.456961 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 17:49:50.456961 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 17:49:50.456961 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 17:49:50.456961 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 17:49:50.456961 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 17:49:50.456961 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 17:49:50.456961 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 17:49:50.457938 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 17:49:50.457938 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 17:49:50.457938 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 17:49:50.457938 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 17:49:50.457938 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 17:49:50.457938 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 17:49:50.457938 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 17:49:50.457938 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 17:49:50.457938 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 17:49:50.457938 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 17:49:50.457938 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 17:49:50.457938 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 17:49:50.457938 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 17:49:50.457938 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 17:49:50.457938 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 17:49:50.457938 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 17:49:50.458830 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-b46f164f-8e1e-4601-9970-b49a13d8f2a3) Aug 10 17:49:50.458830 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:49:50.458830 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:49:50.458830 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:49:50.458830 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:49:50.458830 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:49:50.458830 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:49:50.458830 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:49:50.458830 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:49:50.458830 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 10 17:49:50.458830 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 10 17:49:50.458830 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:49:50.458830 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:49:50.458830 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:49:50.458830 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:49:50.458830 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:49:50.458830 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:49:50.458830 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:49:50.458830 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:49:50.472793 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:49:50.472793 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:49:50.472793 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:49:50.472793 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:49:50.472793 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:49:50.472793 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-a2799481-917c-4302-9793-9e87bbe2ffae tempest-LiveAutoBlockMigrationV225Test-1294760569 tempest-LiveAutoBlockMigrationV225Test-1294760569-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:49:50.472793 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:49:50.472793 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-a2799481-917c-4302-9793-9e87bbe2ffae tempest-LiveAutoBlockMigrationV225Test-1294760569 tempest-LiveAutoBlockMigrationV225Test-1294760569-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.25 time: 0.813769 Aug 10 17:49:50.472793 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 100/214] 10.222.0.50 () {62 vars in 1188 bytes} [Wed Aug 10 17:49:49 2022] POST /compute/v2.1/servers => generated 214 bytes in 825 msecs (HTTP/1.1 500) 9 headers in 393 bytes (2 switches on core 0) Aug 10 17:49:50.473734 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-64a88ad8-e059-46af-97cc-81caf66356e6 tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:50.473734 n-d-852296-2 devstack@n-api.service[129410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:49:50.473734 n-d-852296-2 devstack@n-api.service[129410]: warnings.warn(msg) Aug 10 17:49:50.514123 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.network.neutron [None req-a8a7e9be-2d06-4325-adce-be5e830e6a69 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] validate_networks() for None {{(pid=129409) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 17:49:50.642535 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-64a88ad8-e059-46af-97cc-81caf66356e6 tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.176764 Aug 10 17:49:50.644389 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 101/215] 10.222.0.50 () {58 vars in 1152 bytes} [Wed Aug 10 17:49:50 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 10 17:49:50.655185 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-b1ad6fd9-9174-445f-98c8-ce42ba13657b tempest-LiveAutoBlockMigrationV225Test-1294760569 tempest-LiveAutoBlockMigrationV225Test-1294760569-project] Action: 'create', calling method: .version_select at 0x7fb349214af0>, body: {"keypair": {"name": "tempest-keypair-15043570", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM+32EDPOlbovSxeHAzlk3zYdiYVTreUr9R35EJaWlePASGI+bIXh9jECAkLf+K+6I8vgVtTC5a5wnv5M4U2+8y0mKQJxU9n6veOCDGxRChsLZS5niKnNpOIMt0dPu+Ofw=="}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:49:50.704687 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.quota [None req-b1ad6fd9-9174-445f-98c8-ce42ba13657b tempest-LiveAutoBlockMigrationV225Test-1294760569 tempest-LiveAutoBlockMigrationV225Test-1294760569-project] Getting quotas for project c39984bbc0b549c9bc10d0a5b0e4ca62. Resources: {'key_pairs'} {{(pid=129410) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:49:50.713092 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.quota [None req-b1ad6fd9-9174-445f-98c8-ce42ba13657b tempest-LiveAutoBlockMigrationV225Test-1294760569 tempest-LiveAutoBlockMigrationV225Test-1294760569-project] Getting quotas for user 030a617b52ad4ef3be53a43d812eb8b9 and project c39984bbc0b549c9bc10d0a5b0e4ca62. Resources: {'key_pairs'} {{(pid=129410) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:49:50.770476 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_cell0:SELECT=39,nova_cell0:UPDATE=7 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:49:50.881700 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-b1ad6fd9-9174-445f-98c8-ce42ba13657b tempest-LiveAutoBlockMigrationV225Test-1294760569 tempest-LiveAutoBlockMigrationV225Test-1294760569-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.25 time: 0.235901 Aug 10 17:49:50.889384 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 102/216] 10.222.0.50 () {62 vars in 1200 bytes} [Wed Aug 10 17:49:50 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 244 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 10 17:49:50.965365 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.virt.hardware [None req-a8a7e9be-2d06-4325-adce-be5e830e6a69 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Flavor limits 0:0:0 {{(pid=129409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 17:49:50.966054 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.virt.hardware [None req-a8a7e9be-2d06-4325-adce-be5e830e6a69 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Image limits 0:0:0 {{(pid=129409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 17:49:50.966674 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.virt.hardware [None req-a8a7e9be-2d06-4325-adce-be5e830e6a69 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Flavor pref 0:0:0 {{(pid=129409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 17:49:50.967238 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.virt.hardware [None req-a8a7e9be-2d06-4325-adce-be5e830e6a69 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Image pref 0:0:0 {{(pid=129409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 17:49:50.967841 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.virt.hardware [None req-a8a7e9be-2d06-4325-adce-be5e830e6a69 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 17:49:50.982762 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a8a7e9be-2d06-4325-adce-be5e830e6a69 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:50.984648 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a8a7e9be-2d06-4325-adce-be5e830e6a69 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:50.987021 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a8a7e9be-2d06-4325-adce-be5e830e6a69 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:50.991025 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a8a7e9be-2d06-4325-adce-be5e830e6a69 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:50.993145 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a8a7e9be-2d06-4325-adce-be5e830e6a69 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:50.994674 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a8a7e9be-2d06-4325-adce-be5e830e6a69 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:51.024558 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-a8a7e9be-2d06-4325-adce-be5e830e6a69 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Getting quotas for project d5b721d6dfb14d3d8780094fc4e72890. Resources: {'instances', 'ram', 'cores'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:49:51.028932 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=11,nova_api:INSERT=5,nova_api:DELETE=4 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:49:51.033611 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-a8a7e9be-2d06-4325-adce-be5e830e6a69 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Getting quotas for user 9f242fdc47104b98882cb29c8ca5caae and project d5b721d6dfb14d3d8780094fc4e72890. Resources: {'instances', 'ram', 'cores'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:49:51.061879 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-a8a7e9be-2d06-4325-adce-be5e830e6a69 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Going to run 1 instances... {{(pid=129409) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 17:49:51.085020 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-a8a7e9be-2d06-4325-adce-be5e830e6a69 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] [instance: 7e9ff909-ff6f-4d8d-8d84-97af957c6506] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a735ff26-463a-4ffe-a981-ab9d9baa494f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 17:49:51.301531 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-9dac72d1-1042-4d25-9599-ce7668b6f472 tempest-FlavorsV2TestJSON-1415836278 tempest-FlavorsV2TestJSON-1415836278-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:51.312461 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-9dac72d1-1042-4d25-9599-ce7668b6f472 tempest-FlavorsV2TestJSON-1415836278 tempest-FlavorsV2TestJSON-1415836278-project] 10.222.0.50 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.416785 Aug 10 17:49:51.313078 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 103/217] 10.222.0.50 () {58 vars in 1137 bytes} [Wed Aug 10 17:49:50 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:49:51.321791 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-fe29b606-2971-45c2-b1a1-8cccf6719a28 tempest-AggregatesAdminNegativeTestJSON-734955950 tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1704222106"}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:49:51.325430 n-d-852296-2 devstack@n-api.service[129410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:49:51.325430 n-d-852296-2 devstack@n-api.service[129410]: warnings.warn(msg) Aug 10 17:49:51.326517 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.objects.aggregate [None req-fe29b606-2971-45c2-b1a1-8cccf6719a28 tempest-AggregatesAdminNegativeTestJSON-734955950 tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin] Generated uuid baabc91f-5572-464c-96d9-e5da51da168e for aggregate {{(pid=129410) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 10 17:49:51.382443 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-a8a7e9be-2d06-4325-adce-be5e830e6a69 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.956966 Aug 10 17:49:51.384579 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 115/218] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 17:49:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 960 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 17:49:51.393711 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-77063e13-61ef-48c8-8bde-cb9cde430cf1 tempest-FlavorsV2TestJSON-1415836278 tempest-FlavorsV2TestJSON-1415836278-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:51.421590 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-77063e13-61ef-48c8-8bde-cb9cde430cf1 tempest-FlavorsV2TestJSON-1415836278 tempest-FlavorsV2TestJSON-1415836278-project] 10.222.0.50 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.035636 Aug 10 17:49:51.422878 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 116/219] 10.222.0.50 () {58 vars in 1125 bytes} [Wed Aug 10 17:49:51 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:49:51.427736 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-2fe95773-b151-491a-a51b-17b7a41eb3e1 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:51.428607 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-2fe95773-b151-491a-a51b-17b7a41eb3e1 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] [instance: 7e9ff909-ff6f-4d8d-8d84-97af957c6506] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:49:51.514217 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-2fe95773-b151-491a-a51b-17b7a41eb3e1 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f242fdc47104b98882cb29c8ca5caae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b721d6dfb14d3d8780094fc4e72890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:49:51.521027 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-2fe95773-b151-491a-a51b-17b7a41eb3e1 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] 10.222.0.50 "GET /compute/v2.1/servers/7e9ff909-ff6f-4d8d-8d84-97af957c6506" status: 200 len: 1220 microversion: 2.1 time: 0.096883 Aug 10 17:49:51.535820 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 117/220] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:49:51 2022] GET /compute/v2.1/servers/7e9ff909-ff6f-4d8d-8d84-97af957c6506 => generated 1220 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:49:51.552763 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-5f729e2e-a243-4486-950f-c1ecf1f24214 tempest-FlavorsV2TestJSON-1415836278 tempest-FlavorsV2TestJSON-1415836278-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:51.564614 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-5f729e2e-a243-4486-950f-c1ecf1f24214 tempest-FlavorsV2TestJSON-1415836278 tempest-FlavorsV2TestJSON-1415836278-project] 10.222.0.50 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.027271 Aug 10 17:49:51.567170 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 118/221] 10.222.0.50 () {58 vars in 1137 bytes} [Wed Aug 10 17:49:51 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:49:51.601005 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-224a95f6-f1b0-40a4-bf7e-8751fe75e585 tempest-FlavorsV2TestJSON-1415836278 tempest-FlavorsV2TestJSON-1415836278-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:51.624411 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-224a95f6-f1b0-40a4-bf7e-8751fe75e585 tempest-FlavorsV2TestJSON-1415836278 tempest-FlavorsV2TestJSON-1415836278-project] 10.222.0.50 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.042505 Aug 10 17:49:51.624959 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 119/222] 10.222.0.50 () {58 vars in 1137 bytes} [Wed Aug 10 17:49:51 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:49:51.649844 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-a5649bfc-2f35-415e-a178-75b2a34ea98b tempest-FlavorsV2TestJSON-1415836278 tempest-FlavorsV2TestJSON-1415836278-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:51.703013 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-fe29b606-2971-45c2-b1a1-8cccf6719a28 tempest-AggregatesAdminNegativeTestJSON-734955950 tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.387528 Aug 10 17:49:51.703869 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-a5649bfc-2f35-415e-a178-75b2a34ea98b tempest-FlavorsV2TestJSON-1415836278 tempest-FlavorsV2TestJSON-1415836278-project] 10.222.0.50 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.070784 Aug 10 17:49:51.705726 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 120/223] 10.222.0.50 () {58 vars in 1165 bytes} [Wed Aug 10 17:49:51 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:49:51.706170 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 104/224] 10.222.0.50 () {60 vars in 1164 bytes} [Wed Aug 10 17:49:51 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:49:51.731627 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-05f7cdc2-ee66-4840-8b42-ee3eaea93640 tempest-FlavorsV2TestJSON-1415836278 tempest-FlavorsV2TestJSON-1415836278-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:51.741665 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-05f7cdc2-ee66-4840-8b42-ee3eaea93640 tempest-FlavorsV2TestJSON-1415836278 tempest-FlavorsV2TestJSON-1415836278-project] 10.222.0.50 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.016465 Aug 10 17:49:51.746485 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-f2ffefe9-1bdb-4d6e-bffb-8875048d0f1f tempest-AggregatesAdminNegativeTestJSON-734955950 tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-852296-2"}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:49:51.751221 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 105/225] 10.222.0.50 () {58 vars in 1137 bytes} [Wed Aug 10 17:49:51 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:49:51.754177 n-d-852296-2 devstack@n-api.service[129409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:49:51.754177 n-d-852296-2 devstack@n-api.service[129409]: warnings.warn(msg) Aug 10 17:49:51.756914 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-99dc4a79-bed6-48a6-94a7-66649b0e21cd tempest-FlavorsV2TestJSON-1415836278 tempest-FlavorsV2TestJSON-1415836278-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:51.764885 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-f2ffefe9-1bdb-4d6e-bffb-8875048d0f1f tempest-AggregatesAdminNegativeTestJSON-734955950 tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:51.765474 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-f2ffefe9-1bdb-4d6e-bffb-8875048d0f1f tempest-AggregatesAdminNegativeTestJSON-734955950 tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:51.766269 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-f2ffefe9-1bdb-4d6e-bffb-8875048d0f1f tempest-AggregatesAdminNegativeTestJSON-734955950 tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:51.787954 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-99dc4a79-bed6-48a6-94a7-66649b0e21cd tempest-FlavorsV2TestJSON-1415836278 tempest-FlavorsV2TestJSON-1415836278-project] 10.222.0.50 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.035323 Aug 10 17:49:51.793334 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 106/226] 10.222.0.50 () {58 vars in 1169 bytes} [Wed Aug 10 17:49:51 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:49:51.805713 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-5c7fdf66-c38d-4e23-b864-fc00bd33754b tempest-FlavorsV2TestJSON-1415836278 tempest-FlavorsV2TestJSON-1415836278-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:51.819586 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-5c7fdf66-c38d-4e23-b864-fc00bd33754b tempest-FlavorsV2TestJSON-1415836278 tempest-FlavorsV2TestJSON-1415836278-project] 10.222.0.50 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.017694 Aug 10 17:49:51.844080 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 107/227] 10.222.0.50 () {58 vars in 1161 bytes} [Wed Aug 10 17:49:51 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:49:51.850230 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-3f541245-0a79-4268-aafb-e32335074491 tempest-FlavorsV2TestJSON-1415836278 tempest-FlavorsV2TestJSON-1415836278-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:51.861871 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-3f541245-0a79-4268-aafb-e32335074491 tempest-FlavorsV2TestJSON-1415836278 tempest-FlavorsV2TestJSON-1415836278-project] 10.222.0.50 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.016066 Aug 10 17:49:51.862457 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 108/228] 10.222.0.50 () {58 vars in 1137 bytes} [Wed Aug 10 17:49:51 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:49:51.875558 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-747a57e0-211a-4e1f-a767-718b0e0f0da2 tempest-FlavorsV2TestJSON-1415836278 tempest-FlavorsV2TestJSON-1415836278-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:51.966792 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-747a57e0-211a-4e1f-a767-718b0e0f0da2 tempest-FlavorsV2TestJSON-1415836278 tempest-FlavorsV2TestJSON-1415836278-project] 10.222.0.50 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.094477 Aug 10 17:49:51.969524 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 109/229] 10.222.0.50 () {58 vars in 1167 bytes} [Wed Aug 10 17:49:51 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:49:51.988175 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-5b6381c4-427d-417e-84b3-e4bbca778c17 tempest-FlavorsV2TestJSON-1415836278 tempest-FlavorsV2TestJSON-1415836278-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:52.000047 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-5b6381c4-427d-417e-84b3-e4bbca778c17 tempest-FlavorsV2TestJSON-1415836278 tempest-FlavorsV2TestJSON-1415836278-project] 10.222.0.50 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.016821 Aug 10 17:49:52.001505 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 110/230] 10.222.0.50 () {58 vars in 1137 bytes} [Wed Aug 10 17:49:51 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:49:52.014876 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-4a955552-b856-4dfa-92f1-91fcf726da5d tempest-FlavorsV2TestJSON-1415836278 tempest-FlavorsV2TestJSON-1415836278-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:52.037782 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_api:DELETE=5,nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:49:52.066521 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-4a955552-b856-4dfa-92f1-91fcf726da5d tempest-FlavorsV2TestJSON-1415836278 tempest-FlavorsV2TestJSON-1415836278-project] 10.222.0.50 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.055502 Aug 10 17:49:52.067137 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 111/231] 10.222.0.50 () {58 vars in 1144 bytes} [Wed Aug 10 17:49:52 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:49:52.087883 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-781d13de-41a2-48a4-b544-df75b7df771d tempest-FlavorsV2TestJSON-1415836278 tempest-FlavorsV2TestJSON-1415836278-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:52.098359 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-781d13de-41a2-48a4-b544-df75b7df771d tempest-FlavorsV2TestJSON-1415836278 tempest-FlavorsV2TestJSON-1415836278-project] 10.222.0.50 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015302 Aug 10 17:49:52.098949 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 112/232] 10.222.0.50 () {58 vars in 1137 bytes} [Wed Aug 10 17:49:52 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:49:52.111175 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-44e61cee-4ddb-4a23-ad28-0c696d301d49 tempest-FlavorsV2TestJSON-1415836278 tempest-FlavorsV2TestJSON-1415836278-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:52.130564 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-44e61cee-4ddb-4a23-ad28-0c696d301d49 tempest-FlavorsV2TestJSON-1415836278 tempest-FlavorsV2TestJSON-1415836278-project] 10.222.0.50 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.023132 Aug 10 17:49:52.131351 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 113/233] 10.222.0.50 () {58 vars in 1148 bytes} [Wed Aug 10 17:49:52 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:49:52.147935 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-d2b305e4-c156-4ba5-92ea-0953880d2933 tempest-FlavorsV2TestJSON-1415836278 tempest-FlavorsV2TestJSON-1415836278-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:52.170008 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-d2b305e4-c156-4ba5-92ea-0953880d2933 tempest-FlavorsV2TestJSON-1415836278 tempest-FlavorsV2TestJSON-1415836278-project] 10.222.0.50 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.028507 Aug 10 17:49:52.178067 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 114/234] 10.222.0.50 () {58 vars in 1140 bytes} [Wed Aug 10 17:49:52 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:49:52.185758 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-84e5b08f-03a2-49b1-8479-04f8a94518b8 tempest-FlavorsV2TestJSON-1415836278 tempest-FlavorsV2TestJSON-1415836278-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:52.207748 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-84e5b08f-03a2-49b1-8479-04f8a94518b8 tempest-FlavorsV2TestJSON-1415836278 tempest-FlavorsV2TestJSON-1415836278-project] 10.222.0.50 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.027796 Aug 10 17:49:52.210293 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 115/235] 10.222.0.50 () {58 vars in 1137 bytes} [Wed Aug 10 17:49:52 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:49:52.227684 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-b833b71d-1b31-4b0d-bb02-7fc30e599f68 tempest-FlavorsV2TestJSON-1415836278 tempest-FlavorsV2TestJSON-1415836278-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:52.257191 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-b833b71d-1b31-4b0d-bb02-7fc30e599f68 tempest-FlavorsV2TestJSON-1415836278 tempest-FlavorsV2TestJSON-1415836278-project] 10.222.0.50 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.038171 Aug 10 17:49:52.258877 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 116/236] 10.222.0.50 () {58 vars in 1146 bytes} [Wed Aug 10 17:49:52 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:49:52.280523 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-31d234f1-3960-44e7-ae38-68e1ba6a98b6 tempest-FlavorsV2TestJSON-1415836278 tempest-FlavorsV2TestJSON-1415836278-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:52.328005 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-31d234f1-3960-44e7-ae38-68e1ba6a98b6 tempest-FlavorsV2TestJSON-1415836278 tempest-FlavorsV2TestJSON-1415836278-project] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.060033 Aug 10 17:49:52.334635 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 117/237] 10.222.0.50 () {58 vars in 1146 bytes} [Wed Aug 10 17:49:52 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:49:52.358771 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-0993be56-8431-448a-b158-6b9894dc7659 tempest-FlavorsV2TestJSON-1415836278 tempest-FlavorsV2TestJSON-1415836278-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:52.407598 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-0993be56-8431-448a-b158-6b9894dc7659 tempest-FlavorsV2TestJSON-1415836278 tempest-FlavorsV2TestJSON-1415836278-project] 10.222.0.50 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.059054 Aug 10 17:49:52.408820 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 118/238] 10.222.0.50 () {58 vars in 1137 bytes} [Wed Aug 10 17:49:52 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:49:52.517845 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-f2ffefe9-1bdb-4d6e-bffb-8875048d0f1f tempest-AggregatesAdminNegativeTestJSON-734955950 tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 242 microversion: 2.1 time: 0.793218 Aug 10 17:49:52.518428 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 121/239] 10.222.0.50 () {60 vars in 1191 bytes} [Wed Aug 10 17:49:51 2022] POST /compute/v2.1/os-aggregates/4/action => generated 242 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:49:52.530824 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-1041e02f-7e62-44ec-88a9-f8eaa91d2b4a tempest-AggregatesAdminNegativeTestJSON-734955950 tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-852296-2"}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:49:52.533663 n-d-852296-2 devstack@n-api.service[129410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:49:52.533663 n-d-852296-2 devstack@n-api.service[129410]: warnings.warn(msg) Aug 10 17:49:52.542069 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-1041e02f-7e62-44ec-88a9-f8eaa91d2b4a tempest-AggregatesAdminNegativeTestJSON-734955950 tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:52.542548 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-1041e02f-7e62-44ec-88a9-f8eaa91d2b4a tempest-AggregatesAdminNegativeTestJSON-734955950 tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:52.543024 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-1041e02f-7e62-44ec-88a9-f8eaa91d2b4a tempest-AggregatesAdminNegativeTestJSON-734955950 tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:52.562934 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-2edfcde4-ba1e-418a-b9c8-bbf8a85d436f tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:52.563670 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-2edfcde4-ba1e-418a-b9c8-bbf8a85d436f tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] [instance: 7e9ff909-ff6f-4d8d-8d84-97af957c6506] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:49:52.648383 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-1041e02f-7e62-44ec-88a9-f8eaa91d2b4a tempest-AggregatesAdminNegativeTestJSON-734955950 tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin] HTTP exception thrown: Aggregate 4 already has host n-h2-852296-2. Aug 10 17:49:52.669359 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-1041e02f-7e62-44ec-88a9-f8eaa91d2b4a tempest-AggregatesAdminNegativeTestJSON-734955950 tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin] Request method failure captured: Aug 10 17:49:52.669359 n-d-852296-2 devstack@n-api.service[129410]: request: POST /compute/v2.1/os-aggregates/4/action HTTP/1.1 Aug 10 17:49:52.669359 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 17:49:52.669359 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 17:49:52.669359 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 17:49:52.669359 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 39 Aug 10 17:49:52.669359 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 17:49:52.669359 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 17:49:52.669359 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 17:49:52.669359 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 17:49:52.669359 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8--FinhXlxx8IFKnpFpAT2Mo9QKfGxddI_iKMGNb1Cjl8iSxKagj8DS2koXne8dIwX5_FVGCNTdOoyiHy2-sqqTjQfCR9EdEKc3gZynR9hJpVzE6YDP0hjcv2eKwEJp7WPPXp_BMt0f15rXmrKAPP-NUjl5gpiR7Muqr5uV0EQw-IDk Aug 10 17:49:52.669359 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 17:49:52.669359 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 17:49:52.669359 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 17:49:52.669359 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 17:49:52.669359 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 17:49:52.669359 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 17:49:52.669359 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: 812966d76c404431a451a541b1d1e58d Aug 10 17:49:52.669359 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-734955950 Aug 10 17:49:52.669359 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member,admin Aug 10 17:49:52.669359 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member,admin Aug 10 17:49:52.670931 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/812966d76c404431a451a541b1d1e58d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/812966d76c404431a451a541b1d1e58d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/812966d76c404431a451a541b1d1e58d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_812966d76c404431a451a541b1d1e58d", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:49:52.670931 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-734955950 Aug 10 17:49:52.670931 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: 812966d76c404431a451a541b1d1e58d Aug 10 17:49:52.670931 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-734955950 Aug 10 17:49:52.670931 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin Aug 10 17:49:52.670931 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 17:49:52.670931 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 17:49:52.670931 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: 32c6d09f10a94ddeb38b0185705b6740 Aug 10 17:49:52.670931 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin Aug 10 17:49:52.670931 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 17:49:52.670931 n-d-852296-2 devstack@n-api.service[129410]: {"add_host": {"host": "n-h2-852296-2"}} Aug 10 17:49:52.670931 n-d-852296-2 devstack@n-api.service[129410]: method: > Aug 10 17:49:52.670931 n-d-852296-2 devstack@n-api.service[129410]: exception: Aggregate 4 already has host n-h2-852296-2. Aug 10 17:49:52.671703 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'id': '4', 'body': {'add_host': {'host': 'n-h2-852296-2'}}} Aug 10 17:49:52.671703 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:49:52.671703 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:49:52.671703 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 10 17:49:52.671703 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 10 17:49:52.671703 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 10 17:49:52.671703 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 10 17:49:52.671703 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 10 17:49:52.671703 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 10 17:49:52.671703 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 10 17:49:52.671703 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 10 17:49:52.671703 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 10 17:49:52.671703 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 10 17:49:52.671703 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 10 17:49:52.671703 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result.read() Aug 10 17:49:52.671703 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 10 17:49:52.671703 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 10 17:49:52.671703 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 10 17:49:52.671703 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 10 17:49:52.672739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 10 17:49:52.672739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 10 17:49:52.672739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 10 17:49:52.672739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 10 17:49:52.672739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h2-852296-2-4' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Aug 10 17:49:52.672739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:49:52.672739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 10 17:49:52.672739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:49:52.672739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:49:52.672739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Aug 10 17:49:52.672739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Aug 10 17:49:52.672739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Aug 10 17:49:52.672739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi session.flush() Aug 10 17:49:52.672739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 10 17:49:52.672739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._flush(objects) Aug 10 17:49:52.672739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 10 17:49:52.672739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Aug 10 17:49:52.672739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 10 17:49:52.672739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi compat.raise_( Aug 10 17:49:52.673762 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 10 17:49:52.673762 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exception Aug 10 17:49:52.673762 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 10 17:49:52.673762 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi flush_context.execute() Aug 10 17:49:52.673762 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 10 17:49:52.673762 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi rec.execute(self) Aug 10 17:49:52.673762 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 10 17:49:52.673762 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Aug 10 17:49:52.673762 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 10 17:49:52.673762 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Aug 10 17:49:52.673762 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 10 17:49:52.673762 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Aug 10 17:49:52.673762 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 10 17:49:52.673762 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Aug 10 17:49:52.673762 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 10 17:49:52.673762 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Aug 10 17:49:52.673762 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 10 17:49:52.673762 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Aug 10 17:49:52.674732 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 10 17:49:52.674732 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Aug 10 17:49:52.674732 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 10 17:49:52.674732 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 10 17:49:52.674732 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 10 17:49:52.674732 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exception Aug 10 17:49:52.674732 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 10 17:49:52.674732 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 10 17:49:52.674732 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 10 17:49:52.674732 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 10 17:49:52.674732 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 10 17:49:52.674732 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 10 17:49:52.674732 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 10 17:49:52.674732 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 10 17:49:52.674732 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 10 17:49:52.674732 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 10 17:49:52.674732 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 10 17:49:52.674732 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result.read() Aug 10 17:49:52.675734 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 10 17:49:52.675734 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 10 17:49:52.675734 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 10 17:49:52.675734 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 10 17:49:52.675734 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 10 17:49:52.675734 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 10 17:49:52.675734 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 10 17:49:52.675734 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 10 17:49:52.675734 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h2-852296-2-4' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Aug 10 17:49:52.675734 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Aug 10 17:49:52.675734 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 8, 10, 17, 49, 52, 559376), 'updated_at': None, 'host': 'n-h2-852296-2', 'aggregate_id': 4}] Aug 10 17:49:52.675734 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 10 17:49:52.675734 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:49:52.675734 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:49:52.675734 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:49:52.675734 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:49:52.675734 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Aug 10 17:49:52.684143 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Aug 10 17:49:52.684143 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 10 17:49:52.684143 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 10 17:49:52.684143 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 10 17:49:52.684143 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 10 17:49:52.684143 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 10 17:49:52.684143 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise self.value Aug 10 17:49:52.684143 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 10 17:49:52.684143 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 10 17:49:52.684143 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6594, in add_host_to_aggregate Aug 10 17:49:52.684143 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Aug 10 17:49:52.684143 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 10 17:49:52.684143 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 10 17:49:52.684143 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Aug 10 17:49:52.684143 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Aug 10 17:49:52.684143 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Aug 10 17:49:52.684143 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Aug 10 17:49:52.684143 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 4 already has host n-h2-852296-2. Aug 10 17:49:52.684143 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:49:52.684143 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:49:52.686865 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:49:52.686865 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:49:52.686865 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:49:52.686865 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:49:52.686865 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:49:52.686865 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:49:52.686865 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:49:52.686865 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:49:52.686865 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:49:52.686865 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:49:52.686865 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Aug 10 17:49:52.686865 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Aug 10 17:49:52.686865 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 4 already has host n-h2-852296-2. Aug 10 17:49:52.686865 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:49:52.686865 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:49:52.686865 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:49:52.686865 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:49:52.686865 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:49:52.686865 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:49:52.686865 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:49:52.686865 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:49:52.690029 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 4 already has host n-h2-852296-2. Aug 10 17:49:52.690029 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:49:52.690291 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-2edfcde4-ba1e-418a-b9c8-bbf8a85d436f tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f242fdc47104b98882cb29c8ca5caae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b721d6dfb14d3d8780094fc4e72890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:49:52.691089 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-1041e02f-7e62-44ec-88a9-f8eaa91d2b4a tempest-AggregatesAdminNegativeTestJSON-734955950 tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin] Returning 409 to user: Aggregate 4 already has host n-h2-852296-2. {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:49:52.691089 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-1041e02f-7e62-44ec-88a9-f8eaa91d2b4a tempest-AggregatesAdminNegativeTestJSON-734955950 tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/4/action" status: 409 len: 95 microversion: 2.1 time: 0.152499 Aug 10 17:49:52.691089 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 119/240] 10.222.0.50 () {60 vars in 1191 bytes} [Wed Aug 10 17:49:52 2022] POST /compute/v2.1/os-aggregates/4/action => generated 95 bytes in 154 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Aug 10 17:49:52.695024 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-d74717ee-2872-4f68-a7a0-bae03b422435 tempest-AggregatesAdminNegativeTestJSON-734955950 tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-852296-2"}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:49:52.704404 n-d-852296-2 devstack@n-api.service[129410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:49:52.704404 n-d-852296-2 devstack@n-api.service[129410]: warnings.warn(msg) Aug 10 17:49:52.704583 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-2edfcde4-ba1e-418a-b9c8-bbf8a85d436f tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] 10.222.0.50 "GET /compute/v2.1/servers/7e9ff909-ff6f-4d8d-8d84-97af957c6506" status: 200 len: 1220 microversion: 2.1 time: 0.143272 Aug 10 17:49:52.705019 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 122/241] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:49:52 2022] GET /compute/v2.1/servers/7e9ff909-ff6f-4d8d-8d84-97af957c6506 => generated 1220 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:49:52.732623 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d74717ee-2872-4f68-a7a0-bae03b422435 tempest-AggregatesAdminNegativeTestJSON-734955950 tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:52.733319 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d74717ee-2872-4f68-a7a0-bae03b422435 tempest-AggregatesAdminNegativeTestJSON-734955950 tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:52.734517 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d74717ee-2872-4f68-a7a0-bae03b422435 tempest-AggregatesAdminNegativeTestJSON-734955950 tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:53.199062 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-d74717ee-2872-4f68-a7a0-bae03b422435 tempest-AggregatesAdminNegativeTestJSON-734955950 tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 227 microversion: 2.1 time: 0.510918 Aug 10 17:49:53.200052 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 120/242] 10.222.0.50 () {60 vars in 1191 bytes} [Wed Aug 10 17:49:52 2022] POST /compute/v2.1/os-aggregates/4/action => generated 227 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:49:53.219694 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-7e5f3e28-c995-481a-a3eb-e8112f8dc616 tempest-AggregatesAdminNegativeTestJSON-734955950 tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:53.219694 n-d-852296-2 devstack@n-api.service[129409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:49:53.219694 n-d-852296-2 devstack@n-api.service[129409]: warnings.warn(msg) Aug 10 17:49:53.417720 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-7e5f3e28-c995-481a-a3eb-e8112f8dc616 tempest-AggregatesAdminNegativeTestJSON-734955950 tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.210126 Aug 10 17:49:53.425650 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 123/243] 10.222.0.50 () {58 vars in 1152 bytes} [Wed Aug 10 17:49:53 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 10 17:49:53.432818 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-4affe46c-24f2-4560-99f9-01bec35b18f1 tempest-AggregatesAdminNegativeTestJSON-734955950 tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-924915489"}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:49:53.435862 n-d-852296-2 devstack@n-api.service[129410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:49:53.435862 n-d-852296-2 devstack@n-api.service[129410]: warnings.warn(msg) Aug 10 17:49:53.436924 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.objects.aggregate [None req-4affe46c-24f2-4560-99f9-01bec35b18f1 tempest-AggregatesAdminNegativeTestJSON-734955950 tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin] Generated uuid f8a3c0de-cdf5-4c9e-96a9-c0e99ab438be for aggregate {{(pid=129410) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 10 17:49:53.516827 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-9cec1e65-e7aa-4fc9-a790-63bc62f1f6cb tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-541664176"}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:49:53.520066 n-d-852296-2 devstack@n-api.service[129409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:49:53.520066 n-d-852296-2 devstack@n-api.service[129409]: warnings.warn(msg) Aug 10 17:49:53.521049 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.objects.aggregate [None req-9cec1e65-e7aa-4fc9-a790-63bc62f1f6cb tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] Generated uuid f9a0c7bb-d4fe-4ad8-a8b0-e74f46795aa2 for aggregate {{(pid=129409) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 10 17:49:53.574079 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-4affe46c-24f2-4560-99f9-01bec35b18f1 tempest-AggregatesAdminNegativeTestJSON-734955950 tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.148874 Aug 10 17:49:53.575002 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 121/244] 10.222.0.50 () {60 vars in 1164 bytes} [Wed Aug 10 17:49:53 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:49:53.660699 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-9cec1e65-e7aa-4fc9-a790-63bc62f1f6cb tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.150802 Aug 10 17:49:53.661630 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 124/245] 10.222.0.50 () {60 vars in 1164 bytes} [Wed Aug 10 17:49:53 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:49:53.674117 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-645831c5-4fa4-4354-8da2-0338fabe6799 tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-852296-2"}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:49:53.681839 n-d-852296-2 devstack@n-api.service[129409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:49:53.681839 n-d-852296-2 devstack@n-api.service[129409]: warnings.warn(msg) Aug 10 17:49:53.739075 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-645831c5-4fa4-4354-8da2-0338fabe6799 tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:53.739595 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-645831c5-4fa4-4354-8da2-0338fabe6799 tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:53.743770 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-645831c5-4fa4-4354-8da2-0338fabe6799 tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:53.949899 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-ad9468a2-8178-461f-b96b-5e82defdcf29 tempest-AggregatesAdminNegativeTestJSON-1827635580 tempest-AggregatesAdminNegativeTestJSON-1827635580-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-852296-2"}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:49:53.953414 n-d-852296-2 devstack@n-api.service[129410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:49:53.953414 n-d-852296-2 devstack@n-api.service[129410]: warnings.warn(msg) Aug 10 17:49:53.954691 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-ad9468a2-8178-461f-b96b-5e82defdcf29 tempest-AggregatesAdminNegativeTestJSON-1827635580 tempest-AggregatesAdminNegativeTestJSON-1827635580-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': 'c9987b20fcac4cda950c2e3df182b032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cb25a6949b42b58732402ae05f6198', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:49:53.958398 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-ad9468a2-8178-461f-b96b-5e82defdcf29 tempest-AggregatesAdminNegativeTestJSON-1827635580 tempest-AggregatesAdminNegativeTestJSON-1827635580-project] Request method failure captured: Aug 10 17:49:53.958398 n-d-852296-2 devstack@n-api.service[129410]: request: POST /compute/v2.1/os-aggregates/5/action HTTP/1.1 Aug 10 17:49:53.958398 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 17:49:53.958398 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 17:49:53.958398 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 17:49:53.958398 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 39 Aug 10 17:49:53.958398 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 17:49:53.958398 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 17:49:53.958398 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 17:49:53.958398 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 17:49:53.958398 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8--BhZ_ASJqc84aYTnO7aQpuVDeONca1CX474xJ14h-b-uW2MUffMGHSgJWjYRN3p9o1cElv-yNB-MZH5MH5irxiDf3dRJiNnKCMFw3_hkxJM7CT2rEzXVBPenTitk4X93SODDB17foMPBbZVdjE-FR_u9ZHmrVa8eTkl-QsrT_nsJU Aug 10 17:49:53.958398 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 17:49:53.958398 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 17:49:53.958398 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 17:49:53.958398 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 17:49:53.958398 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 17:49:53.958398 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 17:49:53.958398 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: 44cb25a6949b42b58732402ae05f6198 Aug 10 17:49:53.958398 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1827635580 Aug 10 17:49:53.958398 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 17:49:53.958398 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 17:49:53.959665 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/44cb25a6949b42b58732402ae05f6198"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/44cb25a6949b42b58732402ae05f6198"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/44cb25a6949b42b58732402ae05f6198"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_44cb25a6949b42b58732402ae05f6198", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:49:53.959665 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1827635580 Aug 10 17:49:53.959665 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: 44cb25a6949b42b58732402ae05f6198 Aug 10 17:49:53.959665 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1827635580 Aug 10 17:49:53.959665 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-AggregatesAdminNegativeTestJSON-1827635580-project Aug 10 17:49:53.959665 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 17:49:53.959665 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 17:49:53.959665 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: c9987b20fcac4cda950c2e3df182b032 Aug 10 17:49:53.959665 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1827635580-project Aug 10 17:49:53.959665 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 17:49:53.959665 n-d-852296-2 devstack@n-api.service[129410]: {"add_host": {"host": "n-h2-852296-2"}} Aug 10 17:49:53.959665 n-d-852296-2 devstack@n-api.service[129410]: method: > Aug 10 17:49:53.959665 n-d-852296-2 devstack@n-api.service[129410]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Aug 10 17:49:53.960443 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'id': '5', 'body': {'add_host': {'host': 'n-h2-852296-2'}}} Aug 10 17:49:53.960443 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:49:53.960443 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:49:53.960443 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:49:53.960443 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:49:53.960443 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:49:53.960443 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:49:53.960443 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:49:53.960443 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:49:53.960443 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:49:53.960443 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:49:53.960443 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Aug 10 17:49:53.960443 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Aug 10 17:49:53.960443 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 10 17:49:53.960443 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 10 17:49:53.960443 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 10 17:49:53.960443 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 10 17:49:53.960443 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 10 17:49:53.960443 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 10 17:49:53.962262 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 10 17:49:53.962262 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise self.value Aug 10 17:49:53.962262 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 10 17:49:53.962262 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 10 17:49:53.962262 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 10 17:49:53.962262 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 10 17:49:53.962262 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 10 17:49:53.962262 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 10 17:49:53.962262 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Aug 10 17:49:53.962262 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:49:53.962262 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:49:53.962262 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:49:53.962262 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:49:53.962262 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:49:53.962262 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:49:53.962262 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 10 17:49:53.962262 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 10 17:49:53.962262 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Aug 10 17:49:53.962262 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:49:53.968935 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-ad9468a2-8178-461f-b96b-5e82defdcf29 tempest-AggregatesAdminNegativeTestJSON-1827635580 tempest-AggregatesAdminNegativeTestJSON-1827635580-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:49:53.970165 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-ad9468a2-8178-461f-b96b-5e82defdcf29 tempest-AggregatesAdminNegativeTestJSON-1827635580 tempest-AggregatesAdminNegativeTestJSON-1827635580-project] 10.222.0.50 "POST /compute/v2.1/os-aggregates/5/action" status: 403 len: 118 microversion: 2.1 time: 0.383475 Aug 10 17:49:53.974145 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 122/246] 10.222.0.50 () {60 vars in 1191 bytes} [Wed Aug 10 17:49:53 2022] POST /compute/v2.1/os-aggregates/5/action => generated 118 bytes in 388 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 10 17:49:53.985687 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-3f0d37b5-5324-40ff-8055-7d8a4c5ffaed tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:53.986411 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-3f0d37b5-5324-40ff-8055-7d8a4c5ffaed tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] [instance: 7e9ff909-ff6f-4d8d-8d84-97af957c6506] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:49:53.998477 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-3f0d37b5-5324-40ff-8055-7d8a4c5ffaed tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:54.003115 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-3f0d37b5-5324-40ff-8055-7d8a4c5ffaed tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:54.003581 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-3f0d37b5-5324-40ff-8055-7d8a4c5ffaed tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:54.005925 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-3f0d37b5-5324-40ff-8055-7d8a4c5ffaed tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:54.006408 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-3f0d37b5-5324-40ff-8055-7d8a4c5ffaed tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:54.007171 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-3f0d37b5-5324-40ff-8055-7d8a4c5ffaed tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:54.239494 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-645831c5-4fa4-4354-8da2-0338fabe6799 tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 241 microversion: 2.1 time: 0.569443 Aug 10 17:49:54.244623 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 125/247] 10.222.0.50 () {60 vars in 1191 bytes} [Wed Aug 10 17:49:53 2022] POST /compute/v2.1/os-aggregates/6/action => generated 241 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:49:54.250649 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-8861cff5-7dae-47a1-b418-acb17ea45ae4 tempest-AggregatesAdminNegativeTestJSON-734955950 tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:54.251797 n-d-852296-2 devstack@n-api.service[129409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:49:54.251797 n-d-852296-2 devstack@n-api.service[129409]: warnings.warn(msg) Aug 10 17:49:54.253300 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-3f0d37b5-5324-40ff-8055-7d8a4c5ffaed tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f242fdc47104b98882cb29c8ca5caae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b721d6dfb14d3d8780094fc4e72890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:49:54.273773 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-3f0d37b5-5324-40ff-8055-7d8a4c5ffaed tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] 10.222.0.50 "GET /compute/v2.1/servers/7e9ff909-ff6f-4d8d-8d84-97af957c6506" status: 200 len: 1224 microversion: 2.1 time: 0.298071 Aug 10 17:49:54.274375 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 123/248] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:49:53 2022] GET /compute/v2.1/servers/7e9ff909-ff6f-4d8d-8d84-97af957c6506 => generated 1224 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:49:54.307119 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-3a2a9db1-faab-4f63-963f-8c5de6a588d4 tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:54.308001 n-d-852296-2 devstack@n-api.service[129410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:49:54.308001 n-d-852296-2 devstack@n-api.service[129410]: warnings.warn(msg) Aug 10 17:49:54.335381 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-3a2a9db1-faab-4f63-963f-8c5de6a588d4 tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] 10.222.0.50 "GET /compute/v2.1/os-aggregates" status: 200 len: 457 microversion: 2.1 time: 0.059937 Aug 10 17:49:54.346672 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 124/249] 10.222.0.50 () {58 vars in 1143 bytes} [Wed Aug 10 17:49:54 2022] GET /compute/v2.1/os-aggregates => generated 457 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:49:54.352364 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-e366c14c-0a88-463f-8c44-a7216a6b899e tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-852296-2"}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:49:54.369049 n-d-852296-2 devstack@n-api.service[129410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:49:54.369049 n-d-852296-2 devstack@n-api.service[129410]: warnings.warn(msg) Aug 10 17:49:54.401403 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e366c14c-0a88-463f-8c44-a7216a6b899e tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:54.402309 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e366c14c-0a88-463f-8c44-a7216a6b899e tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:54.403606 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e366c14c-0a88-463f-8c44-a7216a6b899e tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:54.472160 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-8861cff5-7dae-47a1-b418-acb17ea45ae4 tempest-AggregatesAdminNegativeTestJSON-734955950 tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.226351 Aug 10 17:49:54.473375 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 126/250] 10.222.0.50 () {58 vars in 1152 bytes} [Wed Aug 10 17:49:54 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 10 17:49:54.485302 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-1b6b61fa-a59f-4c92-b88a-8b598f6fa1c8 tempest-AggregatesAdminNegativeTestJSON-734955950 tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-578131597"}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:49:54.497983 n-d-852296-2 devstack@n-api.service[129409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:49:54.497983 n-d-852296-2 devstack@n-api.service[129409]: warnings.warn(msg) Aug 10 17:49:54.504751 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.objects.aggregate [None req-1b6b61fa-a59f-4c92-b88a-8b598f6fa1c8 tempest-AggregatesAdminNegativeTestJSON-734955950 tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin] Generated uuid 7979a478-fead-426c-a2ee-52373262ce80 for aggregate {{(pid=129409) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 10 17:49:54.640201 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-1b6b61fa-a59f-4c92-b88a-8b598f6fa1c8 tempest-AggregatesAdminNegativeTestJSON-734955950 tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.159468 Aug 10 17:49:54.642717 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 127/251] 10.222.0.50 () {60 vars in 1164 bytes} [Wed Aug 10 17:49:54 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:49:54.661247 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-fed5676a-b830-45ea-a628-540ce932c60a tempest-AggregatesAdminNegativeTestJSON-734955950 tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-820518532"}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:49:54.664370 n-d-852296-2 devstack@n-api.service[129409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:49:54.664370 n-d-852296-2 devstack@n-api.service[129409]: warnings.warn(msg) Aug 10 17:49:54.674576 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-fed5676a-b830-45ea-a628-540ce932c60a tempest-AggregatesAdminNegativeTestJSON-734955950 tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:54.675188 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-fed5676a-b830-45ea-a628-540ce932c60a tempest-AggregatesAdminNegativeTestJSON-734955950 tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:54.675666 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-fed5676a-b830-45ea-a628-540ce932c60a tempest-AggregatesAdminNegativeTestJSON-734955950 tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:54.687523 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-fed5676a-b830-45ea-a628-540ce932c60a tempest-AggregatesAdminNegativeTestJSON-734955950 tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:54.688151 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-fed5676a-b830-45ea-a628-540ce932c60a tempest-AggregatesAdminNegativeTestJSON-734955950 tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:54.688694 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-fed5676a-b830-45ea-a628-540ce932c60a tempest-AggregatesAdminNegativeTestJSON-734955950 tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:54.702038 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-fed5676a-b830-45ea-a628-540ce932c60a tempest-AggregatesAdminNegativeTestJSON-734955950 tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-820518532 could not be found. Aug 10 17:49:54.719195 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-fed5676a-b830-45ea-a628-540ce932c60a tempest-AggregatesAdminNegativeTestJSON-734955950 tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin] Request method failure captured: Aug 10 17:49:54.719195 n-d-852296-2 devstack@n-api.service[129409]: request: POST /compute/v2.1/os-aggregates/7/action HTTP/1.1 Aug 10 17:49:54.719195 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 17:49:54.719195 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 17:49:54.719195 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 17:49:54.719195 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 57 Aug 10 17:49:54.719195 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 17:49:54.719195 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 17:49:54.719195 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 17:49:54.719195 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 17:49:54.719195 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8--FinhXlxx8IFKnpFpAT2Mo9QKfGxddI_iKMGNb1Cjl8iSxKagj8DS2koXne8dIwX5_FVGCNTdOoyiHy2-sqqTjQfCR9EdEKc3gZynR9hJpVzE6YDP0hjcv2eKwEJp7WPPXp_BMt0f15rXmrKAPP-NUjl5gpiR7Muqr5uV0EQw-IDk Aug 10 17:49:54.719195 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 17:49:54.719195 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 17:49:54.719195 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 17:49:54.719195 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 17:49:54.719195 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 17:49:54.719195 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 17:49:54.719195 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: 812966d76c404431a451a541b1d1e58d Aug 10 17:49:54.719195 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-734955950 Aug 10 17:49:54.719195 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member,admin Aug 10 17:49:54.719195 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member,admin Aug 10 17:49:54.720850 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/812966d76c404431a451a541b1d1e58d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/812966d76c404431a451a541b1d1e58d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/812966d76c404431a451a541b1d1e58d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_812966d76c404431a451a541b1d1e58d", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:49:54.720850 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-734955950 Aug 10 17:49:54.720850 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: 812966d76c404431a451a541b1d1e58d Aug 10 17:49:54.720850 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-734955950 Aug 10 17:49:54.720850 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin Aug 10 17:49:54.720850 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 17:49:54.720850 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 17:49:54.720850 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: 32c6d09f10a94ddeb38b0185705b6740 Aug 10 17:49:54.720850 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin Aug 10 17:49:54.720850 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:49:54.720850 n-d-852296-2 devstack@n-api.service[129409]: {"add_host": {"host": "tempest-nonexist_host-820518532"}} Aug 10 17:49:54.720850 n-d-852296-2 devstack@n-api.service[129409]: method: > Aug 10 17:49:54.720850 n-d-852296-2 devstack@n-api.service[129409]: exception: Compute host tempest-nonexist_host-820518532 could not be found. Aug 10 17:49:54.721738 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'id': '7', 'body': {'add_host': {'host': 'tempest-nonexist_host-820518532'}}} Aug 10 17:49:54.721738 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:49:54.721738 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:49:54.721738 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5949, in _get_service_in_cell_by_host Aug 10 17:49:54.721738 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Aug 10 17:49:54.721738 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 17:49:54.721738 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 17:49:54.721738 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 10 17:49:54.721738 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 10 17:49:54.721738 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 10 17:49:54.721738 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 10 17:49:54.721738 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 10 17:49:54.721738 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 10 17:49:54.721738 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-820518532' is not mapped to any cell Aug 10 17:49:54.721738 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:49:54.721738 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:49:54.721738 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:49:54.721738 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:49:54.721738 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5955, in _get_service_in_cell_by_host Aug 10 17:49:54.722796 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Aug 10 17:49:54.722796 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6017, in _find_service_in_cell Aug 10 17:49:54.722796 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 10 17:49:54.722796 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 10 17:49:54.722796 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:49:54.722796 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:49:54.722796 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:49:54.722796 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:49:54.722796 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Aug 10 17:49:54.722796 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Aug 10 17:49:54.722796 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 10 17:49:54.722796 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 10 17:49:54.722796 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 10 17:49:54.722796 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 10 17:49:54.722796 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 10 17:49:54.722796 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise self.value Aug 10 17:49:54.722796 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 10 17:49:54.722796 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 10 17:49:54.722796 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6574, in add_host_to_aggregate Aug 10 17:49:54.722796 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Aug 10 17:49:54.724859 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5957, in _get_service_in_cell_by_host Aug 10 17:49:54.724859 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Aug 10 17:49:54.724859 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-820518532 could not be found. Aug 10 17:49:54.724859 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:49:54.724859 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:49:54.724859 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:49:54.724859 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:49:54.724859 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:49:54.724859 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:49:54.724859 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:49:54.724859 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:49:54.724859 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:49:54.724859 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:49:54.724859 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:49:54.724859 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:49:54.724859 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Aug 10 17:49:54.724859 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:49:54.724859 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-820518532 could not be found. Aug 10 17:49:54.724859 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:49:54.724859 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:49:54.724859 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:49:54.726247 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:49:54.726247 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:49:54.726247 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:49:54.726247 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:49:54.726247 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:49:54.726247 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-820518532 could not be found. Aug 10 17:49:54.726247 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:49:54.728762 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-fed5676a-b830-45ea-a628-540ce932c60a tempest-AggregatesAdminNegativeTestJSON-734955950 tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-820518532 could not be found. {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:49:54.729806 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-fed5676a-b830-45ea-a628-540ce932c60a tempest-AggregatesAdminNegativeTestJSON-734955950 tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/7/action" status: 404 len: 110 microversion: 2.1 time: 0.079721 Aug 10 17:49:54.730539 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 128/252] 10.222.0.50 () {60 vars in 1191 bytes} [Wed Aug 10 17:49:54 2022] POST /compute/v2.1/os-aggregates/7/action => generated 110 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 17:49:54.740426 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-a0c687ff-4e9e-48eb-ae57-3268cbf74300 tempest-AggregatesAdminNegativeTestJSON-734955950 tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:54.742012 n-d-852296-2 devstack@n-api.service[129409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:49:54.742012 n-d-852296-2 devstack@n-api.service[129409]: warnings.warn(msg) Aug 10 17:49:54.877914 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-e366c14c-0a88-463f-8c44-a7216a6b899e tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 226 microversion: 2.1 time: 0.529446 Aug 10 17:49:54.879384 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 125/253] 10.222.0.50 () {60 vars in 1191 bytes} [Wed Aug 10 17:49:54 2022] POST /compute/v2.1/os-aggregates/6/action => generated 226 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:49:54.903561 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-8b0b00b3-31f2-451c-85d9-00cde5a4e065 tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:54.905079 n-d-852296-2 devstack@n-api.service[129410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:49:54.905079 n-d-852296-2 devstack@n-api.service[129410]: warnings.warn(msg) Aug 10 17:49:54.995242 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-a0c687ff-4e9e-48eb-ae57-3268cbf74300 tempest-AggregatesAdminNegativeTestJSON-734955950 tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.259337 Aug 10 17:49:55.003709 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 129/254] 10.222.0.50 () {58 vars in 1152 bytes} [Wed Aug 10 17:49:54 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 10 17:49:55.060926 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-8b0b00b3-31f2-451c-85d9-00cde5a4e065 tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.167124 Aug 10 17:49:55.068463 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 126/255] 10.222.0.50 () {58 vars in 1152 bytes} [Wed Aug 10 17:49:54 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 10 17:49:55.085043 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-ad3c7314-a300-43ec-9ea4-572fd50734f1 tempest-AggregatesAdminNegativeTestJSON-734955950 tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:49:55.088546 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-6b3002f1-bd0e-4324-9db8-7a144b18a3ca tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-992743550"}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:49:55.096345 n-d-852296-2 devstack@n-api.service[129410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:49:55.096345 n-d-852296-2 devstack@n-api.service[129410]: warnings.warn(msg) Aug 10 17:49:55.101022 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.objects.aggregate [None req-6b3002f1-bd0e-4324-9db8-7a144b18a3ca tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] Generated uuid c8cec384-c1ad-49d9-9ba9-9d2b8abb226e for aggregate {{(pid=129410) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 10 17:49:55.116752 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-ad3c7314-a300-43ec-9ea4-572fd50734f1 tempest-AggregatesAdminNegativeTestJSON-734955950 tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin] Request method failure captured: Aug 10 17:49:55.116752 n-d-852296-2 devstack@n-api.service[129409]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 10 17:49:55.116752 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 17:49:55.116752 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 17:49:55.116752 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 17:49:55.116752 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 283 Aug 10 17:49:55.116752 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 17:49:55.116752 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 17:49:55.116752 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 17:49:55.116752 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 17:49:55.116752 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8--FinhXlxx8IFKnpFpAT2Mo9QKfGxddI_iKMGNb1Cjl8iSxKagj8DS2koXne8dIwX5_FVGCNTdOoyiHy2-sqqTjQfCR9EdEKc3gZynR9hJpVzE6YDP0hjcv2eKwEJp7WPPXp_BMt0f15rXmrKAPP-NUjl5gpiR7Muqr5uV0EQw-IDk Aug 10 17:49:55.116752 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 17:49:55.116752 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 17:49:55.116752 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 17:49:55.116752 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 17:49:55.116752 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 17:49:55.116752 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 17:49:55.116752 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: 812966d76c404431a451a541b1d1e58d Aug 10 17:49:55.116752 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-734955950 Aug 10 17:49:55.116752 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member,admin Aug 10 17:49:55.116752 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member,admin Aug 10 17:49:55.118470 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/812966d76c404431a451a541b1d1e58d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/812966d76c404431a451a541b1d1e58d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/812966d76c404431a451a541b1d1e58d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_812966d76c404431a451a541b1d1e58d", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:49:55.118470 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-734955950 Aug 10 17:49:55.118470 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: 812966d76c404431a451a541b1d1e58d Aug 10 17:49:55.118470 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-734955950 Aug 10 17:49:55.118470 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin Aug 10 17:49:55.118470 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 17:49:55.118470 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 17:49:55.118470 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: 32c6d09f10a94ddeb38b0185705b6740 Aug 10 17:49:55.118470 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin Aug 10 17:49:55.118470 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:49:55.119269 n-d-852296-2 devstack@n-api.service[129409]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Aug 10 17:49:55.119269 n-d-852296-2 devstack@n-api.service[129409]: method: > Aug 10 17:49:55.119269 n-d-852296-2 devstack@n-api.service[129409]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 10 17:49:55.119269 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Aug 10 17:49:55.119269 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:49:55.119269 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:49:55.119269 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 10 17:49:55.119269 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 10 17:49:55.119269 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 10 17:49:55.119269 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise error Aug 10 17:49:55.119957 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 10 17:49:55.119957 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:49:55.119957 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Aug 10 17:49:55.119957 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 10 17:49:55.119957 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:49:55.119957 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Aug 10 17:49:55.119957 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 10 17:49:55.119957 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:49:55.119957 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:49:55.119957 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:49:55.119957 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:49:55.119957 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:49:55.119957 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:49:55.119957 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:49:55.119957 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:49:55.119957 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:49:55.119957 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:49:55.121052 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:49:55.121052 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:49:55.121052 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 10 17:49:55.121052 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 10 17:49:55.121052 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 10 17:49:55.121052 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 10 17:49:55.121052 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 10 17:49:55.121052 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 10 17:49:55.121052 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 10 17:49:55.121052 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:49:55.121052 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:49:55.121052 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:49:55.121052 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:49:55.121052 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:49:55.121052 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:49:55.122174 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 10 17:49:55.122174 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 10 17:49:55.122174 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 10 17:49:55.122174 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:49:55.123279 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-ad3c7314-a300-43ec-9ea4-572fd50734f1 tempest-AggregatesAdminNegativeTestJSON-734955950 tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:49:55.124811 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-ad3c7314-a300-43ec-9ea4-572fd50734f1 tempest-AggregatesAdminNegativeTestJSON-734955950 tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.119610 Aug 10 17:49:55.125747 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 130/256] 10.222.0.50 () {60 vars in 1165 bytes} [Wed Aug 10 17:49:55 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 121 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 10 17:49:55.239950 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-6b3002f1-bd0e-4324-9db8-7a144b18a3ca tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.167834 Aug 10 17:49:55.240927 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 127/257] 10.222.0.50 () {60 vars in 1164 bytes} [Wed Aug 10 17:49:55 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:49:55.246081 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-d5a7c5d0-bcb2-4f02-8c66-c2b5646fb344 tempest-AggregatesAdminNegativeTestJSON-734955950 tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:49:55.256319 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-d5a7c5d0-bcb2-4f02-8c66-c2b5646fb344 tempest-AggregatesAdminNegativeTestJSON-734955950 tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin] Request method failure captured: Aug 10 17:49:55.256319 n-d-852296-2 devstack@n-api.service[129410]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 10 17:49:55.256319 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 17:49:55.256319 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 17:49:55.256319 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 17:49:55.256319 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 27 Aug 10 17:49:55.256319 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 17:49:55.256319 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 17:49:55.256319 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 17:49:55.256319 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 17:49:55.256319 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8--FinhXlxx8IFKnpFpAT2Mo9QKfGxddI_iKMGNb1Cjl8iSxKagj8DS2koXne8dIwX5_FVGCNTdOoyiHy2-sqqTjQfCR9EdEKc3gZynR9hJpVzE6YDP0hjcv2eKwEJp7WPPXp_BMt0f15rXmrKAPP-NUjl5gpiR7Muqr5uV0EQw-IDk Aug 10 17:49:55.256319 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 17:49:55.256319 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 17:49:55.256319 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 17:49:55.256319 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 17:49:55.256319 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 17:49:55.256319 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 17:49:55.256319 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: 812966d76c404431a451a541b1d1e58d Aug 10 17:49:55.256319 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-734955950 Aug 10 17:49:55.256319 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member,admin Aug 10 17:49:55.256319 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member,admin Aug 10 17:49:55.258151 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/812966d76c404431a451a541b1d1e58d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/812966d76c404431a451a541b1d1e58d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/812966d76c404431a451a541b1d1e58d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_812966d76c404431a451a541b1d1e58d", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:49:55.258151 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-734955950 Aug 10 17:49:55.258151 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: 812966d76c404431a451a541b1d1e58d Aug 10 17:49:55.258151 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-734955950 Aug 10 17:49:55.258151 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin Aug 10 17:49:55.258151 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 17:49:55.258151 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 17:49:55.258151 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: 32c6d09f10a94ddeb38b0185705b6740 Aug 10 17:49:55.258151 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin Aug 10 17:49:55.258151 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 17:49:55.258151 n-d-852296-2 devstack@n-api.service[129410]: {"aggregate": {"name": ""}} Aug 10 17:49:55.258151 n-d-852296-2 devstack@n-api.service[129410]: method: > Aug 10 17:49:55.258151 n-d-852296-2 devstack@n-api.service[129410]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 10 17:49:55.258870 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'body': {'aggregate': {'name': ''}}} Aug 10 17:49:55.258870 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:49:55.258870 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:49:55.258870 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 10 17:49:55.258870 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 10 17:49:55.258870 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 10 17:49:55.258870 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise error Aug 10 17:49:55.258870 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 10 17:49:55.258870 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:49:55.258870 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Aug 10 17:49:55.258870 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 10 17:49:55.258870 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:49:55.258870 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Aug 10 17:49:55.258870 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi '' Aug 10 17:49:55.258870 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:49:55.258870 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:49:55.258870 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:49:55.258870 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:49:55.258870 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:49:55.258870 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:49:55.258870 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:49:55.258870 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:49:55.258870 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:49:55.260236 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:49:55.260236 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:49:55.260236 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:49:55.260236 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 10 17:49:55.260236 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 10 17:49:55.260236 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 10 17:49:55.260236 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 10 17:49:55.260236 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 10 17:49:55.260236 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 10 17:49:55.260236 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 10 17:49:55.260236 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:49:55.260236 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:49:55.260236 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:49:55.260236 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:49:55.260236 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:49:55.260236 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:49:55.260236 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 10 17:49:55.260236 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 10 17:49:55.260236 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 10 17:49:55.260236 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:49:55.264014 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-d5a7c5d0-bcb2-4f02-8c66-c2b5646fb344 tempest-AggregatesAdminNegativeTestJSON-734955950 tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:49:55.265472 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-d5a7c5d0-bcb2-4f02-8c66-c2b5646fb344 tempest-AggregatesAdminNegativeTestJSON-734955950 tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.023344 Aug 10 17:49:55.278107 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 128/258] 10.222.0.50 () {60 vars in 1164 bytes} [Wed Aug 10 17:49:55 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 10 17:49:55.289952 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-0325aa84-e9f4-4642-9c43-ce9b96d82039 tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-852296-2"}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:49:55.295189 n-d-852296-2 devstack@n-api.service[129410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:49:55.295189 n-d-852296-2 devstack@n-api.service[129410]: warnings.warn(msg) Aug 10 17:49:55.311098 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-0325aa84-e9f4-4642-9c43-ce9b96d82039 tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:55.315724 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-0325aa84-e9f4-4642-9c43-ce9b96d82039 tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:55.319665 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-0325aa84-e9f4-4642-9c43-ce9b96d82039 tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:55.390689 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-c9339c6e-c83d-40d8-82bd-a125a5339ae8 tempest-FlavorsAccessTestJSON-1040209795 tempest-FlavorsAccessTestJSON-1040209795-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-145165688", "id": 1300362398, "os-flavor-access:is_public": "False"}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:49:55.393843 n-d-852296-2 devstack@n-api.service[129409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:49:55.393843 n-d-852296-2 devstack@n-api.service[129409]: warnings.warn(msg) Aug 10 17:49:55.497303 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-c9339c6e-c83d-40d8-82bd-a125a5339ae8 tempest-FlavorsAccessTestJSON-1040209795 tempest-FlavorsAccessTestJSON-1040209795-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.369760 Aug 10 17:49:55.499060 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 131/259] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 17:49:55 2022] POST /compute/v2.1/flavors => generated 430 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:49:55.511792 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-4b15c8d6-6155-49ff-b2bc-e931cbca1e40 tempest-AggregatesAdminNegativeTestJSON-1827635580 tempest-AggregatesAdminNegativeTestJSON-1827635580-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-607524745"}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:49:55.520787 n-d-852296-2 devstack@n-api.service[129409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:49:55.520787 n-d-852296-2 devstack@n-api.service[129409]: warnings.warn(msg) Aug 10 17:49:55.525954 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-4b15c8d6-6155-49ff-b2bc-e931cbca1e40 tempest-AggregatesAdminNegativeTestJSON-1827635580 tempest-AggregatesAdminNegativeTestJSON-1827635580-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': 'c9987b20fcac4cda950c2e3df182b032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cb25a6949b42b58732402ae05f6198', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:49:55.530254 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-4b15c8d6-6155-49ff-b2bc-e931cbca1e40 tempest-AggregatesAdminNegativeTestJSON-1827635580 tempest-AggregatesAdminNegativeTestJSON-1827635580-project] Request method failure captured: Aug 10 17:49:55.530254 n-d-852296-2 devstack@n-api.service[129409]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 10 17:49:55.530254 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 17:49:55.530254 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 17:49:55.530254 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 17:49:55.530254 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 59 Aug 10 17:49:55.530254 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 17:49:55.530254 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 17:49:55.530254 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 17:49:55.530254 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 17:49:55.530254 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8--BhZ_ASJqc84aYTnO7aQpuVDeONca1CX474xJ14h-b-uW2MUffMGHSgJWjYRN3p9o1cElv-yNB-MZH5MH5irxiDf3dRJiNnKCMFw3_hkxJM7CT2rEzXVBPenTitk4X93SODDB17foMPBbZVdjE-FR_u9ZHmrVa8eTkl-QsrT_nsJU Aug 10 17:49:55.530254 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 17:49:55.530254 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 17:49:55.530254 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 17:49:55.530254 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 17:49:55.530254 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 17:49:55.530254 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 17:49:55.530254 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: 44cb25a6949b42b58732402ae05f6198 Aug 10 17:49:55.530254 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1827635580 Aug 10 17:49:55.530254 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 17:49:55.530254 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 17:49:55.531600 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/44cb25a6949b42b58732402ae05f6198"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/44cb25a6949b42b58732402ae05f6198"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/44cb25a6949b42b58732402ae05f6198"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_44cb25a6949b42b58732402ae05f6198", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:49:55.531600 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1827635580 Aug 10 17:49:55.531600 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: 44cb25a6949b42b58732402ae05f6198 Aug 10 17:49:55.531600 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1827635580 Aug 10 17:49:55.531600 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-AggregatesAdminNegativeTestJSON-1827635580-project Aug 10 17:49:55.531600 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 17:49:55.531600 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 17:49:55.531600 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: c9987b20fcac4cda950c2e3df182b032 Aug 10 17:49:55.531600 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1827635580-project Aug 10 17:49:55.531600 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:49:55.531600 n-d-852296-2 devstack@n-api.service[129409]: {"aggregate": {"name": "tempest-test_aggregate-607524745"}} Aug 10 17:49:55.531600 n-d-852296-2 devstack@n-api.service[129409]: method: > Aug 10 17:49:55.531600 n-d-852296-2 devstack@n-api.service[129409]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Aug 10 17:49:55.532343 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-607524745'}}} Aug 10 17:49:55.532343 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:49:55.532343 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:49:55.532343 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:49:55.532343 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:49:55.532343 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:49:55.532343 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:49:55.532343 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:49:55.532343 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:49:55.532343 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:49:55.532343 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:49:55.532343 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:49:55.532343 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:49:55.532343 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Aug 10 17:49:55.532343 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Aug 10 17:49:55.532343 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 10 17:49:55.532343 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 10 17:49:55.532343 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 10 17:49:55.532343 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 10 17:49:55.533565 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 10 17:49:55.533565 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 10 17:49:55.533565 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 10 17:49:55.533565 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise self.value Aug 10 17:49:55.533565 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 10 17:49:55.533565 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 10 17:49:55.533565 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 10 17:49:55.533565 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 10 17:49:55.533565 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 10 17:49:55.533565 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 10 17:49:55.533565 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Aug 10 17:49:55.533565 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:49:55.533565 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:49:55.533565 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:49:55.533565 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:49:55.533565 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:49:55.533565 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:49:55.533565 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 10 17:49:55.533565 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 10 17:49:55.533565 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Aug 10 17:49:55.536420 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:49:55.537800 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-4b15c8d6-6155-49ff-b2bc-e931cbca1e40 tempest-AggregatesAdminNegativeTestJSON-1827635580 tempest-AggregatesAdminNegativeTestJSON-1827635580-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:49:55.539883 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-4b15c8d6-6155-49ff-b2bc-e931cbca1e40 tempest-AggregatesAdminNegativeTestJSON-1827635580 tempest-AggregatesAdminNegativeTestJSON-1827635580-project] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.038928 Aug 10 17:49:55.554159 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 132/260] 10.222.0.50 () {60 vars in 1164 bytes} [Wed Aug 10 17:49:55 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 54 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:49:55.583343 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-28e9aa03-f7dd-46eb-bb9d-e040c7860b11 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:55.584233 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-28e9aa03-f7dd-46eb-bb9d-e040c7860b11 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] [instance: 7e9ff909-ff6f-4d8d-8d84-97af957c6506] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:49:55.616101 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-28e9aa03-f7dd-46eb-bb9d-e040c7860b11 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:55.616101 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-28e9aa03-f7dd-46eb-bb9d-e040c7860b11 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:55.616971 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-28e9aa03-f7dd-46eb-bb9d-e040c7860b11 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:55.620150 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-28e9aa03-f7dd-46eb-bb9d-e040c7860b11 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:55.621417 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-28e9aa03-f7dd-46eb-bb9d-e040c7860b11 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:55.622078 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-28e9aa03-f7dd-46eb-bb9d-e040c7860b11 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:55.790864 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-28e9aa03-f7dd-46eb-bb9d-e040c7860b11 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f242fdc47104b98882cb29c8ca5caae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b721d6dfb14d3d8780094fc4e72890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:49:55.799516 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-28e9aa03-f7dd-46eb-bb9d-e040c7860b11 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] 10.222.0.50 "GET /compute/v2.1/servers/7e9ff909-ff6f-4d8d-8d84-97af957c6506" status: 200 len: 1280 microversion: 2.1 time: 0.243335 Aug 10 17:49:55.802021 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 133/261] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:49:55 2022] GET /compute/v2.1/servers/7e9ff909-ff6f-4d8d-8d84-97af957c6506 => generated 1280 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:49:55.807751 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-0d2ecbe6-d532-4493-b024-5dbb230318e0 tempest-FlavorsAccessTestJSON-1040209795 tempest-FlavorsAccessTestJSON-1040209795-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "1d2ac8e9f79f4e72b977203d32be0743"}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:49:55.810290 n-d-852296-2 devstack@n-api.service[129409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:49:55.810290 n-d-852296-2 devstack@n-api.service[129409]: warnings.warn(msg) Aug 10 17:49:55.887491 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-0325aa84-e9f4-4642-9c43-ce9b96d82039 tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 241 microversion: 2.1 time: 0.608004 Aug 10 17:49:55.894367 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 129/262] 10.222.0.50 () {60 vars in 1191 bytes} [Wed Aug 10 17:49:55 2022] POST /compute/v2.1/os-aggregates/8/action => generated 241 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:49:55.894367 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-2f13e5f4-7d71-434a-beb3-6169365e2377 tempest-AggregatesAdminNegativeTestJSON-734955950 tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1203054964"}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:49:55.903780 n-d-852296-2 devstack@n-api.service[129410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:49:55.903780 n-d-852296-2 devstack@n-api.service[129410]: warnings.warn(msg) Aug 10 17:49:55.904961 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.objects.aggregate [None req-2f13e5f4-7d71-434a-beb3-6169365e2377 tempest-AggregatesAdminNegativeTestJSON-734955950 tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin] Generated uuid 2e575e29-e78d-43cf-a865-67f53eaec42f for aggregate {{(pid=129410) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 10 17:49:56.096571 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-2f13e5f4-7d71-434a-beb3-6169365e2377 tempest-AggregatesAdminNegativeTestJSON-734955950 tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.206161 Aug 10 17:49:56.104516 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 130/263] 10.222.0.50 () {60 vars in 1164 bytes} [Wed Aug 10 17:49:55 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:49:56.107305 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-2cef5856-24d8-409d-bb23-d8c71cfb6b0d tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-852296-2"}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:49:56.112950 n-d-852296-2 devstack@n-api.service[129410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:49:56.112950 n-d-852296-2 devstack@n-api.service[129410]: warnings.warn(msg) Aug 10 17:49:56.129785 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2cef5856-24d8-409d-bb23-d8c71cfb6b0d tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:56.130278 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2cef5856-24d8-409d-bb23-d8c71cfb6b0d tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:56.130881 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2cef5856-24d8-409d-bb23-d8c71cfb6b0d tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:56.186813 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-0d2ecbe6-d532-4493-b024-5dbb230318e0 tempest-FlavorsAccessTestJSON-1040209795 tempest-FlavorsAccessTestJSON-1040209795-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors/1300362398/action" status: 200 len: 97 microversion: 2.1 time: 0.383361 Aug 10 17:49:56.190986 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 134/264] 10.222.0.50 () {60 vars in 1200 bytes} [Wed Aug 10 17:49:55 2022] POST /compute/v2.1/flavors/1300362398/action => generated 97 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 17:49:56.196799 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-65a7aff9-f04f-4789-9795-c9f39ca664e5 tempest-AggregatesAdminNegativeTestJSON-734955950 tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1203054964"}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:49:56.200364 n-d-852296-2 devstack@n-api.service[129409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:49:56.200364 n-d-852296-2 devstack@n-api.service[129409]: warnings.warn(msg) Aug 10 17:49:56.201869 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.objects.aggregate [None req-65a7aff9-f04f-4789-9795-c9f39ca664e5 tempest-AggregatesAdminNegativeTestJSON-734955950 tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin] Generated uuid f2ff0a8b-5203-49c8-bec8-2b004b2649e1 for aggregate {{(pid=129409) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 10 17:49:56.230427 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-65a7aff9-f04f-4789-9795-c9f39ca664e5 tempest-AggregatesAdminNegativeTestJSON-734955950 tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-1203054964 already exists. Aug 10 17:49:56.235153 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-65a7aff9-f04f-4789-9795-c9f39ca664e5 tempest-AggregatesAdminNegativeTestJSON-734955950 tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin] Request method failure captured: Aug 10 17:49:56.235153 n-d-852296-2 devstack@n-api.service[129409]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 10 17:49:56.235153 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 17:49:56.235153 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 17:49:56.235153 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 17:49:56.235153 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 60 Aug 10 17:49:56.235153 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 17:49:56.235153 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 17:49:56.235153 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 17:49:56.235153 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 17:49:56.235153 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8--FinhXlxx8IFKnpFpAT2Mo9QKfGxddI_iKMGNb1Cjl8iSxKagj8DS2koXne8dIwX5_FVGCNTdOoyiHy2-sqqTjQfCR9EdEKc3gZynR9hJpVzE6YDP0hjcv2eKwEJp7WPPXp_BMt0f15rXmrKAPP-NUjl5gpiR7Muqr5uV0EQw-IDk Aug 10 17:49:56.235153 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 17:49:56.235153 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 17:49:56.235153 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 17:49:56.235153 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 17:49:56.235153 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 17:49:56.235153 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 17:49:56.235153 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: 812966d76c404431a451a541b1d1e58d Aug 10 17:49:56.235153 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-734955950 Aug 10 17:49:56.235153 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member,admin Aug 10 17:49:56.235153 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member,admin Aug 10 17:49:56.236675 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/812966d76c404431a451a541b1d1e58d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/812966d76c404431a451a541b1d1e58d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/812966d76c404431a451a541b1d1e58d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_812966d76c404431a451a541b1d1e58d", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:49:56.236675 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-734955950 Aug 10 17:49:56.236675 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: 812966d76c404431a451a541b1d1e58d Aug 10 17:49:56.236675 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-734955950 Aug 10 17:49:56.236675 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin Aug 10 17:49:56.236675 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 17:49:56.236675 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 17:49:56.236675 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: 32c6d09f10a94ddeb38b0185705b6740 Aug 10 17:49:56.236675 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin Aug 10 17:49:56.236675 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:49:56.236675 n-d-852296-2 devstack@n-api.service[129409]: {"aggregate": {"name": "tempest-test_aggregate-1203054964"}} Aug 10 17:49:56.236675 n-d-852296-2 devstack@n-api.service[129409]: method: > Aug 10 17:49:56.236675 n-d-852296-2 devstack@n-api.service[129409]: exception: Aggregate tempest-test_aggregate-1203054964 already exists. Aug 10 17:49:56.237520 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1203054964'}}} Aug 10 17:49:56.237520 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:49:56.237520 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:49:56.237520 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Aug 10 17:49:56.237520 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Aug 10 17:49:56.237520 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 10 17:49:56.237520 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 10 17:49:56.237520 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 10 17:49:56.237520 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 10 17:49:56.237520 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 10 17:49:56.237520 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise self.value Aug 10 17:49:56.237520 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 10 17:49:56.237520 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 10 17:49:56.237520 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6411, in create_aggregate Aug 10 17:49:56.237520 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi aggregate.create() Aug 10 17:49:56.237520 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 10 17:49:56.237520 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 10 17:49:56.237520 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Aug 10 17:49:56.237520 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Aug 10 17:49:56.238838 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 10 17:49:56.238838 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 10 17:49:56.238838 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Aug 10 17:49:56.238838 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Aug 10 17:49:56.238838 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-1203054964 already exists. Aug 10 17:49:56.238838 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:49:56.238838 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:49:56.238838 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:49:56.238838 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:49:56.238838 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:49:56.238838 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:49:56.238838 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:49:56.238838 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:49:56.238838 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:49:56.238838 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:49:56.238838 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:49:56.238838 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:49:56.238838 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:49:56.238838 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:49:56.238838 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Aug 10 17:49:56.240214 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Aug 10 17:49:56.240214 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-1203054964 already exists. Aug 10 17:49:56.240214 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:49:56.240214 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:49:56.240214 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:49:56.240214 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:49:56.240214 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:49:56.240214 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:49:56.240214 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:49:56.240214 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:49:56.240214 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-1203054964 already exists. Aug 10 17:49:56.240214 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:49:56.244897 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-65a7aff9-f04f-4789-9795-c9f39ca664e5 tempest-AggregatesAdminNegativeTestJSON-734955950 tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-1203054964 already exists. {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:49:56.249285 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-65a7aff9-f04f-4789-9795-c9f39ca664e5 tempest-AggregatesAdminNegativeTestJSON-734955950 tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 409 len: 111 microversion: 2.1 time: 0.058127 Aug 10 17:49:56.252501 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 135/265] 10.222.0.50 () {60 vars in 1164 bytes} [Wed Aug 10 17:49:56 2022] POST /compute/v2.1/os-aggregates => generated 111 bytes in 61 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 10 17:49:56.394526 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-92e56b0a-5c35-431e-b7b5-4604aa4b412e tempest-FlavorsAccessTestJSON-1713358375 tempest-FlavorsAccessTestJSON-1713358375-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:56.421132 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-92e56b0a-5c35-431e-b7b5-4604aa4b412e tempest-FlavorsAccessTestJSON-1713358375 tempest-FlavorsAccessTestJSON-1713358375-project] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 5411 microversion: 2.1 time: 0.167358 Aug 10 17:49:56.422271 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 136/266] 10.222.0.50 () {58 vars in 1146 bytes} [Wed Aug 10 17:49:56 2022] GET /compute/v2.1/flavors/detail => generated 5411 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:49:56.430695 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-5118a39d-7c1b-4369-a844-0dce60396065 tempest-AggregatesAdminNegativeTestJSON-734955950 tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:56.431710 n-d-852296-2 devstack@n-api.service[129409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:49:56.431710 n-d-852296-2 devstack@n-api.service[129409]: warnings.warn(msg) Aug 10 17:49:56.527585 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-5118a39d-7c1b-4369-a844-0dce60396065 tempest-AggregatesAdminNegativeTestJSON-734955950 tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.103854 Aug 10 17:49:56.528853 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 137/267] 10.222.0.50 () {58 vars in 1152 bytes} [Wed Aug 10 17:49:56 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 10 17:49:56.540023 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-a5f601a6-c713-4a80-8595-e84c64e218b8 tempest-FlavorsAccessTestJSON-1040209795 tempest-FlavorsAccessTestJSON-1040209795-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "1d2ac8e9f79f4e72b977203d32be0743"}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:49:56.552496 n-d-852296-2 devstack@n-api.service[129409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:49:56.552496 n-d-852296-2 devstack@n-api.service[129409]: warnings.warn(msg) Aug 10 17:49:56.553599 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-2cef5856-24d8-409d-bb23-d8c71cfb6b0d tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 226 microversion: 2.1 time: 0.453340 Aug 10 17:49:56.555064 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 131/268] 10.222.0.50 () {60 vars in 1191 bytes} [Wed Aug 10 17:49:56 2022] POST /compute/v2.1/os-aggregates/8/action => generated 226 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:49:56.561325 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-b6943f24-84c0-43a1-90a6-19d29aac6c3d tempest-AggregatesAdminNegativeTestJSON-734955950 tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-117635116"}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:49:56.572423 n-d-852296-2 devstack@n-api.service[129410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:49:56.572423 n-d-852296-2 devstack@n-api.service[129410]: warnings.warn(msg) Aug 10 17:49:56.581336 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.objects.aggregate [None req-b6943f24-84c0-43a1-90a6-19d29aac6c3d tempest-AggregatesAdminNegativeTestJSON-734955950 tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin] Generated uuid 3ab23a99-3559-4130-a851-d12322a06c32 for aggregate {{(pid=129410) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 10 17:49:56.740731 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-b6943f24-84c0-43a1-90a6-19d29aac6c3d tempest-AggregatesAdminNegativeTestJSON-734955950 tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.183324 Aug 10 17:49:56.741861 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 132/269] 10.222.0.50 () {60 vars in 1164 bytes} [Wed Aug 10 17:49:56 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:49:56.747619 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-74e0ad81-b184-455f-a7bb-9bd75c3eba65 tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:56.748631 n-d-852296-2 devstack@n-api.service[129410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:49:56.748631 n-d-852296-2 devstack@n-api.service[129410]: warnings.warn(msg) Aug 10 17:49:56.753102 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_cell0:SELECT=6 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:49:56.856133 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-74e0ad81-b184-455f-a7bb-9bd75c3eba65 tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.111866 Aug 10 17:49:56.859170 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 133/270] 10.222.0.50 () {58 vars in 1152 bytes} [Wed Aug 10 17:49:56 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 10 17:49:56.865541 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-d209d7ce-a74c-435e-a9ec-fadb4a6bd5a8 tempest-AggregatesAdminNegativeTestJSON-1827635580 tempest-AggregatesAdminNegativeTestJSON-1827635580-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:56.866352 n-d-852296-2 devstack@n-api.service[129410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:49:56.866352 n-d-852296-2 devstack@n-api.service[129410]: warnings.warn(msg) Aug 10 17:49:56.871168 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-d209d7ce-a74c-435e-a9ec-fadb4a6bd5a8 tempest-AggregatesAdminNegativeTestJSON-1827635580 tempest-AggregatesAdminNegativeTestJSON-1827635580-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': 'c9987b20fcac4cda950c2e3df182b032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cb25a6949b42b58732402ae05f6198', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:49:56.873165 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-d209d7ce-a74c-435e-a9ec-fadb4a6bd5a8 tempest-AggregatesAdminNegativeTestJSON-1827635580 tempest-AggregatesAdminNegativeTestJSON-1827635580-project] Request method failure captured: Aug 10 17:49:56.873165 n-d-852296-2 devstack@n-api.service[129410]: request: DELETE /compute/v2.1/os-aggregates/10 HTTP/1.1 Aug 10 17:49:56.873165 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 17:49:56.873165 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 17:49:56.873165 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 17:49:56.873165 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 0 Aug 10 17:49:56.873165 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 17:49:56.873165 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 17:49:56.873165 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 17:49:56.873165 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 17:49:56.873165 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8--BhZ_ASJqc84aYTnO7aQpuVDeONca1CX474xJ14h-b-uW2MUffMGHSgJWjYRN3p9o1cElv-yNB-MZH5MH5irxiDf3dRJiNnKCMFw3_hkxJM7CT2rEzXVBPenTitk4X93SODDB17foMPBbZVdjE-FR_u9ZHmrVa8eTkl-QsrT_nsJU Aug 10 17:49:56.873165 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 17:49:56.873165 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 17:49:56.873165 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 17:49:56.873165 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 17:49:56.873165 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 17:49:56.873165 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 17:49:56.873165 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: 44cb25a6949b42b58732402ae05f6198 Aug 10 17:49:56.873165 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1827635580 Aug 10 17:49:56.873165 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 17:49:56.873165 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 17:49:56.874387 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/44cb25a6949b42b58732402ae05f6198"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/44cb25a6949b42b58732402ae05f6198"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/44cb25a6949b42b58732402ae05f6198"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_44cb25a6949b42b58732402ae05f6198", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:49:56.874387 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1827635580 Aug 10 17:49:56.874387 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: 44cb25a6949b42b58732402ae05f6198 Aug 10 17:49:56.874387 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1827635580 Aug 10 17:49:56.874387 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-AggregatesAdminNegativeTestJSON-1827635580-project Aug 10 17:49:56.874387 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 17:49:56.874387 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 17:49:56.874387 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: c9987b20fcac4cda950c2e3df182b032 Aug 10 17:49:56.874387 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1827635580-project Aug 10 17:49:56.874387 n-d-852296-2 devstack@n-api.service[129410]: method: > Aug 10 17:49:56.874387 n-d-852296-2 devstack@n-api.service[129410]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Aug 10 17:49:56.874387 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'id': '10'} Aug 10 17:49:56.875043 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:49:56.875043 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:49:56.875043 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:49:56.875043 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:49:56.875043 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:49:56.875043 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:49:56.875043 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:49:56.875043 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:49:56.875043 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Aug 10 17:49:56.875043 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Aug 10 17:49:56.875043 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 10 17:49:56.875043 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 10 17:49:56.875043 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 10 17:49:56.875043 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 10 17:49:56.875043 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 10 17:49:56.875043 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 10 17:49:56.875043 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 10 17:49:56.875043 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise self.value Aug 10 17:49:56.875043 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 10 17:49:56.877448 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 10 17:49:56.877448 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 10 17:49:56.877448 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 10 17:49:56.877448 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 10 17:49:56.877448 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 10 17:49:56.877448 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Aug 10 17:49:56.877448 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:49:56.877448 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:49:56.877448 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:49:56.877448 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:49:56.877448 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:49:56.877448 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:49:56.877448 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 10 17:49:56.877448 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 10 17:49:56.877448 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Aug 10 17:49:56.877448 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:49:56.877448 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-d209d7ce-a74c-435e-a9ec-fadb4a6bd5a8 tempest-AggregatesAdminNegativeTestJSON-1827635580 tempest-AggregatesAdminNegativeTestJSON-1827635580-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:49:56.878454 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-d209d7ce-a74c-435e-a9ec-fadb4a6bd5a8 tempest-AggregatesAdminNegativeTestJSON-1827635580 tempest-AggregatesAdminNegativeTestJSON-1827635580-project] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/10" status: 403 len: 116 microversion: 2.1 time: 0.016864 Aug 10 17:49:56.878454 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 134/271] 10.222.0.50 () {58 vars in 1155 bytes} [Wed Aug 10 17:49:56 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 116 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:49:56.921679 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-0289f8ad-e954-4ce1-9e9d-01931f330a0a tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:56.922707 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-0289f8ad-e954-4ce1-9e9d-01931f330a0a tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] [instance: 7e9ff909-ff6f-4d8d-8d84-97af957c6506] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:49:56.933302 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-0289f8ad-e954-4ce1-9e9d-01931f330a0a tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:56.934064 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-0289f8ad-e954-4ce1-9e9d-01931f330a0a tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:56.934687 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-0289f8ad-e954-4ce1-9e9d-01931f330a0a tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:56.937374 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-0289f8ad-e954-4ce1-9e9d-01931f330a0a tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:56.937374 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-0289f8ad-e954-4ce1-9e9d-01931f330a0a tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:56.937374 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-0289f8ad-e954-4ce1-9e9d-01931f330a0a tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:57.011853 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-0289f8ad-e954-4ce1-9e9d-01931f330a0a tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f242fdc47104b98882cb29c8ca5caae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b721d6dfb14d3d8780094fc4e72890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:49:57.021005 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-0289f8ad-e954-4ce1-9e9d-01931f330a0a tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] 10.222.0.50 "GET /compute/v2.1/servers/7e9ff909-ff6f-4d8d-8d84-97af957c6506" status: 200 len: 1278 microversion: 2.1 time: 0.144843 Aug 10 17:49:57.021613 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 135/272] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:49:56 2022] GET /compute/v2.1/servers/7e9ff909-ff6f-4d8d-8d84-97af957c6506 => generated 1278 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:49:57.029355 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-2db86c13-34fb-470b-ba1e-595cc9cf091e tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1964818576"}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:49:57.032199 n-d-852296-2 devstack@n-api.service[129410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:49:57.032199 n-d-852296-2 devstack@n-api.service[129410]: warnings.warn(msg) Aug 10 17:49:57.033623 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.objects.aggregate [None req-2db86c13-34fb-470b-ba1e-595cc9cf091e tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] Generated uuid 9f047fe8-6f1b-4978-98dc-c7026e2d6caf for aggregate {{(pid=129410) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 10 17:49:57.049850 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-a5f601a6-c713-4a80-8595-e84c64e218b8 tempest-FlavorsAccessTestJSON-1040209795 tempest-FlavorsAccessTestJSON-1040209795-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors/1300362398/action" status: 200 len: 21 microversion: 2.1 time: 0.519845 Aug 10 17:49:57.050844 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 138/273] 10.222.0.50 () {60 vars in 1200 bytes} [Wed Aug 10 17:49:56 2022] POST /compute/v2.1/flavors/1300362398/action => generated 21 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 17:49:57.058800 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-70150306-cf4f-4ce6-a862-814afdbc5afe tempest-AggregatesAdminNegativeTestJSON-734955950 tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:57.058800 n-d-852296-2 devstack@n-api.service[129409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:49:57.058800 n-d-852296-2 devstack@n-api.service[129409]: warnings.warn(msg) Aug 10 17:49:57.247992 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-2db86c13-34fb-470b-ba1e-595cc9cf091e tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.225108 Aug 10 17:49:57.248625 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 136/274] 10.222.0.50 () {60 vars in 1164 bytes} [Wed Aug 10 17:49:57 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:49:57.263842 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-70150306-cf4f-4ce6-a862-814afdbc5afe tempest-AggregatesAdminNegativeTestJSON-734955950 tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.209147 Aug 10 17:49:57.264854 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 139/275] 10.222.0.50 () {58 vars in 1155 bytes} [Wed Aug 10 17:49:57 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 10 17:49:57.274249 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-ae083f6e-9917-4810-a314-06f56ad975a1 tempest-FlavorsAccessTestJSON-1713358375 tempest-FlavorsAccessTestJSON-1713358375-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:57.276125 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-c92ebff4-e106-4c4a-ab59-aa32f0d498d1 tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:57.277691 n-d-852296-2 devstack@n-api.service[129409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:49:57.277691 n-d-852296-2 devstack@n-api.service[129409]: warnings.warn(msg) Aug 10 17:49:57.334437 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-ae083f6e-9917-4810-a314-06f56ad975a1 tempest-FlavorsAccessTestJSON-1713358375 tempest-FlavorsAccessTestJSON-1713358375-project] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.084618 Aug 10 17:49:57.335673 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 137/276] 10.222.0.50 () {58 vars in 1146 bytes} [Wed Aug 10 17:49:57 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:49:57.346325 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-f4a63a8e-b48d-4e11-aa76-3ee339b3ec7c tempest-AggregatesAdminNegativeTestJSON-734955950 tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:57.347767 n-d-852296-2 devstack@n-api.service[129410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:49:57.347767 n-d-852296-2 devstack@n-api.service[129410]: warnings.warn(msg) Aug 10 17:49:57.372630 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-f4a63a8e-b48d-4e11-aa76-3ee339b3ec7c tempest-AggregatesAdminNegativeTestJSON-734955950 tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Aug 10 17:49:57.376499 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-f4a63a8e-b48d-4e11-aa76-3ee339b3ec7c tempest-AggregatesAdminNegativeTestJSON-734955950 tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin] Request method failure captured: Aug 10 17:49:57.376499 n-d-852296-2 devstack@n-api.service[129410]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Aug 10 17:49:57.376499 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 17:49:57.376499 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 17:49:57.376499 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 17:49:57.376499 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 0 Aug 10 17:49:57.376499 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 17:49:57.376499 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 17:49:57.376499 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 17:49:57.376499 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 17:49:57.376499 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8--FinhXlxx8IFKnpFpAT2Mo9QKfGxddI_iKMGNb1Cjl8iSxKagj8DS2koXne8dIwX5_FVGCNTdOoyiHy2-sqqTjQfCR9EdEKc3gZynR9hJpVzE6YDP0hjcv2eKwEJp7WPPXp_BMt0f15rXmrKAPP-NUjl5gpiR7Muqr5uV0EQw-IDk Aug 10 17:49:57.376499 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 17:49:57.376499 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 17:49:57.376499 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 17:49:57.376499 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 17:49:57.376499 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 17:49:57.376499 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 17:49:57.376499 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: 812966d76c404431a451a541b1d1e58d Aug 10 17:49:57.376499 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-734955950 Aug 10 17:49:57.376499 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member,admin Aug 10 17:49:57.376499 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member,admin Aug 10 17:49:57.377758 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/812966d76c404431a451a541b1d1e58d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/812966d76c404431a451a541b1d1e58d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/812966d76c404431a451a541b1d1e58d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_812966d76c404431a451a541b1d1e58d", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:49:57.377758 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-734955950 Aug 10 17:49:57.377758 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: 812966d76c404431a451a541b1d1e58d Aug 10 17:49:57.377758 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-734955950 Aug 10 17:49:57.377758 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin Aug 10 17:49:57.377758 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 17:49:57.377758 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 17:49:57.377758 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: 32c6d09f10a94ddeb38b0185705b6740 Aug 10 17:49:57.377758 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin Aug 10 17:49:57.377758 n-d-852296-2 devstack@n-api.service[129410]: method: > Aug 10 17:49:57.377758 n-d-852296-2 devstack@n-api.service[129410]: exception: Aggregate -1 could not be found. Aug 10 17:49:57.377758 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'id': '-1'} Aug 10 17:49:57.378437 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:49:57.378437 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:49:57.378437 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Aug 10 17:49:57.378437 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Aug 10 17:49:57.378437 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 10 17:49:57.378437 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 10 17:49:57.378437 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 10 17:49:57.378437 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 10 17:49:57.378437 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 10 17:49:57.378437 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise self.value Aug 10 17:49:57.378437 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 10 17:49:57.378437 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 10 17:49:57.378437 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6470, in delete_aggregate Aug 10 17:49:57.378437 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Aug 10 17:49:57.378437 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 17:49:57.378437 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 17:49:57.378437 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 10 17:49:57.378437 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 10 17:49:57.378437 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 10 17:49:57.379557 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 10 17:49:57.379557 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 10 17:49:57.379557 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 10 17:49:57.379557 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Aug 10 17:49:57.379557 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:49:57.379557 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:49:57.379557 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:49:57.379557 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:49:57.379557 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:49:57.379557 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:49:57.379557 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:49:57.379557 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:49:57.379557 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:49:57.379557 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:49:57.379557 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Aug 10 17:49:57.379557 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:49:57.379557 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Aug 10 17:49:57.379557 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:49:57.379557 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:49:57.379557 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:49:57.379557 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:49:57.380809 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:49:57.380809 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:49:57.380809 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:49:57.380809 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:49:57.380809 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Aug 10 17:49:57.380809 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:49:57.380809 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-f4a63a8e-b48d-4e11-aa76-3ee339b3ec7c tempest-AggregatesAdminNegativeTestJSON-734955950 tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:49:57.380809 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-f4a63a8e-b48d-4e11-aa76-3ee339b3ec7c tempest-AggregatesAdminNegativeTestJSON-734955950 tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.039589 Aug 10 17:49:57.386904 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 138/277] 10.222.0.50 () {58 vars in 1155 bytes} [Wed Aug 10 17:49:57 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 10 17:49:57.397894 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-eb7fd24a-8f12-4427-9cfb-97f28d86c19c tempest-FlavorsAccessTestJSON-1040209795 tempest-FlavorsAccessTestJSON-1040209795-project-admin] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:57.400107 n-d-852296-2 devstack@n-api.service[129410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:49:57.400107 n-d-852296-2 devstack@n-api.service[129410]: warnings.warn(msg) Aug 10 17:49:57.469551 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-c92ebff4-e106-4c4a-ab59-aa32f0d498d1 tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.202445 Aug 10 17:49:57.473994 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 140/278] 10.222.0.50 () {58 vars in 1155 bytes} [Wed Aug 10 17:49:57 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 10 17:49:57.480661 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-4e13d84b-3d12-4213-82d6-535137fe6895 tempest-AggregatesAdminNegativeTestJSON-734955950 tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-447710569"}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:49:57.484149 n-d-852296-2 devstack@n-api.service[129409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:49:57.484149 n-d-852296-2 devstack@n-api.service[129409]: warnings.warn(msg) Aug 10 17:49:57.485727 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.objects.aggregate [None req-4e13d84b-3d12-4213-82d6-535137fe6895 tempest-AggregatesAdminNegativeTestJSON-734955950 tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin] Generated uuid fbec0373-10f3-45f5-bb2d-02d04c4fdc38 for aggregate {{(pid=129409) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 10 17:49:57.530619 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-eb7fd24a-8f12-4427-9cfb-97f28d86c19c tempest-FlavorsAccessTestJSON-1040209795 tempest-FlavorsAccessTestJSON-1040209795-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/1300362398" status: 202 len: 0 microversion: 2.1 time: 0.137825 Aug 10 17:49:57.531211 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 139/279] 10.222.0.50 () {58 vars in 1161 bytes} [Wed Aug 10 17:49:57 2022] DELETE /compute/v2.1/flavors/1300362398 => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 17:49:57.537521 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-9d34a183-c604-4f4c-8f66-5bb1bee62325 tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:57.538359 n-d-852296-2 devstack@n-api.service[129410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:49:57.538359 n-d-852296-2 devstack@n-api.service[129410]: warnings.warn(msg) Aug 10 17:49:57.545047 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-9d34a183-c604-4f4c-8f66-5bb1bee62325 tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] HTTP exception thrown: Aggregate 11 could not be found. Aug 10 17:49:57.546655 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-9d34a183-c604-4f4c-8f66-5bb1bee62325 tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] Request method failure captured: Aug 10 17:49:57.546655 n-d-852296-2 devstack@n-api.service[129410]: request: GET /compute/v2.1/os-aggregates/11 HTTP/1.1 Aug 10 17:49:57.546655 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 17:49:57.546655 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 17:49:57.546655 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 17:49:57.546655 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 0 Aug 10 17:49:57.546655 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 17:49:57.546655 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 17:49:57.546655 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 17:49:57.546655 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 17:49:57.546655 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8--Ficu9girV1f5lF4EPOFlCIURN5B_zqNJ-YIOI-bx-bqJ5Cu5qRvpTnGWvb7956SrbLaxdr3OVwX_8ULdDaq3VABGkKVyKL9PpGvVcYaRETpooFFx5oifqGQZVBWhiUBTytiVt9j28wbqqxnck27zwFyhHgis933MYJIMrB48U7uU Aug 10 17:49:57.546655 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 17:49:57.546655 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 17:49:57.546655 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 17:49:57.546655 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 17:49:57.546655 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 17:49:57.546655 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 17:49:57.546655 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: 3c7de6e64e36444cb04e0c582cc71f4d Aug 10 17:49:57.546655 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-AggregatesAdminTestJSON-1209654538 Aug 10 17:49:57.546655 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member,admin Aug 10 17:49:57.546655 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member,admin Aug 10 17:49:57.548126 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3c7de6e64e36444cb04e0c582cc71f4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3c7de6e64e36444cb04e0c582cc71f4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3c7de6e64e36444cb04e0c582cc71f4d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3c7de6e64e36444cb04e0c582cc71f4d", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:49:57.548126 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-AggregatesAdminTestJSON-1209654538 Aug 10 17:49:57.548126 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: 3c7de6e64e36444cb04e0c582cc71f4d Aug 10 17:49:57.548126 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1209654538 Aug 10 17:49:57.548126 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-AggregatesAdminTestJSON-1209654538-project-admin Aug 10 17:49:57.548126 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 17:49:57.548126 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 17:49:57.548126 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: a477dc711ac745cb9525a1106a284195 Aug 10 17:49:57.548126 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-AggregatesAdminTestJSON-1209654538-project-admin Aug 10 17:49:57.548126 n-d-852296-2 devstack@n-api.service[129410]: method: > Aug 10 17:49:57.548126 n-d-852296-2 devstack@n-api.service[129410]: exception: Aggregate 11 could not be found. Aug 10 17:49:57.548126 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'id': '11'} Aug 10 17:49:57.548126 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:49:57.549108 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:49:57.549108 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Aug 10 17:49:57.549108 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Aug 10 17:49:57.549108 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6417, in get_aggregate Aug 10 17:49:57.549108 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Aug 10 17:49:57.549108 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 17:49:57.549108 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 17:49:57.549108 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 10 17:49:57.549108 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 10 17:49:57.549108 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 10 17:49:57.549108 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 10 17:49:57.549108 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 10 17:49:57.549108 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 10 17:49:57.549108 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 11 could not be found. Aug 10 17:49:57.549108 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:49:57.549108 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:49:57.549108 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:49:57.549108 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:49:57.549108 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:49:57.550329 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:49:57.550329 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:49:57.550329 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:49:57.550329 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:49:57.550329 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:49:57.550329 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Aug 10 17:49:57.550329 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:49:57.550329 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 11 could not be found. Aug 10 17:49:57.550329 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:49:57.550329 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:49:57.550329 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:49:57.550329 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:49:57.550329 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:49:57.550329 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:49:57.550329 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:49:57.550329 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:49:57.550329 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 11 could not be found. Aug 10 17:49:57.550329 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:49:57.551518 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-9d34a183-c604-4f4c-8f66-5bb1bee62325 tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] Returning 404 to user: Aggregate 11 could not be found. {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:49:57.551518 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-9d34a183-c604-4f4c-8f66-5bb1bee62325 tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] 10.222.0.50 "GET /compute/v2.1/os-aggregates/11" status: 404 len: 78 microversion: 2.1 time: 0.016117 Aug 10 17:49:57.551518 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 140/280] 10.222.0.50 () {58 vars in 1152 bytes} [Wed Aug 10 17:49:57 2022] GET /compute/v2.1/os-aggregates/11 => generated 78 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 10 17:49:57.555967 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-44faed05-981e-4f8c-a9e3-56a1b717079f tempest-FlavorsAccessTestJSON-1040209795 tempest-FlavorsAccessTestJSON-1040209795-project-admin] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:57.579085 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-44faed05-981e-4f8c-a9e3-56a1b717079f tempest-FlavorsAccessTestJSON-1040209795 tempest-FlavorsAccessTestJSON-1040209795-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.027843 Aug 10 17:49:57.580235 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 141/281] 10.222.0.50 () {58 vars in 1146 bytes} [Wed Aug 10 17:49:57 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:49:57.596843 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-4e13d84b-3d12-4213-82d6-535137fe6895 tempest-AggregatesAdminNegativeTestJSON-734955950 tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.121724 Aug 10 17:49:57.599024 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 141/282] 10.222.0.50 () {60 vars in 1164 bytes} [Wed Aug 10 17:49:57 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:49:57.612818 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-ff7fe09f-d8cc-4491-949d-219c5e23e06f tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:57.613979 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-9e29bfca-cef1-459a-8308-ac5ae7cf803b tempest-FlavorsAccessTestJSON-1040209795 tempest-FlavorsAccessTestJSON-1040209795-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-766450552", "id": 1428074562, "os-flavor-access:is_public": "False"}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:49:57.619772 n-d-852296-2 devstack@n-api.service[129409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:49:57.619772 n-d-852296-2 devstack@n-api.service[129409]: warnings.warn(msg) Aug 10 17:49:57.641966 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-ff7fe09f-d8cc-4491-949d-219c5e23e06f tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] HTTP exception thrown: Aggregate 11 could not be found. Aug 10 17:49:57.641966 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-ff7fe09f-d8cc-4491-949d-219c5e23e06f tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] Request method failure captured: Aug 10 17:49:57.641966 n-d-852296-2 devstack@n-api.service[129410]: request: DELETE /compute/v2.1/os-aggregates/11 HTTP/1.1 Aug 10 17:49:57.641966 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 17:49:57.641966 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 17:49:57.641966 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 17:49:57.641966 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 0 Aug 10 17:49:57.641966 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 17:49:57.641966 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 17:49:57.641966 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 17:49:57.641966 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 17:49:57.641966 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8--Ficu9girV1f5lF4EPOFlCIURN5B_zqNJ-YIOI-bx-bqJ5Cu5qRvpTnGWvb7956SrbLaxdr3OVwX_8ULdDaq3VABGkKVyKL9PpGvVcYaRETpooFFx5oifqGQZVBWhiUBTytiVt9j28wbqqxnck27zwFyhHgis933MYJIMrB48U7uU Aug 10 17:49:57.641966 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 17:49:57.641966 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 17:49:57.641966 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 17:49:57.641966 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 17:49:57.641966 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 17:49:57.641966 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 17:49:57.641966 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: 3c7de6e64e36444cb04e0c582cc71f4d Aug 10 17:49:57.641966 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-AggregatesAdminTestJSON-1209654538 Aug 10 17:49:57.641966 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member,admin Aug 10 17:49:57.641966 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member,admin Aug 10 17:49:57.643455 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3c7de6e64e36444cb04e0c582cc71f4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3c7de6e64e36444cb04e0c582cc71f4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3c7de6e64e36444cb04e0c582cc71f4d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3c7de6e64e36444cb04e0c582cc71f4d", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:49:57.643455 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-AggregatesAdminTestJSON-1209654538 Aug 10 17:49:57.643455 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: 3c7de6e64e36444cb04e0c582cc71f4d Aug 10 17:49:57.643455 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1209654538 Aug 10 17:49:57.643455 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-AggregatesAdminTestJSON-1209654538-project-admin Aug 10 17:49:57.643455 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 17:49:57.643455 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 17:49:57.643455 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: a477dc711ac745cb9525a1106a284195 Aug 10 17:49:57.643455 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-AggregatesAdminTestJSON-1209654538-project-admin Aug 10 17:49:57.643455 n-d-852296-2 devstack@n-api.service[129410]: method: > Aug 10 17:49:57.643455 n-d-852296-2 devstack@n-api.service[129410]: exception: Aggregate 11 could not be found. Aug 10 17:49:57.643455 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'id': '11'} Aug 10 17:49:57.643455 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:49:57.644169 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:49:57.644169 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Aug 10 17:49:57.644169 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Aug 10 17:49:57.644169 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 10 17:49:57.644169 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 10 17:49:57.644169 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 10 17:49:57.644169 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 10 17:49:57.644169 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 10 17:49:57.644169 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise self.value Aug 10 17:49:57.644169 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 10 17:49:57.644169 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 10 17:49:57.644169 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6470, in delete_aggregate Aug 10 17:49:57.644169 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Aug 10 17:49:57.644169 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 17:49:57.644169 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 17:49:57.644169 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 10 17:49:57.644169 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 10 17:49:57.644169 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 10 17:49:57.644169 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 10 17:49:57.645208 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 10 17:49:57.645208 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 10 17:49:57.645208 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 11 could not be found. Aug 10 17:49:57.645208 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:49:57.645208 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:49:57.645208 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:49:57.645208 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:49:57.645208 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:49:57.645208 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:49:57.645208 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:49:57.645208 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:49:57.645208 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:49:57.645208 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:49:57.645208 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Aug 10 17:49:57.645208 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:49:57.645208 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 11 could not be found. Aug 10 17:49:57.645208 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:49:57.645208 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:49:57.645208 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:49:57.645208 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:49:57.645208 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:49:57.646404 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:49:57.646404 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:49:57.646404 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:49:57.646404 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 11 could not be found. Aug 10 17:49:57.646404 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:49:57.646404 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-ff7fe09f-d8cc-4491-949d-219c5e23e06f tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] Returning 404 to user: Aggregate 11 could not be found. {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:49:57.646404 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-ff7fe09f-d8cc-4491-949d-219c5e23e06f tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/11" status: 404 len: 78 microversion: 2.1 time: 0.060918 Aug 10 17:49:57.646404 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 142/283] 10.222.0.50 () {58 vars in 1155 bytes} [Wed Aug 10 17:49:57 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 78 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 10 17:49:57.656941 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-c5a72fd5-c859-4b7e-a82e-a23c73aec340 tempest-AggregatesAdminNegativeTestJSON-1827635580 tempest-AggregatesAdminNegativeTestJSON-1827635580-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:57.658986 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-c5a72fd5-c859-4b7e-a82e-a23c73aec340 tempest-AggregatesAdminNegativeTestJSON-1827635580 tempest-AggregatesAdminNegativeTestJSON-1827635580-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': 'c9987b20fcac4cda950c2e3df182b032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cb25a6949b42b58732402ae05f6198', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:49:57.660998 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-c5a72fd5-c859-4b7e-a82e-a23c73aec340 tempest-AggregatesAdminNegativeTestJSON-1827635580 tempest-AggregatesAdminNegativeTestJSON-1827635580-project] Request method failure captured: Aug 10 17:49:57.660998 n-d-852296-2 devstack@n-api.service[129410]: request: GET /compute/v2.1/os-aggregates/12 HTTP/1.1 Aug 10 17:49:57.660998 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 17:49:57.660998 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 17:49:57.660998 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 17:49:57.660998 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 0 Aug 10 17:49:57.660998 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 17:49:57.660998 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 17:49:57.660998 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 17:49:57.660998 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 17:49:57.660998 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8--BhZ_ASJqc84aYTnO7aQpuVDeONca1CX474xJ14h-b-uW2MUffMGHSgJWjYRN3p9o1cElv-yNB-MZH5MH5irxiDf3dRJiNnKCMFw3_hkxJM7CT2rEzXVBPenTitk4X93SODDB17foMPBbZVdjE-FR_u9ZHmrVa8eTkl-QsrT_nsJU Aug 10 17:49:57.660998 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 17:49:57.660998 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 17:49:57.660998 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 17:49:57.660998 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 17:49:57.660998 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 17:49:57.660998 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 17:49:57.660998 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: 44cb25a6949b42b58732402ae05f6198 Aug 10 17:49:57.660998 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1827635580 Aug 10 17:49:57.660998 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 17:49:57.660998 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 17:49:57.662469 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/44cb25a6949b42b58732402ae05f6198"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/44cb25a6949b42b58732402ae05f6198"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/44cb25a6949b42b58732402ae05f6198"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_44cb25a6949b42b58732402ae05f6198", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:49:57.662469 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1827635580 Aug 10 17:49:57.662469 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: 44cb25a6949b42b58732402ae05f6198 Aug 10 17:49:57.662469 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1827635580 Aug 10 17:49:57.662469 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-AggregatesAdminNegativeTestJSON-1827635580-project Aug 10 17:49:57.662469 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 17:49:57.662469 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 17:49:57.662469 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: c9987b20fcac4cda950c2e3df182b032 Aug 10 17:49:57.662469 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1827635580-project Aug 10 17:49:57.662469 n-d-852296-2 devstack@n-api.service[129410]: method: > Aug 10 17:49:57.662469 n-d-852296-2 devstack@n-api.service[129410]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Aug 10 17:49:57.662469 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'id': '12'} Aug 10 17:49:57.663153 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:49:57.663153 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:49:57.663153 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:49:57.663153 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:49:57.663153 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:49:57.663153 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:49:57.663153 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:49:57.663153 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:49:57.663153 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Aug 10 17:49:57.663153 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Aug 10 17:49:57.663153 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 10 17:49:57.663153 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 10 17:49:57.663153 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 10 17:49:57.663153 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 10 17:49:57.663153 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 10 17:49:57.663153 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 10 17:49:57.663153 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 10 17:49:57.663153 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise self.value Aug 10 17:49:57.663153 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 10 17:49:57.664292 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 10 17:49:57.664292 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 10 17:49:57.664292 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 10 17:49:57.664292 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 10 17:49:57.664292 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 10 17:49:57.664292 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Aug 10 17:49:57.664292 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:49:57.664292 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:49:57.664292 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:49:57.664292 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:49:57.664292 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:49:57.664292 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:49:57.664292 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 10 17:49:57.664292 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 10 17:49:57.664292 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Aug 10 17:49:57.664292 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:49:57.664292 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-c5a72fd5-c859-4b7e-a82e-a23c73aec340 tempest-AggregatesAdminNegativeTestJSON-1827635580 tempest-AggregatesAdminNegativeTestJSON-1827635580-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:49:57.666073 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-c5a72fd5-c859-4b7e-a82e-a23c73aec340 tempest-AggregatesAdminNegativeTestJSON-1827635580 tempest-AggregatesAdminNegativeTestJSON-1827635580-project] 10.222.0.50 "GET /compute/v2.1/os-aggregates/12" status: 403 len: 114 microversion: 2.1 time: 0.011614 Aug 10 17:49:57.666073 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 143/284] 10.222.0.50 () {58 vars in 1152 bytes} [Wed Aug 10 17:49:57 2022] GET /compute/v2.1/os-aggregates/12 => generated 114 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:49:57.674500 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-a78ed035-f178-4284-b29a-07291dd745de tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1218730677", "name": "tempest-test_aggregate-1430130355"}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:49:57.694658 n-d-852296-2 devstack@n-api.service[129410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:49:57.694658 n-d-852296-2 devstack@n-api.service[129410]: warnings.warn(msg) Aug 10 17:49:57.696223 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.objects.aggregate [None req-a78ed035-f178-4284-b29a-07291dd745de tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] Generated uuid c0f02e36-1955-480b-bc00-9165a73304ee for aggregate {{(pid=129410) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 10 17:49:57.762555 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-9e29bfca-cef1-459a-8308-ac5ae7cf803b tempest-FlavorsAccessTestJSON-1040209795 tempest-FlavorsAccessTestJSON-1040209795-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.161554 Aug 10 17:49:57.764452 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 142/285] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 17:49:57 2022] POST /compute/v2.1/flavors => generated 430 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:49:57.791182 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-4bed10d6-3f9a-44bb-8725-e0ce05409970 tempest-AggregatesAdminNegativeTestJSON-734955950 tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:57.795732 n-d-852296-2 devstack@n-api.service[129409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:49:57.795732 n-d-852296-2 devstack@n-api.service[129409]: warnings.warn(msg) Aug 10 17:49:57.824208 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-a78ed035-f178-4284-b29a-07291dd745de tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 200 len: 223 microversion: 2.1 time: 0.159575 Aug 10 17:49:57.826524 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 144/286] 10.222.0.50 () {60 vars in 1165 bytes} [Wed Aug 10 17:49:57 2022] POST /compute/v2.1/os-aggregates => generated 223 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:49:57.837180 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-7b54d274-6647-4bac-b62a-404698d5f850 tempest-LiveAutoBlockMigrationV225Test-1294760569 tempest-LiveAutoBlockMigrationV225Test-1294760569-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-821356098", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "65f0edf1-6c38-4348-ba86-cccd27e183bd"}], "security_groups": [{"name": "tempest-securitygroup--813597580"}], "key_name": "tempest-keypair-15043570", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:49:57.994868 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.network.neutron [None req-7b54d274-6647-4bac-b62a-404698d5f850 tempest-LiveAutoBlockMigrationV225Test-1294760569 tempest-LiveAutoBlockMigrationV225Test-1294760569-project] validate_networks() for [('65f0edf1-6c38-4348-ba86-cccd27e183bd', None, None, None, None, None)] {{(pid=129410) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 17:49:58.080121 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-4bed10d6-3f9a-44bb-8725-e0ce05409970 tempest-AggregatesAdminNegativeTestJSON-734955950 tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.297451 Aug 10 17:49:58.082723 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 143/287] 10.222.0.50 () {58 vars in 1155 bytes} [Wed Aug 10 17:49:57 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 10 17:49:58.103858 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-34faff84-ef06-493e-b53c-499c0dea5038 tempest-FlavorsAccessTestJSON-1040209795 tempest-FlavorsAccessTestJSON-1040209795-project-admin] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:58.107531 n-d-852296-2 devstack@n-api.service[129409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:49:58.107531 n-d-852296-2 devstack@n-api.service[129409]: warnings.warn(msg) Aug 10 17:49:58.130859 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-34faff84-ef06-493e-b53c-499c0dea5038 tempest-FlavorsAccessTestJSON-1040209795 tempest-FlavorsAccessTestJSON-1040209795-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/1428074562/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.046694 Aug 10 17:49:58.141742 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 144/288] 10.222.0.50 () {58 vars in 1209 bytes} [Wed Aug 10 17:49:58 2022] GET /compute/v2.1/flavors/1428074562/os-flavor-access => generated 21 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 17:49:58.156300 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-fc5c3027-5098-4c5f-b5a8-b19718ba18a2 tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:58.157544 n-d-852296-2 devstack@n-api.service[129409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:49:58.157544 n-d-852296-2 devstack@n-api.service[129409]: warnings.warn(msg) Aug 10 17:49:58.362242 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [None req-7b54d274-6647-4bac-b62a-404698d5f850 tempest-LiveAutoBlockMigrationV225Test-1294760569 tempest-LiveAutoBlockMigrationV225Test-1294760569-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-6a28c5f9-a00e-4cd2-95c6-30502c29550c) Aug 10 17:49:58.362242 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:49:58.362242 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:49:58.362242 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:49:58.362242 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:49:58.362242 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:49:58.362242 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:49:58.362242 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:49:58.362242 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:49:58.362242 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:49:58.362242 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 17:49:58.362242 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 17:49:58.362242 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 17:49:58.362242 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 17:49:58.362242 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 17:49:58.362242 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 17:49:58.363722 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 17:49:58.363722 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 17:49:58.363722 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 17:49:58.363722 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 17:49:58.363722 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 17:49:58.363722 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 17:49:58.363722 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 17:49:58.363722 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 17:49:58.363722 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 17:49:58.363722 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 17:49:58.363722 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 17:49:58.363722 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:49:58.363722 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:49:58.363722 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 17:49:58.363722 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 17:49:58.363722 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:49:58.363722 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:49:58.363722 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:49:58.365337 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:49:58.365337 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:49:58.365337 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:49:58.365337 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:49:58.365337 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:49:58.365337 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:49:58.365337 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:49:58.365337 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 17:49:58.365337 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 17:49:58.365337 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 17:49:58.365337 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 17:49:58.365337 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 17:49:58.365337 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 17:49:58.365337 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 17:49:58.365337 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 17:49:58.365337 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 17:49:58.365337 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 17:49:58.365337 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 17:49:58.367428 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 17:49:58.367428 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 17:49:58.367428 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 17:49:58.367428 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 17:49:58.367428 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 17:49:58.367428 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 17:49:58.367428 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 17:49:58.367428 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 17:49:58.367428 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 17:49:58.367428 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 17:49:58.367428 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 17:49:58.367428 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 17:49:58.367428 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 17:49:58.367428 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 17:49:58.367428 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 17:49:58.369407 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-6a28c5f9-a00e-4cd2-95c6-30502c29550c) Aug 10 17:49:58.369407 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:49:58.369407 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-7b54d274-6647-4bac-b62a-404698d5f850 tempest-LiveAutoBlockMigrationV225Test-1294760569 tempest-LiveAutoBlockMigrationV225Test-1294760569-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:49:58.369407 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 17:49:58.369407 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-7b54d274-6647-4bac-b62a-404698d5f850 tempest-LiveAutoBlockMigrationV225Test-1294760569 tempest-LiveAutoBlockMigrationV225Test-1294760569-project] Request method failure captured: Aug 10 17:49:58.369407 n-d-852296-2 devstack@n-api.service[129410]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 17:49:58.369407 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 17:49:58.369407 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 17:49:58.369407 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 17:49:58.369407 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 467 Aug 10 17:49:58.369407 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 17:49:58.369407 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 17:49:58.369407 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 17:49:58.369407 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 17:49:58.369407 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8--rUpQnQMRCcxoeoEEfTZB9bNgVG1LtvLGpdIGsID2pqNy7Yz0btlbySW2s05YZQP69IS5fxYZQ-jPa-PuRzZfIUwlDBjarRUPCbYXiuLNF1PUgDRGkB2Jfpb6O1Pd21aPA9R68lGSAqcVayeh1ErXuIM5RIKbttfyrdx7XjnnLOis Aug 10 17:49:58.369407 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 17:49:58.369407 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 17:49:58.369407 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 17:49:58.369407 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 17:49:58.369407 n-d-852296-2 devstack@n-api.service[129410]: X-Openstack-Nova-Api-Version: 2.25 Aug 10 17:49:58.369407 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 17:49:58.369407 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 17:49:58.369407 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: c39984bbc0b549c9bc10d0a5b0e4ca62 Aug 10 17:49:58.369407 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1294760569 Aug 10 17:49:58.369407 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 17:49:58.369407 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 17:49:58.371526 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c39984bbc0b549c9bc10d0a5b0e4ca62"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c39984bbc0b549c9bc10d0a5b0e4ca62"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c39984bbc0b549c9bc10d0a5b0e4ca62"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c39984bbc0b549c9bc10d0a5b0e4ca62", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:49:58.371526 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1294760569 Aug 10 17:49:58.371526 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: c39984bbc0b549c9bc10d0a5b0e4ca62 Aug 10 17:49:58.371526 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1294760569 Aug 10 17:49:58.371526 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-LiveAutoBlockMigrationV225Test-1294760569-project Aug 10 17:49:58.371526 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 17:49:58.371526 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 17:49:58.371526 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: 030a617b52ad4ef3be53a43d812eb8b9 Aug 10 17:49:58.371526 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1294760569-project Aug 10 17:49:58.371526 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 17:49:58.372129 n-d-852296-2 devstack@n-api.service[129410]: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-821356098", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "65f0edf1-6c38-4348-ba86-cccd27e183bd"}], "security_groups": [{"name": "tempest-securitygroup--813597580"}], "key_name": "tempest-keypair-15043570", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} Aug 10 17:49:58.372129 n-d-852296-2 devstack@n-api.service[129410]: method: > Aug 10 17:49:58.372129 n-d-852296-2 devstack@n-api.service[129410]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:49:58.372129 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 17:49:58.372129 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'body': {'server': {'name': 'tempest-LiveAutoBlockMigrationV225Test-server-821356098', 'imageRef': 'a735ff26-463a-4ffe-a981-ab9d9baa494f', 'flavorRef': '452', 'networks': [{'uuid': '65f0edf1-6c38-4348-ba86-cccd27e183bd'}], 'security_groups': [{'name': 'tempest-securitygroup--813597580'}], 'key_name': 'tempest-keypair-15043570', 'user_data': 'IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo='}}} Aug 10 17:49:58.372129 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:49:58.372129 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:49:58.372129 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:49:58.372129 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:49:58.372129 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:49:58.372129 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:49:58.372129 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:49:58.372129 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:49:58.372959 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:49:58.372959 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:49:58.372959 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 17:49:58.372959 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 17:49:58.372959 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 17:49:58.372959 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 17:49:58.372959 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 17:49:58.372959 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 17:49:58.372959 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 17:49:58.372959 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 17:49:58.372959 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 17:49:58.372959 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 17:49:58.372959 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 17:49:58.372959 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 17:49:58.372959 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 17:49:58.372959 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 17:49:58.372959 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 17:49:58.372959 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 17:49:58.373919 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 17:49:58.373919 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:49:58.373919 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:49:58.373919 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 17:49:58.373919 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 17:49:58.373919 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:49:58.373919 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:49:58.373919 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:49:58.373919 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:49:58.373919 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:49:58.373919 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:49:58.373919 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:49:58.373919 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:49:58.373919 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:49:58.373919 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:49:58.373919 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 17:49:58.373919 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 17:49:58.373919 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 17:49:58.377286 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 17:49:58.377286 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 17:49:58.377286 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 17:49:58.377286 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 17:49:58.377286 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 17:49:58.377286 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 17:49:58.377286 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 17:49:58.377286 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 17:49:58.377286 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 17:49:58.377286 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 17:49:58.377286 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 17:49:58.377286 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 17:49:58.377286 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 17:49:58.377286 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 17:49:58.377286 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 17:49:58.377286 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 17:49:58.377286 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 17:49:58.379420 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 17:49:58.379420 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 17:49:58.379420 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 17:49:58.379420 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 17:49:58.379420 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 17:49:58.379420 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 17:49:58.379420 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-6a28c5f9-a00e-4cd2-95c6-30502c29550c) Aug 10 17:49:58.379420 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:49:58.379420 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:49:58.379420 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:49:58.379420 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:49:58.379420 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:49:58.379420 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:49:58.379420 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:49:58.379420 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:49:58.379420 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 10 17:49:58.379420 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 10 17:49:58.383202 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:49:58.383202 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:49:58.383202 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:49:58.383202 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:49:58.383202 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:49:58.383202 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:49:58.383202 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:49:58.383202 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:49:58.383202 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:49:58.383202 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:49:58.383202 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:49:58.383202 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:49:58.383202 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:49:58.383202 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-7b54d274-6647-4bac-b62a-404698d5f850 tempest-LiveAutoBlockMigrationV225Test-1294760569 tempest-LiveAutoBlockMigrationV225Test-1294760569-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:49:58.383202 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:49:58.387211 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-7b54d274-6647-4bac-b62a-404698d5f850 tempest-LiveAutoBlockMigrationV225Test-1294760569 tempest-LiveAutoBlockMigrationV225Test-1294760569-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.25 time: 0.541123 Aug 10 17:49:58.387211 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 145/289] 10.222.0.50 () {62 vars in 1188 bytes} [Wed Aug 10 17:49:57 2022] POST /compute/v2.1/servers => generated 214 bytes in 542 msecs (HTTP/1.1 500) 9 headers in 393 bytes (1 switches on core 0) Aug 10 17:49:58.406928 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-95e27b06-0ea6-4e09-bf3b-ff61d65bbb36 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:58.406928 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-95e27b06-0ea6-4e09-bf3b-ff61d65bbb36 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] [instance: 7e9ff909-ff6f-4d8d-8d84-97af957c6506] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:49:58.419180 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-95e27b06-0ea6-4e09-bf3b-ff61d65bbb36 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:58.419674 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-95e27b06-0ea6-4e09-bf3b-ff61d65bbb36 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:58.420103 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-95e27b06-0ea6-4e09-bf3b-ff61d65bbb36 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:58.421530 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-95e27b06-0ea6-4e09-bf3b-ff61d65bbb36 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:58.422189 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-95e27b06-0ea6-4e09-bf3b-ff61d65bbb36 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:58.422766 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-95e27b06-0ea6-4e09-bf3b-ff61d65bbb36 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:58.569597 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-fc5c3027-5098-4c5f-b5a8-b19718ba18a2 tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.421048 Aug 10 17:49:58.572643 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 145/290] 10.222.0.50 () {58 vars in 1155 bytes} [Wed Aug 10 17:49:58 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 10 17:49:58.588920 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-9f2d6602-13fb-4436-bf6d-983de5e65ae4 tempest-AggregatesAdminNegativeTestJSON-734955950 tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:58.588920 n-d-852296-2 devstack@n-api.service[129409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:49:58.588920 n-d-852296-2 devstack@n-api.service[129409]: warnings.warn(msg) Aug 10 17:49:58.590732 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-9f2d6602-13fb-4436-bf6d-983de5e65ae4 tempest-AggregatesAdminNegativeTestJSON-734955950 tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Aug 10 17:49:58.592672 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-9f2d6602-13fb-4436-bf6d-983de5e65ae4 tempest-AggregatesAdminNegativeTestJSON-734955950 tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin] Request method failure captured: Aug 10 17:49:58.592672 n-d-852296-2 devstack@n-api.service[129409]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Aug 10 17:49:58.592672 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 17:49:58.592672 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 17:49:58.592672 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 17:49:58.592672 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 0 Aug 10 17:49:58.592672 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 17:49:58.592672 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 17:49:58.592672 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 17:49:58.592672 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 17:49:58.592672 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8--FinhXlxx8IFKnpFpAT2Mo9QKfGxddI_iKMGNb1Cjl8iSxKagj8DS2koXne8dIwX5_FVGCNTdOoyiHy2-sqqTjQfCR9EdEKc3gZynR9hJpVzE6YDP0hjcv2eKwEJp7WPPXp_BMt0f15rXmrKAPP-NUjl5gpiR7Muqr5uV0EQw-IDk Aug 10 17:49:58.592672 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 17:49:58.592672 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 17:49:58.592672 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 17:49:58.592672 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 17:49:58.592672 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 17:49:58.592672 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 17:49:58.592672 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: 812966d76c404431a451a541b1d1e58d Aug 10 17:49:58.592672 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-734955950 Aug 10 17:49:58.592672 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member,admin Aug 10 17:49:58.592672 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member,admin Aug 10 17:49:58.594535 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/812966d76c404431a451a541b1d1e58d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/812966d76c404431a451a541b1d1e58d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/812966d76c404431a451a541b1d1e58d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_812966d76c404431a451a541b1d1e58d", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:49:58.594535 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-734955950 Aug 10 17:49:58.594535 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: 812966d76c404431a451a541b1d1e58d Aug 10 17:49:58.594535 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-734955950 Aug 10 17:49:58.594535 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin Aug 10 17:49:58.594535 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 17:49:58.594535 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 17:49:58.594535 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: 32c6d09f10a94ddeb38b0185705b6740 Aug 10 17:49:58.594535 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin Aug 10 17:49:58.594535 n-d-852296-2 devstack@n-api.service[129409]: method: > Aug 10 17:49:58.594535 n-d-852296-2 devstack@n-api.service[129409]: exception: Aggregate -1 could not be found. Aug 10 17:49:58.594535 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'id': '-1'} Aug 10 17:49:58.595366 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:49:58.595366 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:49:58.595366 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Aug 10 17:49:58.595366 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Aug 10 17:49:58.595366 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6417, in get_aggregate Aug 10 17:49:58.595366 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Aug 10 17:49:58.595366 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 17:49:58.595366 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 17:49:58.595366 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 10 17:49:58.595366 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 10 17:49:58.595366 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 10 17:49:58.595366 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 10 17:49:58.595366 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 10 17:49:58.595366 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 10 17:49:58.595366 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Aug 10 17:49:58.595366 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:49:58.595366 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:49:58.595366 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:49:58.595366 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:49:58.595366 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:49:58.596983 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:49:58.596983 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:49:58.596983 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:49:58.596983 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:49:58.596983 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:49:58.596983 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Aug 10 17:49:58.596983 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:49:58.596983 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Aug 10 17:49:58.596983 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:49:58.596983 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:49:58.596983 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:49:58.596983 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:49:58.596983 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:49:58.596983 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:49:58.596983 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:49:58.596983 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:49:58.596983 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Aug 10 17:49:58.596983 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:49:58.599840 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-9f2d6602-13fb-4436-bf6d-983de5e65ae4 tempest-AggregatesAdminNegativeTestJSON-734955950 tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:49:58.601046 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-9f2d6602-13fb-4436-bf6d-983de5e65ae4 tempest-AggregatesAdminNegativeTestJSON-734955950 tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin] 10.222.0.50 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.027193 Aug 10 17:49:58.601751 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 146/291] 10.222.0.50 () {58 vars in 1152 bytes} [Wed Aug 10 17:49:58 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 10 17:49:58.610415 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-e2f3c789-8f72-4bc8-a2ac-2341f2ad6001 tempest-FlavorsAccessTestJSON-1040209795 tempest-FlavorsAccessTestJSON-1040209795-project-admin] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:58.611229 n-d-852296-2 devstack@n-api.service[129409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:49:58.611229 n-d-852296-2 devstack@n-api.service[129409]: warnings.warn(msg) Aug 10 17:49:58.617177 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-95e27b06-0ea6-4e09-bf3b-ff61d65bbb36 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f242fdc47104b98882cb29c8ca5caae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b721d6dfb14d3d8780094fc4e72890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:49:58.626861 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-95e27b06-0ea6-4e09-bf3b-ff61d65bbb36 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] 10.222.0.50 "GET /compute/v2.1/servers/7e9ff909-ff6f-4d8d-8d84-97af957c6506" status: 200 len: 1320 microversion: 2.1 time: 0.256132 Aug 10 17:49:58.627480 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 146/292] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:49:58 2022] GET /compute/v2.1/servers/7e9ff909-ff6f-4d8d-8d84-97af957c6506 => generated 1320 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:49:58.640635 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-5bd72f76-f261-4900-83db-2bce3cb45bdf tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:58.641388 n-d-852296-2 devstack@n-api.service[129410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:49:58.641388 n-d-852296-2 devstack@n-api.service[129410]: warnings.warn(msg) Aug 10 17:49:58.647282 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-5bd72f76-f261-4900-83db-2bce3cb45bdf tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] HTTP exception thrown: Aggregate 13 could not be found. Aug 10 17:49:58.649755 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-5bd72f76-f261-4900-83db-2bce3cb45bdf tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] Request method failure captured: Aug 10 17:49:58.649755 n-d-852296-2 devstack@n-api.service[129410]: request: GET /compute/v2.1/os-aggregates/13 HTTP/1.1 Aug 10 17:49:58.649755 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 17:49:58.649755 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 17:49:58.649755 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 17:49:58.649755 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 0 Aug 10 17:49:58.649755 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 17:49:58.649755 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 17:49:58.649755 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 17:49:58.649755 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 17:49:58.649755 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8--Ficu9girV1f5lF4EPOFlCIURN5B_zqNJ-YIOI-bx-bqJ5Cu5qRvpTnGWvb7956SrbLaxdr3OVwX_8ULdDaq3VABGkKVyKL9PpGvVcYaRETpooFFx5oifqGQZVBWhiUBTytiVt9j28wbqqxnck27zwFyhHgis933MYJIMrB48U7uU Aug 10 17:49:58.649755 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 17:49:58.649755 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 17:49:58.649755 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 17:49:58.649755 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 17:49:58.649755 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 17:49:58.649755 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 17:49:58.649755 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: 3c7de6e64e36444cb04e0c582cc71f4d Aug 10 17:49:58.649755 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-AggregatesAdminTestJSON-1209654538 Aug 10 17:49:58.649755 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member,admin Aug 10 17:49:58.649755 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member,admin Aug 10 17:49:58.651570 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3c7de6e64e36444cb04e0c582cc71f4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3c7de6e64e36444cb04e0c582cc71f4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3c7de6e64e36444cb04e0c582cc71f4d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3c7de6e64e36444cb04e0c582cc71f4d", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:49:58.651570 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-AggregatesAdminTestJSON-1209654538 Aug 10 17:49:58.651570 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: 3c7de6e64e36444cb04e0c582cc71f4d Aug 10 17:49:58.651570 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1209654538 Aug 10 17:49:58.651570 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-AggregatesAdminTestJSON-1209654538-project-admin Aug 10 17:49:58.651570 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 17:49:58.651570 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 17:49:58.651570 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: a477dc711ac745cb9525a1106a284195 Aug 10 17:49:58.651570 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-AggregatesAdminTestJSON-1209654538-project-admin Aug 10 17:49:58.651570 n-d-852296-2 devstack@n-api.service[129410]: method: > Aug 10 17:49:58.651570 n-d-852296-2 devstack@n-api.service[129410]: exception: Aggregate 13 could not be found. Aug 10 17:49:58.651570 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'id': '13'} Aug 10 17:49:58.651570 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:49:58.656295 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:49:58.656295 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Aug 10 17:49:58.656295 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Aug 10 17:49:58.656295 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6417, in get_aggregate Aug 10 17:49:58.656295 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Aug 10 17:49:58.656295 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 17:49:58.656295 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 17:49:58.656295 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 10 17:49:58.656295 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 10 17:49:58.656295 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 10 17:49:58.656295 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 10 17:49:58.656295 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 10 17:49:58.656295 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 10 17:49:58.656295 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 13 could not be found. Aug 10 17:49:58.656295 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:49:58.656295 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:49:58.656295 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:49:58.656295 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:49:58.656295 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:49:58.657700 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:49:58.657700 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:49:58.657700 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:49:58.657700 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:49:58.657700 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:49:58.657700 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Aug 10 17:49:58.657700 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:49:58.657700 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 13 could not be found. Aug 10 17:49:58.657700 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:49:58.657700 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:49:58.657700 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:49:58.657700 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:49:58.657700 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:49:58.657700 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:49:58.657700 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:49:58.657700 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:49:58.657700 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 13 could not be found. Aug 10 17:49:58.657700 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:49:58.659010 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-5bd72f76-f261-4900-83db-2bce3cb45bdf tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] Returning 404 to user: Aggregate 13 could not be found. {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:49:58.659010 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-5bd72f76-f261-4900-83db-2bce3cb45bdf tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] 10.222.0.50 "GET /compute/v2.1/os-aggregates/13" status: 404 len: 78 microversion: 2.1 time: 0.022182 Aug 10 17:49:58.659010 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 147/293] 10.222.0.50 () {58 vars in 1152 bytes} [Wed Aug 10 17:49:58 2022] GET /compute/v2.1/os-aggregates/13 => generated 78 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 10 17:49:58.659253 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-d3cb404a-9703-411d-8ccc-87d495145342 tempest-AggregatesAdminNegativeTestJSON-1827635580 tempest-AggregatesAdminNegativeTestJSON-1827635580-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:58.659977 n-d-852296-2 devstack@n-api.service[129410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:49:58.659977 n-d-852296-2 devstack@n-api.service[129410]: warnings.warn(msg) Aug 10 17:49:58.660840 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-d3cb404a-9703-411d-8ccc-87d495145342 tempest-AggregatesAdminNegativeTestJSON-1827635580 tempest-AggregatesAdminNegativeTestJSON-1827635580-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': 'c9987b20fcac4cda950c2e3df182b032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cb25a6949b42b58732402ae05f6198', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:49:58.662575 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-d3cb404a-9703-411d-8ccc-87d495145342 tempest-AggregatesAdminNegativeTestJSON-1827635580 tempest-AggregatesAdminNegativeTestJSON-1827635580-project] Request method failure captured: Aug 10 17:49:58.662575 n-d-852296-2 devstack@n-api.service[129410]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Aug 10 17:49:58.662575 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 17:49:58.662575 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 17:49:58.662575 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 17:49:58.662575 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 0 Aug 10 17:49:58.662575 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 17:49:58.662575 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 17:49:58.662575 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 17:49:58.662575 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 17:49:58.662575 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8--BhZ_ASJqc84aYTnO7aQpuVDeONca1CX474xJ14h-b-uW2MUffMGHSgJWjYRN3p9o1cElv-yNB-MZH5MH5irxiDf3dRJiNnKCMFw3_hkxJM7CT2rEzXVBPenTitk4X93SODDB17foMPBbZVdjE-FR_u9ZHmrVa8eTkl-QsrT_nsJU Aug 10 17:49:58.662575 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 17:49:58.662575 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 17:49:58.662575 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 17:49:58.662575 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 17:49:58.662575 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 17:49:58.662575 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 17:49:58.662575 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: 44cb25a6949b42b58732402ae05f6198 Aug 10 17:49:58.662575 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1827635580 Aug 10 17:49:58.662575 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 17:49:58.662575 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 17:49:58.664168 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/44cb25a6949b42b58732402ae05f6198"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/44cb25a6949b42b58732402ae05f6198"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/44cb25a6949b42b58732402ae05f6198"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_44cb25a6949b42b58732402ae05f6198", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:49:58.664168 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1827635580 Aug 10 17:49:58.664168 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: 44cb25a6949b42b58732402ae05f6198 Aug 10 17:49:58.664168 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1827635580 Aug 10 17:49:58.664168 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-AggregatesAdminNegativeTestJSON-1827635580-project Aug 10 17:49:58.664168 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 17:49:58.664168 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 17:49:58.664168 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: c9987b20fcac4cda950c2e3df182b032 Aug 10 17:49:58.664168 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1827635580-project Aug 10 17:49:58.664168 n-d-852296-2 devstack@n-api.service[129410]: method: > Aug 10 17:49:58.664168 n-d-852296-2 devstack@n-api.service[129410]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Aug 10 17:49:58.664168 n-d-852296-2 devstack@n-api.service[129410]: action_args: {} Aug 10 17:49:58.665160 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:49:58.665160 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:49:58.665160 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:49:58.665160 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:49:58.665160 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:49:58.665160 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:49:58.665160 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:49:58.665160 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:49:58.665160 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Aug 10 17:49:58.665160 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Aug 10 17:49:58.665160 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 10 17:49:58.665160 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 10 17:49:58.665160 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 10 17:49:58.665160 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 10 17:49:58.665160 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 10 17:49:58.665160 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 10 17:49:58.665160 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 10 17:49:58.665160 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise self.value Aug 10 17:49:58.665160 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 10 17:49:58.666472 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 10 17:49:58.666472 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 10 17:49:58.666472 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 10 17:49:58.666472 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 10 17:49:58.666472 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 10 17:49:58.666472 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Aug 10 17:49:58.666472 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:49:58.666472 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:49:58.666472 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:49:58.666472 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:49:58.666472 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:49:58.666472 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:49:58.666472 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 10 17:49:58.666472 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 10 17:49:58.666472 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Aug 10 17:49:58.666472 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:49:58.666472 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-d3cb404a-9703-411d-8ccc-87d495145342 tempest-AggregatesAdminNegativeTestJSON-1827635580 tempest-AggregatesAdminNegativeTestJSON-1827635580-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:49:58.670059 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-d3cb404a-9703-411d-8ccc-87d495145342 tempest-AggregatesAdminNegativeTestJSON-1827635580 tempest-AggregatesAdminNegativeTestJSON-1827635580-project] 10.222.0.50 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.011462 Aug 10 17:49:58.670059 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 148/294] 10.222.0.50 () {58 vars in 1143 bytes} [Wed Aug 10 17:49:58 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:49:58.678319 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-546de9d2-dd8a-4e41-a868-9a0877b28e51 tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:58.697479 n-d-852296-2 devstack@n-api.service[129410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:49:58.697479 n-d-852296-2 devstack@n-api.service[129410]: warnings.warn(msg) Aug 10 17:49:58.697479 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-546de9d2-dd8a-4e41-a868-9a0877b28e51 tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] HTTP exception thrown: Aggregate 13 could not be found. Aug 10 17:49:58.697479 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-546de9d2-dd8a-4e41-a868-9a0877b28e51 tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] Request method failure captured: Aug 10 17:49:58.697479 n-d-852296-2 devstack@n-api.service[129410]: request: DELETE /compute/v2.1/os-aggregates/13 HTTP/1.1 Aug 10 17:49:58.697479 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 17:49:58.697479 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 17:49:58.697479 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 17:49:58.697479 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 0 Aug 10 17:49:58.697479 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 17:49:58.697479 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 17:49:58.697479 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 17:49:58.697479 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 17:49:58.697479 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8--Ficu9girV1f5lF4EPOFlCIURN5B_zqNJ-YIOI-bx-bqJ5Cu5qRvpTnGWvb7956SrbLaxdr3OVwX_8ULdDaq3VABGkKVyKL9PpGvVcYaRETpooFFx5oifqGQZVBWhiUBTytiVt9j28wbqqxnck27zwFyhHgis933MYJIMrB48U7uU Aug 10 17:49:58.697479 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 17:49:58.697479 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 17:49:58.697479 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 17:49:58.697479 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 17:49:58.697479 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 17:49:58.697479 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 17:49:58.697479 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: 3c7de6e64e36444cb04e0c582cc71f4d Aug 10 17:49:58.697479 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-AggregatesAdminTestJSON-1209654538 Aug 10 17:49:58.697479 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member,admin Aug 10 17:49:58.697479 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member,admin Aug 10 17:49:58.699564 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3c7de6e64e36444cb04e0c582cc71f4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3c7de6e64e36444cb04e0c582cc71f4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3c7de6e64e36444cb04e0c582cc71f4d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3c7de6e64e36444cb04e0c582cc71f4d", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:49:58.699564 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-AggregatesAdminTestJSON-1209654538 Aug 10 17:49:58.699564 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: 3c7de6e64e36444cb04e0c582cc71f4d Aug 10 17:49:58.699564 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1209654538 Aug 10 17:49:58.699564 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-AggregatesAdminTestJSON-1209654538-project-admin Aug 10 17:49:58.699564 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 17:49:58.699564 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 17:49:58.699564 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: a477dc711ac745cb9525a1106a284195 Aug 10 17:49:58.699564 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-AggregatesAdminTestJSON-1209654538-project-admin Aug 10 17:49:58.699564 n-d-852296-2 devstack@n-api.service[129410]: method: > Aug 10 17:49:58.699564 n-d-852296-2 devstack@n-api.service[129410]: exception: Aggregate 13 could not be found. Aug 10 17:49:58.699564 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'id': '13'} Aug 10 17:49:58.699564 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:49:58.700485 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:49:58.700485 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Aug 10 17:49:58.700485 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Aug 10 17:49:58.700485 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 10 17:49:58.700485 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 10 17:49:58.700485 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 10 17:49:58.700485 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 10 17:49:58.700485 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 10 17:49:58.700485 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise self.value Aug 10 17:49:58.700485 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 10 17:49:58.700485 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 10 17:49:58.700485 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6470, in delete_aggregate Aug 10 17:49:58.700485 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Aug 10 17:49:58.700485 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 17:49:58.700485 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 17:49:58.700485 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 10 17:49:58.700485 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 10 17:49:58.700485 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 10 17:49:58.700485 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 10 17:49:58.701921 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 10 17:49:58.701921 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 10 17:49:58.701921 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 13 could not be found. Aug 10 17:49:58.701921 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:49:58.701921 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:49:58.701921 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:49:58.701921 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:49:58.701921 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:49:58.701921 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:49:58.701921 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:49:58.701921 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:49:58.701921 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:49:58.701921 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:49:58.701921 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Aug 10 17:49:58.701921 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:49:58.701921 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 13 could not be found. Aug 10 17:49:58.701921 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:49:58.701921 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:49:58.701921 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:49:58.701921 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:49:58.701921 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:49:58.703459 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:49:58.703459 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:49:58.703459 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:49:58.703459 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 13 could not be found. Aug 10 17:49:58.703459 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:49:58.703459 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-546de9d2-dd8a-4e41-a868-9a0877b28e51 tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] Returning 404 to user: Aggregate 13 could not be found. {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:49:58.703459 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-546de9d2-dd8a-4e41-a868-9a0877b28e51 tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/13" status: 404 len: 78 microversion: 2.1 time: 0.023556 Aug 10 17:49:58.704701 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 149/295] 10.222.0.50 () {58 vars in 1155 bytes} [Wed Aug 10 17:49:58 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 78 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 10 17:49:58.716413 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-3793f0f9-858d-4713-b708-bc2171fad0a0 tempest-AggregatesAdminNegativeTestJSON-734955950 tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2128864704"}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:49:58.721085 n-d-852296-2 devstack@n-api.service[129410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:49:58.721085 n-d-852296-2 devstack@n-api.service[129410]: warnings.warn(msg) Aug 10 17:49:58.722558 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.objects.aggregate [None req-3793f0f9-858d-4713-b708-bc2171fad0a0 tempest-AggregatesAdminNegativeTestJSON-734955950 tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin] Generated uuid 45201fa4-8882-44eb-b9b3-85589b58cb58 for aggregate {{(pid=129410) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 10 17:49:59.019109 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-e2f3c789-8f72-4bc8-a2ac-2341f2ad6001 tempest-FlavorsAccessTestJSON-1040209795 tempest-FlavorsAccessTestJSON-1040209795-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/1428074562" status: 202 len: 0 microversion: 2.1 time: 0.416220 Aug 10 17:49:59.019700 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 147/296] 10.222.0.50 () {58 vars in 1161 bytes} [Wed Aug 10 17:49:58 2022] DELETE /compute/v2.1/flavors/1428074562 => generated 0 bytes in 417 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 17:49:59.036389 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-c94f1b6c-a161-489c-849a-0870a68b72be tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1668081807"}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:49:59.036389 n-d-852296-2 devstack@n-api.service[129409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:49:59.036389 n-d-852296-2 devstack@n-api.service[129409]: warnings.warn(msg) Aug 10 17:49:59.036389 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.objects.aggregate [None req-c94f1b6c-a161-489c-849a-0870a68b72be tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] Generated uuid 091a076d-ffe4-460b-ad7f-199ff1c960a0 for aggregate {{(pid=129409) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 10 17:49:59.069259 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-3793f0f9-858d-4713-b708-bc2171fad0a0 tempest-AggregatesAdminNegativeTestJSON-734955950 tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.354399 Aug 10 17:49:59.069259 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 150/297] 10.222.0.50 () {60 vars in 1164 bytes} [Wed Aug 10 17:49:58 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:49:59.077886 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-dc34e4b5-973f-4a49-9cb8-6a8296bc8acf tempest-FlavorsAccessTestJSON-1040209795 tempest-FlavorsAccessTestJSON-1040209795-project-admin] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:59.110519 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-dc34e4b5-973f-4a49-9cb8-6a8296bc8acf tempest-FlavorsAccessTestJSON-1040209795 tempest-FlavorsAccessTestJSON-1040209795-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.041307 Aug 10 17:49:59.111620 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 151/298] 10.222.0.50 () {58 vars in 1146 bytes} [Wed Aug 10 17:49:59 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:49:59.118660 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-5f425373-7c45-4ae5-874e-cd43f95510ac tempest-AggregatesAdminNegativeTestJSON-734955950 tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-852296-2"}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:49:59.122785 n-d-852296-2 devstack@n-api.service[129410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:49:59.122785 n-d-852296-2 devstack@n-api.service[129410]: warnings.warn(msg) Aug 10 17:49:59.136105 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-5f425373-7c45-4ae5-874e-cd43f95510ac tempest-AggregatesAdminNegativeTestJSON-734955950 tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:59.137196 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-5f425373-7c45-4ae5-874e-cd43f95510ac tempest-AggregatesAdminNegativeTestJSON-734955950 tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:59.138525 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-5f425373-7c45-4ae5-874e-cd43f95510ac tempest-AggregatesAdminNegativeTestJSON-734955950 tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:59.318042 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-c94f1b6c-a161-489c-849a-0870a68b72be tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.297049 Aug 10 17:49:59.325192 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 148/299] 10.222.0.50 () {60 vars in 1164 bytes} [Wed Aug 10 17:49:59 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:49:59.325507 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [req-59308d63-96fa-4106-96ac-697674331d4a req-1bc17af8-325e-4caf-ab8d-85ffd0d6e5c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e9ff909-ff6f-4d8d-8d84-97af957c6506", "tag": "d660d305-1815-4a27-ab6a-2061b967f6a2"}]} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:49:59.335963 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-59308d63-96fa-4106-96ac-697674331d4a req-1bc17af8-325e-4caf-ab8d-85ffd0d6e5c5 service nova] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:59.336802 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-59308d63-96fa-4106-96ac-697674331d4a req-1bc17af8-325e-4caf-ab8d-85ffd0d6e5c5 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:59.337493 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-59308d63-96fa-4106-96ac-697674331d4a req-1bc17af8-325e-4caf-ab8d-85ffd0d6e5c5 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:59.349461 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.compute.server_external_events [req-59308d63-96fa-4106-96ac-697674331d4a req-1bc17af8-325e-4caf-ab8d-85ffd0d6e5c5 service nova] Creating event network-changed:d660d305-1815-4a27-ab6a-2061b967f6a2 for instance 7e9ff909-ff6f-4d8d-8d84-97af957c6506 on n-h1-852296-2 Aug 10 17:49:59.355432 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [req-59308d63-96fa-4106-96ac-697674331d4a req-1bc17af8-325e-4caf-ab8d-85ffd0d6e5c5 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034316 Aug 10 17:49:59.356816 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 149/300] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 10 17:49:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:49:59.362486 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-d955aa36-c0b8-4c73-9bbe-0790ff2353a3 tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:59.363463 n-d-852296-2 devstack@n-api.service[129409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:49:59.363463 n-d-852296-2 devstack@n-api.service[129409]: warnings.warn(msg) Aug 10 17:49:59.372098 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-d955aa36-c0b8-4c73-9bbe-0790ff2353a3 tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] 10.222.0.50 "GET /compute/v2.1/os-aggregates/15" status: 200 len: 228 microversion: 2.1 time: 0.013693 Aug 10 17:49:59.372732 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 150/301] 10.222.0.50 () {58 vars in 1152 bytes} [Wed Aug 10 17:49:59 2022] GET /compute/v2.1/os-aggregates/15 => generated 228 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:49:59.383826 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-c44d52a4-f5ea-4da4-bc99-10674998cb07 tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:49:59.386768 n-d-852296-2 devstack@n-api.service[129409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:49:59.386768 n-d-852296-2 devstack@n-api.service[129409]: warnings.warn(msg) Aug 10 17:49:59.547415 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-c44d52a4-f5ea-4da4-bc99-10674998cb07 tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/15/action" status: 200 len: 266 microversion: 2.1 time: 0.167081 Aug 10 17:49:59.549184 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 151/302] 10.222.0.50 () {60 vars in 1194 bytes} [Wed Aug 10 17:49:59 2022] POST /compute/v2.1/os-aggregates/15/action => generated 266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:49:59.564976 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-f21acbe8-2238-49e4-81c3-600d8bc19dbf tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:59.568698 n-d-852296-2 devstack@n-api.service[129409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:49:59.568698 n-d-852296-2 devstack@n-api.service[129409]: warnings.warn(msg) Aug 10 17:49:59.585048 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-f21acbe8-2238-49e4-81c3-600d8bc19dbf tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] 10.222.0.50 "GET /compute/v2.1/os-aggregates/15" status: 200 len: 242 microversion: 2.1 time: 0.027006 Aug 10 17:49:59.587923 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 152/303] 10.222.0.50 () {58 vars in 1152 bytes} [Wed Aug 10 17:49:59 2022] GET /compute/v2.1/os-aggregates/15 => generated 242 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:49:59.609528 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-789757df-00c3-4e28-a9f1-7375c0601787 tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:59.610846 n-d-852296-2 devstack@n-api.service[129409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:49:59.610846 n-d-852296-2 devstack@n-api.service[129409]: warnings.warn(msg) Aug 10 17:49:59.811673 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-5f425373-7c45-4ae5-874e-cd43f95510ac tempest-AggregatesAdminNegativeTestJSON-734955950 tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/14/action" status: 200 len: 243 microversion: 2.1 time: 0.698258 Aug 10 17:49:59.812457 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 152/304] 10.222.0.50 () {60 vars in 1194 bytes} [Wed Aug 10 17:49:59 2022] POST /compute/v2.1/os-aggregates/14/action => generated 243 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:49:59.830627 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-82869589-a776-4269-bc40-9b8cda124107 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:49:59.831444 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-789757df-00c3-4e28-a9f1-7375c0601787 tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.234299 Aug 10 17:49:59.832050 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-82869589-a776-4269-bc40-9b8cda124107 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] [instance: 7e9ff909-ff6f-4d8d-8d84-97af957c6506] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:49:59.837219 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 153/305] 10.222.0.50 () {58 vars in 1155 bytes} [Wed Aug 10 17:49:59 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 10 17:49:59.872392 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-82869589-a776-4269-bc40-9b8cda124107 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:59.873233 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-82869589-a776-4269-bc40-9b8cda124107 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:59.873939 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-82869589-a776-4269-bc40-9b8cda124107 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:59.874874 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-82869589-a776-4269-bc40-9b8cda124107 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:49:59.875484 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-82869589-a776-4269-bc40-9b8cda124107 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:49:59.876821 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-82869589-a776-4269-bc40-9b8cda124107 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:49:59.911547 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-d2741c81-0428-404b-a299-7005e9b14bb9 tempest-AggregatesAdminNegativeTestJSON-1827635580 tempest-AggregatesAdminNegativeTestJSON-1827635580-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-852296-2"}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:49:59.931169 n-d-852296-2 devstack@n-api.service[129409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:49:59.931169 n-d-852296-2 devstack@n-api.service[129409]: warnings.warn(msg) Aug 10 17:49:59.944219 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-d2741c81-0428-404b-a299-7005e9b14bb9 tempest-AggregatesAdminNegativeTestJSON-1827635580 tempest-AggregatesAdminNegativeTestJSON-1827635580-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': 'c9987b20fcac4cda950c2e3df182b032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cb25a6949b42b58732402ae05f6198', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:49:59.956797 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-d2741c81-0428-404b-a299-7005e9b14bb9 tempest-AggregatesAdminNegativeTestJSON-1827635580 tempest-AggregatesAdminNegativeTestJSON-1827635580-project] Request method failure captured: Aug 10 17:49:59.956797 n-d-852296-2 devstack@n-api.service[129409]: request: POST /compute/v2.1/os-aggregates/14/action HTTP/1.1 Aug 10 17:49:59.956797 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 17:49:59.956797 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 17:49:59.956797 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 17:49:59.956797 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 42 Aug 10 17:49:59.956797 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 17:49:59.956797 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 17:49:59.956797 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 17:49:59.956797 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 17:49:59.956797 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8--BhZ_ASJqc84aYTnO7aQpuVDeONca1CX474xJ14h-b-uW2MUffMGHSgJWjYRN3p9o1cElv-yNB-MZH5MH5irxiDf3dRJiNnKCMFw3_hkxJM7CT2rEzXVBPenTitk4X93SODDB17foMPBbZVdjE-FR_u9ZHmrVa8eTkl-QsrT_nsJU Aug 10 17:49:59.956797 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 17:49:59.956797 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 17:49:59.956797 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 17:49:59.956797 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 17:49:59.956797 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 17:49:59.956797 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 17:49:59.956797 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: 44cb25a6949b42b58732402ae05f6198 Aug 10 17:49:59.956797 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1827635580 Aug 10 17:49:59.956797 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 17:49:59.956797 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 17:49:59.958361 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/44cb25a6949b42b58732402ae05f6198"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/44cb25a6949b42b58732402ae05f6198"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/44cb25a6949b42b58732402ae05f6198"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_44cb25a6949b42b58732402ae05f6198", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:49:59.958361 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1827635580 Aug 10 17:49:59.958361 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: 44cb25a6949b42b58732402ae05f6198 Aug 10 17:49:59.958361 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1827635580 Aug 10 17:49:59.958361 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-AggregatesAdminNegativeTestJSON-1827635580-project Aug 10 17:49:59.958361 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 17:49:59.958361 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 17:49:59.958361 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: c9987b20fcac4cda950c2e3df182b032 Aug 10 17:49:59.958361 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1827635580-project Aug 10 17:49:59.958361 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:49:59.958361 n-d-852296-2 devstack@n-api.service[129409]: {"remove_host": {"host": "n-h2-852296-2"}} Aug 10 17:49:59.958361 n-d-852296-2 devstack@n-api.service[129409]: method: > Aug 10 17:49:59.958361 n-d-852296-2 devstack@n-api.service[129409]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Aug 10 17:49:59.959257 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'id': '14', 'body': {'remove_host': {'host': 'n-h2-852296-2'}}} Aug 10 17:49:59.959257 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:49:59.959257 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:49:59.959257 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:49:59.959257 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:49:59.959257 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:49:59.959257 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:49:59.959257 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:49:59.959257 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:49:59.959257 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:49:59.959257 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:49:59.959257 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Aug 10 17:49:59.959257 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Aug 10 17:49:59.959257 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 10 17:49:59.959257 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 10 17:49:59.959257 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 10 17:49:59.959257 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 10 17:49:59.959257 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 10 17:49:59.959257 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 10 17:49:59.960534 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 10 17:49:59.960534 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise self.value Aug 10 17:49:59.960534 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 10 17:49:59.960534 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 10 17:49:59.960534 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 10 17:49:59.960534 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 10 17:49:59.960534 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 10 17:49:59.960534 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 10 17:49:59.960534 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Aug 10 17:49:59.960534 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:49:59.960534 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:49:59.960534 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:49:59.960534 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:49:59.960534 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:49:59.960534 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:49:59.960534 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 10 17:49:59.960534 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 10 17:49:59.960534 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Aug 10 17:49:59.960534 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:49:59.973314 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-d2741c81-0428-404b-a299-7005e9b14bb9 tempest-AggregatesAdminNegativeTestJSON-1827635580 tempest-AggregatesAdminNegativeTestJSON-1827635580-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:49:59.973314 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-d2741c81-0428-404b-a299-7005e9b14bb9 tempest-AggregatesAdminNegativeTestJSON-1827635580 tempest-AggregatesAdminNegativeTestJSON-1827635580-project] 10.222.0.50 "POST /compute/v2.1/os-aggregates/14/action" status: 403 len: 121 microversion: 2.1 time: 0.131533 Aug 10 17:49:59.973314 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 154/306] 10.222.0.50 () {60 vars in 1194 bytes} [Wed Aug 10 17:49:59 2022] POST /compute/v2.1/os-aggregates/14/action => generated 121 bytes in 135 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:50:00.000672 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-e797dd43-b80c-4c42-b769-6c8c1945db02 tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1577621100", "availability_zone": "tempest-test_az-1018052877"}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:50:00.073948 n-d-852296-2 devstack@n-api.service[129409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:50:00.073948 n-d-852296-2 devstack@n-api.service[129409]: warnings.warn(msg) Aug 10 17:50:00.075776 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.objects.aggregate [None req-e797dd43-b80c-4c42-b769-6c8c1945db02 tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] Generated uuid 4f044b09-b327-40a4-be82-98dc6281a67b for aggregate {{(pid=129409) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 10 17:50:00.084265 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=9,nova_api:DELETE=11 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:50:00.249303 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-82869589-a776-4269-bc40-9b8cda124107 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f242fdc47104b98882cb29c8ca5caae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b721d6dfb14d3d8780094fc4e72890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:50:00.257294 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-82869589-a776-4269-bc40-9b8cda124107 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] 10.222.0.50 "GET /compute/v2.1/servers/7e9ff909-ff6f-4d8d-8d84-97af957c6506" status: 200 len: 1320 microversion: 2.1 time: 0.443320 Aug 10 17:50:00.272559 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 153/307] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:49:59 2022] GET /compute/v2.1/servers/7e9ff909-ff6f-4d8d-8d84-97af957c6506 => generated 1320 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:50:00.277736 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-f10d1d5e-80f7-4a2d-bb87-22d298a00e5d tempest-AggregatesAdminNegativeTestJSON-734955950 tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-852296-2"}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:50:00.281165 n-d-852296-2 devstack@n-api.service[129410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:50:00.281165 n-d-852296-2 devstack@n-api.service[129410]: warnings.warn(msg) Aug 10 17:50:00.295360 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-f10d1d5e-80f7-4a2d-bb87-22d298a00e5d tempest-AggregatesAdminNegativeTestJSON-734955950 tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:00.301277 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-f10d1d5e-80f7-4a2d-bb87-22d298a00e5d tempest-AggregatesAdminNegativeTestJSON-734955950 tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:00.301277 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-f10d1d5e-80f7-4a2d-bb87-22d298a00e5d tempest-AggregatesAdminNegativeTestJSON-734955950 tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:00.308237 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-e797dd43-b80c-4c42-b769-6c8c1945db02 tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 200 len: 223 microversion: 2.1 time: 0.318820 Aug 10 17:50:00.314970 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 155/308] 10.222.0.50 () {60 vars in 1165 bytes} [Wed Aug 10 17:49:59 2022] POST /compute/v2.1/os-aggregates => generated 223 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:50:00.321504 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-35525dda-83d0-4bc4-b675-dbaff13681f9 tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1577621100_new", "availability_zone": "tempest-test_az-1018052877_new"}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:50:00.328461 n-d-852296-2 devstack@n-api.service[129409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:50:00.328461 n-d-852296-2 devstack@n-api.service[129409]: warnings.warn(msg) Aug 10 17:50:00.511700 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-35525dda-83d0-4bc4-b675-dbaff13681f9 tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:00.512216 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-35525dda-83d0-4bc4-b675-dbaff13681f9 tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:00.512705 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-35525dda-83d0-4bc4-b675-dbaff13681f9 tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:00.784686 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-35525dda-83d0-4bc4-b675-dbaff13681f9 tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-aggregates/16" status: 200 len: 337 microversion: 2.1 time: 0.468152 Aug 10 17:50:00.786955 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 156/309] 10.222.0.50 () {60 vars in 1173 bytes} [Wed Aug 10 17:50:00 2022] PUT /compute/v2.1/os-aggregates/16 => generated 337 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:50:00.800436 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-ae6536f6-8e69-4eeb-bde8-7099ce6d7944 tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:50:00.802903 n-d-852296-2 devstack@n-api.service[129409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:50:00.802903 n-d-852296-2 devstack@n-api.service[129409]: warnings.warn(msg) Aug 10 17:50:00.826918 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-ae6536f6-8e69-4eeb-bde8-7099ce6d7944 tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] 10.222.0.50 "GET /compute/v2.1/os-aggregates" status: 200 len: 570 microversion: 2.1 time: 0.031283 Aug 10 17:50:00.828293 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 157/310] 10.222.0.50 () {58 vars in 1143 bytes} [Wed Aug 10 17:50:00 2022] GET /compute/v2.1/os-aggregates => generated 570 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:50:00.841237 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-e3d07d6e-0b3e-4a64-aeca-f487d7a99c37 tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:50:00.842295 n-d-852296-2 devstack@n-api.service[129409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:50:00.842295 n-d-852296-2 devstack@n-api.service[129409]: warnings.warn(msg) Aug 10 17:50:00.909796 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-f10d1d5e-80f7-4a2d-bb87-22d298a00e5d tempest-AggregatesAdminNegativeTestJSON-734955950 tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/14/action" status: 200 len: 228 microversion: 2.1 time: 0.608680 Aug 10 17:50:00.909796 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 154/311] 10.222.0.50 () {60 vars in 1194 bytes} [Wed Aug 10 17:50:00 2022] POST /compute/v2.1/os-aggregates/14/action => generated 228 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:50:00.921045 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-5d4840a6-8a4a-4a41-872d-0819a6aa1581 tempest-AggregatesAdminNegativeTestJSON-734955950 tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:50:00.921917 n-d-852296-2 devstack@n-api.service[129410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:50:00.921917 n-d-852296-2 devstack@n-api.service[129410]: warnings.warn(msg) Aug 10 17:50:01.066554 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=7,nova_api:DELETE=9 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:50:01.073638 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-e3d07d6e-0b3e-4a64-aeca-f487d7a99c37 tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.236869 Aug 10 17:50:01.075057 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 158/312] 10.222.0.50 () {58 vars in 1155 bytes} [Wed Aug 10 17:50:00 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 10 17:50:01.087272 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-4682b8c9-1591-4b1f-9f61-a2326c7cf775 tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1593592549"}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:50:01.095068 n-d-852296-2 devstack@n-api.service[129409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:50:01.095068 n-d-852296-2 devstack@n-api.service[129409]: warnings.warn(msg) Aug 10 17:50:01.097274 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.objects.aggregate [None req-4682b8c9-1591-4b1f-9f61-a2326c7cf775 tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] Generated uuid aad56765-4301-424e-9e2e-8bef1a50f7df for aggregate {{(pid=129409) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 10 17:50:01.120893 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-5d4840a6-8a4a-4a41-872d-0819a6aa1581 tempest-AggregatesAdminNegativeTestJSON-734955950 tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.203907 Aug 10 17:50:01.121494 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 155/313] 10.222.0.50 () {58 vars in 1155 bytes} [Wed Aug 10 17:50:00 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 10 17:50:01.131815 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-e48cf674-8c70-4457-a9c1-54f96473c129 tempest-AggregatesAdminNegativeTestJSON-734955950 tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-521154130"}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:50:01.147827 n-d-852296-2 devstack@n-api.service[129410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:50:01.147827 n-d-852296-2 devstack@n-api.service[129410]: warnings.warn(msg) Aug 10 17:50:01.149465 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.objects.aggregate [None req-e48cf674-8c70-4457-a9c1-54f96473c129 tempest-AggregatesAdminNegativeTestJSON-734955950 tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin] Generated uuid eeb8f9ff-ef77-432f-8ee7-abdbc3165bb7 for aggregate {{(pid=129410) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 10 17:50:01.316598 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-4682b8c9-1591-4b1f-9f61-a2326c7cf775 tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.234197 Aug 10 17:50:01.317235 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 159/314] 10.222.0.50 () {60 vars in 1164 bytes} [Wed Aug 10 17:50:01 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:50:01.334092 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-e48cf674-8c70-4457-a9c1-54f96473c129 tempest-AggregatesAdminNegativeTestJSON-734955950 tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.206263 Aug 10 17:50:01.347437 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-aeff0756-eba6-445c-81bd-70903cd59be9 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:50:01.347944 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 156/315] 10.222.0.50 () {60 vars in 1164 bytes} [Wed Aug 10 17:50:01 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:50:01.349026 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-aeff0756-eba6-445c-81bd-70903cd59be9 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] [instance: 7e9ff909-ff6f-4d8d-8d84-97af957c6506] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:50:01.355284 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-8d329847-66e7-4deb-be0d-84fa45e25e09 tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:50:01.358552 n-d-852296-2 devstack@n-api.service[129410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:50:01.358552 n-d-852296-2 devstack@n-api.service[129410]: warnings.warn(msg) Aug 10 17:50:01.369726 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_cell0:SELECT=4 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:50:01.376934 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-aeff0756-eba6-445c-81bd-70903cd59be9 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:01.377485 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-aeff0756-eba6-445c-81bd-70903cd59be9 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:01.380056 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-aeff0756-eba6-445c-81bd-70903cd59be9 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:01.383310 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-aeff0756-eba6-445c-81bd-70903cd59be9 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:01.383801 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-aeff0756-eba6-445c-81bd-70903cd59be9 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:01.384240 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-aeff0756-eba6-445c-81bd-70903cd59be9 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:01.384899 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-8d329847-66e7-4deb-be0d-84fa45e25e09 tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] 10.222.0.50 "GET /compute/v2.1/os-aggregates" status: 200 len: 445 microversion: 2.1 time: 0.035331 Aug 10 17:50:01.399865 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 157/316] 10.222.0.50 () {58 vars in 1143 bytes} [Wed Aug 10 17:50:01 2022] GET /compute/v2.1/os-aggregates => generated 445 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:50:01.412019 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-5e5a7480-0efa-4792-9aa0-fd9a62f1f07e tempest-AggregatesAdminNegativeTestJSON-734955950 tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:50:01.417988 n-d-852296-2 devstack@n-api.service[129410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:50:01.417988 n-d-852296-2 devstack@n-api.service[129410]: warnings.warn(msg) Aug 10 17:50:01.436493 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-5e5a7480-0efa-4792-9aa0-fd9a62f1f07e tempest-AggregatesAdminNegativeTestJSON-734955950 tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:01.440631 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-5e5a7480-0efa-4792-9aa0-fd9a62f1f07e tempest-AggregatesAdminNegativeTestJSON-734955950 tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:01.443649 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-5e5a7480-0efa-4792-9aa0-fd9a62f1f07e tempest-AggregatesAdminNegativeTestJSON-734955950 tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:01.458384 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-5e5a7480-0efa-4792-9aa0-fd9a62f1f07e tempest-AggregatesAdminNegativeTestJSON-734955950 tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:01.460421 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-5e5a7480-0efa-4792-9aa0-fd9a62f1f07e tempest-AggregatesAdminNegativeTestJSON-734955950 tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:01.461652 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-5e5a7480-0efa-4792-9aa0-fd9a62f1f07e tempest-AggregatesAdminNegativeTestJSON-734955950 tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:01.475929 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_cell1:SELECT=100 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:50:01.482852 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.compute.aggregates [None req-5e5a7480-0efa-4792-9aa0-fd9a62f1f07e tempest-AggregatesAdminNegativeTestJSON-734955950 tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin] Failed to remove host nonexist_host from aggregate 18. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Aug 10 17:50:01.484783 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-5e5a7480-0efa-4792-9aa0-fd9a62f1f07e tempest-AggregatesAdminNegativeTestJSON-734955950 tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 18 Aug 10 17:50:01.497457 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-5e5a7480-0efa-4792-9aa0-fd9a62f1f07e tempest-AggregatesAdminNegativeTestJSON-734955950 tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin] Request method failure captured: Aug 10 17:50:01.497457 n-d-852296-2 devstack@n-api.service[129410]: request: POST /compute/v2.1/os-aggregates/18/action HTTP/1.1 Aug 10 17:50:01.497457 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 17:50:01.497457 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 17:50:01.497457 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 17:50:01.497457 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 42 Aug 10 17:50:01.497457 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 17:50:01.497457 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 17:50:01.497457 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 17:50:01.497457 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 17:50:01.497457 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8--FinhXlxx8IFKnpFpAT2Mo9QKfGxddI_iKMGNb1Cjl8iSxKagj8DS2koXne8dIwX5_FVGCNTdOoyiHy2-sqqTjQfCR9EdEKc3gZynR9hJpVzE6YDP0hjcv2eKwEJp7WPPXp_BMt0f15rXmrKAPP-NUjl5gpiR7Muqr5uV0EQw-IDk Aug 10 17:50:01.497457 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 17:50:01.497457 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 17:50:01.497457 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 17:50:01.497457 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 17:50:01.497457 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 17:50:01.497457 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 17:50:01.497457 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: 812966d76c404431a451a541b1d1e58d Aug 10 17:50:01.497457 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-734955950 Aug 10 17:50:01.497457 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member,admin Aug 10 17:50:01.497457 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member,admin Aug 10 17:50:01.498928 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/812966d76c404431a451a541b1d1e58d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/812966d76c404431a451a541b1d1e58d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/812966d76c404431a451a541b1d1e58d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_812966d76c404431a451a541b1d1e58d", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:50:01.498928 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-734955950 Aug 10 17:50:01.498928 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: 812966d76c404431a451a541b1d1e58d Aug 10 17:50:01.498928 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-734955950 Aug 10 17:50:01.498928 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin Aug 10 17:50:01.498928 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 17:50:01.498928 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 17:50:01.498928 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: 32c6d09f10a94ddeb38b0185705b6740 Aug 10 17:50:01.498928 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin Aug 10 17:50:01.498928 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 17:50:01.498928 n-d-852296-2 devstack@n-api.service[129410]: {"remove_host": {"host": "nonexist_host"}} Aug 10 17:50:01.498928 n-d-852296-2 devstack@n-api.service[129410]: method: > Aug 10 17:50:01.498928 n-d-852296-2 devstack@n-api.service[129410]: exception: Cannot remove host nonexist_host in aggregate 18 Aug 10 17:50:01.499701 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'id': '18', 'body': {'remove_host': {'host': 'nonexist_host'}}} Aug 10 17:50:01.499701 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:50:01.499701 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:01.499701 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5949, in _get_service_in_cell_by_host Aug 10 17:50:01.499701 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Aug 10 17:50:01.499701 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 17:50:01.499701 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 17:50:01.499701 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 10 17:50:01.499701 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 10 17:50:01.499701 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 10 17:50:01.499701 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 10 17:50:01.499701 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 10 17:50:01.499701 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 10 17:50:01.499701 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Aug 10 17:50:01.499701 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:01.499701 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:50:01.499701 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:01.499701 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:01.499701 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5955, in _get_service_in_cell_by_host Aug 10 17:50:01.499701 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Aug 10 17:50:01.500862 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6017, in _find_service_in_cell Aug 10 17:50:01.500862 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 10 17:50:01.500862 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 10 17:50:01.500862 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:01.500862 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:50:01.500862 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:01.500862 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:01.500862 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Aug 10 17:50:01.500862 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Aug 10 17:50:01.500862 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 10 17:50:01.500862 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 10 17:50:01.500862 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 10 17:50:01.500862 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 10 17:50:01.500862 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 10 17:50:01.500862 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise self.value Aug 10 17:50:01.500862 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 10 17:50:01.500862 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 10 17:50:01.500862 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6636, in remove_host_from_aggregate Aug 10 17:50:01.500862 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Aug 10 17:50:01.500862 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5957, in _get_service_in_cell_by_host Aug 10 17:50:01.501963 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Aug 10 17:50:01.501963 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Aug 10 17:50:01.501963 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:01.501963 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:50:01.501963 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:01.501963 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:01.501963 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:50:01.501963 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:50:01.501963 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:50:01.501963 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:50:01.501963 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:50:01.501963 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:50:01.501963 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:50:01.501963 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:50:01.501963 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Aug 10 17:50:01.501963 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 10 17:50:01.501963 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 18 Aug 10 17:50:01.501963 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:01.501963 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:50:01.501963 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:01.501963 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:01.503165 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:50:01.503165 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:50:01.503165 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:50:01.503165 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:50:01.503165 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 18 Aug 10 17:50:01.503165 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:01.506352 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-5e5a7480-0efa-4792-9aa0-fd9a62f1f07e tempest-AggregatesAdminNegativeTestJSON-734955950 tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 18 {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:50:01.507993 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-5e5a7480-0efa-4792-9aa0-fd9a62f1f07e tempest-AggregatesAdminNegativeTestJSON-734955950 tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/18/action" status: 404 len: 94 microversion: 2.1 time: 0.106238 Aug 10 17:50:01.512234 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 158/317] 10.222.0.50 () {60 vars in 1194 bytes} [Wed Aug 10 17:50:01 2022] POST /compute/v2.1/os-aggregates/18/action => generated 94 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 10 17:50:01.518057 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-91ebc51b-a6a0-40f6-b351-c3ef84cc57af tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:50:01.519050 n-d-852296-2 devstack@n-api.service[129410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:50:01.519050 n-d-852296-2 devstack@n-api.service[129410]: warnings.warn(msg) Aug 10 17:50:01.633092 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-91ebc51b-a6a0-40f6-b351-c3ef84cc57af tempest-AggregatesAdminTestJSON-1209654538 tempest-AggregatesAdminTestJSON-1209654538-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.118751 Aug 10 17:50:01.635166 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 159/318] 10.222.0.50 () {58 vars in 1155 bytes} [Wed Aug 10 17:50:01 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 10 17:50:01.666168 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-8fc753f5-c62a-4160-b715-7f422518fc69 tempest-AggregatesAdminNegativeTestJSON-734955950 tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:50:01.676590 n-d-852296-2 devstack@n-api.service[129410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:50:01.676590 n-d-852296-2 devstack@n-api.service[129410]: warnings.warn(msg) Aug 10 17:50:01.852194 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-8fc753f5-c62a-4160-b715-7f422518fc69 tempest-AggregatesAdminNegativeTestJSON-734955950 tempest-AggregatesAdminNegativeTestJSON-734955950-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.207962 Aug 10 17:50:01.856693 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 160/319] 10.222.0.50 () {58 vars in 1155 bytes} [Wed Aug 10 17:50:01 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 10 17:50:01.884296 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-b74bd8a0-c175-467b-8fb7-183ab46c581c tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:50:01.889934 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-b74bd8a0-c175-467b-8fb7-183ab46c581c tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] [instance: 419ed54a-a752-46bf-b399-b93ace51b625] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:50:01.918159 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b74bd8a0-c175-467b-8fb7-183ab46c581c tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:01.922462 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b74bd8a0-c175-467b-8fb7-183ab46c581c tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:01.924178 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b74bd8a0-c175-467b-8fb7-183ab46c581c tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:01.925188 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b74bd8a0-c175-467b-8fb7-183ab46c581c tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:01.926547 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b74bd8a0-c175-467b-8fb7-183ab46c581c tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:01.928309 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b74bd8a0-c175-467b-8fb7-183ab46c581c tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:01.964668 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-aeff0756-eba6-445c-81bd-70903cd59be9 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f242fdc47104b98882cb29c8ca5caae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b721d6dfb14d3d8780094fc4e72890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:50:01.976214 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-aeff0756-eba6-445c-81bd-70903cd59be9 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] 10.222.0.50 "GET /compute/v2.1/servers/7e9ff909-ff6f-4d8d-8d84-97af957c6506" status: 200 len: 1320 microversion: 2.1 time: 0.654602 Aug 10 17:50:01.977016 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 160/320] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:50:01 2022] GET /compute/v2.1/servers/7e9ff909-ff6f-4d8d-8d84-97af957c6506 => generated 1320 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:50:01.984589 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-b74bd8a0-c175-467b-8fb7-183ab46c581c tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] HTTP exception thrown: Instance 419ed54a-a752-46bf-b399-b93ace51b625 could not be found. Aug 10 17:50:01.995704 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-b74bd8a0-c175-467b-8fb7-183ab46c581c tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Request method failure captured: Aug 10 17:50:01.995704 n-d-852296-2 devstack@n-api.service[129410]: request: DELETE /compute/v2.1/servers/419ed54a-a752-46bf-b399-b93ace51b625 HTTP/1.1 Aug 10 17:50:01.995704 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 17:50:01.995704 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 17:50:01.995704 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 17:50:01.995704 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 0 Aug 10 17:50:01.995704 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 17:50:01.995704 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 17:50:01.995704 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 17:50:01.995704 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 17:50:01.995704 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8--C1WLKSpAzCQq_ZVF31VRa8CFFECW_tCOqDA0zpb6eyfERe0CHGjLDZE2S8svcm6xoIKSiOdtgetdSRN-UfnSUgjYI8XUg8u1ZK760QqchH7eKQR8SxEJ2FksHFZQBki2FvdVn5BdCFF1kX5LwkBDDk666fIRi1p7elQYdzlDAE2k Aug 10 17:50:01.995704 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 17:50:01.995704 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 17:50:01.995704 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 17:50:01.995704 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 17:50:01.995704 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 17:50:01.995704 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 17:50:01.995704 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: dcc21714f4484762aa8797d16cd3f70b Aug 10 17:50:01.995704 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-AggregatesAdminTestJSON-1989475572 Aug 10 17:50:01.995704 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 17:50:01.995704 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 17:50:01.997070 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/dcc21714f4484762aa8797d16cd3f70b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/dcc21714f4484762aa8797d16cd3f70b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/dcc21714f4484762aa8797d16cd3f70b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_dcc21714f4484762aa8797d16cd3f70b", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:50:01.997070 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-AggregatesAdminTestJSON-1989475572 Aug 10 17:50:01.997070 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: dcc21714f4484762aa8797d16cd3f70b Aug 10 17:50:01.997070 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1989475572 Aug 10 17:50:01.997070 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-AggregatesAdminTestJSON-1989475572-project Aug 10 17:50:01.997070 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 17:50:01.997070 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 17:50:01.997070 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: d069b0c285c649b0967d0a0e3fdb24ee Aug 10 17:50:01.997070 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-AggregatesAdminTestJSON-1989475572-project Aug 10 17:50:01.997070 n-d-852296-2 devstack@n-api.service[129410]: method: > Aug 10 17:50:01.997070 n-d-852296-2 devstack@n-api.service[129410]: exception: Instance 419ed54a-a752-46bf-b399-b93ace51b625 could not be found. Aug 10 17:50:01.997070 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'id': '419ed54a-a752-46bf-b399-b93ace51b625'} Aug 10 17:50:01.997758 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:50:01.997758 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:01.997758 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 17:50:01.997758 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 17:50:01.997758 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 17:50:01.997758 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 17:50:01.997758 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 17:50:01.997758 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 17:50:01.997758 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 17:50:01.997758 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 17:50:01.997758 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 419ed54a-a752-46bf-b399-b93ace51b625 could not be found. Aug 10 17:50:01.997758 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:01.997758 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:50:01.997758 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:01.997758 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:01.997758 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:50:01.997758 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:50:01.997758 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:50:01.997758 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:50:01.997758 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:50:01.998858 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:50:01.998858 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 17:50:01.998858 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 17:50:01.998858 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 17:50:01.998858 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 17:50:01.998858 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 17:50:01.998858 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 17:50:01.998858 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 17:50:01.998858 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:50:01.998858 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 419ed54a-a752-46bf-b399-b93ace51b625 could not be found. Aug 10 17:50:01.998858 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:01.998858 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:50:01.998858 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:01.998858 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:01.998858 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:50:01.998858 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:50:01.998858 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:50:01.998858 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:50:01.998858 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 419ed54a-a752-46bf-b399-b93ace51b625 could not be found. Aug 10 17:50:01.998858 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:02.002572 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-b74bd8a0-c175-467b-8fb7-183ab46c581c tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Returning 404 to user: Instance 419ed54a-a752-46bf-b399-b93ace51b625 could not be found. {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:50:02.012139 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-b74bd8a0-c175-467b-8fb7-183ab46c581c tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] 10.222.0.50 "DELETE /compute/v2.1/servers/419ed54a-a752-46bf-b399-b93ace51b625" status: 404 len: 111 microversion: 2.1 time: 0.136214 Aug 10 17:50:02.012139 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 161/321] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 10 17:50:01 2022] DELETE /compute/v2.1/servers/419ed54a-a752-46bf-b399-b93ace51b625 => generated 111 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:50:02.019705 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-262d5ac8-d989-4856-9cb2-57a27ea025c4 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:50:02.020422 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-262d5ac8-d989-4856-9cb2-57a27ea025c4 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] [instance: 419ed54a-a752-46bf-b399-b93ace51b625] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:50:02.033461 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-262d5ac8-d989-4856-9cb2-57a27ea025c4 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:02.033964 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-262d5ac8-d989-4856-9cb2-57a27ea025c4 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:02.035772 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-262d5ac8-d989-4856-9cb2-57a27ea025c4 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:02.039673 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-262d5ac8-d989-4856-9cb2-57a27ea025c4 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:02.044862 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-262d5ac8-d989-4856-9cb2-57a27ea025c4 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:02.045830 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-262d5ac8-d989-4856-9cb2-57a27ea025c4 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:02.076223 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-262d5ac8-d989-4856-9cb2-57a27ea025c4 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] HTTP exception thrown: Instance 419ed54a-a752-46bf-b399-b93ace51b625 could not be found. Aug 10 17:50:02.079111 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-262d5ac8-d989-4856-9cb2-57a27ea025c4 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Request method failure captured: Aug 10 17:50:02.079111 n-d-852296-2 devstack@n-api.service[129409]: request: GET /compute/v2.1/servers/419ed54a-a752-46bf-b399-b93ace51b625 HTTP/1.1 Aug 10 17:50:02.079111 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 17:50:02.079111 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 17:50:02.079111 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 17:50:02.079111 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 0 Aug 10 17:50:02.079111 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 17:50:02.079111 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 17:50:02.079111 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 17:50:02.079111 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 17:50:02.079111 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8--C1WLKSpAzCQq_ZVF31VRa8CFFECW_tCOqDA0zpb6eyfERe0CHGjLDZE2S8svcm6xoIKSiOdtgetdSRN-UfnSUgjYI8XUg8u1ZK760QqchH7eKQR8SxEJ2FksHFZQBki2FvdVn5BdCFF1kX5LwkBDDk666fIRi1p7elQYdzlDAE2k Aug 10 17:50:02.079111 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 17:50:02.079111 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 17:50:02.079111 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 17:50:02.079111 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 17:50:02.079111 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 17:50:02.079111 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 17:50:02.079111 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: dcc21714f4484762aa8797d16cd3f70b Aug 10 17:50:02.079111 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-AggregatesAdminTestJSON-1989475572 Aug 10 17:50:02.079111 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 17:50:02.079111 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 17:50:02.080582 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/dcc21714f4484762aa8797d16cd3f70b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/dcc21714f4484762aa8797d16cd3f70b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/dcc21714f4484762aa8797d16cd3f70b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_dcc21714f4484762aa8797d16cd3f70b", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:50:02.080582 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-AggregatesAdminTestJSON-1989475572 Aug 10 17:50:02.080582 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: dcc21714f4484762aa8797d16cd3f70b Aug 10 17:50:02.080582 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1989475572 Aug 10 17:50:02.080582 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-AggregatesAdminTestJSON-1989475572-project Aug 10 17:50:02.080582 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 17:50:02.080582 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 17:50:02.080582 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: d069b0c285c649b0967d0a0e3fdb24ee Aug 10 17:50:02.080582 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-AggregatesAdminTestJSON-1989475572-project Aug 10 17:50:02.080582 n-d-852296-2 devstack@n-api.service[129409]: method: > Aug 10 17:50:02.080582 n-d-852296-2 devstack@n-api.service[129409]: exception: Instance 419ed54a-a752-46bf-b399-b93ace51b625 could not be found. Aug 10 17:50:02.080582 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'id': '419ed54a-a752-46bf-b399-b93ace51b625'} Aug 10 17:50:02.081428 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:50:02.081428 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:02.081428 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 17:50:02.081428 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 17:50:02.081428 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 17:50:02.081428 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 17:50:02.081428 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 17:50:02.081428 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 17:50:02.081428 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 17:50:02.081428 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 17:50:02.081428 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 419ed54a-a752-46bf-b399-b93ace51b625 could not be found. Aug 10 17:50:02.081428 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:50:02.081428 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:50:02.081428 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:50:02.081428 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:02.081428 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:50:02.081428 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:50:02.081428 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:50:02.081428 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:50:02.081428 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:50:02.083609 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:50:02.083609 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 17:50:02.083609 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 17:50:02.083609 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 17:50:02.083609 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 17:50:02.083609 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 17:50:02.083609 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:50:02.083609 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 419ed54a-a752-46bf-b399-b93ace51b625 could not be found. Aug 10 17:50:02.083609 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:50:02.083609 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:50:02.083609 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:50:02.083609 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:02.083609 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:50:02.083609 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:50:02.083609 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:50:02.083609 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:50:02.083609 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 419ed54a-a752-46bf-b399-b93ace51b625 could not be found. Aug 10 17:50:02.083609 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:50:02.086629 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-262d5ac8-d989-4856-9cb2-57a27ea025c4 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] Returning 404 to user: Instance 419ed54a-a752-46bf-b399-b93ace51b625 could not be found. {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:50:02.086629 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-262d5ac8-d989-4856-9cb2-57a27ea025c4 tempest-AggregatesAdminTestJSON-1989475572 tempest-AggregatesAdminTestJSON-1989475572-project] 10.222.0.50 "GET /compute/v2.1/servers/419ed54a-a752-46bf-b399-b93ace51b625" status: 404 len: 111 microversion: 2.1 time: 0.064845 Aug 10 17:50:02.086629 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 161/322] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:50:02 2022] GET /compute/v2.1/servers/419ed54a-a752-46bf-b399-b93ace51b625 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:50:02.999050 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-01f734ec-4469-436d-9f89-6b0d7eb710c2 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:50:03.000528 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-01f734ec-4469-436d-9f89-6b0d7eb710c2 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] [instance: 7e9ff909-ff6f-4d8d-8d84-97af957c6506] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:50:03.031421 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-01f734ec-4469-436d-9f89-6b0d7eb710c2 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:03.035461 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-01f734ec-4469-436d-9f89-6b0d7eb710c2 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:03.039682 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-01f734ec-4469-436d-9f89-6b0d7eb710c2 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:03.040687 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-01f734ec-4469-436d-9f89-6b0d7eb710c2 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:03.041453 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-01f734ec-4469-436d-9f89-6b0d7eb710c2 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:03.042043 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-01f734ec-4469-436d-9f89-6b0d7eb710c2 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:03.689216 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-01f734ec-4469-436d-9f89-6b0d7eb710c2 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f242fdc47104b98882cb29c8ca5caae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b721d6dfb14d3d8780094fc4e72890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:50:03.702405 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-01f734ec-4469-436d-9f89-6b0d7eb710c2 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] 10.222.0.50 "GET /compute/v2.1/servers/7e9ff909-ff6f-4d8d-8d84-97af957c6506" status: 200 len: 1320 microversion: 2.1 time: 0.703543 Aug 10 17:50:03.702405 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 162/323] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:50:02 2022] GET /compute/v2.1/servers/7e9ff909-ff6f-4d8d-8d84-97af957c6506 => generated 1320 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:50:04.718167 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-cc5695e5-38f4-46ac-a51e-61755fa0785f tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:50:04.720392 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-cc5695e5-38f4-46ac-a51e-61755fa0785f tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] [instance: 7e9ff909-ff6f-4d8d-8d84-97af957c6506] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:50:04.723066 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_cell0:SELECT=6 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:50:04.734175 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-cc5695e5-38f4-46ac-a51e-61755fa0785f tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:04.738736 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-cc5695e5-38f4-46ac-a51e-61755fa0785f tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:04.739384 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-cc5695e5-38f4-46ac-a51e-61755fa0785f tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:04.740490 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-cc5695e5-38f4-46ac-a51e-61755fa0785f tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:04.741364 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-cc5695e5-38f4-46ac-a51e-61755fa0785f tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:04.742352 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-cc5695e5-38f4-46ac-a51e-61755fa0785f tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:05.134950 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_cell0:SELECT=10 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:50:05.274515 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-cc5695e5-38f4-46ac-a51e-61755fa0785f tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f242fdc47104b98882cb29c8ca5caae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b721d6dfb14d3d8780094fc4e72890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:50:05.289119 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-cc5695e5-38f4-46ac-a51e-61755fa0785f tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] 10.222.0.50 "GET /compute/v2.1/servers/7e9ff909-ff6f-4d8d-8d84-97af957c6506" status: 200 len: 1320 microversion: 2.1 time: 0.572559 Aug 10 17:50:05.290577 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 162/324] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:50:04 2022] GET /compute/v2.1/servers/7e9ff909-ff6f-4d8d-8d84-97af957c6506 => generated 1320 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:50:06.310897 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-7d0bf87b-1b63-45e6-a71e-b03c86936e72 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:50:06.311670 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-7d0bf87b-1b63-45e6-a71e-b03c86936e72 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] [instance: 7e9ff909-ff6f-4d8d-8d84-97af957c6506] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:50:06.333075 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-7d0bf87b-1b63-45e6-a71e-b03c86936e72 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:06.333741 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-7d0bf87b-1b63-45e6-a71e-b03c86936e72 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:06.334996 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-7d0bf87b-1b63-45e6-a71e-b03c86936e72 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:06.337584 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-7d0bf87b-1b63-45e6-a71e-b03c86936e72 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:06.338893 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-7d0bf87b-1b63-45e6-a71e-b03c86936e72 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:06.339541 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-7d0bf87b-1b63-45e6-a71e-b03c86936e72 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:06.739990 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-7d0bf87b-1b63-45e6-a71e-b03c86936e72 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f242fdc47104b98882cb29c8ca5caae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b721d6dfb14d3d8780094fc4e72890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:50:06.750779 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-7d0bf87b-1b63-45e6-a71e-b03c86936e72 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] 10.222.0.50 "GET /compute/v2.1/servers/7e9ff909-ff6f-4d8d-8d84-97af957c6506" status: 200 len: 1320 microversion: 2.1 time: 0.446421 Aug 10 17:50:06.751874 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 163/325] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:50:06 2022] GET /compute/v2.1/servers/7e9ff909-ff6f-4d8d-8d84-97af957c6506 => generated 1320 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:50:07.777290 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-ab137bca-7cdc-4f1c-9c8f-40ea6b2947aa tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:50:07.779256 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-ab137bca-7cdc-4f1c-9c8f-40ea6b2947aa tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] [instance: 7e9ff909-ff6f-4d8d-8d84-97af957c6506] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:50:07.799408 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-ab137bca-7cdc-4f1c-9c8f-40ea6b2947aa tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:07.800163 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-ab137bca-7cdc-4f1c-9c8f-40ea6b2947aa tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:07.804592 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-ab137bca-7cdc-4f1c-9c8f-40ea6b2947aa tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:07.805423 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-ab137bca-7cdc-4f1c-9c8f-40ea6b2947aa tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:07.805896 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-ab137bca-7cdc-4f1c-9c8f-40ea6b2947aa tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:07.806321 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-ab137bca-7cdc-4f1c-9c8f-40ea6b2947aa tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:08.877758 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-ab137bca-7cdc-4f1c-9c8f-40ea6b2947aa tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f242fdc47104b98882cb29c8ca5caae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b721d6dfb14d3d8780094fc4e72890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:50:08.886127 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-ab137bca-7cdc-4f1c-9c8f-40ea6b2947aa tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] 10.222.0.50 "GET /compute/v2.1/servers/7e9ff909-ff6f-4d8d-8d84-97af957c6506" status: 200 len: 1320 microversion: 2.1 time: 1.115420 Aug 10 17:50:08.886701 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 163/326] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:50:07 2022] GET /compute/v2.1/servers/7e9ff909-ff6f-4d8d-8d84-97af957c6506 => generated 1320 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:50:09.916134 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-4fe340a6-1fde-4afd-96f3-f45bb91c526a tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:50:09.923504 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-4fe340a6-1fde-4afd-96f3-f45bb91c526a tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] [instance: 7e9ff909-ff6f-4d8d-8d84-97af957c6506] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:50:09.946594 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-4fe340a6-1fde-4afd-96f3-f45bb91c526a tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:09.948409 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-4fe340a6-1fde-4afd-96f3-f45bb91c526a tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:09.949569 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-4fe340a6-1fde-4afd-96f3-f45bb91c526a tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:09.951299 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-4fe340a6-1fde-4afd-96f3-f45bb91c526a tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:09.952914 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-4fe340a6-1fde-4afd-96f3-f45bb91c526a tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:09.965380 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-4fe340a6-1fde-4afd-96f3-f45bb91c526a tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:10.255536 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-4fe340a6-1fde-4afd-96f3-f45bb91c526a tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f242fdc47104b98882cb29c8ca5caae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b721d6dfb14d3d8780094fc4e72890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:50:10.277360 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-4fe340a6-1fde-4afd-96f3-f45bb91c526a tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] 10.222.0.50 "GET /compute/v2.1/servers/7e9ff909-ff6f-4d8d-8d84-97af957c6506" status: 200 len: 1320 microversion: 2.1 time: 0.371061 Aug 10 17:50:10.295485 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 164/327] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:50:09 2022] GET /compute/v2.1/servers/7e9ff909-ff6f-4d8d-8d84-97af957c6506 => generated 1320 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:50:11.303149 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-c386acbd-e73e-4683-a9c6-6b92329d4650 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:50:11.304847 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-c386acbd-e73e-4683-a9c6-6b92329d4650 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] [instance: 7e9ff909-ff6f-4d8d-8d84-97af957c6506] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:50:11.317365 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-c386acbd-e73e-4683-a9c6-6b92329d4650 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:11.321836 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-c386acbd-e73e-4683-a9c6-6b92329d4650 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:11.322946 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-c386acbd-e73e-4683-a9c6-6b92329d4650 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:11.325703 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-c386acbd-e73e-4683-a9c6-6b92329d4650 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:11.327721 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-c386acbd-e73e-4683-a9c6-6b92329d4650 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:11.329640 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-c386acbd-e73e-4683-a9c6-6b92329d4650 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:11.458466 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_cell0:SELECT=2 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:50:11.542859 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-c5441714-9053-48a5-9860-014f4368d20e tempest-ImagesOneServerNegativeTestJSON-1037820194 tempest-ImagesOneServerNegativeTestJSON-1037820194-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-2135189169", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "6f0fa7d0-059b-4cc3-9920-00caf6da013d"}]}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:50:11.676879 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.network.neutron [None req-c5441714-9053-48a5-9860-014f4368d20e tempest-ImagesOneServerNegativeTestJSON-1037820194 tempest-ImagesOneServerNegativeTestJSON-1037820194-project] validate_networks() for [('6f0fa7d0-059b-4cc3-9920-00caf6da013d', None, None, None, None, None)] {{(pid=129409) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 17:50:11.978221 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-c386acbd-e73e-4683-a9c6-6b92329d4650 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f242fdc47104b98882cb29c8ca5caae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b721d6dfb14d3d8780094fc4e72890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:50:11.986449 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-c386acbd-e73e-4683-a9c6-6b92329d4650 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] 10.222.0.50 "GET /compute/v2.1/servers/7e9ff909-ff6f-4d8d-8d84-97af957c6506" status: 200 len: 1320 microversion: 2.1 time: 0.687539 Aug 10 17:50:11.987040 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 165/328] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:50:11 2022] GET /compute/v2.1/servers/7e9ff909-ff6f-4d8d-8d84-97af957c6506 => generated 1320 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:50:12.750107 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-f63f19b4-8f48-4f26-b163-8ef99456253c tempest-FlavorsAccessNegativeTestJSON-243181220 tempest-FlavorsAccessNegativeTestJSON-243181220-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-287319497", "id": 2015673645, "os-flavor-access:is_public": "False"}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:50:12.756129 n-d-852296-2 devstack@n-api.service[129410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:50:12.756129 n-d-852296-2 devstack@n-api.service[129410]: warnings.warn(msg) Aug 10 17:50:12.774991 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [None req-c5441714-9053-48a5-9860-014f4368d20e tempest-ImagesOneServerNegativeTestJSON-1037820194 tempest-ImagesOneServerNegativeTestJSON-1037820194-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-895615ec-6348-41c3-8cd3-5e79475838ea) Aug 10 17:50:12.774991 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:12.774991 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:50:12.774991 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:50:12.774991 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:50:12.774991 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:50:12.774991 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:50:12.774991 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:50:12.774991 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:50:12.774991 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:50:12.774991 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 17:50:12.774991 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 17:50:12.774991 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 17:50:12.774991 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 17:50:12.774991 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 17:50:12.774991 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 17:50:12.782083 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 17:50:12.782083 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 17:50:12.782083 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 17:50:12.782083 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 17:50:12.782083 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 17:50:12.782083 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 17:50:12.782083 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 17:50:12.782083 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 17:50:12.782083 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 17:50:12.782083 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 17:50:12.782083 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 17:50:12.782083 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:50:12.782083 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:50:12.782083 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 17:50:12.782083 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 17:50:12.782083 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:50:12.782083 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:50:12.782083 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:50:12.783438 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:50:12.783438 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:50:12.783438 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:50:12.783438 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:50:12.783438 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:50:12.783438 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:50:12.783438 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:50:12.783438 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 17:50:12.783438 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 17:50:12.783438 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 17:50:12.783438 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 17:50:12.783438 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 17:50:12.783438 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 17:50:12.783438 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 17:50:12.783438 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 17:50:12.783438 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 17:50:12.783438 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 17:50:12.783438 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 17:50:12.785224 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 17:50:12.785224 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 17:50:12.785224 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 17:50:12.785224 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 17:50:12.785224 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 17:50:12.785224 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 17:50:12.785224 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 17:50:12.785224 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 17:50:12.785224 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 17:50:12.785224 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 17:50:12.785224 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 17:50:12.785224 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 17:50:12.785224 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 17:50:12.785224 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 17:50:12.785224 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 17:50:12.787161 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-895615ec-6348-41c3-8cd3-5e79475838ea) Aug 10 17:50:12.787161 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:50:12.787161 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-c5441714-9053-48a5-9860-014f4368d20e tempest-ImagesOneServerNegativeTestJSON-1037820194 tempest-ImagesOneServerNegativeTestJSON-1037820194-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:50:12.787161 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:50:12.789322 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-c5441714-9053-48a5-9860-014f4368d20e tempest-ImagesOneServerNegativeTestJSON-1037820194 tempest-ImagesOneServerNegativeTestJSON-1037820194-project] Request method failure captured: Aug 10 17:50:12.789322 n-d-852296-2 devstack@n-api.service[129409]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 17:50:12.789322 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 17:50:12.789322 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 17:50:12.789322 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 17:50:12.789322 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 217 Aug 10 17:50:12.789322 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 17:50:12.789322 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 17:50:12.789322 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 17:50:12.789322 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 17:50:12.789322 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8-_Sg4itrz5xU0QdT3df1uFA0mPId7TQEL5OXBRgMgEZJh-blVA8xIu3kj3boGZ9B-ZLjgsgk7zZ5YZNhSvZ3ouxiEjf0JJ6f0qcLcHoC_poryGxt33fBIOktEM5b4HmfeorEcEI0yZazDydAffTDMiIL1fCs3k6lk5z3s8d9FLW9PU Aug 10 17:50:12.789322 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 17:50:12.789322 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 17:50:12.789322 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 17:50:12.789322 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 17:50:12.789322 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 17:50:12.789322 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 17:50:12.789322 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: 842792e1ba82480db3d890285bbc378c Aug 10 17:50:12.789322 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1037820194 Aug 10 17:50:12.789322 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 17:50:12.789322 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 17:50:12.791351 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/842792e1ba82480db3d890285bbc378c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/842792e1ba82480db3d890285bbc378c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/842792e1ba82480db3d890285bbc378c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_842792e1ba82480db3d890285bbc378c", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:50:12.791351 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1037820194 Aug 10 17:50:12.791351 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: 842792e1ba82480db3d890285bbc378c Aug 10 17:50:12.791351 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1037820194 Aug 10 17:50:12.791351 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-ImagesOneServerNegativeTestJSON-1037820194-project Aug 10 17:50:12.791351 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 17:50:12.791351 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 17:50:12.791351 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: 676309299cd2461cb5b1f9a574368a4c Aug 10 17:50:12.791351 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1037820194-project Aug 10 17:50:12.791351 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:50:12.791351 n-d-852296-2 devstack@n-api.service[129409]: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-2135189169", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "6f0fa7d0-059b-4cc3-9920-00caf6da013d"}]}} Aug 10 17:50:12.792178 n-d-852296-2 devstack@n-api.service[129409]: method: > Aug 10 17:50:12.792178 n-d-852296-2 devstack@n-api.service[129409]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:50:12.792178 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:50:12.792178 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'body': {'server': {'name': 'tempest-ImagesOneServerNegativeTestJSON-server-2135189169', 'imageRef': 'a735ff26-463a-4ffe-a981-ab9d9baa494f', 'flavorRef': '452', 'networks': [{'uuid': '6f0fa7d0-059b-4cc3-9920-00caf6da013d'}]}}} Aug 10 17:50:12.792178 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:50:12.792178 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:12.792178 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:50:12.792178 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:50:12.792178 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:50:12.792178 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:50:12.792178 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:50:12.792178 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:50:12.792178 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:50:12.792178 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:50:12.792178 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 17:50:12.792178 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 17:50:12.792178 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 17:50:12.792178 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 17:50:12.792178 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 17:50:12.793514 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 17:50:12.793514 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 17:50:12.793514 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 17:50:12.793514 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 17:50:12.793514 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 17:50:12.793514 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 17:50:12.793514 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 17:50:12.793514 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 17:50:12.793514 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 17:50:12.793514 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 17:50:12.793514 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 17:50:12.793514 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 17:50:12.793514 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:50:12.793514 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:50:12.793514 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 17:50:12.793514 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 17:50:12.793514 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:50:12.793514 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:50:12.794736 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:50:12.794736 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:50:12.794736 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:50:12.794736 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:50:12.794736 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:50:12.794736 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:50:12.794736 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:50:12.794736 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:50:12.794736 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 17:50:12.794736 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 17:50:12.794736 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 17:50:12.794736 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 17:50:12.794736 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 17:50:12.794736 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 17:50:12.794736 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 17:50:12.794736 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 17:50:12.794736 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 17:50:12.794736 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 17:50:12.797048 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 17:50:12.797048 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 17:50:12.797048 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 17:50:12.797048 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 17:50:12.797048 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 17:50:12.797048 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 17:50:12.797048 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 17:50:12.797048 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 17:50:12.797048 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 17:50:12.797048 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 17:50:12.797048 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 17:50:12.797048 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 17:50:12.797048 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 17:50:12.797048 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 17:50:12.797048 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 17:50:12.797048 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 17:50:12.798681 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-895615ec-6348-41c3-8cd3-5e79475838ea) Aug 10 17:50:12.798681 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:50:12.798681 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:50:12.798681 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:50:12.798681 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:12.798681 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:50:12.798681 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:50:12.798681 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:50:12.798681 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:50:12.798681 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 10 17:50:12.798681 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 10 17:50:12.798681 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:50:12.798681 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:50:12.798681 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:50:12.798681 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:50:12.798681 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:50:12.798681 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:12.798681 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:50:12.798681 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:50:12.801630 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:50:12.801630 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:50:12.801630 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:50:12.801630 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:50:12.801630 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:50:12.801630 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-c5441714-9053-48a5-9860-014f4368d20e tempest-ImagesOneServerNegativeTestJSON-1037820194 tempest-ImagesOneServerNegativeTestJSON-1037820194-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:50:12.801630 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:50:12.806211 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-c5441714-9053-48a5-9860-014f4368d20e tempest-ImagesOneServerNegativeTestJSON-1037820194 tempest-ImagesOneServerNegativeTestJSON-1037820194-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.724520 Aug 10 17:50:12.811255 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 164/329] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 17:50:11 2022] POST /compute/v2.1/servers => generated 214 bytes in 1731 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 10 17:50:13.007965 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-74038afc-63e5-4c5c-9f68-387ee98c6cfa tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:50:13.008856 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-74038afc-63e5-4c5c-9f68-387ee98c6cfa tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] [instance: 7e9ff909-ff6f-4d8d-8d84-97af957c6506] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:50:13.028861 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-74038afc-63e5-4c5c-9f68-387ee98c6cfa tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:13.029098 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-f63f19b4-8f48-4f26-b163-8ef99456253c tempest-FlavorsAccessNegativeTestJSON-243181220 tempest-FlavorsAccessNegativeTestJSON-243181220-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.744636 Aug 10 17:50:13.029723 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-74038afc-63e5-4c5c-9f68-387ee98c6cfa tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:13.030112 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 166/330] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 17:50:12 2022] POST /compute/v2.1/flavors => generated 438 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:50:13.031169 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-74038afc-63e5-4c5c-9f68-387ee98c6cfa tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:13.034035 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-74038afc-63e5-4c5c-9f68-387ee98c6cfa tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:13.034437 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-74038afc-63e5-4c5c-9f68-387ee98c6cfa tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:13.034880 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-74038afc-63e5-4c5c-9f68-387ee98c6cfa tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:13.043085 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-70e35821-e19e-4f8f-8992-00f89e93c219 tempest-FlavorsAccessNegativeTestJSON-243181220 tempest-FlavorsAccessNegativeTestJSON-243181220-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "d820d1df32e94bc69d9f3695d10e8789"}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:50:13.049655 n-d-852296-2 devstack@n-api.service[129410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:50:13.049655 n-d-852296-2 devstack@n-api.service[129410]: warnings.warn(msg) Aug 10 17:50:13.068040 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:50:13.679690 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-70e35821-e19e-4f8f-8992-00f89e93c219 tempest-FlavorsAccessNegativeTestJSON-243181220 tempest-FlavorsAccessNegativeTestJSON-243181220-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors/2015673645/action" status: 200 len: 97 microversion: 2.1 time: 0.640282 Aug 10 17:50:13.681010 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 167/331] 10.222.0.50 () {60 vars in 1200 bytes} [Wed Aug 10 17:50:13 2022] POST /compute/v2.1/flavors/2015673645/action => generated 97 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 17:50:13.698059 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-bdfc1cfd-8f51-4308-9c3a-7b1c70ccde2c tempest-FlavorsAccessNegativeTestJSON-243181220 tempest-FlavorsAccessNegativeTestJSON-243181220-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "d820d1df32e94bc69d9f3695d10e8789"}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:50:13.755029 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-74038afc-63e5-4c5c-9f68-387ee98c6cfa tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f242fdc47104b98882cb29c8ca5caae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b721d6dfb14d3d8780094fc4e72890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:50:13.770523 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-74038afc-63e5-4c5c-9f68-387ee98c6cfa tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] 10.222.0.50 "GET /compute/v2.1/servers/7e9ff909-ff6f-4d8d-8d84-97af957c6506" status: 200 len: 1320 microversion: 2.1 time: 0.767142 Aug 10 17:50:13.776905 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 165/332] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:50:13 2022] GET /compute/v2.1/servers/7e9ff909-ff6f-4d8d-8d84-97af957c6506 => generated 1320 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:50:14.302168 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [req-131e1f60-dac1-4f0a-a1a7-4f24c0948621 req-5be39b14-de0f-4a7c-9ebd-e4dad43400dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e9ff909-ff6f-4d8d-8d84-97af957c6506", "name": "network-vif-plugged", "status": "completed", "tag": "d660d305-1815-4a27-ab6a-2061b967f6a2"}]} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:50:14.327616 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-bdfc1cfd-8f51-4308-9c3a-7b1c70ccde2c tempest-FlavorsAccessNegativeTestJSON-243181220 tempest-FlavorsAccessNegativeTestJSON-243181220-project-admin] HTTP exception thrown: Flavor access already exists for flavor 34 and project d820d1df32e94bc69d9f3695d10e8789 combination. Aug 10 17:50:14.330411 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-bdfc1cfd-8f51-4308-9c3a-7b1c70ccde2c tempest-FlavorsAccessNegativeTestJSON-243181220 tempest-FlavorsAccessNegativeTestJSON-243181220-project-admin] Request method failure captured: Aug 10 17:50:14.330411 n-d-852296-2 devstack@n-api.service[129410]: request: POST /compute/v2.1/flavors/2015673645/action HTTP/1.1 Aug 10 17:50:14.330411 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 17:50:14.330411 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 17:50:14.330411 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 17:50:14.330411 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 67 Aug 10 17:50:14.330411 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 17:50:14.330411 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 17:50:14.330411 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 17:50:14.330411 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 17:50:14.330411 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8-_RZgfZgmoo3sbghASsI3nAJ1ftELclq8Vad_k1tzwe9bS4WgQjdZZGN76a3ugIRo01o7Ezzt6gGQ3FtqcXAKy88Kv6ikqDoTkt35A3Xfb5zBnf3ZhNn1dllbSAGtWDsQ4wi8-mNIWHhBWlWfx1Onds37tiPsBAyljziBAdCQh9lXc Aug 10 17:50:14.330411 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 17:50:14.330411 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 17:50:14.330411 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 17:50:14.330411 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 17:50:14.330411 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 17:50:14.330411 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 17:50:14.330411 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: fc8082fa1dbf4f239422cf9a8f8c5b63 Aug 10 17:50:14.330411 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-243181220 Aug 10 17:50:14.330411 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member,admin Aug 10 17:50:14.330411 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member,admin Aug 10 17:50:14.331767 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/fc8082fa1dbf4f239422cf9a8f8c5b63"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/fc8082fa1dbf4f239422cf9a8f8c5b63"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/fc8082fa1dbf4f239422cf9a8f8c5b63"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_fc8082fa1dbf4f239422cf9a8f8c5b63", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:50:14.331767 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-243181220 Aug 10 17:50:14.331767 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: fc8082fa1dbf4f239422cf9a8f8c5b63 Aug 10 17:50:14.331767 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-243181220 Aug 10 17:50:14.331767 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-FlavorsAccessNegativeTestJSON-243181220-project-admin Aug 10 17:50:14.331767 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 17:50:14.331767 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 17:50:14.331767 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: 0d6a610c518641858f1ee3d1295b7af8 Aug 10 17:50:14.331767 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-243181220-project-admin Aug 10 17:50:14.331767 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 17:50:14.331767 n-d-852296-2 devstack@n-api.service[129410]: {"addTenantAccess": {"tenant": "d820d1df32e94bc69d9f3695d10e8789"}} Aug 10 17:50:14.331767 n-d-852296-2 devstack@n-api.service[129410]: method: > Aug 10 17:50:14.332493 n-d-852296-2 devstack@n-api.service[129410]: exception: Flavor access already exists for flavor 34 and project d820d1df32e94bc69d9f3695d10e8789 combination. Aug 10 17:50:14.332493 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'id': '2015673645', 'body': {'addTenantAccess': {'tenant': 'd820d1df32e94bc69d9f3695d10e8789'}}} Aug 10 17:50:14.332493 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:50:14.332493 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:14.332493 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 10 17:50:14.332493 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 10 17:50:14.332493 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 10 17:50:14.332493 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 10 17:50:14.332493 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 10 17:50:14.332493 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 10 17:50:14.332493 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 10 17:50:14.332493 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 10 17:50:14.332493 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 10 17:50:14.332493 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 10 17:50:14.332493 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 10 17:50:14.332493 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result.read() Aug 10 17:50:14.332493 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 10 17:50:14.332493 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 10 17:50:14.333579 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 10 17:50:14.333579 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 10 17:50:14.333579 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 10 17:50:14.333579 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 10 17:50:14.333579 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 10 17:50:14.333579 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 10 17:50:14.333579 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '34-d820d1df32e94bc69d9f3695d10e8789' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Aug 10 17:50:14.333579 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:14.333579 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 10 17:50:14.333579 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:14.333579 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:14.333579 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Aug 10 17:50:14.333579 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi project.save(context.session) Aug 10 17:50:14.333579 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Aug 10 17:50:14.333579 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi session.flush() Aug 10 17:50:14.333579 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 10 17:50:14.333579 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._flush(objects) Aug 10 17:50:14.333579 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 10 17:50:14.333579 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Aug 10 17:50:14.342019 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 10 17:50:14.342019 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi compat.raise_( Aug 10 17:50:14.342019 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 10 17:50:14.342019 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exception Aug 10 17:50:14.342019 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 10 17:50:14.342019 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi flush_context.execute() Aug 10 17:50:14.342019 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 10 17:50:14.342019 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi rec.execute(self) Aug 10 17:50:14.342019 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 10 17:50:14.342019 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Aug 10 17:50:14.342019 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 10 17:50:14.342019 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Aug 10 17:50:14.342019 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 10 17:50:14.342019 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Aug 10 17:50:14.342019 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 10 17:50:14.342019 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Aug 10 17:50:14.342019 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 10 17:50:14.342019 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Aug 10 17:50:14.343343 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 10 17:50:14.343343 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Aug 10 17:50:14.343343 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 10 17:50:14.343343 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Aug 10 17:50:14.343343 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 10 17:50:14.343343 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 10 17:50:14.343343 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 10 17:50:14.343343 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exception Aug 10 17:50:14.343343 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 10 17:50:14.343343 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 10 17:50:14.343343 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 10 17:50:14.343343 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 10 17:50:14.343343 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 10 17:50:14.343343 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 10 17:50:14.343343 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 10 17:50:14.343343 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 10 17:50:14.343343 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 10 17:50:14.343343 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 10 17:50:14.344386 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 10 17:50:14.344386 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result.read() Aug 10 17:50:14.344386 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 10 17:50:14.344386 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 10 17:50:14.344386 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 10 17:50:14.344386 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 10 17:50:14.344386 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 10 17:50:14.344386 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 10 17:50:14.344386 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 10 17:50:14.344386 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 10 17:50:14.344386 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '34-d820d1df32e94bc69d9f3695d10e8789' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Aug 10 17:50:14.344386 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Aug 10 17:50:14.344386 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 8, 10, 17, 50, 14, 253427), 'updated_at': None, 'flavor_id': 34, 'project_id': 'd820d1df32e94bc69d9f3695d10e8789'}] Aug 10 17:50:14.344386 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 10 17:50:14.344386 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:14.344386 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:50:14.344386 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:14.351739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:14.351739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Aug 10 17:50:14.351739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Aug 10 17:50:14.351739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 10 17:50:14.351739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 10 17:50:14.351739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Aug 10 17:50:14.351739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Aug 10 17:50:14.351739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Aug 10 17:50:14.351739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Aug 10 17:50:14.351739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Aug 10 17:50:14.351739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Aug 10 17:50:14.351739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 10 17:50:14.351739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 10 17:50:14.351739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Aug 10 17:50:14.351739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Aug 10 17:50:14.351739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 34 and project d820d1df32e94bc69d9f3695d10e8789 combination. Aug 10 17:50:14.351739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:14.351739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:50:14.351739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:14.353665 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:14.353665 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:50:14.353665 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:50:14.353665 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:50:14.353665 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:50:14.353665 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:50:14.353665 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:50:14.353665 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:50:14.353665 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:50:14.353665 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Aug 10 17:50:14.353665 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Aug 10 17:50:14.353665 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 34 and project d820d1df32e94bc69d9f3695d10e8789 combination. Aug 10 17:50:14.353665 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:14.353665 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:50:14.353665 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:14.353665 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:14.353665 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:50:14.353665 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:50:14.353665 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:50:14.353665 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:50:14.355861 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 34 and project d820d1df32e94bc69d9f3695d10e8789 combination. Aug 10 17:50:14.355861 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:14.355861 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-bdfc1cfd-8f51-4308-9c3a-7b1c70ccde2c tempest-FlavorsAccessNegativeTestJSON-243181220 tempest-FlavorsAccessNegativeTestJSON-243181220-project-admin] Returning 409 to user: Flavor access already exists for flavor 34 and project d820d1df32e94bc69d9f3695d10e8789 combination. {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:50:14.355861 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-bdfc1cfd-8f51-4308-9c3a-7b1c70ccde2c tempest-FlavorsAccessNegativeTestJSON-243181220 tempest-FlavorsAccessNegativeTestJSON-243181220-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors/2015673645/action" status: 409 len: 152 microversion: 2.1 time: 0.641384 Aug 10 17:50:14.355861 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 168/333] 10.222.0.50 () {60 vars in 1200 bytes} [Wed Aug 10 17:50:13 2022] POST /compute/v2.1/flavors/2015673645/action => generated 152 bytes in 643 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 10 17:50:14.355861 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-5d55ed05-2e68-4fe6-88fe-7d6e82d8cba0 tempest-FlavorsAccessNegativeTestJSON-243181220 tempest-FlavorsAccessNegativeTestJSON-243181220-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "d820d1df32e94bc69d9f3695d10e8789"}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:50:14.356854 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_api:DELETE=13,nova_api:SELECT=78,nova_api:INSERT=7,nova_api:UPDATE=2 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:50:14.356854 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-131e1f60-dac1-4f0a-a1a7-4f24c0948621 req-5be39b14-de0f-4a7c-9ebd-e4dad43400dc service nova] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:14.363820 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-131e1f60-dac1-4f0a-a1a7-4f24c0948621 req-5be39b14-de0f-4a7c-9ebd-e4dad43400dc service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:14.364306 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-131e1f60-dac1-4f0a-a1a7-4f24c0948621 req-5be39b14-de0f-4a7c-9ebd-e4dad43400dc service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:14.375780 n-d-852296-2 devstack@n-api.service[129410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:50:14.375780 n-d-852296-2 devstack@n-api.service[129410]: warnings.warn(msg) Aug 10 17:50:14.403351 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.compute.server_external_events [req-131e1f60-dac1-4f0a-a1a7-4f24c0948621 req-5be39b14-de0f-4a7c-9ebd-e4dad43400dc service nova] Creating event network-vif-plugged:d660d305-1815-4a27-ab6a-2061b967f6a2 for instance 7e9ff909-ff6f-4d8d-8d84-97af957c6506 on n-h1-852296-2 Aug 10 17:50:14.412191 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [req-131e1f60-dac1-4f0a-a1a7-4f24c0948621 req-5be39b14-de0f-4a7c-9ebd-e4dad43400dc service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115005 Aug 10 17:50:14.419726 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 166/334] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 10 17:50:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:50:14.829748 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-41d0012c-3a2f-48b0-ac9c-660575258adf tempest-FloatingIPsAssociationNegativeTestJSON-1049993124 tempest-FloatingIPsAssociationNegativeTestJSON-1049993124-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-1049792545", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "9818a43c-fe48-4a6e-8639-9a2a15799afd"}]}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:50:14.981076 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.network.neutron [None req-41d0012c-3a2f-48b0-ac9c-660575258adf tempest-FloatingIPsAssociationNegativeTestJSON-1049993124 tempest-FloatingIPsAssociationNegativeTestJSON-1049993124-project] validate_networks() for [('9818a43c-fe48-4a6e-8639-9a2a15799afd', None, None, None, None, None)] {{(pid=129409) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 17:50:15.688299 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_api:SELECT=84,nova_api:DELETE=8,nova_api:INSERT=8 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:50:15.772812 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-5d55ed05-2e68-4fe6-88fe-7d6e82d8cba0 tempest-FlavorsAccessNegativeTestJSON-243181220 tempest-FlavorsAccessNegativeTestJSON-243181220-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors/2015673645/action" status: 200 len: 21 microversion: 2.1 time: 1.434178 Aug 10 17:50:15.778836 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 169/335] 10.222.0.50 () {60 vars in 1200 bytes} [Wed Aug 10 17:50:14 2022] POST /compute/v2.1/flavors/2015673645/action => generated 21 bytes in 1442 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 10 17:50:15.798171 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-b7ffbc91-9b60-4d61-bd5c-956e73661d94 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:50:15.799094 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-b7ffbc91-9b60-4d61-bd5c-956e73661d94 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] [instance: 7e9ff909-ff6f-4d8d-8d84-97af957c6506] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:50:15.822305 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b7ffbc91-9b60-4d61-bd5c-956e73661d94 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:15.823043 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b7ffbc91-9b60-4d61-bd5c-956e73661d94 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:15.823861 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b7ffbc91-9b60-4d61-bd5c-956e73661d94 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:15.825538 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b7ffbc91-9b60-4d61-bd5c-956e73661d94 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:15.826167 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b7ffbc91-9b60-4d61-bd5c-956e73661d94 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:15.826748 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b7ffbc91-9b60-4d61-bd5c-956e73661d94 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:16.023669 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [None req-41d0012c-3a2f-48b0-ac9c-660575258adf tempest-FloatingIPsAssociationNegativeTestJSON-1049993124 tempest-FloatingIPsAssociationNegativeTestJSON-1049993124-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-b4dfd3d2-9350-4abc-a1b0-5610c4f6db52) Aug 10 17:50:16.023669 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:16.023669 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:50:16.023669 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:50:16.023669 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:50:16.023669 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:50:16.023669 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:50:16.023669 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:50:16.023669 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:50:16.023669 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:50:16.023669 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 17:50:16.023669 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 17:50:16.023669 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 17:50:16.023669 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 17:50:16.023669 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 17:50:16.023669 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 17:50:16.024967 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 17:50:16.024967 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 17:50:16.024967 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 17:50:16.024967 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 17:50:16.024967 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 17:50:16.024967 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 17:50:16.024967 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 17:50:16.024967 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 17:50:16.024967 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 17:50:16.024967 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 17:50:16.024967 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 17:50:16.024967 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:50:16.024967 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:50:16.024967 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 17:50:16.024967 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 17:50:16.024967 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:50:16.024967 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:50:16.024967 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:50:16.025917 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:50:16.025917 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:50:16.025917 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:50:16.025917 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:50:16.025917 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:50:16.025917 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:50:16.025917 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:50:16.025917 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 17:50:16.025917 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 17:50:16.025917 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 17:50:16.025917 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 17:50:16.025917 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 17:50:16.025917 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 17:50:16.025917 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 17:50:16.025917 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 17:50:16.025917 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 17:50:16.025917 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 17:50:16.025917 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 17:50:16.026865 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 17:50:16.026865 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 17:50:16.026865 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 17:50:16.026865 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 17:50:16.026865 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 17:50:16.026865 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 17:50:16.026865 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 17:50:16.026865 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 17:50:16.026865 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 17:50:16.026865 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 17:50:16.026865 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 17:50:16.026865 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 17:50:16.026865 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 17:50:16.026865 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 17:50:16.026865 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 17:50:16.027668 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-b4dfd3d2-9350-4abc-a1b0-5610c4f6db52) Aug 10 17:50:16.027668 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:50:16.027668 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-41d0012c-3a2f-48b0-ac9c-660575258adf tempest-FloatingIPsAssociationNegativeTestJSON-1049993124 tempest-FloatingIPsAssociationNegativeTestJSON-1049993124-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:50:16.027668 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:50:16.027668 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-41d0012c-3a2f-48b0-ac9c-660575258adf tempest-FloatingIPsAssociationNegativeTestJSON-1049993124 tempest-FloatingIPsAssociationNegativeTestJSON-1049993124-project] Request method failure captured: Aug 10 17:50:16.027668 n-d-852296-2 devstack@n-api.service[129409]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 17:50:16.027668 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 17:50:16.027668 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 17:50:16.027668 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 17:50:16.027668 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 224 Aug 10 17:50:16.027668 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 17:50:16.027668 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 17:50:16.027668 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 17:50:16.027668 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 17:50:16.027668 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8-_VdkHjCoDAH0x9u7cGlbHl9DZvD1V0553-x91y_3IIH-M-2UfaMdqjBllGGOHurbT40S-qYIfHLUkPxe2KaSbdlVNMzclfZ18BSax-TVgRnujanmAiZLAakmNAiicw2oBzKMgrowK96kaeanrQWdg2pE9fgv139-tQ1NgoX4Svk-c Aug 10 17:50:16.027668 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 17:50:16.027668 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 17:50:16.027668 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 17:50:16.027668 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 17:50:16.027668 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 17:50:16.027668 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 17:50:16.027668 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: 2cde15b66a2b4ba3af0291e9237c2b35 Aug 10 17:50:16.027668 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1049993124 Aug 10 17:50:16.027668 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 17:50:16.027668 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 17:50:16.029069 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2cde15b66a2b4ba3af0291e9237c2b35"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/2cde15b66a2b4ba3af0291e9237c2b35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2cde15b66a2b4ba3af0291e9237c2b35"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_2cde15b66a2b4ba3af0291e9237c2b35", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:50:16.029069 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1049993124 Aug 10 17:50:16.029069 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: 2cde15b66a2b4ba3af0291e9237c2b35 Aug 10 17:50:16.029069 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1049993124 Aug 10 17:50:16.029069 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1049993124-project Aug 10 17:50:16.029069 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 17:50:16.029069 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 17:50:16.029069 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: a3fc67a41fff4d86b105aa669c74881f Aug 10 17:50:16.029069 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1049993124-project Aug 10 17:50:16.029069 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:50:16.029069 n-d-852296-2 devstack@n-api.service[129409]: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-1049792545", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "9818a43c-fe48-4a6e-8639-9a2a15799afd"}]}} Aug 10 17:50:16.029687 n-d-852296-2 devstack@n-api.service[129409]: method: > Aug 10 17:50:16.029687 n-d-852296-2 devstack@n-api.service[129409]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:50:16.029687 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:50:16.029687 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'body': {'server': {'name': 'tempest-FloatingIPsAssociationNegativeTestJSON-server-1049792545', 'imageRef': 'a735ff26-463a-4ffe-a981-ab9d9baa494f', 'flavorRef': '452', 'networks': [{'uuid': '9818a43c-fe48-4a6e-8639-9a2a15799afd'}]}}} Aug 10 17:50:16.029687 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:50:16.029687 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:16.029687 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:50:16.029687 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:50:16.029687 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:50:16.029687 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:50:16.029687 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:50:16.029687 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:50:16.029687 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:50:16.029687 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:50:16.029687 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 17:50:16.029687 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 17:50:16.029687 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 17:50:16.029687 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 17:50:16.029687 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 17:50:16.030706 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 17:50:16.030706 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 17:50:16.030706 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 17:50:16.030706 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 17:50:16.030706 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 17:50:16.030706 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 17:50:16.030706 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 17:50:16.030706 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 17:50:16.030706 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 17:50:16.030706 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 17:50:16.030706 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 17:50:16.030706 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 17:50:16.030706 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:50:16.030706 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:50:16.030706 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 17:50:16.030706 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 17:50:16.030706 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:50:16.030706 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:50:16.031654 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:50:16.031654 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:50:16.031654 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:50:16.031654 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:50:16.031654 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:50:16.031654 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:50:16.031654 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:50:16.031654 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:50:16.031654 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 17:50:16.031654 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 17:50:16.031654 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 17:50:16.031654 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 17:50:16.031654 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 17:50:16.031654 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 17:50:16.031654 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 17:50:16.031654 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 17:50:16.031654 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 17:50:16.031654 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 17:50:16.035369 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 17:50:16.035369 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 17:50:16.035369 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 17:50:16.035369 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 17:50:16.035369 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 17:50:16.035369 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 17:50:16.035369 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 17:50:16.035369 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 17:50:16.035369 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 17:50:16.035369 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 17:50:16.035369 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 17:50:16.035369 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 17:50:16.035369 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 17:50:16.035369 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 17:50:16.035369 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 17:50:16.035369 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 17:50:16.040052 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-b4dfd3d2-9350-4abc-a1b0-5610c4f6db52) Aug 10 17:50:16.040052 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:50:16.040052 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:50:16.040052 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:50:16.040052 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:16.040052 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:50:16.040052 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:50:16.040052 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:50:16.040052 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:50:16.040052 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 10 17:50:16.040052 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 10 17:50:16.040052 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:50:16.040052 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:50:16.040052 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:50:16.040052 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:50:16.040052 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:50:16.040052 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:16.040052 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:50:16.040052 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:50:16.042601 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:50:16.042601 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:50:16.042601 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:50:16.042601 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:50:16.042601 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:50:16.042601 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-41d0012c-3a2f-48b0-ac9c-660575258adf tempest-FloatingIPsAssociationNegativeTestJSON-1049993124 tempest-FloatingIPsAssociationNegativeTestJSON-1049993124-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:50:16.042601 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:50:16.042601 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-41d0012c-3a2f-48b0-ac9c-660575258adf tempest-FloatingIPsAssociationNegativeTestJSON-1049993124 tempest-FloatingIPsAssociationNegativeTestJSON-1049993124-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.420523 Aug 10 17:50:16.042601 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 167/336] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 17:50:14 2022] POST /compute/v2.1/servers => generated 214 bytes in 1422 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 10 17:50:16.592275 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-6bc40709-642f-43ca-9976-e313325268bf tempest-HostsAdminTestJSON-8957156 tempest-HostsAdminTestJSON-8957156-project-admin] Calling method '.version_select at 0x7fb346839b80>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:50:16.595589 n-d-852296-2 devstack@n-api.service[129409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:50:16.595589 n-d-852296-2 devstack@n-api.service[129409]: warnings.warn(msg) Aug 10 17:50:16.602613 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-6bc40709-642f-43ca-9976-e313325268bf tempest-HostsAdminTestJSON-8957156 tempest-HostsAdminTestJSON-8957156-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:16.603255 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-6bc40709-642f-43ca-9976-e313325268bf tempest-HostsAdminTestJSON-8957156 tempest-HostsAdminTestJSON-8957156-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:16.603770 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-6bc40709-642f-43ca-9976-e313325268bf tempest-HostsAdminTestJSON-8957156 tempest-HostsAdminTestJSON-8957156-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:16.604651 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-6bc40709-642f-43ca-9976-e313325268bf tempest-HostsAdminTestJSON-8957156 tempest-HostsAdminTestJSON-8957156-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:16.605182 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-6bc40709-642f-43ca-9976-e313325268bf tempest-HostsAdminTestJSON-8957156 tempest-HostsAdminTestJSON-8957156-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:16.605691 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-6bc40709-642f-43ca-9976-e313325268bf tempest-HostsAdminTestJSON-8957156 tempest-HostsAdminTestJSON-8957156-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:16.671219 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-b7ffbc91-9b60-4d61-bd5c-956e73661d94 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f242fdc47104b98882cb29c8ca5caae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b721d6dfb14d3d8780094fc4e72890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:50:16.686330 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-b7ffbc91-9b60-4d61-bd5c-956e73661d94 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] 10.222.0.50 "GET /compute/v2.1/servers/7e9ff909-ff6f-4d8d-8d84-97af957c6506" status: 200 len: 1320 microversion: 2.1 time: 0.906108 Aug 10 17:50:16.693419 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 170/337] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:50:15 2022] GET /compute/v2.1/servers/7e9ff909-ff6f-4d8d-8d84-97af957c6506 => generated 1320 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:50:16.717658 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-281c489b-9de0-44ef-ae0f-41a955a90bc3 tempest-FlavorsAccessNegativeTestJSON-243181220 tempest-FlavorsAccessNegativeTestJSON-243181220-project-admin] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:50:16.734269 n-d-852296-2 devstack@n-api.service[129410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:50:16.734269 n-d-852296-2 devstack@n-api.service[129410]: warnings.warn(msg) Aug 10 17:50:16.750038 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-6bc40709-642f-43ca-9976-e313325268bf tempest-HostsAdminTestJSON-8957156 tempest-HostsAdminTestJSON-8957156-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.718613 Aug 10 17:50:16.755479 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 168/338] 10.222.0.50 () {58 vars in 1128 bytes} [Wed Aug 10 17:50:16 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:50:16.878843 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-fad25051-1daf-4842-83a0-26e6ec6c3020 tempest-FlavorsExtraSpecsNegativeTestJSON-1685476613 tempest-FlavorsExtraSpecsNegativeTestJSON-1685476613-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1432852631", "ram": 512, "vcpus": 1, "disk": 10, "id": 30325457, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:50:16.883783 n-d-852296-2 devstack@n-api.service[129409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:50:16.883783 n-d-852296-2 devstack@n-api.service[129409]: warnings.warn(msg) Aug 10 17:50:17.015866 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-281c489b-9de0-44ef-ae0f-41a955a90bc3 tempest-FlavorsAccessNegativeTestJSON-243181220 tempest-FlavorsAccessNegativeTestJSON-243181220-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/2015673645" status: 202 len: 0 microversion: 2.1 time: 0.319699 Aug 10 17:50:17.016834 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 171/339] 10.222.0.50 () {58 vars in 1161 bytes} [Wed Aug 10 17:50:16 2022] DELETE /compute/v2.1/flavors/2015673645 => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 17:50:17.023522 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-05851ab8-5e88-41a4-a5c6-15941920ba40 tempest-HostsAdminTestJSON-8957156 tempest-HostsAdminTestJSON-8957156-project-admin] Calling method '.version_select at 0x7fb34688d3a0>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:50:17.030261 n-d-852296-2 devstack@n-api.service[129410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:50:17.030261 n-d-852296-2 devstack@n-api.service[129410]: warnings.warn(msg) Aug 10 17:50:17.031893 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-05851ab8-5e88-41a4-a5c6-15941920ba40 tempest-HostsAdminTestJSON-8957156 tempest-HostsAdminTestJSON-8957156-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:17.032567 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-05851ab8-5e88-41a4-a5c6-15941920ba40 tempest-HostsAdminTestJSON-8957156 tempest-HostsAdminTestJSON-8957156-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:17.033160 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-05851ab8-5e88-41a4-a5c6-15941920ba40 tempest-HostsAdminTestJSON-8957156 tempest-HostsAdminTestJSON-8957156-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:17.038244 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-05851ab8-5e88-41a4-a5c6-15941920ba40 tempest-HostsAdminTestJSON-8957156 tempest-HostsAdminTestJSON-8957156-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:17.039148 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-05851ab8-5e88-41a4-a5c6-15941920ba40 tempest-HostsAdminTestJSON-8957156 tempest-HostsAdminTestJSON-8957156-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:17.039776 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-05851ab8-5e88-41a4-a5c6-15941920ba40 tempest-HostsAdminTestJSON-8957156 tempest-HostsAdminTestJSON-8957156-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:17.058103 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-fad25051-1daf-4842-83a0-26e6ec6c3020 tempest-FlavorsExtraSpecsNegativeTestJSON-1685476613 tempest-FlavorsExtraSpecsNegativeTestJSON-1685476613-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 0.298848 Aug 10 17:50:17.061202 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 169/340] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 17:50:16 2022] POST /compute/v2.1/flavors => generated 410 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:50:17.077176 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-c4b84ab3-0d5e-4b16-bd5f-700e9e31db29 tempest-FlavorsAccessNegativeTestJSON-243181220 tempest-FlavorsAccessNegativeTestJSON-243181220-project-admin] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:50:17.142016 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-05851ab8-5e88-41a4-a5c6-15941920ba40 tempest-HostsAdminTestJSON-8957156 tempest-HostsAdminTestJSON-8957156-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 376 microversion: 2.1 time: 0.121039 Aug 10 17:50:17.144647 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 172/341] 10.222.0.50 () {58 vars in 1139 bytes} [Wed Aug 10 17:50:17 2022] GET /compute/v2.1/os-hosts?zone= => generated 376 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:50:17.175831 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-c4b84ab3-0d5e-4b16-bd5f-700e9e31db29 tempest-FlavorsAccessNegativeTestJSON-243181220 tempest-FlavorsAccessNegativeTestJSON-243181220-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 5391 microversion: 2.1 time: 0.113227 Aug 10 17:50:17.176709 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 170/342] 10.222.0.50 () {58 vars in 1146 bytes} [Wed Aug 10 17:50:17 2022] GET /compute/v2.1/flavors/detail => generated 5391 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:50:17.182367 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-d454a873-a2a5-4c6a-95f4-f206ecb209db tempest-HostsAdminTestJSON-8957156 tempest-HostsAdminTestJSON-8957156-project-admin] Calling method '.version_select at 0x7fb346839d30>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:50:17.189544 n-d-852296-2 devstack@n-api.service[129409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:50:17.189544 n-d-852296-2 devstack@n-api.service[129409]: warnings.warn(msg) Aug 10 17:50:17.195544 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-d454a873-a2a5-4c6a-95f4-f206ecb209db tempest-HostsAdminTestJSON-8957156 tempest-HostsAdminTestJSON-8957156-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:17.201853 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-d454a873-a2a5-4c6a-95f4-f206ecb209db tempest-HostsAdminTestJSON-8957156 tempest-HostsAdminTestJSON-8957156-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:17.202844 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-d454a873-a2a5-4c6a-95f4-f206ecb209db tempest-HostsAdminTestJSON-8957156 tempest-HostsAdminTestJSON-8957156-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:17.212479 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-d454a873-a2a5-4c6a-95f4-f206ecb209db tempest-HostsAdminTestJSON-8957156 tempest-HostsAdminTestJSON-8957156-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:17.213338 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-d454a873-a2a5-4c6a-95f4-f206ecb209db tempest-HostsAdminTestJSON-8957156 tempest-HostsAdminTestJSON-8957156-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:17.214136 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-d454a873-a2a5-4c6a-95f4-f206ecb209db tempest-HostsAdminTestJSON-8957156 tempest-HostsAdminTestJSON-8957156-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:17.302567 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-d454a873-a2a5-4c6a-95f4-f206ecb209db tempest-HostsAdminTestJSON-8957156 tempest-HostsAdminTestJSON-8957156-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.124467 Aug 10 17:50:17.306399 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 171/343] 10.222.0.50 () {58 vars in 1145 bytes} [Wed Aug 10 17:50:17 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 17:50:17.318116 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-92d3eb0f-a5cc-4eeb-8630-3f611c1e78d0 tempest-FlavorsAccessNegativeTestJSON-243181220 tempest-FlavorsAccessNegativeTestJSON-243181220-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1586602111", "id": 756689895, "os-flavor-access:is_public": "True"}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:50:17.323919 n-d-852296-2 devstack@n-api.service[129409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:50:17.323919 n-d-852296-2 devstack@n-api.service[129409]: warnings.warn(msg) Aug 10 17:50:17.459832 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-b8ee08a2-2b0c-46f3-a4e4-72a83842dc97 tempest-FlavorsExtraSpecsNegativeTestJSON-73171872 tempest-FlavorsExtraSpecsNegativeTestJSON-73171872-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:50:17.462102 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-92d3eb0f-a5cc-4eeb-8630-3f611c1e78d0 tempest-FlavorsAccessNegativeTestJSON-243181220 tempest-FlavorsAccessNegativeTestJSON-243181220-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.153977 Aug 10 17:50:17.463031 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 172/344] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 17:50:17 2022] POST /compute/v2.1/flavors => generated 435 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:50:17.480136 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-d9c7ed84-9bf7-4098-a217-4ebdd6a33eb7 tempest-HostsAdminTestJSON-8957156 tempest-HostsAdminTestJSON-8957156-project-admin] Calling method '.version_select at 0x7fb346946280>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:50:17.484570 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-b8ee08a2-2b0c-46f3-a4e4-72a83842dc97 tempest-FlavorsExtraSpecsNegativeTestJSON-73171872 tempest-FlavorsExtraSpecsNegativeTestJSON-73171872-project] HTTP exception thrown: Flavor 30325457 has no extra specs with key hw:cpu_thread_policy. Aug 10 17:50:17.484965 n-d-852296-2 devstack@n-api.service[129409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:50:17.484965 n-d-852296-2 devstack@n-api.service[129409]: warnings.warn(msg) Aug 10 17:50:17.486324 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-b8ee08a2-2b0c-46f3-a4e4-72a83842dc97 tempest-FlavorsExtraSpecsNegativeTestJSON-73171872 tempest-FlavorsExtraSpecsNegativeTestJSON-73171872-project] Request method failure captured: Aug 10 17:50:17.486324 n-d-852296-2 devstack@n-api.service[129410]: request: GET /compute/v2.1/flavors/30325457/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Aug 10 17:50:17.486324 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 17:50:17.486324 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 17:50:17.486324 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 17:50:17.486324 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 0 Aug 10 17:50:17.486324 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 17:50:17.486324 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 17:50:17.486324 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 17:50:17.486324 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 17:50:17.486324 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8-_VTu4xaVzzCSusqX9f5hK8GSdA-yJKgSa8gSbDR5ANXsL_lvAcatVXRZnPyFvt0hIH4kaSI2vj7suypF6detQX64ldjEws1t7NXSuSQkZdGtNq9hmjixvjxcd-vEnSd5snXMoPDG3jqv2DrJHB1RAOgv59C1ruwvAAWSlO1tnjwUU Aug 10 17:50:17.486324 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 17:50:17.486324 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 17:50:17.486324 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 17:50:17.486324 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 17:50:17.486324 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 17:50:17.486324 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 17:50:17.486324 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: 48c42b80b1d744f29616214606185406 Aug 10 17:50:17.486324 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-73171872 Aug 10 17:50:17.486324 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 17:50:17.486324 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 17:50:17.487568 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/48c42b80b1d744f29616214606185406"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/48c42b80b1d744f29616214606185406"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/48c42b80b1d744f29616214606185406"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_48c42b80b1d744f29616214606185406", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:50:17.487568 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-73171872 Aug 10 17:50:17.487568 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: 48c42b80b1d744f29616214606185406 Aug 10 17:50:17.487568 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-73171872 Aug 10 17:50:17.487568 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-73171872-project Aug 10 17:50:17.487568 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 17:50:17.487568 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 17:50:17.487568 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: 5195b8fdb52547cfb58e8e3d1006cacf Aug 10 17:50:17.487568 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-73171872-project Aug 10 17:50:17.487568 n-d-852296-2 devstack@n-api.service[129410]: method: > Aug 10 17:50:17.487568 n-d-852296-2 devstack@n-api.service[129410]: exception: Flavor 30325457 has no extra specs with key hw:cpu_thread_policy. Aug 10 17:50:17.488213 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'flavor_id': '30325457', 'id': 'hw:cpu_thread_policy'} Aug 10 17:50:17.488213 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:50:17.488213 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:17.488213 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Aug 10 17:50:17.488213 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Aug 10 17:50:17.488213 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Aug 10 17:50:17.488213 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:17.488213 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:50:17.488213 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:17.488213 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:17.488213 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:50:17.488213 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:50:17.488213 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:50:17.488213 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:50:17.488213 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:50:17.488213 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:50:17.488213 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Aug 10 17:50:17.488213 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 10 17:50:17.488213 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 30325457 has no extra specs with key hw:cpu_thread_policy. Aug 10 17:50:17.488213 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:17.488213 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:50:17.488213 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:17.489463 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:17.489463 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:50:17.489463 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:50:17.489463 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:50:17.489463 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:50:17.489463 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 30325457 has no extra specs with key hw:cpu_thread_policy. Aug 10 17:50:17.489463 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:17.493308 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-b8ee08a2-2b0c-46f3-a4e4-72a83842dc97 tempest-FlavorsExtraSpecsNegativeTestJSON-73171872 tempest-FlavorsExtraSpecsNegativeTestJSON-73171872-project] Returning 404 to user: Flavor 30325457 has no extra specs with key hw:cpu_thread_policy. {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:50:17.494242 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-d9c7ed84-9bf7-4098-a217-4ebdd6a33eb7 tempest-HostsAdminTestJSON-8957156 tempest-HostsAdminTestJSON-8957156-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:17.494744 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-d9c7ed84-9bf7-4098-a217-4ebdd6a33eb7 tempest-HostsAdminTestJSON-8957156 tempest-HostsAdminTestJSON-8957156-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:17.495181 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-d9c7ed84-9bf7-4098-a217-4ebdd6a33eb7 tempest-HostsAdminTestJSON-8957156 tempest-HostsAdminTestJSON-8957156-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:17.495907 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-d9c7ed84-9bf7-4098-a217-4ebdd6a33eb7 tempest-HostsAdminTestJSON-8957156 tempest-HostsAdminTestJSON-8957156-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:17.498411 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-b8ee08a2-2b0c-46f3-a4e4-72a83842dc97 tempest-FlavorsExtraSpecsNegativeTestJSON-73171872 tempest-FlavorsExtraSpecsNegativeTestJSON-73171872-project] 10.222.0.50 "GET /compute/v2.1/flavors/30325457/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 111 microversion: 2.1 time: 0.338382 Aug 10 17:50:17.499476 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 173/345] 10.222.0.50 () {58 vars in 1260 bytes} [Wed Aug 10 17:50:17 2022] GET /compute/v2.1/flavors/30325457/os-extra_specs/hw:cpu_thread_policy => generated 111 bytes in 342 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:50:17.509245 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-d9c7ed84-9bf7-4098-a217-4ebdd6a33eb7 tempest-HostsAdminTestJSON-8957156 tempest-HostsAdminTestJSON-8957156-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:17.510658 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-d9c7ed84-9bf7-4098-a217-4ebdd6a33eb7 tempest-HostsAdminTestJSON-8957156 tempest-HostsAdminTestJSON-8957156-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:17.513211 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-72cad07b-8f2f-430e-9222-9fe8e08b31d8 tempest-FlavorsAccessNegativeTestJSON-243181220 tempest-FlavorsAccessNegativeTestJSON-243181220-project-admin] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:50:17.516695 n-d-852296-2 devstack@n-api.service[129410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:50:17.516695 n-d-852296-2 devstack@n-api.service[129410]: warnings.warn(msg) Aug 10 17:50:17.533440 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-72cad07b-8f2f-430e-9222-9fe8e08b31d8 tempest-FlavorsAccessNegativeTestJSON-243181220 tempest-FlavorsAccessNegativeTestJSON-243181220-project-admin] HTTP exception thrown: Access list not available for public flavors. Aug 10 17:50:17.536136 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-72cad07b-8f2f-430e-9222-9fe8e08b31d8 tempest-FlavorsAccessNegativeTestJSON-243181220 tempest-FlavorsAccessNegativeTestJSON-243181220-project-admin] Request method failure captured: Aug 10 17:50:17.536136 n-d-852296-2 devstack@n-api.service[129410]: request: GET /compute/v2.1/flavors/756689895/os-flavor-access HTTP/1.1 Aug 10 17:50:17.536136 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 17:50:17.536136 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 17:50:17.536136 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 17:50:17.536136 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 0 Aug 10 17:50:17.536136 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 17:50:17.536136 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 17:50:17.536136 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 17:50:17.536136 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 17:50:17.536136 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8-_RZgfZgmoo3sbghASsI3nAJ1ftELclq8Vad_k1tzwe9bS4WgQjdZZGN76a3ugIRo01o7Ezzt6gGQ3FtqcXAKy88Kv6ikqDoTkt35A3Xfb5zBnf3ZhNn1dllbSAGtWDsQ4wi8-mNIWHhBWlWfx1Onds37tiPsBAyljziBAdCQh9lXc Aug 10 17:50:17.536136 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 17:50:17.536136 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 17:50:17.536136 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 17:50:17.536136 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 17:50:17.536136 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 17:50:17.536136 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 17:50:17.536136 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: fc8082fa1dbf4f239422cf9a8f8c5b63 Aug 10 17:50:17.536136 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-243181220 Aug 10 17:50:17.536136 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member,admin Aug 10 17:50:17.536136 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member,admin Aug 10 17:50:17.537614 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/fc8082fa1dbf4f239422cf9a8f8c5b63"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/fc8082fa1dbf4f239422cf9a8f8c5b63"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/fc8082fa1dbf4f239422cf9a8f8c5b63"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_fc8082fa1dbf4f239422cf9a8f8c5b63", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:50:17.537614 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-243181220 Aug 10 17:50:17.537614 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: fc8082fa1dbf4f239422cf9a8f8c5b63 Aug 10 17:50:17.537614 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-243181220 Aug 10 17:50:17.537614 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-FlavorsAccessNegativeTestJSON-243181220-project-admin Aug 10 17:50:17.537614 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 17:50:17.537614 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 17:50:17.537614 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: 0d6a610c518641858f1ee3d1295b7af8 Aug 10 17:50:17.537614 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-243181220-project-admin Aug 10 17:50:17.537614 n-d-852296-2 devstack@n-api.service[129410]: method: > Aug 10 17:50:17.537614 n-d-852296-2 devstack@n-api.service[129410]: exception: Access list not available for public flavors. Aug 10 17:50:17.537614 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'flavor_id': '756689895'} Aug 10 17:50:17.538810 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:50:17.538810 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:17.538810 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:50:17.538810 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:50:17.538810 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:50:17.538810 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:50:17.538810 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:50:17.538810 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:50:17.538810 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Aug 10 17:50:17.538810 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 10 17:50:17.538810 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Aug 10 17:50:17.538810 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:17.538810 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:50:17.538810 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:17.538810 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:17.538810 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:50:17.538810 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:50:17.538810 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:50:17.538810 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:50:17.538810 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Aug 10 17:50:17.538810 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:17.542576 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-72cad07b-8f2f-430e-9222-9fe8e08b31d8 tempest-FlavorsAccessNegativeTestJSON-243181220 tempest-FlavorsAccessNegativeTestJSON-243181220-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:50:17.543521 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-72cad07b-8f2f-430e-9222-9fe8e08b31d8 tempest-FlavorsAccessNegativeTestJSON-243181220 tempest-FlavorsAccessNegativeTestJSON-243181220-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/756689895/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.042608 Aug 10 17:50:17.555811 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 174/346] 10.222.0.50 () {58 vars in 1206 bytes} [Wed Aug 10 17:50:17 2022] GET /compute/v2.1/flavors/756689895/os-flavor-access => generated 91 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 10 17:50:17.569900 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-aa66f73d-60c3-47aa-b110-add30ec5e093 tempest-FlavorsExtraSpecsNegativeTestJSON-73171872 tempest-FlavorsExtraSpecsNegativeTestJSON-73171872-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:50:17.593501 n-d-852296-2 devstack@n-api.service[129410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:50:17.593501 n-d-852296-2 devstack@n-api.service[129410]: warnings.warn(msg) Aug 10 17:50:17.593501 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-aa66f73d-60c3-47aa-b110-add30ec5e093 tempest-FlavorsExtraSpecsNegativeTestJSON-73171872 tempest-FlavorsExtraSpecsNegativeTestJSON-73171872-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': '5195b8fdb52547cfb58e8e3d1006cacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c42b80b1d744f29616214606185406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:50:17.594786 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-aa66f73d-60c3-47aa-b110-add30ec5e093 tempest-FlavorsExtraSpecsNegativeTestJSON-73171872 tempest-FlavorsExtraSpecsNegativeTestJSON-73171872-project] Request method failure captured: Aug 10 17:50:17.594786 n-d-852296-2 devstack@n-api.service[129410]: request: POST /compute/v2.1/flavors/30325457/os-extra_specs HTTP/1.1 Aug 10 17:50:17.594786 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 17:50:17.594786 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 17:50:17.594786 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 17:50:17.594786 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 66 Aug 10 17:50:17.594786 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 17:50:17.594786 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 17:50:17.594786 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 17:50:17.594786 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 17:50:17.594786 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8-_VTu4xaVzzCSusqX9f5hK8GSdA-yJKgSa8gSbDR5ANXsL_lvAcatVXRZnPyFvt0hIH4kaSI2vj7suypF6detQX64ldjEws1t7NXSuSQkZdGtNq9hmjixvjxcd-vEnSd5snXMoPDG3jqv2DrJHB1RAOgv59C1ruwvAAWSlO1tnjwUU Aug 10 17:50:17.594786 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 17:50:17.594786 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 17:50:17.594786 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 17:50:17.594786 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 17:50:17.594786 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 17:50:17.594786 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 17:50:17.594786 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: 48c42b80b1d744f29616214606185406 Aug 10 17:50:17.594786 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-73171872 Aug 10 17:50:17.594786 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 17:50:17.594786 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 17:50:17.596198 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/48c42b80b1d744f29616214606185406"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/48c42b80b1d744f29616214606185406"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/48c42b80b1d744f29616214606185406"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_48c42b80b1d744f29616214606185406", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:50:17.596198 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-73171872 Aug 10 17:50:17.596198 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: 48c42b80b1d744f29616214606185406 Aug 10 17:50:17.596198 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-73171872 Aug 10 17:50:17.596198 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-73171872-project Aug 10 17:50:17.596198 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 17:50:17.596198 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 17:50:17.596198 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: 5195b8fdb52547cfb58e8e3d1006cacf Aug 10 17:50:17.596198 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-73171872-project Aug 10 17:50:17.596198 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 17:50:17.596198 n-d-852296-2 devstack@n-api.service[129410]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Aug 10 17:50:17.596198 n-d-852296-2 devstack@n-api.service[129410]: method: > Aug 10 17:50:17.597062 n-d-852296-2 devstack@n-api.service[129410]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Aug 10 17:50:17.597062 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'flavor_id': '30325457', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Aug 10 17:50:17.597062 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:50:17.597062 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:17.597062 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:50:17.597062 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:50:17.597062 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:50:17.597062 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:50:17.597062 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:50:17.597062 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:50:17.597062 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:50:17.597062 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:50:17.597062 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Aug 10 17:50:17.597062 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Aug 10 17:50:17.597062 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 10 17:50:17.597062 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 10 17:50:17.597062 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 10 17:50:17.597062 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 10 17:50:17.597062 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 10 17:50:17.598395 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 10 17:50:17.598395 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 10 17:50:17.598395 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise self.value Aug 10 17:50:17.598395 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 10 17:50:17.598395 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 10 17:50:17.598395 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 10 17:50:17.598395 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 10 17:50:17.598395 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 10 17:50:17.598395 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 10 17:50:17.598395 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Aug 10 17:50:17.598395 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:17.598395 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:50:17.598395 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:17.598395 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:17.598395 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:50:17.598395 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:50:17.598395 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 10 17:50:17.598395 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 10 17:50:17.598395 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Aug 10 17:50:17.598395 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:17.604543 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-aa66f73d-60c3-47aa-b110-add30ec5e093 tempest-FlavorsExtraSpecsNegativeTestJSON-73171872 tempest-FlavorsExtraSpecsNegativeTestJSON-73171872-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:50:17.604543 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-aa66f73d-60c3-47aa-b110-add30ec5e093 tempest-FlavorsExtraSpecsNegativeTestJSON-73171872 tempest-FlavorsExtraSpecsNegativeTestJSON-73171872-project] 10.222.0.50 "POST /compute/v2.1/flavors/30325457/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.049738 Aug 10 17:50:17.606568 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 175/347] 10.222.0.50 () {60 vars in 1218 bytes} [Wed Aug 10 17:50:17 2022] POST /compute/v2.1/flavors/30325457/os-extra_specs => generated 124 bytes in 56 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:50:17.612328 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-d44e45d4-9d90-46bd-8c7a-98b3fa2fffad tempest-FlavorsAccessNegativeTestJSON-243181220 tempest-FlavorsAccessNegativeTestJSON-243181220-project-admin] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:50:17.613097 n-d-852296-2 devstack@n-api.service[129410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:50:17.613097 n-d-852296-2 devstack@n-api.service[129410]: warnings.warn(msg) Aug 10 17:50:17.620534 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-d9c7ed84-9bf7-4098-a217-4ebdd6a33eb7 tempest-HostsAdminTestJSON-8957156 tempest-HostsAdminTestJSON-8957156-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.155924 Aug 10 17:50:17.632776 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 173/348] 10.222.0.50 () {58 vars in 1128 bytes} [Wed Aug 10 17:50:17 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:50:17.648866 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-9fdb8d0b-626f-4fea-b87e-c2c01f8813e5 tempest-FlavorsExtraSpecsNegativeTestJSON-1685476613 tempest-FlavorsExtraSpecsNegativeTestJSON-1685476613-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:50:17.666678 n-d-852296-2 devstack@n-api.service[129409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:50:17.666678 n-d-852296-2 devstack@n-api.service[129409]: warnings.warn(msg) Aug 10 17:50:17.776418 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-d44e45d4-9d90-46bd-8c7a-98b3fa2fffad tempest-FlavorsAccessNegativeTestJSON-243181220 tempest-FlavorsAccessNegativeTestJSON-243181220-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/756689895" status: 202 len: 0 microversion: 2.1 time: 0.168361 Aug 10 17:50:17.777218 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 176/349] 10.222.0.50 () {58 vars in 1158 bytes} [Wed Aug 10 17:50:17 2022] DELETE /compute/v2.1/flavors/756689895 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 17:50:17.789740 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-2b628118-4405-4b26-9492-8856264e56cd tempest-HostsAdminTestJSON-8957156 tempest-HostsAdminTestJSON-8957156-project-admin] Calling method '.version_select at 0x7fb346a2e9d0>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:50:17.800025 n-d-852296-2 devstack@n-api.service[129410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:50:17.800025 n-d-852296-2 devstack@n-api.service[129410]: warnings.warn(msg) Aug 10 17:50:17.801313 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2b628118-4405-4b26-9492-8856264e56cd tempest-HostsAdminTestJSON-8957156 tempest-HostsAdminTestJSON-8957156-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:17.801807 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2b628118-4405-4b26-9492-8856264e56cd tempest-HostsAdminTestJSON-8957156 tempest-HostsAdminTestJSON-8957156-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:17.802251 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2b628118-4405-4b26-9492-8856264e56cd tempest-HostsAdminTestJSON-8957156 tempest-HostsAdminTestJSON-8957156-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:17.808566 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2b628118-4405-4b26-9492-8856264e56cd tempest-HostsAdminTestJSON-8957156 tempest-HostsAdminTestJSON-8957156-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:17.809532 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2b628118-4405-4b26-9492-8856264e56cd tempest-HostsAdminTestJSON-8957156 tempest-HostsAdminTestJSON-8957156-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:17.810180 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2b628118-4405-4b26-9492-8856264e56cd tempest-HostsAdminTestJSON-8957156 tempest-HostsAdminTestJSON-8957156-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:17.921781 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-2b628118-4405-4b26-9492-8856264e56cd tempest-HostsAdminTestJSON-8957156 tempest-HostsAdminTestJSON-8957156-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 236 microversion: 2.1 time: 0.139680 Aug 10 17:50:17.922722 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 177/350] 10.222.0.50 () {58 vars in 1155 bytes} [Wed Aug 10 17:50:17 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 236 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:50:17.932816 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-c5dcbf54-ee2c-4a01-b184-3f16658e717d tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:50:17.933676 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-c5dcbf54-ee2c-4a01-b184-3f16658e717d tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] [instance: 7e9ff909-ff6f-4d8d-8d84-97af957c6506] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:50:17.943138 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-c5dcbf54-ee2c-4a01-b184-3f16658e717d tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:17.943631 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-c5dcbf54-ee2c-4a01-b184-3f16658e717d tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:17.965618 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-c5dcbf54-ee2c-4a01-b184-3f16658e717d tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:17.965618 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-c5dcbf54-ee2c-4a01-b184-3f16658e717d tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:17.965618 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-c5dcbf54-ee2c-4a01-b184-3f16658e717d tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:17.965618 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-c5dcbf54-ee2c-4a01-b184-3f16658e717d tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:18.097379 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-9fdb8d0b-626f-4fea-b87e-c2c01f8813e5 tempest-FlavorsExtraSpecsNegativeTestJSON-1685476613 tempest-FlavorsExtraSpecsNegativeTestJSON-1685476613-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors/30325457/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.460613 Aug 10 17:50:18.103653 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 174/351] 10.222.0.50 () {60 vars in 1218 bytes} [Wed Aug 10 17:50:17 2022] POST /compute/v2.1/flavors/30325457/os-extra_specs => generated 66 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 17:50:18.122622 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-23e09a62-3750-4db9-a01b-4c3bf5e09ed3 tempest-FlavorsAccessNegativeTestJSON-243181220 tempest-FlavorsAccessNegativeTestJSON-243181220-project-admin] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:50:18.174444 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-23e09a62-3750-4db9-a01b-4c3bf5e09ed3 tempest-FlavorsAccessNegativeTestJSON-243181220 tempest-FlavorsAccessNegativeTestJSON-243181220-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 5391 microversion: 2.1 time: 0.068666 Aug 10 17:50:18.184619 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 175/352] 10.222.0.50 () {58 vars in 1146 bytes} [Wed Aug 10 17:50:18 2022] GET /compute/v2.1/flavors/detail => generated 5391 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:50:18.189777 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-875b071b-de1e-47be-8d59-0baf27df54c6 tempest-HostsAdminTestJSON-8957156 tempest-HostsAdminTestJSON-8957156-project-admin] Calling method '.version_select at 0x7fb346839c10>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:50:18.209556 n-d-852296-2 devstack@n-api.service[129409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:50:18.209556 n-d-852296-2 devstack@n-api.service[129409]: warnings.warn(msg) Aug 10 17:50:18.211766 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-875b071b-de1e-47be-8d59-0baf27df54c6 tempest-HostsAdminTestJSON-8957156 tempest-HostsAdminTestJSON-8957156-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:18.212725 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-875b071b-de1e-47be-8d59-0baf27df54c6 tempest-HostsAdminTestJSON-8957156 tempest-HostsAdminTestJSON-8957156-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:18.213540 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-875b071b-de1e-47be-8d59-0baf27df54c6 tempest-HostsAdminTestJSON-8957156 tempest-HostsAdminTestJSON-8957156-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:18.216314 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-875b071b-de1e-47be-8d59-0baf27df54c6 tempest-HostsAdminTestJSON-8957156 tempest-HostsAdminTestJSON-8957156-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:18.216314 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-875b071b-de1e-47be-8d59-0baf27df54c6 tempest-HostsAdminTestJSON-8957156 tempest-HostsAdminTestJSON-8957156-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:18.216314 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-875b071b-de1e-47be-8d59-0baf27df54c6 tempest-HostsAdminTestJSON-8957156 tempest-HostsAdminTestJSON-8957156-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:18.270748 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-875b071b-de1e-47be-8d59-0baf27df54c6 tempest-HostsAdminTestJSON-8957156 tempest-HostsAdminTestJSON-8957156-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.084449 Aug 10 17:50:18.271360 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 176/353] 10.222.0.50 () {58 vars in 1128 bytes} [Wed Aug 10 17:50:18 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:50:18.284023 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-21fed001-7f39-42e7-8603-8cf4538d81d2 tempest-FlavorsExtraSpecsNegativeTestJSON-73171872 tempest-FlavorsExtraSpecsNegativeTestJSON-73171872-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:50:18.300884 n-d-852296-2 devstack@n-api.service[129409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:50:18.300884 n-d-852296-2 devstack@n-api.service[129409]: warnings.warn(msg) Aug 10 17:50:18.300884 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-21fed001-7f39-42e7-8603-8cf4538d81d2 tempest-FlavorsExtraSpecsNegativeTestJSON-73171872 tempest-FlavorsExtraSpecsNegativeTestJSON-73171872-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': '5195b8fdb52547cfb58e8e3d1006cacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c42b80b1d744f29616214606185406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:50:18.300884 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-21fed001-7f39-42e7-8603-8cf4538d81d2 tempest-FlavorsExtraSpecsNegativeTestJSON-73171872 tempest-FlavorsExtraSpecsNegativeTestJSON-73171872-project] Request method failure captured: Aug 10 17:50:18.300884 n-d-852296-2 devstack@n-api.service[129409]: request: DELETE /compute/v2.1/flavors/30325457/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 10 17:50:18.300884 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 17:50:18.300884 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 17:50:18.300884 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 17:50:18.300884 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 0 Aug 10 17:50:18.300884 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 17:50:18.300884 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 17:50:18.300884 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 17:50:18.300884 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 17:50:18.300884 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8-_VTu4xaVzzCSusqX9f5hK8GSdA-yJKgSa8gSbDR5ANXsL_lvAcatVXRZnPyFvt0hIH4kaSI2vj7suypF6detQX64ldjEws1t7NXSuSQkZdGtNq9hmjixvjxcd-vEnSd5snXMoPDG3jqv2DrJHB1RAOgv59C1ruwvAAWSlO1tnjwUU Aug 10 17:50:18.300884 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 17:50:18.300884 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 17:50:18.300884 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 17:50:18.300884 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 17:50:18.302116 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 17:50:18.302116 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 17:50:18.302116 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: 48c42b80b1d744f29616214606185406 Aug 10 17:50:18.302116 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-73171872 Aug 10 17:50:18.302116 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 17:50:18.302116 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 17:50:18.302116 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/48c42b80b1d744f29616214606185406"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/48c42b80b1d744f29616214606185406"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/48c42b80b1d744f29616214606185406"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_48c42b80b1d744f29616214606185406", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:50:18.302116 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-73171872 Aug 10 17:50:18.302116 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: 48c42b80b1d744f29616214606185406 Aug 10 17:50:18.302116 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-73171872 Aug 10 17:50:18.302116 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-73171872-project Aug 10 17:50:18.302116 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 17:50:18.302116 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 17:50:18.302116 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: 5195b8fdb52547cfb58e8e3d1006cacf Aug 10 17:50:18.302116 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-73171872-project Aug 10 17:50:18.302975 n-d-852296-2 devstack@n-api.service[129409]: method: > Aug 10 17:50:18.302975 n-d-852296-2 devstack@n-api.service[129409]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Aug 10 17:50:18.302975 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'flavor_id': '30325457', 'id': 'hw:numa_nodes'} Aug 10 17:50:18.302975 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:50:18.302975 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:18.302975 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:50:18.302975 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:50:18.302975 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:50:18.302975 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:50:18.302975 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:50:18.302975 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:50:18.302975 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Aug 10 17:50:18.302975 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Aug 10 17:50:18.302975 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 10 17:50:18.302975 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 10 17:50:18.302975 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 10 17:50:18.302975 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 10 17:50:18.302975 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 10 17:50:18.302975 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 10 17:50:18.304671 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 10 17:50:18.304671 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise self.value Aug 10 17:50:18.304671 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 10 17:50:18.304671 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 10 17:50:18.304671 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 10 17:50:18.304671 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 10 17:50:18.304671 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 10 17:50:18.304671 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 10 17:50:18.304671 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Aug 10 17:50:18.304671 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:50:18.304671 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:50:18.304671 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:50:18.304671 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:18.304671 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:50:18.304671 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:50:18.304671 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 10 17:50:18.304671 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 10 17:50:18.304671 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Aug 10 17:50:18.304671 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:50:18.305845 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-21fed001-7f39-42e7-8603-8cf4538d81d2 tempest-FlavorsExtraSpecsNegativeTestJSON-73171872 tempest-FlavorsExtraSpecsNegativeTestJSON-73171872-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:50:18.305845 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-21fed001-7f39-42e7-8603-8cf4538d81d2 tempest-FlavorsExtraSpecsNegativeTestJSON-73171872 tempest-FlavorsExtraSpecsNegativeTestJSON-73171872-project] 10.222.0.50 "DELETE /compute/v2.1/flavors/30325457/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.015609 Aug 10 17:50:18.305845 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 177/354] 10.222.0.50 () {58 vars in 1242 bytes} [Wed Aug 10 17:50:18 2022] DELETE /compute/v2.1/flavors/30325457/os-extra_specs/hw:numa_nodes => generated 124 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:50:18.305845 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-b2293b55-cafe-4a19-9dc5-f1462588b1bb tempest-FlavorsAccessNegativeTestJSON-243181220 tempest-FlavorsAccessNegativeTestJSON-243181220-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-221725164", "id": 1619575899, "os-flavor-access:is_public": "False"}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:50:18.306163 n-d-852296-2 devstack@n-api.service[129409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:50:18.306163 n-d-852296-2 devstack@n-api.service[129409]: warnings.warn(msg) Aug 10 17:50:18.461124 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-c5dcbf54-ee2c-4a01-b184-3f16658e717d tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f242fdc47104b98882cb29c8ca5caae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b721d6dfb14d3d8780094fc4e72890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:50:18.470360 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-c5dcbf54-ee2c-4a01-b184-3f16658e717d tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] 10.222.0.50 "GET /compute/v2.1/servers/7e9ff909-ff6f-4d8d-8d84-97af957c6506" status: 200 len: 1469 microversion: 2.1 time: 0.546493 Aug 10 17:50:18.471880 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-b2293b55-cafe-4a19-9dc5-f1462588b1bb tempest-FlavorsAccessNegativeTestJSON-243181220 tempest-FlavorsAccessNegativeTestJSON-243181220-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.178754 Aug 10 17:50:18.475688 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 178/355] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:50:17 2022] GET /compute/v2.1/servers/7e9ff909-ff6f-4d8d-8d84-97af957c6506 => generated 1469 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:50:18.478153 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 178/356] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 17:50:18 2022] POST /compute/v2.1/flavors => generated 438 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:50:18.504992 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-f28c5ee0-de10-47c6-b103-3b5d6583dd27 tempest-HostsAdminTestJSON-8957156 tempest-HostsAdminTestJSON-8957156-project-admin] Calling method '.version_select at 0x7fb34669fb80>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:50:18.504992 n-d-852296-2 devstack@n-api.service[129410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:50:18.504992 n-d-852296-2 devstack@n-api.service[129410]: warnings.warn(msg) Aug 10 17:50:18.520038 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-f28c5ee0-de10-47c6-b103-3b5d6583dd27 tempest-HostsAdminTestJSON-8957156 tempest-HostsAdminTestJSON-8957156-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:18.521899 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-22179a92-377b-41f5-a454-ce70895a5392 tempest-FlavorsExtraSpecsNegativeTestJSON-1685476613 tempest-FlavorsExtraSpecsNegativeTestJSON-1685476613-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:50:18.522445 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-f28c5ee0-de10-47c6-b103-3b5d6583dd27 tempest-HostsAdminTestJSON-8957156 tempest-HostsAdminTestJSON-8957156-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:18.526253 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-f28c5ee0-de10-47c6-b103-3b5d6583dd27 tempest-HostsAdminTestJSON-8957156 tempest-HostsAdminTestJSON-8957156-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:18.545778 n-d-852296-2 devstack@n-api.service[129409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:50:18.545778 n-d-852296-2 devstack@n-api.service[129409]: warnings.warn(msg) Aug 10 17:50:18.546566 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-f28c5ee0-de10-47c6-b103-3b5d6583dd27 tempest-HostsAdminTestJSON-8957156 tempest-HostsAdminTestJSON-8957156-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:18.547123 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-f28c5ee0-de10-47c6-b103-3b5d6583dd27 tempest-HostsAdminTestJSON-8957156 tempest-HostsAdminTestJSON-8957156-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:18.547635 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-f28c5ee0-de10-47c6-b103-3b5d6583dd27 tempest-HostsAdminTestJSON-8957156 tempest-HostsAdminTestJSON-8957156-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:18.577386 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-f28c5ee0-de10-47c6-b103-3b5d6583dd27 tempest-HostsAdminTestJSON-8957156 tempest-HostsAdminTestJSON-8957156-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hosts/n-h2-852296-2" status: 200 len: 332 microversion: 2.1 time: 0.100030 Aug 10 17:50:18.582452 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 179/357] 10.222.0.50 () {58 vars in 1170 bytes} [Wed Aug 10 17:50:18 2022] GET /compute/v2.1/os-hosts/n-h2-852296-2 => generated 332 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:50:18.629753 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-22179a92-377b-41f5-a454-ce70895a5392 tempest-FlavorsExtraSpecsNegativeTestJSON-1685476613 tempest-FlavorsExtraSpecsNegativeTestJSON-1685476613-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors/30325457/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.148436 Aug 10 17:50:18.642677 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 179/358] 10.222.0.50 () {60 vars in 1218 bytes} [Wed Aug 10 17:50:18 2022] POST /compute/v2.1/flavors/30325457/os-extra_specs => generated 66 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 17:50:18.652298 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-7f7517d4-c813-4071-9308-685fd6a1a99e tempest-DeleteServersAdminTestJSON-841828601 tempest-DeleteServersAdminTestJSON-841828601-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:50:18.659774 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-7f7517d4-c813-4071-9308-685fd6a1a99e tempest-DeleteServersAdminTestJSON-841828601 tempest-DeleteServersAdminTestJSON-841828601-project-admin] [instance: 7e9ff909-ff6f-4d8d-8d84-97af957c6506] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:50:18.675123 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7f7517d4-c813-4071-9308-685fd6a1a99e tempest-DeleteServersAdminTestJSON-841828601 tempest-DeleteServersAdminTestJSON-841828601-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:18.678126 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7f7517d4-c813-4071-9308-685fd6a1a99e tempest-DeleteServersAdminTestJSON-841828601 tempest-DeleteServersAdminTestJSON-841828601-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:18.685745 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7f7517d4-c813-4071-9308-685fd6a1a99e tempest-DeleteServersAdminTestJSON-841828601 tempest-DeleteServersAdminTestJSON-841828601-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:18.686589 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7f7517d4-c813-4071-9308-685fd6a1a99e tempest-DeleteServersAdminTestJSON-841828601 tempest-DeleteServersAdminTestJSON-841828601-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:18.687177 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7f7517d4-c813-4071-9308-685fd6a1a99e tempest-DeleteServersAdminTestJSON-841828601 tempest-DeleteServersAdminTestJSON-841828601-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:18.687663 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7f7517d4-c813-4071-9308-685fd6a1a99e tempest-DeleteServersAdminTestJSON-841828601 tempest-DeleteServersAdminTestJSON-841828601-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:18.859237 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-6af988dd-816a-496d-8c50-3bb6adb11c55 tempest-FlavorsAccessNegativeTestJSON-2119990731 tempest-FlavorsAccessNegativeTestJSON-2119990731-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "d820d1df32e94bc69d9f3695d10e8789"}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:50:18.863917 n-d-852296-2 devstack@n-api.service[129410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:50:18.863917 n-d-852296-2 devstack@n-api.service[129410]: warnings.warn(msg) Aug 10 17:50:18.869900 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-6af988dd-816a-496d-8c50-3bb6adb11c55 tempest-FlavorsAccessNegativeTestJSON-2119990731 tempest-FlavorsAccessNegativeTestJSON-2119990731-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': 'd323ba73a4c04f109d0ca177d9b9eaa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820d1df32e94bc69d9f3695d10e8789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:50:18.874009 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-6af988dd-816a-496d-8c50-3bb6adb11c55 tempest-FlavorsAccessNegativeTestJSON-2119990731 tempest-FlavorsAccessNegativeTestJSON-2119990731-project] Request method failure captured: Aug 10 17:50:18.874009 n-d-852296-2 devstack@n-api.service[129410]: request: POST /compute/v2.1/flavors/1619575899/action HTTP/1.1 Aug 10 17:50:18.874009 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 17:50:18.874009 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 17:50:18.874009 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 17:50:18.874009 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 67 Aug 10 17:50:18.874009 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 17:50:18.874009 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 17:50:18.874009 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 17:50:18.874009 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 17:50:18.874009 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8-_QZCASXzYp5rb9xCP9CB4UujryVoO-bFWVNMOCYoM-PJpaP4mpG2zTd5j2EwLw2-ed1TG4cCzavPahOYGHrbDo7tbAcEIS7AqaNIc84hwwUK1szuV0x5kfbgTYCqXOjEkCyGJVIBrULpicatIAAUlIN25l31okxvB_yYdVPCC-nak Aug 10 17:50:18.874009 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 17:50:18.874009 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 17:50:18.874009 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 17:50:18.874009 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 17:50:18.874009 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 17:50:18.874009 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 17:50:18.874009 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: d820d1df32e94bc69d9f3695d10e8789 Aug 10 17:50:18.874009 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-2119990731 Aug 10 17:50:18.874009 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 17:50:18.874009 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 17:50:18.875569 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d820d1df32e94bc69d9f3695d10e8789"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d820d1df32e94bc69d9f3695d10e8789"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d820d1df32e94bc69d9f3695d10e8789"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d820d1df32e94bc69d9f3695d10e8789", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:50:18.875569 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-2119990731 Aug 10 17:50:18.875569 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: d820d1df32e94bc69d9f3695d10e8789 Aug 10 17:50:18.875569 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-2119990731 Aug 10 17:50:18.875569 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-FlavorsAccessNegativeTestJSON-2119990731-project Aug 10 17:50:18.875569 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 17:50:18.875569 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 17:50:18.875569 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: d323ba73a4c04f109d0ca177d9b9eaa2 Aug 10 17:50:18.875569 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-2119990731-project Aug 10 17:50:18.875569 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 17:50:18.875569 n-d-852296-2 devstack@n-api.service[129410]: {"addTenantAccess": {"tenant": "d820d1df32e94bc69d9f3695d10e8789"}} Aug 10 17:50:18.875569 n-d-852296-2 devstack@n-api.service[129410]: method: > Aug 10 17:50:18.876451 n-d-852296-2 devstack@n-api.service[129410]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Aug 10 17:50:18.876451 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'id': '1619575899', 'body': {'addTenantAccess': {'tenant': 'd820d1df32e94bc69d9f3695d10e8789'}}} Aug 10 17:50:18.876451 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:50:18.876451 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:18.876451 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:50:18.876451 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:50:18.876451 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:50:18.876451 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:50:18.876451 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:50:18.876451 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:50:18.876451 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:50:18.876451 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:50:18.876451 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Aug 10 17:50:18.876451 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Aug 10 17:50:18.876451 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 10 17:50:18.876451 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 10 17:50:18.876451 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 10 17:50:18.876451 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 10 17:50:18.876451 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 10 17:50:18.877718 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 10 17:50:18.877718 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 10 17:50:18.877718 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise self.value Aug 10 17:50:18.877718 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 10 17:50:18.877718 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 10 17:50:18.877718 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 10 17:50:18.877718 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 10 17:50:18.877718 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 10 17:50:18.877718 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 10 17:50:18.877718 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Aug 10 17:50:18.877718 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:18.877718 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:50:18.877718 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:18.877718 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:18.877718 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:50:18.877718 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:50:18.877718 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 10 17:50:18.877718 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 10 17:50:18.877718 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Aug 10 17:50:18.877718 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:18.882505 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-6af988dd-816a-496d-8c50-3bb6adb11c55 tempest-FlavorsAccessNegativeTestJSON-2119990731 tempest-FlavorsAccessNegativeTestJSON-2119990731-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:50:18.886169 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-6af988dd-816a-496d-8c50-3bb6adb11c55 tempest-FlavorsAccessNegativeTestJSON-2119990731 tempest-FlavorsAccessNegativeTestJSON-2119990731-project] 10.222.0.50 "POST /compute/v2.1/flavors/1619575899/action" status: 403 len: 130 microversion: 2.1 time: 0.304926 Aug 10 17:50:18.887671 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 180/359] 10.222.0.50 () {60 vars in 1200 bytes} [Wed Aug 10 17:50:18 2022] POST /compute/v2.1/flavors/1619575899/action => generated 130 bytes in 309 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:50:18.895042 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-7b3ce9e6-0871-406b-873b-b514a55e4643 tempest-HostsAdminTestJSON-8957156 tempest-HostsAdminTestJSON-8957156-project-admin] Calling method '.version_select at 0x7fb346632040>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:50:18.896543 n-d-852296-2 devstack@n-api.service[129410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:50:18.896543 n-d-852296-2 devstack@n-api.service[129410]: warnings.warn(msg) Aug 10 17:50:18.906020 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-7b3ce9e6-0871-406b-873b-b514a55e4643 tempest-HostsAdminTestJSON-8957156 tempest-HostsAdminTestJSON-8957156-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:18.924773 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-7b3ce9e6-0871-406b-873b-b514a55e4643 tempest-HostsAdminTestJSON-8957156 tempest-HostsAdminTestJSON-8957156-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:18.924773 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-7b3ce9e6-0871-406b-873b-b514a55e4643 tempest-HostsAdminTestJSON-8957156 tempest-HostsAdminTestJSON-8957156-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:18.959162 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-7b3ce9e6-0871-406b-873b-b514a55e4643 tempest-HostsAdminTestJSON-8957156 tempest-HostsAdminTestJSON-8957156-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:18.961294 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-7b3ce9e6-0871-406b-873b-b514a55e4643 tempest-HostsAdminTestJSON-8957156 tempest-HostsAdminTestJSON-8957156-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:18.961901 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-7b3ce9e6-0871-406b-873b-b514a55e4643 tempest-HostsAdminTestJSON-8957156 tempest-HostsAdminTestJSON-8957156-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:19.001588 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-7b3ce9e6-0871-406b-873b-b514a55e4643 tempest-HostsAdminTestJSON-8957156 tempest-HostsAdminTestJSON-8957156-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hosts/n-h1-852296-2" status: 200 len: 467 microversion: 2.1 time: 0.112593 Aug 10 17:50:19.002509 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 181/360] 10.222.0.50 () {58 vars in 1170 bytes} [Wed Aug 10 17:50:18 2022] GET /compute/v2.1/os-hosts/n-h1-852296-2 => generated 467 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:50:19.030597 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-a20eccb3-560f-4462-a9d7-418d3e493360 tempest-FlavorsExtraSpecsNegativeTestJSON-73171872 tempest-FlavorsExtraSpecsNegativeTestJSON-73171872-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:50:19.043161 n-d-852296-2 devstack@n-api.service[129410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:50:19.043161 n-d-852296-2 devstack@n-api.service[129410]: warnings.warn(msg) Aug 10 17:50:19.047071 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-a20eccb3-560f-4462-a9d7-418d3e493360 tempest-FlavorsExtraSpecsNegativeTestJSON-73171872 tempest-FlavorsExtraSpecsNegativeTestJSON-73171872-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': '5195b8fdb52547cfb58e8e3d1006cacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c42b80b1d744f29616214606185406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:50:19.057218 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-a20eccb3-560f-4462-a9d7-418d3e493360 tempest-FlavorsExtraSpecsNegativeTestJSON-73171872 tempest-FlavorsExtraSpecsNegativeTestJSON-73171872-project] Request method failure captured: Aug 10 17:50:19.057218 n-d-852296-2 devstack@n-api.service[129410]: request: PUT /compute/v2.1/flavors/30325457/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 10 17:50:19.057218 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 17:50:19.057218 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 17:50:19.057218 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 17:50:19.057218 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 22 Aug 10 17:50:19.057218 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 17:50:19.057218 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 17:50:19.057218 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 17:50:19.057218 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 17:50:19.057218 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8-_VTu4xaVzzCSusqX9f5hK8GSdA-yJKgSa8gSbDR5ANXsL_lvAcatVXRZnPyFvt0hIH4kaSI2vj7suypF6detQX64ldjEws1t7NXSuSQkZdGtNq9hmjixvjxcd-vEnSd5snXMoPDG3jqv2DrJHB1RAOgv59C1ruwvAAWSlO1tnjwUU Aug 10 17:50:19.057218 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 17:50:19.057218 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 17:50:19.057218 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 17:50:19.057218 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 17:50:19.057218 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 17:50:19.057218 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 17:50:19.057218 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: 48c42b80b1d744f29616214606185406 Aug 10 17:50:19.057218 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-73171872 Aug 10 17:50:19.057218 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 17:50:19.057218 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 17:50:19.058709 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/48c42b80b1d744f29616214606185406"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/48c42b80b1d744f29616214606185406"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/48c42b80b1d744f29616214606185406"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_48c42b80b1d744f29616214606185406", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:50:19.058709 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-73171872 Aug 10 17:50:19.058709 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: 48c42b80b1d744f29616214606185406 Aug 10 17:50:19.058709 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-73171872 Aug 10 17:50:19.058709 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-73171872-project Aug 10 17:50:19.058709 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 17:50:19.058709 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 17:50:19.058709 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: 5195b8fdb52547cfb58e8e3d1006cacf Aug 10 17:50:19.058709 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-73171872-project Aug 10 17:50:19.058709 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 17:50:19.058709 n-d-852296-2 devstack@n-api.service[129410]: {"hw:numa_nodes": "1"} Aug 10 17:50:19.058709 n-d-852296-2 devstack@n-api.service[129410]: method: > Aug 10 17:50:19.058709 n-d-852296-2 devstack@n-api.service[129410]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Aug 10 17:50:19.059491 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'flavor_id': '30325457', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Aug 10 17:50:19.059491 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:50:19.059491 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:19.059491 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:50:19.059491 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:50:19.059491 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:50:19.059491 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:50:19.059491 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:50:19.059491 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:50:19.059491 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:50:19.059491 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:50:19.059491 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Aug 10 17:50:19.059491 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Aug 10 17:50:19.059491 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 10 17:50:19.059491 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 10 17:50:19.059491 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 10 17:50:19.059491 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 10 17:50:19.059491 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 10 17:50:19.059491 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 10 17:50:19.060798 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 10 17:50:19.060798 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise self.value Aug 10 17:50:19.060798 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 10 17:50:19.060798 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 10 17:50:19.060798 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 10 17:50:19.060798 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 10 17:50:19.060798 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 10 17:50:19.060798 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 10 17:50:19.060798 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Aug 10 17:50:19.060798 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:19.060798 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:50:19.060798 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:19.060798 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:19.060798 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:50:19.060798 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:50:19.060798 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 10 17:50:19.060798 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 10 17:50:19.060798 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Aug 10 17:50:19.060798 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:19.063500 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-a20eccb3-560f-4462-a9d7-418d3e493360 tempest-FlavorsExtraSpecsNegativeTestJSON-73171872 tempest-FlavorsExtraSpecsNegativeTestJSON-73171872-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:50:19.063500 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-a20eccb3-560f-4462-a9d7-418d3e493360 tempest-FlavorsExtraSpecsNegativeTestJSON-73171872 tempest-FlavorsExtraSpecsNegativeTestJSON-73171872-project] 10.222.0.50 "PUT /compute/v2.1/flavors/30325457/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.055133 Aug 10 17:50:19.067888 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 182/361] 10.222.0.50 () {60 vars in 1259 bytes} [Wed Aug 10 17:50:19 2022] PUT /compute/v2.1/flavors/30325457/os-extra_specs/hw:numa_nodes => generated 124 bytes in 62 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:50:19.075506 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-63944f53-b2c3-43fc-9bf5-b1222d29f514 tempest-FlavorsAccessNegativeTestJSON-243181220 tempest-FlavorsAccessNegativeTestJSON-243181220-project-admin] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:50:19.076296 n-d-852296-2 devstack@n-api.service[129410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:50:19.076296 n-d-852296-2 devstack@n-api.service[129410]: warnings.warn(msg) Aug 10 17:50:19.231040 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-63944f53-b2c3-43fc-9bf5-b1222d29f514 tempest-FlavorsAccessNegativeTestJSON-243181220 tempest-FlavorsAccessNegativeTestJSON-243181220-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/1619575899" status: 202 len: 0 microversion: 2.1 time: 0.161897 Aug 10 17:50:19.233003 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 183/362] 10.222.0.50 () {58 vars in 1161 bytes} [Wed Aug 10 17:50:19 2022] DELETE /compute/v2.1/flavors/1619575899 => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 17:50:19.245730 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-b230a187-d877-4d44-93a2-f1e5848480cd tempest-FlavorsExtraSpecsNegativeTestJSON-1685476613 tempest-FlavorsExtraSpecsNegativeTestJSON-1685476613-project-admin] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:50:19.245730 n-d-852296-2 devstack@n-api.service[129410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:50:19.245730 n-d-852296-2 devstack@n-api.service[129410]: warnings.warn(msg) Aug 10 17:50:19.255579 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-b230a187-d877-4d44-93a2-f1e5848480cd tempest-FlavorsExtraSpecsNegativeTestJSON-1685476613 tempest-FlavorsExtraSpecsNegativeTestJSON-1685476613-project-admin] HTTP exception thrown: Flavor 30325457 has no extra specs with key hw:cpu_thread_policy. Aug 10 17:50:19.262019 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-b230a187-d877-4d44-93a2-f1e5848480cd tempest-FlavorsExtraSpecsNegativeTestJSON-1685476613 tempest-FlavorsExtraSpecsNegativeTestJSON-1685476613-project-admin] Request method failure captured: Aug 10 17:50:19.262019 n-d-852296-2 devstack@n-api.service[129410]: request: DELETE /compute/v2.1/flavors/30325457/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Aug 10 17:50:19.262019 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 17:50:19.262019 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 17:50:19.262019 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 17:50:19.262019 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 0 Aug 10 17:50:19.262019 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 17:50:19.262019 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 17:50:19.262019 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 17:50:19.262019 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 17:50:19.262019 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8-_Y6fe3rdFu8S8kE0VtpqXOjTnExFGJJmI-lGFU7ab4V4ECckHX4oH6yF3dZnWlV9QoIZrhApudYALKvpi-HRgvemyk4-Z8_y6QWy4nxBkP5RpWw1CEQVYUcIVo4IRhoZ0EItcq9TmPtdegSdg2-q1W7lyeL2VGyYDbmGuTHbKn0Uo Aug 10 17:50:19.262019 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 17:50:19.262019 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 17:50:19.262019 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 17:50:19.262019 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 17:50:19.262019 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 17:50:19.262019 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 17:50:19.262019 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: 77506d2b89914ae79fe3d7bc55cba0de Aug 10 17:50:19.262019 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1685476613 Aug 10 17:50:19.262019 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member,admin Aug 10 17:50:19.262019 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member,admin Aug 10 17:50:19.263448 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/77506d2b89914ae79fe3d7bc55cba0de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/77506d2b89914ae79fe3d7bc55cba0de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/77506d2b89914ae79fe3d7bc55cba0de"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_77506d2b89914ae79fe3d7bc55cba0de", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:50:19.263448 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1685476613 Aug 10 17:50:19.263448 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: 77506d2b89914ae79fe3d7bc55cba0de Aug 10 17:50:19.263448 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1685476613 Aug 10 17:50:19.263448 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1685476613-project-admin Aug 10 17:50:19.263448 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 17:50:19.263448 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 17:50:19.263448 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: 9b691f6d50b1440688678a667d84c472 Aug 10 17:50:19.263448 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1685476613-project-admin Aug 10 17:50:19.263448 n-d-852296-2 devstack@n-api.service[129410]: method: > Aug 10 17:50:19.263448 n-d-852296-2 devstack@n-api.service[129410]: exception: Flavor 30325457 has no extra specs with key hw:cpu_thread_policy. Aug 10 17:50:19.264134 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'flavor_id': '30325457', 'id': 'hw:cpu_thread_policy'} Aug 10 17:50:19.264134 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:50:19.264134 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:19.264134 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Aug 10 17:50:19.264134 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Aug 10 17:50:19.264134 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Aug 10 17:50:19.264134 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:19.264134 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:50:19.264134 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:19.264134 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:19.264134 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:50:19.264134 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:50:19.264134 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:50:19.264134 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:50:19.264134 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:50:19.264134 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:50:19.264134 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Aug 10 17:50:19.264134 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 10 17:50:19.264134 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 30325457 has no extra specs with key hw:cpu_thread_policy. Aug 10 17:50:19.264134 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:19.264134 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:50:19.264134 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:19.265452 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:19.265452 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:50:19.265452 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:50:19.265452 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:50:19.265452 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:50:19.265452 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 30325457 has no extra specs with key hw:cpu_thread_policy. Aug 10 17:50:19.265452 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:19.273741 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-b230a187-d877-4d44-93a2-f1e5848480cd tempest-FlavorsExtraSpecsNegativeTestJSON-1685476613 tempest-FlavorsExtraSpecsNegativeTestJSON-1685476613-project-admin] Returning 404 to user: Flavor 30325457 has no extra specs with key hw:cpu_thread_policy. {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:50:19.274612 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-b230a187-d877-4d44-93a2-f1e5848480cd tempest-FlavorsExtraSpecsNegativeTestJSON-1685476613 tempest-FlavorsExtraSpecsNegativeTestJSON-1685476613-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/30325457/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 111 microversion: 2.1 time: 0.040378 Aug 10 17:50:19.287904 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 184/363] 10.222.0.50 () {58 vars in 1263 bytes} [Wed Aug 10 17:50:19 2022] DELETE /compute/v2.1/flavors/30325457/os-extra_specs/hw:cpu_thread_policy => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:50:19.327951 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-7f7517d4-c813-4071-9308-685fd6a1a99e tempest-DeleteServersAdminTestJSON-841828601 tempest-DeleteServersAdminTestJSON-841828601-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/7e9ff909-ff6f-4d8d-8d84-97af957c6506/action" status: 202 len: 0 microversion: 2.1 time: 0.650182 Aug 10 17:50:19.327951 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 180/364] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 10 17:50:18 2022] POST /compute/v2.1/servers/7e9ff909-ff6f-4d8d-8d84-97af957c6506/action => generated 0 bytes in 653 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 17:50:19.327951 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-5549d7b3-3117-4e9a-a352-50da6cd16817 tempest-FlavorsExtraSpecsNegativeTestJSON-1685476613 tempest-FlavorsExtraSpecsNegativeTestJSON-1685476613-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:50:19.328500 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-0bafc638-224b-439f-9601-578c25850d3c tempest-FlavorsAccessNegativeTestJSON-243181220 tempest-FlavorsAccessNegativeTestJSON-243181220-project-admin] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:50:19.328581 n-d-852296-2 devstack@n-api.service[129409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:50:19.328581 n-d-852296-2 devstack@n-api.service[129409]: warnings.warn(msg) Aug 10 17:50:19.328581 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-5549d7b3-3117-4e9a-a352-50da6cd16817 tempest-FlavorsExtraSpecsNegativeTestJSON-1685476613 tempest-FlavorsExtraSpecsNegativeTestJSON-1685476613-project-admin] HTTP exception thrown: Request body and URI mismatch Aug 10 17:50:19.328581 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-5549d7b3-3117-4e9a-a352-50da6cd16817 tempest-FlavorsExtraSpecsNegativeTestJSON-1685476613 tempest-FlavorsExtraSpecsNegativeTestJSON-1685476613-project-admin] Request method failure captured: Aug 10 17:50:19.328581 n-d-852296-2 devstack@n-api.service[129409]: request: PUT /compute/v2.1/flavors/30325457/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 10 17:50:19.328581 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 17:50:19.328581 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 17:50:19.328581 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 17:50:19.328581 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 27 Aug 10 17:50:19.328581 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 17:50:19.328581 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 17:50:19.328581 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 17:50:19.328581 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 17:50:19.328581 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8-_Y6fe3rdFu8S8kE0VtpqXOjTnExFGJJmI-lGFU7ab4V4ECckHX4oH6yF3dZnWlV9QoIZrhApudYALKvpi-HRgvemyk4-Z8_y6QWy4nxBkP5RpWw1CEQVYUcIVo4IRhoZ0EItcq9TmPtdegSdg2-q1W7lyeL2VGyYDbmGuTHbKn0Uo Aug 10 17:50:19.328581 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 17:50:19.328581 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 17:50:19.328581 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 17:50:19.328581 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 17:50:19.328581 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 17:50:19.328581 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 17:50:19.328581 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: 77506d2b89914ae79fe3d7bc55cba0de Aug 10 17:50:19.328581 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1685476613 Aug 10 17:50:19.328581 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member,admin Aug 10 17:50:19.328581 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member,admin Aug 10 17:50:19.329850 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/77506d2b89914ae79fe3d7bc55cba0de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/77506d2b89914ae79fe3d7bc55cba0de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/77506d2b89914ae79fe3d7bc55cba0de"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_77506d2b89914ae79fe3d7bc55cba0de", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:50:19.329850 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1685476613 Aug 10 17:50:19.329850 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: 77506d2b89914ae79fe3d7bc55cba0de Aug 10 17:50:19.329850 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1685476613 Aug 10 17:50:19.329850 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1685476613-project-admin Aug 10 17:50:19.329850 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 17:50:19.329850 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 17:50:19.329850 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: 9b691f6d50b1440688678a667d84c472 Aug 10 17:50:19.329850 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1685476613-project-admin Aug 10 17:50:19.329850 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:50:19.329850 n-d-852296-2 devstack@n-api.service[129409]: {"hw:cpu_policy": "shared"} Aug 10 17:50:19.329850 n-d-852296-2 devstack@n-api.service[129409]: method: > Aug 10 17:50:19.329850 n-d-852296-2 devstack@n-api.service[129409]: exception: Request body and URI mismatch Aug 10 17:50:19.330578 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'flavor_id': '30325457', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Aug 10 17:50:19.330578 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:50:19.330578 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:19.330578 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:50:19.330578 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:50:19.330578 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:50:19.330578 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:50:19.330578 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:50:19.330578 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:50:19.330578 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:50:19.330578 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:50:19.330578 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Aug 10 17:50:19.330578 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Aug 10 17:50:19.330578 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Aug 10 17:50:19.330578 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:50:19.330578 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:50:19.330578 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:50:19.330578 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:19.330578 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:50:19.330578 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:50:19.332061 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:50:19.332061 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:50:19.332061 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Aug 10 17:50:19.332061 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:50:19.332061 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-5549d7b3-3117-4e9a-a352-50da6cd16817 tempest-FlavorsExtraSpecsNegativeTestJSON-1685476613 tempest-FlavorsExtraSpecsNegativeTestJSON-1685476613-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:50:19.332061 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-5549d7b3-3117-4e9a-a352-50da6cd16817 tempest-FlavorsExtraSpecsNegativeTestJSON-1685476613 tempest-FlavorsExtraSpecsNegativeTestJSON-1685476613-project-admin] 10.222.0.50 "PUT /compute/v2.1/flavors/30325457/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.027131 Aug 10 17:50:19.332061 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 181/365] 10.222.0.50 () {60 vars in 1259 bytes} [Wed Aug 10 17:50:19 2022] PUT /compute/v2.1/flavors/30325457/os-extra_specs/hw:numa_nodes => generated 73 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 10 17:50:19.345528 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-e56ff250-8540-4416-9965-d248eb11df3a tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:50:19.346422 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-e56ff250-8540-4416-9965-d248eb11df3a tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] [instance: 7e9ff909-ff6f-4d8d-8d84-97af957c6506] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:50:19.360687 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e56ff250-8540-4416-9965-d248eb11df3a tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:19.364882 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e56ff250-8540-4416-9965-d248eb11df3a tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:19.365516 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e56ff250-8540-4416-9965-d248eb11df3a tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:19.367006 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e56ff250-8540-4416-9965-d248eb11df3a tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:19.368832 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e56ff250-8540-4416-9965-d248eb11df3a tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:19.369478 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-0bafc638-224b-439f-9601-578c25850d3c tempest-FlavorsAccessNegativeTestJSON-243181220 tempest-FlavorsAccessNegativeTestJSON-243181220-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 5391 microversion: 2.1 time: 0.077569 Aug 10 17:50:19.369633 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e56ff250-8540-4416-9965-d248eb11df3a tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:19.370505 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 185/366] 10.222.0.50 () {58 vars in 1146 bytes} [Wed Aug 10 17:50:19 2022] GET /compute/v2.1/flavors/detail => generated 5391 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:50:19.391412 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-adc717d6-2b4a-4983-aa38-e16771e0f4b3 tempest-FlavorsExtraSpecsNegativeTestJSON-1685476613 tempest-FlavorsExtraSpecsNegativeTestJSON-1685476613-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:50:19.396407 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-adc717d6-2b4a-4983-aa38-e16771e0f4b3 tempest-FlavorsExtraSpecsNegativeTestJSON-1685476613 tempest-FlavorsExtraSpecsNegativeTestJSON-1685476613-project-admin] Request method failure captured: Aug 10 17:50:19.396407 n-d-852296-2 devstack@n-api.service[129410]: request: PUT /compute/v2.1/flavors/30325457/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 10 17:50:19.396407 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 17:50:19.396407 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 17:50:19.396407 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 17:50:19.396407 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 49 Aug 10 17:50:19.396407 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 17:50:19.396407 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 17:50:19.396407 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 17:50:19.396407 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 17:50:19.396407 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8-_Y6fe3rdFu8S8kE0VtpqXOjTnExFGJJmI-lGFU7ab4V4ECckHX4oH6yF3dZnWlV9QoIZrhApudYALKvpi-HRgvemyk4-Z8_y6QWy4nxBkP5RpWw1CEQVYUcIVo4IRhoZ0EItcq9TmPtdegSdg2-q1W7lyeL2VGyYDbmGuTHbKn0Uo Aug 10 17:50:19.396407 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 17:50:19.396407 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 17:50:19.396407 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 17:50:19.396407 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 17:50:19.396407 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 17:50:19.396407 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 17:50:19.396407 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: 77506d2b89914ae79fe3d7bc55cba0de Aug 10 17:50:19.396407 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1685476613 Aug 10 17:50:19.396407 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member,admin Aug 10 17:50:19.396407 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member,admin Aug 10 17:50:19.398227 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/77506d2b89914ae79fe3d7bc55cba0de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/77506d2b89914ae79fe3d7bc55cba0de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/77506d2b89914ae79fe3d7bc55cba0de"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_77506d2b89914ae79fe3d7bc55cba0de", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:50:19.398227 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1685476613 Aug 10 17:50:19.398227 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: 77506d2b89914ae79fe3d7bc55cba0de Aug 10 17:50:19.398227 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1685476613 Aug 10 17:50:19.398227 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1685476613-project-admin Aug 10 17:50:19.398227 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 17:50:19.398227 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 17:50:19.398227 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: 9b691f6d50b1440688678a667d84c472 Aug 10 17:50:19.398227 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1685476613-project-admin Aug 10 17:50:19.398227 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 17:50:19.398227 n-d-852296-2 devstack@n-api.service[129410]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Aug 10 17:50:19.398227 n-d-852296-2 devstack@n-api.service[129410]: method: > Aug 10 17:50:19.399046 n-d-852296-2 devstack@n-api.service[129410]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 10 17:50:19.399046 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'flavor_id': '30325457', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Aug 10 17:50:19.399046 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:50:19.399046 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:19.399046 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 10 17:50:19.399046 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 10 17:50:19.399046 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 10 17:50:19.399046 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise error Aug 10 17:50:19.399046 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 10 17:50:19.399046 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:19.399046 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Aug 10 17:50:19.399046 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 10 17:50:19.399046 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Aug 10 17:50:19.399046 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Aug 10 17:50:19.399046 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 10 17:50:19.399046 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi 'type': ['string', Aug 10 17:50:19.399046 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi 'number']}}, Aug 10 17:50:19.399046 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 10 17:50:19.399046 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:19.399046 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi On instance: Aug 10 17:50:19.399046 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Aug 10 17:50:19.399046 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:19.400628 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:50:19.400628 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:19.400628 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:19.400628 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:50:19.400628 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:50:19.400628 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:50:19.400628 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:50:19.400628 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:50:19.400628 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:50:19.400628 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 10 17:50:19.400628 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 10 17:50:19.400628 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 10 17:50:19.400628 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 10 17:50:19.400628 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 10 17:50:19.400628 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 10 17:50:19.400628 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 10 17:50:19.400628 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:19.400628 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:50:19.400628 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:19.400628 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:19.403537 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:50:19.403537 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:50:19.403537 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 10 17:50:19.403537 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 10 17:50:19.403537 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 10 17:50:19.403537 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:19.403537 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-adc717d6-2b4a-4983-aa38-e16771e0f4b3 tempest-FlavorsExtraSpecsNegativeTestJSON-1685476613 tempest-FlavorsExtraSpecsNegativeTestJSON-1685476613-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:50:19.403537 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-adc717d6-2b4a-4983-aa38-e16771e0f4b3 tempest-FlavorsExtraSpecsNegativeTestJSON-1685476613 tempest-FlavorsExtraSpecsNegativeTestJSON-1685476613-project-admin] 10.222.0.50 "PUT /compute/v2.1/flavors/30325457/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.026782 Aug 10 17:50:19.403537 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 186/367] 10.222.0.50 () {60 vars in 1259 bytes} [Wed Aug 10 17:50:19 2022] PUT /compute/v2.1/flavors/30325457/os-extra_specs/hw:numa_nodes => generated 117 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 10 17:50:19.404605 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-60216b59-12fa-44ab-b2be-524ea8b27f14 tempest-FlavorsAccessNegativeTestJSON-243181220 tempest-FlavorsAccessNegativeTestJSON-243181220-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-144927309", "id": 1953615052, "os-flavor-access:is_public": "False"}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:50:19.408132 n-d-852296-2 devstack@n-api.service[129410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:50:19.408132 n-d-852296-2 devstack@n-api.service[129410]: warnings.warn(msg) Aug 10 17:50:19.462175 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e56ff250-8540-4416-9965-d248eb11df3a tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:19.465322 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e56ff250-8540-4416-9965-d248eb11df3a tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:19.465765 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e56ff250-8540-4416-9965-d248eb11df3a tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:19.466236 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.objects.instance [None req-e56ff250-8540-4416-9965-d248eb11df3a tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lazy-loading 'fault' on Instance uuid 7e9ff909-ff6f-4d8d-8d84-97af957c6506 {{(pid=129409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:50:19.543561 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-60216b59-12fa-44ab-b2be-524ea8b27f14 tempest-FlavorsAccessNegativeTestJSON-243181220 tempest-FlavorsAccessNegativeTestJSON-243181220-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.142260 Aug 10 17:50:19.544432 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 187/368] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 17:50:19 2022] POST /compute/v2.1/flavors => generated 438 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:50:19.558789 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-a1cfbeae-0cc0-4b0b-bb52-1a52a7d69024 tempest-FlavorsExtraSpecsNegativeTestJSON-1685476613 tempest-FlavorsExtraSpecsNegativeTestJSON-1685476613-project-admin] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:50:19.715463 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-a1cfbeae-0cc0-4b0b-bb52-1a52a7d69024 tempest-FlavorsExtraSpecsNegativeTestJSON-1685476613 tempest-FlavorsExtraSpecsNegativeTestJSON-1685476613-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/30325457" status: 202 len: 0 microversion: 2.1 time: 0.169183 Aug 10 17:50:19.716053 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 188/369] 10.222.0.50 () {58 vars in 1155 bytes} [Wed Aug 10 17:50:19 2022] DELETE /compute/v2.1/flavors/30325457 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 17:50:19.722870 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-429ae441-94de-4eae-a663-4740343a5316 tempest-FlavorsAccessNegativeTestJSON-243181220 tempest-FlavorsAccessNegativeTestJSON-243181220-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "d820d1df32e94bc69d9f3695d10e8789"}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:50:19.725993 n-d-852296-2 devstack@n-api.service[129410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:50:19.725993 n-d-852296-2 devstack@n-api.service[129410]: warnings.warn(msg) Aug 10 17:50:19.764706 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-e56ff250-8540-4416-9965-d248eb11df3a tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f242fdc47104b98882cb29c8ca5caae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b721d6dfb14d3d8780094fc4e72890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:50:19.773873 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-e56ff250-8540-4416-9965-d248eb11df3a tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] 10.222.0.50 "GET /compute/v2.1/servers/7e9ff909-ff6f-4d8d-8d84-97af957c6506" status: 200 len: 1452 microversion: 2.1 time: 0.447592 Aug 10 17:50:19.798691 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 182/370] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:50:19 2022] GET /compute/v2.1/servers/7e9ff909-ff6f-4d8d-8d84-97af957c6506 => generated 1452 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:50:19.809309 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-08dbc7a3-0359-4beb-8108-cdc2b7df1eeb tempest-FlavorsExtraSpecsNegativeTestJSON-1685476613 tempest-FlavorsExtraSpecsNegativeTestJSON-1685476613-project-admin] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:50:19.878984 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-08dbc7a3-0359-4beb-8108-cdc2b7df1eeb tempest-FlavorsExtraSpecsNegativeTestJSON-1685476613 tempest-FlavorsExtraSpecsNegativeTestJSON-1685476613-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.077401 Aug 10 17:50:19.901053 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 183/371] 10.222.0.50 () {58 vars in 1146 bytes} [Wed Aug 10 17:50:19 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:50:19.903299 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-1d65df61-aec5-4924-946d-3b8db9868528 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:50:19.903963 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-1d65df61-aec5-4924-946d-3b8db9868528 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] [instance: 7e9ff909-ff6f-4d8d-8d84-97af957c6506] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:50:19.921422 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-1d65df61-aec5-4924-946d-3b8db9868528 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:19.921926 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-1d65df61-aec5-4924-946d-3b8db9868528 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:19.922365 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-1d65df61-aec5-4924-946d-3b8db9868528 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:19.923090 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-1d65df61-aec5-4924-946d-3b8db9868528 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:19.923552 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-1d65df61-aec5-4924-946d-3b8db9868528 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:19.923985 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-1d65df61-aec5-4924-946d-3b8db9868528 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:20.044514 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-1d65df61-aec5-4924-946d-3b8db9868528 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] [instance: 7e9ff909-ff6f-4d8d-8d84-97af957c6506] Going to try to terminate instance {{(pid=129409) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 17:50:20.460611 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-429ae441-94de-4eae-a663-4740343a5316 tempest-FlavorsAccessNegativeTestJSON-243181220 tempest-FlavorsAccessNegativeTestJSON-243181220-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors/1953615052/action" status: 200 len: 97 microversion: 2.1 time: 0.742755 Aug 10 17:50:20.467784 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 189/372] 10.222.0.50 () {60 vars in 1200 bytes} [Wed Aug 10 17:50:19 2022] POST /compute/v2.1/flavors/1953615052/action => generated 97 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 17:50:20.483694 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-ba5e22ad-5fec-4b2e-b46e-69fdf65ebc2e tempest-FlavorsAccessNegativeTestJSON-2119990731 tempest-FlavorsAccessNegativeTestJSON-2119990731-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "d820d1df32e94bc69d9f3695d10e8789"}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:50:20.490133 n-d-852296-2 devstack@n-api.service[129410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:50:20.490133 n-d-852296-2 devstack@n-api.service[129410]: warnings.warn(msg) Aug 10 17:50:20.492626 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-ba5e22ad-5fec-4b2e-b46e-69fdf65ebc2e tempest-FlavorsAccessNegativeTestJSON-2119990731 tempest-FlavorsAccessNegativeTestJSON-2119990731-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': 'd323ba73a4c04f109d0ca177d9b9eaa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820d1df32e94bc69d9f3695d10e8789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:50:20.498948 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-ba5e22ad-5fec-4b2e-b46e-69fdf65ebc2e tempest-FlavorsAccessNegativeTestJSON-2119990731 tempest-FlavorsAccessNegativeTestJSON-2119990731-project] Request method failure captured: Aug 10 17:50:20.498948 n-d-852296-2 devstack@n-api.service[129410]: request: POST /compute/v2.1/flavors/1953615052/action HTTP/1.1 Aug 10 17:50:20.498948 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 17:50:20.498948 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 17:50:20.498948 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 17:50:20.498948 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 70 Aug 10 17:50:20.498948 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 17:50:20.498948 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 17:50:20.498948 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 17:50:20.498948 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 17:50:20.498948 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8-_QZCASXzYp5rb9xCP9CB4UujryVoO-bFWVNMOCYoM-PJpaP4mpG2zTd5j2EwLw2-ed1TG4cCzavPahOYGHrbDo7tbAcEIS7AqaNIc84hwwUK1szuV0x5kfbgTYCqXOjEkCyGJVIBrULpicatIAAUlIN25l31okxvB_yYdVPCC-nak Aug 10 17:50:20.498948 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 17:50:20.498948 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 17:50:20.498948 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 17:50:20.498948 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 17:50:20.498948 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 17:50:20.498948 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 17:50:20.498948 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: d820d1df32e94bc69d9f3695d10e8789 Aug 10 17:50:20.498948 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-2119990731 Aug 10 17:50:20.498948 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 17:50:20.498948 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 17:50:20.500174 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d820d1df32e94bc69d9f3695d10e8789"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d820d1df32e94bc69d9f3695d10e8789"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d820d1df32e94bc69d9f3695d10e8789"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d820d1df32e94bc69d9f3695d10e8789", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:50:20.500174 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-2119990731 Aug 10 17:50:20.500174 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: d820d1df32e94bc69d9f3695d10e8789 Aug 10 17:50:20.500174 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-2119990731 Aug 10 17:50:20.500174 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-FlavorsAccessNegativeTestJSON-2119990731-project Aug 10 17:50:20.500174 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 17:50:20.500174 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 17:50:20.500174 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: d323ba73a4c04f109d0ca177d9b9eaa2 Aug 10 17:50:20.500174 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-2119990731-project Aug 10 17:50:20.500174 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 17:50:20.500174 n-d-852296-2 devstack@n-api.service[129410]: {"removeTenantAccess": {"tenant": "d820d1df32e94bc69d9f3695d10e8789"}} Aug 10 17:50:20.500174 n-d-852296-2 devstack@n-api.service[129410]: method: > Aug 10 17:50:20.500974 n-d-852296-2 devstack@n-api.service[129410]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Aug 10 17:50:20.500974 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'id': '1953615052', 'body': {'removeTenantAccess': {'tenant': 'd820d1df32e94bc69d9f3695d10e8789'}}} Aug 10 17:50:20.500974 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:50:20.500974 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:20.500974 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:50:20.500974 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:50:20.500974 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:50:20.500974 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:50:20.500974 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:50:20.500974 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:50:20.500974 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:50:20.500974 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:50:20.500974 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Aug 10 17:50:20.500974 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi context.can( Aug 10 17:50:20.500974 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 10 17:50:20.500974 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 10 17:50:20.500974 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 10 17:50:20.500974 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 10 17:50:20.500974 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 10 17:50:20.500974 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 10 17:50:20.502062 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 10 17:50:20.502062 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise self.value Aug 10 17:50:20.502062 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 10 17:50:20.502062 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 10 17:50:20.502062 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 10 17:50:20.502062 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 10 17:50:20.502062 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 10 17:50:20.502062 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 10 17:50:20.502062 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Aug 10 17:50:20.502062 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:20.502062 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:50:20.502062 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:20.502062 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:20.502062 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:50:20.502062 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:50:20.502062 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 10 17:50:20.502062 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 10 17:50:20.502062 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Aug 10 17:50:20.502062 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:20.509442 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-ba5e22ad-5fec-4b2e-b46e-69fdf65ebc2e tempest-FlavorsAccessNegativeTestJSON-2119990731 tempest-FlavorsAccessNegativeTestJSON-2119990731-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:50:20.512769 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-ba5e22ad-5fec-4b2e-b46e-69fdf65ebc2e tempest-FlavorsAccessNegativeTestJSON-2119990731 tempest-FlavorsAccessNegativeTestJSON-2119990731-project] 10.222.0.50 "POST /compute/v2.1/flavors/1953615052/action" status: 403 len: 133 microversion: 2.1 time: 0.040849 Aug 10 17:50:20.513740 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 190/373] 10.222.0.50 () {60 vars in 1200 bytes} [Wed Aug 10 17:50:20 2022] POST /compute/v2.1/flavors/1953615052/action => generated 133 bytes in 45 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:50:20.530816 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-03b3000f-69cb-47f5-ad04-bc48b521d8c5 tempest-FlavorsAccessNegativeTestJSON-243181220 tempest-FlavorsAccessNegativeTestJSON-243181220-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "d820d1df32e94bc69d9f3695d10e8789"}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:50:20.771975 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-1d65df61-aec5-4924-946d-3b8db9868528 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] 10.222.0.50 "DELETE /compute/v2.1/servers/7e9ff909-ff6f-4d8d-8d84-97af957c6506" status: 204 len: 0 microversion: 2.1 time: 0.874576 Aug 10 17:50:20.773563 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 184/374] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 10 17:50:19 2022] DELETE /compute/v2.1/servers/7e9ff909-ff6f-4d8d-8d84-97af957c6506 => generated 0 bytes in 891 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 17:50:20.791237 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-d34005cc-a81f-44e8-afae-fb0bb4514023 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:50:20.792859 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-d34005cc-a81f-44e8-afae-fb0bb4514023 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] [instance: 7e9ff909-ff6f-4d8d-8d84-97af957c6506] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:50:20.801687 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-d34005cc-a81f-44e8-afae-fb0bb4514023 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:20.802561 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-d34005cc-a81f-44e8-afae-fb0bb4514023 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:20.803823 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-d34005cc-a81f-44e8-afae-fb0bb4514023 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:20.805087 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-d34005cc-a81f-44e8-afae-fb0bb4514023 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:20.806483 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-d34005cc-a81f-44e8-afae-fb0bb4514023 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:20.809274 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-d34005cc-a81f-44e8-afae-fb0bb4514023 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:20.900083 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-d34005cc-a81f-44e8-afae-fb0bb4514023 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:20.900848 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-d34005cc-a81f-44e8-afae-fb0bb4514023 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:20.901939 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-d34005cc-a81f-44e8-afae-fb0bb4514023 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:20.902655 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.objects.instance [None req-d34005cc-a81f-44e8-afae-fb0bb4514023 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lazy-loading 'fault' on Instance uuid 7e9ff909-ff6f-4d8d-8d84-97af957c6506 {{(pid=129409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:50:21.061027 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-03b3000f-69cb-47f5-ad04-bc48b521d8c5 tempest-FlavorsAccessNegativeTestJSON-243181220 tempest-FlavorsAccessNegativeTestJSON-243181220-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors/1953615052/action" status: 200 len: 21 microversion: 2.1 time: 0.542509 Aug 10 17:50:21.062204 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 191/375] 10.222.0.50 () {60 vars in 1200 bytes} [Wed Aug 10 17:50:20 2022] POST /compute/v2.1/flavors/1953615052/action => generated 21 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 10 17:50:21.088756 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-ea0dd45c-ad27-4207-8fa3-658d032eec3b tempest-FlavorsAccessNegativeTestJSON-243181220 tempest-FlavorsAccessNegativeTestJSON-243181220-project-admin] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:50:21.328010 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-d34005cc-a81f-44e8-afae-fb0bb4514023 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f242fdc47104b98882cb29c8ca5caae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b721d6dfb14d3d8780094fc4e72890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:50:21.333177 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-ea0dd45c-ad27-4207-8fa3-658d032eec3b tempest-FlavorsAccessNegativeTestJSON-243181220 tempest-FlavorsAccessNegativeTestJSON-243181220-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/1953615052" status: 202 len: 0 microversion: 2.1 time: 0.262797 Aug 10 17:50:21.333908 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 192/376] 10.222.0.50 () {58 vars in 1161 bytes} [Wed Aug 10 17:50:21 2022] DELETE /compute/v2.1/flavors/1953615052 => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 17:50:21.352681 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-d34005cc-a81f-44e8-afae-fb0bb4514023 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] 10.222.0.50 "GET /compute/v2.1/servers/7e9ff909-ff6f-4d8d-8d84-97af957c6506" status: 200 len: 1458 microversion: 2.1 time: 0.560729 Aug 10 17:50:21.352681 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 185/377] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:50:20 2022] GET /compute/v2.1/servers/7e9ff909-ff6f-4d8d-8d84-97af957c6506 => generated 1458 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:50:21.353027 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-e3e6c31f-bc20-4def-80b4-aa69ecb7410f tempest-FlavorsAccessNegativeTestJSON-243181220 tempest-FlavorsAccessNegativeTestJSON-243181220-project-admin] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:50:21.442926 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-e3e6c31f-bc20-4def-80b4-aa69ecb7410f tempest-FlavorsAccessNegativeTestJSON-243181220 tempest-FlavorsAccessNegativeTestJSON-243181220-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.101384 Aug 10 17:50:21.444917 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 193/378] 10.222.0.50 () {58 vars in 1146 bytes} [Wed Aug 10 17:50:21 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:50:21.468339 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-2ca44984-e280-4b77-a395-d9dc021dbe0c tempest-FlavorsAccessNegativeTestJSON-243181220 tempest-FlavorsAccessNegativeTestJSON-243181220-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1241771662", "id": 253771368, "os-flavor-access:is_public": "False"}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:50:21.471843 n-d-852296-2 devstack@n-api.service[129409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:50:21.471843 n-d-852296-2 devstack@n-api.service[129409]: warnings.warn(msg) Aug 10 17:50:21.641563 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-2ca44984-e280-4b77-a395-d9dc021dbe0c tempest-FlavorsAccessNegativeTestJSON-243181220 tempest-FlavorsAccessNegativeTestJSON-243181220-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.178879 Aug 10 17:50:21.649993 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 186/379] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 17:50:21 2022] POST /compute/v2.1/flavors => generated 436 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:50:21.738934 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-f510fde6-f1a0-4a96-a7d3-6f31481908d4 tempest-FlavorsAccessNegativeTestJSON-243181220 tempest-FlavorsAccessNegativeTestJSON-243181220-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "cc011a4f716e4df3b1b8d8e4308b8938"}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:50:22.023906 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-f510fde6-f1a0-4a96-a7d3-6f31481908d4 tempest-FlavorsAccessNegativeTestJSON-243181220 tempest-FlavorsAccessNegativeTestJSON-243181220-project-admin] HTTP exception thrown: Flavor access not found for 39 / cc011a4f716e4df3b1b8d8e4308b8938 combination. Aug 10 17:50:22.023906 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-f510fde6-f1a0-4a96-a7d3-6f31481908d4 tempest-FlavorsAccessNegativeTestJSON-243181220 tempest-FlavorsAccessNegativeTestJSON-243181220-project-admin] Request method failure captured: Aug 10 17:50:22.023906 n-d-852296-2 devstack@n-api.service[129410]: request: POST /compute/v2.1/flavors/253771368/action HTTP/1.1 Aug 10 17:50:22.023906 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 17:50:22.023906 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 17:50:22.023906 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 17:50:22.023906 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 70 Aug 10 17:50:22.023906 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 17:50:22.023906 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 17:50:22.023906 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 17:50:22.023906 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 17:50:22.023906 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8-_RZgfZgmoo3sbghASsI3nAJ1ftELclq8Vad_k1tzwe9bS4WgQjdZZGN76a3ugIRo01o7Ezzt6gGQ3FtqcXAKy88Kv6ikqDoTkt35A3Xfb5zBnf3ZhNn1dllbSAGtWDsQ4wi8-mNIWHhBWlWfx1Onds37tiPsBAyljziBAdCQh9lXc Aug 10 17:50:22.023906 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 17:50:22.023906 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 17:50:22.023906 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 17:50:22.023906 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 17:50:22.023906 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 17:50:22.023906 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 17:50:22.023906 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: fc8082fa1dbf4f239422cf9a8f8c5b63 Aug 10 17:50:22.023906 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-243181220 Aug 10 17:50:22.023906 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member,admin Aug 10 17:50:22.023906 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member,admin Aug 10 17:50:22.026555 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/fc8082fa1dbf4f239422cf9a8f8c5b63"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/fc8082fa1dbf4f239422cf9a8f8c5b63"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/fc8082fa1dbf4f239422cf9a8f8c5b63"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_fc8082fa1dbf4f239422cf9a8f8c5b63", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:50:22.026555 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-243181220 Aug 10 17:50:22.026555 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: fc8082fa1dbf4f239422cf9a8f8c5b63 Aug 10 17:50:22.026555 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-243181220 Aug 10 17:50:22.026555 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-FlavorsAccessNegativeTestJSON-243181220-project-admin Aug 10 17:50:22.026555 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 17:50:22.026555 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 17:50:22.026555 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: 0d6a610c518641858f1ee3d1295b7af8 Aug 10 17:50:22.026555 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-243181220-project-admin Aug 10 17:50:22.026555 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 17:50:22.026555 n-d-852296-2 devstack@n-api.service[129410]: {"removeTenantAccess": {"tenant": "cc011a4f716e4df3b1b8d8e4308b8938"}} Aug 10 17:50:22.026555 n-d-852296-2 devstack@n-api.service[129410]: method: > Aug 10 17:50:22.027669 n-d-852296-2 devstack@n-api.service[129410]: exception: Flavor access not found for 39 / cc011a4f716e4df3b1b8d8e4308b8938 combination. Aug 10 17:50:22.027669 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'id': '253771368', 'body': {'removeTenantAccess': {'tenant': 'cc011a4f716e4df3b1b8d8e4308b8938'}}} Aug 10 17:50:22.027669 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:50:22.027669 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:22.027669 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Aug 10 17:50:22.027669 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Aug 10 17:50:22.027669 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 10 17:50:22.027669 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 10 17:50:22.027669 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Aug 10 17:50:22.027669 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Aug 10 17:50:22.027669 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Aug 10 17:50:22.027669 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Aug 10 17:50:22.027669 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Aug 10 17:50:22.027669 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Aug 10 17:50:22.027669 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 10 17:50:22.027669 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 10 17:50:22.027669 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Aug 10 17:50:22.027669 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Aug 10 17:50:22.031497 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 39 / cc011a4f716e4df3b1b8d8e4308b8938 combination. Aug 10 17:50:22.031497 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:22.031497 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:50:22.031497 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:22.031497 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:22.031497 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:50:22.031497 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:50:22.031497 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:50:22.031497 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:50:22.031497 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:50:22.031497 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:50:22.031497 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:50:22.031497 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:50:22.031497 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Aug 10 17:50:22.031497 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:50:22.031497 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 39 / cc011a4f716e4df3b1b8d8e4308b8938 combination. Aug 10 17:50:22.031497 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:22.031497 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:50:22.031497 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:22.031497 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:22.033493 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:50:22.033493 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:50:22.033493 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:50:22.033493 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:50:22.033493 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 39 / cc011a4f716e4df3b1b8d8e4308b8938 combination. Aug 10 17:50:22.033493 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:22.033493 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-f510fde6-f1a0-4a96-a7d3-6f31481908d4 tempest-FlavorsAccessNegativeTestJSON-243181220 tempest-FlavorsAccessNegativeTestJSON-243181220-project-admin] Returning 404 to user: Flavor access not found for 39 / cc011a4f716e4df3b1b8d8e4308b8938 combination. {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:50:22.033493 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-f510fde6-f1a0-4a96-a7d3-6f31481908d4 tempest-FlavorsAccessNegativeTestJSON-243181220 tempest-FlavorsAccessNegativeTestJSON-243181220-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors/253771368/action" status: 404 len: 124 microversion: 2.1 time: 0.275778 Aug 10 17:50:22.033493 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 194/380] 10.222.0.50 () {60 vars in 1197 bytes} [Wed Aug 10 17:50:21 2022] POST /compute/v2.1/flavors/253771368/action => generated 124 bytes in 277 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:50:22.034346 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-eabb2ba7-374b-49ac-a7b0-0067edbabf5e tempest-FlavorsAccessNegativeTestJSON-243181220 tempest-FlavorsAccessNegativeTestJSON-243181220-project-admin] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:50:22.034346 n-d-852296-2 devstack@n-api.service[129409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:50:22.034346 n-d-852296-2 devstack@n-api.service[129409]: warnings.warn(msg) Aug 10 17:50:22.367353 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-1c5159d1-dc38-4fae-af06-dddfd106d099 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:50:22.368448 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-1c5159d1-dc38-4fae-af06-dddfd106d099 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] [instance: 7e9ff909-ff6f-4d8d-8d84-97af957c6506] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:50:22.375177 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-1c5159d1-dc38-4fae-af06-dddfd106d099 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:22.375725 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-1c5159d1-dc38-4fae-af06-dddfd106d099 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:22.376222 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-1c5159d1-dc38-4fae-af06-dddfd106d099 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:22.377055 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-1c5159d1-dc38-4fae-af06-dddfd106d099 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:22.377763 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-1c5159d1-dc38-4fae-af06-dddfd106d099 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:22.378252 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-1c5159d1-dc38-4fae-af06-dddfd106d099 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:22.418452 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-1c5159d1-dc38-4fae-af06-dddfd106d099 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:22.419166 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-1c5159d1-dc38-4fae-af06-dddfd106d099 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:22.419746 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-1c5159d1-dc38-4fae-af06-dddfd106d099 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:22.420398 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.objects.instance [None req-1c5159d1-dc38-4fae-af06-dddfd106d099 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lazy-loading 'fault' on Instance uuid 7e9ff909-ff6f-4d8d-8d84-97af957c6506 {{(pid=129410) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:50:22.567842 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-1c5159d1-dc38-4fae-af06-dddfd106d099 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f242fdc47104b98882cb29c8ca5caae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b721d6dfb14d3d8780094fc4e72890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:50:22.582374 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-1c5159d1-dc38-4fae-af06-dddfd106d099 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] 10.222.0.50 "GET /compute/v2.1/servers/7e9ff909-ff6f-4d8d-8d84-97af957c6506" status: 200 len: 1458 microversion: 2.1 time: 0.217394 Aug 10 17:50:22.583513 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 195/381] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:50:22 2022] GET /compute/v2.1/servers/7e9ff909-ff6f-4d8d-8d84-97af957c6506 => generated 1458 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:50:23.104517 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-eabb2ba7-374b-49ac-a7b0-0067edbabf5e tempest-FlavorsAccessNegativeTestJSON-243181220 tempest-FlavorsAccessNegativeTestJSON-243181220-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/253771368" status: 202 len: 0 microversion: 2.1 time: 1.090420 Aug 10 17:50:23.106368 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 187/382] 10.222.0.50 () {58 vars in 1158 bytes} [Wed Aug 10 17:50:22 2022] DELETE /compute/v2.1/flavors/253771368 => generated 0 bytes in 1093 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 17:50:23.141125 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-1b189d48-e655-4b73-b83d-2e0fee2e49b4 tempest-FlavorsAccessNegativeTestJSON-243181220 tempest-FlavorsAccessNegativeTestJSON-243181220-project-admin] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:50:23.148997 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-1b189d48-e655-4b73-b83d-2e0fee2e49b4 tempest-FlavorsAccessNegativeTestJSON-243181220 tempest-FlavorsAccessNegativeTestJSON-243181220-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.037674 Aug 10 17:50:23.150177 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 196/383] 10.222.0.50 () {58 vars in 1146 bytes} [Wed Aug 10 17:50:23 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:50:23.606777 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-c14ec689-fb13-4a0e-930a-ceb6e2e08a09 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:50:23.607897 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-c14ec689-fb13-4a0e-930a-ceb6e2e08a09 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] [instance: 7e9ff909-ff6f-4d8d-8d84-97af957c6506] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:50:23.619281 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c14ec689-fb13-4a0e-930a-ceb6e2e08a09 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:23.621567 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c14ec689-fb13-4a0e-930a-ceb6e2e08a09 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:23.625001 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c14ec689-fb13-4a0e-930a-ceb6e2e08a09 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:23.628986 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c14ec689-fb13-4a0e-930a-ceb6e2e08a09 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:23.630077 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c14ec689-fb13-4a0e-930a-ceb6e2e08a09 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:23.631466 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c14ec689-fb13-4a0e-930a-ceb6e2e08a09 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:23.711696 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c14ec689-fb13-4a0e-930a-ceb6e2e08a09 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:23.714424 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c14ec689-fb13-4a0e-930a-ceb6e2e08a09 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:23.714909 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c14ec689-fb13-4a0e-930a-ceb6e2e08a09 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:23.715369 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.objects.instance [None req-c14ec689-fb13-4a0e-930a-ceb6e2e08a09 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lazy-loading 'fault' on Instance uuid 7e9ff909-ff6f-4d8d-8d84-97af957c6506 {{(pid=129409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:50:23.925457 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-c14ec689-fb13-4a0e-930a-ceb6e2e08a09 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f242fdc47104b98882cb29c8ca5caae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b721d6dfb14d3d8780094fc4e72890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:50:23.937937 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-c14ec689-fb13-4a0e-930a-ceb6e2e08a09 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] 10.222.0.50 "GET /compute/v2.1/servers/7e9ff909-ff6f-4d8d-8d84-97af957c6506" status: 200 len: 1416 microversion: 2.1 time: 0.332525 Aug 10 17:50:23.947574 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 188/384] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:50:23 2022] GET /compute/v2.1/servers/7e9ff909-ff6f-4d8d-8d84-97af957c6506 => generated 1416 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:50:24.201256 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [req-d192ca2f-7b8e-4745-8cc0-ecb20c50e6b3 req-1ba9920b-b0be-4612-885c-1b278ee25afd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e9ff909-ff6f-4d8d-8d84-97af957c6506", "name": "network-vif-deleted", "tag": "d660d305-1815-4a27-ab6a-2061b967f6a2"}]} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:50:24.234552 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-d192ca2f-7b8e-4745-8cc0-ecb20c50e6b3 req-1ba9920b-b0be-4612-885c-1b278ee25afd service nova] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:24.235032 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-d192ca2f-7b8e-4745-8cc0-ecb20c50e6b3 req-1ba9920b-b0be-4612-885c-1b278ee25afd service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:24.235462 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-d192ca2f-7b8e-4745-8cc0-ecb20c50e6b3 req-1ba9920b-b0be-4612-885c-1b278ee25afd service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:24.286114 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.compute.server_external_events [req-d192ca2f-7b8e-4745-8cc0-ecb20c50e6b3 req-1ba9920b-b0be-4612-885c-1b278ee25afd service nova] Creating event network-vif-deleted:d660d305-1815-4a27-ab6a-2061b967f6a2 for instance 7e9ff909-ff6f-4d8d-8d84-97af957c6506 on n-h1-852296-2 Aug 10 17:50:24.314208 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [req-d192ca2f-7b8e-4745-8cc0-ecb20c50e6b3 req-1ba9920b-b0be-4612-885c-1b278ee25afd service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116584 Aug 10 17:50:24.320728 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 197/385] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 10 17:50:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:50:24.967733 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-2870ebae-2b82-44ee-b1ae-fa803329c900 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:50:24.970935 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-2870ebae-2b82-44ee-b1ae-fa803329c900 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] [instance: 7e9ff909-ff6f-4d8d-8d84-97af957c6506] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:50:24.985215 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-2870ebae-2b82-44ee-b1ae-fa803329c900 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:24.985706 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-2870ebae-2b82-44ee-b1ae-fa803329c900 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:24.986145 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-2870ebae-2b82-44ee-b1ae-fa803329c900 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:24.986871 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-2870ebae-2b82-44ee-b1ae-fa803329c900 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:24.987304 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-2870ebae-2b82-44ee-b1ae-fa803329c900 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:24.987724 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-2870ebae-2b82-44ee-b1ae-fa803329c900 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:25.064443 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-2870ebae-2b82-44ee-b1ae-fa803329c900 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:25.064938 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-2870ebae-2b82-44ee-b1ae-fa803329c900 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:25.065376 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-2870ebae-2b82-44ee-b1ae-fa803329c900 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:25.065829 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.objects.instance [None req-2870ebae-2b82-44ee-b1ae-fa803329c900 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lazy-loading 'fault' on Instance uuid 7e9ff909-ff6f-4d8d-8d84-97af957c6506 {{(pid=129409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:50:25.141067 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-2870ebae-2b82-44ee-b1ae-fa803329c900 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f242fdc47104b98882cb29c8ca5caae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b721d6dfb14d3d8780094fc4e72890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:50:25.152577 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-2870ebae-2b82-44ee-b1ae-fa803329c900 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] 10.222.0.50 "GET /compute/v2.1/servers/7e9ff909-ff6f-4d8d-8d84-97af957c6506" status: 200 len: 1310 microversion: 2.1 time: 0.195571 Aug 10 17:50:25.153169 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 189/386] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:50:24 2022] GET /compute/v2.1/servers/7e9ff909-ff6f-4d8d-8d84-97af957c6506 => generated 1310 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:50:26.183005 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-c0bf49dc-81a2-4b88-9e05-40cd8f26c709 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:50:26.187259 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-c0bf49dc-81a2-4b88-9e05-40cd8f26c709 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] [instance: 7e9ff909-ff6f-4d8d-8d84-97af957c6506] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:50:26.203493 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-c0bf49dc-81a2-4b88-9e05-40cd8f26c709 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:26.204933 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-c0bf49dc-81a2-4b88-9e05-40cd8f26c709 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:26.206121 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-c0bf49dc-81a2-4b88-9e05-40cd8f26c709 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:26.207897 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-c0bf49dc-81a2-4b88-9e05-40cd8f26c709 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:26.208616 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-c0bf49dc-81a2-4b88-9e05-40cd8f26c709 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:26.210415 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-c0bf49dc-81a2-4b88-9e05-40cd8f26c709 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:26.243497 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-c0bf49dc-81a2-4b88-9e05-40cd8f26c709 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] HTTP exception thrown: Instance 7e9ff909-ff6f-4d8d-8d84-97af957c6506 could not be found. Aug 10 17:50:26.248510 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-c0bf49dc-81a2-4b88-9e05-40cd8f26c709 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Request method failure captured: Aug 10 17:50:26.248510 n-d-852296-2 devstack@n-api.service[129410]: request: GET /compute/v2.1/servers/7e9ff909-ff6f-4d8d-8d84-97af957c6506 HTTP/1.1 Aug 10 17:50:26.248510 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 17:50:26.248510 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 17:50:26.248510 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 17:50:26.248510 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 0 Aug 10 17:50:26.248510 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 17:50:26.248510 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 17:50:26.248510 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 17:50:26.248510 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 17:50:26.248510 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8--PSosbYFYBsYw53_ADT3pIQ5DhUK8RE9RQl1-lBh9FKh7PTmZEPoLK2iELsncTnxsMkZyGzpgbygYlXVB1pvYxIR3wpMh6-_qAYg8Mrb4CFQbrvftW6NnNmR3ozUeo6GQUHyLrpWR4L3weWKYB7E0bMLf2tdQm4vEhBlmT0h-gZ2Y Aug 10 17:50:26.248510 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 17:50:26.248510 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 17:50:26.248510 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 17:50:26.248510 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 17:50:26.248510 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 17:50:26.248510 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 17:50:26.248510 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: d5b721d6dfb14d3d8780094fc4e72890 Aug 10 17:50:26.248510 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-DeleteServersAdminTestJSON-496690079 Aug 10 17:50:26.248510 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 17:50:26.248510 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 17:50:26.250773 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d5b721d6dfb14d3d8780094fc4e72890"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d5b721d6dfb14d3d8780094fc4e72890"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d5b721d6dfb14d3d8780094fc4e72890"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d5b721d6dfb14d3d8780094fc4e72890", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:50:26.250773 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-DeleteServersAdminTestJSON-496690079 Aug 10 17:50:26.250773 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: d5b721d6dfb14d3d8780094fc4e72890 Aug 10 17:50:26.250773 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-496690079 Aug 10 17:50:26.250773 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-DeleteServersAdminTestJSON-496690079-project Aug 10 17:50:26.250773 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 17:50:26.250773 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 17:50:26.250773 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: 9f242fdc47104b98882cb29c8ca5caae Aug 10 17:50:26.250773 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-DeleteServersAdminTestJSON-496690079-project Aug 10 17:50:26.250773 n-d-852296-2 devstack@n-api.service[129410]: method: > Aug 10 17:50:26.250773 n-d-852296-2 devstack@n-api.service[129410]: exception: Instance 7e9ff909-ff6f-4d8d-8d84-97af957c6506 could not be found. Aug 10 17:50:26.250773 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'id': '7e9ff909-ff6f-4d8d-8d84-97af957c6506'} Aug 10 17:50:26.251484 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:50:26.251484 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:26.251484 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 17:50:26.251484 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 17:50:26.251484 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 17:50:26.251484 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 17:50:26.251484 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 17:50:26.251484 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 17:50:26.251484 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 17:50:26.251484 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 17:50:26.251484 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e9ff909-ff6f-4d8d-8d84-97af957c6506 could not be found. Aug 10 17:50:26.251484 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:26.251484 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:50:26.251484 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:26.251484 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:26.251484 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:50:26.251484 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:50:26.251484 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:50:26.251484 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:50:26.251484 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:50:26.252708 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:50:26.252708 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 17:50:26.252708 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 17:50:26.252708 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 17:50:26.252708 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 17:50:26.252708 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 17:50:26.252708 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:50:26.252708 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e9ff909-ff6f-4d8d-8d84-97af957c6506 could not be found. Aug 10 17:50:26.252708 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:26.252708 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:50:26.252708 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:26.252708 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:26.252708 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:50:26.252708 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:50:26.252708 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:50:26.252708 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:50:26.252708 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e9ff909-ff6f-4d8d-8d84-97af957c6506 could not be found. Aug 10 17:50:26.252708 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:26.259942 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-c0bf49dc-81a2-4b88-9e05-40cd8f26c709 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Returning 404 to user: Instance 7e9ff909-ff6f-4d8d-8d84-97af957c6506 could not be found. {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:50:26.261440 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-c0bf49dc-81a2-4b88-9e05-40cd8f26c709 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] 10.222.0.50 "GET /compute/v2.1/servers/7e9ff909-ff6f-4d8d-8d84-97af957c6506" status: 404 len: 111 microversion: 2.1 time: 0.087195 Aug 10 17:50:26.262598 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 198/387] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:50:26 2022] GET /compute/v2.1/servers/7e9ff909-ff6f-4d8d-8d84-97af957c6506 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:50:26.279646 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-189920c6-a528-4a07-803d-3f75c4dc46fb tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:50:26.284026 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-189920c6-a528-4a07-803d-3f75c4dc46fb tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] [instance: 7e9ff909-ff6f-4d8d-8d84-97af957c6506] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:50:26.289424 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-189920c6-a528-4a07-803d-3f75c4dc46fb tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:26.290160 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-189920c6-a528-4a07-803d-3f75c4dc46fb tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:26.290989 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-189920c6-a528-4a07-803d-3f75c4dc46fb tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:26.292170 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-189920c6-a528-4a07-803d-3f75c4dc46fb tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:26.293220 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-189920c6-a528-4a07-803d-3f75c4dc46fb tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:26.303861 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-189920c6-a528-4a07-803d-3f75c4dc46fb tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:26.330213 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-189920c6-a528-4a07-803d-3f75c4dc46fb tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] HTTP exception thrown: Instance 7e9ff909-ff6f-4d8d-8d84-97af957c6506 could not be found. Aug 10 17:50:26.332823 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-189920c6-a528-4a07-803d-3f75c4dc46fb tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Request method failure captured: Aug 10 17:50:26.332823 n-d-852296-2 devstack@n-api.service[129409]: request: DELETE /compute/v2.1/servers/7e9ff909-ff6f-4d8d-8d84-97af957c6506 HTTP/1.1 Aug 10 17:50:26.332823 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 17:50:26.332823 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 17:50:26.332823 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 17:50:26.332823 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 0 Aug 10 17:50:26.332823 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 17:50:26.332823 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 17:50:26.332823 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 17:50:26.332823 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 17:50:26.332823 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8--PSosbYFYBsYw53_ADT3pIQ5DhUK8RE9RQl1-lBh9FKh7PTmZEPoLK2iELsncTnxsMkZyGzpgbygYlXVB1pvYxIR3wpMh6-_qAYg8Mrb4CFQbrvftW6NnNmR3ozUeo6GQUHyLrpWR4L3weWKYB7E0bMLf2tdQm4vEhBlmT0h-gZ2Y Aug 10 17:50:26.332823 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 17:50:26.332823 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 17:50:26.332823 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 17:50:26.332823 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 17:50:26.332823 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 17:50:26.332823 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 17:50:26.332823 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: d5b721d6dfb14d3d8780094fc4e72890 Aug 10 17:50:26.332823 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-DeleteServersAdminTestJSON-496690079 Aug 10 17:50:26.332823 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 17:50:26.332823 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 17:50:26.336025 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d5b721d6dfb14d3d8780094fc4e72890"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d5b721d6dfb14d3d8780094fc4e72890"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d5b721d6dfb14d3d8780094fc4e72890"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d5b721d6dfb14d3d8780094fc4e72890", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:50:26.336025 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-DeleteServersAdminTestJSON-496690079 Aug 10 17:50:26.336025 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: d5b721d6dfb14d3d8780094fc4e72890 Aug 10 17:50:26.336025 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-496690079 Aug 10 17:50:26.336025 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-DeleteServersAdminTestJSON-496690079-project Aug 10 17:50:26.336025 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 17:50:26.336025 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 17:50:26.336025 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: 9f242fdc47104b98882cb29c8ca5caae Aug 10 17:50:26.336025 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-DeleteServersAdminTestJSON-496690079-project Aug 10 17:50:26.336025 n-d-852296-2 devstack@n-api.service[129409]: method: > Aug 10 17:50:26.336025 n-d-852296-2 devstack@n-api.service[129409]: exception: Instance 7e9ff909-ff6f-4d8d-8d84-97af957c6506 could not be found. Aug 10 17:50:26.336025 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'id': '7e9ff909-ff6f-4d8d-8d84-97af957c6506'} Aug 10 17:50:26.337904 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:50:26.337904 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:26.337904 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 17:50:26.337904 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 17:50:26.337904 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 17:50:26.337904 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 17:50:26.337904 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 17:50:26.337904 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 17:50:26.337904 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 17:50:26.337904 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 17:50:26.337904 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e9ff909-ff6f-4d8d-8d84-97af957c6506 could not be found. Aug 10 17:50:26.337904 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:50:26.337904 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:50:26.337904 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:50:26.337904 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:26.337904 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:50:26.337904 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:50:26.337904 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:50:26.337904 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:50:26.337904 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:50:26.341250 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:50:26.341250 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 17:50:26.341250 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 17:50:26.341250 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 17:50:26.341250 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 17:50:26.341250 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 17:50:26.341250 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 17:50:26.341250 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 17:50:26.341250 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:50:26.341250 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e9ff909-ff6f-4d8d-8d84-97af957c6506 could not be found. Aug 10 17:50:26.341250 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:50:26.341250 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:50:26.341250 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:50:26.341250 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:26.341250 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:50:26.341250 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:50:26.341250 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:50:26.341250 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:50:26.341250 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e9ff909-ff6f-4d8d-8d84-97af957c6506 could not be found. Aug 10 17:50:26.341250 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:50:26.343617 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-189920c6-a528-4a07-803d-3f75c4dc46fb tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Returning 404 to user: Instance 7e9ff909-ff6f-4d8d-8d84-97af957c6506 could not be found. {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:50:26.343617 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-189920c6-a528-4a07-803d-3f75c4dc46fb tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] 10.222.0.50 "DELETE /compute/v2.1/servers/7e9ff909-ff6f-4d8d-8d84-97af957c6506" status: 404 len: 111 microversion: 2.1 time: 0.064189 Aug 10 17:50:26.343617 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 190/388] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 10 17:50:26 2022] DELETE /compute/v2.1/servers/7e9ff909-ff6f-4d8d-8d84-97af957c6506 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:50:26.365094 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-310fe40a-fcf0-44f8-a0b8-dd87ccf55c52 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:50:26.376355 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-310fe40a-fcf0-44f8-a0b8-dd87ccf55c52 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] [instance: 7e9ff909-ff6f-4d8d-8d84-97af957c6506] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:50:26.404301 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_api:DELETE=18,nova_api:SELECT=80,nova_api:INSERT=2 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:50:26.406068 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-310fe40a-fcf0-44f8-a0b8-dd87ccf55c52 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:26.414385 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-310fe40a-fcf0-44f8-a0b8-dd87ccf55c52 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:26.415406 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-310fe40a-fcf0-44f8-a0b8-dd87ccf55c52 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:26.416561 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-310fe40a-fcf0-44f8-a0b8-dd87ccf55c52 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:26.417151 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-310fe40a-fcf0-44f8-a0b8-dd87ccf55c52 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:26.417699 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-310fe40a-fcf0-44f8-a0b8-dd87ccf55c52 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:26.435523 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-310fe40a-fcf0-44f8-a0b8-dd87ccf55c52 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] HTTP exception thrown: Instance 7e9ff909-ff6f-4d8d-8d84-97af957c6506 could not be found. Aug 10 17:50:26.437209 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-310fe40a-fcf0-44f8-a0b8-dd87ccf55c52 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Request method failure captured: Aug 10 17:50:26.437209 n-d-852296-2 devstack@n-api.service[129410]: request: GET /compute/v2.1/servers/7e9ff909-ff6f-4d8d-8d84-97af957c6506 HTTP/1.1 Aug 10 17:50:26.437209 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 17:50:26.437209 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 17:50:26.437209 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 17:50:26.437209 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 0 Aug 10 17:50:26.437209 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 17:50:26.437209 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 17:50:26.437209 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 17:50:26.437209 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 17:50:26.437209 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8--PSosbYFYBsYw53_ADT3pIQ5DhUK8RE9RQl1-lBh9FKh7PTmZEPoLK2iELsncTnxsMkZyGzpgbygYlXVB1pvYxIR3wpMh6-_qAYg8Mrb4CFQbrvftW6NnNmR3ozUeo6GQUHyLrpWR4L3weWKYB7E0bMLf2tdQm4vEhBlmT0h-gZ2Y Aug 10 17:50:26.437209 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 17:50:26.437209 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 17:50:26.437209 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 17:50:26.437209 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 17:50:26.437209 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 17:50:26.437209 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 17:50:26.437209 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: d5b721d6dfb14d3d8780094fc4e72890 Aug 10 17:50:26.437209 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-DeleteServersAdminTestJSON-496690079 Aug 10 17:50:26.437209 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 17:50:26.437209 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 17:50:26.441355 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d5b721d6dfb14d3d8780094fc4e72890"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d5b721d6dfb14d3d8780094fc4e72890"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d5b721d6dfb14d3d8780094fc4e72890"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d5b721d6dfb14d3d8780094fc4e72890", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:50:26.441355 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-DeleteServersAdminTestJSON-496690079 Aug 10 17:50:26.441355 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: d5b721d6dfb14d3d8780094fc4e72890 Aug 10 17:50:26.441355 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-496690079 Aug 10 17:50:26.441355 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-DeleteServersAdminTestJSON-496690079-project Aug 10 17:50:26.441355 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 17:50:26.441355 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 17:50:26.441355 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: 9f242fdc47104b98882cb29c8ca5caae Aug 10 17:50:26.441355 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-DeleteServersAdminTestJSON-496690079-project Aug 10 17:50:26.441355 n-d-852296-2 devstack@n-api.service[129410]: method: > Aug 10 17:50:26.441355 n-d-852296-2 devstack@n-api.service[129410]: exception: Instance 7e9ff909-ff6f-4d8d-8d84-97af957c6506 could not be found. Aug 10 17:50:26.441355 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'id': '7e9ff909-ff6f-4d8d-8d84-97af957c6506'} Aug 10 17:50:26.442937 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:50:26.442937 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:26.442937 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 17:50:26.442937 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 17:50:26.442937 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 17:50:26.442937 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 17:50:26.442937 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 17:50:26.442937 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 17:50:26.442937 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 17:50:26.442937 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 17:50:26.442937 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e9ff909-ff6f-4d8d-8d84-97af957c6506 could not be found. Aug 10 17:50:26.442937 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:26.442937 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:50:26.442937 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:26.442937 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:26.442937 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:50:26.442937 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:50:26.442937 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:50:26.442937 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:50:26.442937 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:50:26.446414 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:50:26.446414 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 17:50:26.446414 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 17:50:26.446414 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 17:50:26.446414 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 17:50:26.446414 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 17:50:26.446414 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:50:26.446414 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e9ff909-ff6f-4d8d-8d84-97af957c6506 could not be found. Aug 10 17:50:26.446414 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:26.446414 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:50:26.446414 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:26.446414 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:26.446414 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:50:26.446414 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:50:26.446414 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:50:26.446414 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:50:26.446414 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e9ff909-ff6f-4d8d-8d84-97af957c6506 could not be found. Aug 10 17:50:26.446414 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:26.450524 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-310fe40a-fcf0-44f8-a0b8-dd87ccf55c52 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Returning 404 to user: Instance 7e9ff909-ff6f-4d8d-8d84-97af957c6506 could not be found. {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:50:26.465793 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-310fe40a-fcf0-44f8-a0b8-dd87ccf55c52 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] 10.222.0.50 "GET /compute/v2.1/servers/7e9ff909-ff6f-4d8d-8d84-97af957c6506" status: 404 len: 111 microversion: 2.1 time: 0.103353 Aug 10 17:50:26.470827 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 199/389] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:50:26 2022] GET /compute/v2.1/servers/7e9ff909-ff6f-4d8d-8d84-97af957c6506 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:50:26.480634 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-8ea5bf80-5951-40e3-b0bf-f8caa26a245e tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:50:26.488953 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-8ea5bf80-5951-40e3-b0bf-f8caa26a245e tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] [instance: 8e4a95fa-1d4a-4dca-9ba6-73a55f57d771] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:50:26.499551 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-8ea5bf80-5951-40e3-b0bf-f8caa26a245e tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:26.500606 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-8ea5bf80-5951-40e3-b0bf-f8caa26a245e tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:26.501257 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-8ea5bf80-5951-40e3-b0bf-f8caa26a245e tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:26.504037 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-8ea5bf80-5951-40e3-b0bf-f8caa26a245e tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:26.505001 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-8ea5bf80-5951-40e3-b0bf-f8caa26a245e tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:26.508233 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-8ea5bf80-5951-40e3-b0bf-f8caa26a245e tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:26.560371 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-8ea5bf80-5951-40e3-b0bf-f8caa26a245e tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] HTTP exception thrown: Instance 8e4a95fa-1d4a-4dca-9ba6-73a55f57d771 could not be found. Aug 10 17:50:26.562915 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-8ea5bf80-5951-40e3-b0bf-f8caa26a245e tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Request method failure captured: Aug 10 17:50:26.562915 n-d-852296-2 devstack@n-api.service[129409]: request: DELETE /compute/v2.1/servers/8e4a95fa-1d4a-4dca-9ba6-73a55f57d771 HTTP/1.1 Aug 10 17:50:26.562915 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 17:50:26.562915 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 17:50:26.562915 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 17:50:26.562915 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 0 Aug 10 17:50:26.562915 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 17:50:26.562915 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 17:50:26.562915 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 17:50:26.562915 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 17:50:26.562915 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8--PSosbYFYBsYw53_ADT3pIQ5DhUK8RE9RQl1-lBh9FKh7PTmZEPoLK2iELsncTnxsMkZyGzpgbygYlXVB1pvYxIR3wpMh6-_qAYg8Mrb4CFQbrvftW6NnNmR3ozUeo6GQUHyLrpWR4L3weWKYB7E0bMLf2tdQm4vEhBlmT0h-gZ2Y Aug 10 17:50:26.562915 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 17:50:26.562915 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 17:50:26.562915 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 17:50:26.562915 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 17:50:26.562915 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 17:50:26.562915 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 17:50:26.562915 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: d5b721d6dfb14d3d8780094fc4e72890 Aug 10 17:50:26.562915 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-DeleteServersAdminTestJSON-496690079 Aug 10 17:50:26.562915 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 17:50:26.562915 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 17:50:26.564213 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d5b721d6dfb14d3d8780094fc4e72890"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d5b721d6dfb14d3d8780094fc4e72890"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d5b721d6dfb14d3d8780094fc4e72890"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d5b721d6dfb14d3d8780094fc4e72890", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:50:26.564213 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-DeleteServersAdminTestJSON-496690079 Aug 10 17:50:26.564213 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: d5b721d6dfb14d3d8780094fc4e72890 Aug 10 17:50:26.564213 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-496690079 Aug 10 17:50:26.564213 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-DeleteServersAdminTestJSON-496690079-project Aug 10 17:50:26.564213 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 17:50:26.564213 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 17:50:26.564213 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: 9f242fdc47104b98882cb29c8ca5caae Aug 10 17:50:26.564213 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-DeleteServersAdminTestJSON-496690079-project Aug 10 17:50:26.564213 n-d-852296-2 devstack@n-api.service[129409]: method: > Aug 10 17:50:26.564213 n-d-852296-2 devstack@n-api.service[129409]: exception: Instance 8e4a95fa-1d4a-4dca-9ba6-73a55f57d771 could not be found. Aug 10 17:50:26.564213 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'id': '8e4a95fa-1d4a-4dca-9ba6-73a55f57d771'} Aug 10 17:50:26.564917 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:50:26.564917 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:26.564917 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 17:50:26.564917 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 17:50:26.564917 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 17:50:26.564917 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 17:50:26.564917 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 17:50:26.564917 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 17:50:26.564917 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 17:50:26.564917 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 17:50:26.564917 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e4a95fa-1d4a-4dca-9ba6-73a55f57d771 could not be found. Aug 10 17:50:26.564917 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:50:26.564917 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:50:26.564917 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:50:26.564917 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:26.564917 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:50:26.564917 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:50:26.564917 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:50:26.564917 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:50:26.564917 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:50:26.566870 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:50:26.566870 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 17:50:26.566870 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 17:50:26.566870 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 17:50:26.566870 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 17:50:26.566870 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 17:50:26.566870 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 17:50:26.566870 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 17:50:26.566870 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:50:26.566870 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e4a95fa-1d4a-4dca-9ba6-73a55f57d771 could not be found. Aug 10 17:50:26.566870 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:50:26.566870 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:50:26.566870 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:50:26.566870 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:26.566870 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:50:26.566870 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:50:26.566870 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:50:26.566870 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:50:26.566870 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e4a95fa-1d4a-4dca-9ba6-73a55f57d771 could not be found. Aug 10 17:50:26.566870 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:50:26.572806 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-8ea5bf80-5951-40e3-b0bf-f8caa26a245e tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Returning 404 to user: Instance 8e4a95fa-1d4a-4dca-9ba6-73a55f57d771 could not be found. {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:50:26.574664 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-8ea5bf80-5951-40e3-b0bf-f8caa26a245e tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] 10.222.0.50 "DELETE /compute/v2.1/servers/8e4a95fa-1d4a-4dca-9ba6-73a55f57d771" status: 404 len: 111 microversion: 2.1 time: 0.099118 Aug 10 17:50:26.575227 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 191/390] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 10 17:50:26 2022] DELETE /compute/v2.1/servers/8e4a95fa-1d4a-4dca-9ba6-73a55f57d771 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:50:26.586982 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-62ec9e35-828d-41fb-b9ae-0a69683fcbd3 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:50:26.587604 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-62ec9e35-828d-41fb-b9ae-0a69683fcbd3 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] [instance: 8e4a95fa-1d4a-4dca-9ba6-73a55f57d771] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:50:26.617207 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-62ec9e35-828d-41fb-b9ae-0a69683fcbd3 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:26.618828 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-62ec9e35-828d-41fb-b9ae-0a69683fcbd3 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:26.622030 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-62ec9e35-828d-41fb-b9ae-0a69683fcbd3 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:26.623413 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-62ec9e35-828d-41fb-b9ae-0a69683fcbd3 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:26.630168 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-62ec9e35-828d-41fb-b9ae-0a69683fcbd3 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:26.632109 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-62ec9e35-828d-41fb-b9ae-0a69683fcbd3 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:26.701852 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-62ec9e35-828d-41fb-b9ae-0a69683fcbd3 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] HTTP exception thrown: Instance 8e4a95fa-1d4a-4dca-9ba6-73a55f57d771 could not be found. Aug 10 17:50:26.707064 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-62ec9e35-828d-41fb-b9ae-0a69683fcbd3 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Request method failure captured: Aug 10 17:50:26.707064 n-d-852296-2 devstack@n-api.service[129410]: request: GET /compute/v2.1/servers/8e4a95fa-1d4a-4dca-9ba6-73a55f57d771 HTTP/1.1 Aug 10 17:50:26.707064 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 17:50:26.707064 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 17:50:26.707064 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 17:50:26.707064 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 0 Aug 10 17:50:26.707064 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 17:50:26.707064 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 17:50:26.707064 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 17:50:26.707064 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 17:50:26.707064 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8--PSosbYFYBsYw53_ADT3pIQ5DhUK8RE9RQl1-lBh9FKh7PTmZEPoLK2iELsncTnxsMkZyGzpgbygYlXVB1pvYxIR3wpMh6-_qAYg8Mrb4CFQbrvftW6NnNmR3ozUeo6GQUHyLrpWR4L3weWKYB7E0bMLf2tdQm4vEhBlmT0h-gZ2Y Aug 10 17:50:26.707064 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 17:50:26.707064 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 17:50:26.707064 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 17:50:26.707064 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 17:50:26.707064 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 17:50:26.707064 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 17:50:26.707064 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: d5b721d6dfb14d3d8780094fc4e72890 Aug 10 17:50:26.707064 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-DeleteServersAdminTestJSON-496690079 Aug 10 17:50:26.707064 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 17:50:26.707064 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 17:50:26.708426 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d5b721d6dfb14d3d8780094fc4e72890"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d5b721d6dfb14d3d8780094fc4e72890"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d5b721d6dfb14d3d8780094fc4e72890"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d5b721d6dfb14d3d8780094fc4e72890", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:50:26.708426 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-DeleteServersAdminTestJSON-496690079 Aug 10 17:50:26.708426 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: d5b721d6dfb14d3d8780094fc4e72890 Aug 10 17:50:26.708426 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-496690079 Aug 10 17:50:26.708426 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-DeleteServersAdminTestJSON-496690079-project Aug 10 17:50:26.708426 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 17:50:26.708426 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 17:50:26.708426 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: 9f242fdc47104b98882cb29c8ca5caae Aug 10 17:50:26.708426 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-DeleteServersAdminTestJSON-496690079-project Aug 10 17:50:26.708426 n-d-852296-2 devstack@n-api.service[129410]: method: > Aug 10 17:50:26.708426 n-d-852296-2 devstack@n-api.service[129410]: exception: Instance 8e4a95fa-1d4a-4dca-9ba6-73a55f57d771 could not be found. Aug 10 17:50:26.708426 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'id': '8e4a95fa-1d4a-4dca-9ba6-73a55f57d771'} Aug 10 17:50:26.709734 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:50:26.709734 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:26.709734 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 17:50:26.709734 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 17:50:26.709734 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 17:50:26.709734 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 17:50:26.709734 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 17:50:26.709734 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 17:50:26.709734 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 17:50:26.709734 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 17:50:26.709734 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e4a95fa-1d4a-4dca-9ba6-73a55f57d771 could not be found. Aug 10 17:50:26.709734 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:26.709734 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:50:26.709734 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:26.709734 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:26.709734 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:50:26.709734 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:50:26.709734 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:50:26.709734 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:50:26.709734 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:50:26.711335 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:50:26.711335 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 17:50:26.711335 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 17:50:26.711335 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 17:50:26.711335 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 17:50:26.711335 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 17:50:26.711335 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:50:26.711335 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e4a95fa-1d4a-4dca-9ba6-73a55f57d771 could not be found. Aug 10 17:50:26.711335 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:26.711335 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:50:26.711335 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:26.711335 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:26.711335 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:50:26.711335 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:50:26.711335 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:50:26.711335 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:50:26.711335 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e4a95fa-1d4a-4dca-9ba6-73a55f57d771 could not be found. Aug 10 17:50:26.711335 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:26.715020 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-62ec9e35-828d-41fb-b9ae-0a69683fcbd3 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] Returning 404 to user: Instance 8e4a95fa-1d4a-4dca-9ba6-73a55f57d771 could not be found. {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:50:26.727827 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-62ec9e35-828d-41fb-b9ae-0a69683fcbd3 tempest-DeleteServersAdminTestJSON-496690079 tempest-DeleteServersAdminTestJSON-496690079-project] 10.222.0.50 "GET /compute/v2.1/servers/8e4a95fa-1d4a-4dca-9ba6-73a55f57d771" status: 404 len: 111 microversion: 2.1 time: 0.136134 Aug 10 17:50:26.727827 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 200/391] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:50:26 2022] GET /compute/v2.1/servers/8e4a95fa-1d4a-4dca-9ba6-73a55f57d771 => generated 111 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:50:33.480651 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_cell0:SELECT=8 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:50:34.323651 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-26d49869-17be-4145-9240-b77aba14c66f tempest-KeyPairsV2TestJSON-782143794 tempest-KeyPairsV2TestJSON-782143794-project] Action: 'create', calling method: .version_select at 0x7fb3467cd280>, body: {"keypair": {"name": "tempest-keypair-616556585", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBRjNFcmuI8Z4kVR8+mazzbiCZddJHNSgoJTUsZxKIkCs9WG8XZUsqhFRRKDRDMwtngqgWhar54Dr9DziK4raHHPUwmfKTd5WtZlu59WXwpP7Dd+3Tyl2zdAVEve6Y4iJw=="}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:50:34.339156 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=6,nova_api:SAVEPOINT=4,nova_api:RELEASE=4,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:50:34.354342 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-26d49869-17be-4145-9240-b77aba14c66f tempest-KeyPairsV2TestJSON-782143794 tempest-KeyPairsV2TestJSON-782143794-project] Getting quotas for project 5ca04a26e2e64a119b83e442d48f3dff. Resources: {'key_pairs'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:50:34.359210 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-26d49869-17be-4145-9240-b77aba14c66f tempest-KeyPairsV2TestJSON-782143794 tempest-KeyPairsV2TestJSON-782143794-project] Getting quotas for user 79db3ccc38804a7dba7b70f3779a87aa and project 5ca04a26e2e64a119b83e442d48f3dff. Resources: {'key_pairs'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:50:34.702157 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_cell0:SELECT=4 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:50:34.851015 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-26d49869-17be-4145-9240-b77aba14c66f tempest-KeyPairsV2TestJSON-782143794 tempest-KeyPairsV2TestJSON-782143794-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.376764 Aug 10 17:50:34.851744 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 192/392] 10.222.0.50 () {60 vars in 1159 bytes} [Wed Aug 10 17:50:33 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1378 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:50:34.871190 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-fc1fec6c-591a-48e3-9bf8-dd77af503db2 tempest-KeyPairsV2TestJSON-782143794 tempest-KeyPairsV2TestJSON-782143794-project] Calling method '.version_select at 0x7fb3467f8f70>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:50:34.879741 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-fc1fec6c-591a-48e3-9bf8-dd77af503db2 tempest-KeyPairsV2TestJSON-782143794 tempest-KeyPairsV2TestJSON-782143794-project] 10.222.0.50 "GET /compute/v2.1/os-keypairs/tempest-keypair-616556585" status: 200 len: 496 microversion: 2.1 time: 0.012335 Aug 10 17:50:34.880315 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 193/393] 10.222.0.50 () {58 vars in 1215 bytes} [Wed Aug 10 17:50:34 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-616556585 => generated 496 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:50:34.892098 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-14042c1a-418b-4065-b0bb-44a0f6a2e31c tempest-KeyPairsV2TestJSON-782143794 tempest-KeyPairsV2TestJSON-782143794-project] Calling method '.version_select at 0x7fb346711af0>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:50:35.403043 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-14042c1a-418b-4065-b0bb-44a0f6a2e31c tempest-KeyPairsV2TestJSON-782143794 tempest-KeyPairsV2TestJSON-782143794-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-616556585" status: 202 len: 0 microversion: 2.1 time: 0.514374 Aug 10 17:50:35.403632 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 194/394] 10.222.0.50 () {58 vars in 1218 bytes} [Wed Aug 10 17:50:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-616556585 => generated 0 bytes in 515 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 17:50:35.424679 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-849207c1-f24d-4cdc-8ee9-dc4d41fd3e25 tempest-KeyPairsV2TestJSON-782143794 tempest-KeyPairsV2TestJSON-782143794-project] Action: 'create', calling method: .version_select at 0x7fb346784310>, body: {"keypair": {"name": "tempest-keypair-2043864324", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPdvPlhUu1ib+DqbVFUifEVryDYn87hH1a2xQeJF4teDGNXMwcRZMGTjGTgXLKqCB4UcB32TGQ+tAWbsDgH9rs326qUBLEBq9hZq4fKN+6OErFV/qqAJeGxZcp8AcoWj7w=="}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:50:35.439725 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-849207c1-f24d-4cdc-8ee9-dc4d41fd3e25 tempest-KeyPairsV2TestJSON-782143794 tempest-KeyPairsV2TestJSON-782143794-project] Getting quotas for project 5ca04a26e2e64a119b83e442d48f3dff. Resources: {'key_pairs'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:50:35.444988 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-849207c1-f24d-4cdc-8ee9-dc4d41fd3e25 tempest-KeyPairsV2TestJSON-782143794 tempest-KeyPairsV2TestJSON-782143794-project] Getting quotas for user 79db3ccc38804a7dba7b70f3779a87aa and project 5ca04a26e2e64a119b83e442d48f3dff. Resources: {'key_pairs'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:50:35.649642 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-a5af951d-80c8-4e1d-bad2-c15d3d855b4a tempest-ListImagesTestJSON-289791848 tempest-ListImagesTestJSON-289791848-project] Calling method '.version_select at 0x7fb34688daf0>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:50:35.660586 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-849207c1-f24d-4cdc-8ee9-dc4d41fd3e25 tempest-KeyPairsV2TestJSON-782143794 tempest-KeyPairsV2TestJSON-782143794-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.239845 Aug 10 17:50:35.679567 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 195/395] 10.222.0.50 () {60 vars in 1159 bytes} [Wed Aug 10 17:50:35 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:50:35.679567 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-7c28ca24-2110-4b14-9b43-e9961f288cc5 tempest-KeyPairsV2TestJSON-782143794 tempest-KeyPairsV2TestJSON-782143794-project] Calling method '.version_select at 0x7fb3467f8b80>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:50:35.698459 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-a5af951d-80c8-4e1d-bad2-c15d3d855b4a tempest-ListImagesTestJSON-289791848 tempest-ListImagesTestJSON-289791848-project] 10.222.0.50 "GET /compute/v2.1/images/a735ff26-463a-4ffe-a981-ab9d9baa494f" status: 200 len: 784 microversion: 2.1 time: 0.998738 Aug 10 17:50:35.699037 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 201/396] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:50:34 2022] GET /compute/v2.1/images/a735ff26-463a-4ffe-a981-ab9d9baa494f => generated 784 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:50:35.713550 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-13975da8-b4d8-4681-a674-dcf243a8a12e tempest-ListImagesTestJSON-289791848 tempest-ListImagesTestJSON-289791848-project] Calling method '.version_select at 0x7fb3465c9670>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:50:35.803281 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-13975da8-b4d8-4681-a674-dcf243a8a12e tempest-ListImagesTestJSON-289791848 tempest-ListImagesTestJSON-289791848-project] 10.222.0.50 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.081742 Aug 10 17:50:35.803281 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 202/397] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 10 17:50:35 2022] GET /compute/v2.1/images => generated 445 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:50:35.814876 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-07eaafd9-7007-4ddb-9e85-b53ab0a67b90 tempest-ListImagesTestJSON-289791848 tempest-ListImagesTestJSON-289791848-project] Calling method '.version_select at 0x7fb34688dc10>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:50:35.871840 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-07eaafd9-7007-4ddb-9e85-b53ab0a67b90 tempest-ListImagesTestJSON-289791848 tempest-ListImagesTestJSON-289791848-project] 10.222.0.50 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.051098 Aug 10 17:50:35.871840 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 203/398] 10.222.0.50 () {58 vars in 1143 bytes} [Wed Aug 10 17:50:35 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:50:35.984895 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-7c28ca24-2110-4b14-9b43-e9961f288cc5 tempest-KeyPairsV2TestJSON-782143794 tempest-KeyPairsV2TestJSON-782143794-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2043864324" status: 202 len: 0 microversion: 2.1 time: 0.316703 Aug 10 17:50:35.986328 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 196/399] 10.222.0.50 () {58 vars in 1221 bytes} [Wed Aug 10 17:50:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2043864324 => generated 0 bytes in 319 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 17:50:36.008741 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-0c5adfdf-de89-4229-aa2d-b255cf7d3b7f tempest-KeyPairsV2TestJSON-782143794 tempest-KeyPairsV2TestJSON-782143794-project] Action: 'create', calling method: .version_select at 0x7fb3465c9550>, body: {"keypair": {"name": "tempest-keypair-1667742083", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:50:36.024335 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.quota [None req-0c5adfdf-de89-4229-aa2d-b255cf7d3b7f tempest-KeyPairsV2TestJSON-782143794 tempest-KeyPairsV2TestJSON-782143794-project] Getting quotas for project 5ca04a26e2e64a119b83e442d48f3dff. Resources: {'key_pairs'} {{(pid=129410) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:50:36.028755 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.quota [None req-0c5adfdf-de89-4229-aa2d-b255cf7d3b7f tempest-KeyPairsV2TestJSON-782143794 tempest-KeyPairsV2TestJSON-782143794-project] Getting quotas for user 79db3ccc38804a7dba7b70f3779a87aa and project 5ca04a26e2e64a119b83e442d48f3dff. Resources: {'key_pairs'} {{(pid=129410) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:50:36.305648 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-0c5adfdf-de89-4229-aa2d-b255cf7d3b7f tempest-KeyPairsV2TestJSON-782143794 tempest-KeyPairsV2TestJSON-782143794-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 574 microversion: 2.1 time: 0.301167 Aug 10 17:50:36.306260 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 204/400] 10.222.0.50 () {60 vars in 1159 bytes} [Wed Aug 10 17:50:36 2022] POST /compute/v2.1/os-keypairs => generated 574 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:50:36.316377 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-2dc39953-2a2a-41c1-a47d-1cc5f69c2daf tempest-KeyPairsV2TestJSON-782143794 tempest-KeyPairsV2TestJSON-782143794-project] Calling method '.version_select at 0x7fb346791940>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:50:36.507671 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-2dc39953-2a2a-41c1-a47d-1cc5f69c2daf tempest-KeyPairsV2TestJSON-782143794 tempest-KeyPairsV2TestJSON-782143794-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1667742083" status: 202 len: 0 microversion: 2.1 time: 0.195030 Aug 10 17:50:36.508300 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 197/401] 10.222.0.50 () {58 vars in 1221 bytes} [Wed Aug 10 17:50:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1667742083 => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 17:50:36.524842 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-9773d79d-2c6c-44b9-a3ff-e9763587b1fe tempest-KeyPairsV2TestJSON-782143794 tempest-KeyPairsV2TestJSON-782143794-project] Action: 'create', calling method: .version_select at 0x7fb3465e4b80>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-216766894", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOhIy7k95tfAgNqhUV5/TD7jpmvV/9zQ5MQPiizncLGZmeh/j1T3Ikf5vqsFB6Dv3vULtZ3ZIKQGYfIrPlL7QA7iBmnWTDWA5xPo/VPh5bgUR+dcm1n8aqpuX99E4JiR3g=="}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:50:36.541332 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.quota [None req-9773d79d-2c6c-44b9-a3ff-e9763587b1fe tempest-KeyPairsV2TestJSON-782143794 tempest-KeyPairsV2TestJSON-782143794-project] Getting quotas for project 5ca04a26e2e64a119b83e442d48f3dff. Resources: {'key_pairs'} {{(pid=129410) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:50:36.545752 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.quota [None req-9773d79d-2c6c-44b9-a3ff-e9763587b1fe tempest-KeyPairsV2TestJSON-782143794 tempest-KeyPairsV2TestJSON-782143794-project] Getting quotas for user 79db3ccc38804a7dba7b70f3779a87aa and project 5ca04a26e2e64a119b83e442d48f3dff. Resources: {'key_pairs'} {{(pid=129410) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:50:36.702184 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_cell1:SELECT=68 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:50:36.753500 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-9773d79d-2c6c-44b9-a3ff-e9763587b1fe tempest-KeyPairsV2TestJSON-782143794 tempest-KeyPairsV2TestJSON-782143794-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.233097 Aug 10 17:50:36.754371 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 205/402] 10.222.0.50 () {60 vars in 1159 bytes} [Wed Aug 10 17:50:36 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:50:36.764202 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_cell1:SELECT=77,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:50:36.768515 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-2d79c12a-0986-4182-9916-cc70c03adddb tempest-KeyPairsV2TestJSON-782143794 tempest-KeyPairsV2TestJSON-782143794-project] Action: 'create', calling method: .version_select at 0x7fb346806790>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-842475492", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCkxgWc3yg1LbYyx6DFbqNJNTKkokK0pTWrjrFW+WvbhRhGRYjeqBMiWHSLexthr3+crqWCAK10sCumCXOaZUIwyd8jRBFsxMTfTjMpmQDQuf3iLou5FlnVaOJFuta05Kg=="}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:50:36.784530 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-2d79c12a-0986-4182-9916-cc70c03adddb tempest-KeyPairsV2TestJSON-782143794 tempest-KeyPairsV2TestJSON-782143794-project] Getting quotas for project 5ca04a26e2e64a119b83e442d48f3dff. Resources: {'key_pairs'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:50:36.790011 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-2d79c12a-0986-4182-9916-cc70c03adddb tempest-KeyPairsV2TestJSON-782143794 tempest-KeyPairsV2TestJSON-782143794-project] Getting quotas for user 79db3ccc38804a7dba7b70f3779a87aa and project 5ca04a26e2e64a119b83e442d48f3dff. Resources: {'key_pairs'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:50:36.973276 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-2d79c12a-0986-4182-9916-cc70c03adddb tempest-KeyPairsV2TestJSON-782143794 tempest-KeyPairsV2TestJSON-782143794-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.209613 Aug 10 17:50:36.973901 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 198/403] 10.222.0.50 () {60 vars in 1159 bytes} [Wed Aug 10 17:50:36 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:50:36.999868 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-f58b130e-aa2a-41f2-8492-153643e6b5b1 tempest-KeyPairsV2TestJSON-782143794 tempest-KeyPairsV2TestJSON-782143794-project] Action: 'create', calling method: .version_select at 0x7fb3465e4940>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-594038087", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBELXONJzkvwmcEYhOt92wNYrPQv4krwIhiuc7UFp2ff6FO/7SPsA3nMnZfx9x7HkqieSUg/j3Jzl/PBXqQ/DRLFWiPP60/IXsn1X0yimz0ixwHTM71LhUDV4lNEe+Av3jg=="}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:50:37.015340 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.quota [None req-f58b130e-aa2a-41f2-8492-153643e6b5b1 tempest-KeyPairsV2TestJSON-782143794 tempest-KeyPairsV2TestJSON-782143794-project] Getting quotas for project 5ca04a26e2e64a119b83e442d48f3dff. Resources: {'key_pairs'} {{(pid=129410) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:50:37.019634 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.quota [None req-f58b130e-aa2a-41f2-8492-153643e6b5b1 tempest-KeyPairsV2TestJSON-782143794 tempest-KeyPairsV2TestJSON-782143794-project] Getting quotas for user 79db3ccc38804a7dba7b70f3779a87aa and project 5ca04a26e2e64a119b83e442d48f3dff. Resources: {'key_pairs'} {{(pid=129410) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:50:37.148165 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-f58b130e-aa2a-41f2-8492-153643e6b5b1 tempest-KeyPairsV2TestJSON-782143794 tempest-KeyPairsV2TestJSON-782143794-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.152305 Aug 10 17:50:37.148796 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 206/404] 10.222.0.50 () {60 vars in 1159 bytes} [Wed Aug 10 17:50:36 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:50:37.158969 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-067081da-b731-4045-a85c-880cb4350379 tempest-KeyPairsV2TestJSON-782143794 tempest-KeyPairsV2TestJSON-782143794-project] Calling method '.version_select at 0x7fb3467cdc10>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:50:37.163347 n-d-852296-2 devstack@n-api.service[129409]: WARNING oslo_db.sqlalchemy.utils [None req-067081da-b731-4045-a85c-880cb4350379 tempest-KeyPairsV2TestJSON-782143794 tempest-KeyPairsV2TestJSON-782143794-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 10 17:50:37.170255 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-067081da-b731-4045-a85c-880cb4350379 tempest-KeyPairsV2TestJSON-782143794 tempest-KeyPairsV2TestJSON-782143794-project] 10.222.0.50 "GET /compute/v2.1/os-keypairs" status: 200 len: 1091 microversion: 2.1 time: 0.015179 Aug 10 17:50:37.170817 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 199/405] 10.222.0.50 () {58 vars in 1137 bytes} [Wed Aug 10 17:50:37 2022] GET /compute/v2.1/os-keypairs => generated 1091 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:50:37.191436 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-b687cdb0-6e13-457a-8d13-9dca3e5d5e4d tempest-KeyPairsV2TestJSON-782143794 tempest-KeyPairsV2TestJSON-782143794-project] Calling method '.version_select at 0x7fb34688d3a0>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:50:37.423533 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-b687cdb0-6e13-457a-8d13-9dca3e5d5e4d tempest-KeyPairsV2TestJSON-782143794 tempest-KeyPairsV2TestJSON-782143794-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-594038087" status: 202 len: 0 microversion: 2.1 time: 0.235960 Aug 10 17:50:37.424756 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 207/406] 10.222.0.50 () {58 vars in 1275 bytes} [Wed Aug 10 17:50:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-594038087 => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 17:50:37.440210 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-171233c6-db92-43e0-a5e1-3b6422240488 tempest-KeyPairsV2TestJSON-782143794 tempest-KeyPairsV2TestJSON-782143794-project] Calling method '.version_select at 0x7fb346711940>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:50:37.572873 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-171233c6-db92-43e0-a5e1-3b6422240488 tempest-KeyPairsV2TestJSON-782143794 tempest-KeyPairsV2TestJSON-782143794-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-842475492" status: 202 len: 0 microversion: 2.1 time: 0.137725 Aug 10 17:50:37.572873 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 200/407] 10.222.0.50 () {58 vars in 1275 bytes} [Wed Aug 10 17:50:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-842475492 => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 17:50:37.579928 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-33b64907-6b17-4396-8246-75a820029cf8 tempest-KeyPairsV2TestJSON-782143794 tempest-KeyPairsV2TestJSON-782143794-project] Calling method '.version_select at 0x7fb346601dc0>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:50:37.930801 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-33b64907-6b17-4396-8246-75a820029cf8 tempest-KeyPairsV2TestJSON-782143794 tempest-KeyPairsV2TestJSON-782143794-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-216766894" status: 202 len: 0 microversion: 2.1 time: 0.354882 Aug 10 17:50:37.931405 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 208/408] 10.222.0.50 () {58 vars in 1275 bytes} [Wed Aug 10 17:50:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-216766894 => generated 0 bytes in 356 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 17:50:38.809127 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-51bc9f2e-9337-4f07-9ffc-8f925207a744 tempest-HostsAdminNegativeTestJSON-1158414051 tempest-HostsAdminNegativeTestJSON-1158414051-project-admin] Calling method '.version_select at 0x7fb3467114c0>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:50:38.811486 n-d-852296-2 devstack@n-api.service[129409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:50:38.811486 n-d-852296-2 devstack@n-api.service[129409]: warnings.warn(msg) Aug 10 17:50:38.812566 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-51bc9f2e-9337-4f07-9ffc-8f925207a744 tempest-HostsAdminNegativeTestJSON-1158414051 tempest-HostsAdminNegativeTestJSON-1158414051-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:38.813053 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-51bc9f2e-9337-4f07-9ffc-8f925207a744 tempest-HostsAdminNegativeTestJSON-1158414051 tempest-HostsAdminNegativeTestJSON-1158414051-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:38.813490 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-51bc9f2e-9337-4f07-9ffc-8f925207a744 tempest-HostsAdminNegativeTestJSON-1158414051 tempest-HostsAdminNegativeTestJSON-1158414051-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:38.814285 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-51bc9f2e-9337-4f07-9ffc-8f925207a744 tempest-HostsAdminNegativeTestJSON-1158414051 tempest-HostsAdminNegativeTestJSON-1158414051-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:38.814793 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-51bc9f2e-9337-4f07-9ffc-8f925207a744 tempest-HostsAdminNegativeTestJSON-1158414051 tempest-HostsAdminNegativeTestJSON-1158414051-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:38.815296 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-51bc9f2e-9337-4f07-9ffc-8f925207a744 tempest-HostsAdminNegativeTestJSON-1158414051 tempest-HostsAdminNegativeTestJSON-1158414051-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:38.840319 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-51bc9f2e-9337-4f07-9ffc-8f925207a744 tempest-HostsAdminNegativeTestJSON-1158414051 tempest-HostsAdminNegativeTestJSON-1158414051-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.776995 Aug 10 17:50:38.841339 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 201/409] 10.222.0.50 () {58 vars in 1128 bytes} [Wed Aug 10 17:50:38 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:50:39.115632 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-52037cbf-7a5e-4eee-8c5b-8b8141a686f2 tempest-HypervisorAdminTestJSON-1477577370 tempest-HypervisorAdminTestJSON-1477577370-project-admin] Calling method '.version_select at 0x7fb3465ef940>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:50:39.116562 n-d-852296-2 devstack@n-api.service[129410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:50:39.116562 n-d-852296-2 devstack@n-api.service[129410]: warnings.warn(msg) Aug 10 17:50:39.117659 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-52037cbf-7a5e-4eee-8c5b-8b8141a686f2 tempest-HypervisorAdminTestJSON-1477577370 tempest-HypervisorAdminTestJSON-1477577370-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:39.118132 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-52037cbf-7a5e-4eee-8c5b-8b8141a686f2 tempest-HypervisorAdminTestJSON-1477577370 tempest-HypervisorAdminTestJSON-1477577370-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:39.118558 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-52037cbf-7a5e-4eee-8c5b-8b8141a686f2 tempest-HypervisorAdminTestJSON-1477577370 tempest-HypervisorAdminTestJSON-1477577370-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:39.137873 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-52037cbf-7a5e-4eee-8c5b-8b8141a686f2 tempest-HypervisorAdminTestJSON-1477577370 tempest-HypervisorAdminTestJSON-1477577370-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:39.137873 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-52037cbf-7a5e-4eee-8c5b-8b8141a686f2 tempest-HypervisorAdminTestJSON-1477577370 tempest-HypervisorAdminTestJSON-1477577370-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:39.137873 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-52037cbf-7a5e-4eee-8c5b-8b8141a686f2 tempest-HypervisorAdminTestJSON-1477577370 tempest-HypervisorAdminTestJSON-1477577370-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:39.144568 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-52037cbf-7a5e-4eee-8c5b-8b8141a686f2 tempest-HypervisorAdminTestJSON-1477577370 tempest-HypervisorAdminTestJSON-1477577370-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:39.145113 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-52037cbf-7a5e-4eee-8c5b-8b8141a686f2 tempest-HypervisorAdminTestJSON-1477577370 tempest-HypervisorAdminTestJSON-1477577370-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:39.145537 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-52037cbf-7a5e-4eee-8c5b-8b8141a686f2 tempest-HypervisorAdminTestJSON-1477577370 tempest-HypervisorAdminTestJSON-1477577370-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:39.152002 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-52037cbf-7a5e-4eee-8c5b-8b8141a686f2 tempest-HypervisorAdminTestJSON-1477577370 tempest-HypervisorAdminTestJSON-1477577370-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.784914 Aug 10 17:50:39.152928 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 209/410] 10.222.0.50 () {58 vars in 1146 bytes} [Wed Aug 10 17:50:38 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:50:39.164765 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-749271af-b4aa-4780-8598-450ce074e318 tempest-HypervisorAdminTestJSON-1477577370 tempest-HypervisorAdminTestJSON-1477577370-project-admin] Calling method '.version_select at 0x7fb3465ef700>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:50:39.165571 n-d-852296-2 devstack@n-api.service[129410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:50:39.165571 n-d-852296-2 devstack@n-api.service[129410]: warnings.warn(msg) Aug 10 17:50:39.167008 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-749271af-b4aa-4780-8598-450ce074e318 tempest-HypervisorAdminTestJSON-1477577370 tempest-HypervisorAdminTestJSON-1477577370-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:39.167123 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-749271af-b4aa-4780-8598-450ce074e318 tempest-HypervisorAdminTestJSON-1477577370 tempest-HypervisorAdminTestJSON-1477577370-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:39.167553 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-749271af-b4aa-4780-8598-450ce074e318 tempest-HypervisorAdminTestJSON-1477577370 tempest-HypervisorAdminTestJSON-1477577370-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:39.181729 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-749271af-b4aa-4780-8598-450ce074e318 tempest-HypervisorAdminTestJSON-1477577370 tempest-HypervisorAdminTestJSON-1477577370-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:39.182206 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-749271af-b4aa-4780-8598-450ce074e318 tempest-HypervisorAdminTestJSON-1477577370 tempest-HypervisorAdminTestJSON-1477577370-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:39.182644 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-749271af-b4aa-4780-8598-450ce074e318 tempest-HypervisorAdminTestJSON-1477577370 tempest-HypervisorAdminTestJSON-1477577370-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:39.193346 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-749271af-b4aa-4780-8598-450ce074e318 tempest-HypervisorAdminTestJSON-1477577370 tempest-HypervisorAdminTestJSON-1477577370-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:39.194189 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-749271af-b4aa-4780-8598-450ce074e318 tempest-HypervisorAdminTestJSON-1477577370 tempest-HypervisorAdminTestJSON-1477577370-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:39.194634 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-749271af-b4aa-4780-8598-450ce074e318 tempest-HypervisorAdminTestJSON-1477577370 tempest-HypervisorAdminTestJSON-1477577370-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:39.201158 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-749271af-b4aa-4780-8598-450ce074e318 tempest-HypervisorAdminTestJSON-1477577370 tempest-HypervisorAdminTestJSON-1477577370-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 0.041090 Aug 10 17:50:39.201750 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 210/411] 10.222.0.50 () {58 vars in 1167 bytes} [Wed Aug 10 17:50:39 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:50:39.218223 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-6d81e814-3aed-4f61-b24c-1532b472597c tempest-HypervisorAdminTestJSON-1477577370 tempest-HypervisorAdminTestJSON-1477577370-project-admin] Calling method '.version_select at 0x7fb3465ef550>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:50:39.219030 n-d-852296-2 devstack@n-api.service[129410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:50:39.219030 n-d-852296-2 devstack@n-api.service[129410]: warnings.warn(msg) Aug 10 17:50:39.220095 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-6d81e814-3aed-4f61-b24c-1532b472597c tempest-HypervisorAdminTestJSON-1477577370 tempest-HypervisorAdminTestJSON-1477577370-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:39.220604 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-6d81e814-3aed-4f61-b24c-1532b472597c tempest-HypervisorAdminTestJSON-1477577370 tempest-HypervisorAdminTestJSON-1477577370-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:39.221052 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-6d81e814-3aed-4f61-b24c-1532b472597c tempest-HypervisorAdminTestJSON-1477577370 tempest-HypervisorAdminTestJSON-1477577370-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:39.235029 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-6d81e814-3aed-4f61-b24c-1532b472597c tempest-HypervisorAdminTestJSON-1477577370 tempest-HypervisorAdminTestJSON-1477577370-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:39.236596 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-6d81e814-3aed-4f61-b24c-1532b472597c tempest-HypervisorAdminTestJSON-1477577370 tempest-HypervisorAdminTestJSON-1477577370-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:39.237132 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-6d81e814-3aed-4f61-b24c-1532b472597c tempest-HypervisorAdminTestJSON-1477577370 tempest-HypervisorAdminTestJSON-1477577370-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:39.249282 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-6d81e814-3aed-4f61-b24c-1532b472597c tempest-HypervisorAdminTestJSON-1477577370 tempest-HypervisorAdminTestJSON-1477577370-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:39.249806 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-6d81e814-3aed-4f61-b24c-1532b472597c tempest-HypervisorAdminTestJSON-1477577370 tempest-HypervisorAdminTestJSON-1477577370-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:39.250250 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-6d81e814-3aed-4f61-b24c-1532b472597c tempest-HypervisorAdminTestJSON-1477577370 tempest-HypervisorAdminTestJSON-1477577370-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:39.257438 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-6d81e814-3aed-4f61-b24c-1532b472597c tempest-HypervisorAdminTestJSON-1477577370 tempest-HypervisorAdminTestJSON-1477577370-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.042767 Aug 10 17:50:39.258030 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 211/412] 10.222.0.50 () {58 vars in 1146 bytes} [Wed Aug 10 17:50:39 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:50:39.268336 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-163f24d1-d662-4343-a11c-d188d2dab8e0 tempest-HypervisorAdminTestJSON-1477577370 tempest-HypervisorAdminTestJSON-1477577370-project-admin] Calling method '.version_select at 0x7fb3465ef820>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:50:39.269132 n-d-852296-2 devstack@n-api.service[129410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:50:39.269132 n-d-852296-2 devstack@n-api.service[129410]: warnings.warn(msg) Aug 10 17:50:39.270236 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-163f24d1-d662-4343-a11c-d188d2dab8e0 tempest-HypervisorAdminTestJSON-1477577370 tempest-HypervisorAdminTestJSON-1477577370-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:39.270778 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-163f24d1-d662-4343-a11c-d188d2dab8e0 tempest-HypervisorAdminTestJSON-1477577370 tempest-HypervisorAdminTestJSON-1477577370-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:39.271782 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-163f24d1-d662-4343-a11c-d188d2dab8e0 tempest-HypervisorAdminTestJSON-1477577370 tempest-HypervisorAdminTestJSON-1477577370-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:39.288556 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-163f24d1-d662-4343-a11c-d188d2dab8e0 tempest-HypervisorAdminTestJSON-1477577370 tempest-HypervisorAdminTestJSON-1477577370-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:39.289134 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-163f24d1-d662-4343-a11c-d188d2dab8e0 tempest-HypervisorAdminTestJSON-1477577370 tempest-HypervisorAdminTestJSON-1477577370-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:39.289542 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-163f24d1-d662-4343-a11c-d188d2dab8e0 tempest-HypervisorAdminTestJSON-1477577370 tempest-HypervisorAdminTestJSON-1477577370-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:39.295668 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-163f24d1-d662-4343-a11c-d188d2dab8e0 tempest-HypervisorAdminTestJSON-1477577370 tempest-HypervisorAdminTestJSON-1477577370-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 757 microversion: 2.1 time: 0.031160 Aug 10 17:50:39.300763 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 212/413] 10.222.0.50 () {58 vars in 1152 bytes} [Wed Aug 10 17:50:39 2022] GET /compute/v2.1/os-hypervisors/1 => generated 757 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:50:39.310508 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-13d9739f-4f4a-4384-8e41-d380d34f7936 tempest-HypervisorAdminTestJSON-1477577370 tempest-HypervisorAdminTestJSON-1477577370-project-admin] Calling method '.version_select at 0x7fb3465efdc0>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:50:39.311330 n-d-852296-2 devstack@n-api.service[129410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:50:39.311330 n-d-852296-2 devstack@n-api.service[129410]: warnings.warn(msg) Aug 10 17:50:39.312379 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-13d9739f-4f4a-4384-8e41-d380d34f7936 tempest-HypervisorAdminTestJSON-1477577370 tempest-HypervisorAdminTestJSON-1477577370-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:39.312857 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-13d9739f-4f4a-4384-8e41-d380d34f7936 tempest-HypervisorAdminTestJSON-1477577370 tempest-HypervisorAdminTestJSON-1477577370-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:39.313292 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-13d9739f-4f4a-4384-8e41-d380d34f7936 tempest-HypervisorAdminTestJSON-1477577370 tempest-HypervisorAdminTestJSON-1477577370-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:39.332507 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-13d9739f-4f4a-4384-8e41-d380d34f7936 tempest-HypervisorAdminTestJSON-1477577370 tempest-HypervisorAdminTestJSON-1477577370-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.025501 Aug 10 17:50:39.333124 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 213/414] 10.222.0.50 () {58 vars in 1179 bytes} [Wed Aug 10 17:50:39 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:50:39.347214 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-6655d8ff-403b-47db-89aa-c051c0f76979 tempest-HypervisorAdminTestJSON-1477577370 tempest-HypervisorAdminTestJSON-1477577370-project-admin] Calling method '.version_select at 0x7fb3465ef040>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:50:39.348041 n-d-852296-2 devstack@n-api.service[129410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:50:39.348041 n-d-852296-2 devstack@n-api.service[129410]: warnings.warn(msg) Aug 10 17:50:39.349190 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-6655d8ff-403b-47db-89aa-c051c0f76979 tempest-HypervisorAdminTestJSON-1477577370 tempest-HypervisorAdminTestJSON-1477577370-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:39.349663 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-6655d8ff-403b-47db-89aa-c051c0f76979 tempest-HypervisorAdminTestJSON-1477577370 tempest-HypervisorAdminTestJSON-1477577370-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:39.350096 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-6655d8ff-403b-47db-89aa-c051c0f76979 tempest-HypervisorAdminTestJSON-1477577370 tempest-HypervisorAdminTestJSON-1477577370-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:39.363743 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-6655d8ff-403b-47db-89aa-c051c0f76979 tempest-HypervisorAdminTestJSON-1477577370 tempest-HypervisorAdminTestJSON-1477577370-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:39.364214 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-6655d8ff-403b-47db-89aa-c051c0f76979 tempest-HypervisorAdminTestJSON-1477577370 tempest-HypervisorAdminTestJSON-1477577370-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:39.365280 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-6655d8ff-403b-47db-89aa-c051c0f76979 tempest-HypervisorAdminTestJSON-1477577370 tempest-HypervisorAdminTestJSON-1477577370-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:39.375287 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-6655d8ff-403b-47db-89aa-c051c0f76979 tempest-HypervisorAdminTestJSON-1477577370 tempest-HypervisorAdminTestJSON-1477577370-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:39.375823 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-6655d8ff-403b-47db-89aa-c051c0f76979 tempest-HypervisorAdminTestJSON-1477577370 tempest-HypervisorAdminTestJSON-1477577370-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:39.376401 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-6655d8ff-403b-47db-89aa-c051c0f76979 tempest-HypervisorAdminTestJSON-1477577370 tempest-HypervisorAdminTestJSON-1477577370-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:39.383184 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-6655d8ff-403b-47db-89aa-c051c0f76979 tempest-HypervisorAdminTestJSON-1477577370 tempest-HypervisorAdminTestJSON-1477577370-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.040945 Aug 10 17:50:39.383773 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 214/415] 10.222.0.50 () {58 vars in 1146 bytes} [Wed Aug 10 17:50:39 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:50:39.393648 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-66d6454e-320a-4211-ab03-8a647f164807 tempest-HypervisorAdminTestJSON-1477577370 tempest-HypervisorAdminTestJSON-1477577370-project-admin] Calling method '.version_select at 0x7fb3465ef9d0>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:50:39.394439 n-d-852296-2 devstack@n-api.service[129410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:50:39.394439 n-d-852296-2 devstack@n-api.service[129410]: warnings.warn(msg) Aug 10 17:50:39.395508 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-66d6454e-320a-4211-ab03-8a647f164807 tempest-HypervisorAdminTestJSON-1477577370 tempest-HypervisorAdminTestJSON-1477577370-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:39.396173 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-66d6454e-320a-4211-ab03-8a647f164807 tempest-HypervisorAdminTestJSON-1477577370 tempest-HypervisorAdminTestJSON-1477577370-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:39.396773 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-66d6454e-320a-4211-ab03-8a647f164807 tempest-HypervisorAdminTestJSON-1477577370 tempest-HypervisorAdminTestJSON-1477577370-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:39.409460 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-66d6454e-320a-4211-ab03-8a647f164807 tempest-HypervisorAdminTestJSON-1477577370 tempest-HypervisorAdminTestJSON-1477577370-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:39.409934 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-66d6454e-320a-4211-ab03-8a647f164807 tempest-HypervisorAdminTestJSON-1477577370 tempest-HypervisorAdminTestJSON-1477577370-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:39.410365 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-66d6454e-320a-4211-ab03-8a647f164807 tempest-HypervisorAdminTestJSON-1477577370 tempest-HypervisorAdminTestJSON-1477577370-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:39.416890 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-66d6454e-320a-4211-ab03-8a647f164807 tempest-HypervisorAdminTestJSON-1477577370 tempest-HypervisorAdminTestJSON-1477577370-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 757 microversion: 2.1 time: 0.026669 Aug 10 17:50:39.418134 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 215/416] 10.222.0.50 () {58 vars in 1152 bytes} [Wed Aug 10 17:50:39 2022] GET /compute/v2.1/os-hypervisors/1 => generated 757 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:50:39.431653 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-cc09bbbf-8aff-45fd-9b6d-9250cc6f9049 tempest-HypervisorAdminTestJSON-1477577370 tempest-HypervisorAdminTestJSON-1477577370-project-admin] Calling method '.version_select at 0x7fb3465ef0d0>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:50:39.432504 n-d-852296-2 devstack@n-api.service[129410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:50:39.432504 n-d-852296-2 devstack@n-api.service[129410]: warnings.warn(msg) Aug 10 17:50:39.433573 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-cc09bbbf-8aff-45fd-9b6d-9250cc6f9049 tempest-HypervisorAdminTestJSON-1477577370 tempest-HypervisorAdminTestJSON-1477577370-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:39.434042 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-cc09bbbf-8aff-45fd-9b6d-9250cc6f9049 tempest-HypervisorAdminTestJSON-1477577370 tempest-HypervisorAdminTestJSON-1477577370-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:39.434473 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-cc09bbbf-8aff-45fd-9b6d-9250cc6f9049 tempest-HypervisorAdminTestJSON-1477577370 tempest-HypervisorAdminTestJSON-1477577370-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:39.448598 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-cc09bbbf-8aff-45fd-9b6d-9250cc6f9049 tempest-HypervisorAdminTestJSON-1477577370 tempest-HypervisorAdminTestJSON-1477577370-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:39.449158 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-cc09bbbf-8aff-45fd-9b6d-9250cc6f9049 tempest-HypervisorAdminTestJSON-1477577370 tempest-HypervisorAdminTestJSON-1477577370-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:39.449659 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-cc09bbbf-8aff-45fd-9b6d-9250cc6f9049 tempest-HypervisorAdminTestJSON-1477577370 tempest-HypervisorAdminTestJSON-1477577370-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:39.455760 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-cc09bbbf-8aff-45fd-9b6d-9250cc6f9049 tempest-HypervisorAdminTestJSON-1477577370 tempest-HypervisorAdminTestJSON-1477577370-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 757 microversion: 2.1 time: 0.028355 Aug 10 17:50:39.456381 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 216/417] 10.222.0.50 () {58 vars in 1152 bytes} [Wed Aug 10 17:50:39 2022] GET /compute/v2.1/os-hypervisors/2 => generated 757 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:50:39.487919 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-3ddfe396-4391-49b7-90e5-d72390bc9fac tempest-HypervisorAdminTestJSON-1477577370 tempest-HypervisorAdminTestJSON-1477577370-project-admin] Calling method '.version_select at 0x7fb3465ef4c0>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:50:39.488735 n-d-852296-2 devstack@n-api.service[129410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:50:39.488735 n-d-852296-2 devstack@n-api.service[129410]: warnings.warn(msg) Aug 10 17:50:39.490402 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-3ddfe396-4391-49b7-90e5-d72390bc9fac tempest-HypervisorAdminTestJSON-1477577370 tempest-HypervisorAdminTestJSON-1477577370-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:39.490880 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-3ddfe396-4391-49b7-90e5-d72390bc9fac tempest-HypervisorAdminTestJSON-1477577370 tempest-HypervisorAdminTestJSON-1477577370-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:39.491315 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-3ddfe396-4391-49b7-90e5-d72390bc9fac tempest-HypervisorAdminTestJSON-1477577370 tempest-HypervisorAdminTestJSON-1477577370-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:39.503540 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-3ddfe396-4391-49b7-90e5-d72390bc9fac tempest-HypervisorAdminTestJSON-1477577370 tempest-HypervisorAdminTestJSON-1477577370-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:39.504011 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-3ddfe396-4391-49b7-90e5-d72390bc9fac tempest-HypervisorAdminTestJSON-1477577370 tempest-HypervisorAdminTestJSON-1477577370-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:39.504500 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-3ddfe396-4391-49b7-90e5-d72390bc9fac tempest-HypervisorAdminTestJSON-1477577370 tempest-HypervisorAdminTestJSON-1477577370-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:39.516476 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-3ddfe396-4391-49b7-90e5-d72390bc9fac tempest-HypervisorAdminTestJSON-1477577370 tempest-HypervisorAdminTestJSON-1477577370-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:39.517121 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-3ddfe396-4391-49b7-90e5-d72390bc9fac tempest-HypervisorAdminTestJSON-1477577370 tempest-HypervisorAdminTestJSON-1477577370-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:39.517406 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-3ddfe396-4391-49b7-90e5-d72390bc9fac tempest-HypervisorAdminTestJSON-1477577370 tempest-HypervisorAdminTestJSON-1477577370-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:39.545871 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-3ddfe396-4391-49b7-90e5-d72390bc9fac tempest-HypervisorAdminTestJSON-1477577370 tempest-HypervisorAdminTestJSON-1477577370-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.061399 Aug 10 17:50:39.554331 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 217/418] 10.222.0.50 () {58 vars in 1173 bytes} [Wed Aug 10 17:50:39 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:50:39.617401 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-5bd0ca5b-9e95-44b1-a31d-43afed80e41f tempest-HostsAdminNegativeTestJSON-95265963 tempest-HostsAdminNegativeTestJSON-95265963-project] Calling method '.version_select at 0x7fb3467f8d30>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:50:39.619684 n-d-852296-2 devstack@n-api.service[129409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:50:39.619684 n-d-852296-2 devstack@n-api.service[129409]: warnings.warn(msg) Aug 10 17:50:39.620794 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-5bd0ca5b-9e95-44b1-a31d-43afed80e41f tempest-HostsAdminNegativeTestJSON-95265963 tempest-HostsAdminNegativeTestJSON-95265963-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '54adccdf83f84f4f87f8aea8b644acda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f65a4a8e86d44a684ff77fb9dd29207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:50:39.622596 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-5bd0ca5b-9e95-44b1-a31d-43afed80e41f tempest-HostsAdminNegativeTestJSON-95265963 tempest-HostsAdminNegativeTestJSON-95265963-project] Request method failure captured: Aug 10 17:50:39.622596 n-d-852296-2 devstack@n-api.service[129409]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Aug 10 17:50:39.622596 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 17:50:39.622596 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 17:50:39.622596 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 17:50:39.622596 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 0 Aug 10 17:50:39.622596 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 17:50:39.622596 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 17:50:39.622596 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 17:50:39.622596 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 17:50:39.622596 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8-_p9Eft5ylIdHjJKBEp1wM3tSnwzpcnutThUaV9oMhctgwbYrNnFyVMuEJnK_Zi1wikQO-_mA6-kQor-fJ6SurGRGuiKhUz1Gbe5gZMnKZrNNyi0lKehhNILuJirAiCzpTsNWgLBRfZJWlqfX6A2-Il8TH-mfqw7FmcvWGekIctm-Y Aug 10 17:50:39.622596 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 17:50:39.622596 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 17:50:39.622596 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 17:50:39.622596 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 17:50:39.622596 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 17:50:39.622596 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 17:50:39.622596 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: 2f65a4a8e86d44a684ff77fb9dd29207 Aug 10 17:50:39.622596 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-95265963 Aug 10 17:50:39.622596 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 17:50:39.622596 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 17:50:39.624191 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2f65a4a8e86d44a684ff77fb9dd29207"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/2f65a4a8e86d44a684ff77fb9dd29207"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2f65a4a8e86d44a684ff77fb9dd29207"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_2f65a4a8e86d44a684ff77fb9dd29207", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:50:39.624191 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-HostsAdminNegativeTestJSON-95265963 Aug 10 17:50:39.624191 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: 2f65a4a8e86d44a684ff77fb9dd29207 Aug 10 17:50:39.624191 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-95265963 Aug 10 17:50:39.624191 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-HostsAdminNegativeTestJSON-95265963-project Aug 10 17:50:39.624191 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 17:50:39.624191 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 17:50:39.624191 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: 54adccdf83f84f4f87f8aea8b644acda Aug 10 17:50:39.624191 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-HostsAdminNegativeTestJSON-95265963-project Aug 10 17:50:39.624191 n-d-852296-2 devstack@n-api.service[129409]: method: Aug 10 17:50:39.624191 n-d-852296-2 devstack@n-api.service[129409]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Aug 10 17:50:39.624191 n-d-852296-2 devstack@n-api.service[129409]: action_args: {} Aug 10 17:50:39.624191 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:50:39.625210 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:39.625210 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:50:39.625210 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:50:39.625210 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:50:39.625210 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:50:39.625210 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 17:50:39.625210 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 17:50:39.625210 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 10 17:50:39.625210 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:50:39.625210 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:50:39.625210 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:50:39.625210 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Aug 10 17:50:39.625210 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Aug 10 17:50:39.625210 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 10 17:50:39.625210 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 10 17:50:39.625210 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 10 17:50:39.625210 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 10 17:50:39.625210 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 10 17:50:39.625210 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 10 17:50:39.626552 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 10 17:50:39.626552 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise self.value Aug 10 17:50:39.626552 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 10 17:50:39.626552 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 10 17:50:39.626552 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 10 17:50:39.626552 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 10 17:50:39.626552 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 10 17:50:39.626552 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 10 17:50:39.626552 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Aug 10 17:50:39.626552 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:50:39.626552 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:50:39.626552 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:50:39.626552 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:39.626552 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:50:39.626552 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:50:39.626552 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 10 17:50:39.626552 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 10 17:50:39.626552 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Aug 10 17:50:39.626552 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:50:39.627962 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-5bd0ca5b-9e95-44b1-a31d-43afed80e41f tempest-HostsAdminNegativeTestJSON-95265963 tempest-HostsAdminNegativeTestJSON-95265963-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:50:39.627962 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-5bd0ca5b-9e95-44b1-a31d-43afed80e41f tempest-HostsAdminNegativeTestJSON-95265963 tempest-HostsAdminNegativeTestJSON-95265963-project] 10.222.0.50 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.775875 Aug 10 17:50:39.627962 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 202/419] 10.222.0.50 () {58 vars in 1128 bytes} [Wed Aug 10 17:50:38 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 777 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 10 17:50:39.634602 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-65e483a6-7532-4223-a2d0-cff55af41c98 tempest-HostsAdminNegativeTestJSON-95265963 tempest-HostsAdminNegativeTestJSON-95265963-project] Calling method '.version_select at 0x7fb34688d3a0>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:50:39.635638 n-d-852296-2 devstack@n-api.service[129410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:50:39.635638 n-d-852296-2 devstack@n-api.service[129410]: warnings.warn(msg) Aug 10 17:50:39.637077 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-65e483a6-7532-4223-a2d0-cff55af41c98 tempest-HostsAdminNegativeTestJSON-95265963 tempest-HostsAdminNegativeTestJSON-95265963-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '54adccdf83f84f4f87f8aea8b644acda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f65a4a8e86d44a684ff77fb9dd29207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:50:39.639439 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-65e483a6-7532-4223-a2d0-cff55af41c98 tempest-HostsAdminNegativeTestJSON-95265963 tempest-HostsAdminNegativeTestJSON-95265963-project] Request method failure captured: Aug 10 17:50:39.639439 n-d-852296-2 devstack@n-api.service[129410]: request: GET /compute/v2.1/os-hosts/n-d-852296-2/reboot HTTP/1.1 Aug 10 17:50:39.639439 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 17:50:39.639439 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 17:50:39.639439 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 17:50:39.639439 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 0 Aug 10 17:50:39.639439 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 17:50:39.639439 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 17:50:39.639439 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 17:50:39.639439 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 17:50:39.639439 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8-_p9Eft5ylIdHjJKBEp1wM3tSnwzpcnutThUaV9oMhctgwbYrNnFyVMuEJnK_Zi1wikQO-_mA6-kQor-fJ6SurGRGuiKhUz1Gbe5gZMnKZrNNyi0lKehhNILuJirAiCzpTsNWgLBRfZJWlqfX6A2-Il8TH-mfqw7FmcvWGekIctm-Y Aug 10 17:50:39.639439 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 17:50:39.639439 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 17:50:39.639439 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 17:50:39.639439 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 17:50:39.639439 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 17:50:39.639439 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 17:50:39.639439 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: 2f65a4a8e86d44a684ff77fb9dd29207 Aug 10 17:50:39.639439 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-95265963 Aug 10 17:50:39.639439 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 17:50:39.639439 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 17:50:39.641023 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2f65a4a8e86d44a684ff77fb9dd29207"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/2f65a4a8e86d44a684ff77fb9dd29207"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2f65a4a8e86d44a684ff77fb9dd29207"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_2f65a4a8e86d44a684ff77fb9dd29207", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:50:39.641023 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-HostsAdminNegativeTestJSON-95265963 Aug 10 17:50:39.641023 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: 2f65a4a8e86d44a684ff77fb9dd29207 Aug 10 17:50:39.641023 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-95265963 Aug 10 17:50:39.641023 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-HostsAdminNegativeTestJSON-95265963-project Aug 10 17:50:39.641023 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 17:50:39.641023 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 17:50:39.641023 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: 54adccdf83f84f4f87f8aea8b644acda Aug 10 17:50:39.641023 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-HostsAdminNegativeTestJSON-95265963-project Aug 10 17:50:39.641023 n-d-852296-2 devstack@n-api.service[129410]: method: Aug 10 17:50:39.641023 n-d-852296-2 devstack@n-api.service[129410]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Aug 10 17:50:39.641023 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'id': 'n-d-852296-2'} Aug 10 17:50:39.641023 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:50:39.642033 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:39.642033 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:50:39.642033 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:50:39.642033 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:50:39.642033 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:50:39.642033 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 17:50:39.642033 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 17:50:39.642033 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:50:39.642033 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:50:39.642033 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Aug 10 17:50:39.642033 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Aug 10 17:50:39.642033 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 10 17:50:39.642033 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 10 17:50:39.642033 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 10 17:50:39.642033 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 10 17:50:39.642033 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 10 17:50:39.642033 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 10 17:50:39.642033 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 10 17:50:39.642033 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise self.value Aug 10 17:50:39.643281 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 10 17:50:39.643281 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 10 17:50:39.643281 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 10 17:50:39.643281 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 10 17:50:39.643281 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 10 17:50:39.643281 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 10 17:50:39.643281 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Aug 10 17:50:39.643281 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:39.643281 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:50:39.643281 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:39.643281 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:39.643281 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:50:39.643281 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:50:39.643281 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 10 17:50:39.643281 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 10 17:50:39.643281 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Aug 10 17:50:39.643281 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:39.644287 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-65e483a6-7532-4223-a2d0-cff55af41c98 tempest-HostsAdminNegativeTestJSON-95265963 tempest-HostsAdminNegativeTestJSON-95265963-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:50:39.644287 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-65e483a6-7532-4223-a2d0-cff55af41c98 tempest-HostsAdminNegativeTestJSON-95265963 tempest-HostsAdminNegativeTestJSON-95265963-project] 10.222.0.50 "GET /compute/v2.1/os-hosts/n-d-852296-2/reboot" status: 403 len: 111 microversion: 2.1 time: 0.012089 Aug 10 17:50:39.644287 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 218/420] 10.222.0.50 () {58 vars in 1188 bytes} [Wed Aug 10 17:50:39 2022] GET /compute/v2.1/os-hosts/n-d-852296-2/reboot => generated 111 bytes in 13 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:50:39.657755 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-58dd2762-d9f8-4f44-95b8-d0d7f35da9e6 tempest-HostsAdminNegativeTestJSON-1158414051 tempest-HostsAdminNegativeTestJSON-1158414051-project-admin] Calling method '.version_select at 0x7fb3467cdc10>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:50:39.658226 n-d-852296-2 devstack@n-api.service[129409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:50:39.658226 n-d-852296-2 devstack@n-api.service[129409]: warnings.warn(msg) Aug 10 17:50:39.668210 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-58dd2762-d9f8-4f44-95b8-d0d7f35da9e6 tempest-HostsAdminNegativeTestJSON-1158414051 tempest-HostsAdminNegativeTestJSON-1158414051-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 10 17:50:39.670228 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-58dd2762-d9f8-4f44-95b8-d0d7f35da9e6 tempest-HostsAdminNegativeTestJSON-1158414051 tempest-HostsAdminNegativeTestJSON-1158414051-project-admin] Request method failure captured: Aug 10 17:50:39.670228 n-d-852296-2 devstack@n-api.service[129409]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Aug 10 17:50:39.670228 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 17:50:39.670228 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 17:50:39.670228 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 17:50:39.670228 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 0 Aug 10 17:50:39.670228 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 17:50:39.670228 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 17:50:39.670228 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 17:50:39.670228 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 17:50:39.670228 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8-_tmolNyVEl1HQLGDxWXKRbI6-05maiqV6hJMxuhiuELfmXEw6Xk26EYSDX2yqcW0Bca0Q15_uJAdKpyagHj9pGCLqGHebNJYunDfV49tu3FT1N_8cgpdUo0VnqQvqKV6WO2Y7dsEFR51ABnshjk7vLODdnzqiai6YIW_9xddNQRAw Aug 10 17:50:39.670228 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 17:50:39.670228 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 17:50:39.670228 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 17:50:39.670228 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 17:50:39.670228 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 17:50:39.670228 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 17:50:39.670228 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: 72cce85fcbe24246b877061ced8c2d0c Aug 10 17:50:39.670228 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1158414051 Aug 10 17:50:39.670228 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member,admin Aug 10 17:50:39.670228 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member,admin Aug 10 17:50:39.671772 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/72cce85fcbe24246b877061ced8c2d0c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/72cce85fcbe24246b877061ced8c2d0c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/72cce85fcbe24246b877061ced8c2d0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_72cce85fcbe24246b877061ced8c2d0c", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:50:39.671772 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1158414051 Aug 10 17:50:39.671772 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: 72cce85fcbe24246b877061ced8c2d0c Aug 10 17:50:39.671772 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1158414051 Aug 10 17:50:39.671772 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-HostsAdminNegativeTestJSON-1158414051-project-admin Aug 10 17:50:39.671772 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 17:50:39.671772 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 17:50:39.671772 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: f046e2cecd2a47438d0618b4b145ee3f Aug 10 17:50:39.671772 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1158414051-project-admin Aug 10 17:50:39.671772 n-d-852296-2 devstack@n-api.service[129409]: method: Aug 10 17:50:39.671772 n-d-852296-2 devstack@n-api.service[129409]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 10 17:50:39.671772 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'id': 'nonexistent_hostname'} Aug 10 17:50:39.671772 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:50:39.672770 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:39.672770 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Aug 10 17:50:39.672770 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Aug 10 17:50:39.672770 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 10 17:50:39.672770 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 10 17:50:39.672770 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 10 17:50:39.672770 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 10 17:50:39.672770 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 10 17:50:39.672770 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise self.value Aug 10 17:50:39.672770 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 10 17:50:39.672770 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 10 17:50:39.672770 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5940, in targeted Aug 10 17:50:39.672770 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 10 17:50:39.672770 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 17:50:39.672770 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 17:50:39.672770 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 10 17:50:39.672770 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 10 17:50:39.672770 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 10 17:50:39.672770 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 10 17:50:39.674176 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 10 17:50:39.674176 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 10 17:50:39.674176 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 10 17:50:39.674176 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:50:39.674176 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:50:39.674176 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:50:39.674176 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:39.674176 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:50:39.674176 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:50:39.674176 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:50:39.674176 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:50:39.674176 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 17:50:39.674176 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 17:50:39.674176 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:50:39.674176 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:50:39.674176 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Aug 10 17:50:39.674176 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Aug 10 17:50:39.674176 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Aug 10 17:50:39.674176 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:50:39.678396 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 10 17:50:39.678396 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:50:39.678396 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:50:39.678396 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:50:39.678396 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:39.678396 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:50:39.678396 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:50:39.678396 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:50:39.678396 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:50:39.678396 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 10 17:50:39.678396 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:50:39.678396 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-58dd2762-d9f8-4f44-95b8-d0d7f35da9e6 tempest-HostsAdminNegativeTestJSON-1158414051 tempest-HostsAdminNegativeTestJSON-1158414051-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:50:39.678396 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-58dd2762-d9f8-4f44-95b8-d0d7f35da9e6 tempest-HostsAdminNegativeTestJSON-1158414051 tempest-HostsAdminNegativeTestJSON-1158414051-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.018263 Aug 10 17:50:39.678396 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 203/421] 10.222.0.50 () {58 vars in 1212 bytes} [Wed Aug 10 17:50:39 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 10 17:50:39.689790 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-0b022d29-8128-45cd-8375-d51014cfa006 tempest-HostsAdminNegativeTestJSON-95265963 tempest-HostsAdminNegativeTestJSON-95265963-project] Calling method '.version_select at 0x7fb34688d280>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:50:39.689790 n-d-852296-2 devstack@n-api.service[129410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:50:39.689790 n-d-852296-2 devstack@n-api.service[129410]: warnings.warn(msg) Aug 10 17:50:39.689790 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-0b022d29-8128-45cd-8375-d51014cfa006 tempest-HostsAdminNegativeTestJSON-95265963 tempest-HostsAdminNegativeTestJSON-95265963-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '54adccdf83f84f4f87f8aea8b644acda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f65a4a8e86d44a684ff77fb9dd29207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:50:39.689790 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-0b022d29-8128-45cd-8375-d51014cfa006 tempest-HostsAdminNegativeTestJSON-95265963 tempest-HostsAdminNegativeTestJSON-95265963-project] Request method failure captured: Aug 10 17:50:39.689790 n-d-852296-2 devstack@n-api.service[129410]: request: GET /compute/v2.1/os-hosts/n-d-852296-2 HTTP/1.1 Aug 10 17:50:39.689790 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 17:50:39.689790 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 17:50:39.689790 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 17:50:39.689790 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 0 Aug 10 17:50:39.689790 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 17:50:39.689790 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 17:50:39.689790 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 17:50:39.690843 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 17:50:39.690843 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8-_p9Eft5ylIdHjJKBEp1wM3tSnwzpcnutThUaV9oMhctgwbYrNnFyVMuEJnK_Zi1wikQO-_mA6-kQor-fJ6SurGRGuiKhUz1Gbe5gZMnKZrNNyi0lKehhNILuJirAiCzpTsNWgLBRfZJWlqfX6A2-Il8TH-mfqw7FmcvWGekIctm-Y Aug 10 17:50:39.690843 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 17:50:39.690843 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 17:50:39.690843 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 17:50:39.690843 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 17:50:39.690843 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 17:50:39.690843 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 17:50:39.690843 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: 2f65a4a8e86d44a684ff77fb9dd29207 Aug 10 17:50:39.690843 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-95265963 Aug 10 17:50:39.690843 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 17:50:39.690843 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 17:50:39.690843 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2f65a4a8e86d44a684ff77fb9dd29207"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/2f65a4a8e86d44a684ff77fb9dd29207"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2f65a4a8e86d44a684ff77fb9dd29207"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_2f65a4a8e86d44a684ff77fb9dd29207", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:50:39.690843 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-HostsAdminNegativeTestJSON-95265963 Aug 10 17:50:39.690843 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: 2f65a4a8e86d44a684ff77fb9dd29207 Aug 10 17:50:39.691798 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-95265963 Aug 10 17:50:39.691798 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-HostsAdminNegativeTestJSON-95265963-project Aug 10 17:50:39.691798 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 17:50:39.691798 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 17:50:39.691798 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: 54adccdf83f84f4f87f8aea8b644acda Aug 10 17:50:39.691798 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-HostsAdminNegativeTestJSON-95265963-project Aug 10 17:50:39.691798 n-d-852296-2 devstack@n-api.service[129410]: method: Aug 10 17:50:39.691798 n-d-852296-2 devstack@n-api.service[129410]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Aug 10 17:50:39.691798 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'id': 'n-d-852296-2'} Aug 10 17:50:39.691798 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:50:39.691798 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:39.691798 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:50:39.691798 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:50:39.691798 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:50:39.691798 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:50:39.691798 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 17:50:39.691798 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 17:50:39.691798 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:50:39.691798 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:50:39.691798 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Aug 10 17:50:39.691798 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Aug 10 17:50:39.691798 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 10 17:50:39.691798 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 10 17:50:39.691798 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 10 17:50:39.694167 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 10 17:50:39.694167 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 10 17:50:39.694167 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 10 17:50:39.694167 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 10 17:50:39.694167 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise self.value Aug 10 17:50:39.694167 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 10 17:50:39.694167 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 10 17:50:39.694167 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 10 17:50:39.694167 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 10 17:50:39.694167 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 10 17:50:39.694167 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 10 17:50:39.694167 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Aug 10 17:50:39.694167 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:39.694167 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:50:39.694167 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:39.694167 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:39.694167 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:50:39.694167 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:50:39.694167 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 10 17:50:39.694167 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 10 17:50:39.695311 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Aug 10 17:50:39.695311 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:39.695311 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-0b022d29-8128-45cd-8375-d51014cfa006 tempest-HostsAdminNegativeTestJSON-95265963 tempest-HostsAdminNegativeTestJSON-95265963-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:50:39.695311 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-0b022d29-8128-45cd-8375-d51014cfa006 tempest-HostsAdminNegativeTestJSON-95265963 tempest-HostsAdminNegativeTestJSON-95265963-project] 10.222.0.50 "GET /compute/v2.1/os-hosts/n-d-852296-2" status: 403 len: 109 microversion: 2.1 time: 0.010987 Aug 10 17:50:39.695311 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 219/422] 10.222.0.50 () {58 vars in 1167 bytes} [Wed Aug 10 17:50:39 2022] GET /compute/v2.1/os-hosts/n-d-852296-2 => generated 109 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:50:39.699681 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-1e2283ba-a3d0-4b70-9450-046a5a678b97 tempest-HostsAdminNegativeTestJSON-1158414051 tempest-HostsAdminNegativeTestJSON-1158414051-project-admin] Calling method '.version_select at 0x7fb346711430>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:50:39.700491 n-d-852296-2 devstack@n-api.service[129409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:50:39.700491 n-d-852296-2 devstack@n-api.service[129409]: warnings.warn(msg) Aug 10 17:50:39.706170 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-1e2283ba-a3d0-4b70-9450-046a5a678b97 tempest-HostsAdminNegativeTestJSON-1158414051 tempest-HostsAdminNegativeTestJSON-1158414051-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 10 17:50:39.707706 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-1e2283ba-a3d0-4b70-9450-046a5a678b97 tempest-HostsAdminNegativeTestJSON-1158414051 tempest-HostsAdminNegativeTestJSON-1158414051-project-admin] Request method failure captured: Aug 10 17:50:39.707706 n-d-852296-2 devstack@n-api.service[129409]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Aug 10 17:50:39.707706 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 17:50:39.707706 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 17:50:39.707706 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 17:50:39.707706 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 0 Aug 10 17:50:39.707706 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 17:50:39.707706 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 17:50:39.707706 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 17:50:39.707706 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 17:50:39.707706 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8-_tmolNyVEl1HQLGDxWXKRbI6-05maiqV6hJMxuhiuELfmXEw6Xk26EYSDX2yqcW0Bca0Q15_uJAdKpyagHj9pGCLqGHebNJYunDfV49tu3FT1N_8cgpdUo0VnqQvqKV6WO2Y7dsEFR51ABnshjk7vLODdnzqiai6YIW_9xddNQRAw Aug 10 17:50:39.707706 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 17:50:39.707706 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 17:50:39.707706 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 17:50:39.707706 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 17:50:39.707706 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 17:50:39.707706 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 17:50:39.707706 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: 72cce85fcbe24246b877061ced8c2d0c Aug 10 17:50:39.707706 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1158414051 Aug 10 17:50:39.707706 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member,admin Aug 10 17:50:39.707706 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member,admin Aug 10 17:50:39.709729 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/72cce85fcbe24246b877061ced8c2d0c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/72cce85fcbe24246b877061ced8c2d0c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/72cce85fcbe24246b877061ced8c2d0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_72cce85fcbe24246b877061ced8c2d0c", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:50:39.709729 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1158414051 Aug 10 17:50:39.709729 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: 72cce85fcbe24246b877061ced8c2d0c Aug 10 17:50:39.709729 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1158414051 Aug 10 17:50:39.709729 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-HostsAdminNegativeTestJSON-1158414051-project-admin Aug 10 17:50:39.709729 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 17:50:39.709729 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 17:50:39.709729 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: f046e2cecd2a47438d0618b4b145ee3f Aug 10 17:50:39.709729 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1158414051-project-admin Aug 10 17:50:39.709729 n-d-852296-2 devstack@n-api.service[129409]: method: Aug 10 17:50:39.709729 n-d-852296-2 devstack@n-api.service[129409]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 10 17:50:39.709729 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'id': 'nonexistent_hostname'} Aug 10 17:50:39.709729 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:50:39.710950 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:39.710950 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Aug 10 17:50:39.710950 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Aug 10 17:50:39.710950 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 17:50:39.710950 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 17:50:39.710950 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 10 17:50:39.710950 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 10 17:50:39.710950 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 10 17:50:39.710950 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 10 17:50:39.710950 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 10 17:50:39.710950 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 10 17:50:39.710950 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 10 17:50:39.710950 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:50:39.710950 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:50:39.710950 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:50:39.710950 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:39.710950 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:50:39.710950 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:50:39.710950 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:50:39.712201 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:50:39.712201 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 17:50:39.712201 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 17:50:39.712201 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:50:39.712201 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:50:39.712201 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Aug 10 17:50:39.712201 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:50:39.712201 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 10 17:50:39.712201 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:50:39.712201 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:50:39.712201 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:50:39.712201 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:39.712201 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:50:39.712201 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:50:39.712201 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:50:39.712201 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:50:39.712201 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 10 17:50:39.712201 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:50:39.713315 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-1e2283ba-a3d0-4b70-9450-046a5a678b97 tempest-HostsAdminNegativeTestJSON-1158414051 tempest-HostsAdminNegativeTestJSON-1158414051-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:50:39.713315 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-1e2283ba-a3d0-4b70-9450-046a5a678b97 tempest-HostsAdminNegativeTestJSON-1158414051 tempest-HostsAdminNegativeTestJSON-1158414051-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.014196 Aug 10 17:50:39.713315 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 204/423] 10.222.0.50 () {58 vars in 1191 bytes} [Wed Aug 10 17:50:39 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 10 17:50:39.719929 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-58d78bf0-25a9-4345-b286-b82c1e0aba66 tempest-HostsAdminNegativeTestJSON-95265963 tempest-HostsAdminNegativeTestJSON-95265963-project] Calling method '.version_select at 0x7fb346601c10>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:50:39.720740 n-d-852296-2 devstack@n-api.service[129410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:shutdown": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:50:39.720740 n-d-852296-2 devstack@n-api.service[129410]: warnings.warn(msg) Aug 10 17:50:39.721803 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-58d78bf0-25a9-4345-b286-b82c1e0aba66 tempest-HostsAdminNegativeTestJSON-95265963 tempest-HostsAdminNegativeTestJSON-95265963-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '54adccdf83f84f4f87f8aea8b644acda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f65a4a8e86d44a684ff77fb9dd29207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:50:39.723313 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-58d78bf0-25a9-4345-b286-b82c1e0aba66 tempest-HostsAdminNegativeTestJSON-95265963 tempest-HostsAdminNegativeTestJSON-95265963-project] Request method failure captured: Aug 10 17:50:39.723313 n-d-852296-2 devstack@n-api.service[129410]: request: GET /compute/v2.1/os-hosts/n-d-852296-2/shutdown HTTP/1.1 Aug 10 17:50:39.723313 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 17:50:39.723313 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 17:50:39.723313 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 17:50:39.723313 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 0 Aug 10 17:50:39.723313 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 17:50:39.723313 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 17:50:39.723313 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 17:50:39.723313 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 17:50:39.723313 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8-_p9Eft5ylIdHjJKBEp1wM3tSnwzpcnutThUaV9oMhctgwbYrNnFyVMuEJnK_Zi1wikQO-_mA6-kQor-fJ6SurGRGuiKhUz1Gbe5gZMnKZrNNyi0lKehhNILuJirAiCzpTsNWgLBRfZJWlqfX6A2-Il8TH-mfqw7FmcvWGekIctm-Y Aug 10 17:50:39.723313 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 17:50:39.723313 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 17:50:39.723313 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 17:50:39.723313 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 17:50:39.723313 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 17:50:39.723313 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 17:50:39.723313 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: 2f65a4a8e86d44a684ff77fb9dd29207 Aug 10 17:50:39.723313 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-95265963 Aug 10 17:50:39.723313 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 17:50:39.723313 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 17:50:39.724964 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2f65a4a8e86d44a684ff77fb9dd29207"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/2f65a4a8e86d44a684ff77fb9dd29207"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2f65a4a8e86d44a684ff77fb9dd29207"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_2f65a4a8e86d44a684ff77fb9dd29207", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:50:39.724964 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-HostsAdminNegativeTestJSON-95265963 Aug 10 17:50:39.724964 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: 2f65a4a8e86d44a684ff77fb9dd29207 Aug 10 17:50:39.724964 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-95265963 Aug 10 17:50:39.724964 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-HostsAdminNegativeTestJSON-95265963-project Aug 10 17:50:39.724964 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 17:50:39.724964 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 17:50:39.724964 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: 54adccdf83f84f4f87f8aea8b644acda Aug 10 17:50:39.724964 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-HostsAdminNegativeTestJSON-95265963-project Aug 10 17:50:39.724964 n-d-852296-2 devstack@n-api.service[129410]: method: Aug 10 17:50:39.724964 n-d-852296-2 devstack@n-api.service[129410]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Aug 10 17:50:39.724964 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'id': 'n-d-852296-2'} Aug 10 17:50:39.724964 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:50:39.728709 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:39.728709 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:50:39.728709 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:50:39.728709 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:50:39.728709 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:50:39.728709 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 17:50:39.728709 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 17:50:39.728709 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:50:39.728709 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:50:39.728709 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Aug 10 17:50:39.728709 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Aug 10 17:50:39.728709 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 10 17:50:39.728709 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 10 17:50:39.728709 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 10 17:50:39.728709 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 10 17:50:39.728709 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 10 17:50:39.728709 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 10 17:50:39.728709 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 10 17:50:39.728709 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise self.value Aug 10 17:50:39.730030 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 10 17:50:39.730030 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 10 17:50:39.730030 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 10 17:50:39.730030 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 10 17:50:39.730030 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 10 17:50:39.730030 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 10 17:50:39.730030 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Aug 10 17:50:39.730030 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:39.730030 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:50:39.730030 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:39.730030 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:39.730030 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:50:39.730030 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:50:39.730030 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 10 17:50:39.730030 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 10 17:50:39.730030 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Aug 10 17:50:39.730030 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:39.731239 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-58d78bf0-25a9-4345-b286-b82c1e0aba66 tempest-HostsAdminNegativeTestJSON-95265963 tempest-HostsAdminNegativeTestJSON-95265963-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:50:39.731239 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-58d78bf0-25a9-4345-b286-b82c1e0aba66 tempest-HostsAdminNegativeTestJSON-95265963 tempest-HostsAdminNegativeTestJSON-95265963-project] 10.222.0.50 "GET /compute/v2.1/os-hosts/n-d-852296-2/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.009360 Aug 10 17:50:39.731239 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 220/424] 10.222.0.50 () {58 vars in 1194 bytes} [Wed Aug 10 17:50:39 2022] GET /compute/v2.1/os-hosts/n-d-852296-2/shutdown => generated 113 bytes in 10 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:50:39.734960 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-ca9af34e-2149-418d-bc89-f7b9c6553516 tempest-HostsAdminNegativeTestJSON-1158414051 tempest-HostsAdminNegativeTestJSON-1158414051-project-admin] Calling method '.version_select at 0x7fb3467f8ee0>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:50:39.735750 n-d-852296-2 devstack@n-api.service[129409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:shutdown": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:50:39.735750 n-d-852296-2 devstack@n-api.service[129409]: warnings.warn(msg) Aug 10 17:50:39.744473 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-ca9af34e-2149-418d-bc89-f7b9c6553516 tempest-HostsAdminNegativeTestJSON-1158414051 tempest-HostsAdminNegativeTestJSON-1158414051-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 10 17:50:39.746131 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-ca9af34e-2149-418d-bc89-f7b9c6553516 tempest-HostsAdminNegativeTestJSON-1158414051 tempest-HostsAdminNegativeTestJSON-1158414051-project-admin] Request method failure captured: Aug 10 17:50:39.746131 n-d-852296-2 devstack@n-api.service[129409]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Aug 10 17:50:39.746131 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 17:50:39.746131 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 17:50:39.746131 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 17:50:39.746131 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 0 Aug 10 17:50:39.746131 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 17:50:39.746131 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 17:50:39.746131 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 17:50:39.746131 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 17:50:39.746131 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8-_tmolNyVEl1HQLGDxWXKRbI6-05maiqV6hJMxuhiuELfmXEw6Xk26EYSDX2yqcW0Bca0Q15_uJAdKpyagHj9pGCLqGHebNJYunDfV49tu3FT1N_8cgpdUo0VnqQvqKV6WO2Y7dsEFR51ABnshjk7vLODdnzqiai6YIW_9xddNQRAw Aug 10 17:50:39.746131 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 17:50:39.746131 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 17:50:39.746131 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 17:50:39.746131 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 17:50:39.746131 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 17:50:39.746131 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 17:50:39.746131 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: 72cce85fcbe24246b877061ced8c2d0c Aug 10 17:50:39.746131 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1158414051 Aug 10 17:50:39.746131 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member,admin Aug 10 17:50:39.746131 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member,admin Aug 10 17:50:39.747503 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/72cce85fcbe24246b877061ced8c2d0c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/72cce85fcbe24246b877061ced8c2d0c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/72cce85fcbe24246b877061ced8c2d0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_72cce85fcbe24246b877061ced8c2d0c", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:50:39.747503 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1158414051 Aug 10 17:50:39.747503 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: 72cce85fcbe24246b877061ced8c2d0c Aug 10 17:50:39.747503 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1158414051 Aug 10 17:50:39.747503 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-HostsAdminNegativeTestJSON-1158414051-project-admin Aug 10 17:50:39.747503 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 17:50:39.747503 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 17:50:39.747503 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: f046e2cecd2a47438d0618b4b145ee3f Aug 10 17:50:39.747503 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1158414051-project-admin Aug 10 17:50:39.747503 n-d-852296-2 devstack@n-api.service[129409]: method: Aug 10 17:50:39.747503 n-d-852296-2 devstack@n-api.service[129409]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 10 17:50:39.747503 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'id': 'nonexistent_hostname'} Aug 10 17:50:39.747503 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:50:39.748457 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:39.748457 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Aug 10 17:50:39.748457 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Aug 10 17:50:39.748457 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 10 17:50:39.748457 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 10 17:50:39.748457 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 10 17:50:39.748457 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 10 17:50:39.748457 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 10 17:50:39.748457 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise self.value Aug 10 17:50:39.748457 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 10 17:50:39.748457 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 10 17:50:39.748457 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5940, in targeted Aug 10 17:50:39.748457 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 10 17:50:39.748457 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 17:50:39.748457 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 17:50:39.748457 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 10 17:50:39.748457 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 10 17:50:39.748457 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 10 17:50:39.748457 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 10 17:50:39.749871 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 10 17:50:39.749871 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 10 17:50:39.749871 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 10 17:50:39.749871 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:50:39.749871 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:50:39.749871 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:50:39.749871 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:39.749871 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:50:39.749871 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:50:39.749871 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:50:39.749871 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:50:39.749871 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 17:50:39.749871 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 17:50:39.749871 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:50:39.749871 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:50:39.749871 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Aug 10 17:50:39.749871 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Aug 10 17:50:39.749871 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Aug 10 17:50:39.749871 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:50:39.751395 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 10 17:50:39.751395 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:50:39.751395 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:50:39.751395 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:50:39.751395 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:39.751395 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:50:39.751395 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:50:39.751395 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:50:39.751395 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:50:39.751395 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 10 17:50:39.751395 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:50:39.751395 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-ca9af34e-2149-418d-bc89-f7b9c6553516 tempest-HostsAdminNegativeTestJSON-1158414051 tempest-HostsAdminNegativeTestJSON-1158414051-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:50:39.751395 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-ca9af34e-2149-418d-bc89-f7b9c6553516 tempest-HostsAdminNegativeTestJSON-1158414051 tempest-HostsAdminNegativeTestJSON-1158414051-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.017127 Aug 10 17:50:39.751395 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 205/425] 10.222.0.50 () {58 vars in 1218 bytes} [Wed Aug 10 17:50:39 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 10 17:50:39.758643 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-80f4ebec-b019-43bb-b93c-71d402366998 tempest-HostsAdminNegativeTestJSON-95265963 tempest-HostsAdminNegativeTestJSON-95265963-project] Calling method '.version_select at 0x7fb346601310>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:50:39.759446 n-d-852296-2 devstack@n-api.service[129410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:start": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:50:39.759446 n-d-852296-2 devstack@n-api.service[129410]: warnings.warn(msg) Aug 10 17:50:39.760642 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-80f4ebec-b019-43bb-b93c-71d402366998 tempest-HostsAdminNegativeTestJSON-95265963 tempest-HostsAdminNegativeTestJSON-95265963-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '54adccdf83f84f4f87f8aea8b644acda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f65a4a8e86d44a684ff77fb9dd29207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:50:39.762151 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-80f4ebec-b019-43bb-b93c-71d402366998 tempest-HostsAdminNegativeTestJSON-95265963 tempest-HostsAdminNegativeTestJSON-95265963-project] Request method failure captured: Aug 10 17:50:39.762151 n-d-852296-2 devstack@n-api.service[129410]: request: GET /compute/v2.1/os-hosts/n-d-852296-2/startup HTTP/1.1 Aug 10 17:50:39.762151 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 17:50:39.762151 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 17:50:39.762151 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 17:50:39.762151 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 0 Aug 10 17:50:39.762151 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 17:50:39.762151 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 17:50:39.762151 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 17:50:39.762151 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 17:50:39.762151 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8-_p9Eft5ylIdHjJKBEp1wM3tSnwzpcnutThUaV9oMhctgwbYrNnFyVMuEJnK_Zi1wikQO-_mA6-kQor-fJ6SurGRGuiKhUz1Gbe5gZMnKZrNNyi0lKehhNILuJirAiCzpTsNWgLBRfZJWlqfX6A2-Il8TH-mfqw7FmcvWGekIctm-Y Aug 10 17:50:39.762151 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 17:50:39.762151 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 17:50:39.762151 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 17:50:39.762151 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 17:50:39.762151 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 17:50:39.762151 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 17:50:39.762151 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: 2f65a4a8e86d44a684ff77fb9dd29207 Aug 10 17:50:39.762151 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-95265963 Aug 10 17:50:39.762151 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 17:50:39.762151 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 17:50:39.763746 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2f65a4a8e86d44a684ff77fb9dd29207"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/2f65a4a8e86d44a684ff77fb9dd29207"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2f65a4a8e86d44a684ff77fb9dd29207"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_2f65a4a8e86d44a684ff77fb9dd29207", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:50:39.763746 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-HostsAdminNegativeTestJSON-95265963 Aug 10 17:50:39.763746 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: 2f65a4a8e86d44a684ff77fb9dd29207 Aug 10 17:50:39.763746 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-95265963 Aug 10 17:50:39.763746 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-HostsAdminNegativeTestJSON-95265963-project Aug 10 17:50:39.763746 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 17:50:39.763746 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 17:50:39.763746 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: 54adccdf83f84f4f87f8aea8b644acda Aug 10 17:50:39.763746 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-HostsAdminNegativeTestJSON-95265963-project Aug 10 17:50:39.763746 n-d-852296-2 devstack@n-api.service[129410]: method: Aug 10 17:50:39.763746 n-d-852296-2 devstack@n-api.service[129410]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Aug 10 17:50:39.763746 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'id': 'n-d-852296-2'} Aug 10 17:50:39.763746 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:50:39.764783 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:39.764783 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:50:39.764783 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:50:39.764783 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:50:39.764783 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:50:39.764783 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 17:50:39.764783 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 17:50:39.764783 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:50:39.764783 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:50:39.764783 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Aug 10 17:50:39.764783 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Aug 10 17:50:39.764783 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 10 17:50:39.764783 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 10 17:50:39.764783 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 10 17:50:39.764783 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 10 17:50:39.764783 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 10 17:50:39.764783 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 10 17:50:39.764783 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 10 17:50:39.764783 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise self.value Aug 10 17:50:39.766118 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 10 17:50:39.766118 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 10 17:50:39.766118 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 10 17:50:39.766118 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 10 17:50:39.766118 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 10 17:50:39.766118 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 10 17:50:39.766118 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Aug 10 17:50:39.766118 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:39.766118 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:50:39.766118 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:39.766118 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:39.766118 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:50:39.766118 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:50:39.766118 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 10 17:50:39.766118 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 10 17:50:39.766118 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Aug 10 17:50:39.766118 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:39.767203 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-80f4ebec-b019-43bb-b93c-71d402366998 tempest-HostsAdminNegativeTestJSON-95265963 tempest-HostsAdminNegativeTestJSON-95265963-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:50:39.767203 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-80f4ebec-b019-43bb-b93c-71d402366998 tempest-HostsAdminNegativeTestJSON-95265963 tempest-HostsAdminNegativeTestJSON-95265963-project] 10.222.0.50 "GET /compute/v2.1/os-hosts/n-d-852296-2/startup" status: 403 len: 110 microversion: 2.1 time: 0.010365 Aug 10 17:50:39.767203 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 221/426] 10.222.0.50 () {58 vars in 1191 bytes} [Wed Aug 10 17:50:39 2022] GET /compute/v2.1/os-hosts/n-d-852296-2/startup => generated 110 bytes in 11 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 10 17:50:39.772838 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-5371123a-63d3-47a6-ade3-df22f0285cc8 tempest-HostsAdminNegativeTestJSON-1158414051 tempest-HostsAdminNegativeTestJSON-1158414051-project-admin] Calling method '.version_select at 0x7fb3469f4d30>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:50:39.773806 n-d-852296-2 devstack@n-api.service[129409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:start": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:50:39.773806 n-d-852296-2 devstack@n-api.service[129409]: warnings.warn(msg) Aug 10 17:50:39.781768 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-5371123a-63d3-47a6-ade3-df22f0285cc8 tempest-HostsAdminNegativeTestJSON-1158414051 tempest-HostsAdminNegativeTestJSON-1158414051-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 10 17:50:39.783448 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-5371123a-63d3-47a6-ade3-df22f0285cc8 tempest-HostsAdminNegativeTestJSON-1158414051 tempest-HostsAdminNegativeTestJSON-1158414051-project-admin] Request method failure captured: Aug 10 17:50:39.783448 n-d-852296-2 devstack@n-api.service[129409]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Aug 10 17:50:39.783448 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 17:50:39.783448 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 17:50:39.783448 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 17:50:39.783448 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 0 Aug 10 17:50:39.783448 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 17:50:39.783448 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 17:50:39.783448 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 17:50:39.783448 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 17:50:39.783448 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8-_tmolNyVEl1HQLGDxWXKRbI6-05maiqV6hJMxuhiuELfmXEw6Xk26EYSDX2yqcW0Bca0Q15_uJAdKpyagHj9pGCLqGHebNJYunDfV49tu3FT1N_8cgpdUo0VnqQvqKV6WO2Y7dsEFR51ABnshjk7vLODdnzqiai6YIW_9xddNQRAw Aug 10 17:50:39.783448 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 17:50:39.783448 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 17:50:39.783448 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 17:50:39.783448 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 17:50:39.783448 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 17:50:39.783448 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 17:50:39.783448 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: 72cce85fcbe24246b877061ced8c2d0c Aug 10 17:50:39.783448 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1158414051 Aug 10 17:50:39.783448 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member,admin Aug 10 17:50:39.783448 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member,admin Aug 10 17:50:39.784995 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/72cce85fcbe24246b877061ced8c2d0c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/72cce85fcbe24246b877061ced8c2d0c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/72cce85fcbe24246b877061ced8c2d0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_72cce85fcbe24246b877061ced8c2d0c", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:50:39.784995 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1158414051 Aug 10 17:50:39.784995 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: 72cce85fcbe24246b877061ced8c2d0c Aug 10 17:50:39.784995 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1158414051 Aug 10 17:50:39.784995 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-HostsAdminNegativeTestJSON-1158414051-project-admin Aug 10 17:50:39.784995 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 17:50:39.784995 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 17:50:39.784995 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: f046e2cecd2a47438d0618b4b145ee3f Aug 10 17:50:39.784995 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1158414051-project-admin Aug 10 17:50:39.784995 n-d-852296-2 devstack@n-api.service[129409]: method: Aug 10 17:50:39.784995 n-d-852296-2 devstack@n-api.service[129409]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 10 17:50:39.784995 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'id': 'nonexistent_hostname'} Aug 10 17:50:39.784995 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:50:39.790235 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:39.790235 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Aug 10 17:50:39.790235 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Aug 10 17:50:39.790235 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 10 17:50:39.790235 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 10 17:50:39.790235 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 10 17:50:39.790235 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 10 17:50:39.790235 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 10 17:50:39.790235 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise self.value Aug 10 17:50:39.790235 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 10 17:50:39.790235 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 10 17:50:39.790235 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5940, in targeted Aug 10 17:50:39.790235 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 10 17:50:39.790235 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 17:50:39.790235 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 17:50:39.790235 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 10 17:50:39.790235 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 10 17:50:39.790235 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 10 17:50:39.790235 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 10 17:50:39.791576 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 10 17:50:39.791576 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 10 17:50:39.791576 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 10 17:50:39.791576 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:50:39.791576 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:50:39.791576 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:50:39.791576 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:39.791576 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:50:39.791576 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:50:39.791576 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:50:39.791576 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:50:39.791576 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 17:50:39.791576 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 17:50:39.791576 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:50:39.791576 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:50:39.791576 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Aug 10 17:50:39.791576 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Aug 10 17:50:39.791576 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Aug 10 17:50:39.791576 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:50:39.792924 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 10 17:50:39.792924 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:50:39.792924 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:50:39.792924 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:50:39.792924 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:39.792924 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:50:39.792924 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:50:39.792924 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:50:39.792924 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:50:39.792924 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 10 17:50:39.792924 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:50:39.792924 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-5371123a-63d3-47a6-ade3-df22f0285cc8 tempest-HostsAdminNegativeTestJSON-1158414051 tempest-HostsAdminNegativeTestJSON-1158414051-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:50:39.792924 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-5371123a-63d3-47a6-ade3-df22f0285cc8 tempest-HostsAdminNegativeTestJSON-1158414051 tempest-HostsAdminNegativeTestJSON-1158414051-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.016292 Aug 10 17:50:39.792924 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 206/427] 10.222.0.50 () {58 vars in 1215 bytes} [Wed Aug 10 17:50:39 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 10 17:50:39.797095 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-43d9fd94-e421-41e5-b74f-49ca886561f8 tempest-HostsAdminNegativeTestJSON-1158414051 tempest-HostsAdminNegativeTestJSON-1158414051-project-admin] Action: 'update', calling method: .version_select at 0x7fb346601f70>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:50:39.800910 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-43d9fd94-e421-41e5-b74f-49ca886561f8 tempest-HostsAdminNegativeTestJSON-1158414051 tempest-HostsAdminNegativeTestJSON-1158414051-project-admin] Request method failure captured: Aug 10 17:50:39.800910 n-d-852296-2 devstack@n-api.service[129410]: request: PUT /compute/v2.1/os-hosts/n-d-852296-2 HTTP/1.1 Aug 10 17:50:39.800910 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 17:50:39.800910 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 17:50:39.800910 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 17:50:39.800910 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 51 Aug 10 17:50:39.800910 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 17:50:39.800910 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 17:50:39.800910 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 17:50:39.800910 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 17:50:39.800910 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8-_tmolNyVEl1HQLGDxWXKRbI6-05maiqV6hJMxuhiuELfmXEw6Xk26EYSDX2yqcW0Bca0Q15_uJAdKpyagHj9pGCLqGHebNJYunDfV49tu3FT1N_8cgpdUo0VnqQvqKV6WO2Y7dsEFR51ABnshjk7vLODdnzqiai6YIW_9xddNQRAw Aug 10 17:50:39.800910 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 17:50:39.800910 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 17:50:39.800910 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 17:50:39.800910 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 17:50:39.800910 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 17:50:39.800910 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 17:50:39.800910 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: 72cce85fcbe24246b877061ced8c2d0c Aug 10 17:50:39.800910 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1158414051 Aug 10 17:50:39.800910 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member,admin Aug 10 17:50:39.800910 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member,admin Aug 10 17:50:39.802585 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/72cce85fcbe24246b877061ced8c2d0c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/72cce85fcbe24246b877061ced8c2d0c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/72cce85fcbe24246b877061ced8c2d0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_72cce85fcbe24246b877061ced8c2d0c", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:50:39.802585 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1158414051 Aug 10 17:50:39.802585 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: 72cce85fcbe24246b877061ced8c2d0c Aug 10 17:50:39.802585 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1158414051 Aug 10 17:50:39.802585 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-HostsAdminNegativeTestJSON-1158414051-project-admin Aug 10 17:50:39.802585 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 17:50:39.802585 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 17:50:39.802585 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: f046e2cecd2a47438d0618b4b145ee3f Aug 10 17:50:39.802585 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1158414051-project-admin Aug 10 17:50:39.802585 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 17:50:39.802585 n-d-852296-2 devstack@n-api.service[129410]: {"status": "enable", "maintenance_mode": "invalid"} Aug 10 17:50:39.802585 n-d-852296-2 devstack@n-api.service[129410]: method: Aug 10 17:50:39.802585 n-d-852296-2 devstack@n-api.service[129410]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 10 17:50:39.803735 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'id': 'n-d-852296-2', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Aug 10 17:50:39.803735 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:50:39.803735 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:39.803735 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 10 17:50:39.803735 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 10 17:50:39.803735 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 10 17:50:39.803735 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise error Aug 10 17:50:39.803735 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 10 17:50:39.803735 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:39.803735 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Aug 10 17:50:39.803735 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Aug 10 17:50:39.803735 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi 'disable', Aug 10 17:50:39.803735 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi 'Enable', Aug 10 17:50:39.803735 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi 'Disable', Aug 10 17:50:39.803735 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi 'ENABLE', Aug 10 17:50:39.803735 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi 'DISABLE'], Aug 10 17:50:39.803735 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 10 17:50:39.803735 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:39.803735 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi On instance: Aug 10 17:50:39.803735 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi 'invalid' Aug 10 17:50:39.803735 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:39.803735 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:50:39.803735 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:39.803735 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:39.803735 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:50:39.805654 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:50:39.805654 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:50:39.805654 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:50:39.805654 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 17:50:39.805654 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 17:50:39.805654 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:50:39.805654 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:50:39.805654 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 10 17:50:39.805654 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 10 17:50:39.805654 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 10 17:50:39.805654 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 10 17:50:39.805654 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 10 17:50:39.805654 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 10 17:50:39.805654 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 10 17:50:39.805654 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:39.805654 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:50:39.805654 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:39.805654 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:39.805654 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:50:39.806984 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:50:39.806984 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 10 17:50:39.806984 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 10 17:50:39.806984 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 10 17:50:39.806984 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:39.806984 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-43d9fd94-e421-41e5-b74f-49ca886561f8 tempest-HostsAdminNegativeTestJSON-1158414051 tempest-HostsAdminNegativeTestJSON-1158414051-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:50:39.806984 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-43d9fd94-e421-41e5-b74f-49ca886561f8 tempest-HostsAdminNegativeTestJSON-1158414051 tempest-HostsAdminNegativeTestJSON-1158414051-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-hosts/n-d-852296-2" status: 400 len: 199 microversion: 2.1 time: 0.008836 Aug 10 17:50:39.806984 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 222/428] 10.222.0.50 () {60 vars in 1187 bytes} [Wed Aug 10 17:50:39 2022] PUT /compute/v2.1/os-hosts/n-d-852296-2 => generated 199 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 10 17:50:39.812050 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-a48526e7-209f-4130-8c0f-453bb231a0dc tempest-HostsAdminNegativeTestJSON-1158414051 tempest-HostsAdminNegativeTestJSON-1158414051-project-admin] Action: 'update', calling method: .version_select at 0x7fb3467f8670>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:50:39.815700 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-a48526e7-209f-4130-8c0f-453bb231a0dc tempest-HostsAdminNegativeTestJSON-1158414051 tempest-HostsAdminNegativeTestJSON-1158414051-project-admin] Request method failure captured: Aug 10 17:50:39.815700 n-d-852296-2 devstack@n-api.service[129409]: request: PUT /compute/v2.1/os-hosts/n-d-852296-2 HTTP/1.1 Aug 10 17:50:39.815700 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 17:50:39.815700 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 17:50:39.815700 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 17:50:39.815700 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 51 Aug 10 17:50:39.815700 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 17:50:39.815700 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 17:50:39.815700 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 17:50:39.815700 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 17:50:39.815700 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8-_tmolNyVEl1HQLGDxWXKRbI6-05maiqV6hJMxuhiuELfmXEw6Xk26EYSDX2yqcW0Bca0Q15_uJAdKpyagHj9pGCLqGHebNJYunDfV49tu3FT1N_8cgpdUo0VnqQvqKV6WO2Y7dsEFR51ABnshjk7vLODdnzqiai6YIW_9xddNQRAw Aug 10 17:50:39.815700 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 17:50:39.815700 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 17:50:39.815700 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 17:50:39.815700 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 17:50:39.815700 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 17:50:39.815700 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 17:50:39.815700 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: 72cce85fcbe24246b877061ced8c2d0c Aug 10 17:50:39.815700 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1158414051 Aug 10 17:50:39.815700 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member,admin Aug 10 17:50:39.815700 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member,admin Aug 10 17:50:39.817227 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/72cce85fcbe24246b877061ced8c2d0c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/72cce85fcbe24246b877061ced8c2d0c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/72cce85fcbe24246b877061ced8c2d0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_72cce85fcbe24246b877061ced8c2d0c", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:50:39.817227 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1158414051 Aug 10 17:50:39.817227 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: 72cce85fcbe24246b877061ced8c2d0c Aug 10 17:50:39.817227 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1158414051 Aug 10 17:50:39.817227 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-HostsAdminNegativeTestJSON-1158414051-project-admin Aug 10 17:50:39.817227 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 17:50:39.817227 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 17:50:39.817227 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: f046e2cecd2a47438d0618b4b145ee3f Aug 10 17:50:39.817227 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1158414051-project-admin Aug 10 17:50:39.817227 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:50:39.817227 n-d-852296-2 devstack@n-api.service[129409]: {"status": "invalid", "maintenance_mode": "enable"} Aug 10 17:50:39.817227 n-d-852296-2 devstack@n-api.service[129409]: method: Aug 10 17:50:39.817227 n-d-852296-2 devstack@n-api.service[129409]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 10 17:50:39.818569 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'id': 'n-d-852296-2', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Aug 10 17:50:39.818569 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:50:39.818569 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:39.818569 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 10 17:50:39.818569 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 10 17:50:39.818569 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 10 17:50:39.818569 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise error Aug 10 17:50:39.818569 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 10 17:50:39.818569 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:50:39.818569 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Aug 10 17:50:39.818569 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Aug 10 17:50:39.818569 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi 'disable', Aug 10 17:50:39.818569 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi 'Enable', Aug 10 17:50:39.818569 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi 'Disable', Aug 10 17:50:39.818569 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi 'ENABLE', Aug 10 17:50:39.818569 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi 'DISABLE'], Aug 10 17:50:39.818569 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 10 17:50:39.818569 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:50:39.818569 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi On instance: Aug 10 17:50:39.818569 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi 'invalid' Aug 10 17:50:39.818569 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:50:39.818569 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:50:39.818569 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:50:39.818569 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:39.818569 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:50:39.820940 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:50:39.820940 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:50:39.820940 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:50:39.820940 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 17:50:39.820940 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 17:50:39.820940 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:50:39.820940 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:50:39.820940 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 10 17:50:39.820940 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 10 17:50:39.820940 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 10 17:50:39.820940 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 10 17:50:39.820940 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 10 17:50:39.820940 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 10 17:50:39.820940 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 10 17:50:39.820940 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:50:39.820940 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:50:39.820940 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:50:39.820940 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:39.820940 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:50:39.834050 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:50:39.834050 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 10 17:50:39.834050 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 10 17:50:39.834050 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 10 17:50:39.834050 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:50:39.834050 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-a48526e7-209f-4130-8c0f-453bb231a0dc tempest-HostsAdminNegativeTestJSON-1158414051 tempest-HostsAdminNegativeTestJSON-1158414051-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:50:39.834050 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-a48526e7-209f-4130-8c0f-453bb231a0dc tempest-HostsAdminNegativeTestJSON-1158414051 tempest-HostsAdminNegativeTestJSON-1158414051-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-hosts/n-d-852296-2" status: 400 len: 189 microversion: 2.1 time: 0.008919 Aug 10 17:50:39.834050 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 207/429] 10.222.0.50 () {60 vars in 1187 bytes} [Wed Aug 10 17:50:39 2022] PUT /compute/v2.1/os-hosts/n-d-852296-2 => generated 189 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 10 17:50:39.838119 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-1d0338af-0908-443f-b323-f02d92ced591 tempest-HostsAdminNegativeTestJSON-95265963 tempest-HostsAdminNegativeTestJSON-95265963-project] Action: 'update', calling method: .version_select at 0x7fb34688d820>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:50:39.841416 n-d-852296-2 devstack@n-api.service[129410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:50:39.841416 n-d-852296-2 devstack@n-api.service[129410]: warnings.warn(msg) Aug 10 17:50:39.842633 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-1d0338af-0908-443f-b323-f02d92ced591 tempest-HostsAdminNegativeTestJSON-95265963 tempest-HostsAdminNegativeTestJSON-95265963-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '54adccdf83f84f4f87f8aea8b644acda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f65a4a8e86d44a684ff77fb9dd29207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:50:39.844482 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-1d0338af-0908-443f-b323-f02d92ced591 tempest-HostsAdminNegativeTestJSON-95265963 tempest-HostsAdminNegativeTestJSON-95265963-project] Request method failure captured: Aug 10 17:50:39.844482 n-d-852296-2 devstack@n-api.service[129410]: request: PUT /compute/v2.1/os-hosts/n-d-852296-2 HTTP/1.1 Aug 10 17:50:39.844482 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 17:50:39.844482 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 17:50:39.844482 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 17:50:39.844482 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 50 Aug 10 17:50:39.844482 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 17:50:39.844482 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 17:50:39.844482 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 17:50:39.844482 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 17:50:39.844482 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8-_p9Eft5ylIdHjJKBEp1wM3tSnwzpcnutThUaV9oMhctgwbYrNnFyVMuEJnK_Zi1wikQO-_mA6-kQor-fJ6SurGRGuiKhUz1Gbe5gZMnKZrNNyi0lKehhNILuJirAiCzpTsNWgLBRfZJWlqfX6A2-Il8TH-mfqw7FmcvWGekIctm-Y Aug 10 17:50:39.844482 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 17:50:39.844482 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 17:50:39.844482 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 17:50:39.844482 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 17:50:39.844482 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 17:50:39.844482 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 17:50:39.844482 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: 2f65a4a8e86d44a684ff77fb9dd29207 Aug 10 17:50:39.844482 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-95265963 Aug 10 17:50:39.844482 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 17:50:39.844482 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 17:50:39.845917 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2f65a4a8e86d44a684ff77fb9dd29207"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/2f65a4a8e86d44a684ff77fb9dd29207"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2f65a4a8e86d44a684ff77fb9dd29207"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_2f65a4a8e86d44a684ff77fb9dd29207", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:50:39.845917 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-HostsAdminNegativeTestJSON-95265963 Aug 10 17:50:39.845917 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: 2f65a4a8e86d44a684ff77fb9dd29207 Aug 10 17:50:39.845917 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-95265963 Aug 10 17:50:39.845917 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-HostsAdminNegativeTestJSON-95265963-project Aug 10 17:50:39.845917 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 17:50:39.845917 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 17:50:39.845917 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: 54adccdf83f84f4f87f8aea8b644acda Aug 10 17:50:39.845917 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-HostsAdminNegativeTestJSON-95265963-project Aug 10 17:50:39.845917 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 17:50:39.845917 n-d-852296-2 devstack@n-api.service[129410]: {"status": "enable", "maintenance_mode": "enable"} Aug 10 17:50:39.845917 n-d-852296-2 devstack@n-api.service[129410]: method: Aug 10 17:50:39.845917 n-d-852296-2 devstack@n-api.service[129410]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Aug 10 17:50:39.845917 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'id': 'n-d-852296-2', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Aug 10 17:50:39.846788 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:50:39.846788 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:39.846788 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:50:39.846788 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:50:39.846788 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:50:39.846788 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:50:39.846788 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 17:50:39.846788 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 17:50:39.846788 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:50:39.846788 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:50:39.846788 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:50:39.846788 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:50:39.846788 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Aug 10 17:50:39.846788 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Aug 10 17:50:39.846788 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 10 17:50:39.846788 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 10 17:50:39.846788 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 10 17:50:39.846788 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 10 17:50:39.846788 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 10 17:50:39.846788 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 10 17:50:39.848354 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 10 17:50:39.848354 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise self.value Aug 10 17:50:39.848354 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 10 17:50:39.848354 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 10 17:50:39.848354 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 10 17:50:39.848354 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 10 17:50:39.848354 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 10 17:50:39.848354 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 10 17:50:39.848354 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Aug 10 17:50:39.848354 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:39.848354 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:50:39.848354 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:39.848354 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:39.848354 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:50:39.848354 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:50:39.848354 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 10 17:50:39.848354 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 10 17:50:39.848354 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Aug 10 17:50:39.848354 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:39.850577 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-1d0338af-0908-443f-b323-f02d92ced591 tempest-HostsAdminNegativeTestJSON-95265963 tempest-HostsAdminNegativeTestJSON-95265963-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:50:39.850577 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-1d0338af-0908-443f-b323-f02d92ced591 tempest-HostsAdminNegativeTestJSON-95265963 tempest-HostsAdminNegativeTestJSON-95265963-project] 10.222.0.50 "PUT /compute/v2.1/os-hosts/n-d-852296-2" status: 403 len: 111 microversion: 2.1 time: 0.012310 Aug 10 17:50:39.850577 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 223/430] 10.222.0.50 () {60 vars in 1187 bytes} [Wed Aug 10 17:50:39 2022] PUT /compute/v2.1/os-hosts/n-d-852296-2 => generated 111 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:50:39.856587 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-479351b9-ad22-4be0-8369-efca0e648c0f tempest-HostsAdminNegativeTestJSON-1158414051 tempest-HostsAdminNegativeTestJSON-1158414051-project-admin] Action: 'update', calling method: .version_select at 0x7fb3467cd700>, body: {"status": null, "maintenance_mode": null} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:50:39.860299 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-479351b9-ad22-4be0-8369-efca0e648c0f tempest-HostsAdminNegativeTestJSON-1158414051 tempest-HostsAdminNegativeTestJSON-1158414051-project-admin] Request method failure captured: Aug 10 17:50:39.860299 n-d-852296-2 devstack@n-api.service[129409]: request: PUT /compute/v2.1/os-hosts/n-d-852296-2 HTTP/1.1 Aug 10 17:50:39.860299 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 17:50:39.860299 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 17:50:39.860299 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 17:50:39.860299 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 42 Aug 10 17:50:39.860299 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 17:50:39.860299 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 17:50:39.860299 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 17:50:39.860299 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 17:50:39.860299 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8-_tmolNyVEl1HQLGDxWXKRbI6-05maiqV6hJMxuhiuELfmXEw6Xk26EYSDX2yqcW0Bca0Q15_uJAdKpyagHj9pGCLqGHebNJYunDfV49tu3FT1N_8cgpdUo0VnqQvqKV6WO2Y7dsEFR51ABnshjk7vLODdnzqiai6YIW_9xddNQRAw Aug 10 17:50:39.860299 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 17:50:39.860299 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 17:50:39.860299 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 17:50:39.860299 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 17:50:39.860299 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 17:50:39.860299 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 17:50:39.860299 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: 72cce85fcbe24246b877061ced8c2d0c Aug 10 17:50:39.860299 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1158414051 Aug 10 17:50:39.860299 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member,admin Aug 10 17:50:39.860299 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member,admin Aug 10 17:50:39.861817 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/72cce85fcbe24246b877061ced8c2d0c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/72cce85fcbe24246b877061ced8c2d0c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/72cce85fcbe24246b877061ced8c2d0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_72cce85fcbe24246b877061ced8c2d0c", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:50:39.861817 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1158414051 Aug 10 17:50:39.861817 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: 72cce85fcbe24246b877061ced8c2d0c Aug 10 17:50:39.861817 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1158414051 Aug 10 17:50:39.861817 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-HostsAdminNegativeTestJSON-1158414051-project-admin Aug 10 17:50:39.861817 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 17:50:39.861817 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 17:50:39.861817 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: f046e2cecd2a47438d0618b4b145ee3f Aug 10 17:50:39.861817 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1158414051-project-admin Aug 10 17:50:39.861817 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:50:39.861817 n-d-852296-2 devstack@n-api.service[129409]: {"status": null, "maintenance_mode": null} Aug 10 17:50:39.861817 n-d-852296-2 devstack@n-api.service[129409]: method: Aug 10 17:50:39.861817 n-d-852296-2 devstack@n-api.service[129409]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Aug 10 17:50:39.861817 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'id': 'n-d-852296-2', 'body': {'status': None, 'maintenance_mode': None}} Aug 10 17:50:39.862787 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:50:39.862787 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:39.862787 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 10 17:50:39.862787 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 10 17:50:39.862787 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 10 17:50:39.862787 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise error Aug 10 17:50:39.862787 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Aug 10 17:50:39.862787 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:50:39.862787 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Aug 10 17:50:39.862787 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Aug 10 17:50:39.862787 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi 'disable', Aug 10 17:50:39.862787 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi 'Enable', Aug 10 17:50:39.862787 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi 'Disable', Aug 10 17:50:39.862787 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi 'ENABLE', Aug 10 17:50:39.862787 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi 'DISABLE'], Aug 10 17:50:39.862787 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 10 17:50:39.862787 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:50:39.862787 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi On instance: Aug 10 17:50:39.862787 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi None Aug 10 17:50:39.862787 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:50:39.862787 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:50:39.862787 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:50:39.862787 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:39.862787 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:50:39.862787 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:50:39.864316 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:50:39.864316 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:50:39.864316 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 17:50:39.864316 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 17:50:39.864316 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:50:39.864316 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:50:39.864316 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 10 17:50:39.864316 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 10 17:50:39.864316 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 10 17:50:39.864316 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 10 17:50:39.864316 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 10 17:50:39.864316 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 10 17:50:39.864316 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Aug 10 17:50:39.864316 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:50:39.864316 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:50:39.864316 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:50:39.864316 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:39.864316 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:50:39.864316 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:50:39.866181 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 10 17:50:39.866181 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 10 17:50:39.866181 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Aug 10 17:50:39.866181 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:50:39.866181 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-479351b9-ad22-4be0-8369-efca0e648c0f tempest-HostsAdminNegativeTestJSON-1158414051 tempest-HostsAdminNegativeTestJSON-1158414051-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:50:39.866181 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-479351b9-ad22-4be0-8369-efca0e648c0f tempest-HostsAdminNegativeTestJSON-1158414051 tempest-HostsAdminNegativeTestJSON-1158414051-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-hosts/n-d-852296-2" status: 400 len: 127 microversion: 2.1 time: 0.008890 Aug 10 17:50:39.866181 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 208/431] 10.222.0.50 () {60 vars in 1187 bytes} [Wed Aug 10 17:50:39 2022] PUT /compute/v2.1/os-hosts/n-d-852296-2 => generated 127 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 10 17:50:39.872185 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-3341ddb0-610e-4719-bf7a-3921edc95baf tempest-HostsAdminNegativeTestJSON-1158414051 tempest-HostsAdminNegativeTestJSON-1158414051-project-admin] Action: 'update', calling method: .version_select at 0x7fb346601af0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:50:39.875378 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.compute.hosts [None req-3341ddb0-610e-4719-bf7a-3921edc95baf tempest-HostsAdminNegativeTestJSON-1158414051 tempest-HostsAdminNegativeTestJSON-1158414051-project-admin] Enabling host nonexistent_hostname. Aug 10 17:50:39.884141 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-3341ddb0-610e-4719-bf7a-3921edc95baf tempest-HostsAdminNegativeTestJSON-1158414051 tempest-HostsAdminNegativeTestJSON-1158414051-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 10 17:50:39.886092 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-3341ddb0-610e-4719-bf7a-3921edc95baf tempest-HostsAdminNegativeTestJSON-1158414051 tempest-HostsAdminNegativeTestJSON-1158414051-project-admin] Request method failure captured: Aug 10 17:50:39.886092 n-d-852296-2 devstack@n-api.service[129410]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Aug 10 17:50:39.886092 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 17:50:39.886092 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 17:50:39.886092 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 17:50:39.886092 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 50 Aug 10 17:50:39.886092 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 17:50:39.886092 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 17:50:39.886092 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 17:50:39.886092 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 17:50:39.886092 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8-_tmolNyVEl1HQLGDxWXKRbI6-05maiqV6hJMxuhiuELfmXEw6Xk26EYSDX2yqcW0Bca0Q15_uJAdKpyagHj9pGCLqGHebNJYunDfV49tu3FT1N_8cgpdUo0VnqQvqKV6WO2Y7dsEFR51ABnshjk7vLODdnzqiai6YIW_9xddNQRAw Aug 10 17:50:39.886092 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 17:50:39.886092 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 17:50:39.886092 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 17:50:39.886092 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 17:50:39.886092 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 17:50:39.886092 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 17:50:39.886092 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: 72cce85fcbe24246b877061ced8c2d0c Aug 10 17:50:39.886092 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1158414051 Aug 10 17:50:39.886092 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member,admin Aug 10 17:50:39.886092 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member,admin Aug 10 17:50:39.887885 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/72cce85fcbe24246b877061ced8c2d0c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/72cce85fcbe24246b877061ced8c2d0c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/72cce85fcbe24246b877061ced8c2d0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_72cce85fcbe24246b877061ced8c2d0c", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:50:39.887885 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1158414051 Aug 10 17:50:39.887885 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: 72cce85fcbe24246b877061ced8c2d0c Aug 10 17:50:39.887885 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1158414051 Aug 10 17:50:39.887885 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-HostsAdminNegativeTestJSON-1158414051-project-admin Aug 10 17:50:39.887885 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 17:50:39.887885 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 17:50:39.887885 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: f046e2cecd2a47438d0618b4b145ee3f Aug 10 17:50:39.887885 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1158414051-project-admin Aug 10 17:50:39.887885 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 17:50:39.887885 n-d-852296-2 devstack@n-api.service[129410]: {"status": "enable", "maintenance_mode": "enable"} Aug 10 17:50:39.887885 n-d-852296-2 devstack@n-api.service[129410]: method: Aug 10 17:50:39.887885 n-d-852296-2 devstack@n-api.service[129410]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 10 17:50:39.887885 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Aug 10 17:50:39.889245 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:50:39.889245 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:39.889245 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Aug 10 17:50:39.889245 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Aug 10 17:50:39.889245 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 10 17:50:39.889245 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 10 17:50:39.889245 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 10 17:50:39.889245 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 10 17:50:39.889245 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 10 17:50:39.889245 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise self.value Aug 10 17:50:39.889245 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 10 17:50:39.889245 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 10 17:50:39.889245 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5940, in targeted Aug 10 17:50:39.889245 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 10 17:50:39.889245 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 17:50:39.889245 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 17:50:39.889245 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 10 17:50:39.889245 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 10 17:50:39.890915 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 10 17:50:39.890915 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 10 17:50:39.890915 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 10 17:50:39.890915 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 10 17:50:39.890915 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 10 17:50:39.890915 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:39.890915 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:50:39.890915 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:39.890915 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:39.890915 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:50:39.890915 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:50:39.890915 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:50:39.890915 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:50:39.890915 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 17:50:39.890915 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 17:50:39.890915 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:50:39.890915 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:50:39.890915 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:50:39.890915 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:50:39.890915 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Aug 10 17:50:39.892763 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Aug 10 17:50:39.892763 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Aug 10 17:50:39.892763 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:50:39.892763 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 10 17:50:39.892763 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:39.892763 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:50:39.892763 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:39.892763 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:39.892763 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:50:39.892763 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:50:39.892763 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:50:39.892763 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:50:39.892763 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 10 17:50:39.892763 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:39.892763 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-3341ddb0-610e-4719-bf7a-3921edc95baf tempest-HostsAdminNegativeTestJSON-1158414051 tempest-HostsAdminNegativeTestJSON-1158414051-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:50:39.894264 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-3341ddb0-610e-4719-bf7a-3921edc95baf tempest-HostsAdminNegativeTestJSON-1158414051 tempest-HostsAdminNegativeTestJSON-1158414051-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.019829 Aug 10 17:50:39.894264 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 224/432] 10.222.0.50 () {60 vars in 1211 bytes} [Wed Aug 10 17:50:39 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 10 17:50:43.421513 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-85aa4048-4f23-4408-a059-1bf7dca04042 tempest-InstanceUsageAuditLogNegativeTestJSON-198208415 tempest-InstanceUsageAuditLogNegativeTestJSON-198208415-project-admin] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:50:43.424071 n-d-852296-2 devstack@n-api.service[129409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:50:43.424071 n-d-852296-2 devstack@n-api.service[129409]: warnings.warn(msg) Aug 10 17:50:43.425943 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-85aa4048-4f23-4408-a059-1bf7dca04042 tempest-InstanceUsageAuditLogNegativeTestJSON-198208415 tempest-InstanceUsageAuditLogNegativeTestJSON-198208415-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Aug 10 17:50:43.436005 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-85aa4048-4f23-4408-a059-1bf7dca04042 tempest-InstanceUsageAuditLogNegativeTestJSON-198208415 tempest-InstanceUsageAuditLogNegativeTestJSON-198208415-project-admin] Request method failure captured: Aug 10 17:50:43.436005 n-d-852296-2 devstack@n-api.service[129409]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Aug 10 17:50:43.436005 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 17:50:43.436005 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 17:50:43.436005 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 17:50:43.436005 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 0 Aug 10 17:50:43.436005 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 17:50:43.436005 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 17:50:43.436005 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 17:50:43.436005 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 17:50:43.436005 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8-_yhjyMN6r66yJ4VuZOXoukDZuC_dIlnlTroqtiPc-lGLZ7dk_kazz4aNPcTYB8y8hG4JL1wWOnD1FOB1Dr3xZXIt57Q52Zux9sirG86PutEI9Tl840pcE4sDFddX9eAXlocRlxUIWoM6HUeouJnCxWVdjgfewCRSJWAci9TJT6G5U Aug 10 17:50:43.436005 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 17:50:43.436005 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 17:50:43.436005 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 17:50:43.436005 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 17:50:43.436005 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 17:50:43.436005 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 17:50:43.436005 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: 6ae3973d373d40778729cc9580941088 Aug 10 17:50:43.436005 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-198208415 Aug 10 17:50:43.436005 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member,admin Aug 10 17:50:43.436005 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member,admin Aug 10 17:50:43.437769 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6ae3973d373d40778729cc9580941088"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6ae3973d373d40778729cc9580941088"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6ae3973d373d40778729cc9580941088"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6ae3973d373d40778729cc9580941088", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:50:43.437769 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-198208415 Aug 10 17:50:43.437769 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: 6ae3973d373d40778729cc9580941088 Aug 10 17:50:43.437769 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-198208415 Aug 10 17:50:43.437769 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-198208415-project-admin Aug 10 17:50:43.437769 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 17:50:43.437769 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 17:50:43.437769 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: 2410ff46e79d431eb9d8203f98de8128 Aug 10 17:50:43.437769 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-198208415-project-admin Aug 10 17:50:43.437769 n-d-852296-2 devstack@n-api.service[129409]: method: > Aug 10 17:50:43.437769 n-d-852296-2 devstack@n-api.service[129409]: exception: Invalid timestamp for date invalid_time Aug 10 17:50:43.438474 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'id': 'invalid_time'} Aug 10 17:50:43.438474 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:50:43.438474 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:43.438474 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Aug 10 17:50:43.438474 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Aug 10 17:50:43.438474 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Aug 10 17:50:43.438474 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Aug 10 17:50:43.438474 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Aug 10 17:50:43.438474 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Aug 10 17:50:43.438474 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Aug 10 17:50:43.438474 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:50:43.438474 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:50:43.438474 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:50:43.438474 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:43.438474 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:50:43.438474 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:50:43.438474 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:50:43.438474 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:50:43.438474 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:50:43.438474 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:50:43.439776 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Aug 10 17:50:43.439776 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Aug 10 17:50:43.439776 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Aug 10 17:50:43.439776 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:50:43.439776 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:50:43.439776 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:50:43.439776 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:43.439776 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:50:43.439776 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:50:43.439776 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:50:43.439776 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:50:43.439776 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Aug 10 17:50:43.439776 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:50:43.442386 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-85aa4048-4f23-4408-a059-1bf7dca04042 tempest-InstanceUsageAuditLogNegativeTestJSON-198208415 tempest-InstanceUsageAuditLogNegativeTestJSON-198208415-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:50:43.445848 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-85aa4048-4f23-4408-a059-1bf7dca04042 tempest-InstanceUsageAuditLogNegativeTestJSON-198208415 tempest-InstanceUsageAuditLogNegativeTestJSON-198208415-project-admin] 10.222.0.50 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 1.051693 Aug 10 17:50:43.453750 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 209/433] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 10 17:50:42 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 1060 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 10 17:50:43.928866 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-0f9cb111-1225-4329-96df-e87bfd22e255 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-745827441", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452"}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:50:43.981865 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.network.neutron [None req-0f9cb111-1225-4329-96df-e87bfd22e255 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] validate_networks() for None {{(pid=129410) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 17:50:44.027495 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-50a38719-3b9a-4ae8-89fe-d41a6d2392d3 tempest-InstanceUsageAuditLogNegativeTestJSON-776132419 tempest-InstanceUsageAuditLogNegativeTestJSON-776132419-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:50:44.028442 n-d-852296-2 devstack@n-api.service[129409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:50:44.028442 n-d-852296-2 devstack@n-api.service[129409]: warnings.warn(msg) Aug 10 17:50:44.029804 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-50a38719-3b9a-4ae8-89fe-d41a6d2392d3 tempest-InstanceUsageAuditLogNegativeTestJSON-776132419 tempest-InstanceUsageAuditLogNegativeTestJSON-776132419-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': 'e6b8630d8c7b43bc8dec79e3c12113c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88761a54e014783a0b4e5cbe9b77008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:50:44.031441 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-50a38719-3b9a-4ae8-89fe-d41a6d2392d3 tempest-InstanceUsageAuditLogNegativeTestJSON-776132419 tempest-InstanceUsageAuditLogNegativeTestJSON-776132419-project] Request method failure captured: Aug 10 17:50:44.031441 n-d-852296-2 devstack@n-api.service[129409]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Aug 10 17:50:44.031441 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 17:50:44.031441 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 17:50:44.031441 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 17:50:44.031441 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 0 Aug 10 17:50:44.031441 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 17:50:44.031441 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 17:50:44.031441 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 17:50:44.031441 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 17:50:44.031441 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8-_u5q-xv2b3uiNsJSn6DeviLc5B30Z8m9vVrfLbkxvuaJb_DgwPang55LOT0GMBkU9xnTQDzfS0f6JAC7sET2i_Os8X55K2HBUd7QRahE_BlUmtUS10lfJJL6HtBXAt2ehlrmUTkriYc5QehbnO7QmFhvKY_0NfF0gOdouluhZ0gZg Aug 10 17:50:44.031441 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 17:50:44.031441 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 17:50:44.031441 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 17:50:44.031441 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 17:50:44.031441 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 17:50:44.031441 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 17:50:44.031441 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: e88761a54e014783a0b4e5cbe9b77008 Aug 10 17:50:44.031441 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-776132419 Aug 10 17:50:44.031441 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 17:50:44.031441 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 17:50:44.032763 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e88761a54e014783a0b4e5cbe9b77008"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/e88761a54e014783a0b4e5cbe9b77008"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e88761a54e014783a0b4e5cbe9b77008"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_e88761a54e014783a0b4e5cbe9b77008", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:50:44.032763 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-776132419 Aug 10 17:50:44.032763 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: e88761a54e014783a0b4e5cbe9b77008 Aug 10 17:50:44.032763 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-776132419 Aug 10 17:50:44.032763 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-776132419-project Aug 10 17:50:44.032763 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 17:50:44.032763 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 17:50:44.032763 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: e6b8630d8c7b43bc8dec79e3c12113c0 Aug 10 17:50:44.032763 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-776132419-project Aug 10 17:50:44.032763 n-d-852296-2 devstack@n-api.service[129409]: method: > Aug 10 17:50:44.033380 n-d-852296-2 devstack@n-api.service[129409]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Aug 10 17:50:44.033380 n-d-852296-2 devstack@n-api.service[129409]: action_args: {} Aug 10 17:50:44.033380 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:50:44.033380 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:44.033380 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:50:44.033380 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:50:44.033380 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:50:44.033380 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:50:44.033380 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:50:44.033380 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:50:44.033380 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Aug 10 17:50:44.033380 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Aug 10 17:50:44.033380 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 10 17:50:44.033380 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 10 17:50:44.033380 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 10 17:50:44.033380 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 10 17:50:44.033380 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 10 17:50:44.033380 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 10 17:50:44.033380 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 10 17:50:44.033380 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise self.value Aug 10 17:50:44.035191 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 10 17:50:44.035191 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 10 17:50:44.035191 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 10 17:50:44.035191 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 10 17:50:44.035191 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 10 17:50:44.035191 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 10 17:50:44.035191 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Aug 10 17:50:44.035191 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:50:44.035191 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:50:44.035191 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:50:44.035191 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:44.035191 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:50:44.035191 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:50:44.035191 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 10 17:50:44.035191 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 10 17:50:44.035191 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Aug 10 17:50:44.035191 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:50:44.036551 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-50a38719-3b9a-4ae8-89fe-d41a6d2392d3 tempest-InstanceUsageAuditLogNegativeTestJSON-776132419 tempest-InstanceUsageAuditLogNegativeTestJSON-776132419-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:50:44.036551 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-50a38719-3b9a-4ae8-89fe-d41a6d2392d3 tempest-InstanceUsageAuditLogNegativeTestJSON-776132419 tempest-InstanceUsageAuditLogNegativeTestJSON-776132419-project] 10.222.0.50 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.577660 Aug 10 17:50:44.036551 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 210/434] 10.222.0.50 () {58 vars in 1185 bytes} [Wed Aug 10 17:50:43 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 579 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:50:44.189016 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.virt.hardware [None req-0f9cb111-1225-4329-96df-e87bfd22e255 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Flavor limits 0:0:0 {{(pid=129410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 17:50:44.189538 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.virt.hardware [None req-0f9cb111-1225-4329-96df-e87bfd22e255 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Image limits 0:0:0 {{(pid=129410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 17:50:44.190023 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.virt.hardware [None req-0f9cb111-1225-4329-96df-e87bfd22e255 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Flavor pref 0:0:0 {{(pid=129410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 17:50:44.190436 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.virt.hardware [None req-0f9cb111-1225-4329-96df-e87bfd22e255 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Image pref 0:0:0 {{(pid=129410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 17:50:44.190860 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.virt.hardware [None req-0f9cb111-1225-4329-96df-e87bfd22e255 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 17:50:44.200091 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-0f9cb111-1225-4329-96df-e87bfd22e255 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:44.200609 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-0f9cb111-1225-4329-96df-e87bfd22e255 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:44.201094 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-0f9cb111-1225-4329-96df-e87bfd22e255 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:44.201828 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-0f9cb111-1225-4329-96df-e87bfd22e255 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:44.202286 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-0f9cb111-1225-4329-96df-e87bfd22e255 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:44.202713 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-0f9cb111-1225-4329-96df-e87bfd22e255 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:44.221001 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.quota [None req-0f9cb111-1225-4329-96df-e87bfd22e255 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Getting quotas for project 0638146d08704b2983761619745290b3. Resources: {'instances', 'ram', 'cores'} {{(pid=129410) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:50:44.226877 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.quota [None req-0f9cb111-1225-4329-96df-e87bfd22e255 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Getting quotas for user f76b870a54454956b3926c34f9f27442 and project 0638146d08704b2983761619745290b3. Resources: {'instances', 'ram', 'cores'} {{(pid=129410) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:50:44.241732 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-0f9cb111-1225-4329-96df-e87bfd22e255 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Going to run 1 instances... {{(pid=129410) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 17:50:44.244652 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-0f9cb111-1225-4329-96df-e87bfd22e255 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: af745ef7-21f0-4149-ba68-33f45f73f2dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a735ff26-463a-4ffe-a981-ab9d9baa494f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129410) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 17:50:44.274700 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-2bbb65dc-b23f-4317-8f0b-cfebad2417d2 tempest-KeyPairsNegativeTestJSON-139630628 tempest-KeyPairsNegativeTestJSON-139630628-project] Action: 'create', calling method: .version_select at 0x7fb3467f8160>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCP/uxAu92EvRIA2rLhKVGtQaVbCMcIRS9YcURFvRCVuiRC7cFsAODba6heOhOD2K92KehWC3JBaYy0ZCEloupTq2cFidFErqk8qvZX5xZIn9V7Y8W6GcqawDgqxaLKuOg=="}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:50:44.277609 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-2bbb65dc-b23f-4317-8f0b-cfebad2417d2 tempest-KeyPairsNegativeTestJSON-139630628 tempest-KeyPairsNegativeTestJSON-139630628-project] Request method failure captured: Aug 10 17:50:44.277609 n-d-852296-2 devstack@n-api.service[129409]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 10 17:50:44.277609 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 17:50:44.277609 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 17:50:44.277609 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 17:50:44.277609 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 257 Aug 10 17:50:44.277609 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 17:50:44.277609 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 17:50:44.277609 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 17:50:44.277609 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 17:50:44.277609 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8-_z27T-rdu9inrn3ptL1-NOzUeCuwN3cqLiVdAX6O4J3CJMZXs4T0dh65ZxgyW5FDXJLyXohGjafrsD--N1YjOlWtl0MkxR5MKcUMQ-U7VnBWVukUgEQFCKPeaFgjzUUk--xQX_gvM0iLgy38arv9XPGXOcEKYwqJi7DD-sA1WnaEo Aug 10 17:50:44.277609 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 17:50:44.277609 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 17:50:44.277609 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 17:50:44.277609 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 17:50:44.277609 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 17:50:44.277609 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 17:50:44.277609 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: 01ed1d0998ca4419a63aaf623d3ddc27 Aug 10 17:50:44.277609 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-139630628 Aug 10 17:50:44.277609 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 17:50:44.277609 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 17:50:44.279067 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/01ed1d0998ca4419a63aaf623d3ddc27"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/01ed1d0998ca4419a63aaf623d3ddc27"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/01ed1d0998ca4419a63aaf623d3ddc27"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_01ed1d0998ca4419a63aaf623d3ddc27", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:50:44.279067 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-KeyPairsNegativeTestJSON-139630628 Aug 10 17:50:44.279067 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: 01ed1d0998ca4419a63aaf623d3ddc27 Aug 10 17:50:44.279067 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-139630628 Aug 10 17:50:44.279067 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-KeyPairsNegativeTestJSON-139630628-project Aug 10 17:50:44.279067 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 17:50:44.279067 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 17:50:44.279067 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: 284720aef6df4dd18a714409e4e823f9 Aug 10 17:50:44.279067 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-KeyPairsNegativeTestJSON-139630628-project Aug 10 17:50:44.279067 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:50:44.279067 n-d-852296-2 devstack@n-api.service[129409]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCP/uxAu92EvRIA2rLhKVGtQaVbCMcIRS9YcURFvRCVuiRC7cFsAODba6heOhOD2K92KehWC3JBaYy0ZCEloupTq2cFidFErqk8qvZX5xZIn9V7Y8W6GcqawDgqxaLKuOg=="}} Aug 10 17:50:44.279753 n-d-852296-2 devstack@n-api.service[129409]: method: Aug 10 17:50:44.279753 n-d-852296-2 devstack@n-api.service[129409]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 10 17:50:44.279753 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCP/uxAu92EvRIA2rLhKVGtQaVbCMcIRS9YcURFvRCVuiRC7cFsAODba6heOhOD2K92KehWC3JBaYy0ZCEloupTq2cFidFErqk8qvZX5xZIn9V7Y8W6GcqawDgqxaLKuOg=='}}} Aug 10 17:50:44.279753 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:50:44.279753 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:44.279753 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Aug 10 17:50:44.279753 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = func(instance) Aug 10 17:50:44.279753 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Aug 10 17:50:44.279753 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Aug 10 17:50:44.279753 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Aug 10 17:50:44.279753 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Aug 10 17:50:44.279753 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 10 17:50:44.279753 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:50:44.279753 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 10 17:50:44.279753 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:50:44.279753 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:44.279753 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 10 17:50:44.280837 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 10 17:50:44.280837 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 10 17:50:44.280837 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise error Aug 10 17:50:44.280837 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Aug 10 17:50:44.280837 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:50:44.280837 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Aug 10 17:50:44.280837 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Aug 10 17:50:44.280837 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Aug 10 17:50:44.280837 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi 'minLength': 1, Aug 10 17:50:44.280837 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 10 17:50:44.280837 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:50:44.280837 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Aug 10 17:50:44.280837 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Aug 10 17:50:44.280837 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:50:44.280837 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:50:44.280837 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:50:44.280837 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:44.280837 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:50:44.280837 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:50:44.280837 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:50:44.280837 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:50:44.280837 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 17:50:44.280837 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 17:50:44.282252 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:50:44.282252 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:50:44.282252 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:50:44.282252 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:50:44.282252 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 10 17:50:44.282252 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 10 17:50:44.282252 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 10 17:50:44.282252 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 10 17:50:44.282252 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 10 17:50:44.282252 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 10 17:50:44.282252 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 10 17:50:44.282252 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:50:44.282252 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:50:44.282252 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:50:44.282252 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:44.282252 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:50:44.282252 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:50:44.282252 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 10 17:50:44.282252 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 10 17:50:44.283388 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 10 17:50:44.283388 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:50:44.283388 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-2bbb65dc-b23f-4317-8f0b-cfebad2417d2 tempest-KeyPairsNegativeTestJSON-139630628 tempest-KeyPairsNegativeTestJSON-139630628-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:50:44.283388 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-2bbb65dc-b23f-4317-8f0b-cfebad2417d2 tempest-KeyPairsNegativeTestJSON-139630628 tempest-KeyPairsNegativeTestJSON-139630628-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.244612 Aug 10 17:50:44.283388 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 211/435] 10.222.0.50 () {60 vars in 1159 bytes} [Wed Aug 10 17:50:44 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 246 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 10 17:50:44.284129 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-c56ac83c-f127-49d0-9b8a-58b8ad43daa0 tempest-InstanceUsageAuditLogNegativeTestJSON-776132419 tempest-InstanceUsageAuditLogNegativeTestJSON-776132419-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:50:44.285949 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-c56ac83c-f127-49d0-9b8a-58b8ad43daa0 tempest-InstanceUsageAuditLogNegativeTestJSON-776132419 tempest-InstanceUsageAuditLogNegativeTestJSON-776132419-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': 'e6b8630d8c7b43bc8dec79e3c12113c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88761a54e014783a0b4e5cbe9b77008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:50:44.288547 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-c56ac83c-f127-49d0-9b8a-58b8ad43daa0 tempest-InstanceUsageAuditLogNegativeTestJSON-776132419 tempest-InstanceUsageAuditLogNegativeTestJSON-776132419-project] Request method failure captured: Aug 10 17:50:44.288547 n-d-852296-2 devstack@n-api.service[129409]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-08-10%2017:50:44 HTTP/1.1 Aug 10 17:50:44.288547 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 17:50:44.288547 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 17:50:44.288547 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 17:50:44.288547 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 0 Aug 10 17:50:44.288547 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 17:50:44.288547 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 17:50:44.288547 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 17:50:44.288547 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 17:50:44.288547 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8-_u5q-xv2b3uiNsJSn6DeviLc5B30Z8m9vVrfLbkxvuaJb_DgwPang55LOT0GMBkU9xnTQDzfS0f6JAC7sET2i_Os8X55K2HBUd7QRahE_BlUmtUS10lfJJL6HtBXAt2ehlrmUTkriYc5QehbnO7QmFhvKY_0NfF0gOdouluhZ0gZg Aug 10 17:50:44.288547 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 17:50:44.288547 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 17:50:44.288547 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 17:50:44.288547 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 17:50:44.288547 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 17:50:44.288547 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 17:50:44.288547 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: e88761a54e014783a0b4e5cbe9b77008 Aug 10 17:50:44.288547 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-776132419 Aug 10 17:50:44.288547 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 17:50:44.288547 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 17:50:44.290644 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e88761a54e014783a0b4e5cbe9b77008"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/e88761a54e014783a0b4e5cbe9b77008"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e88761a54e014783a0b4e5cbe9b77008"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_e88761a54e014783a0b4e5cbe9b77008", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:50:44.290644 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-776132419 Aug 10 17:50:44.290644 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: e88761a54e014783a0b4e5cbe9b77008 Aug 10 17:50:44.290644 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-776132419 Aug 10 17:50:44.290644 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-776132419-project Aug 10 17:50:44.290644 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 17:50:44.290644 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 17:50:44.290644 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: e6b8630d8c7b43bc8dec79e3c12113c0 Aug 10 17:50:44.290644 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-776132419-project Aug 10 17:50:44.290644 n-d-852296-2 devstack@n-api.service[129409]: method: > Aug 10 17:50:44.291871 n-d-852296-2 devstack@n-api.service[129409]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Aug 10 17:50:44.291871 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'id': '2022-08-10 17:50:44'} Aug 10 17:50:44.291871 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:50:44.291871 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:44.291871 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:50:44.291871 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:50:44.291871 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:50:44.291871 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:50:44.291871 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:50:44.291871 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:50:44.291871 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Aug 10 17:50:44.291871 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Aug 10 17:50:44.291871 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 10 17:50:44.291871 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 10 17:50:44.291871 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 10 17:50:44.291871 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 10 17:50:44.291871 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 10 17:50:44.291871 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 10 17:50:44.291871 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 10 17:50:44.291871 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise self.value Aug 10 17:50:44.294872 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 10 17:50:44.294872 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 10 17:50:44.294872 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 10 17:50:44.294872 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 10 17:50:44.294872 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 10 17:50:44.294872 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 10 17:50:44.294872 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Aug 10 17:50:44.294872 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:50:44.294872 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:50:44.294872 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:50:44.294872 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:44.294872 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:50:44.294872 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:50:44.294872 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 10 17:50:44.294872 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 10 17:50:44.294872 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Aug 10 17:50:44.294872 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:50:44.296785 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-c56ac83c-f127-49d0-9b8a-58b8ad43daa0 tempest-InstanceUsageAuditLogNegativeTestJSON-776132419 tempest-InstanceUsageAuditLogNegativeTestJSON-776132419-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:50:44.296785 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-c56ac83c-f127-49d0-9b8a-58b8ad43daa0 tempest-InstanceUsageAuditLogNegativeTestJSON-776132419 tempest-InstanceUsageAuditLogNegativeTestJSON-776132419-project] 10.222.0.50 "GET /compute/v2.1/os-instance_usage_audit_log/2022-08-10 17:50:44" status: 403 len: 128 microversion: 2.1 time: 0.009493 Aug 10 17:50:44.296785 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 212/436] 10.222.0.50 () {58 vars in 1251 bytes} [Wed Aug 10 17:50:44 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-08-10%2017%3A50%3A44 => generated 128 bytes in 10 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:50:44.297471 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-055f4e7c-b47a-4c46-9e45-88f3eabe3620 tempest-KeyPairsNegativeTestJSON-139630628 tempest-KeyPairsNegativeTestJSON-139630628-project] Action: 'create', calling method: .version_select at 0x7fb34676cf70>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1542436703", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:50:44.311966 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-055f4e7c-b47a-4c46-9e45-88f3eabe3620 tempest-KeyPairsNegativeTestJSON-139630628 tempest-KeyPairsNegativeTestJSON-139630628-project] Getting quotas for project 01ed1d0998ca4419a63aaf623d3ddc27. Resources: {'key_pairs'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:50:44.316723 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-055f4e7c-b47a-4c46-9e45-88f3eabe3620 tempest-KeyPairsNegativeTestJSON-139630628 tempest-KeyPairsNegativeTestJSON-139630628-project] Getting quotas for user 284720aef6df4dd18a714409e4e823f9 and project 01ed1d0998ca4419a63aaf623d3ddc27. Resources: {'key_pairs'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:50:44.334149 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-055f4e7c-b47a-4c46-9e45-88f3eabe3620 tempest-KeyPairsNegativeTestJSON-139630628 tempest-KeyPairsNegativeTestJSON-139630628-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Aug 10 17:50:44.343735 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-055f4e7c-b47a-4c46-9e45-88f3eabe3620 tempest-KeyPairsNegativeTestJSON-139630628 tempest-KeyPairsNegativeTestJSON-139630628-project] Request method failure captured: Aug 10 17:50:44.343735 n-d-852296-2 devstack@n-api.service[129409]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 10 17:50:44.343735 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 17:50:44.343735 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 17:50:44.343735 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 17:50:44.343735 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 2167 Aug 10 17:50:44.343735 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 17:50:44.343735 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 17:50:44.343735 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 17:50:44.343735 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 17:50:44.343735 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8-_z27T-rdu9inrn3ptL1-NOzUeCuwN3cqLiVdAX6O4J3CJMZXs4T0dh65ZxgyW5FDXJLyXohGjafrsD--N1YjOlWtl0MkxR5MKcUMQ-U7VnBWVukUgEQFCKPeaFgjzUUk--xQX_gvM0iLgy38arv9XPGXOcEKYwqJi7DD-sA1WnaEo Aug 10 17:50:44.343735 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 17:50:44.343735 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 17:50:44.343735 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 17:50:44.343735 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 17:50:44.343735 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 17:50:44.343735 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 17:50:44.343735 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: 01ed1d0998ca4419a63aaf623d3ddc27 Aug 10 17:50:44.343735 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-139630628 Aug 10 17:50:44.343735 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 17:50:44.343735 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 17:50:44.343735 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/01ed1d0998ca4419a63aaf623d3ddc27"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/01ed1d0998ca4419a63aaf623d3ddc27"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/01ed1d0998ca4419a63aaf623d3ddc27"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_01ed1d0998ca4419a63aaf623d3ddc27", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:50:44.343735 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-KeyPairsNegativeTestJSON-139630628 Aug 10 17:50:44.343735 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: 01ed1d0998ca4419a63aaf623d3ddc27 Aug 10 17:50:44.343735 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-139630628 Aug 10 17:50:44.343735 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-KeyPairsNegativeTestJSON-139630628-project Aug 10 17:50:44.343735 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 17:50:44.343735 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 17:50:44.343735 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: 284720aef6df4dd18a714409e4e823f9 Aug 10 17:50:44.343735 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-KeyPairsNegativeTestJSON-139630628-project Aug 10 17:50:44.343735 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:50:44.343735 n-d-852296-2 devstack@n-api.service[129409]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1542436703", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Aug 10 17:50:44.343735 n-d-852296-2 devstack@n-api.service[129409]: method: Aug 10 17:50:44.343735 n-d-852296-2 devstack@n-api.service[129409]: exception: Keypair data is invalid: failed to generate fingerprint Aug 10 17:50:44.346362 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1542436703', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Aug 10 17:50:44.346362 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:50:44.346362 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:44.346362 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Aug 10 17:50:44.346362 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Aug 10 17:50:44.346362 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Aug 10 17:50:44.346362 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Aug 10 17:50:44.346362 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Aug 10 17:50:44.346362 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:50:44.346362 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:50:44.346362 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:50:44.346362 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:44.346362 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 10 17:50:44.346362 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 10 17:50:44.346362 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 10 17:50:44.346362 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 10 17:50:44.346362 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 10 17:50:44.346362 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 10 17:50:44.346362 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 10 17:50:44.346362 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise self.value Aug 10 17:50:44.346362 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 10 17:50:44.346362 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 10 17:50:44.346362 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6727, in import_key_pair Aug 10 17:50:44.346362 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Aug 10 17:50:44.346362 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6800, in _generate_fingerprint Aug 10 17:50:44.346362 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Aug 10 17:50:44.346362 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Aug 10 17:50:44.346362 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Aug 10 17:50:44.346362 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Aug 10 17:50:44.346362 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:50:44.346362 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:50:44.346362 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:50:44.346362 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:44.346362 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:50:44.346362 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:50:44.346362 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:50:44.346362 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:50:44.346362 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 17:50:44.346362 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 17:50:44.346362 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:50:44.346362 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:50:44.357741 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:50:44.357741 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:50:44.357741 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:50:44.357741 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:50:44.357741 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 10 17:50:44.357741 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 10 17:50:44.357741 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Aug 10 17:50:44.357741 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Aug 10 17:50:44.357741 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Aug 10 17:50:44.357741 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:50:44.357741 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:50:44.357741 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:50:44.357741 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:44.357741 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:50:44.357741 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:50:44.357741 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:50:44.357741 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:50:44.357741 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Aug 10 17:50:44.357741 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:50:44.357741 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-055f4e7c-b47a-4c46-9e45-88f3eabe3620 tempest-KeyPairsNegativeTestJSON-139630628 tempest-KeyPairsNegativeTestJSON-139630628-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:50:44.357741 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-055f4e7c-b47a-4c46-9e45-88f3eabe3620 tempest-KeyPairsNegativeTestJSON-139630628 tempest-KeyPairsNegativeTestJSON-139630628-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.053395 Aug 10 17:50:44.357741 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 213/437] 10.222.0.50 () {60 vars in 1160 bytes} [Wed Aug 10 17:50:44 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 55 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 10 17:50:44.357741 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-1185cb92-0008-45c8-8399-75335936bffc tempest-KeyPairsNegativeTestJSON-139630628 tempest-KeyPairsNegativeTestJSON-139630628-project] Action: 'create', calling method: .version_select at 0x7fb346711310>, body: {"keypair": {"name": "tempest-keypair-517702061", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBErZNZ4XBNAnFkGSPPGNmFoLqR9y4i5srtNnKta2up5HvNyGSXo7nvEG1rAXW8lNdwpHwaK7g9xVKLpGkG03mchUWXIRSnGUSInSLWhECqmVL3KrbRG5lGgBPvToMeR0Qw=="}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:50:44.374056 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-1185cb92-0008-45c8-8399-75335936bffc tempest-KeyPairsNegativeTestJSON-139630628 tempest-KeyPairsNegativeTestJSON-139630628-project] Getting quotas for project 01ed1d0998ca4419a63aaf623d3ddc27. Resources: {'key_pairs'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:50:44.381006 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-1185cb92-0008-45c8-8399-75335936bffc tempest-KeyPairsNegativeTestJSON-139630628 tempest-KeyPairsNegativeTestJSON-139630628-project] Getting quotas for user 284720aef6df4dd18a714409e4e823f9 and project 01ed1d0998ca4419a63aaf623d3ddc27. Resources: {'key_pairs'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:50:44.461291 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-0f9cb111-1225-4329-96df-e87bfd22e255 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.012317 Aug 10 17:50:44.462348 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 225/438] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 17:50:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1014 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 17:50:44.475030 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-3341300c-4f61-4bd2-817a-652a9cfb81b0 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:50:44.475887 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-3341300c-4f61-4bd2-817a-652a9cfb81b0 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: af745ef7-21f0-4149-ba68-33f45f73f2dd] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:50:44.543364 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-3341300c-4f61-4bd2-817a-652a9cfb81b0 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:50:44.551279 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-3341300c-4f61-4bd2-817a-652a9cfb81b0 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/af745ef7-21f0-4149-ba68-33f45f73f2dd" status: 200 len: 1216 microversion: 2.1 time: 0.081333 Aug 10 17:50:44.562101 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 226/439] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:50:44 2022] GET /compute/v2.1/servers/af745ef7-21f0-4149-ba68-33f45f73f2dd => generated 1216 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:50:44.562281 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-1185cb92-0008-45c8-8399-75335936bffc tempest-KeyPairsNegativeTestJSON-139630628 tempest-KeyPairsNegativeTestJSON-139630628-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.199377 Aug 10 17:50:44.562281 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 214/440] 10.222.0.50 () {60 vars in 1159 bytes} [Wed Aug 10 17:50:44 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:50:44.568278 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-4ee65597-58fc-401f-bc82-896760f2106c tempest-KeyPairsNegativeTestJSON-139630628 tempest-KeyPairsNegativeTestJSON-139630628-project] Action: 'create', calling method: .version_select at 0x7fb3465eff70>, body: {"keypair": {"name": "tempest-keypair-517702061", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEgGRdNNrfmqghkA9PDW4QOmWh+GC501gwCleXc963np4doHOiJfCXeyhjAJkXGbnPVrPaNwt3aO32y3PUs3Ad6PS6PUfIWsoQBYl6ZRBpbnoHB5Kt0Qcysnu894Uplklw=="}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:50:44.584403 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.quota [None req-4ee65597-58fc-401f-bc82-896760f2106c tempest-KeyPairsNegativeTestJSON-139630628 tempest-KeyPairsNegativeTestJSON-139630628-project] Getting quotas for project 01ed1d0998ca4419a63aaf623d3ddc27. Resources: {'key_pairs'} {{(pid=129410) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:50:44.587406 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:DELETE=2 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:50:44.590431 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.quota [None req-4ee65597-58fc-401f-bc82-896760f2106c tempest-KeyPairsNegativeTestJSON-139630628 tempest-KeyPairsNegativeTestJSON-139630628-project] Getting quotas for user 284720aef6df4dd18a714409e4e823f9 and project 01ed1d0998ca4419a63aaf623d3ddc27. Resources: {'key_pairs'} {{(pid=129410) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:50:44.716468 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-4ee65597-58fc-401f-bc82-896760f2106c tempest-KeyPairsNegativeTestJSON-139630628 tempest-KeyPairsNegativeTestJSON-139630628-project] HTTP exception thrown: Key pair 'tempest-keypair-517702061' already exists. Aug 10 17:50:44.720843 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-4ee65597-58fc-401f-bc82-896760f2106c tempest-KeyPairsNegativeTestJSON-139630628 tempest-KeyPairsNegativeTestJSON-139630628-project] Request method failure captured: Aug 10 17:50:44.720843 n-d-852296-2 devstack@n-api.service[129410]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 10 17:50:44.720843 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 17:50:44.720843 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 17:50:44.720843 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 17:50:44.720843 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 272 Aug 10 17:50:44.720843 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 17:50:44.720843 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 17:50:44.720843 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 17:50:44.720843 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 17:50:44.720843 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8-_z27T-rdu9inrn3ptL1-NOzUeCuwN3cqLiVdAX6O4J3CJMZXs4T0dh65ZxgyW5FDXJLyXohGjafrsD--N1YjOlWtl0MkxR5MKcUMQ-U7VnBWVukUgEQFCKPeaFgjzUUk--xQX_gvM0iLgy38arv9XPGXOcEKYwqJi7DD-sA1WnaEo Aug 10 17:50:44.720843 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 17:50:44.720843 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 17:50:44.720843 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 17:50:44.720843 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 17:50:44.720843 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 17:50:44.720843 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 17:50:44.720843 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: 01ed1d0998ca4419a63aaf623d3ddc27 Aug 10 17:50:44.720843 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-139630628 Aug 10 17:50:44.720843 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 17:50:44.720843 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 17:50:44.720843 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/01ed1d0998ca4419a63aaf623d3ddc27"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/01ed1d0998ca4419a63aaf623d3ddc27"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/01ed1d0998ca4419a63aaf623d3ddc27"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_01ed1d0998ca4419a63aaf623d3ddc27", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:50:44.720843 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-KeyPairsNegativeTestJSON-139630628 Aug 10 17:50:44.720843 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: 01ed1d0998ca4419a63aaf623d3ddc27 Aug 10 17:50:44.720843 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-139630628 Aug 10 17:50:44.720843 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-KeyPairsNegativeTestJSON-139630628-project Aug 10 17:50:44.720843 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 17:50:44.720843 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 17:50:44.720843 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: 284720aef6df4dd18a714409e4e823f9 Aug 10 17:50:44.720843 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-KeyPairsNegativeTestJSON-139630628-project Aug 10 17:50:44.720843 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 17:50:44.720843 n-d-852296-2 devstack@n-api.service[129410]: {"keypair": {"name": "tempest-keypair-517702061", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEgGRdNNrfmqghkA9PDW4QOmWh+GC501gwCleXc963np4doHOiJfCXeyhjAJkXGbnPVrPaNwt3aO32y3PUs3Ad6PS6PUfIWsoQBYl6ZRBpbnoHB5Kt0Qcysnu894Uplklw=="}} Aug 10 17:50:44.720843 n-d-852296-2 devstack@n-api.service[129410]: method: Aug 10 17:50:44.720843 n-d-852296-2 devstack@n-api.service[129410]: exception: Key pair 'tempest-keypair-517702061' already exists. Aug 10 17:50:44.720843 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-517702061', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEgGRdNNrfmqghkA9PDW4QOmWh+GC501gwCleXc963np4doHOiJfCXeyhjAJkXGbnPVrPaNwt3aO32y3PUs3Ad6PS6PUfIWsoQBYl6ZRBpbnoHB5Kt0Qcysnu894Uplklw=='}}} Aug 10 17:50:44.720843 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:50:44.720843 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:44.720843 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 10 17:50:44.720843 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 10 17:50:44.720843 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 10 17:50:44.720843 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 10 17:50:44.720843 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 10 17:50:44.720843 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 10 17:50:44.720843 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 10 17:50:44.720843 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 10 17:50:44.720843 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 10 17:50:44.720843 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 10 17:50:44.720843 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 10 17:50:44.720843 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result.read() Aug 10 17:50:44.720843 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 10 17:50:44.720843 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 10 17:50:44.720843 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 10 17:50:44.720843 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 10 17:50:44.720843 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 10 17:50:44.720843 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 10 17:50:44.720843 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 10 17:50:44.720843 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 10 17:50:44.720843 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '284720aef6df4dd18a714409e4e823f9-tempest-keypair-517702061' for key 'key_pairs.uniq_key_pairs0user_id0name'") Aug 10 17:50:44.720843 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:44.733523 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 10 17:50:44.733523 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:44.733523 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:44.733523 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Aug 10 17:50:44.733523 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi kp.save(context.session) Aug 10 17:50:44.733523 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Aug 10 17:50:44.733523 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi session.flush() Aug 10 17:50:44.733523 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 10 17:50:44.733523 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._flush(objects) Aug 10 17:50:44.733523 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 10 17:50:44.733523 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Aug 10 17:50:44.733523 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 10 17:50:44.733523 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi compat.raise_( Aug 10 17:50:44.733523 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 10 17:50:44.733523 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exception Aug 10 17:50:44.733523 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 10 17:50:44.733523 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi flush_context.execute() Aug 10 17:50:44.733523 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 10 17:50:44.733523 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi rec.execute(self) Aug 10 17:50:44.733523 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 10 17:50:44.733523 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Aug 10 17:50:44.733523 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 10 17:50:44.733523 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Aug 10 17:50:44.733523 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 10 17:50:44.733523 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Aug 10 17:50:44.733523 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 10 17:50:44.733523 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Aug 10 17:50:44.733523 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 10 17:50:44.733523 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Aug 10 17:50:44.733523 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 10 17:50:44.733523 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Aug 10 17:50:44.733523 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 10 17:50:44.733523 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Aug 10 17:50:44.733523 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 10 17:50:44.733523 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 10 17:50:44.733523 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 10 17:50:44.733523 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exception Aug 10 17:50:44.733523 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 10 17:50:44.733523 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 10 17:50:44.733523 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 10 17:50:44.733523 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 10 17:50:44.733523 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 10 17:50:44.733523 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 10 17:50:44.733523 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 10 17:50:44.733523 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 10 17:50:44.733523 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 10 17:50:44.733523 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 10 17:50:44.733523 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 10 17:50:44.733523 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result.read() Aug 10 17:50:44.733523 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 10 17:50:44.733523 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 10 17:50:44.733523 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 10 17:50:44.733523 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 10 17:50:44.733523 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 10 17:50:44.733523 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 10 17:50:44.733523 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 10 17:50:44.742926 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 10 17:50:44.742926 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '284720aef6df4dd18a714409e4e823f9-tempest-keypair-517702061' for key 'key_pairs.uniq_key_pairs0user_id0name'") Aug 10 17:50:44.742926 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Aug 10 17:50:44.742926 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 8, 10, 17, 50, 44, 611883), 'updated_at': None, 'name': 'tempest-keypair-517702061', 'user_id': '284720aef6df4dd18a714409e4e823f9', 'fingerprint': '59:9c:a2:26:e6:8b:d7:80:1b:25:5e:e1:c0:c4:0a:0e', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEgGRdNNrfmqghkA9PDW4QOmWh+GC501gwCleXc963np4doHOiJfCXeyhjAJkXGbnPVrPaNwt3aO32y3PUs3Ad6PS6PUfIWsoQBYl6ZRBpbnoHB5Kt0Qcysnu894Uplklw==', 'type': 'ssh'}] Aug 10 17:50:44.742926 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 10 17:50:44.742926 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:44.742926 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:50:44.742926 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:44.742926 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:44.742926 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 10 17:50:44.742926 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 10 17:50:44.742926 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 10 17:50:44.742926 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 10 17:50:44.742926 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 10 17:50:44.742926 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 10 17:50:44.742926 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 10 17:50:44.742926 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise self.value Aug 10 17:50:44.742926 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 10 17:50:44.742926 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 10 17:50:44.742926 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6730, in import_key_pair Aug 10 17:50:44.742926 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi keypair.create() Aug 10 17:50:44.742926 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 10 17:50:44.742926 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 10 17:50:44.742926 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Aug 10 17:50:44.742926 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._create() Aug 10 17:50:44.742926 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Aug 10 17:50:44.742926 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Aug 10 17:50:44.742926 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Aug 10 17:50:44.742926 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Aug 10 17:50:44.742926 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 10 17:50:44.742926 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 10 17:50:44.742926 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Aug 10 17:50:44.742926 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Aug 10 17:50:44.742926 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-517702061' already exists. Aug 10 17:50:44.742926 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:44.742926 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:50:44.742926 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:44.742926 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:44.742926 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:50:44.742926 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:50:44.742926 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:50:44.742926 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:50:44.742926 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 17:50:44.742926 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 17:50:44.742926 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:50:44.742926 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:50:44.742926 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:50:44.742926 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:50:44.742926 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:50:44.742926 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:50:44.742926 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 10 17:50:44.742926 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 10 17:50:44.742926 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Aug 10 17:50:44.742926 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Aug 10 17:50:44.742926 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-517702061' already exists. Aug 10 17:50:44.749583 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:44.749583 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:50:44.749583 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:44.749583 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:44.749583 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:50:44.749583 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:50:44.749583 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:50:44.749583 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:50:44.749583 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-517702061' already exists. Aug 10 17:50:44.749583 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:44.749583 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-4ee65597-58fc-401f-bc82-896760f2106c tempest-KeyPairsNegativeTestJSON-139630628 tempest-KeyPairsNegativeTestJSON-139630628-project] Returning 409 to user: Key pair 'tempest-keypair-517702061' already exists. {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:50:44.749583 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-4ee65597-58fc-401f-bc82-896760f2106c tempest-KeyPairsNegativeTestJSON-139630628 tempest-KeyPairsNegativeTestJSON-139630628-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 409 len: 104 microversion: 2.1 time: 0.162460 Aug 10 17:50:44.749583 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 227/441] 10.222.0.50 () {60 vars in 1159 bytes} [Wed Aug 10 17:50:44 2022] POST /compute/v2.1/os-keypairs => generated 104 bytes in 164 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 10 17:50:44.751349 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-f43d2595-1c94-4201-af59-5a8b83412e18 tempest-KeyPairsNegativeTestJSON-139630628 tempest-KeyPairsNegativeTestJSON-139630628-project] Calling method '.version_select at 0x7fb346806550>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:50:45.028156 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-f43d2595-1c94-4201-af59-5a8b83412e18 tempest-KeyPairsNegativeTestJSON-139630628 tempest-KeyPairsNegativeTestJSON-139630628-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-517702061" status: 202 len: 0 microversion: 2.1 time: 0.296833 Aug 10 17:50:45.029031 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 215/442] 10.222.0.50 () {58 vars in 1218 bytes} [Wed Aug 10 17:50:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-517702061 => generated 0 bytes in 299 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 17:50:45.041692 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-1a0338e3-542c-4d7a-8eb9-86ba8e545f4d tempest-KeyPairsNegativeTestJSON-139630628 tempest-KeyPairsNegativeTestJSON-139630628-project] Action: 'create', calling method: .version_select at 0x7fb3465ef700>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHol3BrBdUxHzA8e1WoIgVzOW1PlYMNyrMe2RO1pJjRMTZ1EviClz4ppslc+2q8n3CqDUtK+3q1VFhf2ivXJsj0lf/SxJN9EoybCb3ajG7CjwkZXwcnNUtyhmoqDzsYp0Q=="}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:50:45.045313 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-1a0338e3-542c-4d7a-8eb9-86ba8e545f4d tempest-KeyPairsNegativeTestJSON-139630628 tempest-KeyPairsNegativeTestJSON-139630628-project] Request method failure captured: Aug 10 17:50:45.045313 n-d-852296-2 devstack@n-api.service[129410]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 10 17:50:45.045313 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 17:50:45.045313 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 17:50:45.045313 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 17:50:45.045313 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 247 Aug 10 17:50:45.045313 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 17:50:45.045313 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 17:50:45.045313 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 17:50:45.045313 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 17:50:45.045313 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8-_z27T-rdu9inrn3ptL1-NOzUeCuwN3cqLiVdAX6O4J3CJMZXs4T0dh65ZxgyW5FDXJLyXohGjafrsD--N1YjOlWtl0MkxR5MKcUMQ-U7VnBWVukUgEQFCKPeaFgjzUUk--xQX_gvM0iLgy38arv9XPGXOcEKYwqJi7DD-sA1WnaEo Aug 10 17:50:45.045313 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 17:50:45.045313 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 17:50:45.045313 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 17:50:45.045313 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 17:50:45.045313 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 17:50:45.045313 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 17:50:45.045313 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: 01ed1d0998ca4419a63aaf623d3ddc27 Aug 10 17:50:45.045313 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-139630628 Aug 10 17:50:45.045313 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 17:50:45.045313 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 17:50:45.045313 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/01ed1d0998ca4419a63aaf623d3ddc27"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/01ed1d0998ca4419a63aaf623d3ddc27"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/01ed1d0998ca4419a63aaf623d3ddc27"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_01ed1d0998ca4419a63aaf623d3ddc27", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:50:45.045313 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-KeyPairsNegativeTestJSON-139630628 Aug 10 17:50:45.045313 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: 01ed1d0998ca4419a63aaf623d3ddc27 Aug 10 17:50:45.045313 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-139630628 Aug 10 17:50:45.045313 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-KeyPairsNegativeTestJSON-139630628-project Aug 10 17:50:45.045313 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 17:50:45.045313 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 17:50:45.045313 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: 284720aef6df4dd18a714409e4e823f9 Aug 10 17:50:45.045313 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-KeyPairsNegativeTestJSON-139630628-project Aug 10 17:50:45.045313 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 17:50:45.045313 n-d-852296-2 devstack@n-api.service[129410]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHol3BrBdUxHzA8e1WoIgVzOW1PlYMNyrMe2RO1pJjRMTZ1EviClz4ppslc+2q8n3CqDUtK+3q1VFhf2ivXJsj0lf/SxJN9EoybCb3ajG7CjwkZXwcnNUtyhmoqDzsYp0Q=="}} Aug 10 17:50:45.045313 n-d-852296-2 devstack@n-api.service[129410]: method: Aug 10 17:50:45.045313 n-d-852296-2 devstack@n-api.service[129410]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 10 17:50:45.045313 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHol3BrBdUxHzA8e1WoIgVzOW1PlYMNyrMe2RO1pJjRMTZ1EviClz4ppslc+2q8n3CqDUtK+3q1VFhf2ivXJsj0lf/SxJN9EoybCb3ajG7CjwkZXwcnNUtyhmoqDzsYp0Q=='}}} Aug 10 17:50:45.045313 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:50:45.045313 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:45.045313 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 10 17:50:45.045313 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 10 17:50:45.045313 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 10 17:50:45.045313 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise error Aug 10 17:50:45.045313 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 10 17:50:45.045313 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:45.045313 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Aug 10 17:50:45.045313 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 10 17:50:45.045313 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:45.045313 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi On instance['keypair']: Aug 10 17:50:45.045313 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi '' Aug 10 17:50:45.045313 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:45.045313 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:50:45.045313 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:45.045313 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:45.045313 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:50:45.045313 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:50:45.045313 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:50:45.045313 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:50:45.045313 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 17:50:45.045313 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 17:50:45.045313 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:50:45.045313 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:50:45.045313 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:50:45.045313 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:50:45.045313 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 10 17:50:45.045313 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 10 17:50:45.050378 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 10 17:50:45.050378 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 10 17:50:45.050378 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 10 17:50:45.050378 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 10 17:50:45.050378 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 10 17:50:45.050378 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:45.050378 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:50:45.050378 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:45.050378 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:45.050378 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:50:45.050378 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:50:45.050378 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 10 17:50:45.050378 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 10 17:50:45.050378 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 10 17:50:45.050378 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:45.050378 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-1a0338e3-542c-4d7a-8eb9-86ba8e545f4d tempest-KeyPairsNegativeTestJSON-139630628 tempest-KeyPairsNegativeTestJSON-139630628-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:50:45.050378 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-1a0338e3-542c-4d7a-8eb9-86ba8e545f4d tempest-KeyPairsNegativeTestJSON-139630628 tempest-KeyPairsNegativeTestJSON-139630628-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.010169 Aug 10 17:50:45.050378 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 228/443] 10.222.0.50 () {60 vars in 1159 bytes} [Wed Aug 10 17:50:45 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 10 17:50:45.058241 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-1e4b0b81-c3db-427b-b9c6-ae202729a621 tempest-KeyPairsNegativeTestJSON-139630628 tempest-KeyPairsNegativeTestJSON-139630628-project] Action: 'create', calling method: .version_select at 0x7fb34697f700>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1060128625", "public_key": " "}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:50:45.078214 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-1e4b0b81-c3db-427b-b9c6-ae202729a621 tempest-KeyPairsNegativeTestJSON-139630628 tempest-KeyPairsNegativeTestJSON-139630628-project] Getting quotas for project 01ed1d0998ca4419a63aaf623d3ddc27. Resources: {'key_pairs'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:50:45.083773 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-1e4b0b81-c3db-427b-b9c6-ae202729a621 tempest-KeyPairsNegativeTestJSON-139630628 tempest-KeyPairsNegativeTestJSON-139630628-project] Getting quotas for user 284720aef6df4dd18a714409e4e823f9 and project 01ed1d0998ca4419a63aaf623d3ddc27. Resources: {'key_pairs'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:50:45.100655 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-1e4b0b81-c3db-427b-b9c6-ae202729a621 tempest-KeyPairsNegativeTestJSON-139630628 tempest-KeyPairsNegativeTestJSON-139630628-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Aug 10 17:50:45.102718 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-1e4b0b81-c3db-427b-b9c6-ae202729a621 tempest-KeyPairsNegativeTestJSON-139630628 tempest-KeyPairsNegativeTestJSON-139630628-project] Request method failure captured: Aug 10 17:50:45.102718 n-d-852296-2 devstack@n-api.service[129409]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 10 17:50:45.102718 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 17:50:45.102718 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 17:50:45.102718 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 17:50:45.102718 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 95 Aug 10 17:50:45.102718 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 17:50:45.102718 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 17:50:45.102718 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 17:50:45.102718 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 17:50:45.102718 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8-_z27T-rdu9inrn3ptL1-NOzUeCuwN3cqLiVdAX6O4J3CJMZXs4T0dh65ZxgyW5FDXJLyXohGjafrsD--N1YjOlWtl0MkxR5MKcUMQ-U7VnBWVukUgEQFCKPeaFgjzUUk--xQX_gvM0iLgy38arv9XPGXOcEKYwqJi7DD-sA1WnaEo Aug 10 17:50:45.102718 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 17:50:45.102718 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 17:50:45.102718 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 17:50:45.102718 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 17:50:45.102718 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 17:50:45.102718 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 17:50:45.102718 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: 01ed1d0998ca4419a63aaf623d3ddc27 Aug 10 17:50:45.102718 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-139630628 Aug 10 17:50:45.102718 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 17:50:45.102718 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 17:50:45.102718 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/01ed1d0998ca4419a63aaf623d3ddc27"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/01ed1d0998ca4419a63aaf623d3ddc27"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/01ed1d0998ca4419a63aaf623d3ddc27"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_01ed1d0998ca4419a63aaf623d3ddc27", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:50:45.102718 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-KeyPairsNegativeTestJSON-139630628 Aug 10 17:50:45.102718 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: 01ed1d0998ca4419a63aaf623d3ddc27 Aug 10 17:50:45.102718 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-139630628 Aug 10 17:50:45.102718 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-KeyPairsNegativeTestJSON-139630628-project Aug 10 17:50:45.102718 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 17:50:45.102718 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 17:50:45.102718 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: 284720aef6df4dd18a714409e4e823f9 Aug 10 17:50:45.102718 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-KeyPairsNegativeTestJSON-139630628-project Aug 10 17:50:45.102718 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:50:45.102718 n-d-852296-2 devstack@n-api.service[129409]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1060128625", "public_key": " "}} Aug 10 17:50:45.102718 n-d-852296-2 devstack@n-api.service[129409]: method: Aug 10 17:50:45.102718 n-d-852296-2 devstack@n-api.service[129409]: exception: Keypair data is invalid: failed to generate fingerprint Aug 10 17:50:45.102718 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1060128625', 'public_key': ' '}}} Aug 10 17:50:45.102718 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:50:45.102718 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:45.102718 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Aug 10 17:50:45.102718 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Aug 10 17:50:45.102718 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Aug 10 17:50:45.102718 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Aug 10 17:50:45.102718 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Aug 10 17:50:45.102718 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:50:45.102718 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:50:45.102718 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:50:45.102718 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:45.102718 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 10 17:50:45.102718 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 10 17:50:45.102718 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 10 17:50:45.102718 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 10 17:50:45.102718 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 10 17:50:45.102718 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 10 17:50:45.102718 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 10 17:50:45.102718 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise self.value Aug 10 17:50:45.102718 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 10 17:50:45.102718 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 10 17:50:45.102718 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6727, in import_key_pair Aug 10 17:50:45.102718 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Aug 10 17:50:45.102718 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6800, in _generate_fingerprint Aug 10 17:50:45.102718 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Aug 10 17:50:45.102718 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Aug 10 17:50:45.102718 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Aug 10 17:50:45.102718 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Aug 10 17:50:45.102718 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:50:45.102718 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:50:45.102718 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:50:45.107180 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:45.107180 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:50:45.107180 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:50:45.107180 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:50:45.107180 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:50:45.107180 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 17:50:45.107180 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 17:50:45.107180 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:50:45.107180 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:50:45.107180 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:50:45.107180 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:50:45.107180 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:50:45.107180 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:50:45.107180 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 10 17:50:45.107180 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 10 17:50:45.107180 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Aug 10 17:50:45.107180 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Aug 10 17:50:45.107180 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Aug 10 17:50:45.107180 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:50:45.107180 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:50:45.107180 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:50:45.107180 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:45.107180 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:50:45.107180 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:50:45.107180 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:50:45.107180 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:50:45.107180 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Aug 10 17:50:45.107180 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:50:45.107180 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-1e4b0b81-c3db-427b-b9c6-ae202729a621 tempest-KeyPairsNegativeTestJSON-139630628 tempest-KeyPairsNegativeTestJSON-139630628-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:50:45.107180 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-1e4b0b81-c3db-427b-b9c6-ae202729a621 tempest-KeyPairsNegativeTestJSON-139630628 tempest-KeyPairsNegativeTestJSON-139630628-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.050002 Aug 10 17:50:45.107180 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 216/444] 10.222.0.50 () {60 vars in 1158 bytes} [Wed Aug 10 17:50:45 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 51 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 10 17:50:45.116711 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-25a191e9-6ea2-4018-816c-26e213f75b99 tempest-KeyPairsNegativeTestJSON-139630628 tempest-KeyPairsNegativeTestJSON-139630628-project] Action: 'create', calling method: .version_select at 0x7fb346601af0>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPZgf/VYbsuiRfQxnBlPYN5qXSzyY4zVvfDrS1878xE6GhfjyT7WD+D6G7AqkncuptJp89bKuaHXbs54ATvuMgxaUjHyYKSlqACDj+H0dp/93B4okJkyNpCeUaQEvZjdCQ=="}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:50:45.120920 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-25a191e9-6ea2-4018-816c-26e213f75b99 tempest-KeyPairsNegativeTestJSON-139630628 tempest-KeyPairsNegativeTestJSON-139630628-project] Request method failure captured: Aug 10 17:50:45.120920 n-d-852296-2 devstack@n-api.service[129410]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 10 17:50:45.120920 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 17:50:45.120920 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 17:50:45.120920 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 17:50:45.120920 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 507 Aug 10 17:50:45.120920 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 17:50:45.120920 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 17:50:45.120920 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 17:50:45.120920 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 17:50:45.120920 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8-_z27T-rdu9inrn3ptL1-NOzUeCuwN3cqLiVdAX6O4J3CJMZXs4T0dh65ZxgyW5FDXJLyXohGjafrsD--N1YjOlWtl0MkxR5MKcUMQ-U7VnBWVukUgEQFCKPeaFgjzUUk--xQX_gvM0iLgy38arv9XPGXOcEKYwqJi7DD-sA1WnaEo Aug 10 17:50:45.120920 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 17:50:45.120920 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 17:50:45.120920 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 17:50:45.120920 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 17:50:45.120920 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 17:50:45.120920 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 17:50:45.120920 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: 01ed1d0998ca4419a63aaf623d3ddc27 Aug 10 17:50:45.120920 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-139630628 Aug 10 17:50:45.120920 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 17:50:45.120920 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 17:50:45.120920 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/01ed1d0998ca4419a63aaf623d3ddc27"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/01ed1d0998ca4419a63aaf623d3ddc27"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/01ed1d0998ca4419a63aaf623d3ddc27"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_01ed1d0998ca4419a63aaf623d3ddc27", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:50:45.120920 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-KeyPairsNegativeTestJSON-139630628 Aug 10 17:50:45.120920 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: 01ed1d0998ca4419a63aaf623d3ddc27 Aug 10 17:50:45.120920 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-139630628 Aug 10 17:50:45.120920 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-KeyPairsNegativeTestJSON-139630628-project Aug 10 17:50:45.120920 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 17:50:45.120920 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 17:50:45.120920 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: 284720aef6df4dd18a714409e4e823f9 Aug 10 17:50:45.120920 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-KeyPairsNegativeTestJSON-139630628-project Aug 10 17:50:45.120920 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 17:50:45.120920 n-d-852296-2 devstack@n-api.service[129410]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPZgf/VYbsuiRfQxnBlPYN5qXSzyY4zVvfDrS1878xE6GhfjyT7WD+D6G7AqkncuptJp89bKuaHXbs54ATvuMgxaUjHyYKSlqACDj+H0dp/93B4okJkyNpCeUaQEvZjdCQ=="}} Aug 10 17:50:45.120920 n-d-852296-2 devstack@n-api.service[129410]: method: Aug 10 17:50:45.120920 n-d-852296-2 devstack@n-api.service[129410]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 10 17:50:45.120920 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPZgf/VYbsuiRfQxnBlPYN5qXSzyY4zVvfDrS1878xE6GhfjyT7WD+D6G7AqkncuptJp89bKuaHXbs54ATvuMgxaUjHyYKSlqACDj+H0dp/93B4okJkyNpCeUaQEvZjdCQ=='}}} Aug 10 17:50:45.120920 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:50:45.120920 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:45.120920 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 10 17:50:45.120920 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 10 17:50:45.120920 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 10 17:50:45.120920 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise error Aug 10 17:50:45.120920 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 10 17:50:45.120920 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:45.120920 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Aug 10 17:50:45.120920 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 10 17:50:45.120920 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:45.120920 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi On instance['keypair']: Aug 10 17:50:45.120920 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Aug 10 17:50:45.124003 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:45.124003 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:50:45.124003 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:45.124003 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:45.124003 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:50:45.124003 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:50:45.124003 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:50:45.124003 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:50:45.124003 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 17:50:45.124003 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 17:50:45.124003 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:50:45.124003 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:50:45.124003 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:50:45.124003 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:50:45.124003 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 10 17:50:45.124003 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 10 17:50:45.124003 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 10 17:50:45.124003 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 10 17:50:45.124003 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 10 17:50:45.124003 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 10 17:50:45.124003 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 10 17:50:45.124003 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:45.124003 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:50:45.124003 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:45.124003 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:45.124003 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:50:45.124003 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:50:45.124003 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 10 17:50:45.124003 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 10 17:50:45.124003 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 10 17:50:45.124003 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:45.124003 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-25a191e9-6ea2-4018-816c-26e213f75b99 tempest-KeyPairsNegativeTestJSON-139630628 tempest-KeyPairsNegativeTestJSON-139630628-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:50:45.124003 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-25a191e9-6ea2-4018-816c-26e213f75b99 tempest-KeyPairsNegativeTestJSON-139630628 tempest-KeyPairsNegativeTestJSON-139630628-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.009927 Aug 10 17:50:45.124003 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 229/445] 10.222.0.50 () {60 vars in 1159 bytes} [Wed Aug 10 17:50:45 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 10 17:50:45.134716 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-3021d084-d752-4cb2-80de-9c0196c18a16 tempest-KeyPairsNegativeTestJSON-139630628 tempest-KeyPairsNegativeTestJSON-139630628-project] Action: 'create', calling method: .version_select at 0x7fb346738550>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1791573938", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:50:45.151598 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-3021d084-d752-4cb2-80de-9c0196c18a16 tempest-KeyPairsNegativeTestJSON-139630628 tempest-KeyPairsNegativeTestJSON-139630628-project] Getting quotas for project 01ed1d0998ca4419a63aaf623d3ddc27. Resources: {'key_pairs'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:50:45.156217 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-3021d084-d752-4cb2-80de-9c0196c18a16 tempest-KeyPairsNegativeTestJSON-139630628 tempest-KeyPairsNegativeTestJSON-139630628-project] Getting quotas for user 284720aef6df4dd18a714409e4e823f9 and project 01ed1d0998ca4419a63aaf623d3ddc27. Resources: {'key_pairs'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:50:45.172736 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-3021d084-d752-4cb2-80de-9c0196c18a16 tempest-KeyPairsNegativeTestJSON-139630628 tempest-KeyPairsNegativeTestJSON-139630628-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Aug 10 17:50:45.174647 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-3021d084-d752-4cb2-80de-9c0196c18a16 tempest-KeyPairsNegativeTestJSON-139630628 tempest-KeyPairsNegativeTestJSON-139630628-project] Request method failure captured: Aug 10 17:50:45.174647 n-d-852296-2 devstack@n-api.service[129409]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 10 17:50:45.174647 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 17:50:45.174647 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 17:50:45.174647 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 17:50:45.174647 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 118 Aug 10 17:50:45.174647 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 17:50:45.174647 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 17:50:45.174647 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 17:50:45.174647 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 17:50:45.174647 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8-_z27T-rdu9inrn3ptL1-NOzUeCuwN3cqLiVdAX6O4J3CJMZXs4T0dh65ZxgyW5FDXJLyXohGjafrsD--N1YjOlWtl0MkxR5MKcUMQ-U7VnBWVukUgEQFCKPeaFgjzUUk--xQX_gvM0iLgy38arv9XPGXOcEKYwqJi7DD-sA1WnaEo Aug 10 17:50:45.174647 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 17:50:45.174647 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 17:50:45.174647 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 17:50:45.174647 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 17:50:45.174647 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 17:50:45.174647 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 17:50:45.174647 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: 01ed1d0998ca4419a63aaf623d3ddc27 Aug 10 17:50:45.174647 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-139630628 Aug 10 17:50:45.174647 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 17:50:45.174647 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 17:50:45.174647 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/01ed1d0998ca4419a63aaf623d3ddc27"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/01ed1d0998ca4419a63aaf623d3ddc27"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/01ed1d0998ca4419a63aaf623d3ddc27"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_01ed1d0998ca4419a63aaf623d3ddc27", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:50:45.174647 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-KeyPairsNegativeTestJSON-139630628 Aug 10 17:50:45.174647 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: 01ed1d0998ca4419a63aaf623d3ddc27 Aug 10 17:50:45.174647 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-139630628 Aug 10 17:50:45.174647 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-KeyPairsNegativeTestJSON-139630628-project Aug 10 17:50:45.174647 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 17:50:45.174647 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 17:50:45.174647 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: 284720aef6df4dd18a714409e4e823f9 Aug 10 17:50:45.174647 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-KeyPairsNegativeTestJSON-139630628-project Aug 10 17:50:45.174647 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:50:45.174647 n-d-852296-2 devstack@n-api.service[129409]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1791573938", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Aug 10 17:50:45.174647 n-d-852296-2 devstack@n-api.service[129409]: method: Aug 10 17:50:45.174647 n-d-852296-2 devstack@n-api.service[129409]: exception: Keypair data is invalid: failed to generate fingerprint Aug 10 17:50:45.174647 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1791573938', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Aug 10 17:50:45.174647 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:50:45.174647 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:45.174647 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Aug 10 17:50:45.174647 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Aug 10 17:50:45.174647 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Aug 10 17:50:45.174647 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Aug 10 17:50:45.174647 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Aug 10 17:50:45.174647 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Aug 10 17:50:45.174647 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Aug 10 17:50:45.174647 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Aug 10 17:50:45.174647 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Aug 10 17:50:45.174647 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:50:45.174647 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:50:45.174647 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:50:45.174647 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:45.174647 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 10 17:50:45.174647 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 10 17:50:45.174647 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 10 17:50:45.174647 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 10 17:50:45.174647 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 10 17:50:45.174647 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 10 17:50:45.174647 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 10 17:50:45.174647 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise self.value Aug 10 17:50:45.174647 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 10 17:50:45.174647 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 10 17:50:45.174647 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6727, in import_key_pair Aug 10 17:50:45.174647 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Aug 10 17:50:45.174647 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6800, in _generate_fingerprint Aug 10 17:50:45.174647 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Aug 10 17:50:45.180306 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Aug 10 17:50:45.180306 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Aug 10 17:50:45.180306 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Aug 10 17:50:45.180306 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:50:45.180306 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:50:45.180306 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:50:45.180306 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:45.180306 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:50:45.180306 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:50:45.180306 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:50:45.180306 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:50:45.180306 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 17:50:45.180306 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 17:50:45.180306 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:50:45.180306 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:50:45.180306 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:50:45.180306 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:50:45.180306 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:50:45.180306 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:50:45.180306 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 10 17:50:45.180306 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 10 17:50:45.180306 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Aug 10 17:50:45.180306 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Aug 10 17:50:45.180306 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Aug 10 17:50:45.180306 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:50:45.180306 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:50:45.180306 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:50:45.180306 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:45.180306 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:50:45.180306 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:50:45.180306 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:50:45.180306 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:50:45.180306 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Aug 10 17:50:45.180306 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:50:45.180306 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-3021d084-d752-4cb2-80de-9c0196c18a16 tempest-KeyPairsNegativeTestJSON-139630628 tempest-KeyPairsNegativeTestJSON-139630628-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:50:45.180306 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-3021d084-d752-4cb2-80de-9c0196c18a16 tempest-KeyPairsNegativeTestJSON-139630628 tempest-KeyPairsNegativeTestJSON-139630628-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.046257 Aug 10 17:50:45.180306 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 217/446] 10.222.0.50 () {60 vars in 1159 bytes} [Wed Aug 10 17:50:45 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 47 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Aug 10 17:50:45.187865 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-19cf8542-b2a1-4b8a-a97e-94fcb4513fe6 tempest-KeyPairsNegativeTestJSON-139630628 tempest-KeyPairsNegativeTestJSON-139630628-project] Calling method '.version_select at 0x7fb346562160>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:50:45.199044 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-19cf8542-b2a1-4b8a-a97e-94fcb4513fe6 tempest-KeyPairsNegativeTestJSON-139630628 tempest-KeyPairsNegativeTestJSON-139630628-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-1777420456 not found for user 284720aef6df4dd18a714409e4e823f9 Aug 10 17:50:45.200792 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-19cf8542-b2a1-4b8a-a97e-94fcb4513fe6 tempest-KeyPairsNegativeTestJSON-139630628 tempest-KeyPairsNegativeTestJSON-139630628-project] Request method failure captured: Aug 10 17:50:45.200792 n-d-852296-2 devstack@n-api.service[129410]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1777420456 HTTP/1.1 Aug 10 17:50:45.200792 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 17:50:45.200792 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 17:50:45.200792 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 17:50:45.200792 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 0 Aug 10 17:50:45.200792 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 17:50:45.200792 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 17:50:45.200792 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 17:50:45.200792 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 17:50:45.200792 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8-_z27T-rdu9inrn3ptL1-NOzUeCuwN3cqLiVdAX6O4J3CJMZXs4T0dh65ZxgyW5FDXJLyXohGjafrsD--N1YjOlWtl0MkxR5MKcUMQ-U7VnBWVukUgEQFCKPeaFgjzUUk--xQX_gvM0iLgy38arv9XPGXOcEKYwqJi7DD-sA1WnaEo Aug 10 17:50:45.200792 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 17:50:45.200792 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 17:50:45.200792 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 17:50:45.200792 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 17:50:45.200792 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 17:50:45.200792 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 17:50:45.200792 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: 01ed1d0998ca4419a63aaf623d3ddc27 Aug 10 17:50:45.200792 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-139630628 Aug 10 17:50:45.200792 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 17:50:45.200792 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 17:50:45.200792 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/01ed1d0998ca4419a63aaf623d3ddc27"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/01ed1d0998ca4419a63aaf623d3ddc27"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/01ed1d0998ca4419a63aaf623d3ddc27"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_01ed1d0998ca4419a63aaf623d3ddc27", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:50:45.200792 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-KeyPairsNegativeTestJSON-139630628 Aug 10 17:50:45.200792 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: 01ed1d0998ca4419a63aaf623d3ddc27 Aug 10 17:50:45.200792 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-139630628 Aug 10 17:50:45.200792 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-KeyPairsNegativeTestJSON-139630628-project Aug 10 17:50:45.200792 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 17:50:45.200792 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 17:50:45.200792 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: 284720aef6df4dd18a714409e4e823f9 Aug 10 17:50:45.200792 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-KeyPairsNegativeTestJSON-139630628-project Aug 10 17:50:45.200792 n-d-852296-2 devstack@n-api.service[129410]: method: Aug 10 17:50:45.200792 n-d-852296-2 devstack@n-api.service[129410]: exception: Keypair tempest-keypair-non-existent-1777420456 not found for user 284720aef6df4dd18a714409e4e823f9 Aug 10 17:50:45.200792 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'id': 'tempest-keypair-non-existent-1777420456'} Aug 10 17:50:45.200792 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:50:45.200792 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:45.200792 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Aug 10 17:50:45.200792 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Aug 10 17:50:45.200792 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 10 17:50:45.200792 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 10 17:50:45.200792 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 10 17:50:45.200792 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 10 17:50:45.200792 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 10 17:50:45.200792 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise self.value Aug 10 17:50:45.200792 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 10 17:50:45.200792 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 10 17:50:45.200792 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6814, in delete_key_pair Aug 10 17:50:45.200792 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Aug 10 17:50:45.200792 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6835, in get_key_pair Aug 10 17:50:45.200792 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Aug 10 17:50:45.200792 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 17:50:45.200792 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 17:50:45.200792 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Aug 10 17:50:45.200792 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Aug 10 17:50:45.200792 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Aug 10 17:50:45.200792 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Aug 10 17:50:45.200792 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 10 17:50:45.200792 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 10 17:50:45.200792 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Aug 10 17:50:45.200792 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Aug 10 17:50:45.200792 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-1777420456 not found for user 284720aef6df4dd18a714409e4e823f9 Aug 10 17:50:45.200792 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:45.200792 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:50:45.205622 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:45.205622 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:45.205622 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:50:45.205622 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:50:45.205622 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:50:45.205622 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:50:45.205622 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 17:50:45.205622 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 17:50:45.205622 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 10 17:50:45.205622 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:50:45.205622 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:50:45.205622 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:50:45.205622 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Aug 10 17:50:45.205622 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._delete(req, id) Aug 10 17:50:45.205622 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Aug 10 17:50:45.205622 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Aug 10 17:50:45.205622 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-1777420456 not found for user 284720aef6df4dd18a714409e4e823f9 Aug 10 17:50:45.205622 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:45.205622 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:50:45.205622 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:45.205622 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:45.205622 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:50:45.205622 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:50:45.205622 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:50:45.205622 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:50:45.205622 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-1777420456 not found for user 284720aef6df4dd18a714409e4e823f9 Aug 10 17:50:45.205622 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:50:45.205622 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-19cf8542-b2a1-4b8a-a97e-94fcb4513fe6 tempest-KeyPairsNegativeTestJSON-139630628 tempest-KeyPairsNegativeTestJSON-139630628-project] Returning 404 to user: Keypair tempest-keypair-non-existent-1777420456 not found for user 284720aef6df4dd18a714409e4e823f9 {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:50:45.205622 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-19cf8542-b2a1-4b8a-a97e-94fcb4513fe6 tempest-KeyPairsNegativeTestJSON-139630628 tempest-KeyPairsNegativeTestJSON-139630628-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1777420456" status: 404 len: 145 microversion: 2.1 time: 0.018862 Aug 10 17:50:45.205622 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 230/447] 10.222.0.50 () {58 vars in 1260 bytes} [Wed Aug 10 17:50:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1777420456 => generated 145 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:50:45.583144 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-be06e71c-a83c-4812-a24b-094dba81d0cd tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:50:45.583144 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-be06e71c-a83c-4812-a24b-094dba81d0cd tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: af745ef7-21f0-4149-ba68-33f45f73f2dd] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:50:45.635020 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-be06e71c-a83c-4812-a24b-094dba81d0cd tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:50:45.640129 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-be06e71c-a83c-4812-a24b-094dba81d0cd tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/af745ef7-21f0-4149-ba68-33f45f73f2dd" status: 200 len: 1216 microversion: 2.1 time: 0.070257 Aug 10 17:50:45.640768 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 231/448] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:50:45 2022] GET /compute/v2.1/servers/af745ef7-21f0-4149-ba68-33f45f73f2dd => generated 1216 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:50:46.174369 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-10903142-56df-4561-9484-d7e92bb561a7 tempest-AbsoluteLimitsTestJSON-2061660273 tempest-AbsoluteLimitsTestJSON-2061660273-project] Calling method '.version_select at 0x7fb346791f70>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:50:46.185724 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-10903142-56df-4561-9484-d7e92bb561a7 tempest-AbsoluteLimitsTestJSON-2061660273 tempest-AbsoluteLimitsTestJSON-2061660273-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:46.186201 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-10903142-56df-4561-9484-d7e92bb561a7 tempest-AbsoluteLimitsTestJSON-2061660273 tempest-AbsoluteLimitsTestJSON-2061660273-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:46.186629 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-10903142-56df-4561-9484-d7e92bb561a7 tempest-AbsoluteLimitsTestJSON-2061660273 tempest-AbsoluteLimitsTestJSON-2061660273-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:46.187342 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-10903142-56df-4561-9484-d7e92bb561a7 tempest-AbsoluteLimitsTestJSON-2061660273 tempest-AbsoluteLimitsTestJSON-2061660273-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:46.187785 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-10903142-56df-4561-9484-d7e92bb561a7 tempest-AbsoluteLimitsTestJSON-2061660273 tempest-AbsoluteLimitsTestJSON-2061660273-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:46.188206 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-10903142-56df-4561-9484-d7e92bb561a7 tempest-AbsoluteLimitsTestJSON-2061660273 tempest-AbsoluteLimitsTestJSON-2061660273-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:46.219277 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-10903142-56df-4561-9484-d7e92bb561a7 tempest-AbsoluteLimitsTestJSON-2061660273 tempest-AbsoluteLimitsTestJSON-2061660273-project] 10.222.0.50 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.665553 Aug 10 17:50:46.219866 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 218/449] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 10 17:50:45 2022] GET /compute/v2.1/limits => generated 511 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:50:46.661538 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-71733022-2e7d-4625-981b-ffd69e96dc40 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:50:46.662862 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-71733022-2e7d-4625-981b-ffd69e96dc40 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: af745ef7-21f0-4149-ba68-33f45f73f2dd] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:50:46.673086 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-71733022-2e7d-4625-981b-ffd69e96dc40 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:46.673086 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-71733022-2e7d-4625-981b-ffd69e96dc40 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:46.673086 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-71733022-2e7d-4625-981b-ffd69e96dc40 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:46.673086 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-71733022-2e7d-4625-981b-ffd69e96dc40 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:46.673086 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-71733022-2e7d-4625-981b-ffd69e96dc40 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:46.673086 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-71733022-2e7d-4625-981b-ffd69e96dc40 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:46.740374 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-71733022-2e7d-4625-981b-ffd69e96dc40 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:50:46.750945 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-71733022-2e7d-4625-981b-ffd69e96dc40 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/af745ef7-21f0-4149-ba68-33f45f73f2dd" status: 200 len: 1220 microversion: 2.1 time: 0.093961 Aug 10 17:50:46.764857 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 232/450] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:50:46 2022] GET /compute/v2.1/servers/af745ef7-21f0-4149-ba68-33f45f73f2dd => generated 1220 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:50:47.774419 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-483b82f4-01b9-4038-af59-1b74a361e0f4 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:50:47.775883 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-483b82f4-01b9-4038-af59-1b74a361e0f4 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: af745ef7-21f0-4149-ba68-33f45f73f2dd] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:50:47.783049 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-483b82f4-01b9-4038-af59-1b74a361e0f4 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:47.783710 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-483b82f4-01b9-4038-af59-1b74a361e0f4 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:47.784329 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-483b82f4-01b9-4038-af59-1b74a361e0f4 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:47.785211 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-483b82f4-01b9-4038-af59-1b74a361e0f4 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:47.785824 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-483b82f4-01b9-4038-af59-1b74a361e0f4 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:47.787240 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-483b82f4-01b9-4038-af59-1b74a361e0f4 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:47.861106 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-483b82f4-01b9-4038-af59-1b74a361e0f4 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:50:47.869119 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-483b82f4-01b9-4038-af59-1b74a361e0f4 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/af745ef7-21f0-4149-ba68-33f45f73f2dd" status: 200 len: 1212 microversion: 2.1 time: 0.099956 Aug 10 17:50:47.869677 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 219/451] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:50:47 2022] GET /compute/v2.1/servers/af745ef7-21f0-4149-ba68-33f45f73f2dd => generated 1212 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:50:48.903024 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-0e610a47-fb26-455b-8c9e-c2f22677aeb0 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:50:48.904641 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-0e610a47-fb26-455b-8c9e-c2f22677aeb0 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: af745ef7-21f0-4149-ba68-33f45f73f2dd] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:50:48.909052 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=4,nova_api:DELETE=5 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:50:48.915988 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-0e610a47-fb26-455b-8c9e-c2f22677aeb0 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:48.916742 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-0e610a47-fb26-455b-8c9e-c2f22677aeb0 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:48.917806 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-0e610a47-fb26-455b-8c9e-c2f22677aeb0 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:48.918757 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-0e610a47-fb26-455b-8c9e-c2f22677aeb0 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:48.919422 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-0e610a47-fb26-455b-8c9e-c2f22677aeb0 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:48.920337 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-0e610a47-fb26-455b-8c9e-c2f22677aeb0 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:48.950039 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-6ed37cde-884d-4620-a59b-e5fe1b65291a tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1210071246", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452"}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:50:49.016902 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-0e610a47-fb26-455b-8c9e-c2f22677aeb0 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:50:49.028094 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-0e610a47-fb26-455b-8c9e-c2f22677aeb0 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/af745ef7-21f0-4149-ba68-33f45f73f2dd" status: 200 len: 1276 microversion: 2.1 time: 0.129077 Aug 10 17:50:49.029027 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 220/452] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:50:48 2022] GET /compute/v2.1/servers/af745ef7-21f0-4149-ba68-33f45f73f2dd => generated 1276 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:50:49.035346 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.network.neutron [None req-6ed37cde-884d-4620-a59b-e5fe1b65291a tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] validate_networks() for None {{(pid=129410) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 17:50:49.405808 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.virt.hardware [None req-6ed37cde-884d-4620-a59b-e5fe1b65291a tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Flavor limits 0:0:0 {{(pid=129410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 17:50:49.406295 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.virt.hardware [None req-6ed37cde-884d-4620-a59b-e5fe1b65291a tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Image limits 0:0:0 {{(pid=129410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 17:50:49.414573 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.virt.hardware [None req-6ed37cde-884d-4620-a59b-e5fe1b65291a tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Flavor pref 0:0:0 {{(pid=129410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 17:50:49.415267 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.virt.hardware [None req-6ed37cde-884d-4620-a59b-e5fe1b65291a tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Image pref 0:0:0 {{(pid=129410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 17:50:49.415759 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.virt.hardware [None req-6ed37cde-884d-4620-a59b-e5fe1b65291a tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 17:50:49.434304 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-6ed37cde-884d-4620-a59b-e5fe1b65291a tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:49.436545 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-6ed37cde-884d-4620-a59b-e5fe1b65291a tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:49.437388 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-6ed37cde-884d-4620-a59b-e5fe1b65291a tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:49.438161 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-6ed37cde-884d-4620-a59b-e5fe1b65291a tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:49.439080 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-6ed37cde-884d-4620-a59b-e5fe1b65291a tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:49.440289 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-6ed37cde-884d-4620-a59b-e5fe1b65291a tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:49.461953 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.quota [None req-6ed37cde-884d-4620-a59b-e5fe1b65291a tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Getting quotas for project 48bbb92998f54ebeb624bc794d406896. Resources: {'instances', 'ram', 'cores'} {{(pid=129410) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:50:49.467682 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.quota [None req-6ed37cde-884d-4620-a59b-e5fe1b65291a tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Getting quotas for user e109c3dcd0574faaa3d7ec31dd4edd24 and project 48bbb92998f54ebeb624bc794d406896. Resources: {'instances', 'ram', 'cores'} {{(pid=129410) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:50:49.485633 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-6ed37cde-884d-4620-a59b-e5fe1b65291a tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Going to run 1 instances... {{(pid=129410) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 17:50:49.488012 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-6ed37cde-884d-4620-a59b-e5fe1b65291a tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] [instance: af35a390-86bf-4618-bce0-db7423a065bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a735ff26-463a-4ffe-a981-ab9d9baa494f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129410) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 17:50:49.783895 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-6ed37cde-884d-4620-a59b-e5fe1b65291a tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.590440 Aug 10 17:50:49.790649 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 233/453] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 17:50:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1592 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 10 17:50:49.795659 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-4ee4ad4a-1437-4385-8079-2cd93f6da360 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:50:49.796290 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-4ee4ad4a-1437-4385-8079-2cd93f6da360 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] [instance: af35a390-86bf-4618-bce0-db7423a065bb] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:50:49.875911 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-4ee4ad4a-1437-4385-8079-2cd93f6da360 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e109c3dcd0574faaa3d7ec31dd4edd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48bbb92998f54ebeb624bc794d406896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:50:49.902009 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-4ee4ad4a-1437-4385-8079-2cd93f6da360 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] 10.222.0.50 "GET /compute/v2.1/servers/af35a390-86bf-4618-bce0-db7423a065bb" status: 200 len: 1213 microversion: 2.1 time: 0.107931 Aug 10 17:50:49.904016 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 221/454] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:50:49 2022] GET /compute/v2.1/servers/af35a390-86bf-4618-bce0-db7423a065bb => generated 1213 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:50:50.050441 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-0d179da7-f919-4b76-ac2c-7bda690acf36 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:50:50.051071 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-0d179da7-f919-4b76-ac2c-7bda690acf36 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: af745ef7-21f0-4149-ba68-33f45f73f2dd] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:50:50.065150 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-0d179da7-f919-4b76-ac2c-7bda690acf36 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:50.065782 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-0d179da7-f919-4b76-ac2c-7bda690acf36 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:50.066321 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-0d179da7-f919-4b76-ac2c-7bda690acf36 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:50.067481 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-0d179da7-f919-4b76-ac2c-7bda690acf36 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:50.068495 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-0d179da7-f919-4b76-ac2c-7bda690acf36 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:50.068937 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-0d179da7-f919-4b76-ac2c-7bda690acf36 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:50.203184 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-383d62a9-d0be-43b8-811e-5882b029c5e6 tempest-LiveAutoBlockMigrationV225Test-1294760569 tempest-LiveAutoBlockMigrationV225Test-1294760569-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-939505104", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "65f0edf1-6c38-4348-ba86-cccd27e183bd"}], "block_device_mapping_v2": [{"uuid": "90457f82-a694-48c6-9222-0e05fcff49ee", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:50:50.231211 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-0d179da7-f919-4b76-ac2c-7bda690acf36 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:50:50.259771 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-0d179da7-f919-4b76-ac2c-7bda690acf36 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/af745ef7-21f0-4149-ba68-33f45f73f2dd" status: 200 len: 1316 microversion: 2.1 time: 0.213320 Aug 10 17:50:50.277745 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 234/455] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:50:50 2022] GET /compute/v2.1/servers/af745ef7-21f0-4149-ba68-33f45f73f2dd => generated 1316 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:50:50.313452 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.network.neutron [None req-383d62a9-d0be-43b8-811e-5882b029c5e6 tempest-LiveAutoBlockMigrationV225Test-1294760569 tempest-LiveAutoBlockMigrationV225Test-1294760569-project] validate_networks() for [('65f0edf1-6c38-4348-ba86-cccd27e183bd', None, None, None, None, None)] {{(pid=129409) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 17:50:50.925518 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-19843ac1-81b8-46fc-8d87-e1898bc2b9f5 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:50:50.926216 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-19843ac1-81b8-46fc-8d87-e1898bc2b9f5 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] [instance: af35a390-86bf-4618-bce0-db7423a065bb] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:50:50.984614 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-19843ac1-81b8-46fc-8d87-e1898bc2b9f5 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e109c3dcd0574faaa3d7ec31dd4edd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48bbb92998f54ebeb624bc794d406896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:50:50.991574 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-19843ac1-81b8-46fc-8d87-e1898bc2b9f5 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] 10.222.0.50 "GET /compute/v2.1/servers/af35a390-86bf-4618-bce0-db7423a065bb" status: 200 len: 1213 microversion: 2.1 time: 0.070342 Aug 10 17:50:50.992171 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 235/456] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:50:50 2022] GET /compute/v2.1/servers/af35a390-86bf-4618-bce0-db7423a065bb => generated 1213 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:50:51.031720 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [None req-383d62a9-d0be-43b8-811e-5882b029c5e6 tempest-LiveAutoBlockMigrationV225Test-1294760569 tempest-LiveAutoBlockMigrationV225Test-1294760569-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-59bb6ae2-95ea-4d63-89f4-a0c8ea6bf5a8) Aug 10 17:50:51.031720 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:51.031720 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:50:51.031720 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:50:51.031720 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:50:51.031720 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:50:51.031720 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:50:51.031720 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:50:51.031720 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:50:51.031720 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:50:51.031720 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 17:50:51.031720 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 17:50:51.031720 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 17:50:51.031720 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 17:50:51.031720 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 17:50:51.031720 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 17:50:51.031720 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 17:50:51.031720 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 17:50:51.031720 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 17:50:51.031720 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 17:50:51.031720 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 17:50:51.031720 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 17:50:51.031720 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 17:50:51.031720 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 17:50:51.031720 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 17:50:51.031720 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 17:50:51.031720 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 17:50:51.031720 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:50:51.031720 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:50:51.031720 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 17:50:51.031720 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 17:50:51.031720 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:50:51.031720 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:50:51.031720 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:50:51.031720 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:50:51.031720 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:50:51.031720 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:50:51.031720 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:50:51.031720 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:50:51.031720 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:50:51.031720 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:50:51.031720 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 17:50:51.031720 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 17:50:51.031720 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 17:50:51.031720 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 17:50:51.031720 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 17:50:51.031720 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 17:50:51.031720 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 17:50:51.031720 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 17:50:51.031720 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 17:50:51.031720 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 17:50:51.031720 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 17:50:51.037318 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 17:50:51.037318 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 17:50:51.037318 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 17:50:51.037318 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 17:50:51.037318 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 17:50:51.037318 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 17:50:51.037318 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 17:50:51.037318 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 17:50:51.037318 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 17:50:51.037318 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 17:50:51.037318 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 17:50:51.037318 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 17:50:51.037318 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 17:50:51.037318 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 17:50:51.037318 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 17:50:51.037318 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-59bb6ae2-95ea-4d63-89f4-a0c8ea6bf5a8) Aug 10 17:50:51.037318 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:50:51.037318 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-383d62a9-d0be-43b8-811e-5882b029c5e6 tempest-LiveAutoBlockMigrationV225Test-1294760569 tempest-LiveAutoBlockMigrationV225Test-1294760569-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:50:51.037318 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:50:51.037318 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-383d62a9-d0be-43b8-811e-5882b029c5e6 tempest-LiveAutoBlockMigrationV225Test-1294760569 tempest-LiveAutoBlockMigrationV225Test-1294760569-project] Request method failure captured: Aug 10 17:50:51.037318 n-d-852296-2 devstack@n-api.service[129409]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 17:50:51.037318 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 17:50:51.037318 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 17:50:51.037318 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 17:50:51.037318 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 361 Aug 10 17:50:51.037318 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 17:50:51.037318 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 17:50:51.037318 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 17:50:51.037318 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 17:50:51.037318 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8--rUpQnQMRCcxoeoEEfTZB9bNgVG1LtvLGpdIGsID2pqNy7Yz0btlbySW2s05YZQP69IS5fxYZQ-jPa-PuRzZfIUwlDBjarRUPCbYXiuLNF1PUgDRGkB2Jfpb6O1Pd21aPA9R68lGSAqcVayeh1ErXuIM5RIKbttfyrdx7XjnnLOis Aug 10 17:50:51.037318 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 17:50:51.037318 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 17:50:51.037318 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 17:50:51.037318 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 17:50:51.037318 n-d-852296-2 devstack@n-api.service[129409]: X-Openstack-Nova-Api-Version: 2.25 Aug 10 17:50:51.037318 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 17:50:51.037318 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 17:50:51.037318 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: c39984bbc0b549c9bc10d0a5b0e4ca62 Aug 10 17:50:51.037318 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1294760569 Aug 10 17:50:51.037318 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 17:50:51.037318 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 17:50:51.037318 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c39984bbc0b549c9bc10d0a5b0e4ca62"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c39984bbc0b549c9bc10d0a5b0e4ca62"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c39984bbc0b549c9bc10d0a5b0e4ca62"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c39984bbc0b549c9bc10d0a5b0e4ca62", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:50:51.037318 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1294760569 Aug 10 17:50:51.037318 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: c39984bbc0b549c9bc10d0a5b0e4ca62 Aug 10 17:50:51.037318 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1294760569 Aug 10 17:50:51.037318 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-LiveAutoBlockMigrationV225Test-1294760569-project Aug 10 17:50:51.037318 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 17:50:51.037318 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 17:50:51.037318 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: 030a617b52ad4ef3be53a43d812eb8b9 Aug 10 17:50:51.037318 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1294760569-project Aug 10 17:50:51.037318 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:50:51.037318 n-d-852296-2 devstack@n-api.service[129409]: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-939505104", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "65f0edf1-6c38-4348-ba86-cccd27e183bd"}], "block_device_mapping_v2": [{"uuid": "90457f82-a694-48c6-9222-0e05fcff49ee", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} Aug 10 17:50:51.037318 n-d-852296-2 devstack@n-api.service[129409]: method: > Aug 10 17:50:51.037318 n-d-852296-2 devstack@n-api.service[129409]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:50:51.037318 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:50:51.042478 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'body': {'server': {'name': 'tempest-LiveAutoBlockMigrationV225Test-server-939505104', 'imageRef': '', 'flavorRef': '452', 'networks': [{'uuid': '65f0edf1-6c38-4348-ba86-cccd27e183bd'}], 'block_device_mapping_v2': [{'source_type': 'volume', 'destination_type': 'volume', 'boot_index': 0, 'delete_on_termination': True, 'volume_id': '90457f82-a694-48c6-9222-0e05fcff49ee'}]}}} Aug 10 17:50:51.042478 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:50:51.042478 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:51.042478 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:50:51.042478 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:50:51.042478 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:50:51.042478 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:50:51.042478 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:50:51.042478 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:50:51.042478 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:50:51.042478 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:50:51.042478 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 17:50:51.042478 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 17:50:51.042478 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 17:50:51.042478 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 17:50:51.042478 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 17:50:51.042478 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 17:50:51.042478 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 17:50:51.042478 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 17:50:51.042478 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 17:50:51.042478 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 17:50:51.042478 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 17:50:51.042478 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 17:50:51.042478 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 17:50:51.042478 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 17:50:51.042478 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 17:50:51.042478 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 17:50:51.042478 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 17:50:51.042478 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:50:51.042478 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:50:51.042478 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 17:50:51.042478 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 17:50:51.042478 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:50:51.042478 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:50:51.042478 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:50:51.042478 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:50:51.042478 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:50:51.042478 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:50:51.042478 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:50:51.042478 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:50:51.042478 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:50:51.042478 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:50:51.042478 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 17:50:51.042478 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 17:50:51.042478 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 17:50:51.042478 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 17:50:51.042478 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 17:50:51.042478 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 17:50:51.042478 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 17:50:51.042478 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 17:50:51.042478 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 17:50:51.042478 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 17:50:51.042478 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 17:50:51.042478 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 17:50:51.046039 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 17:50:51.046039 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 17:50:51.046039 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 17:50:51.046039 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 17:50:51.046039 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 17:50:51.046039 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 17:50:51.046039 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 17:50:51.046039 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 17:50:51.046039 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 17:50:51.046039 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 17:50:51.046039 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 17:50:51.046039 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 17:50:51.046039 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 17:50:51.046039 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 17:50:51.046039 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-59bb6ae2-95ea-4d63-89f4-a0c8ea6bf5a8) Aug 10 17:50:51.046039 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:50:51.046039 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:50:51.046039 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:50:51.046039 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:51.046039 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:50:51.046039 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:50:51.046039 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:50:51.046039 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:50:51.046039 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 10 17:50:51.046039 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 10 17:50:51.046039 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:50:51.046039 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:50:51.046039 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:50:51.046039 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:50:51.046039 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:50:51.046039 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:50:51.046039 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:50:51.046039 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:50:51.046039 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:50:51.046039 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:50:51.046039 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:50:51.046039 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:50:51.046039 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:50:51.046039 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-383d62a9-d0be-43b8-811e-5882b029c5e6 tempest-LiveAutoBlockMigrationV225Test-1294760569 tempest-LiveAutoBlockMigrationV225Test-1294760569-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:50:51.046039 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:50:51.046039 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-383d62a9-d0be-43b8-811e-5882b029c5e6 tempest-LiveAutoBlockMigrationV225Test-1294760569 tempest-LiveAutoBlockMigrationV225Test-1294760569-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.25 time: 0.837315 Aug 10 17:50:51.046039 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 222/457] 10.222.0.50 () {62 vars in 1188 bytes} [Wed Aug 10 17:50:50 2022] POST /compute/v2.1/servers => generated 214 bytes in 843 msecs (HTTP/1.1 500) 9 headers in 393 bytes (2 switches on core 0) Aug 10 17:50:51.056720 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-003637f1-cf54-4c89-8f1c-2686ebd37c3e tempest-LiveAutoBlockMigrationV225Test-1294760569 tempest-LiveAutoBlockMigrationV225Test-1294760569-project] Calling method '.version_select at 0x7fb346562700>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:50:51.144485 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [req-3bf258b8-5c81-4adf-b1cf-2372f57b0008 req-a973dbe3-d151-491e-947e-1b5393d3c281 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af745ef7-21f0-4149-ba68-33f45f73f2dd", "tag": "fdbd759d-9bf2-43a9-9597-36bcdc4fb718"}]} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:50:51.154290 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-3bf258b8-5c81-4adf-b1cf-2372f57b0008 req-a973dbe3-d151-491e-947e-1b5393d3c281 service nova] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:51.155008 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-3bf258b8-5c81-4adf-b1cf-2372f57b0008 req-a973dbe3-d151-491e-947e-1b5393d3c281 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:51.155639 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-3bf258b8-5c81-4adf-b1cf-2372f57b0008 req-a973dbe3-d151-491e-947e-1b5393d3c281 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:51.169143 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.compute.server_external_events [req-3bf258b8-5c81-4adf-b1cf-2372f57b0008 req-a973dbe3-d151-491e-947e-1b5393d3c281 service nova] Creating event network-changed:fdbd759d-9bf2-43a9-9597-36bcdc4fb718 for instance af745ef7-21f0-4149-ba68-33f45f73f2dd on n-h1-852296-2 Aug 10 17:50:51.169967 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-003637f1-cf54-4c89-8f1c-2686ebd37c3e tempest-LiveAutoBlockMigrationV225Test-1294760569 tempest-LiveAutoBlockMigrationV225Test-1294760569-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-15043570" status: 204 len: 0 microversion: 2.25 time: 0.117614 Aug 10 17:50:51.170699 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 236/458] 10.222.0.50 () {60 vars in 1256 bytes} [Wed Aug 10 17:50:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-15043570 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 10 17:50:51.175460 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [req-3bf258b8-5c81-4adf-b1cf-2372f57b0008 req-a973dbe3-d151-491e-947e-1b5393d3c281 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035099 Aug 10 17:50:51.178661 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 223/459] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 10 17:50:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:50:51.287270 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-2e94e852-52bd-4a59-bc16-a8ae1f5d39a4 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:50:51.287881 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-2e94e852-52bd-4a59-bc16-a8ae1f5d39a4 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: af745ef7-21f0-4149-ba68-33f45f73f2dd] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:50:51.294843 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2e94e852-52bd-4a59-bc16-a8ae1f5d39a4 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:51.295354 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2e94e852-52bd-4a59-bc16-a8ae1f5d39a4 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:51.295781 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2e94e852-52bd-4a59-bc16-a8ae1f5d39a4 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:51.296536 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2e94e852-52bd-4a59-bc16-a8ae1f5d39a4 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:51.297277 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2e94e852-52bd-4a59-bc16-a8ae1f5d39a4 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:51.297866 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2e94e852-52bd-4a59-bc16-a8ae1f5d39a4 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:51.472186 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-2e94e852-52bd-4a59-bc16-a8ae1f5d39a4 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:50:51.480978 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-2e94e852-52bd-4a59-bc16-a8ae1f5d39a4 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/af745ef7-21f0-4149-ba68-33f45f73f2dd" status: 200 len: 1316 microversion: 2.1 time: 0.199504 Aug 10 17:50:51.481564 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 237/460] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:50:51 2022] GET /compute/v2.1/servers/af745ef7-21f0-4149-ba68-33f45f73f2dd => generated 1316 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:50:52.013579 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-05d8808a-a3e7-4af0-8e6b-4f45b9e64863 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:50:52.014479 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-05d8808a-a3e7-4af0-8e6b-4f45b9e64863 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] [instance: af35a390-86bf-4618-bce0-db7423a065bb] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:50:52.022788 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-05d8808a-a3e7-4af0-8e6b-4f45b9e64863 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:52.023616 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-05d8808a-a3e7-4af0-8e6b-4f45b9e64863 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:52.024211 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-05d8808a-a3e7-4af0-8e6b-4f45b9e64863 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:52.025089 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-05d8808a-a3e7-4af0-8e6b-4f45b9e64863 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:52.025887 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-05d8808a-a3e7-4af0-8e6b-4f45b9e64863 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:52.026496 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-05d8808a-a3e7-4af0-8e6b-4f45b9e64863 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:52.093696 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-05d8808a-a3e7-4af0-8e6b-4f45b9e64863 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e109c3dcd0574faaa3d7ec31dd4edd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48bbb92998f54ebeb624bc794d406896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:50:52.112789 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-05d8808a-a3e7-4af0-8e6b-4f45b9e64863 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] 10.222.0.50 "GET /compute/v2.1/servers/af35a390-86bf-4618-bce0-db7423a065bb" status: 200 len: 1217 microversion: 2.1 time: 0.103432 Aug 10 17:50:52.113371 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 224/461] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:50:52 2022] GET /compute/v2.1/servers/af35a390-86bf-4618-bce0-db7423a065bb => generated 1217 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:50:52.432490 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-a8b45323-df12-46a9-9874-1368e2240ba2 tempest-HypervisorAdminUnderV252Test-228592988 tempest-HypervisorAdminUnderV252Test-228592988-project-admin] Calling method '.version_select at 0x7fb346601790>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:50:52.433422 n-d-852296-2 devstack@n-api.service[129410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:50:52.433422 n-d-852296-2 devstack@n-api.service[129410]: warnings.warn(msg) Aug 10 17:50:52.434517 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a8b45323-df12-46a9-9874-1368e2240ba2 tempest-HypervisorAdminUnderV252Test-228592988 tempest-HypervisorAdminUnderV252Test-228592988-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:52.435003 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a8b45323-df12-46a9-9874-1368e2240ba2 tempest-HypervisorAdminUnderV252Test-228592988 tempest-HypervisorAdminUnderV252Test-228592988-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:52.435439 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a8b45323-df12-46a9-9874-1368e2240ba2 tempest-HypervisorAdminUnderV252Test-228592988 tempest-HypervisorAdminUnderV252Test-228592988-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:52.455610 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a8b45323-df12-46a9-9874-1368e2240ba2 tempest-HypervisorAdminUnderV252Test-228592988 tempest-HypervisorAdminUnderV252Test-228592988-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:52.456429 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a8b45323-df12-46a9-9874-1368e2240ba2 tempest-HypervisorAdminUnderV252Test-228592988 tempest-HypervisorAdminUnderV252Test-228592988-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:52.456872 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a8b45323-df12-46a9-9874-1368e2240ba2 tempest-HypervisorAdminUnderV252Test-228592988 tempest-HypervisorAdminUnderV252Test-228592988-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:52.471817 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a8b45323-df12-46a9-9874-1368e2240ba2 tempest-HypervisorAdminUnderV252Test-228592988 tempest-HypervisorAdminUnderV252Test-228592988-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:52.472924 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a8b45323-df12-46a9-9874-1368e2240ba2 tempest-HypervisorAdminUnderV252Test-228592988 tempest-HypervisorAdminUnderV252Test-228592988-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:52.474123 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a8b45323-df12-46a9-9874-1368e2240ba2 tempest-HypervisorAdminUnderV252Test-228592988 tempest-HypervisorAdminUnderV252Test-228592988-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:52.482295 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-a8b45323-df12-46a9-9874-1368e2240ba2 tempest-HypervisorAdminUnderV252Test-228592988 tempest-HypervisorAdminUnderV252Test-228592988-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.377942 Aug 10 17:50:52.492633 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 238/462] 10.222.0.50 () {58 vars in 1146 bytes} [Wed Aug 10 17:50:52 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:50:52.502529 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-61f7663e-4c58-4efd-90a8-4596715f6e7a tempest-HypervisorAdminUnderV252Test-228592988 tempest-HypervisorAdminUnderV252Test-228592988-project-admin] Calling method '.version_select at 0x7fb346703a60>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:50:52.504094 n-d-852296-2 devstack@n-api.service[129409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:50:52.504094 n-d-852296-2 devstack@n-api.service[129409]: warnings.warn(msg) Aug 10 17:50:52.505709 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-61f7663e-4c58-4efd-90a8-4596715f6e7a tempest-HypervisorAdminUnderV252Test-228592988 tempest-HypervisorAdminUnderV252Test-228592988-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:52.506414 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-61f7663e-4c58-4efd-90a8-4596715f6e7a tempest-HypervisorAdminUnderV252Test-228592988 tempest-HypervisorAdminUnderV252Test-228592988-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:52.507086 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-61f7663e-4c58-4efd-90a8-4596715f6e7a tempest-HypervisorAdminUnderV252Test-228592988 tempest-HypervisorAdminUnderV252Test-228592988-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:52.514557 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-7cbaf1da-eb5a-4191-898c-da52794c56ec tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:50:52.517133 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-7cbaf1da-eb5a-4191-898c-da52794c56ec tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: af745ef7-21f0-4149-ba68-33f45f73f2dd] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:50:52.526941 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-61f7663e-4c58-4efd-90a8-4596715f6e7a tempest-HypervisorAdminUnderV252Test-228592988 tempest-HypervisorAdminUnderV252Test-228592988-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:52.527845 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-61f7663e-4c58-4efd-90a8-4596715f6e7a tempest-HypervisorAdminUnderV252Test-228592988 tempest-HypervisorAdminUnderV252Test-228592988-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:52.528811 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-7cbaf1da-eb5a-4191-898c-da52794c56ec tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:52.529283 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-61f7663e-4c58-4efd-90a8-4596715f6e7a tempest-HypervisorAdminUnderV252Test-228592988 tempest-HypervisorAdminUnderV252Test-228592988-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:52.529571 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-7cbaf1da-eb5a-4191-898c-da52794c56ec tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:52.530046 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-7cbaf1da-eb5a-4191-898c-da52794c56ec tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:52.531004 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-7cbaf1da-eb5a-4191-898c-da52794c56ec tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:52.531688 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-7cbaf1da-eb5a-4191-898c-da52794c56ec tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:52.532290 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-7cbaf1da-eb5a-4191-898c-da52794c56ec tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:52.553478 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-61f7663e-4c58-4efd-90a8-4596715f6e7a tempest-HypervisorAdminUnderV252Test-228592988 tempest-HypervisorAdminUnderV252Test-228592988-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:52.554807 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-61f7663e-4c58-4efd-90a8-4596715f6e7a tempest-HypervisorAdminUnderV252Test-228592988 tempest-HypervisorAdminUnderV252Test-228592988-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:52.555464 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-61f7663e-4c58-4efd-90a8-4596715f6e7a tempest-HypervisorAdminUnderV252Test-228592988 tempest-HypervisorAdminUnderV252Test-228592988-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:52.564811 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-61f7663e-4c58-4efd-90a8-4596715f6e7a tempest-HypervisorAdminUnderV252Test-228592988 tempest-HypervisorAdminUnderV252Test-228592988-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/n-h2-852296-2/servers" status: 200 len: 196 microversion: 2.1 time: 0.072962 Aug 10 17:50:52.574644 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 225/463] 10.222.0.50 () {58 vars in 1212 bytes} [Wed Aug 10 17:50:52 2022] GET /compute/v2.1/os-hypervisors/n-h2-852296-2/servers => generated 196 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:50:52.580393 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-799cd59d-d33a-4e13-bac3-7320d2250cec tempest-HypervisorAdminUnderV252Test-228592988 tempest-HypervisorAdminUnderV252Test-228592988-project-admin] Calling method '.version_select at 0x7fb346703820>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:50:52.581774 n-d-852296-2 devstack@n-api.service[129409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:50:52.581774 n-d-852296-2 devstack@n-api.service[129409]: warnings.warn(msg) Aug 10 17:50:52.583471 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-799cd59d-d33a-4e13-bac3-7320d2250cec tempest-HypervisorAdminUnderV252Test-228592988 tempest-HypervisorAdminUnderV252Test-228592988-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:52.584184 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-799cd59d-d33a-4e13-bac3-7320d2250cec tempest-HypervisorAdminUnderV252Test-228592988 tempest-HypervisorAdminUnderV252Test-228592988-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:52.585201 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-799cd59d-d33a-4e13-bac3-7320d2250cec tempest-HypervisorAdminUnderV252Test-228592988 tempest-HypervisorAdminUnderV252Test-228592988-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:52.607132 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-799cd59d-d33a-4e13-bac3-7320d2250cec tempest-HypervisorAdminUnderV252Test-228592988 tempest-HypervisorAdminUnderV252Test-228592988-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:52.607903 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-799cd59d-d33a-4e13-bac3-7320d2250cec tempest-HypervisorAdminUnderV252Test-228592988 tempest-HypervisorAdminUnderV252Test-228592988-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:52.608533 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-799cd59d-d33a-4e13-bac3-7320d2250cec tempest-HypervisorAdminUnderV252Test-228592988 tempest-HypervisorAdminUnderV252Test-228592988-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:52.629210 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-799cd59d-d33a-4e13-bac3-7320d2250cec tempest-HypervisorAdminUnderV252Test-228592988 tempest-HypervisorAdminUnderV252Test-228592988-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:52.629958 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-799cd59d-d33a-4e13-bac3-7320d2250cec tempest-HypervisorAdminUnderV252Test-228592988 tempest-HypervisorAdminUnderV252Test-228592988-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:52.630707 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-799cd59d-d33a-4e13-bac3-7320d2250cec tempest-HypervisorAdminUnderV252Test-228592988 tempest-HypervisorAdminUnderV252Test-228592988-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:52.637593 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-799cd59d-d33a-4e13-bac3-7320d2250cec tempest-HypervisorAdminUnderV252Test-228592988 tempest-HypervisorAdminUnderV252Test-228592988-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.061505 Aug 10 17:50:52.640291 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 226/464] 10.222.0.50 () {58 vars in 1146 bytes} [Wed Aug 10 17:50:52 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:50:52.650363 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-930e99f3-8ce3-4f4d-a290-24a2ec8131ec tempest-HypervisorAdminUnderV252Test-228592988 tempest-HypervisorAdminUnderV252Test-228592988-project-admin] Calling method '.version_select at 0x7fb346703280>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:50:52.651576 n-d-852296-2 devstack@n-api.service[129409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:50:52.651576 n-d-852296-2 devstack@n-api.service[129409]: warnings.warn(msg) Aug 10 17:50:52.653444 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-930e99f3-8ce3-4f4d-a290-24a2ec8131ec tempest-HypervisorAdminUnderV252Test-228592988 tempest-HypervisorAdminUnderV252Test-228592988-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:52.654115 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-930e99f3-8ce3-4f4d-a290-24a2ec8131ec tempest-HypervisorAdminUnderV252Test-228592988 tempest-HypervisorAdminUnderV252Test-228592988-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:52.654720 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-930e99f3-8ce3-4f4d-a290-24a2ec8131ec tempest-HypervisorAdminUnderV252Test-228592988 tempest-HypervisorAdminUnderV252Test-228592988-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:52.685002 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-930e99f3-8ce3-4f4d-a290-24a2ec8131ec tempest-HypervisorAdminUnderV252Test-228592988 tempest-HypervisorAdminUnderV252Test-228592988-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:52.685002 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-930e99f3-8ce3-4f4d-a290-24a2ec8131ec tempest-HypervisorAdminUnderV252Test-228592988 tempest-HypervisorAdminUnderV252Test-228592988-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:52.685002 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-930e99f3-8ce3-4f4d-a290-24a2ec8131ec tempest-HypervisorAdminUnderV252Test-228592988 tempest-HypervisorAdminUnderV252Test-228592988-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:52.685352 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-930e99f3-8ce3-4f4d-a290-24a2ec8131ec tempest-HypervisorAdminUnderV252Test-228592988 tempest-HypervisorAdminUnderV252Test-228592988-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/n-h2-852296-2/search" status: 200 len: 104 microversion: 2.1 time: 0.040502 Aug 10 17:50:52.691654 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 227/465] 10.222.0.50 () {58 vars in 1209 bytes} [Wed Aug 10 17:50:52 2022] GET /compute/v2.1/os-hypervisors/n-h2-852296-2/search => generated 104 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:50:52.826776 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-7cbaf1da-eb5a-4191-898c-da52794c56ec tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:50:52.836287 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-7cbaf1da-eb5a-4191-898c-da52794c56ec tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/af745ef7-21f0-4149-ba68-33f45f73f2dd" status: 200 len: 1316 microversion: 2.1 time: 0.331584 Aug 10 17:50:52.837249 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 239/466] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:50:52 2022] GET /compute/v2.1/servers/af745ef7-21f0-4149-ba68-33f45f73f2dd => generated 1316 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:50:52.952498 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-e32a1739-d6e1-470f-8d30-561e2d112d5b tempest-HypervisorAdminV228Test-205806469 tempest-HypervisorAdminV228Test-205806469-project-admin] Calling method '.version_select at 0x7fb346806790>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:50:52.954582 n-d-852296-2 devstack@n-api.service[129409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:50:52.954582 n-d-852296-2 devstack@n-api.service[129409]: warnings.warn(msg) Aug 10 17:50:52.956957 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e32a1739-d6e1-470f-8d30-561e2d112d5b tempest-HypervisorAdminV228Test-205806469 tempest-HypervisorAdminV228Test-205806469-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:52.957682 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e32a1739-d6e1-470f-8d30-561e2d112d5b tempest-HypervisorAdminV228Test-205806469 tempest-HypervisorAdminV228Test-205806469-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:52.958591 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e32a1739-d6e1-470f-8d30-561e2d112d5b tempest-HypervisorAdminV228Test-205806469 tempest-HypervisorAdminV228Test-205806469-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:52.985103 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e32a1739-d6e1-470f-8d30-561e2d112d5b tempest-HypervisorAdminV228Test-205806469 tempest-HypervisorAdminV228Test-205806469-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:52.985823 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e32a1739-d6e1-470f-8d30-561e2d112d5b tempest-HypervisorAdminV228Test-205806469 tempest-HypervisorAdminV228Test-205806469-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:52.986664 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e32a1739-d6e1-470f-8d30-561e2d112d5b tempest-HypervisorAdminV228Test-205806469 tempest-HypervisorAdminV228Test-205806469-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:53.005796 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e32a1739-d6e1-470f-8d30-561e2d112d5b tempest-HypervisorAdminV228Test-205806469 tempest-HypervisorAdminV228Test-205806469-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:53.006766 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e32a1739-d6e1-470f-8d30-561e2d112d5b tempest-HypervisorAdminV228Test-205806469 tempest-HypervisorAdminV228Test-205806469-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:53.007359 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e32a1739-d6e1-470f-8d30-561e2d112d5b tempest-HypervisorAdminV228Test-205806469 tempest-HypervisorAdminV228Test-205806469-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:53.014595 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-e32a1739-d6e1-470f-8d30-561e2d112d5b tempest-HypervisorAdminV228Test-205806469 tempest-HypervisorAdminV228Test-205806469-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.320855 Aug 10 17:50:53.015513 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 228/467] 10.222.0.50 () {60 vars in 1187 bytes} [Wed Aug 10 17:50:52 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 17:50:53.026112 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-f7d1bc0a-a0eb-428d-8c51-1e1c46dd4b40 tempest-HypervisorAdminV228Test-205806469 tempest-HypervisorAdminV228Test-205806469-project-admin] Calling method '.version_select at 0x7fb3465e48b0>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:50:53.027296 n-d-852296-2 devstack@n-api.service[129410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:50:53.027296 n-d-852296-2 devstack@n-api.service[129410]: warnings.warn(msg) Aug 10 17:50:53.028846 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-f7d1bc0a-a0eb-428d-8c51-1e1c46dd4b40 tempest-HypervisorAdminV228Test-205806469 tempest-HypervisorAdminV228Test-205806469-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:53.029318 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-f7d1bc0a-a0eb-428d-8c51-1e1c46dd4b40 tempest-HypervisorAdminV228Test-205806469 tempest-HypervisorAdminV228Test-205806469-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:53.029741 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-f7d1bc0a-a0eb-428d-8c51-1e1c46dd4b40 tempest-HypervisorAdminV228Test-205806469 tempest-HypervisorAdminV228Test-205806469-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:53.043463 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-f7d1bc0a-a0eb-428d-8c51-1e1c46dd4b40 tempest-HypervisorAdminV228Test-205806469 tempest-HypervisorAdminV228Test-205806469-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:53.043939 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-f7d1bc0a-a0eb-428d-8c51-1e1c46dd4b40 tempest-HypervisorAdminV228Test-205806469 tempest-HypervisorAdminV228Test-205806469-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:53.044399 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-f7d1bc0a-a0eb-428d-8c51-1e1c46dd4b40 tempest-HypervisorAdminV228Test-205806469 tempest-HypervisorAdminV228Test-205806469-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:53.051713 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-f7d1bc0a-a0eb-428d-8c51-1e1c46dd4b40 tempest-HypervisorAdminV228Test-205806469 tempest-HypervisorAdminV228Test-205806469-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.028944 Aug 10 17:50:53.052709 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 240/468] 10.222.0.50 () {60 vars in 1193 bytes} [Wed Aug 10 17:50:53 2022] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 17:50:53.134751 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-a44e9403-0432-4f27-b74e-db6234ff50d5 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:50:53.135438 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-a44e9403-0432-4f27-b74e-db6234ff50d5 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] [instance: af35a390-86bf-4618-bce0-db7423a065bb] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:50:53.144783 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a44e9403-0432-4f27-b74e-db6234ff50d5 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:53.146471 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a44e9403-0432-4f27-b74e-db6234ff50d5 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:53.147253 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a44e9403-0432-4f27-b74e-db6234ff50d5 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:53.148277 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a44e9403-0432-4f27-b74e-db6234ff50d5 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:53.148921 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a44e9403-0432-4f27-b74e-db6234ff50d5 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:53.149502 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a44e9403-0432-4f27-b74e-db6234ff50d5 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:53.279452 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-a44e9403-0432-4f27-b74e-db6234ff50d5 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e109c3dcd0574faaa3d7ec31dd4edd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48bbb92998f54ebeb624bc794d406896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:50:53.292045 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-a44e9403-0432-4f27-b74e-db6234ff50d5 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] 10.222.0.50 "GET /compute/v2.1/servers/af35a390-86bf-4618-bce0-db7423a065bb" status: 200 len: 1273 microversion: 2.1 time: 0.161236 Aug 10 17:50:53.294552 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 229/469] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:50:53 2022] GET /compute/v2.1/servers/af35a390-86bf-4618-bce0-db7423a065bb => generated 1273 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:50:53.859103 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-2a50a5bd-05c8-40de-9e84-7b6387b65374 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:50:53.862425 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-2a50a5bd-05c8-40de-9e84-7b6387b65374 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: af745ef7-21f0-4149-ba68-33f45f73f2dd] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:50:53.874443 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2a50a5bd-05c8-40de-9e84-7b6387b65374 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:53.875391 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2a50a5bd-05c8-40de-9e84-7b6387b65374 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:53.876171 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2a50a5bd-05c8-40de-9e84-7b6387b65374 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:53.878414 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2a50a5bd-05c8-40de-9e84-7b6387b65374 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:53.880607 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2a50a5bd-05c8-40de-9e84-7b6387b65374 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:53.882129 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2a50a5bd-05c8-40de-9e84-7b6387b65374 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:54.311806 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-2a50a5bd-05c8-40de-9e84-7b6387b65374 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:50:54.320114 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-ac35694a-6711-4914-820e-184382468405 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:50:54.321422 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-ac35694a-6711-4914-820e-184382468405 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] [instance: af35a390-86bf-4618-bce0-db7423a065bb] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:50:54.331624 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-2a50a5bd-05c8-40de-9e84-7b6387b65374 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/af745ef7-21f0-4149-ba68-33f45f73f2dd" status: 200 len: 1316 microversion: 2.1 time: 0.477785 Aug 10 17:50:54.333557 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-ac35694a-6711-4914-820e-184382468405 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:54.347380 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 241/470] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:50:53 2022] GET /compute/v2.1/servers/af745ef7-21f0-4149-ba68-33f45f73f2dd => generated 1316 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:50:54.349048 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-ac35694a-6711-4914-820e-184382468405 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:54.349749 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-ac35694a-6711-4914-820e-184382468405 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:54.350712 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-ac35694a-6711-4914-820e-184382468405 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:54.351376 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-ac35694a-6711-4914-820e-184382468405 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:54.351970 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-ac35694a-6711-4914-820e-184382468405 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:54.502229 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-ac35694a-6711-4914-820e-184382468405 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e109c3dcd0574faaa3d7ec31dd4edd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48bbb92998f54ebeb624bc794d406896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:50:54.511443 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-ac35694a-6711-4914-820e-184382468405 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] 10.222.0.50 "GET /compute/v2.1/servers/af35a390-86bf-4618-bce0-db7423a065bb" status: 200 len: 1271 microversion: 2.1 time: 0.195699 Aug 10 17:50:54.533540 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 230/471] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:50:54 2022] GET /compute/v2.1/servers/af35a390-86bf-4618-bce0-db7423a065bb => generated 1271 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:50:55.354886 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-737e2423-4ee5-42f0-985a-3377c925f81d tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:50:55.355451 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-737e2423-4ee5-42f0-985a-3377c925f81d tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: af745ef7-21f0-4149-ba68-33f45f73f2dd] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:50:55.361867 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-737e2423-4ee5-42f0-985a-3377c925f81d tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:55.362348 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-737e2423-4ee5-42f0-985a-3377c925f81d tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:55.363088 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-737e2423-4ee5-42f0-985a-3377c925f81d tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:55.364266 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-737e2423-4ee5-42f0-985a-3377c925f81d tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:55.364809 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-737e2423-4ee5-42f0-985a-3377c925f81d tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:55.365412 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-737e2423-4ee5-42f0-985a-3377c925f81d tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:55.533091 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-a81eb20c-1b89-4c4d-a268-d7909693711b tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:50:55.534305 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-a81eb20c-1b89-4c4d-a268-d7909693711b tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] [instance: af35a390-86bf-4618-bce0-db7423a065bb] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:50:55.541888 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a81eb20c-1b89-4c4d-a268-d7909693711b tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:55.542653 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a81eb20c-1b89-4c4d-a268-d7909693711b tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:55.543911 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a81eb20c-1b89-4c4d-a268-d7909693711b tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:55.544835 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a81eb20c-1b89-4c4d-a268-d7909693711b tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:55.545278 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a81eb20c-1b89-4c4d-a268-d7909693711b tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:55.545847 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a81eb20c-1b89-4c4d-a268-d7909693711b tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:55.619064 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-737e2423-4ee5-42f0-985a-3377c925f81d tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:50:55.628427 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-737e2423-4ee5-42f0-985a-3377c925f81d tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/af745ef7-21f0-4149-ba68-33f45f73f2dd" status: 200 len: 1316 microversion: 2.1 time: 0.277107 Aug 10 17:50:55.630077 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 242/472] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:50:55 2022] GET /compute/v2.1/servers/af745ef7-21f0-4149-ba68-33f45f73f2dd => generated 1316 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:50:56.136311 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-a81eb20c-1b89-4c4d-a268-d7909693711b tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e109c3dcd0574faaa3d7ec31dd4edd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48bbb92998f54ebeb624bc794d406896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:50:56.153051 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-a81eb20c-1b89-4c4d-a268-d7909693711b tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] 10.222.0.50 "GET /compute/v2.1/servers/af35a390-86bf-4618-bce0-db7423a065bb" status: 200 len: 1313 microversion: 2.1 time: 0.620073 Aug 10 17:50:56.154418 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 231/473] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:50:55 2022] GET /compute/v2.1/servers/af35a390-86bf-4618-bce0-db7423a065bb => generated 1313 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:50:56.651602 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-f702d2f0-c627-4cf9-9b26-b1326ffc8846 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:50:56.652234 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-f702d2f0-c627-4cf9-9b26-b1326ffc8846 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: af745ef7-21f0-4149-ba68-33f45f73f2dd] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:50:56.663330 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-f702d2f0-c627-4cf9-9b26-b1326ffc8846 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:56.663995 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-f702d2f0-c627-4cf9-9b26-b1326ffc8846 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:56.665216 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-f702d2f0-c627-4cf9-9b26-b1326ffc8846 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:56.666015 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-f702d2f0-c627-4cf9-9b26-b1326ffc8846 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:56.666510 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-f702d2f0-c627-4cf9-9b26-b1326ffc8846 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:56.673665 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-f702d2f0-c627-4cf9-9b26-b1326ffc8846 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:56.962479 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-f702d2f0-c627-4cf9-9b26-b1326ffc8846 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:50:56.966773 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_cell1:SELECT=100 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:50:56.971389 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-f702d2f0-c627-4cf9-9b26-b1326ffc8846 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/af745ef7-21f0-4149-ba68-33f45f73f2dd" status: 200 len: 1316 microversion: 2.1 time: 0.323716 Aug 10 17:50:56.972326 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 243/474] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:50:56 2022] GET /compute/v2.1/servers/af745ef7-21f0-4149-ba68-33f45f73f2dd => generated 1316 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:50:57.174745 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-e54fc967-63e9-44ed-baa2-ebb760ae4de0 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:50:57.175352 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-e54fc967-63e9-44ed-baa2-ebb760ae4de0 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] [instance: af35a390-86bf-4618-bce0-db7423a065bb] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:50:57.183170 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_cell0:SELECT=4 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:50:57.185364 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e54fc967-63e9-44ed-baa2-ebb760ae4de0 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:57.186454 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e54fc967-63e9-44ed-baa2-ebb760ae4de0 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:57.186928 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e54fc967-63e9-44ed-baa2-ebb760ae4de0 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:57.187994 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e54fc967-63e9-44ed-baa2-ebb760ae4de0 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:57.193486 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e54fc967-63e9-44ed-baa2-ebb760ae4de0 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:57.194148 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e54fc967-63e9-44ed-baa2-ebb760ae4de0 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:57.696337 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-e54fc967-63e9-44ed-baa2-ebb760ae4de0 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e109c3dcd0574faaa3d7ec31dd4edd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48bbb92998f54ebeb624bc794d406896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:50:57.710393 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-e54fc967-63e9-44ed-baa2-ebb760ae4de0 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] 10.222.0.50 "GET /compute/v2.1/servers/af35a390-86bf-4618-bce0-db7423a065bb" status: 200 len: 1313 microversion: 2.1 time: 0.539419 Aug 10 17:50:57.730331 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 232/475] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:50:57 2022] GET /compute/v2.1/servers/af35a390-86bf-4618-bce0-db7423a065bb => generated 1313 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:50:57.994220 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-a4396a16-0669-4a79-b776-613718955082 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:50:57.995764 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-a4396a16-0669-4a79-b776-613718955082 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: af745ef7-21f0-4149-ba68-33f45f73f2dd] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:50:58.016404 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a4396a16-0669-4a79-b776-613718955082 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:58.017568 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a4396a16-0669-4a79-b776-613718955082 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:58.019499 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a4396a16-0669-4a79-b776-613718955082 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:58.022725 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a4396a16-0669-4a79-b776-613718955082 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:58.024345 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a4396a16-0669-4a79-b776-613718955082 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:58.025064 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a4396a16-0669-4a79-b776-613718955082 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:58.442716 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-a4396a16-0669-4a79-b776-613718955082 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:50:58.455711 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-a4396a16-0669-4a79-b776-613718955082 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/af745ef7-21f0-4149-ba68-33f45f73f2dd" status: 200 len: 1316 microversion: 2.1 time: 0.465075 Aug 10 17:50:58.457073 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 244/476] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:50:57 2022] GET /compute/v2.1/servers/af745ef7-21f0-4149-ba68-33f45f73f2dd => generated 1316 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:50:58.736709 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-51350dba-f527-4ad7-88a7-3af18bed878f tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:50:58.739056 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-51350dba-f527-4ad7-88a7-3af18bed878f tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] [instance: af35a390-86bf-4618-bce0-db7423a065bb] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:50:58.766278 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-51350dba-f527-4ad7-88a7-3af18bed878f tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:58.766973 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-51350dba-f527-4ad7-88a7-3af18bed878f tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:58.767569 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-51350dba-f527-4ad7-88a7-3af18bed878f tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:58.769365 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-51350dba-f527-4ad7-88a7-3af18bed878f tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:58.771587 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-51350dba-f527-4ad7-88a7-3af18bed878f tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:58.773422 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-51350dba-f527-4ad7-88a7-3af18bed878f tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:59.096416 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-51350dba-f527-4ad7-88a7-3af18bed878f tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e109c3dcd0574faaa3d7ec31dd4edd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48bbb92998f54ebeb624bc794d406896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:50:59.110461 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-51350dba-f527-4ad7-88a7-3af18bed878f tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] 10.222.0.50 "GET /compute/v2.1/servers/af35a390-86bf-4618-bce0-db7423a065bb" status: 200 len: 1313 microversion: 2.1 time: 0.375545 Aug 10 17:50:59.112785 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 233/477] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:50:58 2022] GET /compute/v2.1/servers/af35a390-86bf-4618-bce0-db7423a065bb => generated 1313 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:50:59.325451 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [req-8fe93e05-06dd-4176-a19c-e55522d16678 req-a1a7592e-e189-4fd2-b06c-8f5e0761d199 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af745ef7-21f0-4149-ba68-33f45f73f2dd", "name": "network-vif-plugged", "status": "completed", "tag": "fdbd759d-9bf2-43a9-9597-36bcdc4fb718"}]} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:50:59.340812 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-8fe93e05-06dd-4176-a19c-e55522d16678 req-a1a7592e-e189-4fd2-b06c-8f5e0761d199 service nova] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:59.342290 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-8fe93e05-06dd-4176-a19c-e55522d16678 req-a1a7592e-e189-4fd2-b06c-8f5e0761d199 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:59.346016 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-8fe93e05-06dd-4176-a19c-e55522d16678 req-a1a7592e-e189-4fd2-b06c-8f5e0761d199 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:59.378654 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.compute.server_external_events [req-8fe93e05-06dd-4176-a19c-e55522d16678 req-a1a7592e-e189-4fd2-b06c-8f5e0761d199 service nova] Creating event network-vif-plugged:fdbd759d-9bf2-43a9-9597-36bcdc4fb718 for instance af745ef7-21f0-4149-ba68-33f45f73f2dd on n-h1-852296-2 Aug 10 17:50:59.395319 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [req-8fe93e05-06dd-4176-a19c-e55522d16678 req-a1a7592e-e189-4fd2-b06c-8f5e0761d199 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073211 Aug 10 17:50:59.398099 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 245/478] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 10 17:50:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:50:59.478095 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-4f8e9d85-ee4f-44d4-b2f7-a778cb760317 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:50:59.478876 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-4f8e9d85-ee4f-44d4-b2f7-a778cb760317 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: af745ef7-21f0-4149-ba68-33f45f73f2dd] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:50:59.495322 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-4f8e9d85-ee4f-44d4-b2f7-a778cb760317 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:59.498816 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-4f8e9d85-ee4f-44d4-b2f7-a778cb760317 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:59.498816 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-4f8e9d85-ee4f-44d4-b2f7-a778cb760317 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:59.498816 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-4f8e9d85-ee4f-44d4-b2f7-a778cb760317 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:59.498816 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-4f8e9d85-ee4f-44d4-b2f7-a778cb760317 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:59.498816 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-4f8e9d85-ee4f-44d4-b2f7-a778cb760317 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:59.708581 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [req-8ff32322-547c-4c0c-8136-e600c1de1b1a req-48fe3b6f-97d5-4f1c-bb94-4b07fd016096 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af35a390-86bf-4618-bce0-db7423a065bb", "tag": "fd08385d-d8e2-4f4b-ac59-f79dbc7a4c5d"}]} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:50:59.714980 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_cell0:SELECT=4 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:50:59.728551 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-8ff32322-547c-4c0c-8136-e600c1de1b1a req-48fe3b6f-97d5-4f1c-bb94-4b07fd016096 service nova] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:50:59.729124 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-8ff32322-547c-4c0c-8136-e600c1de1b1a req-48fe3b6f-97d5-4f1c-bb94-4b07fd016096 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:50:59.731780 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-8ff32322-547c-4c0c-8136-e600c1de1b1a req-48fe3b6f-97d5-4f1c-bb94-4b07fd016096 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:50:59.760154 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.compute.server_external_events [req-8ff32322-547c-4c0c-8136-e600c1de1b1a req-48fe3b6f-97d5-4f1c-bb94-4b07fd016096 service nova] Creating event network-changed:fd08385d-d8e2-4f4b-ac59-f79dbc7a4c5d for instance af35a390-86bf-4618-bce0-db7423a065bb on n-h2-852296-2 Aug 10 17:50:59.768872 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [req-8ff32322-547c-4c0c-8136-e600c1de1b1a req-48fe3b6f-97d5-4f1c-bb94-4b07fd016096 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065009 Aug 10 17:50:59.773213 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 246/479] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 10 17:50:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:50:59.900072 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_cell0:SELECT=32 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:51:00.136485 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-23e4b049-8c34-4fce-883a-d232c7d2b480 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:00.137483 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-23e4b049-8c34-4fce-883a-d232c7d2b480 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] [instance: af35a390-86bf-4618-bce0-db7423a065bb] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:51:00.154978 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-23e4b049-8c34-4fce-883a-d232c7d2b480 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:00.159149 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-23e4b049-8c34-4fce-883a-d232c7d2b480 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:00.159149 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-23e4b049-8c34-4fce-883a-d232c7d2b480 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:00.159149 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-23e4b049-8c34-4fce-883a-d232c7d2b480 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:00.159149 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-23e4b049-8c34-4fce-883a-d232c7d2b480 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:00.159149 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-23e4b049-8c34-4fce-883a-d232c7d2b480 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:00.504901 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-4f8e9d85-ee4f-44d4-b2f7-a778cb760317 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:51:00.513166 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-4f8e9d85-ee4f-44d4-b2f7-a778cb760317 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/af745ef7-21f0-4149-ba68-33f45f73f2dd" status: 200 len: 1316 microversion: 2.1 time: 1.039135 Aug 10 17:51:00.513681 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 234/480] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:50:59 2022] GET /compute/v2.1/servers/af745ef7-21f0-4149-ba68-33f45f73f2dd => generated 1316 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:51:00.524443 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-23e4b049-8c34-4fce-883a-d232c7d2b480 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e109c3dcd0574faaa3d7ec31dd4edd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48bbb92998f54ebeb624bc794d406896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:51:00.534560 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-23e4b049-8c34-4fce-883a-d232c7d2b480 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] 10.222.0.50 "GET /compute/v2.1/servers/af35a390-86bf-4618-bce0-db7423a065bb" status: 200 len: 1313 microversion: 2.1 time: 0.402096 Aug 10 17:51:00.538509 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 247/481] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:51:00 2022] GET /compute/v2.1/servers/af35a390-86bf-4618-bce0-db7423a065bb => generated 1313 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:51:01.535950 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-30774333-8e36-4925-8e34-4f3feb1ab7ea tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:01.537352 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-30774333-8e36-4925-8e34-4f3feb1ab7ea tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: af745ef7-21f0-4149-ba68-33f45f73f2dd] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:51:01.553884 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-30774333-8e36-4925-8e34-4f3feb1ab7ea tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:01.557014 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-30774333-8e36-4925-8e34-4f3feb1ab7ea tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:01.563301 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-dfbfe9fa-d065-450b-89e3-bab5e361cebf tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:01.564738 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-dfbfe9fa-d065-450b-89e3-bab5e361cebf tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] [instance: af35a390-86bf-4618-bce0-db7423a065bb] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:51:01.569275 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-30774333-8e36-4925-8e34-4f3feb1ab7ea tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:01.577622 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-30774333-8e36-4925-8e34-4f3feb1ab7ea tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:01.577622 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-30774333-8e36-4925-8e34-4f3feb1ab7ea tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:01.577622 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-30774333-8e36-4925-8e34-4f3feb1ab7ea tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:01.581719 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_cell0:SELECT=34 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:51:01.590565 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-dfbfe9fa-d065-450b-89e3-bab5e361cebf tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:01.596910 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-dfbfe9fa-d065-450b-89e3-bab5e361cebf tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:01.599001 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-dfbfe9fa-d065-450b-89e3-bab5e361cebf tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:01.605254 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-dfbfe9fa-d065-450b-89e3-bab5e361cebf tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:01.607796 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-dfbfe9fa-d065-450b-89e3-bab5e361cebf tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:01.610501 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-dfbfe9fa-d065-450b-89e3-bab5e361cebf tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:01.897151 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-dfbfe9fa-d065-450b-89e3-bab5e361cebf tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e109c3dcd0574faaa3d7ec31dd4edd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48bbb92998f54ebeb624bc794d406896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:51:01.912464 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-dfbfe9fa-d065-450b-89e3-bab5e361cebf tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] 10.222.0.50 "GET /compute/v2.1/servers/af35a390-86bf-4618-bce0-db7423a065bb" status: 200 len: 1313 microversion: 2.1 time: 0.353081 Aug 10 17:51:01.913249 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 248/482] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:51:01 2022] GET /compute/v2.1/servers/af35a390-86bf-4618-bce0-db7423a065bb => generated 1313 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:51:02.478820 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-2e486eb5-82ab-4a58-a6a4-56ace55a8541 tempest-HypervisorAdminNegativeTestJSON-813149892 tempest-HypervisorAdminNegativeTestJSON-813149892-project] Calling method '.version_select at 0x7fb3465e48b0>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:02.480204 n-d-852296-2 devstack@n-api.service[129410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:51:02.480204 n-d-852296-2 devstack@n-api.service[129410]: warnings.warn(msg) Aug 10 17:51:02.481778 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-2e486eb5-82ab-4a58-a6a4-56ace55a8541 tempest-HypervisorAdminNegativeTestJSON-813149892 tempest-HypervisorAdminNegativeTestJSON-813149892-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': '2761150f48084bfa8bbab5748212bf16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fff14d98024d6e9c7ed0960289b1d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:51:02.484065 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-2e486eb5-82ab-4a58-a6a4-56ace55a8541 tempest-HypervisorAdminNegativeTestJSON-813149892 tempest-HypervisorAdminNegativeTestJSON-813149892-project] Request method failure captured: Aug 10 17:51:02.484065 n-d-852296-2 devstack@n-api.service[129410]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Aug 10 17:51:02.484065 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 17:51:02.484065 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 17:51:02.484065 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 17:51:02.484065 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 0 Aug 10 17:51:02.484065 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 17:51:02.484065 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 17:51:02.484065 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 17:51:02.484065 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 17:51:02.484065 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8_ADtDS3DH9jXGdbMnxfaEfex4LqlvJvVi7Tp7FbFmf9IK94WTciBNtvo5jm6Y-cnGNQviuPPCRrj3I9jcgEOJPx306Dt8DVPYDpLznmd-P9nT7P_TfH54McuKMsfMRVxHR4ayXq_-H3-Mw3-eMJ-Kkjq8rmjkILYC76isv5Oz4nG8o Aug 10 17:51:02.484065 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 17:51:02.484065 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 17:51:02.484065 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 17:51:02.484065 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 17:51:02.484065 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 17:51:02.484065 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 17:51:02.484065 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: 30fff14d98024d6e9c7ed0960289b1d1 Aug 10 17:51:02.484065 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-813149892 Aug 10 17:51:02.484065 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 17:51:02.484065 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 17:51:02.484065 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/30fff14d98024d6e9c7ed0960289b1d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/30fff14d98024d6e9c7ed0960289b1d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/30fff14d98024d6e9c7ed0960289b1d1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_30fff14d98024d6e9c7ed0960289b1d1", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:51:02.484065 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-813149892 Aug 10 17:51:02.484065 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: 30fff14d98024d6e9c7ed0960289b1d1 Aug 10 17:51:02.484065 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-813149892 Aug 10 17:51:02.484065 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-HypervisorAdminNegativeTestJSON-813149892-project Aug 10 17:51:02.484065 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 17:51:02.484065 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 17:51:02.484065 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: 2761150f48084bfa8bbab5748212bf16 Aug 10 17:51:02.484065 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-813149892-project Aug 10 17:51:02.484065 n-d-852296-2 devstack@n-api.service[129410]: method: Aug 10 17:51:02.484065 n-d-852296-2 devstack@n-api.service[129410]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Aug 10 17:51:02.484065 n-d-852296-2 devstack@n-api.service[129410]: action_args: {} Aug 10 17:51:02.484065 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:51:02.484065 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:51:02.484065 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:51:02.484065 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:51:02.484065 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:51:02.484065 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:51:02.484065 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 17:51:02.484065 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 17:51:02.484065 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:51:02.484065 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:51:02.484065 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Aug 10 17:51:02.484065 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._detail(req) Aug 10 17:51:02.484065 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Aug 10 17:51:02.484065 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Aug 10 17:51:02.484065 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 10 17:51:02.484065 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 10 17:51:02.484065 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 10 17:51:02.484065 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 10 17:51:02.484065 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 10 17:51:02.484065 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 10 17:51:02.484065 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 10 17:51:02.484065 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise self.value Aug 10 17:51:02.484065 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 10 17:51:02.484065 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 10 17:51:02.484065 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 10 17:51:02.484065 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 10 17:51:02.484065 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 10 17:51:02.484065 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 10 17:51:02.484065 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Aug 10 17:51:02.484065 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:51:02.489163 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:51:02.489163 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:51:02.489163 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:51:02.489163 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:51:02.489163 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:51:02.489163 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 10 17:51:02.489163 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 10 17:51:02.489163 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Aug 10 17:51:02.489163 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:51:02.490944 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-2e486eb5-82ab-4a58-a6a4-56ace55a8541 tempest-HypervisorAdminNegativeTestJSON-813149892 tempest-HypervisorAdminNegativeTestJSON-813149892-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:51:02.492050 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-2e486eb5-82ab-4a58-a6a4-56ace55a8541 tempest-HypervisorAdminNegativeTestJSON-813149892 tempest-HypervisorAdminNegativeTestJSON-813149892-project] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.577671 Aug 10 17:51:02.492799 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 249/483] 10.222.0.50 () {58 vars in 1167 bytes} [Wed Aug 10 17:51:01 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 579 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:51:02.509128 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-4425fca2-be79-4131-86a4-e05795c6e1f5 tempest-HypervisorAdminNegativeTestJSON-813149892 tempest-HypervisorAdminNegativeTestJSON-813149892-project] Calling method '.version_select at 0x7fb346601b80>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:02.510235 n-d-852296-2 devstack@n-api.service[129410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:51:02.510235 n-d-852296-2 devstack@n-api.service[129410]: warnings.warn(msg) Aug 10 17:51:02.514226 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-4425fca2-be79-4131-86a4-e05795c6e1f5 tempest-HypervisorAdminNegativeTestJSON-813149892 tempest-HypervisorAdminNegativeTestJSON-813149892-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': '2761150f48084bfa8bbab5748212bf16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fff14d98024d6e9c7ed0960289b1d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:51:02.516300 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-4425fca2-be79-4131-86a4-e05795c6e1f5 tempest-HypervisorAdminNegativeTestJSON-813149892 tempest-HypervisorAdminNegativeTestJSON-813149892-project] Request method failure captured: Aug 10 17:51:02.516300 n-d-852296-2 devstack@n-api.service[129410]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Aug 10 17:51:02.516300 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 17:51:02.516300 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 17:51:02.516300 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 17:51:02.516300 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 0 Aug 10 17:51:02.516300 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 17:51:02.516300 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 17:51:02.516300 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 17:51:02.516300 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 17:51:02.516300 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8_ADtDS3DH9jXGdbMnxfaEfex4LqlvJvVi7Tp7FbFmf9IK94WTciBNtvo5jm6Y-cnGNQviuPPCRrj3I9jcgEOJPx306Dt8DVPYDpLznmd-P9nT7P_TfH54McuKMsfMRVxHR4ayXq_-H3-Mw3-eMJ-Kkjq8rmjkILYC76isv5Oz4nG8o Aug 10 17:51:02.516300 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 17:51:02.516300 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 17:51:02.516300 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 17:51:02.516300 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 17:51:02.516300 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 17:51:02.516300 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 17:51:02.516300 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: 30fff14d98024d6e9c7ed0960289b1d1 Aug 10 17:51:02.516300 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-813149892 Aug 10 17:51:02.516300 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 17:51:02.516300 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 17:51:02.516300 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/30fff14d98024d6e9c7ed0960289b1d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/30fff14d98024d6e9c7ed0960289b1d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/30fff14d98024d6e9c7ed0960289b1d1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_30fff14d98024d6e9c7ed0960289b1d1", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:51:02.516300 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-813149892 Aug 10 17:51:02.516300 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: 30fff14d98024d6e9c7ed0960289b1d1 Aug 10 17:51:02.516300 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-813149892 Aug 10 17:51:02.516300 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-HypervisorAdminNegativeTestJSON-813149892-project Aug 10 17:51:02.516300 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 17:51:02.516300 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 17:51:02.516300 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: 2761150f48084bfa8bbab5748212bf16 Aug 10 17:51:02.516300 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-813149892-project Aug 10 17:51:02.516300 n-d-852296-2 devstack@n-api.service[129410]: method: Aug 10 17:51:02.516300 n-d-852296-2 devstack@n-api.service[129410]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Aug 10 17:51:02.516300 n-d-852296-2 devstack@n-api.service[129410]: action_args: {} Aug 10 17:51:02.516300 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:51:02.516300 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:51:02.516300 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:51:02.516300 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:51:02.516300 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:51:02.516300 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:51:02.516300 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 17:51:02.516300 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 17:51:02.516300 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:51:02.516300 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:51:02.516300 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Aug 10 17:51:02.516300 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._index(req) Aug 10 17:51:02.516300 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Aug 10 17:51:02.516300 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Aug 10 17:51:02.516300 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 10 17:51:02.516300 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 10 17:51:02.516300 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 10 17:51:02.516300 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 10 17:51:02.516300 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 10 17:51:02.516300 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 10 17:51:02.516300 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 10 17:51:02.516300 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise self.value Aug 10 17:51:02.516300 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 10 17:51:02.516300 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 10 17:51:02.516300 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 10 17:51:02.516300 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 10 17:51:02.516300 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 10 17:51:02.516300 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 10 17:51:02.516300 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Aug 10 17:51:02.516300 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:51:02.520326 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:51:02.520326 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:51:02.520326 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:51:02.520326 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:51:02.520326 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:51:02.520326 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 10 17:51:02.520326 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 10 17:51:02.520326 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Aug 10 17:51:02.520326 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:51:02.523355 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-4425fca2-be79-4131-86a4-e05795c6e1f5 tempest-HypervisorAdminNegativeTestJSON-813149892 tempest-HypervisorAdminNegativeTestJSON-813149892-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:51:02.524496 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-4425fca2-be79-4131-86a4-e05795c6e1f5 tempest-HypervisorAdminNegativeTestJSON-813149892 tempest-HypervisorAdminNegativeTestJSON-813149892-project] 10.222.0.50 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.023499 Aug 10 17:51:02.529690 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 250/484] 10.222.0.50 () {58 vars in 1146 bytes} [Wed Aug 10 17:51:02 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 30 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:51:02.537740 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-dd045e86-b76e-47af-bba8-c3e053673592 tempest-HypervisorAdminNegativeTestJSON-813149892 tempest-HypervisorAdminNegativeTestJSON-813149892-project] Calling method '.version_select at 0x7fb346a2d820>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:02.539556 n-d-852296-2 devstack@n-api.service[129410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:51:02.539556 n-d-852296-2 devstack@n-api.service[129410]: warnings.warn(msg) Aug 10 17:51:02.541502 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-dd045e86-b76e-47af-bba8-c3e053673592 tempest-HypervisorAdminNegativeTestJSON-813149892 tempest-HypervisorAdminNegativeTestJSON-813149892-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': '2761150f48084bfa8bbab5748212bf16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fff14d98024d6e9c7ed0960289b1d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:51:02.544656 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-dd045e86-b76e-47af-bba8-c3e053673592 tempest-HypervisorAdminNegativeTestJSON-813149892 tempest-HypervisorAdminNegativeTestJSON-813149892-project] Request method failure captured: Aug 10 17:51:02.544656 n-d-852296-2 devstack@n-api.service[129410]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Aug 10 17:51:02.544656 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 17:51:02.544656 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 17:51:02.544656 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 17:51:02.544656 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 0 Aug 10 17:51:02.544656 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 17:51:02.544656 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 17:51:02.544656 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 17:51:02.544656 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 17:51:02.544656 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8_ADtDS3DH9jXGdbMnxfaEfex4LqlvJvVi7Tp7FbFmf9IK94WTciBNtvo5jm6Y-cnGNQviuPPCRrj3I9jcgEOJPx306Dt8DVPYDpLznmd-P9nT7P_TfH54McuKMsfMRVxHR4ayXq_-H3-Mw3-eMJ-Kkjq8rmjkILYC76isv5Oz4nG8o Aug 10 17:51:02.544656 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 17:51:02.544656 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 17:51:02.544656 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 17:51:02.544656 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 17:51:02.544656 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 17:51:02.544656 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 17:51:02.544656 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: 30fff14d98024d6e9c7ed0960289b1d1 Aug 10 17:51:02.544656 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-813149892 Aug 10 17:51:02.544656 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 17:51:02.544656 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 17:51:02.544656 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/30fff14d98024d6e9c7ed0960289b1d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/30fff14d98024d6e9c7ed0960289b1d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/30fff14d98024d6e9c7ed0960289b1d1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_30fff14d98024d6e9c7ed0960289b1d1", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:51:02.544656 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-813149892 Aug 10 17:51:02.544656 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: 30fff14d98024d6e9c7ed0960289b1d1 Aug 10 17:51:02.544656 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-813149892 Aug 10 17:51:02.544656 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-HypervisorAdminNegativeTestJSON-813149892-project Aug 10 17:51:02.544656 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 17:51:02.544656 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 17:51:02.544656 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: 2761150f48084bfa8bbab5748212bf16 Aug 10 17:51:02.544656 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-813149892-project Aug 10 17:51:02.544656 n-d-852296-2 devstack@n-api.service[129410]: method: Aug 10 17:51:02.544656 n-d-852296-2 devstack@n-api.service[129410]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Aug 10 17:51:02.544656 n-d-852296-2 devstack@n-api.service[129410]: action_args: {} Aug 10 17:51:02.544656 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:51:02.544656 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:51:02.544656 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:51:02.544656 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:51:02.544656 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:51:02.544656 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:51:02.544656 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 17:51:02.544656 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 17:51:02.544656 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:51:02.544656 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:51:02.544656 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Aug 10 17:51:02.544656 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Aug 10 17:51:02.544656 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 10 17:51:02.544656 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 10 17:51:02.544656 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 10 17:51:02.544656 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 10 17:51:02.544656 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 10 17:51:02.544656 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 10 17:51:02.544656 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 10 17:51:02.544656 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise self.value Aug 10 17:51:02.544656 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 10 17:51:02.544656 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 10 17:51:02.544656 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 10 17:51:02.544656 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 10 17:51:02.544656 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 10 17:51:02.544656 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 10 17:51:02.544656 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Aug 10 17:51:02.544656 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:51:02.544656 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:51:02.544656 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:51:02.544656 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:51:02.558381 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:51:02.558381 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:51:02.558381 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 10 17:51:02.558381 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 10 17:51:02.558381 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Aug 10 17:51:02.558381 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:51:02.558381 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-dd045e86-b76e-47af-bba8-c3e053673592 tempest-HypervisorAdminNegativeTestJSON-813149892 tempest-HypervisorAdminNegativeTestJSON-813149892-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:51:02.558381 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-dd045e86-b76e-47af-bba8-c3e053673592 tempest-HypervisorAdminNegativeTestJSON-813149892 tempest-HypervisorAdminNegativeTestJSON-813149892-project] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.015265 Aug 10 17:51:02.558381 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 251/485] 10.222.0.50 () {58 vars in 1179 bytes} [Wed Aug 10 17:51:02 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:51:02.649931 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-30774333-8e36-4925-8e34-4f3feb1ab7ea tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:51:02.667322 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-30774333-8e36-4925-8e34-4f3feb1ab7ea tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/af745ef7-21f0-4149-ba68-33f45f73f2dd" status: 200 len: 1316 microversion: 2.1 time: 1.134411 Aug 10 17:51:02.671137 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 235/486] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:51:01 2022] GET /compute/v2.1/servers/af745ef7-21f0-4149-ba68-33f45f73f2dd => generated 1316 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:51:02.932670 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-edb31e32-380d-4dc6-a46c-334096414624 tempest-HypervisorAdminNegativeTestJSON-391323163 tempest-HypervisorAdminNegativeTestJSON-391323163-project-admin] Calling method '.version_select at 0x7fb3465e4dc0>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:02.932670 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-edb31e32-380d-4dc6-a46c-334096414624 tempest-HypervisorAdminNegativeTestJSON-391323163 tempest-HypervisorAdminNegativeTestJSON-391323163-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:02.932670 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-edb31e32-380d-4dc6-a46c-334096414624 tempest-HypervisorAdminNegativeTestJSON-391323163 tempest-HypervisorAdminNegativeTestJSON-391323163-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:02.932670 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-edb31e32-380d-4dc6-a46c-334096414624 tempest-HypervisorAdminNegativeTestJSON-391323163 tempest-HypervisorAdminNegativeTestJSON-391323163-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:02.971235 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-649e456a-d0c7-4932-9832-c877ffe65baa tempest-QuotasAdminTestV257-2144869609 tempest-QuotasAdminTestV257-2144869609-project-admin] Action: 'update', calling method: .version_select at 0x7fb3466a7310>, body: {"quota_set": {"ram": "5120"}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:51:02.990870 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-edb31e32-380d-4dc6-a46c-334096414624 tempest-HypervisorAdminNegativeTestJSON-391323163 tempest-HypervisorAdminNegativeTestJSON-391323163-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:02.991810 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-edb31e32-380d-4dc6-a46c-334096414624 tempest-HypervisorAdminNegativeTestJSON-391323163 tempest-HypervisorAdminNegativeTestJSON-391323163-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:02.993570 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-edb31e32-380d-4dc6-a46c-334096414624 tempest-HypervisorAdminNegativeTestJSON-391323163 tempest-HypervisorAdminNegativeTestJSON-391323163-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:03.033564 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-edb31e32-380d-4dc6-a46c-334096414624 tempest-HypervisorAdminNegativeTestJSON-391323163 tempest-HypervisorAdminNegativeTestJSON-391323163-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:03.037006 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-edb31e32-380d-4dc6-a46c-334096414624 tempest-HypervisorAdminNegativeTestJSON-391323163 tempest-HypervisorAdminNegativeTestJSON-391323163-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:03.039609 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-edb31e32-380d-4dc6-a46c-334096414624 tempest-HypervisorAdminNegativeTestJSON-391323163 tempest-HypervisorAdminNegativeTestJSON-391323163-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:03.066812 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-edb31e32-380d-4dc6-a46c-334096414624 tempest-HypervisorAdminNegativeTestJSON-391323163 tempest-HypervisorAdminNegativeTestJSON-391323163-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.495372 Aug 10 17:51:03.066812 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 252/487] 10.222.0.50 () {58 vars in 1146 bytes} [Wed Aug 10 17:51:02 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:51:03.068206 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-1df32731-2b7c-4331-a4ad-0ab05eaf8265 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:03.068928 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-1df32731-2b7c-4331-a4ad-0ab05eaf8265 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] [instance: af35a390-86bf-4618-bce0-db7423a065bb] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:51:03.076791 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-649e456a-d0c7-4932-9832-c877ffe65baa tempest-QuotasAdminTestV257-2144869609 tempest-QuotasAdminTestV257-2144869609-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:03.076987 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-1df32731-2b7c-4331-a4ad-0ab05eaf8265 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:03.077172 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-649e456a-d0c7-4932-9832-c877ffe65baa tempest-QuotasAdminTestV257-2144869609 tempest-QuotasAdminTestV257-2144869609-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:03.078104 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-1df32731-2b7c-4331-a4ad-0ab05eaf8265 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:03.078623 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-1df32731-2b7c-4331-a4ad-0ab05eaf8265 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:03.079397 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-1df32731-2b7c-4331-a4ad-0ab05eaf8265 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:03.080116 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-1df32731-2b7c-4331-a4ad-0ab05eaf8265 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:03.080771 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-1df32731-2b7c-4331-a4ad-0ab05eaf8265 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:03.081065 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-649e456a-d0c7-4932-9832-c877ffe65baa tempest-QuotasAdminTestV257-2144869609 tempest-QuotasAdminTestV257-2144869609-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:03.084802 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-649e456a-d0c7-4932-9832-c877ffe65baa tempest-QuotasAdminTestV257-2144869609 tempest-QuotasAdminTestV257-2144869609-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:03.085775 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-649e456a-d0c7-4932-9832-c877ffe65baa tempest-QuotasAdminTestV257-2144869609 tempest-QuotasAdminTestV257-2144869609-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:03.088918 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-649e456a-d0c7-4932-9832-c877ffe65baa tempest-QuotasAdminTestV257-2144869609 tempest-QuotasAdminTestV257-2144869609-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:03.340885 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-649e456a-d0c7-4932-9832-c877ffe65baa tempest-QuotasAdminTestV257-2144869609 tempest-QuotasAdminTestV257-2144869609-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-quota-sets/48538190d3844f378521354c2389bfc8" status: 200 len: 148 microversion: 2.57 time: 0.552131 Aug 10 17:51:03.340885 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 236/488] 10.222.0.50 () {62 vars in 1303 bytes} [Wed Aug 10 17:51:02 2022] PUT /compute/v2.1/os-quota-sets/48538190d3844f378521354c2389bfc8 => generated 148 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 17:51:03.354056 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-62008010-1ed2-44ad-b155-29f2a0f9a598 tempest-HypervisorAdminNegativeTestJSON-813149892 tempest-HypervisorAdminNegativeTestJSON-813149892-project] Calling method '.version_select at 0x7fb34697f3a0>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:03.355190 n-d-852296-2 devstack@n-api.service[129409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:51:03.355190 n-d-852296-2 devstack@n-api.service[129409]: warnings.warn(msg) Aug 10 17:51:03.359407 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-62008010-1ed2-44ad-b155-29f2a0f9a598 tempest-HypervisorAdminNegativeTestJSON-813149892 tempest-HypervisorAdminNegativeTestJSON-813149892-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': '2761150f48084bfa8bbab5748212bf16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fff14d98024d6e9c7ed0960289b1d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:51:03.364795 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-62008010-1ed2-44ad-b155-29f2a0f9a598 tempest-HypervisorAdminNegativeTestJSON-813149892 tempest-HypervisorAdminNegativeTestJSON-813149892-project] Request method failure captured: Aug 10 17:51:03.364795 n-d-852296-2 devstack@n-api.service[129409]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Aug 10 17:51:03.364795 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 17:51:03.364795 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 17:51:03.364795 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 17:51:03.364795 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 0 Aug 10 17:51:03.364795 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 17:51:03.364795 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 17:51:03.364795 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 17:51:03.364795 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 17:51:03.364795 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8_ADtDS3DH9jXGdbMnxfaEfex4LqlvJvVi7Tp7FbFmf9IK94WTciBNtvo5jm6Y-cnGNQviuPPCRrj3I9jcgEOJPx306Dt8DVPYDpLznmd-P9nT7P_TfH54McuKMsfMRVxHR4ayXq_-H3-Mw3-eMJ-Kkjq8rmjkILYC76isv5Oz4nG8o Aug 10 17:51:03.364795 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 17:51:03.364795 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 17:51:03.364795 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 17:51:03.364795 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 17:51:03.364795 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 17:51:03.364795 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 17:51:03.364795 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: 30fff14d98024d6e9c7ed0960289b1d1 Aug 10 17:51:03.364795 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-813149892 Aug 10 17:51:03.364795 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 17:51:03.364795 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 17:51:03.364795 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/30fff14d98024d6e9c7ed0960289b1d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/30fff14d98024d6e9c7ed0960289b1d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/30fff14d98024d6e9c7ed0960289b1d1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_30fff14d98024d6e9c7ed0960289b1d1", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:51:03.364795 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-813149892 Aug 10 17:51:03.364795 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: 30fff14d98024d6e9c7ed0960289b1d1 Aug 10 17:51:03.364795 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-813149892 Aug 10 17:51:03.364795 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-HypervisorAdminNegativeTestJSON-813149892-project Aug 10 17:51:03.364795 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 17:51:03.364795 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 17:51:03.364795 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: 2761150f48084bfa8bbab5748212bf16 Aug 10 17:51:03.364795 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-813149892-project Aug 10 17:51:03.364795 n-d-852296-2 devstack@n-api.service[129409]: method: Aug 10 17:51:03.364795 n-d-852296-2 devstack@n-api.service[129409]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Aug 10 17:51:03.364795 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'id': '1'} Aug 10 17:51:03.364795 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:51:03.364795 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:51:03.364795 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:51:03.364795 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:51:03.364795 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:51:03.364795 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:51:03.364795 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 17:51:03.364795 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 17:51:03.364795 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:51:03.364795 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:51:03.364795 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Aug 10 17:51:03.364795 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Aug 10 17:51:03.364795 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 10 17:51:03.364795 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 10 17:51:03.364795 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 10 17:51:03.364795 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 10 17:51:03.364795 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 10 17:51:03.364795 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 10 17:51:03.364795 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 10 17:51:03.364795 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise self.value Aug 10 17:51:03.364795 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 10 17:51:03.364795 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 10 17:51:03.364795 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 10 17:51:03.364795 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 10 17:51:03.364795 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 10 17:51:03.364795 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 10 17:51:03.364795 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Aug 10 17:51:03.364795 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:51:03.364795 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:51:03.364795 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:51:03.364795 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:51:03.370964 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:51:03.370964 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:51:03.370964 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 10 17:51:03.370964 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 10 17:51:03.370964 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Aug 10 17:51:03.370964 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:51:03.374299 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-62008010-1ed2-44ad-b155-29f2a0f9a598 tempest-HypervisorAdminNegativeTestJSON-813149892 tempest-HypervisorAdminNegativeTestJSON-813149892-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:51:03.375488 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-62008010-1ed2-44ad-b155-29f2a0f9a598 tempest-HypervisorAdminNegativeTestJSON-813149892 tempest-HypervisorAdminNegativeTestJSON-813149892-project] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.035067 Aug 10 17:51:03.376574 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 237/489] 10.222.0.50 () {58 vars in 1173 bytes} [Wed Aug 10 17:51:03 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 36 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:51:03.381868 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-63fe53e3-39a6-4789-9f6b-12c220e0099d tempest-QuotasAdminTestV257-2144869609 tempest-QuotasAdminTestV257-2144869609-project-admin] Calling method '.version_select at 0x7fb3466a5940>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:03.522184 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-63fe53e3-39a6-4789-9f6b-12c220e0099d tempest-QuotasAdminTestV257-2144869609 tempest-QuotasAdminTestV257-2144869609-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:03.522965 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-63fe53e3-39a6-4789-9f6b-12c220e0099d tempest-QuotasAdminTestV257-2144869609 tempest-QuotasAdminTestV257-2144869609-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:03.523569 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-63fe53e3-39a6-4789-9f6b-12c220e0099d tempest-QuotasAdminTestV257-2144869609 tempest-QuotasAdminTestV257-2144869609-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:03.524533 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-63fe53e3-39a6-4789-9f6b-12c220e0099d tempest-QuotasAdminTestV257-2144869609 tempest-QuotasAdminTestV257-2144869609-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:03.527423 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-63fe53e3-39a6-4789-9f6b-12c220e0099d tempest-QuotasAdminTestV257-2144869609 tempest-QuotasAdminTestV257-2144869609-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:03.528146 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-63fe53e3-39a6-4789-9f6b-12c220e0099d tempest-QuotasAdminTestV257-2144869609 tempest-QuotasAdminTestV257-2144869609-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:03.610592 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-63fe53e3-39a6-4789-9f6b-12c220e0099d tempest-QuotasAdminTestV257-2144869609 tempest-QuotasAdminTestV257-2144869609-project-admin] 10.222.0.50 "GET /compute/v2.1/os-quota-sets/48538190d3844f378521354c2389bfc8/detail" status: 200 len: 463 microversion: 2.57 time: 0.232730 Aug 10 17:51:03.616701 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 238/490] 10.222.0.50 () {60 vars in 1304 bytes} [Wed Aug 10 17:51:03 2022] GET /compute/v2.1/os-quota-sets/48538190d3844f378521354c2389bfc8/detail => generated 463 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 17:51:03.628053 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-cec2dfb5-3253-4098-84e1-a2f350e87f86 tempest-HypervisorAdminNegativeTestJSON-391323163 tempest-HypervisorAdminNegativeTestJSON-391323163-project-admin] Calling method '.version_select at 0x7fb34697f310>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:03.630176 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-cec2dfb5-3253-4098-84e1-a2f350e87f86 tempest-HypervisorAdminNegativeTestJSON-391323163 tempest-HypervisorAdminNegativeTestJSON-391323163-project-admin] HTTP exception thrown: Hypervisor with ID '31e6ca52-86e8-4d18-9938-1be341bbde16' could not be found. Aug 10 17:51:03.642420 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-cec2dfb5-3253-4098-84e1-a2f350e87f86 tempest-HypervisorAdminNegativeTestJSON-391323163 tempest-HypervisorAdminNegativeTestJSON-391323163-project-admin] Request method failure captured: Aug 10 17:51:03.642420 n-d-852296-2 devstack@n-api.service[129409]: request: GET /compute/v2.1/os-hypervisors/31e6ca52-86e8-4d18-9938-1be341bbde16/uptime HTTP/1.1 Aug 10 17:51:03.642420 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 17:51:03.642420 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 17:51:03.642420 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 17:51:03.642420 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 0 Aug 10 17:51:03.642420 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 17:51:03.642420 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 17:51:03.642420 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 17:51:03.642420 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 17:51:03.642420 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8_AFLTfoUA1pEIXR09Z-lk9LDWkqC9N0FV_LwuJzheLaIwN_bPGyYozrqUMvy54jUQn49TNOHE-zVMTANvGWD28lO54tZGHVvBrf-diz-b09OZxhPLvS1EkgLSBEz6tAIrvKmIOv0AlfUFdxgAbm1ZIajpz7yqhvgrpRMgMEOLQFE6Y Aug 10 17:51:03.642420 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 17:51:03.642420 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 17:51:03.642420 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 17:51:03.642420 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 17:51:03.642420 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 17:51:03.642420 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 17:51:03.642420 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: b986bcaaa4f14ee796bbd548827eaaf7 Aug 10 17:51:03.642420 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-391323163 Aug 10 17:51:03.642420 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member,admin Aug 10 17:51:03.642420 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member,admin Aug 10 17:51:03.642420 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b986bcaaa4f14ee796bbd548827eaaf7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/b986bcaaa4f14ee796bbd548827eaaf7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b986bcaaa4f14ee796bbd548827eaaf7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_b986bcaaa4f14ee796bbd548827eaaf7", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:51:03.642420 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-391323163 Aug 10 17:51:03.642420 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: b986bcaaa4f14ee796bbd548827eaaf7 Aug 10 17:51:03.642420 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-391323163 Aug 10 17:51:03.642420 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-HypervisorAdminNegativeTestJSON-391323163-project-admin Aug 10 17:51:03.642420 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 17:51:03.642420 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 17:51:03.642420 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: fdcaa9d118c14d1eb7f84f963301acc6 Aug 10 17:51:03.642420 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-391323163-project-admin Aug 10 17:51:03.642420 n-d-852296-2 devstack@n-api.service[129409]: method: Aug 10 17:51:03.642420 n-d-852296-2 devstack@n-api.service[129409]: exception: Hypervisor with ID '31e6ca52-86e8-4d18-9938-1be341bbde16' could not be found. Aug 10 17:51:03.642420 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'id': '31e6ca52-86e8-4d18-9938-1be341bbde16'} Aug 10 17:51:03.642420 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:51:03.642420 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:51:03.642420 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Aug 10 17:51:03.642420 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi value = int(str(value)) Aug 10 17:51:03.642420 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '31e6ca52-86e8-4d18-9938-1be341bbde16' Aug 10 17:51:03.642420 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:51:03.642420 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:51:03.642420 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:51:03.642420 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:51:03.642420 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Aug 10 17:51:03.642420 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Aug 10 17:51:03.642420 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Aug 10 17:51:03.642420 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Aug 10 17:51:03.642420 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Aug 10 17:51:03.642420 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:51:03.642420 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:51:03.642420 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:51:03.642420 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:51:03.642420 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Aug 10 17:51:03.642420 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Aug 10 17:51:03.642420 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Aug 10 17:51:03.642420 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Aug 10 17:51:03.642420 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Aug 10 17:51:03.642420 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:51:03.642420 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:51:03.642420 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:51:03.642420 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:51:03.642420 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:51:03.642420 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:51:03.642420 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:51:03.642420 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:51:03.642420 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 17:51:03.649909 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 17:51:03.649909 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:51:03.649909 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:51:03.649909 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Aug 10 17:51:03.649909 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Aug 10 17:51:03.649909 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Aug 10 17:51:03.649909 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 10 17:51:03.649909 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '31e6ca52-86e8-4d18-9938-1be341bbde16' could not be found. Aug 10 17:51:03.649909 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:51:03.649909 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:51:03.649909 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:51:03.649909 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:51:03.649909 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:51:03.649909 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:51:03.649909 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:51:03.649909 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:51:03.649909 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '31e6ca52-86e8-4d18-9938-1be341bbde16' could not be found. Aug 10 17:51:03.649909 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:51:03.649909 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-cec2dfb5-3253-4098-84e1-a2f350e87f86 tempest-HypervisorAdminNegativeTestJSON-391323163 tempest-HypervisorAdminNegativeTestJSON-391323163-project-admin] Returning 404 to user: Hypervisor with ID '31e6ca52-86e8-4d18-9938-1be341bbde16' could not be found. {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:51:03.649909 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-cec2dfb5-3253-4098-84e1-a2f350e87f86 tempest-HypervisorAdminNegativeTestJSON-391323163 tempest-HypervisorAdminNegativeTestJSON-391323163-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/31e6ca52-86e8-4d18-9938-1be341bbde16/uptime" status: 404 len: 123 microversion: 2.1 time: 0.025655 Aug 10 17:51:03.653053 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 239/491] 10.222.0.50 () {58 vars in 1278 bytes} [Wed Aug 10 17:51:03 2022] GET /compute/v2.1/os-hypervisors/31e6ca52-86e8-4d18-9938-1be341bbde16/uptime => generated 123 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:51:03.670682 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-7b487c6e-bfbd-495a-b5e3-0546af504e03 tempest-HypervisorAdminNegativeTestJSON-391323163 tempest-HypervisorAdminNegativeTestJSON-391323163-project-admin] Calling method '.version_select at 0x7fb3466a55e0>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:03.673905 n-d-852296-2 devstack@n-api.service[129409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:51:03.673905 n-d-852296-2 devstack@n-api.service[129409]: warnings.warn(msg) Aug 10 17:51:03.678754 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7b487c6e-bfbd-495a-b5e3-0546af504e03 tempest-HypervisorAdminNegativeTestJSON-391323163 tempest-HypervisorAdminNegativeTestJSON-391323163-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:03.679511 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7b487c6e-bfbd-495a-b5e3-0546af504e03 tempest-HypervisorAdminNegativeTestJSON-391323163 tempest-HypervisorAdminNegativeTestJSON-391323163-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:03.689670 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7b487c6e-bfbd-495a-b5e3-0546af504e03 tempest-HypervisorAdminNegativeTestJSON-391323163 tempest-HypervisorAdminNegativeTestJSON-391323163-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:03.732937 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7b487c6e-bfbd-495a-b5e3-0546af504e03 tempest-HypervisorAdminNegativeTestJSON-391323163 tempest-HypervisorAdminNegativeTestJSON-391323163-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:03.735539 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7b487c6e-bfbd-495a-b5e3-0546af504e03 tempest-HypervisorAdminNegativeTestJSON-391323163 tempest-HypervisorAdminNegativeTestJSON-391323163-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:03.737389 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7b487c6e-bfbd-495a-b5e3-0546af504e03 tempest-HypervisorAdminNegativeTestJSON-391323163 tempest-HypervisorAdminNegativeTestJSON-391323163-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:03.773711 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7b487c6e-bfbd-495a-b5e3-0546af504e03 tempest-HypervisorAdminNegativeTestJSON-391323163 tempest-HypervisorAdminNegativeTestJSON-391323163-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:03.775803 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7b487c6e-bfbd-495a-b5e3-0546af504e03 tempest-HypervisorAdminNegativeTestJSON-391323163 tempest-HypervisorAdminNegativeTestJSON-391323163-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:03.776618 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7b487c6e-bfbd-495a-b5e3-0546af504e03 tempest-HypervisorAdminNegativeTestJSON-391323163 tempest-HypervisorAdminNegativeTestJSON-391323163-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:03.790637 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_cell1:SELECT=100 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:51:03.797179 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-7b487c6e-bfbd-495a-b5e3-0546af504e03 tempest-HypervisorAdminNegativeTestJSON-391323163 tempest-HypervisorAdminNegativeTestJSON-391323163-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.136213 Aug 10 17:51:03.799929 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 240/492] 10.222.0.50 () {58 vars in 1146 bytes} [Wed Aug 10 17:51:03 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:51:03.815527 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-67f95a5b-d6dc-40c1-8b62-b51c20c24061 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:03.821142 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-67f95a5b-d6dc-40c1-8b62-b51c20c24061 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: af745ef7-21f0-4149-ba68-33f45f73f2dd] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:51:03.825172 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-67f95a5b-d6dc-40c1-8b62-b51c20c24061 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:03.825886 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-67f95a5b-d6dc-40c1-8b62-b51c20c24061 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:03.826489 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-67f95a5b-d6dc-40c1-8b62-b51c20c24061 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:03.827424 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-67f95a5b-d6dc-40c1-8b62-b51c20c24061 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:03.828058 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-67f95a5b-d6dc-40c1-8b62-b51c20c24061 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:03.828672 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-67f95a5b-d6dc-40c1-8b62-b51c20c24061 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:04.099160 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-1df32731-2b7c-4331-a4ad-0ab05eaf8265 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e109c3dcd0574faaa3d7ec31dd4edd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48bbb92998f54ebeb624bc794d406896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:51:04.110150 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-1df32731-2b7c-4331-a4ad-0ab05eaf8265 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] 10.222.0.50 "GET /compute/v2.1/servers/af35a390-86bf-4618-bce0-db7423a065bb" status: 200 len: 1313 microversion: 2.1 time: 1.047356 Aug 10 17:51:04.110664 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 253/493] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:51:03 2022] GET /compute/v2.1/servers/af35a390-86bf-4618-bce0-db7423a065bb => generated 1313 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:51:04.152508 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-cee42739-2a21-4417-8bdc-94a7bb99ac29 tempest-HypervisorAdminNegativeTestJSON-813149892 tempest-HypervisorAdminNegativeTestJSON-813149892-project] Calling method '.version_select at 0x7fb3466b3940>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:04.157690 n-d-852296-2 devstack@n-api.service[129410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:51:04.157690 n-d-852296-2 devstack@n-api.service[129410]: warnings.warn(msg) Aug 10 17:51:04.159588 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-cee42739-2a21-4417-8bdc-94a7bb99ac29 tempest-HypervisorAdminNegativeTestJSON-813149892 tempest-HypervisorAdminNegativeTestJSON-813149892-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': '2761150f48084bfa8bbab5748212bf16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fff14d98024d6e9c7ed0960289b1d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:51:04.163039 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-cee42739-2a21-4417-8bdc-94a7bb99ac29 tempest-HypervisorAdminNegativeTestJSON-813149892 tempest-HypervisorAdminNegativeTestJSON-813149892-project] Request method failure captured: Aug 10 17:51:04.163039 n-d-852296-2 devstack@n-api.service[129410]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Aug 10 17:51:04.163039 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 17:51:04.163039 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 17:51:04.163039 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 17:51:04.163039 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 0 Aug 10 17:51:04.163039 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 17:51:04.163039 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 17:51:04.163039 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 17:51:04.163039 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 17:51:04.163039 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8_ADtDS3DH9jXGdbMnxfaEfex4LqlvJvVi7Tp7FbFmf9IK94WTciBNtvo5jm6Y-cnGNQviuPPCRrj3I9jcgEOJPx306Dt8DVPYDpLznmd-P9nT7P_TfH54McuKMsfMRVxHR4ayXq_-H3-Mw3-eMJ-Kkjq8rmjkILYC76isv5Oz4nG8o Aug 10 17:51:04.163039 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 17:51:04.163039 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 17:51:04.163039 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 17:51:04.163039 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 17:51:04.163039 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 17:51:04.163039 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 17:51:04.163039 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: 30fff14d98024d6e9c7ed0960289b1d1 Aug 10 17:51:04.163039 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-813149892 Aug 10 17:51:04.163039 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 17:51:04.163039 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 17:51:04.163039 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/30fff14d98024d6e9c7ed0960289b1d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/30fff14d98024d6e9c7ed0960289b1d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/30fff14d98024d6e9c7ed0960289b1d1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_30fff14d98024d6e9c7ed0960289b1d1", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:51:04.163039 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-813149892 Aug 10 17:51:04.163039 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: 30fff14d98024d6e9c7ed0960289b1d1 Aug 10 17:51:04.163039 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-813149892 Aug 10 17:51:04.163039 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-HypervisorAdminNegativeTestJSON-813149892-project Aug 10 17:51:04.163039 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 17:51:04.163039 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 17:51:04.163039 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: 2761150f48084bfa8bbab5748212bf16 Aug 10 17:51:04.163039 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-813149892-project Aug 10 17:51:04.163039 n-d-852296-2 devstack@n-api.service[129410]: method: Aug 10 17:51:04.163039 n-d-852296-2 devstack@n-api.service[129410]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Aug 10 17:51:04.163039 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'id': '1'} Aug 10 17:51:04.163039 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:51:04.163039 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:51:04.163039 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:51:04.163039 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:51:04.163039 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:51:04.163039 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:51:04.163039 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 17:51:04.163039 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 17:51:04.163039 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:51:04.163039 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:51:04.163039 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Aug 10 17:51:04.163039 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._show(req, id) Aug 10 17:51:04.163039 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Aug 10 17:51:04.163039 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Aug 10 17:51:04.163039 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 10 17:51:04.163039 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 10 17:51:04.163039 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 10 17:51:04.163039 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 10 17:51:04.163039 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 10 17:51:04.163039 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 10 17:51:04.163039 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 10 17:51:04.163039 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise self.value Aug 10 17:51:04.163039 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 10 17:51:04.163039 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 10 17:51:04.163039 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 10 17:51:04.163039 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 10 17:51:04.163039 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 10 17:51:04.163039 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 10 17:51:04.163039 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Aug 10 17:51:04.163039 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:51:04.167716 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:51:04.167716 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:51:04.167716 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:51:04.167716 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:51:04.167716 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:51:04.167716 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 10 17:51:04.167716 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 10 17:51:04.167716 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Aug 10 17:51:04.167716 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:51:04.171663 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-cee42739-2a21-4417-8bdc-94a7bb99ac29 tempest-HypervisorAdminNegativeTestJSON-813149892 tempest-HypervisorAdminNegativeTestJSON-813149892-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:51:04.173454 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-cee42739-2a21-4417-8bdc-94a7bb99ac29 tempest-HypervisorAdminNegativeTestJSON-813149892 tempest-HypervisorAdminNegativeTestJSON-813149892-project] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.053408 Aug 10 17:51:04.177147 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 254/494] 10.222.0.50 () {58 vars in 1152 bytes} [Wed Aug 10 17:51:04 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 65 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:51:04.192589 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-5884bfda-8ff5-4b85-906c-648b25dff924 tempest-QuotasAdminTestV257-2144869609 tempest-QuotasAdminTestV257-2144869609-project-admin] Action: 'update', calling method: .version_select at 0x7fb3465aaee0>, body: {"quota_set": {"ram": "2048"}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:51:04.275449 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-67f95a5b-d6dc-40c1-8b62-b51c20c24061 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:51:04.294401 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-67f95a5b-d6dc-40c1-8b62-b51c20c24061 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/af745ef7-21f0-4149-ba68-33f45f73f2dd" status: 200 len: 1466 microversion: 2.1 time: 0.490525 Aug 10 17:51:04.296971 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 241/495] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:51:03 2022] GET /compute/v2.1/servers/af745ef7-21f0-4149-ba68-33f45f73f2dd => generated 1466 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:51:04.315339 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-b366895e-efbd-4cbd-bd09-d9efb6672876 tempest-HypervisorAdminNegativeTestJSON-391323163 tempest-HypervisorAdminNegativeTestJSON-391323163-project-admin] Calling method '.version_select at 0x7fb3467038b0>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:04.316088 n-d-852296-2 devstack@n-api.service[129409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:51:04.316088 n-d-852296-2 devstack@n-api.service[129409]: warnings.warn(msg) Aug 10 17:51:04.318231 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-b366895e-efbd-4cbd-bd09-d9efb6672876 tempest-HypervisorAdminNegativeTestJSON-391323163 tempest-HypervisorAdminNegativeTestJSON-391323163-project-admin] HTTP exception thrown: Hypervisor with ID '167bb8f8-209e-468b-a732-c62dec2b5a0d' could not be found. Aug 10 17:51:04.330406 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-b366895e-efbd-4cbd-bd09-d9efb6672876 tempest-HypervisorAdminNegativeTestJSON-391323163 tempest-HypervisorAdminNegativeTestJSON-391323163-project-admin] Request method failure captured: Aug 10 17:51:04.330406 n-d-852296-2 devstack@n-api.service[129409]: request: GET /compute/v2.1/os-hypervisors/167bb8f8-209e-468b-a732-c62dec2b5a0d HTTP/1.1 Aug 10 17:51:04.330406 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 17:51:04.330406 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 17:51:04.330406 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 17:51:04.330406 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 0 Aug 10 17:51:04.330406 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 17:51:04.330406 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 17:51:04.330406 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 17:51:04.330406 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 17:51:04.330406 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8_AFLTfoUA1pEIXR09Z-lk9LDWkqC9N0FV_LwuJzheLaIwN_bPGyYozrqUMvy54jUQn49TNOHE-zVMTANvGWD28lO54tZGHVvBrf-diz-b09OZxhPLvS1EkgLSBEz6tAIrvKmIOv0AlfUFdxgAbm1ZIajpz7yqhvgrpRMgMEOLQFE6Y Aug 10 17:51:04.330406 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 17:51:04.330406 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 17:51:04.330406 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 17:51:04.330406 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 17:51:04.330406 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 17:51:04.330406 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 17:51:04.330406 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: b986bcaaa4f14ee796bbd548827eaaf7 Aug 10 17:51:04.330406 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-391323163 Aug 10 17:51:04.330406 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member,admin Aug 10 17:51:04.330406 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member,admin Aug 10 17:51:04.330406 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b986bcaaa4f14ee796bbd548827eaaf7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/b986bcaaa4f14ee796bbd548827eaaf7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b986bcaaa4f14ee796bbd548827eaaf7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_b986bcaaa4f14ee796bbd548827eaaf7", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:51:04.330406 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-391323163 Aug 10 17:51:04.330406 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: b986bcaaa4f14ee796bbd548827eaaf7 Aug 10 17:51:04.330406 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-391323163 Aug 10 17:51:04.330406 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-HypervisorAdminNegativeTestJSON-391323163-project-admin Aug 10 17:51:04.330406 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 17:51:04.330406 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 17:51:04.330406 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: fdcaa9d118c14d1eb7f84f963301acc6 Aug 10 17:51:04.330406 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-391323163-project-admin Aug 10 17:51:04.330406 n-d-852296-2 devstack@n-api.service[129409]: method: Aug 10 17:51:04.330406 n-d-852296-2 devstack@n-api.service[129409]: exception: Hypervisor with ID '167bb8f8-209e-468b-a732-c62dec2b5a0d' could not be found. Aug 10 17:51:04.330406 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'id': '167bb8f8-209e-468b-a732-c62dec2b5a0d'} Aug 10 17:51:04.330406 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:51:04.330406 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:51:04.330406 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Aug 10 17:51:04.330406 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi value = int(str(value)) Aug 10 17:51:04.330406 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '167bb8f8-209e-468b-a732-c62dec2b5a0d' Aug 10 17:51:04.330406 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:51:04.330406 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:51:04.330406 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:51:04.330406 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:51:04.330406 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Aug 10 17:51:04.330406 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Aug 10 17:51:04.330406 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Aug 10 17:51:04.330406 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Aug 10 17:51:04.330406 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Aug 10 17:51:04.330406 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:51:04.330406 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:51:04.330406 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:51:04.330406 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:51:04.330406 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Aug 10 17:51:04.330406 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Aug 10 17:51:04.330406 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Aug 10 17:51:04.330406 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Aug 10 17:51:04.330406 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Aug 10 17:51:04.330406 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:51:04.330406 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:51:04.330406 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:51:04.330406 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:51:04.330406 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:51:04.330406 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:51:04.330406 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:51:04.330406 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:51:04.330406 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 17:51:04.330406 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 17:51:04.335239 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:51:04.335239 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:51:04.335239 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Aug 10 17:51:04.335239 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._show(req, id) Aug 10 17:51:04.335239 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Aug 10 17:51:04.335239 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Aug 10 17:51:04.335239 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Aug 10 17:51:04.335239 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 10 17:51:04.335239 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '167bb8f8-209e-468b-a732-c62dec2b5a0d' could not be found. Aug 10 17:51:04.335239 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:51:04.335239 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:51:04.335239 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:51:04.335239 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:51:04.335239 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:51:04.335239 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:51:04.335239 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:51:04.335239 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:51:04.335239 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '167bb8f8-209e-468b-a732-c62dec2b5a0d' could not be found. Aug 10 17:51:04.335239 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:51:04.335239 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-b366895e-efbd-4cbd-bd09-d9efb6672876 tempest-HypervisorAdminNegativeTestJSON-391323163 tempest-HypervisorAdminNegativeTestJSON-391323163-project-admin] Returning 404 to user: Hypervisor with ID '167bb8f8-209e-468b-a732-c62dec2b5a0d' could not be found. {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:51:04.335239 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-b366895e-efbd-4cbd-bd09-d9efb6672876 tempest-HypervisorAdminNegativeTestJSON-391323163 tempest-HypervisorAdminNegativeTestJSON-391323163-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/167bb8f8-209e-468b-a732-c62dec2b5a0d" status: 404 len: 123 microversion: 2.1 time: 0.032963 Aug 10 17:51:04.335239 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 242/496] 10.222.0.50 () {58 vars in 1257 bytes} [Wed Aug 10 17:51:04 2022] GET /compute/v2.1/os-hypervisors/167bb8f8-209e-468b-a732-c62dec2b5a0d => generated 123 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:51:04.344673 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-5884bfda-8ff5-4b85-906c-648b25dff924 tempest-QuotasAdminTestV257-2144869609 tempest-QuotasAdminTestV257-2144869609-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:04.348748 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-5884bfda-8ff5-4b85-906c-648b25dff924 tempest-QuotasAdminTestV257-2144869609 tempest-QuotasAdminTestV257-2144869609-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:04.349217 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-5884bfda-8ff5-4b85-906c-648b25dff924 tempest-QuotasAdminTestV257-2144869609 tempest-QuotasAdminTestV257-2144869609-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:04.350034 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-5884bfda-8ff5-4b85-906c-648b25dff924 tempest-QuotasAdminTestV257-2144869609 tempest-QuotasAdminTestV257-2144869609-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:04.350494 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-5884bfda-8ff5-4b85-906c-648b25dff924 tempest-QuotasAdminTestV257-2144869609 tempest-QuotasAdminTestV257-2144869609-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:04.359422 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-5884bfda-8ff5-4b85-906c-648b25dff924 tempest-QuotasAdminTestV257-2144869609 tempest-QuotasAdminTestV257-2144869609-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:04.516861 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-5884bfda-8ff5-4b85-906c-648b25dff924 tempest-QuotasAdminTestV257-2144869609 tempest-QuotasAdminTestV257-2144869609-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:04.517356 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-5884bfda-8ff5-4b85-906c-648b25dff924 tempest-QuotasAdminTestV257-2144869609 tempest-QuotasAdminTestV257-2144869609-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:04.517797 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-5884bfda-8ff5-4b85-906c-648b25dff924 tempest-QuotasAdminTestV257-2144869609 tempest-QuotasAdminTestV257-2144869609-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:04.528882 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-5884bfda-8ff5-4b85-906c-648b25dff924 tempest-QuotasAdminTestV257-2144869609 tempest-QuotasAdminTestV257-2144869609-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:04.529464 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-5884bfda-8ff5-4b85-906c-648b25dff924 tempest-QuotasAdminTestV257-2144869609 tempest-QuotasAdminTestV257-2144869609-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:04.531712 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-5884bfda-8ff5-4b85-906c-648b25dff924 tempest-QuotasAdminTestV257-2144869609 tempest-QuotasAdminTestV257-2144869609-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:04.649914 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-d569b9e5-9405-4173-ae52-ec56db54d81a tempest-ServersOnMultiNodesTest-116104069 tempest-ServersOnMultiNodesTest-116104069-project-admin] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:04.650560 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-d569b9e5-9405-4173-ae52-ec56db54d81a tempest-ServersOnMultiNodesTest-116104069 tempest-ServersOnMultiNodesTest-116104069-project-admin] [instance: af745ef7-21f0-4149-ba68-33f45f73f2dd] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:51:04.669257 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-d569b9e5-9405-4173-ae52-ec56db54d81a tempest-ServersOnMultiNodesTest-116104069 tempest-ServersOnMultiNodesTest-116104069-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:04.672131 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-d569b9e5-9405-4173-ae52-ec56db54d81a tempest-ServersOnMultiNodesTest-116104069 tempest-ServersOnMultiNodesTest-116104069-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:04.673024 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-d569b9e5-9405-4173-ae52-ec56db54d81a tempest-ServersOnMultiNodesTest-116104069 tempest-ServersOnMultiNodesTest-116104069-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:04.673939 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-d569b9e5-9405-4173-ae52-ec56db54d81a tempest-ServersOnMultiNodesTest-116104069 tempest-ServersOnMultiNodesTest-116104069-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:04.679039 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-d569b9e5-9405-4173-ae52-ec56db54d81a tempest-ServersOnMultiNodesTest-116104069 tempest-ServersOnMultiNodesTest-116104069-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:04.679712 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-d569b9e5-9405-4173-ae52-ec56db54d81a tempest-ServersOnMultiNodesTest-116104069 tempest-ServersOnMultiNodesTest-116104069-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:05.027932 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-5884bfda-8ff5-4b85-906c-648b25dff924 tempest-QuotasAdminTestV257-2144869609 tempest-QuotasAdminTestV257-2144869609-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-quota-sets/48538190d3844f378521354c2389bfc8?user_id=9fcab916e1134f2ba3f3a1659c83a1c6" status: 200 len: 148 microversion: 2.57 time: 0.849313 Aug 10 17:51:05.028607 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 255/497] 10.222.0.50 () {62 vars in 1384 bytes} [Wed Aug 10 17:51:04 2022] PUT /compute/v2.1/os-quota-sets/48538190d3844f378521354c2389bfc8?user_id=9fcab916e1134f2ba3f3a1659c83a1c6 => generated 148 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 17:51:05.060852 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-872e9d0a-0468-43bf-84fc-a48a9c2a8fb9 tempest-QuotasAdminTestV257-2144869609 tempest-QuotasAdminTestV257-2144869609-project-admin] Calling method '.version_select at 0x7fb3465aa5e0>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:05.271713 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:DELETE=1 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:51:05.293336 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-872e9d0a-0468-43bf-84fc-a48a9c2a8fb9 tempest-QuotasAdminTestV257-2144869609 tempest-QuotasAdminTestV257-2144869609-project-admin] 10.222.0.50 "GET /compute/v2.1/os-quota-sets/48538190d3844f378521354c2389bfc8?user_id=9fcab916e1134f2ba3f3a1659c83a1c6" status: 200 len: 190 microversion: 2.57 time: 0.251268 Aug 10 17:51:05.293908 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 256/498] 10.222.0.50 () {60 vars in 1364 bytes} [Wed Aug 10 17:51:05 2022] GET /compute/v2.1/os-quota-sets/48538190d3844f378521354c2389bfc8?user_id=9fcab916e1134f2ba3f3a1659c83a1c6 => generated 190 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 17:51:05.304213 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-f0873d94-6553-4e56-a8cd-96c2c6e9a288 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:05.309275 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-f0873d94-6553-4e56-a8cd-96c2c6e9a288 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] [instance: af35a390-86bf-4618-bce0-db7423a065bb] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:51:05.329173 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-f0873d94-6553-4e56-a8cd-96c2c6e9a288 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:05.330611 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-f0873d94-6553-4e56-a8cd-96c2c6e9a288 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:05.333405 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-f0873d94-6553-4e56-a8cd-96c2c6e9a288 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:05.334628 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-f0873d94-6553-4e56-a8cd-96c2c6e9a288 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:05.336825 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-f0873d94-6553-4e56-a8cd-96c2c6e9a288 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:05.337501 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-f0873d94-6553-4e56-a8cd-96c2c6e9a288 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:05.395894 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-d569b9e5-9405-4173-ae52-ec56db54d81a tempest-ServersOnMultiNodesTest-116104069 tempest-ServersOnMultiNodesTest-116104069-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/af745ef7-21f0-4149-ba68-33f45f73f2dd" status: 200 len: 1617 microversion: 2.1 time: 1.061865 Aug 10 17:51:05.412660 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 243/499] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:51:04 2022] GET /compute/v2.1/servers/af745ef7-21f0-4149-ba68-33f45f73f2dd => generated 1617 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:51:05.427241 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-702c4aad-cabf-4279-a192-046b05b73b7b tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Action: 'create', calling method: .version_select at 0x7fb346806790>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-473668895", "policies": ["affinity"]}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:51:05.491217 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-702c4aad-cabf-4279-a192-046b05b73b7b tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Getting quotas for project 0638146d08704b2983761619745290b3. Resources: {'server_groups'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:51:05.511953 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-702c4aad-cabf-4279-a192-046b05b73b7b tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Getting quotas for user f76b870a54454956b3926c34f9f27442 and project 0638146d08704b2983761619745290b3. Resources: {'server_groups'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:51:05.548491 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:51:05.765707 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-702c4aad-cabf-4279-a192-046b05b73b7b tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Getting quotas for project 0638146d08704b2983761619745290b3. Resources: {'server_groups'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:51:05.776701 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-702c4aad-cabf-4279-a192-046b05b73b7b tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Getting quotas for user f76b870a54454956b3926c34f9f27442 and project 0638146d08704b2983761619745290b3. Resources: {'server_groups'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:51:05.822498 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-702c4aad-cabf-4279-a192-046b05b73b7b tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "POST /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.400090 Aug 10 17:51:05.837999 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 244/500] 10.222.0.50 () {60 vars in 1174 bytes} [Wed Aug 10 17:51:05 2022] POST /compute/v2.1/os-server-groups => generated 187 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:51:06.179124 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-f0873d94-6553-4e56-a8cd-96c2c6e9a288 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e109c3dcd0574faaa3d7ec31dd4edd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48bbb92998f54ebeb624bc794d406896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:51:06.195039 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-25c2c571-576d-4ef7-8916-28948d3b7bf8 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-541565278", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "206e4d1a-3cdd-468f-8feb-a78dff8ee33c"}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:51:06.206016 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-f0873d94-6553-4e56-a8cd-96c2c6e9a288 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] 10.222.0.50 "GET /compute/v2.1/servers/af35a390-86bf-4618-bce0-db7423a065bb" status: 200 len: 1313 microversion: 2.1 time: 0.909618 Aug 10 17:51:06.206550 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 257/501] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:51:05 2022] GET /compute/v2.1/servers/af35a390-86bf-4618-bce0-db7423a065bb => generated 1313 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:51:06.328507 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.network.neutron [None req-25c2c571-576d-4ef7-8916-28948d3b7bf8 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] validate_networks() for None {{(pid=129409) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 17:51:07.227755 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-910f5b0f-eb6e-4726-b5b1-e90ae2bd4397 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:07.228649 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-910f5b0f-eb6e-4726-b5b1-e90ae2bd4397 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] [instance: af35a390-86bf-4618-bce0-db7423a065bb] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:51:07.248667 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-910f5b0f-eb6e-4726-b5b1-e90ae2bd4397 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:07.250760 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-910f5b0f-eb6e-4726-b5b1-e90ae2bd4397 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:07.254292 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-910f5b0f-eb6e-4726-b5b1-e90ae2bd4397 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:07.255814 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-910f5b0f-eb6e-4726-b5b1-e90ae2bd4397 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:07.256051 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-910f5b0f-eb6e-4726-b5b1-e90ae2bd4397 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:07.256780 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-910f5b0f-eb6e-4726-b5b1-e90ae2bd4397 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:07.419372 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.virt.hardware [None req-25c2c571-576d-4ef7-8916-28948d3b7bf8 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Flavor limits 0:0:0 {{(pid=129409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 17:51:07.420769 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.virt.hardware [None req-25c2c571-576d-4ef7-8916-28948d3b7bf8 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Image limits 0:0:0 {{(pid=129409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 17:51:07.421404 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.virt.hardware [None req-25c2c571-576d-4ef7-8916-28948d3b7bf8 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Flavor pref 0:0:0 {{(pid=129409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 17:51:07.421965 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.virt.hardware [None req-25c2c571-576d-4ef7-8916-28948d3b7bf8 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Image pref 0:0:0 {{(pid=129409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 17:51:07.422874 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.virt.hardware [None req-25c2c571-576d-4ef7-8916-28948d3b7bf8 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 17:51:07.483281 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-25c2c571-576d-4ef7-8916-28948d3b7bf8 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:07.484104 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-25c2c571-576d-4ef7-8916-28948d3b7bf8 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:07.485790 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-25c2c571-576d-4ef7-8916-28948d3b7bf8 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:07.486736 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-25c2c571-576d-4ef7-8916-28948d3b7bf8 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:07.489664 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-25c2c571-576d-4ef7-8916-28948d3b7bf8 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:07.490313 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-25c2c571-576d-4ef7-8916-28948d3b7bf8 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:07.538342 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-25c2c571-576d-4ef7-8916-28948d3b7bf8 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Getting quotas for project 0638146d08704b2983761619745290b3. Resources: {'instances', 'ram', 'cores'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:51:07.551751 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-25c2c571-576d-4ef7-8916-28948d3b7bf8 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Getting quotas for user f76b870a54454956b3926c34f9f27442 and project 0638146d08704b2983761619745290b3. Resources: {'instances', 'ram', 'cores'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:51:07.585888 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-25c2c571-576d-4ef7-8916-28948d3b7bf8 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Going to run 2 instances... {{(pid=129409) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 17:51:07.595055 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-25c2c571-576d-4ef7-8916-28948d3b7bf8 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: 6c7e2e8c-4638-4952-9474-acc6ef457abc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a735ff26-463a-4ffe-a981-ab9d9baa494f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 17:51:07.827475 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-25c2c571-576d-4ef7-8916-28948d3b7bf8 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=129409) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Aug 10 17:51:07.862289 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-25c2c571-576d-4ef7-8916-28948d3b7bf8 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Getting quotas for project 0638146d08704b2983761619745290b3. Resources: {'server_group_members'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:51:07.873078 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-25c2c571-576d-4ef7-8916-28948d3b7bf8 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Getting quotas for user f76b870a54454956b3926c34f9f27442 and project 0638146d08704b2983761619745290b3. Resources: {'server_group_members'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:51:08.070331 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-25c2c571-576d-4ef7-8916-28948d3b7bf8 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Getting quotas for project 0638146d08704b2983761619745290b3. Resources: {'server_group_members'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:51:08.081323 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-25c2c571-576d-4ef7-8916-28948d3b7bf8 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Getting quotas for user f76b870a54454956b3926c34f9f27442 and project 0638146d08704b2983761619745290b3. Resources: {'server_group_members'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:51:08.129776 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-25c2c571-576d-4ef7-8916-28948d3b7bf8 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: f174eccc-36df-40a9-9831-0fb5848664ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a735ff26-463a-4ffe-a981-ab9d9baa494f',instance=,instance_uuid=6c7e2e8c-4638-4952-9474-acc6ef457abc,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 17:51:08.243454 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-910f5b0f-eb6e-4726-b5b1-e90ae2bd4397 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e109c3dcd0574faaa3d7ec31dd4edd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48bbb92998f54ebeb624bc794d406896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:51:08.252957 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-910f5b0f-eb6e-4726-b5b1-e90ae2bd4397 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] 10.222.0.50 "GET /compute/v2.1/servers/af35a390-86bf-4618-bce0-db7423a065bb" status: 200 len: 1313 microversion: 2.1 time: 1.029343 Aug 10 17:51:08.269375 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 258/502] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:51:07 2022] GET /compute/v2.1/servers/af35a390-86bf-4618-bce0-db7423a065bb => generated 1313 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:51:08.444195 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-25c2c571-576d-4ef7-8916-28948d3b7bf8 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Getting quotas for project 0638146d08704b2983761619745290b3. Resources: {'server_group_members'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:51:08.458552 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-25c2c571-576d-4ef7-8916-28948d3b7bf8 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Getting quotas for user f76b870a54454956b3926c34f9f27442 and project 0638146d08704b2983761619745290b3. Resources: {'server_group_members'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:51:08.722768 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-25c2c571-576d-4ef7-8916-28948d3b7bf8 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Getting quotas for project 0638146d08704b2983761619745290b3. Resources: {'server_group_members'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:51:08.741018 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-25c2c571-576d-4ef7-8916-28948d3b7bf8 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Getting quotas for user f76b870a54454956b3926c34f9f27442 and project 0638146d08704b2983761619745290b3. Resources: {'server_group_members'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:51:08.865582 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-25c2c571-576d-4ef7-8916-28948d3b7bf8 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 2.672282 Aug 10 17:51:08.869028 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 245/503] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 17:51:06 2022] POST /compute/v2.1/servers => generated 32 bytes in 2679 msecs (HTTP/1.1 202) 9 headers in 362 bytes (2 switches on core 0) Aug 10 17:51:08.874622 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-8b9157c6-810f-4b45-9dd0-ec32e0f1ee29 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:08.881437 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-8b9157c6-810f-4b45-9dd0-ec32e0f1ee29 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:51:08.889275 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-8b9157c6-810f-4b45-9dd0-ec32e0f1ee29 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Searching by: {'deleted': False, 'project_id': '0638146d08704b2983761619745290b3'} {{(pid=129410) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 10 17:51:08.940425 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-8b9157c6-810f-4b45-9dd0-ec32e0f1ee29 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:08.949810 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-8b9157c6-810f-4b45-9dd0-ec32e0f1ee29 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:08.951537 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-8b9157c6-810f-4b45-9dd0-ec32e0f1ee29 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:08.952591 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-8b9157c6-810f-4b45-9dd0-ec32e0f1ee29 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:08.953216 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-8b9157c6-810f-4b45-9dd0-ec32e0f1ee29 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:08.953844 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-8b9157c6-810f-4b45-9dd0-ec32e0f1ee29 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:09.148695 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.multi_cell_list [None req-8b9157c6-810f-4b45-9dd0-ec32e0f1ee29 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=129410) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 10 17:51:09.547564 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-8b9157c6-810f-4b45-9dd0-ec32e0f1ee29 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers" status: 200 len: 1001 microversion: 2.1 time: 0.674363 Aug 10 17:51:09.555587 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 259/504] 10.222.0.50 () {58 vars in 1125 bytes} [Wed Aug 10 17:51:08 2022] GET /compute/v2.1/servers => generated 1001 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:51:09.561409 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-b3789df8-0593-4ad2-828f-1e21414eb829 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:09.562086 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-b3789df8-0593-4ad2-828f-1e21414eb829 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] [instance: af35a390-86bf-4618-bce0-db7423a065bb] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:51:09.578427 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b3789df8-0593-4ad2-828f-1e21414eb829 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:09.582245 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b3789df8-0593-4ad2-828f-1e21414eb829 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:09.582245 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b3789df8-0593-4ad2-828f-1e21414eb829 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:09.582838 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b3789df8-0593-4ad2-828f-1e21414eb829 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:09.585201 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b3789df8-0593-4ad2-828f-1e21414eb829 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:09.585913 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b3789df8-0593-4ad2-828f-1e21414eb829 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:09.933994 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-8890b3a0-8270-4c6c-ae4a-4d21f265d74a tempest-SecurityGroupRulesNegativeTestJSON-666555183 tempest-SecurityGroupRulesNegativeTestJSON-666555183-project] Action: 'create', calling method: .version_select at 0x7fb346621dc0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-926016589", "description": "tempest-description-1657389006"}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:51:10.589623 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-b3789df8-0593-4ad2-828f-1e21414eb829 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e109c3dcd0574faaa3d7ec31dd4edd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48bbb92998f54ebeb624bc794d406896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:51:10.603728 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-b3789df8-0593-4ad2-828f-1e21414eb829 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] 10.222.0.50 "GET /compute/v2.1/servers/af35a390-86bf-4618-bce0-db7423a065bb" status: 200 len: 1313 microversion: 2.1 time: 1.049887 Aug 10 17:51:10.604361 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 260/505] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:51:09 2022] GET /compute/v2.1/servers/af35a390-86bf-4618-bce0-db7423a065bb => generated 1313 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:51:10.638780 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-e04417e5-b38a-4838-9289-2205efb011f9 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:10.640307 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-e04417e5-b38a-4838-9289-2205efb011f9 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: f174eccc-36df-40a9-9831-0fb5848664ba] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:51:10.786660 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-e04417e5-b38a-4838-9289-2205efb011f9 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:51:10.796286 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-e04417e5-b38a-4838-9289-2205efb011f9 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/f174eccc-36df-40a9-9831-0fb5848664ba" status: 200 len: 1218 microversion: 2.1 time: 0.173464 Aug 10 17:51:10.801098 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 261/506] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:51:10 2022] GET /compute/v2.1/servers/f174eccc-36df-40a9-9831-0fb5848664ba => generated 1218 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:51:11.130996 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-8890b3a0-8270-4c6c-ae4a-4d21f265d74a tempest-SecurityGroupRulesNegativeTestJSON-666555183 tempest-SecurityGroupRulesNegativeTestJSON-666555183-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 2.077411 Aug 10 17:51:11.131591 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 246/507] 10.222.0.50 () {60 vars in 1180 bytes} [Wed Aug 10 17:51:09 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 2079 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:51:11.148148 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-b42d1c58-cfd3-4235-a5c2-b9631cf254d5 tempest-SecurityGroupRulesNegativeTestJSON-666555183 tempest-SecurityGroupRulesNegativeTestJSON-666555183-project] Action: 'create', calling method: .version_select at 0x7fb3465231f0>, body: {"security_group_rule": {"parent_group_id": "a919fb6e-19ca-47d6-b3f1-d6398adeac12", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:51:11.625116 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-adc7c178-bbca-4377-ae52-656f07fc0cfc tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:11.626095 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-adc7c178-bbca-4377-ae52-656f07fc0cfc tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] [instance: af35a390-86bf-4618-bce0-db7423a065bb] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:51:11.647395 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-adc7c178-bbca-4377-ae52-656f07fc0cfc tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:11.648273 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-adc7c178-bbca-4377-ae52-656f07fc0cfc tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:11.648908 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-adc7c178-bbca-4377-ae52-656f07fc0cfc tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:11.649891 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-adc7c178-bbca-4377-ae52-656f07fc0cfc tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:11.650572 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-adc7c178-bbca-4377-ae52-656f07fc0cfc tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:11.651319 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-adc7c178-bbca-4377-ae52-656f07fc0cfc tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:12.059887 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-adc7c178-bbca-4377-ae52-656f07fc0cfc tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e109c3dcd0574faaa3d7ec31dd4edd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48bbb92998f54ebeb624bc794d406896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:51:12.072798 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-adc7c178-bbca-4377-ae52-656f07fc0cfc tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] 10.222.0.50 "GET /compute/v2.1/servers/af35a390-86bf-4618-bce0-db7423a065bb" status: 200 len: 1313 microversion: 2.1 time: 0.452001 Aug 10 17:51:12.076092 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 247/508] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:51:11 2022] GET /compute/v2.1/servers/af35a390-86bf-4618-bce0-db7423a065bb => generated 1313 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:51:12.097748 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-07503876-7532-4ed5-811e-798909f2b37e tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:12.098845 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-07503876-7532-4ed5-811e-798909f2b37e tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: f174eccc-36df-40a9-9831-0fb5848664ba] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:51:12.219192 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-07503876-7532-4ed5-811e-798909f2b37e tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:51:12.228977 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-07503876-7532-4ed5-811e-798909f2b37e tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/f174eccc-36df-40a9-9831-0fb5848664ba" status: 200 len: 1218 microversion: 2.1 time: 0.149518 Aug 10 17:51:12.230920 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 248/509] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:51:12 2022] GET /compute/v2.1/servers/f174eccc-36df-40a9-9831-0fb5848664ba => generated 1218 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:51:12.505738 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-b42d1c58-cfd3-4235-a5c2-b9631cf254d5 tempest-SecurityGroupRulesNegativeTestJSON-666555183 tempest-SecurityGroupRulesNegativeTestJSON-666555183-project] 10.222.0.50 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.364689 Aug 10 17:51:12.513284 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 262/510] 10.222.0.50 () {60 vars in 1195 bytes} [Wed Aug 10 17:51:11 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:51:12.524955 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-0af4068b-f63f-451d-90d3-6b6520a25f3b tempest-SecurityGroupRulesNegativeTestJSON-666555183 tempest-SecurityGroupRulesNegativeTestJSON-666555183-project] Action: 'create', calling method: .version_select at 0x7fb346587430>, body: {"security_group_rule": {"parent_group_id": "a919fb6e-19ca-47d6-b3f1-d6398adeac12", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:51:12.757026 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-0af4068b-f63f-451d-90d3-6b6520a25f3b tempest-SecurityGroupRulesNegativeTestJSON-666555183 tempest-SecurityGroupRulesNegativeTestJSON-666555183-project] HTTP exception thrown: This rule already exists in group a919fb6e-19ca-47d6-b3f1-d6398adeac12 Aug 10 17:51:12.758671 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-0af4068b-f63f-451d-90d3-6b6520a25f3b tempest-SecurityGroupRulesNegativeTestJSON-666555183 tempest-SecurityGroupRulesNegativeTestJSON-666555183-project] Request method failure captured: Aug 10 17:51:12.758671 n-d-852296-2 devstack@n-api.service[129409]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 10 17:51:12.758671 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 17:51:12.758671 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 17:51:12.758671 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 17:51:12.758671 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 138 Aug 10 17:51:12.758671 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 17:51:12.758671 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 17:51:12.758671 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 17:51:12.758671 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 17:51:12.758671 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8_AMKyBnCU33wFtvfZP2xDE3F5gFgiab70LlvGpebp4sHf7wWZK9C8xqCcy-50xE42kIYtOVrSqdQ7EmDvqx50MLCmoCWamgmxIFHfO3U29kplln_3tIhUCbE1g4Twc1WpeJEKWL4kE1GZj1JnzGQZYTBsjRA421QaoLkHb1KMHtQA8 Aug 10 17:51:12.758671 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 17:51:12.758671 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 17:51:12.758671 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 17:51:12.758671 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 17:51:12.758671 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 17:51:12.758671 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 17:51:12.758671 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: c816e9d6a6a74659a0931f8c0ea5f6a5 Aug 10 17:51:12.758671 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-666555183 Aug 10 17:51:12.758671 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 17:51:12.758671 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 17:51:12.758671 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c816e9d6a6a74659a0931f8c0ea5f6a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c816e9d6a6a74659a0931f8c0ea5f6a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c816e9d6a6a74659a0931f8c0ea5f6a5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c816e9d6a6a74659a0931f8c0ea5f6a5", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:51:12.758671 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-666555183 Aug 10 17:51:12.758671 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: c816e9d6a6a74659a0931f8c0ea5f6a5 Aug 10 17:51:12.758671 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-666555183 Aug 10 17:51:12.758671 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-666555183-project Aug 10 17:51:12.758671 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 17:51:12.758671 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 17:51:12.758671 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: 31b7ca11df7d41618a4e08a6a99938d3 Aug 10 17:51:12.758671 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-666555183-project Aug 10 17:51:12.758671 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:51:12.758671 n-d-852296-2 devstack@n-api.service[129409]: {"security_group_rule": {"parent_group_id": "a919fb6e-19ca-47d6-b3f1-d6398adeac12", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Aug 10 17:51:12.758671 n-d-852296-2 devstack@n-api.service[129409]: method: Aug 10 17:51:12.758671 n-d-852296-2 devstack@n-api.service[129409]: exception: This rule already exists in group a919fb6e-19ca-47d6-b3f1-d6398adeac12 Aug 10 17:51:12.758671 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'a919fb6e-19ca-47d6-b3f1-d6398adeac12', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Aug 10 17:51:12.758671 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:51:12.758671 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:51:12.758671 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Aug 10 17:51:12.758671 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Aug 10 17:51:12.758671 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Aug 10 17:51:12.758671 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Aug 10 17:51:12.758671 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group a919fb6e-19ca-47d6-b3f1-d6398adeac12 Aug 10 17:51:12.758671 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:51:12.758671 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:51:12.758671 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:51:12.758671 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:51:12.758671 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:51:12.758671 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:51:12.758671 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:51:12.758671 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:51:12.758671 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 17:51:12.758671 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 17:51:12.758671 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:51:12.758671 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:51:12.758671 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Aug 10 17:51:12.758671 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 10 17:51:12.758671 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group a919fb6e-19ca-47d6-b3f1-d6398adeac12 Aug 10 17:51:12.758671 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:51:12.758671 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:51:12.758671 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:51:12.758671 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:51:12.758671 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:51:12.758671 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:51:12.763940 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:51:12.763940 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:51:12.763940 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group a919fb6e-19ca-47d6-b3f1-d6398adeac12 Aug 10 17:51:12.763940 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:51:12.763940 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-0af4068b-f63f-451d-90d3-6b6520a25f3b tempest-SecurityGroupRulesNegativeTestJSON-666555183 tempest-SecurityGroupRulesNegativeTestJSON-666555183-project] Returning 400 to user: This rule already exists in group a919fb6e-19ca-47d6-b3f1-d6398adeac12 {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:51:12.763940 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-0af4068b-f63f-451d-90d3-6b6520a25f3b tempest-SecurityGroupRulesNegativeTestJSON-666555183 tempest-SecurityGroupRulesNegativeTestJSON-666555183-project] 10.222.0.50 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.245891 Aug 10 17:51:12.766389 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 249/511] 10.222.0.50 () {60 vars in 1195 bytes} [Wed Aug 10 17:51:12 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 253 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 10 17:51:12.776862 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-e358b0d1-f3f3-4f07-b93c-d115bc0a6f0c tempest-SecurityGroupRulesNegativeTestJSON-666555183 tempest-SecurityGroupRulesNegativeTestJSON-666555183-project] Calling method '.version_select at 0x7fb3463cb040>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:13.233258 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-e358b0d1-f3f3-4f07-b93c-d115bc0a6f0c tempest-SecurityGroupRulesNegativeTestJSON-666555183 tempest-SecurityGroupRulesNegativeTestJSON-666555183-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-group-rules/ea35b0af-8c15-4a3f-9901-d2483928a011" status: 202 len: 0 microversion: 2.1 time: 0.466223 Aug 10 17:51:13.241963 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 263/512] 10.222.0.50 () {58 vars in 1287 bytes} [Wed Aug 10 17:51:12 2022] DELETE /compute/v2.1/os-security-group-rules/ea35b0af-8c15-4a3f-9901-d2483928a011 => generated 0 bytes in 475 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 17:51:13.248868 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-89c52d60-cb7b-4021-8c19-70cb1fdcf1f8 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:13.249734 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-89c52d60-cb7b-4021-8c19-70cb1fdcf1f8 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] [instance: af35a390-86bf-4618-bce0-db7423a065bb] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:51:13.275961 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-89c52d60-cb7b-4021-8c19-70cb1fdcf1f8 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:13.276837 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-89c52d60-cb7b-4021-8c19-70cb1fdcf1f8 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:13.277808 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-89c52d60-cb7b-4021-8c19-70cb1fdcf1f8 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:13.283966 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-89c52d60-cb7b-4021-8c19-70cb1fdcf1f8 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:13.283966 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-89c52d60-cb7b-4021-8c19-70cb1fdcf1f8 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:13.283966 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-89c52d60-cb7b-4021-8c19-70cb1fdcf1f8 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:13.551926 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-89c52d60-cb7b-4021-8c19-70cb1fdcf1f8 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e109c3dcd0574faaa3d7ec31dd4edd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48bbb92998f54ebeb624bc794d406896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:51:13.564562 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-89c52d60-cb7b-4021-8c19-70cb1fdcf1f8 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] 10.222.0.50 "GET /compute/v2.1/servers/af35a390-86bf-4618-bce0-db7423a065bb" status: 200 len: 1313 microversion: 2.1 time: 0.320892 Aug 10 17:51:13.570134 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 264/513] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:51:13 2022] GET /compute/v2.1/servers/af35a390-86bf-4618-bce0-db7423a065bb => generated 1313 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:51:13.640276 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-6083461f-2686-4dbe-824f-918e407d8717 tempest-SecurityGroupRulesNegativeTestJSON-666555183 tempest-SecurityGroupRulesNegativeTestJSON-666555183-project] Action: 'create', calling method: .version_select at 0x7fb346601310>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1451481328", "description": "tempest-description-471610539"}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:51:13.926735 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-5381676e-e8b0-4f6d-941f-11a77e7afaa3 tempest-ServersNegativeTestJSON-440320920 tempest-ServersNegativeTestJSON-440320920-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1435935491", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "1babaeb1-5df4-4f4b-a9b0-8cb866ca7e64"}]}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:51:14.055638 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.network.neutron [None req-5381676e-e8b0-4f6d-941f-11a77e7afaa3 tempest-ServersNegativeTestJSON-440320920 tempest-ServersNegativeTestJSON-440320920-project] validate_networks() for [('1babaeb1-5df4-4f4b-a9b0-8cb866ca7e64', None, None, None, None, None)] {{(pid=129409) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 17:51:14.640487 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-6083461f-2686-4dbe-824f-918e407d8717 tempest-SecurityGroupRulesNegativeTestJSON-666555183 tempest-SecurityGroupRulesNegativeTestJSON-666555183-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 1.055899 Aug 10 17:51:14.641709 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 265/514] 10.222.0.50 () {60 vars in 1180 bytes} [Wed Aug 10 17:51:13 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:51:14.648560 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-22929ded-e954-44da-9261-60edd7a0d0d2 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:14.650329 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-22929ded-e954-44da-9261-60edd7a0d0d2 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: f174eccc-36df-40a9-9831-0fb5848664ba] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:51:14.664982 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-22929ded-e954-44da-9261-60edd7a0d0d2 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:14.665948 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-22929ded-e954-44da-9261-60edd7a0d0d2 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:14.666783 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-22929ded-e954-44da-9261-60edd7a0d0d2 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:14.667869 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-22929ded-e954-44da-9261-60edd7a0d0d2 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:14.668628 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-22929ded-e954-44da-9261-60edd7a0d0d2 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:14.669268 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-22929ded-e954-44da-9261-60edd7a0d0d2 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:14.776051 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-22929ded-e954-44da-9261-60edd7a0d0d2 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:51:14.788886 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-22929ded-e954-44da-9261-60edd7a0d0d2 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/f174eccc-36df-40a9-9831-0fb5848664ba" status: 200 len: 1278 microversion: 2.1 time: 0.145482 Aug 10 17:51:14.789481 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 266/515] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:51:14 2022] GET /compute/v2.1/servers/f174eccc-36df-40a9-9831-0fb5848664ba => generated 1278 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:51:14.798341 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [req-05ade432-5f60-4e8a-994b-02ea26317786 req-4c04c228-e5b7-46c7-aafe-435a5db3a7e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af35a390-86bf-4618-bce0-db7423a065bb", "name": "network-vif-plugged", "status": "completed", "tag": "fd08385d-d8e2-4f4b-ac59-f79dbc7a4c5d"}]} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:51:14.820846 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-05ade432-5f60-4e8a-994b-02ea26317786 req-4c04c228-e5b7-46c7-aafe-435a5db3a7e0 service nova] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:14.822140 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-05ade432-5f60-4e8a-994b-02ea26317786 req-4c04c228-e5b7-46c7-aafe-435a5db3a7e0 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:14.823458 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-05ade432-5f60-4e8a-994b-02ea26317786 req-4c04c228-e5b7-46c7-aafe-435a5db3a7e0 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:14.839624 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.compute.server_external_events [req-05ade432-5f60-4e8a-994b-02ea26317786 req-4c04c228-e5b7-46c7-aafe-435a5db3a7e0 service nova] Creating event network-vif-plugged:fd08385d-d8e2-4f4b-ac59-f79dbc7a4c5d for instance af35a390-86bf-4618-bce0-db7423a065bb on n-h2-852296-2 Aug 10 17:51:14.845621 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [req-05ade432-5f60-4e8a-994b-02ea26317786 req-4c04c228-e5b7-46c7-aafe-435a5db3a7e0 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052315 Aug 10 17:51:14.847093 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 267/516] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 10 17:51:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:51:14.854804 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-d0491ecd-d34d-45ba-8b10-f3a7aba82de5 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:14.855870 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-d0491ecd-d34d-45ba-8b10-f3a7aba82de5 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] [instance: af35a390-86bf-4618-bce0-db7423a065bb] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:51:14.864167 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d0491ecd-d34d-45ba-8b10-f3a7aba82de5 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:14.865057 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d0491ecd-d34d-45ba-8b10-f3a7aba82de5 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:14.866459 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d0491ecd-d34d-45ba-8b10-f3a7aba82de5 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:14.867430 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d0491ecd-d34d-45ba-8b10-f3a7aba82de5 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:14.868225 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d0491ecd-d34d-45ba-8b10-f3a7aba82de5 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:14.868949 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d0491ecd-d34d-45ba-8b10-f3a7aba82de5 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:15.272945 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-d0491ecd-d34d-45ba-8b10-f3a7aba82de5 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e109c3dcd0574faaa3d7ec31dd4edd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48bbb92998f54ebeb624bc794d406896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:51:15.279231 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [None req-5381676e-e8b0-4f6d-941f-11a77e7afaa3 tempest-ServersNegativeTestJSON-440320920 tempest-ServersNegativeTestJSON-440320920-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-f2603935-ab18-4fbe-9bff-3595e9cc8100) Aug 10 17:51:15.279231 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:51:15.279231 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:51:15.279231 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:51:15.279231 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:51:15.279231 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:51:15.279231 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:51:15.279231 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:51:15.279231 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:51:15.279231 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:51:15.279231 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 17:51:15.279231 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 17:51:15.279231 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 17:51:15.279231 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 17:51:15.279231 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 17:51:15.279231 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 17:51:15.279231 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 17:51:15.279231 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 17:51:15.279231 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 17:51:15.279231 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 17:51:15.279231 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 17:51:15.279231 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 17:51:15.279231 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 17:51:15.279231 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 17:51:15.279231 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 17:51:15.279231 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 17:51:15.279231 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 17:51:15.279231 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:51:15.279231 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:51:15.279231 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 17:51:15.279231 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 17:51:15.279231 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:51:15.279231 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:51:15.279231 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:51:15.279231 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:51:15.279231 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:51:15.279231 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:51:15.279231 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:51:15.279231 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:51:15.279231 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:51:15.279231 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:51:15.279231 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 17:51:15.279231 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 17:51:15.279231 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 17:51:15.279231 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 17:51:15.279231 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 17:51:15.279231 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 17:51:15.279231 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 17:51:15.279231 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 17:51:15.279231 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 17:51:15.279231 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 17:51:15.279231 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 17:51:15.279231 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 17:51:15.283698 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 17:51:15.283698 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 17:51:15.283698 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 17:51:15.283698 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 17:51:15.283698 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 17:51:15.283698 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 17:51:15.283698 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 17:51:15.283698 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 17:51:15.283698 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 17:51:15.283698 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 17:51:15.283698 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 17:51:15.283698 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 17:51:15.283698 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 17:51:15.283698 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 17:51:15.283698 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-f2603935-ab18-4fbe-9bff-3595e9cc8100) Aug 10 17:51:15.283698 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:51:15.283698 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-5381676e-e8b0-4f6d-941f-11a77e7afaa3 tempest-ServersNegativeTestJSON-440320920 tempest-ServersNegativeTestJSON-440320920-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:51:15.283698 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:51:15.283698 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-5381676e-e8b0-4f6d-941f-11a77e7afaa3 tempest-ServersNegativeTestJSON-440320920 tempest-ServersNegativeTestJSON-440320920-project] Request method failure captured: Aug 10 17:51:15.283698 n-d-852296-2 devstack@n-api.service[129409]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 17:51:15.283698 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 17:51:15.283698 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 17:51:15.283698 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 17:51:15.283698 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 209 Aug 10 17:51:15.283698 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 17:51:15.283698 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 17:51:15.283698 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 17:51:15.283698 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 17:51:15.283698 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8_AQAfgp9u_aNFs-eKw8-Xfa6zzierV-yoiI_Kw0E2FGYAKtmUvanFtqUASDapMxOW5W9DsTtGvzy82SV1AMG3jiHyYTBUrC6j2Q3Eo1U8rmDBnxsJEMJYwH-bDIsRHoGWfjVtYYGyyQVbmr78jeVtsFOgVGXk_XonFBhZCaYMEEflQ Aug 10 17:51:15.283698 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 17:51:15.283698 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 17:51:15.283698 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 17:51:15.283698 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 17:51:15.283698 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 17:51:15.283698 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 17:51:15.283698 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: 2510dbb25d954681b32047c49fd83aaf Aug 10 17:51:15.283698 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-ServersNegativeTestJSON-440320920 Aug 10 17:51:15.283698 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 17:51:15.283698 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 17:51:15.283698 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2510dbb25d954681b32047c49fd83aaf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/2510dbb25d954681b32047c49fd83aaf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2510dbb25d954681b32047c49fd83aaf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_2510dbb25d954681b32047c49fd83aaf", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:51:15.283698 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-ServersNegativeTestJSON-440320920 Aug 10 17:51:15.283698 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: 2510dbb25d954681b32047c49fd83aaf Aug 10 17:51:15.283698 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-ServersNegativeTestJSON-440320920 Aug 10 17:51:15.283698 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-ServersNegativeTestJSON-440320920-project Aug 10 17:51:15.283698 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 17:51:15.283698 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 17:51:15.283698 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: d4766058a05140228133131f72523db7 Aug 10 17:51:15.283698 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-ServersNegativeTestJSON-440320920-project Aug 10 17:51:15.283698 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:51:15.283698 n-d-852296-2 devstack@n-api.service[129409]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1435935491", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "1babaeb1-5df4-4f4b-a9b0-8cb866ca7e64"}]}} Aug 10 17:51:15.283698 n-d-852296-2 devstack@n-api.service[129409]: method: > Aug 10 17:51:15.283698 n-d-852296-2 devstack@n-api.service[129409]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:51:15.283698 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:51:15.283698 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1435935491', 'imageRef': 'a735ff26-463a-4ffe-a981-ab9d9baa494f', 'flavorRef': '452', 'networks': [{'uuid': '1babaeb1-5df4-4f4b-a9b0-8cb866ca7e64'}]}}} Aug 10 17:51:15.283698 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:51:15.288776 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:51:15.288776 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:51:15.288776 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:51:15.288776 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:51:15.288776 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:51:15.288776 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:51:15.288776 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:51:15.288776 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:51:15.288776 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:51:15.288776 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 17:51:15.288776 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 17:51:15.288776 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 17:51:15.288776 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 17:51:15.288776 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 17:51:15.288776 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 17:51:15.288776 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 17:51:15.288776 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 17:51:15.288776 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 17:51:15.288776 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 17:51:15.288776 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 17:51:15.288776 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 17:51:15.288776 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 17:51:15.288776 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 17:51:15.288776 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 17:51:15.288776 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 17:51:15.288776 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 17:51:15.288776 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:51:15.288776 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:51:15.288776 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 17:51:15.288776 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 17:51:15.288776 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:51:15.288776 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:51:15.288776 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:51:15.288776 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:51:15.288776 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:51:15.288776 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:51:15.288776 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:51:15.288776 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:51:15.288776 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:51:15.288776 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:51:15.288776 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 17:51:15.288776 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 17:51:15.288776 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 17:51:15.288776 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 17:51:15.288776 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 17:51:15.288776 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 17:51:15.288776 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 17:51:15.288776 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 17:51:15.288776 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 17:51:15.288776 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 17:51:15.288776 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 17:51:15.288776 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 17:51:15.288776 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 17:51:15.288776 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 17:51:15.288776 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 17:51:15.288776 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 17:51:15.294627 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 17:51:15.294627 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 17:51:15.294627 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 17:51:15.294627 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 17:51:15.294627 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 17:51:15.294627 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 17:51:15.294627 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 17:51:15.294627 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 17:51:15.294627 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 17:51:15.294627 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 17:51:15.294627 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-f2603935-ab18-4fbe-9bff-3595e9cc8100) Aug 10 17:51:15.294627 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:51:15.294627 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:51:15.294627 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:51:15.294627 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:51:15.294627 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:51:15.294627 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:51:15.294627 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:51:15.294627 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:51:15.294627 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 10 17:51:15.294627 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 10 17:51:15.294627 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:51:15.294627 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:51:15.294627 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:51:15.294627 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:51:15.294627 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:51:15.294627 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:51:15.294627 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:51:15.294627 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:51:15.294627 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:51:15.294627 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:51:15.294627 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:51:15.294627 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:51:15.294627 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:51:15.294627 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-5381676e-e8b0-4f6d-941f-11a77e7afaa3 tempest-ServersNegativeTestJSON-440320920 tempest-ServersNegativeTestJSON-440320920-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:51:15.294627 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:51:15.294627 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-5381676e-e8b0-4f6d-941f-11a77e7afaa3 tempest-ServersNegativeTestJSON-440320920 tempest-ServersNegativeTestJSON-440320920-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 2.252453 Aug 10 17:51:15.294627 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 250/517] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 17:51:13 2022] POST /compute/v2.1/servers => generated 214 bytes in 2254 msecs (HTTP/1.1 500) 9 headers in 391 bytes (2 switches on core 0) Aug 10 17:51:15.298405 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-d0491ecd-d34d-45ba-8b10-f3a7aba82de5 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] 10.222.0.50 "GET /compute/v2.1/servers/af35a390-86bf-4618-bce0-db7423a065bb" status: 200 len: 1313 microversion: 2.1 time: 0.444254 Aug 10 17:51:15.298511 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-259a28ab-a466-4b2c-b7aa-a544148074db tempest-SecurityGroupRulesNegativeTestJSON-666555183 tempest-SecurityGroupRulesNegativeTestJSON-666555183-project] Action: 'create', calling method: .version_select at 0x7fb3465e89d0>, body: {"security_group_rule": {"parent_group_id": "4d05b5e5-3205-4888-8fc9-8d606ff3cce1", "ip_protocol": "tcp", "from_port": 1306827087, "to_port": 22}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:51:15.300185 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 268/518] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:51:14 2022] GET /compute/v2.1/servers/af35a390-86bf-4618-bce0-db7423a065bb => generated 1313 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:51:15.821380 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-658ca6a2-d434-4661-9945-91fb9baa09e7 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:15.822628 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-658ca6a2-d434-4661-9945-91fb9baa09e7 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: f174eccc-36df-40a9-9831-0fb5848664ba] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:51:15.835843 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-658ca6a2-d434-4661-9945-91fb9baa09e7 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:15.837028 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-658ca6a2-d434-4661-9945-91fb9baa09e7 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:15.838326 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-658ca6a2-d434-4661-9945-91fb9baa09e7 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:15.839934 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-658ca6a2-d434-4661-9945-91fb9baa09e7 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:15.848912 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-658ca6a2-d434-4661-9945-91fb9baa09e7 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:15.849720 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-658ca6a2-d434-4661-9945-91fb9baa09e7 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:15.958867 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-658ca6a2-d434-4661-9945-91fb9baa09e7 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:51:15.968998 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-658ca6a2-d434-4661-9945-91fb9baa09e7 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/f174eccc-36df-40a9-9831-0fb5848664ba" status: 200 len: 1276 microversion: 2.1 time: 0.162024 Aug 10 17:51:15.970226 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 269/519] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:51:15 2022] GET /compute/v2.1/servers/f174eccc-36df-40a9-9831-0fb5848664ba => generated 1276 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:51:16.323683 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-4b62cff8-ddfc-40d1-acd8-c6fe09072131 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:16.333810 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-4b62cff8-ddfc-40d1-acd8-c6fe09072131 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] [instance: af35a390-86bf-4618-bce0-db7423a065bb] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:51:16.345563 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-4b62cff8-ddfc-40d1-acd8-c6fe09072131 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:16.347055 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-4b62cff8-ddfc-40d1-acd8-c6fe09072131 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:16.347791 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-4b62cff8-ddfc-40d1-acd8-c6fe09072131 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:16.348834 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-4b62cff8-ddfc-40d1-acd8-c6fe09072131 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:16.350960 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-4b62cff8-ddfc-40d1-acd8-c6fe09072131 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:16.351643 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-4b62cff8-ddfc-40d1-acd8-c6fe09072131 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:16.668527 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-259a28ab-a466-4b2c-b7aa-a544148074db tempest-SecurityGroupRulesNegativeTestJSON-666555183 tempest-SecurityGroupRulesNegativeTestJSON-666555183-project] HTTP exception thrown: Invalid port range 1306827087:22. Former value cannot be greater than the later Aug 10 17:51:16.670081 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-259a28ab-a466-4b2c-b7aa-a544148074db tempest-SecurityGroupRulesNegativeTestJSON-666555183 tempest-SecurityGroupRulesNegativeTestJSON-666555183-project] Request method failure captured: Aug 10 17:51:16.670081 n-d-852296-2 devstack@n-api.service[129409]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 10 17:51:16.670081 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 17:51:16.670081 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 17:51:16.670081 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 17:51:16.670081 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 146 Aug 10 17:51:16.670081 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 17:51:16.670081 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 17:51:16.670081 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 17:51:16.670081 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 17:51:16.670081 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8_AMKyBnCU33wFtvfZP2xDE3F5gFgiab70LlvGpebp4sHf7wWZK9C8xqCcy-50xE42kIYtOVrSqdQ7EmDvqx50MLCmoCWamgmxIFHfO3U29kplln_3tIhUCbE1g4Twc1WpeJEKWL4kE1GZj1JnzGQZYTBsjRA421QaoLkHb1KMHtQA8 Aug 10 17:51:16.670081 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 17:51:16.670081 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 17:51:16.670081 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 17:51:16.670081 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 17:51:16.670081 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 17:51:16.670081 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 17:51:16.670081 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: c816e9d6a6a74659a0931f8c0ea5f6a5 Aug 10 17:51:16.670081 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-666555183 Aug 10 17:51:16.670081 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 17:51:16.670081 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 17:51:16.670081 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c816e9d6a6a74659a0931f8c0ea5f6a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c816e9d6a6a74659a0931f8c0ea5f6a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c816e9d6a6a74659a0931f8c0ea5f6a5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c816e9d6a6a74659a0931f8c0ea5f6a5", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:51:16.670081 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-666555183 Aug 10 17:51:16.670081 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: c816e9d6a6a74659a0931f8c0ea5f6a5 Aug 10 17:51:16.670081 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-666555183 Aug 10 17:51:16.670081 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-666555183-project Aug 10 17:51:16.670081 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 17:51:16.670081 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 17:51:16.670081 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: 31b7ca11df7d41618a4e08a6a99938d3 Aug 10 17:51:16.670081 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-666555183-project Aug 10 17:51:16.670081 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:51:16.670081 n-d-852296-2 devstack@n-api.service[129409]: {"security_group_rule": {"parent_group_id": "4d05b5e5-3205-4888-8fc9-8d606ff3cce1", "ip_protocol": "tcp", "from_port": 1306827087, "to_port": 22}} Aug 10 17:51:16.670081 n-d-852296-2 devstack@n-api.service[129409]: method: Aug 10 17:51:16.670081 n-d-852296-2 devstack@n-api.service[129409]: exception: Invalid port range 1306827087:22. Former value cannot be greater than the later Aug 10 17:51:16.670081 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'body': {'security_group_rule': {'parent_group_id': '4d05b5e5-3205-4888-8fc9-8d606ff3cce1', 'ip_protocol': 'tcp', 'from_port': 1306827087, 'to_port': 22}}} Aug 10 17:51:16.670081 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:51:16.670081 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:51:16.670081 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 10 17:51:16.670081 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 10 17:51:16.670081 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 10 17:51:16.670081 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 10 17:51:16.670081 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 10 17:51:16.670081 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 10 17:51:16.670081 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Aug 10 17:51:16.670081 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Aug 10 17:51:16.670081 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 1306827087:22. Former value cannot be greater than the later Aug 10 17:51:16.670081 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:51:16.670081 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:51:16.670081 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:51:16.670081 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:51:16.670081 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:51:16.670081 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:51:16.670081 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:51:16.670081 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:51:16.670081 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 17:51:16.670081 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 17:51:16.670081 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:51:16.670081 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:51:16.670081 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 10 17:51:16.670081 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 10 17:51:16.670081 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 1306827087:22. Former value cannot be greater than the later Aug 10 17:51:16.670081 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:51:16.674178 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:51:16.674178 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:51:16.674178 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:51:16.674178 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:51:16.674178 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:51:16.674178 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:51:16.674178 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:51:16.674178 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 1306827087:22. Former value cannot be greater than the later Aug 10 17:51:16.674178 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:51:16.674178 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-259a28ab-a466-4b2c-b7aa-a544148074db tempest-SecurityGroupRulesNegativeTestJSON-666555183 tempest-SecurityGroupRulesNegativeTestJSON-666555183-project] Returning 400 to user: Invalid port range 1306827087:22. Former value cannot be greater than the later {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:51:16.674178 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-259a28ab-a466-4b2c-b7aa-a544148074db tempest-SecurityGroupRulesNegativeTestJSON-666555183 tempest-SecurityGroupRulesNegativeTestJSON-666555183-project] 10.222.0.50 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 123 microversion: 2.1 time: 1.385360 Aug 10 17:51:16.674178 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 251/520] 10.222.0.50 () {60 vars in 1195 bytes} [Wed Aug 10 17:51:15 2022] POST /compute/v2.1/os-security-group-rules => generated 123 bytes in 1386 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 10 17:51:16.882695 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-4b62cff8-ddfc-40d1-acd8-c6fe09072131 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e109c3dcd0574faaa3d7ec31dd4edd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48bbb92998f54ebeb624bc794d406896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:51:16.894250 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-4b62cff8-ddfc-40d1-acd8-c6fe09072131 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] 10.222.0.50 "GET /compute/v2.1/servers/af35a390-86bf-4618-bce0-db7423a065bb" status: 200 len: 1313 microversion: 2.1 time: 0.571844 Aug 10 17:51:16.909599 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 270/521] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:51:16 2022] GET /compute/v2.1/servers/af35a390-86bf-4618-bce0-db7423a065bb => generated 1313 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:51:16.916493 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-1679e579-da08-4c7c-907f-5caac9c47328 tempest-SecurityGroupRulesNegativeTestJSON-666555183 tempest-SecurityGroupRulesNegativeTestJSON-666555183-project] Action: 'create', calling method: .version_select at 0x7fb3463cb9d0>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-300373787", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:51:16.918966 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-1679e579-da08-4c7c-907f-5caac9c47328 tempest-SecurityGroupRulesNegativeTestJSON-666555183 tempest-SecurityGroupRulesNegativeTestJSON-666555183-project] HTTP exception thrown: Security group id should be uuid Aug 10 17:51:16.921483 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-1679e579-da08-4c7c-907f-5caac9c47328 tempest-SecurityGroupRulesNegativeTestJSON-666555183 tempest-SecurityGroupRulesNegativeTestJSON-666555183-project] Request method failure captured: Aug 10 17:51:16.921483 n-d-852296-2 devstack@n-api.service[129410]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 10 17:51:16.921483 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 17:51:16.921483 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 17:51:16.921483 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 17:51:16.921483 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 130 Aug 10 17:51:16.921483 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 17:51:16.921483 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 17:51:16.921483 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 17:51:16.921483 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 17:51:16.921483 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8_AMKyBnCU33wFtvfZP2xDE3F5gFgiab70LlvGpebp4sHf7wWZK9C8xqCcy-50xE42kIYtOVrSqdQ7EmDvqx50MLCmoCWamgmxIFHfO3U29kplln_3tIhUCbE1g4Twc1WpeJEKWL4kE1GZj1JnzGQZYTBsjRA421QaoLkHb1KMHtQA8 Aug 10 17:51:16.921483 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 17:51:16.921483 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 17:51:16.921483 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 17:51:16.921483 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 17:51:16.921483 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 17:51:16.921483 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 17:51:16.921483 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: c816e9d6a6a74659a0931f8c0ea5f6a5 Aug 10 17:51:16.921483 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-666555183 Aug 10 17:51:16.921483 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 17:51:16.921483 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 17:51:16.921483 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c816e9d6a6a74659a0931f8c0ea5f6a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c816e9d6a6a74659a0931f8c0ea5f6a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c816e9d6a6a74659a0931f8c0ea5f6a5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c816e9d6a6a74659a0931f8c0ea5f6a5", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:51:16.921483 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-666555183 Aug 10 17:51:16.921483 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: c816e9d6a6a74659a0931f8c0ea5f6a5 Aug 10 17:51:16.921483 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-666555183 Aug 10 17:51:16.921483 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-666555183-project Aug 10 17:51:16.921483 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 17:51:16.921483 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 17:51:16.921483 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: 31b7ca11df7d41618a4e08a6a99938d3 Aug 10 17:51:16.921483 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-666555183-project Aug 10 17:51:16.921483 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 17:51:16.921483 n-d-852296-2 devstack@n-api.service[129410]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-300373787", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Aug 10 17:51:16.921483 n-d-852296-2 devstack@n-api.service[129410]: method: Aug 10 17:51:16.921483 n-d-852296-2 devstack@n-api.service[129410]: exception: Security group id should be uuid Aug 10 17:51:16.921483 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-300373787', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Aug 10 17:51:16.921483 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:51:16.921483 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:51:16.921483 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Aug 10 17:51:16.921483 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Aug 10 17:51:16.921483 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Aug 10 17:51:16.921483 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Aug 10 17:51:16.921483 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Aug 10 17:51:16.921483 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:51:16.921483 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:51:16.921483 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:51:16.921483 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:51:16.921483 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:51:16.921483 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:51:16.921483 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:51:16.921483 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:51:16.921483 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 17:51:16.921483 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 17:51:16.921483 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:51:16.921483 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:51:16.921483 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 10 17:51:16.921483 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 10 17:51:16.921483 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Aug 10 17:51:16.921483 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:51:16.921483 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:51:16.921483 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:51:16.921483 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:51:16.921483 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:51:16.921483 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:51:16.921483 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:51:16.921483 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:51:16.927239 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Aug 10 17:51:16.927239 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:51:16.928490 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-1679e579-da08-4c7c-907f-5caac9c47328 tempest-SecurityGroupRulesNegativeTestJSON-666555183 tempest-SecurityGroupRulesNegativeTestJSON-666555183-project] Returning 400 to user: Security group id should be uuid {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:51:16.929492 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-1679e579-da08-4c7c-907f-5caac9c47328 tempest-SecurityGroupRulesNegativeTestJSON-666555183 tempest-SecurityGroupRulesNegativeTestJSON-666555183-project] 10.222.0.50 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.018689 Aug 10 17:51:16.934771 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 271/522] 10.222.0.50 () {60 vars in 1195 bytes} [Wed Aug 10 17:51:16 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 10 17:51:16.941727 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-0d3b76ba-835d-442f-b277-6aad1eda357f tempest-SecurityGroupRulesNegativeTestJSON-666555183 tempest-SecurityGroupRulesNegativeTestJSON-666555183-project] Action: 'create', calling method: .version_select at 0x7fb3466b3b80>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-541192381", "description": "tempest-description-1084300161"}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:51:17.379408 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-9460efab-5ad4-47a5-bff4-5b23ed6ab2bf tempest-NetworksTest-1027833917 tempest-NetworksTest-1027833917-project-admin] Calling method '.version_select at 0x7fb346587c10>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:17.507669 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_cell0:SELECT=6 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:51:17.884140 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-9460efab-5ad4-47a5-bff4-5b23ed6ab2bf tempest-NetworksTest-1027833917 tempest-NetworksTest-1027833917-project-admin] 10.222.0.50 "GET /compute/v2.1/os-networks" status: 200 len: 4675 microversion: 2.1 time: 1.210888 Aug 10 17:51:17.891768 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 252/523] 10.222.0.50 () {58 vars in 1137 bytes} [Wed Aug 10 17:51:16 2022] GET /compute/v2.1/os-networks => generated 4675 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:51:17.897610 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-d13a6d1c-e402-4b7a-b585-ca9d3a8cdedb tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:17.899292 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-d13a6d1c-e402-4b7a-b585-ca9d3a8cdedb tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: f174eccc-36df-40a9-9831-0fb5848664ba] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:51:17.909919 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-d13a6d1c-e402-4b7a-b585-ca9d3a8cdedb tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:17.915082 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-d13a6d1c-e402-4b7a-b585-ca9d3a8cdedb tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:17.915804 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-d13a6d1c-e402-4b7a-b585-ca9d3a8cdedb tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:17.916907 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-d13a6d1c-e402-4b7a-b585-ca9d3a8cdedb tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:17.917553 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-d13a6d1c-e402-4b7a-b585-ca9d3a8cdedb tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:17.918186 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-d13a6d1c-e402-4b7a-b585-ca9d3a8cdedb tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:17.969229 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-0d3b76ba-835d-442f-b277-6aad1eda357f tempest-SecurityGroupRulesNegativeTestJSON-666555183 tempest-SecurityGroupRulesNegativeTestJSON-666555183-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 1.032992 Aug 10 17:51:17.978317 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 272/524] 10.222.0.50 () {60 vars in 1180 bytes} [Wed Aug 10 17:51:16 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:51:18.178550 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-717e0dc4-3a41-4e9e-b269-dc423930b7e3 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-410550404", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452"}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:51:18.247029 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.network.neutron [None req-717e0dc4-3a41-4e9e-b269-dc423930b7e3 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] validate_networks() for None {{(pid=129410) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 17:51:18.595620 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-d13a6d1c-e402-4b7a-b585-ca9d3a8cdedb tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:51:18.606898 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-d13a6d1c-e402-4b7a-b585-ca9d3a8cdedb tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/f174eccc-36df-40a9-9831-0fb5848664ba" status: 200 len: 1318 microversion: 2.1 time: 0.713498 Aug 10 17:51:18.607656 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 253/525] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:51:17 2022] GET /compute/v2.1/servers/f174eccc-36df-40a9-9831-0fb5848664ba => generated 1318 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:51:18.628755 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-7a5efed3-1dd5-4ff1-b05d-01c05e9a5b02 tempest-NetworksTest-1027833917 tempest-NetworksTest-1027833917-project-admin] Calling method '.version_select at 0x7fb346587af0>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:18.728575 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.virt.hardware [None req-717e0dc4-3a41-4e9e-b269-dc423930b7e3 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Flavor limits 0:0:0 {{(pid=129410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 17:51:18.728575 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.virt.hardware [None req-717e0dc4-3a41-4e9e-b269-dc423930b7e3 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Image limits 0:0:0 {{(pid=129410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 17:51:18.728575 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.virt.hardware [None req-717e0dc4-3a41-4e9e-b269-dc423930b7e3 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Flavor pref 0:0:0 {{(pid=129410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 17:51:18.728575 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.virt.hardware [None req-717e0dc4-3a41-4e9e-b269-dc423930b7e3 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Image pref 0:0:0 {{(pid=129410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 17:51:18.728916 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.virt.hardware [None req-717e0dc4-3a41-4e9e-b269-dc423930b7e3 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 17:51:18.740819 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-717e0dc4-3a41-4e9e-b269-dc423930b7e3 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:18.741538 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-717e0dc4-3a41-4e9e-b269-dc423930b7e3 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:18.742158 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-717e0dc4-3a41-4e9e-b269-dc423930b7e3 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:18.743089 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-717e0dc4-3a41-4e9e-b269-dc423930b7e3 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:18.745514 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-717e0dc4-3a41-4e9e-b269-dc423930b7e3 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:18.746130 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-717e0dc4-3a41-4e9e-b269-dc423930b7e3 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:18.774796 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.quota [None req-717e0dc4-3a41-4e9e-b269-dc423930b7e3 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Getting quotas for project 6b7c2481a908406fa9c4562513fff665. Resources: {'instances', 'ram', 'cores'} {{(pid=129410) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:51:18.780117 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.quota [None req-717e0dc4-3a41-4e9e-b269-dc423930b7e3 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Getting quotas for user 1b2fd6acf18d4218ad143ccee2d0bb5b and project 6b7c2481a908406fa9c4562513fff665. Resources: {'instances', 'ram', 'cores'} {{(pid=129410) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:51:18.795394 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-717e0dc4-3a41-4e9e-b269-dc423930b7e3 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Going to run 1 instances... {{(pid=129410) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 17:51:18.797680 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-717e0dc4-3a41-4e9e-b269-dc423930b7e3 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] [instance: bee3148a-3834-41bd-99e7-b5da75217256] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a735ff26-463a-4ffe-a981-ab9d9baa494f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129410) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 17:51:18.966253 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-717e0dc4-3a41-4e9e-b269-dc423930b7e3 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.983707 Aug 10 17:51:18.968675 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 273/526] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 17:51:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 990 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 17:51:19.024859 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-799c835e-c0a3-4fb9-b2e5-757dc8136fa8 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:19.032914 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-799c835e-c0a3-4fb9-b2e5-757dc8136fa8 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] [instance: af35a390-86bf-4618-bce0-db7423a065bb] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:51:19.037289 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-7a5efed3-1dd5-4ff1-b05d-01c05e9a5b02 tempest-NetworksTest-1027833917 tempest-NetworksTest-1027833917-project-admin] 10.222.0.50 "GET /compute/v2.1/os-networks/89be6307-995c-4b16-9984-a3b121aa2815" status: 200 len: 652 microversion: 2.1 time: 0.427453 Aug 10 17:51:19.042262 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 254/527] 10.222.0.50 () {58 vars in 1248 bytes} [Wed Aug 10 17:51:18 2022] GET /compute/v2.1/os-networks/89be6307-995c-4b16-9984-a3b121aa2815 => generated 652 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:51:19.044613 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-799c835e-c0a3-4fb9-b2e5-757dc8136fa8 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:19.045357 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-799c835e-c0a3-4fb9-b2e5-757dc8136fa8 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:19.046036 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-799c835e-c0a3-4fb9-b2e5-757dc8136fa8 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:19.049107 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-799c835e-c0a3-4fb9-b2e5-757dc8136fa8 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:19.051060 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-799c835e-c0a3-4fb9-b2e5-757dc8136fa8 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:19.051963 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-799c835e-c0a3-4fb9-b2e5-757dc8136fa8 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:19.055047 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-44e9a4f1-6a7e-4ad0-86bd-7a3c6e816811 tempest-SecurityGroupRulesNegativeTestJSON-666555183 tempest-SecurityGroupRulesNegativeTestJSON-666555183-project] Action: 'create', calling method: .version_select at 0x7fb346621b80>, body: {"security_group_rule": {"parent_group_id": "1351cad8-5fd7-4761-a16e-30601db0e18c", "ip_protocol": "tempest-999-2116193607", "from_port": 22, "to_port": 22}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:51:19.059192 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_cell1:SELECT=100 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:51:19.245802 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-44e9a4f1-6a7e-4ad0-86bd-7a3c6e816811 tempest-SecurityGroupRulesNegativeTestJSON-666555183 tempest-SecurityGroupRulesNegativeTestJSON-666555183-project] HTTP exception thrown: Invalid IP protocol tempest-999-2116193607. Aug 10 17:51:19.257961 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-44e9a4f1-6a7e-4ad0-86bd-7a3c6e816811 tempest-SecurityGroupRulesNegativeTestJSON-666555183 tempest-SecurityGroupRulesNegativeTestJSON-666555183-project] Request method failure captured: Aug 10 17:51:19.257961 n-d-852296-2 devstack@n-api.service[129409]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 10 17:51:19.257961 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 17:51:19.257961 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 17:51:19.257961 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 17:51:19.257961 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 157 Aug 10 17:51:19.257961 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 17:51:19.257961 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 17:51:19.257961 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 17:51:19.257961 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 17:51:19.257961 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8_AMKyBnCU33wFtvfZP2xDE3F5gFgiab70LlvGpebp4sHf7wWZK9C8xqCcy-50xE42kIYtOVrSqdQ7EmDvqx50MLCmoCWamgmxIFHfO3U29kplln_3tIhUCbE1g4Twc1WpeJEKWL4kE1GZj1JnzGQZYTBsjRA421QaoLkHb1KMHtQA8 Aug 10 17:51:19.257961 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 17:51:19.257961 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 17:51:19.257961 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 17:51:19.257961 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 17:51:19.257961 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 17:51:19.257961 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 17:51:19.257961 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: c816e9d6a6a74659a0931f8c0ea5f6a5 Aug 10 17:51:19.257961 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-666555183 Aug 10 17:51:19.257961 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 17:51:19.257961 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 17:51:19.257961 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c816e9d6a6a74659a0931f8c0ea5f6a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c816e9d6a6a74659a0931f8c0ea5f6a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c816e9d6a6a74659a0931f8c0ea5f6a5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c816e9d6a6a74659a0931f8c0ea5f6a5", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:51:19.257961 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-666555183 Aug 10 17:51:19.257961 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: c816e9d6a6a74659a0931f8c0ea5f6a5 Aug 10 17:51:19.257961 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-666555183 Aug 10 17:51:19.257961 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-666555183-project Aug 10 17:51:19.257961 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 17:51:19.257961 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 17:51:19.257961 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: 31b7ca11df7d41618a4e08a6a99938d3 Aug 10 17:51:19.257961 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-666555183-project Aug 10 17:51:19.257961 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:51:19.257961 n-d-852296-2 devstack@n-api.service[129409]: {"security_group_rule": {"parent_group_id": "1351cad8-5fd7-4761-a16e-30601db0e18c", "ip_protocol": "tempest-999-2116193607", "from_port": 22, "to_port": 22}} Aug 10 17:51:19.257961 n-d-852296-2 devstack@n-api.service[129409]: method: Aug 10 17:51:19.257961 n-d-852296-2 devstack@n-api.service[129409]: exception: Invalid IP protocol tempest-999-2116193607. Aug 10 17:51:19.257961 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'body': {'security_group_rule': {'parent_group_id': '1351cad8-5fd7-4761-a16e-30601db0e18c', 'ip_protocol': 'tempest-999-2116193607', 'from_port': 22, 'to_port': 22}}} Aug 10 17:51:19.257961 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:51:19.257961 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:51:19.257961 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 10 17:51:19.257961 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 10 17:51:19.257961 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 10 17:51:19.257961 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 10 17:51:19.257961 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 10 17:51:19.257961 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 10 17:51:19.257961 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Aug 10 17:51:19.257961 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Aug 10 17:51:19.257961 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-2116193607. Aug 10 17:51:19.257961 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:51:19.257961 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:51:19.257961 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:51:19.257961 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:51:19.257961 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:51:19.257961 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:51:19.257961 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:51:19.257961 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:51:19.257961 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 17:51:19.257961 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 17:51:19.257961 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:51:19.257961 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:51:19.257961 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 10 17:51:19.257961 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 10 17:51:19.257961 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-2116193607. Aug 10 17:51:19.257961 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:51:19.257961 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:51:19.263085 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:51:19.263085 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:51:19.263085 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:51:19.263085 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:51:19.263085 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:51:19.263085 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:51:19.263085 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-2116193607. Aug 10 17:51:19.263085 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:51:19.267582 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-44e9a4f1-6a7e-4ad0-86bd-7a3c6e816811 tempest-SecurityGroupRulesNegativeTestJSON-666555183 tempest-SecurityGroupRulesNegativeTestJSON-666555183-project] Returning 400 to user: Invalid IP protocol tempest-999-2116193607. {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:51:19.269770 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-44e9a4f1-6a7e-4ad0-86bd-7a3c6e816811 tempest-SecurityGroupRulesNegativeTestJSON-666555183 tempest-SecurityGroupRulesNegativeTestJSON-666555183-project] 10.222.0.50 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 87 microversion: 2.1 time: 0.226394 Aug 10 17:51:19.276393 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 255/528] 10.222.0.50 () {60 vars in 1195 bytes} [Wed Aug 10 17:51:19 2022] POST /compute/v2.1/os-security-group-rules => generated 87 bytes in 233 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 10 17:51:19.292649 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-452be65e-64b5-4f3f-89ee-7278b268cf33 tempest-NetworksTest-1027833917 tempest-NetworksTest-1027833917-project-admin] Calling method '.version_select at 0x7fb3465e8430>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:19.445601 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-799c835e-c0a3-4fb9-b2e5-757dc8136fa8 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e109c3dcd0574faaa3d7ec31dd4edd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48bbb92998f54ebeb624bc794d406896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:51:19.455343 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-799c835e-c0a3-4fb9-b2e5-757dc8136fa8 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] 10.222.0.50 "GET /compute/v2.1/servers/af35a390-86bf-4618-bce0-db7423a065bb" status: 200 len: 1463 microversion: 2.1 time: 0.483925 Aug 10 17:51:19.459301 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 274/529] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:51:18 2022] GET /compute/v2.1/servers/af35a390-86bf-4618-bce0-db7423a065bb => generated 1463 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:51:19.482977 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-a07c13ad-0c9c-43cc-a48a-2ebb3fc49eba tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1702929817", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452"}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:51:19.634555 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.network.neutron [None req-a07c13ad-0c9c-43cc-a48a-2ebb3fc49eba tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] validate_networks() for None {{(pid=129410) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 17:51:19.815440 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-452be65e-64b5-4f3f-89ee-7278b268cf33 tempest-NetworksTest-1027833917 tempest-NetworksTest-1027833917-project-admin] 10.222.0.50 "GET /compute/v2.1/os-networks" status: 200 len: 4675 microversion: 2.1 time: 0.537758 Aug 10 17:51:19.820466 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 256/530] 10.222.0.50 () {58 vars in 1137 bytes} [Wed Aug 10 17:51:19 2022] GET /compute/v2.1/os-networks => generated 4675 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:51:19.825296 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-b5444614-f4ff-4ec8-b69c-a8107143ad00 tempest-SecurityGroupRulesNegativeTestJSON-666555183 tempest-SecurityGroupRulesNegativeTestJSON-666555183-project] Action: 'create', calling method: .version_select at 0x7fb346598d30>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1772149538", "description": "tempest-description-807839828"}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:51:20.108572 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.virt.hardware [None req-a07c13ad-0c9c-43cc-a48a-2ebb3fc49eba tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Flavor limits 0:0:0 {{(pid=129410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 17:51:20.109035 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.virt.hardware [None req-a07c13ad-0c9c-43cc-a48a-2ebb3fc49eba tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Image limits 0:0:0 {{(pid=129410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 17:51:20.109449 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.virt.hardware [None req-a07c13ad-0c9c-43cc-a48a-2ebb3fc49eba tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Flavor pref 0:0:0 {{(pid=129410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 17:51:20.109857 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.virt.hardware [None req-a07c13ad-0c9c-43cc-a48a-2ebb3fc49eba tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Image pref 0:0:0 {{(pid=129410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 17:51:20.110341 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.virt.hardware [None req-a07c13ad-0c9c-43cc-a48a-2ebb3fc49eba tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 17:51:20.121629 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a07c13ad-0c9c-43cc-a48a-2ebb3fc49eba tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:20.134336 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a07c13ad-0c9c-43cc-a48a-2ebb3fc49eba tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:20.135341 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a07c13ad-0c9c-43cc-a48a-2ebb3fc49eba tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:20.137206 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a07c13ad-0c9c-43cc-a48a-2ebb3fc49eba tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:20.140949 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a07c13ad-0c9c-43cc-a48a-2ebb3fc49eba tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:20.141558 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a07c13ad-0c9c-43cc-a48a-2ebb3fc49eba tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:20.185251 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.quota [None req-a07c13ad-0c9c-43cc-a48a-2ebb3fc49eba tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Getting quotas for project 6b7c2481a908406fa9c4562513fff665. Resources: {'instances', 'ram', 'cores'} {{(pid=129410) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:51:20.195290 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.quota [None req-a07c13ad-0c9c-43cc-a48a-2ebb3fc49eba tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Getting quotas for user 1b2fd6acf18d4218ad143ccee2d0bb5b and project 6b7c2481a908406fa9c4562513fff665. Resources: {'instances', 'ram', 'cores'} {{(pid=129410) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:51:20.222645 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-a07c13ad-0c9c-43cc-a48a-2ebb3fc49eba tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Going to run 1 instances... {{(pid=129410) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 17:51:20.229945 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-a07c13ad-0c9c-43cc-a48a-2ebb3fc49eba tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] [instance: 4db20dd7-9c34-41ea-a53f-e61c197ca66c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a735ff26-463a-4ffe-a981-ab9d9baa494f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129410) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 17:51:20.418347 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-a07c13ad-0c9c-43cc-a48a-2ebb3fc49eba tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.957565 Aug 10 17:51:20.420893 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 275/531] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 17:51:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 961 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 17:51:21.123379 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-b5444614-f4ff-4ec8-b69c-a8107143ad00 tempest-SecurityGroupRulesNegativeTestJSON-666555183 tempest-SecurityGroupRulesNegativeTestJSON-666555183-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 1.301714 Aug 10 17:51:21.123972 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 257/532] 10.222.0.50 () {60 vars in 1180 bytes} [Wed Aug 10 17:51:19 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 1303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:51:21.133746 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-112df40a-62a1-4146-8c2c-70edd8b1dc3b tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:21.134403 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-112df40a-62a1-4146-8c2c-70edd8b1dc3b tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: f174eccc-36df-40a9-9831-0fb5848664ba] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:51:21.152145 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:51:21.153417 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-8b1588a2-c971-413a-bb35-205a52818bed tempest-MigrationsAdminTest-964085913 tempest-MigrationsAdminTest-964085913-project-admin] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:21.154119 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-8b1588a2-c971-413a-bb35-205a52818bed tempest-MigrationsAdminTest-964085913 tempest-MigrationsAdminTest-964085913-project-admin] [instance: af35a390-86bf-4618-bce0-db7423a065bb] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:51:21.157027 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-112df40a-62a1-4146-8c2c-70edd8b1dc3b tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:21.159778 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-112df40a-62a1-4146-8c2c-70edd8b1dc3b tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:21.160506 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-112df40a-62a1-4146-8c2c-70edd8b1dc3b tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:21.162205 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-112df40a-62a1-4146-8c2c-70edd8b1dc3b tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:21.165004 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-112df40a-62a1-4146-8c2c-70edd8b1dc3b tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:21.165657 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-112df40a-62a1-4146-8c2c-70edd8b1dc3b tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:21.177066 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-8b1588a2-c971-413a-bb35-205a52818bed tempest-MigrationsAdminTest-964085913 tempest-MigrationsAdminTest-964085913-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:21.183076 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-8b1588a2-c971-413a-bb35-205a52818bed tempest-MigrationsAdminTest-964085913 tempest-MigrationsAdminTest-964085913-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:21.184838 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-8b1588a2-c971-413a-bb35-205a52818bed tempest-MigrationsAdminTest-964085913 tempest-MigrationsAdminTest-964085913-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:21.185699 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-8b1588a2-c971-413a-bb35-205a52818bed tempest-MigrationsAdminTest-964085913 tempest-MigrationsAdminTest-964085913-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:21.187216 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-8b1588a2-c971-413a-bb35-205a52818bed tempest-MigrationsAdminTest-964085913 tempest-MigrationsAdminTest-964085913-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:21.190854 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-8b1588a2-c971-413a-bb35-205a52818bed tempest-MigrationsAdminTest-964085913 tempest-MigrationsAdminTest-964085913-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:21.802466 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-112df40a-62a1-4146-8c2c-70edd8b1dc3b tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:51:21.813004 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-112df40a-62a1-4146-8c2c-70edd8b1dc3b tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/f174eccc-36df-40a9-9831-0fb5848664ba" status: 200 len: 1318 microversion: 2.1 time: 0.683443 Aug 10 17:51:21.813955 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 258/533] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:51:21 2022] GET /compute/v2.1/servers/f174eccc-36df-40a9-9831-0fb5848664ba => generated 1318 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:51:21.820564 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-dd265de0-28cd-4924-9765-4d02467a5fa1 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:21.821183 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-dd265de0-28cd-4924-9765-4d02467a5fa1 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] [instance: 4db20dd7-9c34-41ea-a53f-e61c197ca66c] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:51:22.227508 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_cell0:SELECT=42 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:51:22.528708 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-dd265de0-28cd-4924-9765-4d02467a5fa1 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2fd6acf18d4218ad143ccee2d0bb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7c2481a908406fa9c4562513fff665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:51:22.536936 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-dd265de0-28cd-4924-9765-4d02467a5fa1 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] 10.222.0.50 "GET /compute/v2.1/servers/4db20dd7-9c34-41ea-a53f-e61c197ca66c" status: 200 len: 1214 microversion: 2.1 time: 0.721773 Aug 10 17:51:22.539855 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 259/534] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:51:21 2022] GET /compute/v2.1/servers/4db20dd7-9c34-41ea-a53f-e61c197ca66c => generated 1214 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:51:22.712957 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [req-f5d7e109-924b-442d-9259-324cb10e47f6 req-9c4a0e08-5ae2-4788-8e18-70dbaa78d7b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f174eccc-36df-40a9-9831-0fb5848664ba", "tag": "1a43209c-8ece-439a-9a58-8148b9b4a77c"}]} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:51:22.727029 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-f5d7e109-924b-442d-9259-324cb10e47f6 req-9c4a0e08-5ae2-4788-8e18-70dbaa78d7b4 service nova] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:22.728757 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-f5d7e109-924b-442d-9259-324cb10e47f6 req-9c4a0e08-5ae2-4788-8e18-70dbaa78d7b4 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:22.729300 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-f5d7e109-924b-442d-9259-324cb10e47f6 req-9c4a0e08-5ae2-4788-8e18-70dbaa78d7b4 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:22.762255 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-8b1588a2-c971-413a-bb35-205a52818bed tempest-MigrationsAdminTest-964085913 tempest-MigrationsAdminTest-964085913-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/af35a390-86bf-4618-bce0-db7423a065bb" status: 200 len: 1614 microversion: 2.1 time: 2.325086 Aug 10 17:51:22.763300 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.compute.server_external_events [req-f5d7e109-924b-442d-9259-324cb10e47f6 req-9c4a0e08-5ae2-4788-8e18-70dbaa78d7b4 service nova] Creating event network-changed:1a43209c-8ece-439a-9a58-8148b9b4a77c for instance f174eccc-36df-40a9-9831-0fb5848664ba on n-h1-852296-2 Aug 10 17:51:22.764799 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 276/535] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:51:20 2022] GET /compute/v2.1/servers/af35a390-86bf-4618-bce0-db7423a065bb => generated 1614 bytes in 2343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:51:22.773992 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [req-f5d7e109-924b-442d-9259-324cb10e47f6 req-9c4a0e08-5ae2-4788-8e18-70dbaa78d7b4 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.231202 Aug 10 17:51:22.781836 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-372812a4-3e43-4744-94d1-d7f033e149b6 tempest-SecurityGroupRulesNegativeTestJSON-666555183 tempest-SecurityGroupRulesNegativeTestJSON-666555183-project] Action: 'create', calling method: .version_select at 0x7fb346a2dc10>, body: {"security_group_rule": {"parent_group_id": "99ef4d9e-5719-4d19-ae18-66ac71f3e6c6", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:51:22.782952 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 260/536] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 10 17:51:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:51:22.807865 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [req-77fe4adb-cf19-493a-a528-bec201edf06a req-42451833-7b99-4191-a798-726ba6386367 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c7e2e8c-4638-4952-9474-acc6ef457abc", "tag": "c1c98211-758c-4205-9ef2-cb54d2f38b9a"}]} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:51:22.829405 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-77fe4adb-cf19-493a-a528-bec201edf06a req-42451833-7b99-4191-a798-726ba6386367 service nova] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:22.835761 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-77fe4adb-cf19-493a-a528-bec201edf06a req-42451833-7b99-4191-a798-726ba6386367 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:22.836742 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-77fe4adb-cf19-493a-a528-bec201edf06a req-42451833-7b99-4191-a798-726ba6386367 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:22.861535 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.compute.server_external_events [req-77fe4adb-cf19-493a-a528-bec201edf06a req-42451833-7b99-4191-a798-726ba6386367 service nova] Creating event network-changed:c1c98211-758c-4205-9ef2-cb54d2f38b9a for instance 6c7e2e8c-4638-4952-9474-acc6ef457abc on n-h1-852296-2 Aug 10 17:51:22.879652 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [req-77fe4adb-cf19-493a-a528-bec201edf06a req-42451833-7b99-4191-a798-726ba6386367 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095201 Aug 10 17:51:22.880322 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 261/537] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 10 17:51:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:51:22.904925 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-17eb937e-5ba9-4075-a09b-1bb3bc4ca4f2 tempest-MigrationsAdminTest-964085913 tempest-MigrationsAdminTest-964085913-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:51:22.905588 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-17eb937e-5ba9-4075-a09b-1bb3bc4ca4f2 tempest-MigrationsAdminTest-964085913 tempest-MigrationsAdminTest-964085913-project-admin] [instance: af35a390-86bf-4618-bce0-db7423a065bb] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:51:22.918440 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-17eb937e-5ba9-4075-a09b-1bb3bc4ca4f2 tempest-MigrationsAdminTest-964085913 tempest-MigrationsAdminTest-964085913-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:22.921037 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-17eb937e-5ba9-4075-a09b-1bb3bc4ca4f2 tempest-MigrationsAdminTest-964085913 tempest-MigrationsAdminTest-964085913-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:22.921653 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-17eb937e-5ba9-4075-a09b-1bb3bc4ca4f2 tempest-MigrationsAdminTest-964085913 tempest-MigrationsAdminTest-964085913-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:22.922560 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-17eb937e-5ba9-4075-a09b-1bb3bc4ca4f2 tempest-MigrationsAdminTest-964085913 tempest-MigrationsAdminTest-964085913-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:22.925824 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-17eb937e-5ba9-4075-a09b-1bb3bc4ca4f2 tempest-MigrationsAdminTest-964085913 tempest-MigrationsAdminTest-964085913-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:22.928195 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-17eb937e-5ba9-4075-a09b-1bb3bc4ca4f2 tempest-MigrationsAdminTest-964085913 tempest-MigrationsAdminTest-964085913-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:23.097012 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-372812a4-3e43-4744-94d1-d7f033e149b6 tempest-SecurityGroupRulesNegativeTestJSON-666555183 tempest-SecurityGroupRulesNegativeTestJSON-666555183-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Aug 10 17:51:23.102049 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-372812a4-3e43-4744-94d1-d7f033e149b6 tempest-SecurityGroupRulesNegativeTestJSON-666555183 tempest-SecurityGroupRulesNegativeTestJSON-666555183-project] Request method failure captured: Aug 10 17:51:23.102049 n-d-852296-2 devstack@n-api.service[129410]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 10 17:51:23.102049 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 17:51:23.102049 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 17:51:23.102049 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 17:51:23.102049 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 138 Aug 10 17:51:23.102049 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 17:51:23.102049 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 17:51:23.102049 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 17:51:23.102049 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 17:51:23.102049 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8_AMKyBnCU33wFtvfZP2xDE3F5gFgiab70LlvGpebp4sHf7wWZK9C8xqCcy-50xE42kIYtOVrSqdQ7EmDvqx50MLCmoCWamgmxIFHfO3U29kplln_3tIhUCbE1g4Twc1WpeJEKWL4kE1GZj1JnzGQZYTBsjRA421QaoLkHb1KMHtQA8 Aug 10 17:51:23.102049 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 17:51:23.102049 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 17:51:23.102049 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 17:51:23.102049 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 17:51:23.102049 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 17:51:23.102049 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 17:51:23.102049 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: c816e9d6a6a74659a0931f8c0ea5f6a5 Aug 10 17:51:23.102049 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-666555183 Aug 10 17:51:23.102049 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 17:51:23.102049 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 17:51:23.102049 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c816e9d6a6a74659a0931f8c0ea5f6a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c816e9d6a6a74659a0931f8c0ea5f6a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c816e9d6a6a74659a0931f8c0ea5f6a5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c816e9d6a6a74659a0931f8c0ea5f6a5", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:51:23.102049 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-666555183 Aug 10 17:51:23.102049 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: c816e9d6a6a74659a0931f8c0ea5f6a5 Aug 10 17:51:23.102049 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-666555183 Aug 10 17:51:23.102049 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-666555183-project Aug 10 17:51:23.102049 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 17:51:23.102049 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 17:51:23.102049 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: 31b7ca11df7d41618a4e08a6a99938d3 Aug 10 17:51:23.102049 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-666555183-project Aug 10 17:51:23.102049 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 17:51:23.102049 n-d-852296-2 devstack@n-api.service[129410]: {"security_group_rule": {"parent_group_id": "99ef4d9e-5719-4d19-ae18-66ac71f3e6c6", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Aug 10 17:51:23.102049 n-d-852296-2 devstack@n-api.service[129410]: method: Aug 10 17:51:23.102049 n-d-852296-2 devstack@n-api.service[129410]: exception: Invalid port range 22:21. Former value cannot be greater than the later Aug 10 17:51:23.102049 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'body': {'security_group_rule': {'parent_group_id': '99ef4d9e-5719-4d19-ae18-66ac71f3e6c6', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Aug 10 17:51:23.102049 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:51:23.102049 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:51:23.102049 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 10 17:51:23.102049 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 10 17:51:23.102049 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 10 17:51:23.102049 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 10 17:51:23.102049 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 10 17:51:23.102049 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 10 17:51:23.102049 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Aug 10 17:51:23.102049 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Aug 10 17:51:23.102049 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Aug 10 17:51:23.102049 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:51:23.102049 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:51:23.102049 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:51:23.102049 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:51:23.102049 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:51:23.102049 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:51:23.102049 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:51:23.102049 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:51:23.102049 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 17:51:23.102049 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 17:51:23.102049 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:51:23.102049 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:51:23.102049 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 10 17:51:23.102049 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 10 17:51:23.102049 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Aug 10 17:51:23.102049 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:51:23.106565 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:51:23.106565 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:51:23.106565 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:51:23.106565 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:51:23.106565 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:51:23.106565 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:51:23.106565 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:51:23.106565 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Aug 10 17:51:23.106565 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:51:23.112586 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-372812a4-3e43-4744-94d1-d7f033e149b6 tempest-SecurityGroupRulesNegativeTestJSON-666555183 tempest-SecurityGroupRulesNegativeTestJSON-666555183-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:51:23.114791 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-372812a4-3e43-4744-94d1-d7f033e149b6 tempest-SecurityGroupRulesNegativeTestJSON-666555183 tempest-SecurityGroupRulesNegativeTestJSON-666555183-project] 10.222.0.50 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.347601 Aug 10 17:51:23.115392 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 277/538] 10.222.0.50 () {60 vars in 1195 bytes} [Wed Aug 10 17:51:22 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 349 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 10 17:51:23.126440 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-0e97e083-5f25-4797-b789-0ee108be2f8d tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:23.136701 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-0e97e083-5f25-4797-b789-0ee108be2f8d tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: f174eccc-36df-40a9-9831-0fb5848664ba] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:51:23.138710 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [None req-17eb937e-5ba9-4075-a09b-1bb3bc4ca4f2 tempest-MigrationsAdminTest-964085913 tempest-MigrationsAdminTest-964085913-project-admin] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-39b0648a-6b0e-49b6-b064-291076e8c94e) Aug 10 17:51:23.138710 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:51:23.138710 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:51:23.138710 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:51:23.138710 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:51:23.138710 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:51:23.138710 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Aug 10 17:51:23.138710 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Aug 10 17:51:23.138710 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 368, in inner Aug 10 17:51:23.138710 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi if self.network_api.instance_has_extended_resource_request( Aug 10 17:51:23.138710 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1035, in instance_has_extended_resource_request Aug 10 17:51:23.138710 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi if not self.has_extended_resource_request_extension(admin_context): Aug 10 17:51:23.138710 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 17:51:23.138710 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 17:51:23.138710 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 17:51:23.138710 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 17:51:23.138710 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 17:51:23.138710 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 17:51:23.138710 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:51:23.138710 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:51:23.138710 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 17:51:23.138710 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 17:51:23.138710 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:51:23.138710 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:51:23.138710 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:51:23.138710 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:51:23.138710 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:51:23.138710 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:51:23.138710 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:51:23.138710 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:51:23.138710 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:51:23.138710 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:51:23.138710 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 17:51:23.138710 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 17:51:23.138710 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 17:51:23.138710 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 17:51:23.138710 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 17:51:23.138710 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 17:51:23.138710 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 17:51:23.138710 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 17:51:23.138710 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 17:51:23.138710 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 17:51:23.138710 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 17:51:23.138710 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 17:51:23.138710 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 17:51:23.138710 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 17:51:23.138710 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 17:51:23.138710 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 17:51:23.138710 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 17:51:23.138710 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 17:51:23.141762 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 17:51:23.141762 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 17:51:23.141762 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 17:51:23.141762 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 17:51:23.141762 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 17:51:23.141762 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 17:51:23.141762 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 17:51:23.141762 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 17:51:23.141762 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-39b0648a-6b0e-49b6-b064-291076e8c94e) Aug 10 17:51:23.141762 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:51:23.141762 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-17eb937e-5ba9-4075-a09b-1bb3bc4ca4f2 tempest-MigrationsAdminTest-964085913 tempest-MigrationsAdminTest-964085913-project-admin] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:51:23.141762 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:51:23.141762 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-17eb937e-5ba9-4075-a09b-1bb3bc4ca4f2 tempest-MigrationsAdminTest-964085913 tempest-MigrationsAdminTest-964085913-project-admin] Request method failure captured: Aug 10 17:51:23.141762 n-d-852296-2 devstack@n-api.service[129409]: request: POST /compute/v2.1/servers/af35a390-86bf-4618-bce0-db7423a065bb/action HTTP/1.1 Aug 10 17:51:23.141762 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 17:51:23.141762 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 17:51:23.141762 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 17:51:23.141762 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 15 Aug 10 17:51:23.141762 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 17:51:23.141762 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 17:51:23.141762 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 17:51:23.141762 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 17:51:23.141762 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8-_34qrKwYhIXal2vjPBD5g82PQVD5R4tnd93fbFZ9M0yciliUNDCwvxCTrKDWpCkYFxf4yVU13v8XzfdSAKmGZfVN2ZmqyaeeCBWjmReFVdg0quFpMaE-UjbbiItZ1X89-_ftumkrChrwUlm9OeC-VxArksbFx2EmsyLnwDfLO4VEQ Aug 10 17:51:23.141762 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 17:51:23.141762 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 17:51:23.141762 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 17:51:23.141762 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 17:51:23.141762 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 17:51:23.141762 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 17:51:23.141762 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: 50abb72754d54a89ae6a586553de4beb Aug 10 17:51:23.141762 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-MigrationsAdminTest-964085913 Aug 10 17:51:23.141762 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member,admin Aug 10 17:51:23.141762 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member,admin Aug 10 17:51:23.141762 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/50abb72754d54a89ae6a586553de4beb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/50abb72754d54a89ae6a586553de4beb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/50abb72754d54a89ae6a586553de4beb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_50abb72754d54a89ae6a586553de4beb", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:51:23.141762 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-MigrationsAdminTest-964085913 Aug 10 17:51:23.141762 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: 50abb72754d54a89ae6a586553de4beb Aug 10 17:51:23.141762 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-MigrationsAdminTest-964085913 Aug 10 17:51:23.141762 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-MigrationsAdminTest-964085913-project-admin Aug 10 17:51:23.141762 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 17:51:23.141762 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 17:51:23.141762 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: 48e3438ea5ed46b79100d48001e63839 Aug 10 17:51:23.141762 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-MigrationsAdminTest-964085913-project-admin Aug 10 17:51:23.141762 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:51:23.141762 n-d-852296-2 devstack@n-api.service[129409]: {"migrate": {}} Aug 10 17:51:23.141762 n-d-852296-2 devstack@n-api.service[129409]: method: > Aug 10 17:51:23.141762 n-d-852296-2 devstack@n-api.service[129409]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:51:23.141762 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:51:23.141762 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'id': 'af35a390-86bf-4618-bce0-db7423a065bb', 'body': {'migrate': {}}} Aug 10 17:51:23.141762 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:51:23.141762 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:51:23.141762 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:51:23.141762 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:51:23.141762 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:51:23.141762 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:51:23.141762 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Aug 10 17:51:23.141762 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Aug 10 17:51:23.141762 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 368, in inner Aug 10 17:51:23.141762 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi if self.network_api.instance_has_extended_resource_request( Aug 10 17:51:23.141762 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1035, in instance_has_extended_resource_request Aug 10 17:51:23.147429 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi if not self.has_extended_resource_request_extension(admin_context): Aug 10 17:51:23.147429 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 17:51:23.147429 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 17:51:23.147429 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 17:51:23.147429 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 17:51:23.147429 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 17:51:23.147429 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 17:51:23.147429 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:51:23.147429 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:51:23.147429 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 17:51:23.147429 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 17:51:23.147429 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:51:23.147429 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:51:23.147429 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:51:23.147429 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:51:23.147429 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:51:23.147429 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:51:23.147429 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:51:23.147429 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:51:23.147429 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:51:23.147429 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:51:23.147429 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 17:51:23.147429 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 17:51:23.147429 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 17:51:23.147429 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 17:51:23.147429 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 17:51:23.147429 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 17:51:23.147429 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 17:51:23.147429 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 17:51:23.147429 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 17:51:23.147429 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 17:51:23.147429 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 17:51:23.147429 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 17:51:23.147429 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 17:51:23.147429 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 17:51:23.147429 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 17:51:23.147429 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 17:51:23.147429 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 17:51:23.147429 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 17:51:23.147429 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 17:51:23.147429 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 17:51:23.147429 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 17:51:23.147429 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 17:51:23.147429 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 17:51:23.147429 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 17:51:23.147429 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 17:51:23.147429 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 17:51:23.147429 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-39b0648a-6b0e-49b6-b064-291076e8c94e) Aug 10 17:51:23.147429 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:51:23.147429 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:51:23.147429 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:51:23.147429 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:51:23.147429 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:51:23.157520 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:51:23.157520 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:51:23.157520 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:51:23.157520 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 10 17:51:23.157520 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 10 17:51:23.157520 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:51:23.157520 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:51:23.157520 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:51:23.157520 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:51:23.157520 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:51:23.157520 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:51:23.157520 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:51:23.157520 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:51:23.157520 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:51:23.157520 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:51:23.157520 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:51:23.157520 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:51:23.157520 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:51:23.157520 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-17eb937e-5ba9-4075-a09b-1bb3bc4ca4f2 tempest-MigrationsAdminTest-964085913 tempest-MigrationsAdminTest-964085913-project-admin] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:51:23.157520 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:51:23.157520 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-17eb937e-5ba9-4075-a09b-1bb3bc4ca4f2 tempest-MigrationsAdminTest-964085913 tempest-MigrationsAdminTest-964085913-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/af35a390-86bf-4618-bce0-db7423a065bb/action" status: 500 len: 214 microversion: 2.1 time: 0.261766 Aug 10 17:51:23.157520 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 262/539] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 10 17:51:22 2022] POST /compute/v2.1/servers/af35a390-86bf-4618-bce0-db7423a065bb/action => generated 214 bytes in 268 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 10 17:51:23.165735 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-0e97e083-5f25-4797-b789-0ee108be2f8d tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:23.166570 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-0e97e083-5f25-4797-b789-0ee108be2f8d tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:23.167287 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-0e97e083-5f25-4797-b789-0ee108be2f8d tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:23.168233 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-0e97e083-5f25-4797-b789-0ee108be2f8d tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:23.169001 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-0e97e083-5f25-4797-b789-0ee108be2f8d tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:23.169772 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-0e97e083-5f25-4797-b789-0ee108be2f8d tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:23.173965 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-6b1b24bb-c2cd-4b15-a39a-ffef5d588f67 tempest-SecurityGroupRulesNegativeTestJSON-666555183 tempest-SecurityGroupRulesNegativeTestJSON-666555183-project] Action: 'create', calling method: .version_select at 0x7fb3465e8040>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-851586356", "description": "tempest-description-1335158474"}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:51:23.669809 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-0e97e083-5f25-4797-b789-0ee108be2f8d tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:51:23.681483 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-0e97e083-5f25-4797-b789-0ee108be2f8d tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/f174eccc-36df-40a9-9831-0fb5848664ba" status: 200 len: 1318 microversion: 2.1 time: 0.562037 Aug 10 17:51:23.683617 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 278/540] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:51:23 2022] GET /compute/v2.1/servers/f174eccc-36df-40a9-9831-0fb5848664ba => generated 1318 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:51:23.689529 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-2f89dc25-d3d6-482a-8464-c4387e3ce50f tempest-MigrationsAdminTest-964085913 tempest-MigrationsAdminTest-964085913-project-admin] Calling method '.version_select at 0x7fb346527f70>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:23.696227 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2f89dc25-d3d6-482a-8464-c4387e3ce50f tempest-MigrationsAdminTest-964085913 tempest-MigrationsAdminTest-964085913-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:23.697054 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2f89dc25-d3d6-482a-8464-c4387e3ce50f tempest-MigrationsAdminTest-964085913 tempest-MigrationsAdminTest-964085913-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:23.702067 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2f89dc25-d3d6-482a-8464-c4387e3ce50f tempest-MigrationsAdminTest-964085913 tempest-MigrationsAdminTest-964085913-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:23.725606 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-2f89dc25-d3d6-482a-8464-c4387e3ce50f tempest-MigrationsAdminTest-964085913 tempest-MigrationsAdminTest-964085913-project-admin] 10.222.0.50 "GET /compute/v2.1/os-migrations" status: 200 len: 18 microversion: 2.1 time: 0.039810 Aug 10 17:51:23.727418 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 279/541] 10.222.0.50 () {58 vars in 1143 bytes} [Wed Aug 10 17:51:23 2022] GET /compute/v2.1/os-migrations => generated 18 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 17:51:23.778953 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-a94e4223-5412-405e-9000-028593ecd6ad tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:23.780502 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-a94e4223-5412-405e-9000-028593ecd6ad tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] [instance: 4db20dd7-9c34-41ea-a53f-e61c197ca66c] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:51:23.803662 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a94e4223-5412-405e-9000-028593ecd6ad tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:23.804172 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a94e4223-5412-405e-9000-028593ecd6ad tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:23.807770 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a94e4223-5412-405e-9000-028593ecd6ad tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:23.808631 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a94e4223-5412-405e-9000-028593ecd6ad tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:23.822231 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a94e4223-5412-405e-9000-028593ecd6ad tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:23.822231 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a94e4223-5412-405e-9000-028593ecd6ad tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:23.931750 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-a94e4223-5412-405e-9000-028593ecd6ad tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2fd6acf18d4218ad143ccee2d0bb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7c2481a908406fa9c4562513fff665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:51:23.948308 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-a94e4223-5412-405e-9000-028593ecd6ad tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] 10.222.0.50 "GET /compute/v2.1/servers/4db20dd7-9c34-41ea-a53f-e61c197ca66c" status: 200 len: 1266 microversion: 2.1 time: 0.219575 Aug 10 17:51:23.951731 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 280/542] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:51:23 2022] GET /compute/v2.1/servers/4db20dd7-9c34-41ea-a53f-e61c197ca66c => generated 1266 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:51:23.983443 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-bdea0865-4b25-47ad-8882-5bb53f491e40 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1573021713", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452"}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:51:24.119962 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.network.neutron [None req-bdea0865-4b25-47ad-8882-5bb53f491e40 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] validate_networks() for None {{(pid=129410) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 17:51:24.387177 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-6b1b24bb-c2cd-4b15-a39a-ffef5d588f67 tempest-SecurityGroupRulesNegativeTestJSON-666555183 tempest-SecurityGroupRulesNegativeTestJSON-666555183-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 1.228359 Aug 10 17:51:24.387625 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 263/543] 10.222.0.50 () {60 vars in 1180 bytes} [Wed Aug 10 17:51:23 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:51:24.401129 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-bf76fa39-f0a8-4b34-8727-69c12edb5e17 tempest-SecurityGroupRulesNegativeTestJSON-666555183 tempest-SecurityGroupRulesNegativeTestJSON-666555183-project] Action: 'create', calling method: .version_select at 0x7fb3466a55e0>, body: {"security_group_rule": {"parent_group_id": "c6e30b94-d1af-4f1f-9987-9cbb3d5fdc40", "ip_protocol": "tcp", "from_port": 22, "to_port": 1775621466}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:51:24.590936 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.virt.hardware [None req-bdea0865-4b25-47ad-8882-5bb53f491e40 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Flavor limits 0:0:0 {{(pid=129410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 17:51:24.590936 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.virt.hardware [None req-bdea0865-4b25-47ad-8882-5bb53f491e40 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Image limits 0:0:0 {{(pid=129410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 17:51:24.590936 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.virt.hardware [None req-bdea0865-4b25-47ad-8882-5bb53f491e40 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Flavor pref 0:0:0 {{(pid=129410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 17:51:24.590936 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.virt.hardware [None req-bdea0865-4b25-47ad-8882-5bb53f491e40 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Image pref 0:0:0 {{(pid=129410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 17:51:24.590936 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.virt.hardware [None req-bdea0865-4b25-47ad-8882-5bb53f491e40 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 17:51:24.601219 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-bdea0865-4b25-47ad-8882-5bb53f491e40 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:24.601995 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-bdea0865-4b25-47ad-8882-5bb53f491e40 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:24.602445 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-bdea0865-4b25-47ad-8882-5bb53f491e40 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:24.603282 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-bdea0865-4b25-47ad-8882-5bb53f491e40 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:24.603735 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-bdea0865-4b25-47ad-8882-5bb53f491e40 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:24.607561 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-bdea0865-4b25-47ad-8882-5bb53f491e40 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:24.654203 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.quota [None req-bdea0865-4b25-47ad-8882-5bb53f491e40 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Getting quotas for project 48bbb92998f54ebeb624bc794d406896. Resources: {'instances', 'ram', 'cores'} {{(pid=129410) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:51:24.669580 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.quota [None req-bdea0865-4b25-47ad-8882-5bb53f491e40 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Getting quotas for user e109c3dcd0574faaa3d7ec31dd4edd24 and project 48bbb92998f54ebeb624bc794d406896. Resources: {'instances', 'ram', 'cores'} {{(pid=129410) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:51:24.685918 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-bf76fa39-f0a8-4b34-8727-69c12edb5e17 tempest-SecurityGroupRulesNegativeTestJSON-666555183 tempest-SecurityGroupRulesNegativeTestJSON-666555183-project] HTTP exception thrown: Invalid port range 22:1775621466. Valid TCP ports should be between 1-65535 Aug 10 17:51:24.688561 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-bf76fa39-f0a8-4b34-8727-69c12edb5e17 tempest-SecurityGroupRulesNegativeTestJSON-666555183 tempest-SecurityGroupRulesNegativeTestJSON-666555183-project] Request method failure captured: Aug 10 17:51:24.688561 n-d-852296-2 devstack@n-api.service[129409]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 10 17:51:24.688561 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 17:51:24.688561 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 17:51:24.688561 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 17:51:24.688561 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 146 Aug 10 17:51:24.688561 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 17:51:24.688561 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 17:51:24.688561 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 17:51:24.688561 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 17:51:24.688561 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8_AMKyBnCU33wFtvfZP2xDE3F5gFgiab70LlvGpebp4sHf7wWZK9C8xqCcy-50xE42kIYtOVrSqdQ7EmDvqx50MLCmoCWamgmxIFHfO3U29kplln_3tIhUCbE1g4Twc1WpeJEKWL4kE1GZj1JnzGQZYTBsjRA421QaoLkHb1KMHtQA8 Aug 10 17:51:24.688561 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 17:51:24.688561 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 17:51:24.688561 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 17:51:24.688561 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 17:51:24.688561 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 17:51:24.688561 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 17:51:24.688561 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: c816e9d6a6a74659a0931f8c0ea5f6a5 Aug 10 17:51:24.688561 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-666555183 Aug 10 17:51:24.688561 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 17:51:24.688561 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 17:51:24.688561 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c816e9d6a6a74659a0931f8c0ea5f6a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c816e9d6a6a74659a0931f8c0ea5f6a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c816e9d6a6a74659a0931f8c0ea5f6a5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c816e9d6a6a74659a0931f8c0ea5f6a5", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:51:24.688561 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-666555183 Aug 10 17:51:24.688561 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: c816e9d6a6a74659a0931f8c0ea5f6a5 Aug 10 17:51:24.688561 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-666555183 Aug 10 17:51:24.688561 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-666555183-project Aug 10 17:51:24.688561 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 17:51:24.688561 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 17:51:24.688561 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: 31b7ca11df7d41618a4e08a6a99938d3 Aug 10 17:51:24.688561 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-666555183-project Aug 10 17:51:24.688561 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:51:24.688561 n-d-852296-2 devstack@n-api.service[129409]: {"security_group_rule": {"parent_group_id": "c6e30b94-d1af-4f1f-9987-9cbb3d5fdc40", "ip_protocol": "tcp", "from_port": 22, "to_port": 1775621466}} Aug 10 17:51:24.688561 n-d-852296-2 devstack@n-api.service[129409]: method: Aug 10 17:51:24.688561 n-d-852296-2 devstack@n-api.service[129409]: exception: Invalid port range 22:1775621466. Valid TCP ports should be between 1-65535 Aug 10 17:51:24.688561 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'c6e30b94-d1af-4f1f-9987-9cbb3d5fdc40', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 1775621466}}} Aug 10 17:51:24.688561 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:51:24.688561 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:51:24.688561 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 10 17:51:24.688561 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 10 17:51:24.688561 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 10 17:51:24.688561 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 10 17:51:24.688561 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 10 17:51:24.688561 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 10 17:51:24.688561 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Aug 10 17:51:24.688561 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Aug 10 17:51:24.688561 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:1775621466. Valid TCP ports should be between 1-65535 Aug 10 17:51:24.688561 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:51:24.688561 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:51:24.688561 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:51:24.688561 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:51:24.688561 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:51:24.688561 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:51:24.688561 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:51:24.688561 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:51:24.688561 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 17:51:24.688561 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 17:51:24.688561 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:51:24.688561 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:51:24.688561 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 10 17:51:24.688561 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 10 17:51:24.688561 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:1775621466. Valid TCP ports should be between 1-65535 Aug 10 17:51:24.688561 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:51:24.693241 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:51:24.693241 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:51:24.693241 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:51:24.693241 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:51:24.693241 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:51:24.693241 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:51:24.693241 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:51:24.693241 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:1775621466. Valid TCP ports should be between 1-65535 Aug 10 17:51:24.693241 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:51:24.694803 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-bdea0865-4b25-47ad-8882-5bb53f491e40 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Going to run 1 instances... {{(pid=129410) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 17:51:24.694803 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-bdea0865-4b25-47ad-8882-5bb53f491e40 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] [instance: 37934416-f4a8-4fee-8f7f-53c9df0f6c72] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a735ff26-463a-4ffe-a981-ab9d9baa494f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129410) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 17:51:24.696309 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-bf76fa39-f0a8-4b34-8727-69c12edb5e17 tempest-SecurityGroupRulesNegativeTestJSON-666555183 tempest-SecurityGroupRulesNegativeTestJSON-666555183-project] Returning 400 to user: Invalid port range 22:1775621466. Valid TCP ports should be between 1-65535 {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:51:24.697980 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-bf76fa39-f0a8-4b34-8727-69c12edb5e17 tempest-SecurityGroupRulesNegativeTestJSON-666555183 tempest-SecurityGroupRulesNegativeTestJSON-666555183-project] 10.222.0.50 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 119 microversion: 2.1 time: 0.300080 Aug 10 17:51:24.699058 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 264/544] 10.222.0.50 () {60 vars in 1195 bytes} [Wed Aug 10 17:51:24 2022] POST /compute/v2.1/os-security-group-rules => generated 119 bytes in 302 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 10 17:51:24.706724 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-f055f1b8-5e03-49aa-899e-160f6a7b7b2f tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:24.708730 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-f055f1b8-5e03-49aa-899e-160f6a7b7b2f tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: f174eccc-36df-40a9-9831-0fb5848664ba] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:51:24.715485 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-f055f1b8-5e03-49aa-899e-160f6a7b7b2f tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:24.716607 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-f055f1b8-5e03-49aa-899e-160f6a7b7b2f tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:24.717248 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-f055f1b8-5e03-49aa-899e-160f6a7b7b2f tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:24.718777 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-f055f1b8-5e03-49aa-899e-160f6a7b7b2f tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:24.719435 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-f055f1b8-5e03-49aa-899e-160f6a7b7b2f tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:24.720060 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-f055f1b8-5e03-49aa-899e-160f6a7b7b2f tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:25.113309 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-bdea0865-4b25-47ad-8882-5bb53f491e40 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.131781 Aug 10 17:51:25.123206 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 281/545] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 17:51:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1145 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 17:51:25.129398 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-d7c45555-d2c3-40c7-8850-b48c15152d26 tempest-SecurityGroupRulesNegativeTestJSON-666555183 tempest-SecurityGroupRulesNegativeTestJSON-666555183-project] Action: 'create', calling method: .version_select at 0x7fb3463e9940>, body: {"security_group_rule": {"parent_group_id": "d2769902-770e-4acf-976a-c9ed760e2e4c", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:51:25.230407 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-f055f1b8-5e03-49aa-899e-160f6a7b7b2f tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:51:25.243875 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-f055f1b8-5e03-49aa-899e-160f6a7b7b2f tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/f174eccc-36df-40a9-9831-0fb5848664ba" status: 200 len: 1318 microversion: 2.1 time: 0.543046 Aug 10 17:51:25.269980 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 265/546] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:51:24 2022] GET /compute/v2.1/servers/f174eccc-36df-40a9-9831-0fb5848664ba => generated 1318 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:51:25.286552 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-0ed73dd9-bedd-4eb5-8282-8cc7e8444f37 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:25.287172 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-0ed73dd9-bedd-4eb5-8282-8cc7e8444f37 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] [instance: 4db20dd7-9c34-41ea-a53f-e61c197ca66c] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:51:25.322318 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-0ed73dd9-bedd-4eb5-8282-8cc7e8444f37 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:25.325844 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-0ed73dd9-bedd-4eb5-8282-8cc7e8444f37 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:25.326402 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-0ed73dd9-bedd-4eb5-8282-8cc7e8444f37 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:25.328070 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-0ed73dd9-bedd-4eb5-8282-8cc7e8444f37 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:25.328749 n-d-852296-2 devstack@n-api.service[129410]: DEBUG neutronclient.v2_0.client [None req-d7c45555-d2c3-40c7-8850-b48c15152d26 tempest-SecurityGroupRulesNegativeTestJSON-666555183 tempest-SecurityGroupRulesNegativeTestJSON-666555183-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d2769902-770e-4acf-976a-c9ed760e2e4c does not exist", "detail": ""}} {{(pid=129410) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 10 17:51:25.330170 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.network.security_group_api [None req-d7c45555-d2c3-40c7-8850-b48c15152d26 tempest-SecurityGroupRulesNegativeTestJSON-666555183 tempest-SecurityGroupRulesNegativeTestJSON-666555183-project] Neutron security group d2769902-770e-4acf-976a-c9ed760e2e4c not found {{(pid=129410) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 10 17:51:25.331668 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-d7c45555-d2c3-40c7-8850-b48c15152d26 tempest-SecurityGroupRulesNegativeTestJSON-666555183 tempest-SecurityGroupRulesNegativeTestJSON-666555183-project] HTTP exception thrown: Security group d2769902-770e-4acf-976a-c9ed760e2e4c does not exist Aug 10 17:51:25.331668 n-d-852296-2 devstack@n-api.service[129410]: Neutron server returns request_ids: ['req-023cd751-e896-4154-9072-5c10ba2c9dfa'] Aug 10 17:51:25.332318 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-0ed73dd9-bedd-4eb5-8282-8cc7e8444f37 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:25.333910 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-d7c45555-d2c3-40c7-8850-b48c15152d26 tempest-SecurityGroupRulesNegativeTestJSON-666555183 tempest-SecurityGroupRulesNegativeTestJSON-666555183-project] Request method failure captured: Aug 10 17:51:25.333910 n-d-852296-2 devstack@n-api.service[129410]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 10 17:51:25.333910 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 17:51:25.333910 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 17:51:25.333910 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 17:51:25.333910 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 138 Aug 10 17:51:25.333910 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 17:51:25.333910 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 17:51:25.333910 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 17:51:25.333910 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 17:51:25.333910 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8_AMKyBnCU33wFtvfZP2xDE3F5gFgiab70LlvGpebp4sHf7wWZK9C8xqCcy-50xE42kIYtOVrSqdQ7EmDvqx50MLCmoCWamgmxIFHfO3U29kplln_3tIhUCbE1g4Twc1WpeJEKWL4kE1GZj1JnzGQZYTBsjRA421QaoLkHb1KMHtQA8 Aug 10 17:51:25.333910 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 17:51:25.333910 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 17:51:25.333910 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 17:51:25.333910 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 17:51:25.333910 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 17:51:25.333910 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 17:51:25.333910 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: c816e9d6a6a74659a0931f8c0ea5f6a5 Aug 10 17:51:25.333910 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-666555183 Aug 10 17:51:25.333910 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 17:51:25.333910 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 17:51:25.333910 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c816e9d6a6a74659a0931f8c0ea5f6a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c816e9d6a6a74659a0931f8c0ea5f6a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c816e9d6a6a74659a0931f8c0ea5f6a5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c816e9d6a6a74659a0931f8c0ea5f6a5", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:51:25.333910 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-666555183 Aug 10 17:51:25.333910 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: c816e9d6a6a74659a0931f8c0ea5f6a5 Aug 10 17:51:25.333910 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-666555183 Aug 10 17:51:25.333910 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-666555183-project Aug 10 17:51:25.333910 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 17:51:25.333910 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 17:51:25.333910 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: 31b7ca11df7d41618a4e08a6a99938d3 Aug 10 17:51:25.333910 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-666555183-project Aug 10 17:51:25.333910 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 17:51:25.333910 n-d-852296-2 devstack@n-api.service[129410]: {"security_group_rule": {"parent_group_id": "d2769902-770e-4acf-976a-c9ed760e2e4c", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Aug 10 17:51:25.333910 n-d-852296-2 devstack@n-api.service[129410]: method: Aug 10 17:51:25.333910 n-d-852296-2 devstack@n-api.service[129410]: exception: Security group d2769902-770e-4acf-976a-c9ed760e2e4c does not exist Aug 10 17:51:25.333910 n-d-852296-2 devstack@n-api.service[129410]: Neutron server returns request_ids: ['req-023cd751-e896-4154-9072-5c10ba2c9dfa'] Aug 10 17:51:25.333910 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'd2769902-770e-4acf-976a-c9ed760e2e4c', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Aug 10 17:51:25.333910 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:51:25.333910 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:51:25.333910 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 10 17:51:25.333910 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 10 17:51:25.333910 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:51:25.333910 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:51:25.333910 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 10 17:51:25.333910 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 10 17:51:25.333910 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:51:25.333910 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:51:25.333910 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:51:25.333910 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:51:25.333910 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:51:25.333910 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:51:25.333910 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:51:25.333910 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:51:25.333910 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:51:25.333910 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:51:25.333910 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 10 17:51:25.333910 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 10 17:51:25.333910 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:51:25.333910 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:51:25.333910 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 10 17:51:25.333910 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 10 17:51:25.333910 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 10 17:51:25.337719 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 10 17:51:25.337719 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d2769902-770e-4acf-976a-c9ed760e2e4c does not exist Aug 10 17:51:25.337719 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-023cd751-e896-4154-9072-5c10ba2c9dfa'] Aug 10 17:51:25.337719 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:51:25.337719 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:51:25.337719 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:51:25.337719 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:51:25.337719 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Aug 10 17:51:25.337719 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Aug 10 17:51:25.337719 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 10 17:51:25.337719 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 10 17:51:25.337719 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d2769902-770e-4acf-976a-c9ed760e2e4c does not exist Aug 10 17:51:25.337719 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-023cd751-e896-4154-9072-5c10ba2c9dfa'] Aug 10 17:51:25.337719 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:51:25.337719 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:51:25.337719 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:51:25.337719 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:51:25.337719 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:51:25.337719 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:51:25.337719 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:51:25.337719 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:51:25.337719 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 17:51:25.337719 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 17:51:25.337719 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:51:25.337719 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:51:25.337719 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Aug 10 17:51:25.337719 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 10 17:51:25.337719 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d2769902-770e-4acf-976a-c9ed760e2e4c does not exist Aug 10 17:51:25.337719 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-023cd751-e896-4154-9072-5c10ba2c9dfa'] Aug 10 17:51:25.337719 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:51:25.337719 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:51:25.337719 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:51:25.337719 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:51:25.337719 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:51:25.337719 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:51:25.337719 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:51:25.337719 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:51:25.337719 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d2769902-770e-4acf-976a-c9ed760e2e4c does not exist Aug 10 17:51:25.337719 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-023cd751-e896-4154-9072-5c10ba2c9dfa'] Aug 10 17:51:25.337719 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:51:25.342628 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-0ed73dd9-bedd-4eb5-8282-8cc7e8444f37 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:25.344480 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-d7c45555-d2c3-40c7-8850-b48c15152d26 tempest-SecurityGroupRulesNegativeTestJSON-666555183 tempest-SecurityGroupRulesNegativeTestJSON-666555183-project] Returning 404 to user: Security group d2769902-770e-4acf-976a-c9ed760e2e4c does not exist Aug 10 17:51:25.344480 n-d-852296-2 devstack@n-api.service[129410]: Neutron server returns request_ids: ['req-023cd751-e896-4154-9072-5c10ba2c9dfa'] {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:51:25.345650 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-d7c45555-d2c3-40c7-8850-b48c15152d26 tempest-SecurityGroupRulesNegativeTestJSON-666555183 tempest-SecurityGroupRulesNegativeTestJSON-666555183-project] 10.222.0.50 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.221024 Aug 10 17:51:25.347283 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 282/547] 10.222.0.50 () {60 vars in 1195 bytes} [Wed Aug 10 17:51:25 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 223 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:51:25.362882 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-558d29b9-4527-48d5-b7f7-27d636e7ba71 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:25.363739 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-558d29b9-4527-48d5-b7f7-27d636e7ba71 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] [instance: 37934416-f4a8-4fee-8f7f-53c9df0f6c72] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:51:25.649018 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-558d29b9-4527-48d5-b7f7-27d636e7ba71 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e109c3dcd0574faaa3d7ec31dd4edd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48bbb92998f54ebeb624bc794d406896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:51:25.657041 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-558d29b9-4527-48d5-b7f7-27d636e7ba71 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] 10.222.0.50 "GET /compute/v2.1/servers/37934416-f4a8-4fee-8f7f-53c9df0f6c72" status: 200 len: 1213 microversion: 2.1 time: 0.308412 Aug 10 17:51:25.658341 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 283/548] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:51:25 2022] GET /compute/v2.1/servers/37934416-f4a8-4fee-8f7f-53c9df0f6c72 => generated 1213 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:51:25.677835 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-a2cf67ce-772a-492c-833d-909c125799f2 tempest-SecurityGroupRulesNegativeTestJSON-666555183 tempest-SecurityGroupRulesNegativeTestJSON-666555183-project] Calling method '.version_select at 0x7fb3463e9940>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:25.821564 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-0ed73dd9-bedd-4eb5-8282-8cc7e8444f37 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2fd6acf18d4218ad143ccee2d0bb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7c2481a908406fa9c4562513fff665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:51:25.832173 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-0ed73dd9-bedd-4eb5-8282-8cc7e8444f37 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] 10.222.0.50 "GET /compute/v2.1/servers/4db20dd7-9c34-41ea-a53f-e61c197ca66c" status: 200 len: 1284 microversion: 2.1 time: 0.561005 Aug 10 17:51:25.833886 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 266/549] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:51:25 2022] GET /compute/v2.1/servers/4db20dd7-9c34-41ea-a53f-e61c197ca66c => generated 1284 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:51:26.197034 n-d-852296-2 devstack@n-api.service[129410]: DEBUG neutronclient.v2_0.client [None req-a2cf67ce-772a-492c-833d-909c125799f2 tempest-SecurityGroupRulesNegativeTestJSON-666555183 tempest-SecurityGroupRulesNegativeTestJSON-666555183-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 7b92780f-5368-4787-a0ee-fa96ce2b7a3c does not exist", "detail": ""}} {{(pid=129410) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 10 17:51:26.197034 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.network.security_group_api [None req-a2cf67ce-772a-492c-833d-909c125799f2 tempest-SecurityGroupRulesNegativeTestJSON-666555183 tempest-SecurityGroupRulesNegativeTestJSON-666555183-project] Neutron security group rule 7b92780f-5368-4787-a0ee-fa96ce2b7a3c not found {{(pid=129410) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Aug 10 17:51:26.197034 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-a2cf67ce-772a-492c-833d-909c125799f2 tempest-SecurityGroupRulesNegativeTestJSON-666555183 tempest-SecurityGroupRulesNegativeTestJSON-666555183-project] HTTP exception thrown: Security group rule 7b92780f-5368-4787-a0ee-fa96ce2b7a3c does not exist Aug 10 17:51:26.197034 n-d-852296-2 devstack@n-api.service[129410]: Neutron server returns request_ids: ['req-c4399f3e-258e-4fae-8a0d-024fb39fc441'] Aug 10 17:51:26.197034 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-a2cf67ce-772a-492c-833d-909c125799f2 tempest-SecurityGroupRulesNegativeTestJSON-666555183 tempest-SecurityGroupRulesNegativeTestJSON-666555183-project] Request method failure captured: Aug 10 17:51:26.197034 n-d-852296-2 devstack@n-api.service[129410]: request: DELETE /compute/v2.1/os-security-group-rules/7b92780f-5368-4787-a0ee-fa96ce2b7a3c HTTP/1.1 Aug 10 17:51:26.197034 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 17:51:26.197034 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 17:51:26.197034 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 17:51:26.197034 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 0 Aug 10 17:51:26.197034 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 17:51:26.197034 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 17:51:26.197034 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 17:51:26.197034 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 17:51:26.197034 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8_AMKyBnCU33wFtvfZP2xDE3F5gFgiab70LlvGpebp4sHf7wWZK9C8xqCcy-50xE42kIYtOVrSqdQ7EmDvqx50MLCmoCWamgmxIFHfO3U29kplln_3tIhUCbE1g4Twc1WpeJEKWL4kE1GZj1JnzGQZYTBsjRA421QaoLkHb1KMHtQA8 Aug 10 17:51:26.197034 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 17:51:26.197034 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 17:51:26.197034 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 17:51:26.197034 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 17:51:26.197034 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 17:51:26.197034 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 17:51:26.197034 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: c816e9d6a6a74659a0931f8c0ea5f6a5 Aug 10 17:51:26.197034 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-666555183 Aug 10 17:51:26.197034 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 17:51:26.197034 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 17:51:26.197034 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c816e9d6a6a74659a0931f8c0ea5f6a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c816e9d6a6a74659a0931f8c0ea5f6a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c816e9d6a6a74659a0931f8c0ea5f6a5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c816e9d6a6a74659a0931f8c0ea5f6a5", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:51:26.197034 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-666555183 Aug 10 17:51:26.197034 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: c816e9d6a6a74659a0931f8c0ea5f6a5 Aug 10 17:51:26.197034 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-666555183 Aug 10 17:51:26.197034 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-666555183-project Aug 10 17:51:26.197034 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 17:51:26.197034 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 17:51:26.197034 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: 31b7ca11df7d41618a4e08a6a99938d3 Aug 10 17:51:26.197034 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-666555183-project Aug 10 17:51:26.197034 n-d-852296-2 devstack@n-api.service[129410]: method: Aug 10 17:51:26.197034 n-d-852296-2 devstack@n-api.service[129410]: exception: Security group rule 7b92780f-5368-4787-a0ee-fa96ce2b7a3c does not exist Aug 10 17:51:26.197034 n-d-852296-2 devstack@n-api.service[129410]: Neutron server returns request_ids: ['req-c4399f3e-258e-4fae-8a0d-024fb39fc441'] Aug 10 17:51:26.197034 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'id': '7b92780f-5368-4787-a0ee-fa96ce2b7a3c'} Aug 10 17:51:26.197034 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:51:26.197034 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:51:26.197034 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Aug 10 17:51:26.197034 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Aug 10 17:51:26.197034 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:51:26.197034 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:51:26.197034 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1064, in show_security_group_rule Aug 10 17:51:26.197034 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Aug 10 17:51:26.197034 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:51:26.197034 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:51:26.197034 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:51:26.197034 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:51:26.197034 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:51:26.197034 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:51:26.201409 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:51:26.201409 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:51:26.201409 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:51:26.201409 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:51:26.201409 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 10 17:51:26.201409 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 10 17:51:26.201409 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:51:26.201409 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:51:26.201409 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 10 17:51:26.201409 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 10 17:51:26.201409 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 10 17:51:26.201409 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 10 17:51:26.201409 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule 7b92780f-5368-4787-a0ee-fa96ce2b7a3c does not exist Aug 10 17:51:26.201409 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c4399f3e-258e-4fae-8a0d-024fb39fc441'] Aug 10 17:51:26.201409 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:51:26.201409 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:51:26.201409 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:51:26.201409 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:51:26.201409 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Aug 10 17:51:26.201409 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Aug 10 17:51:26.201409 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Aug 10 17:51:26.201409 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 10 17:51:26.201409 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule 7b92780f-5368-4787-a0ee-fa96ce2b7a3c does not exist Aug 10 17:51:26.201409 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c4399f3e-258e-4fae-8a0d-024fb39fc441'] Aug 10 17:51:26.201409 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:51:26.201409 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:51:26.201409 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:51:26.201409 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:51:26.201409 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:51:26.201409 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:51:26.201409 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:51:26.201409 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:51:26.201409 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 17:51:26.201409 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 17:51:26.201409 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:51:26.201409 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:51:26.201409 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Aug 10 17:51:26.201409 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 10 17:51:26.201409 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule 7b92780f-5368-4787-a0ee-fa96ce2b7a3c does not exist Aug 10 17:51:26.201409 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c4399f3e-258e-4fae-8a0d-024fb39fc441'] Aug 10 17:51:26.201409 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:51:26.201409 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:51:26.201409 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:51:26.201409 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:51:26.201409 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:51:26.201409 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:51:26.201409 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:51:26.201409 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:51:26.201409 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule 7b92780f-5368-4787-a0ee-fa96ce2b7a3c does not exist Aug 10 17:51:26.201409 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c4399f3e-258e-4fae-8a0d-024fb39fc441'] Aug 10 17:51:26.201409 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:51:26.201409 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-a2cf67ce-772a-492c-833d-909c125799f2 tempest-SecurityGroupRulesNegativeTestJSON-666555183 tempest-SecurityGroupRulesNegativeTestJSON-666555183-project] Returning 404 to user: Security group rule 7b92780f-5368-4787-a0ee-fa96ce2b7a3c does not exist Aug 10 17:51:26.201409 n-d-852296-2 devstack@n-api.service[129410]: Neutron server returns request_ids: ['req-c4399f3e-258e-4fae-8a0d-024fb39fc441'] {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:51:26.212337 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-a2cf67ce-772a-492c-833d-909c125799f2 tempest-SecurityGroupRulesNegativeTestJSON-666555183 tempest-SecurityGroupRulesNegativeTestJSON-666555183-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-group-rules/7b92780f-5368-4787-a0ee-fa96ce2b7a3c" status: 404 len: 199 microversion: 2.1 time: 0.413880 Aug 10 17:51:26.212337 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 284/550] 10.222.0.50 () {58 vars in 1287 bytes} [Wed Aug 10 17:51:25 2022] DELETE /compute/v2.1/os-security-group-rules/7b92780f-5368-4787-a0ee-fa96ce2b7a3c => generated 199 bytes in 415 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:51:26.216623 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-b6df8e67-45cd-4334-8966-aff8f309f953 tempest-SecurityGroupRulesNegativeTestJSON-666555183 tempest-SecurityGroupRulesNegativeTestJSON-666555183-project] Calling method '.version_select at 0x7fb3463af9d0>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:26.535424 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-43e3cbd8-e477-462b-aa6e-e041c289f842 tempest-SecurityGroupsTestAdminJSON-2116476668 tempest-SecurityGroupsTestAdminJSON-2116476668-project] Action: 'create', calling method: .version_select at 0x7fb3465e8790>, body: {"security_group": {"name": "tempest-securitygroup-451941532", "description": "tempest-description-2087154004"}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:51:27.128310 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-b6df8e67-45cd-4334-8966-aff8f309f953 tempest-SecurityGroupRulesNegativeTestJSON-666555183 tempest-SecurityGroupRulesNegativeTestJSON-666555183-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/c6e30b94-d1af-4f1f-9987-9cbb3d5fdc40" status: 202 len: 0 microversion: 2.1 time: 0.923338 Aug 10 17:51:27.135936 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 285/551] 10.222.0.50 () {58 vars in 1272 bytes} [Wed Aug 10 17:51:26 2022] DELETE /compute/v2.1/os-security-groups/c6e30b94-d1af-4f1f-9987-9cbb3d5fdc40 => generated 0 bytes in 934 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 17:51:27.167721 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-e87f9b01-b7e9-4f7c-a78d-6547e14d8099 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:27.170574 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-e87f9b01-b7e9-4f7c-a78d-6547e14d8099 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: f174eccc-36df-40a9-9831-0fb5848664ba] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:51:27.212420 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e87f9b01-b7e9-4f7c-a78d-6547e14d8099 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:27.213619 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e87f9b01-b7e9-4f7c-a78d-6547e14d8099 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:27.214330 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e87f9b01-b7e9-4f7c-a78d-6547e14d8099 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:27.216323 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e87f9b01-b7e9-4f7c-a78d-6547e14d8099 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:27.219203 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e87f9b01-b7e9-4f7c-a78d-6547e14d8099 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:27.219855 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e87f9b01-b7e9-4f7c-a78d-6547e14d8099 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:27.712391 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-e87f9b01-b7e9-4f7c-a78d-6547e14d8099 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:51:27.723223 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-e87f9b01-b7e9-4f7c-a78d-6547e14d8099 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/f174eccc-36df-40a9-9831-0fb5848664ba" status: 200 len: 1318 microversion: 2.1 time: 0.580126 Aug 10 17:51:27.738633 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 286/552] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:51:27 2022] GET /compute/v2.1/servers/f174eccc-36df-40a9-9831-0fb5848664ba => generated 1318 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:51:27.750512 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-d16d4a63-bc54-4486-ad90-6c4d44067a9e tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:27.753838 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-d16d4a63-bc54-4486-ad90-6c4d44067a9e tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] [instance: 37934416-f4a8-4fee-8f7f-53c9df0f6c72] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:51:27.764144 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d16d4a63-bc54-4486-ad90-6c4d44067a9e tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:27.765100 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d16d4a63-bc54-4486-ad90-6c4d44067a9e tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:27.765788 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d16d4a63-bc54-4486-ad90-6c4d44067a9e tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:27.766776 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d16d4a63-bc54-4486-ad90-6c4d44067a9e tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:27.767633 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d16d4a63-bc54-4486-ad90-6c4d44067a9e tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:27.787123 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d16d4a63-bc54-4486-ad90-6c4d44067a9e tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:28.040992 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-d16d4a63-bc54-4486-ad90-6c4d44067a9e tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e109c3dcd0574faaa3d7ec31dd4edd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48bbb92998f54ebeb624bc794d406896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:51:28.049663 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-d16d4a63-bc54-4486-ad90-6c4d44067a9e tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] 10.222.0.50 "GET /compute/v2.1/servers/37934416-f4a8-4fee-8f7f-53c9df0f6c72" status: 200 len: 1217 microversion: 2.1 time: 0.309432 Aug 10 17:51:28.066684 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 287/553] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:51:27 2022] GET /compute/v2.1/servers/37934416-f4a8-4fee-8f7f-53c9df0f6c72 => generated 1217 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:51:28.076985 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-9a74ea21-a20b-4d8c-9e18-b3ae8ad93f55 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:28.077599 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-9a74ea21-a20b-4d8c-9e18-b3ae8ad93f55 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] [instance: 4db20dd7-9c34-41ea-a53f-e61c197ca66c] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:51:28.090522 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-9a74ea21-a20b-4d8c-9e18-b3ae8ad93f55 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:28.091009 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-9a74ea21-a20b-4d8c-9e18-b3ae8ad93f55 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:28.091445 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-9a74ea21-a20b-4d8c-9e18-b3ae8ad93f55 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:28.092153 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-9a74ea21-a20b-4d8c-9e18-b3ae8ad93f55 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:28.092931 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-9a74ea21-a20b-4d8c-9e18-b3ae8ad93f55 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:28.100697 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-9a74ea21-a20b-4d8c-9e18-b3ae8ad93f55 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:28.468389 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-43e3cbd8-e477-462b-aa6e-e041c289f842 tempest-SecurityGroupsTestAdminJSON-2116476668 tempest-SecurityGroupsTestAdminJSON-2116476668-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 2.264292 Aug 10 17:51:28.469113 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 267/554] 10.222.0.50 () {60 vars in 1180 bytes} [Wed Aug 10 17:51:26 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 2268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:51:28.477737 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-5d048b94-1b31-42f6-a686-f50785c7055f tempest-SecurityGroupRulesNegativeTestJSON-666555183 tempest-SecurityGroupRulesNegativeTestJSON-666555183-project] Calling method '.version_select at 0x7fb3465874c0>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:28.536815 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-9a74ea21-a20b-4d8c-9e18-b3ae8ad93f55 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2fd6acf18d4218ad143ccee2d0bb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7c2481a908406fa9c4562513fff665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:51:28.544643 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-9a74ea21-a20b-4d8c-9e18-b3ae8ad93f55 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] 10.222.0.50 "GET /compute/v2.1/servers/4db20dd7-9c34-41ea-a53f-e61c197ca66c" status: 200 len: 1314 microversion: 2.1 time: 0.474038 Aug 10 17:51:28.558633 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 288/555] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:51:28 2022] GET /compute/v2.1/servers/4db20dd7-9c34-41ea-a53f-e61c197ca66c => generated 1314 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:51:28.564111 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-10acf243-5d2c-41eb-96c6-de73299e68d9 tempest-SecurityGroupsTestAdminJSON-2116476668 tempest-SecurityGroupsTestAdminJSON-2116476668-project] Action: 'create', calling method: .version_select at 0x7fb3463cb700>, body: {"security_group": {"name": "tempest-securitygroup-389384121", "description": "tempest-description-2032065155"}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:51:29.258320 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-5d048b94-1b31-42f6-a686-f50785c7055f tempest-SecurityGroupRulesNegativeTestJSON-666555183 tempest-SecurityGroupRulesNegativeTestJSON-666555183-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/99ef4d9e-5719-4d19-ae18-66ac71f3e6c6" status: 202 len: 0 microversion: 2.1 time: 0.785550 Aug 10 17:51:29.263151 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 268/556] 10.222.0.50 () {58 vars in 1272 bytes} [Wed Aug 10 17:51:28 2022] DELETE /compute/v2.1/os-security-groups/99ef4d9e-5719-4d19-ae18-66ac71f3e6c6 => generated 0 bytes in 793 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 17:51:29.290896 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-28a51ba4-48a6-4e57-a263-baadd4b8fd7e tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:29.290896 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-28a51ba4-48a6-4e57-a263-baadd4b8fd7e tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: f174eccc-36df-40a9-9831-0fb5848664ba] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:51:29.298061 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-28a51ba4-48a6-4e57-a263-baadd4b8fd7e tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:29.298891 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-28a51ba4-48a6-4e57-a263-baadd4b8fd7e tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:29.300342 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-28a51ba4-48a6-4e57-a263-baadd4b8fd7e tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:29.301642 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-28a51ba4-48a6-4e57-a263-baadd4b8fd7e tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:29.302356 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-28a51ba4-48a6-4e57-a263-baadd4b8fd7e tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:29.303005 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-28a51ba4-48a6-4e57-a263-baadd4b8fd7e tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:29.639272 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-10acf243-5d2c-41eb-96c6-de73299e68d9 tempest-SecurityGroupsTestAdminJSON-2116476668 tempest-SecurityGroupsTestAdminJSON-2116476668-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.092639 Aug 10 17:51:29.640289 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 289/557] 10.222.0.50 () {60 vars in 1180 bytes} [Wed Aug 10 17:51:28 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:51:29.653585 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-5ec4142e-3285-4b31-be08-e1ae35f6525f tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:29.654207 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-5ec4142e-3285-4b31-be08-e1ae35f6525f tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] [instance: 37934416-f4a8-4fee-8f7f-53c9df0f6c72] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:51:29.662273 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-5ec4142e-3285-4b31-be08-e1ae35f6525f tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:29.663159 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-5ec4142e-3285-4b31-be08-e1ae35f6525f tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:29.663773 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-5ec4142e-3285-4b31-be08-e1ae35f6525f tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:29.664821 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-5ec4142e-3285-4b31-be08-e1ae35f6525f tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:29.665527 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-5ec4142e-3285-4b31-be08-e1ae35f6525f tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:29.666150 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-5ec4142e-3285-4b31-be08-e1ae35f6525f tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:29.716571 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-28a51ba4-48a6-4e57-a263-baadd4b8fd7e tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:51:29.731357 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-28a51ba4-48a6-4e57-a263-baadd4b8fd7e tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/f174eccc-36df-40a9-9831-0fb5848664ba" status: 200 len: 1318 microversion: 2.1 time: 0.465093 Aug 10 17:51:29.740454 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 269/558] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:51:29 2022] GET /compute/v2.1/servers/f174eccc-36df-40a9-9831-0fb5848664ba => generated 1318 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:51:29.740454 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-5c420a87-9f5f-4eaa-9279-44604a1e6e0b tempest-SecurityGroupRulesNegativeTestJSON-666555183 tempest-SecurityGroupRulesNegativeTestJSON-666555183-project] Calling method '.version_select at 0x7fb3468069d0>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:29.843469 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-5ec4142e-3285-4b31-be08-e1ae35f6525f tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e109c3dcd0574faaa3d7ec31dd4edd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48bbb92998f54ebeb624bc794d406896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:51:29.851230 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-5ec4142e-3285-4b31-be08-e1ae35f6525f tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] 10.222.0.50 "GET /compute/v2.1/servers/37934416-f4a8-4fee-8f7f-53c9df0f6c72" status: 200 len: 1217 microversion: 2.1 time: 0.209926 Aug 10 17:51:29.851815 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 290/559] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:51:29 2022] GET /compute/v2.1/servers/37934416-f4a8-4fee-8f7f-53c9df0f6c72 => generated 1217 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:51:29.860345 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [req-f05e9d13-b6fe-4ba1-89c4-eae958ccd981 req-71baa9c7-10d5-482d-aeac-bb78816b0917 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f174eccc-36df-40a9-9831-0fb5848664ba", "name": "network-vif-plugged", "status": "completed", "tag": "1a43209c-8ece-439a-9a58-8148b9b4a77c"}]} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:51:29.877701 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-f05e9d13-b6fe-4ba1-89c4-eae958ccd981 req-71baa9c7-10d5-482d-aeac-bb78816b0917 service nova] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:29.879574 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-f05e9d13-b6fe-4ba1-89c4-eae958ccd981 req-71baa9c7-10d5-482d-aeac-bb78816b0917 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:29.881409 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-f05e9d13-b6fe-4ba1-89c4-eae958ccd981 req-71baa9c7-10d5-482d-aeac-bb78816b0917 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:29.900416 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.compute.server_external_events [req-f05e9d13-b6fe-4ba1-89c4-eae958ccd981 req-71baa9c7-10d5-482d-aeac-bb78816b0917 service nova] Creating event network-vif-plugged:1a43209c-8ece-439a-9a58-8148b9b4a77c for instance f174eccc-36df-40a9-9831-0fb5848664ba on n-h1-852296-2 Aug 10 17:51:29.911912 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [req-f05e9d13-b6fe-4ba1-89c4-eae958ccd981 req-71baa9c7-10d5-482d-aeac-bb78816b0917 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056945 Aug 10 17:51:29.911912 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 291/560] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 10 17:51:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:51:29.932721 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-bd2ad824-da1e-4f3c-93a8-9a01bd085edc tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:29.936360 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-bd2ad824-da1e-4f3c-93a8-9a01bd085edc tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] [instance: 4db20dd7-9c34-41ea-a53f-e61c197ca66c] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:51:29.943971 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-bd2ad824-da1e-4f3c-93a8-9a01bd085edc tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:29.953853 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-bd2ad824-da1e-4f3c-93a8-9a01bd085edc tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:29.953853 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-bd2ad824-da1e-4f3c-93a8-9a01bd085edc tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:29.953853 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-bd2ad824-da1e-4f3c-93a8-9a01bd085edc tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:29.953853 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-bd2ad824-da1e-4f3c-93a8-9a01bd085edc tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:29.953853 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-bd2ad824-da1e-4f3c-93a8-9a01bd085edc tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:30.372269 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-bd2ad824-da1e-4f3c-93a8-9a01bd085edc tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2fd6acf18d4218ad143ccee2d0bb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7c2481a908406fa9c4562513fff665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:51:30.382403 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-bd2ad824-da1e-4f3c-93a8-9a01bd085edc tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] 10.222.0.50 "GET /compute/v2.1/servers/4db20dd7-9c34-41ea-a53f-e61c197ca66c" status: 200 len: 1314 microversion: 2.1 time: 0.468579 Aug 10 17:51:30.386217 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 292/561] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:51:29 2022] GET /compute/v2.1/servers/4db20dd7-9c34-41ea-a53f-e61c197ca66c => generated 1314 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:51:30.662607 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-5c420a87-9f5f-4eaa-9279-44604a1e6e0b tempest-SecurityGroupRulesNegativeTestJSON-666555183 tempest-SecurityGroupRulesNegativeTestJSON-666555183-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/1351cad8-5fd7-4761-a16e-30601db0e18c" status: 202 len: 0 microversion: 2.1 time: 0.929456 Aug 10 17:51:30.665998 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 270/562] 10.222.0.50 () {58 vars in 1272 bytes} [Wed Aug 10 17:51:29 2022] DELETE /compute/v2.1/os-security-groups/1351cad8-5fd7-4761-a16e-30601db0e18c => generated 0 bytes in 931 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 17:51:30.669504 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [req-1a05343c-dfd9-4dd4-aa1c-e023dafdbe3f req-71b90126-85d6-4fb6-b2e3-bf1291f1d41c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bee3148a-3834-41bd-99e7-b5da75217256", "tag": "2f16a409-b711-4b31-9eb5-9884dbbe9489"}]} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:51:30.728049 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-1a05343c-dfd9-4dd4-aa1c-e023dafdbe3f req-71b90126-85d6-4fb6-b2e3-bf1291f1d41c service nova] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:30.731913 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-1a05343c-dfd9-4dd4-aa1c-e023dafdbe3f req-71b90126-85d6-4fb6-b2e3-bf1291f1d41c service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:30.732439 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-1a05343c-dfd9-4dd4-aa1c-e023dafdbe3f req-71b90126-85d6-4fb6-b2e3-bf1291f1d41c service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:30.778054 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.compute.server_external_events [req-1a05343c-dfd9-4dd4-aa1c-e023dafdbe3f req-71b90126-85d6-4fb6-b2e3-bf1291f1d41c service nova] Creating event network-changed:2f16a409-b711-4b31-9eb5-9884dbbe9489 for instance bee3148a-3834-41bd-99e7-b5da75217256 on n-h2-852296-2 Aug 10 17:51:30.785586 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-69375ca3-92c5-4014-8192-96d010f99328 tempest-SecurityGroupsTestAdminJSON-579284065 tempest-SecurityGroupsTestAdminJSON-579284065-project-admin] Action: 'create', calling method: .version_select at 0x7fb3463b6310>, body: {"security_group": {"name": "tempest-securitygroup-689186074", "description": "tempest-description-1767475032"}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:51:30.806196 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [req-1a05343c-dfd9-4dd4-aa1c-e023dafdbe3f req-71b90126-85d6-4fb6-b2e3-bf1291f1d41c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134678 Aug 10 17:51:30.806868 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 271/563] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 10 17:51:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:51:30.827328 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-7ec0132f-c634-42c4-866b-d2956b31c6dc tempest-SecurityGroupRulesNegativeTestJSON-666555183 tempest-SecurityGroupRulesNegativeTestJSON-666555183-project] Calling method '.version_select at 0x7fb3465e80d0>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:31.705816 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-69375ca3-92c5-4014-8192-96d010f99328 tempest-SecurityGroupsTestAdminJSON-579284065 tempest-SecurityGroupsTestAdminJSON-579284065-project-admin] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.314839 Aug 10 17:51:31.717469 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 293/564] 10.222.0.50 () {60 vars in 1180 bytes} [Wed Aug 10 17:51:30 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:51:31.724863 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-b7ac2a24-470b-4b90-9c30-1def5ddaf690 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:31.726211 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-b7ac2a24-470b-4b90-9c30-1def5ddaf690 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: f174eccc-36df-40a9-9831-0fb5848664ba] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:51:31.735434 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b7ac2a24-470b-4b90-9c30-1def5ddaf690 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:31.745231 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b7ac2a24-470b-4b90-9c30-1def5ddaf690 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:31.747049 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b7ac2a24-470b-4b90-9c30-1def5ddaf690 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:31.748886 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b7ac2a24-470b-4b90-9c30-1def5ddaf690 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:31.749906 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b7ac2a24-470b-4b90-9c30-1def5ddaf690 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:31.750488 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b7ac2a24-470b-4b90-9c30-1def5ddaf690 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:31.933323 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-b7ac2a24-470b-4b90-9c30-1def5ddaf690 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:51:31.943603 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-b7ac2a24-470b-4b90-9c30-1def5ddaf690 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/f174eccc-36df-40a9-9831-0fb5848664ba" status: 200 len: 1318 microversion: 2.1 time: 0.224629 Aug 10 17:51:31.944372 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 294/565] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:51:31 2022] GET /compute/v2.1/servers/f174eccc-36df-40a9-9831-0fb5848664ba => generated 1318 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:51:31.982701 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-7ec0132f-c634-42c4-866b-d2956b31c6dc tempest-SecurityGroupRulesNegativeTestJSON-666555183 tempest-SecurityGroupRulesNegativeTestJSON-666555183-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/4d05b5e5-3205-4888-8fc9-8d606ff3cce1" status: 202 len: 0 microversion: 2.1 time: 1.167274 Aug 10 17:51:31.982701 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 272/566] 10.222.0.50 () {58 vars in 1272 bytes} [Wed Aug 10 17:51:30 2022] DELETE /compute/v2.1/os-security-groups/4d05b5e5-3205-4888-8fc9-8d606ff3cce1 => generated 0 bytes in 1169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 17:51:31.988809 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-3950f7aa-a95b-4dbc-a5b9-e95d9f14e54a tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:31.990469 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-3950f7aa-a95b-4dbc-a5b9-e95d9f14e54a tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] [instance: 37934416-f4a8-4fee-8f7f-53c9df0f6c72] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:51:32.029019 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-3950f7aa-a95b-4dbc-a5b9-e95d9f14e54a tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:32.029785 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-3950f7aa-a95b-4dbc-a5b9-e95d9f14e54a tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:32.033235 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-3950f7aa-a95b-4dbc-a5b9-e95d9f14e54a tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:32.035021 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-3950f7aa-a95b-4dbc-a5b9-e95d9f14e54a tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:32.038729 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-3950f7aa-a95b-4dbc-a5b9-e95d9f14e54a tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:32.040275 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-3950f7aa-a95b-4dbc-a5b9-e95d9f14e54a tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:32.174521 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-3950f7aa-a95b-4dbc-a5b9-e95d9f14e54a tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e109c3dcd0574faaa3d7ec31dd4edd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48bbb92998f54ebeb624bc794d406896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:51:32.184431 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-3950f7aa-a95b-4dbc-a5b9-e95d9f14e54a tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] 10.222.0.50 "GET /compute/v2.1/servers/37934416-f4a8-4fee-8f7f-53c9df0f6c72" status: 200 len: 1273 microversion: 2.1 time: 0.206842 Aug 10 17:51:32.187488 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 273/567] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:51:31 2022] GET /compute/v2.1/servers/37934416-f4a8-4fee-8f7f-53c9df0f6c72 => generated 1273 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:51:32.390010 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-801ceb09-81f1-4888-8efb-ec827f6a2910 tempest-QuotasAdminTestV236-429108018 tempest-QuotasAdminTestV236-429108018-project-admin] Action: 'update', calling method: .version_select at 0x7fb3463b6280>, body: {"quota_set": {"ram": "5120"}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:51:32.403959 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-e03bec52-329d-4994-ab20-87d846e513b7 tempest-LiveMigrationTest-599680963 tempest-LiveMigrationTest-599680963-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-902023459", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "623c412b-148c-4a37-96d8-0a1f84e37887"}]}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:51:32.500459 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.network.neutron [None req-e03bec52-329d-4994-ab20-87d846e513b7 tempest-LiveMigrationTest-599680963 tempest-LiveMigrationTest-599680963-project] validate_networks() for [('623c412b-148c-4a37-96d8-0a1f84e37887', None, None, None, None, None)] {{(pid=129409) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 17:51:32.504898 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:51:32.514451 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-801ceb09-81f1-4888-8efb-ec827f6a2910 tempest-QuotasAdminTestV236-429108018 tempest-QuotasAdminTestV236-429108018-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:32.515743 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-801ceb09-81f1-4888-8efb-ec827f6a2910 tempest-QuotasAdminTestV236-429108018 tempest-QuotasAdminTestV236-429108018-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:32.516404 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-801ceb09-81f1-4888-8efb-ec827f6a2910 tempest-QuotasAdminTestV236-429108018 tempest-QuotasAdminTestV236-429108018-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:32.517350 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-801ceb09-81f1-4888-8efb-ec827f6a2910 tempest-QuotasAdminTestV236-429108018 tempest-QuotasAdminTestV236-429108018-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:32.518710 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-801ceb09-81f1-4888-8efb-ec827f6a2910 tempest-QuotasAdminTestV236-429108018 tempest-QuotasAdminTestV236-429108018-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:32.519319 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-801ceb09-81f1-4888-8efb-ec827f6a2910 tempest-QuotasAdminTestV236-429108018 tempest-QuotasAdminTestV236-429108018-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:32.529953 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_cell0:SELECT=14 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:51:32.718531 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_cell0:SELECT=45 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:51:32.733930 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-801ceb09-81f1-4888-8efb-ec827f6a2910 tempest-QuotasAdminTestV236-429108018 tempest-QuotasAdminTestV236-429108018-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-quota-sets/12c7f221ea964170b2f959bfe10acad2" status: 200 len: 240 microversion: 2.36 time: 0.787053 Aug 10 17:51:32.733930 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 295/568] 10.222.0.50 () {62 vars in 1303 bytes} [Wed Aug 10 17:51:31 2022] PUT /compute/v2.1/os-quota-sets/12c7f221ea964170b2f959bfe10acad2 => generated 240 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 17:51:32.738517 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [None req-e03bec52-329d-4994-ab20-87d846e513b7 tempest-LiveMigrationTest-599680963 tempest-LiveMigrationTest-599680963-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-948a5225-018c-48a8-b418-d3f1bf493881) Aug 10 17:51:32.738517 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:51:32.738517 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:51:32.738517 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:51:32.738517 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:51:32.738517 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:51:32.738517 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:51:32.738517 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:51:32.738517 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:51:32.738517 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:51:32.738517 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 17:51:32.738517 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 17:51:32.738517 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 17:51:32.738517 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 17:51:32.738517 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 17:51:32.738517 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 17:51:32.738517 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 17:51:32.738517 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 17:51:32.738517 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 17:51:32.738517 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 17:51:32.738517 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 17:51:32.738517 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 17:51:32.738517 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 17:51:32.738517 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 17:51:32.738517 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 17:51:32.738517 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 17:51:32.738517 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 17:51:32.738517 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:51:32.738517 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:51:32.738517 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 17:51:32.738517 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 17:51:32.738517 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:51:32.738517 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:51:32.738517 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:51:32.738517 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:51:32.738517 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:51:32.738517 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:51:32.738517 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:51:32.738517 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:51:32.738517 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:51:32.738517 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:51:32.738517 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 17:51:32.738517 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 17:51:32.738517 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 17:51:32.738517 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 17:51:32.738517 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 17:51:32.738517 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 17:51:32.738517 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 17:51:32.738517 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 17:51:32.738517 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 17:51:32.738517 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 17:51:32.738517 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 17:51:32.738517 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 17:51:32.742654 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 17:51:32.742654 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 17:51:32.742654 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 17:51:32.742654 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 17:51:32.742654 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 17:51:32.742654 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 17:51:32.742654 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 17:51:32.742654 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 17:51:32.742654 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 17:51:32.742654 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 17:51:32.742654 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 17:51:32.742654 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 17:51:32.742654 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 17:51:32.742654 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 17:51:32.742654 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-948a5225-018c-48a8-b418-d3f1bf493881) Aug 10 17:51:32.742654 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:51:32.742654 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-e03bec52-329d-4994-ab20-87d846e513b7 tempest-LiveMigrationTest-599680963 tempest-LiveMigrationTest-599680963-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:51:32.742654 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:51:32.745097 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-8abb6c40-35b7-45fc-bc8c-d5bcaf1b93b0 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:32.745703 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-8abb6c40-35b7-45fc-bc8c-d5bcaf1b93b0 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] [instance: 4db20dd7-9c34-41ea-a53f-e61c197ca66c] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:51:32.746139 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-e03bec52-329d-4994-ab20-87d846e513b7 tempest-LiveMigrationTest-599680963 tempest-LiveMigrationTest-599680963-project] Request method failure captured: Aug 10 17:51:32.746139 n-d-852296-2 devstack@n-api.service[129409]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 17:51:32.746139 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 17:51:32.746139 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 17:51:32.746139 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 17:51:32.746139 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 202 Aug 10 17:51:32.746139 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 17:51:32.746139 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 17:51:32.746139 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 17:51:32.746139 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 17:51:32.746139 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8_AO3YZ0wNOhHSEtDBEZBVvtYn7m6Qn_F_DYGySZEUrfUaziWiB7goSICh-3pRLhBRcEAIanjg5W_oTgET_b2RlFYHQdLGmCYcb8a6bIZVqdupYVhdSkNWUTJ-LpZ5JXV49BiMsKoTfQpe-UPgKB-l6zUjTDW3HDMYqVsazAtUHA70M Aug 10 17:51:32.746139 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 17:51:32.746139 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 17:51:32.746139 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 17:51:32.746139 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 17:51:32.746139 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 17:51:32.746139 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 17:51:32.746139 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: c330e5bdaec74dbca34fe733a9d9d2f7 Aug 10 17:51:32.746139 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-LiveMigrationTest-599680963 Aug 10 17:51:32.746139 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 17:51:32.746139 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 17:51:32.746139 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c330e5bdaec74dbca34fe733a9d9d2f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c330e5bdaec74dbca34fe733a9d9d2f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c330e5bdaec74dbca34fe733a9d9d2f7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c330e5bdaec74dbca34fe733a9d9d2f7", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:51:32.746139 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-LiveMigrationTest-599680963 Aug 10 17:51:32.746139 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: c330e5bdaec74dbca34fe733a9d9d2f7 Aug 10 17:51:32.746139 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-LiveMigrationTest-599680963 Aug 10 17:51:32.746139 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-LiveMigrationTest-599680963-project Aug 10 17:51:32.746139 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 17:51:32.746139 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 17:51:32.746139 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: f3bca1f64dd44e6bb6e1427d5e28075f Aug 10 17:51:32.746139 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-LiveMigrationTest-599680963-project Aug 10 17:51:32.746139 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:51:32.746139 n-d-852296-2 devstack@n-api.service[129409]: {"server": {"name": "tempest-LiveMigrationTest-server-902023459", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "623c412b-148c-4a37-96d8-0a1f84e37887"}]}} Aug 10 17:51:32.746139 n-d-852296-2 devstack@n-api.service[129409]: method: > Aug 10 17:51:32.746139 n-d-852296-2 devstack@n-api.service[129409]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:51:32.746139 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:51:32.746139 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'body': {'server': {'name': 'tempest-LiveMigrationTest-server-902023459', 'imageRef': 'a735ff26-463a-4ffe-a981-ab9d9baa494f', 'flavorRef': '452', 'networks': [{'uuid': '623c412b-148c-4a37-96d8-0a1f84e37887'}]}}} Aug 10 17:51:32.746139 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:51:32.746139 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:51:32.746139 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:51:32.746139 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:51:32.746139 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:51:32.746139 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:51:32.746139 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:51:32.746139 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:51:32.746139 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:51:32.746139 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:51:32.746139 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 17:51:32.746139 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 17:51:32.746139 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 17:51:32.746139 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 17:51:32.746139 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 17:51:32.746139 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 17:51:32.746139 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 17:51:32.746139 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 17:51:32.746139 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 17:51:32.746139 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 17:51:32.746139 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 17:51:32.746139 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 17:51:32.746139 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 17:51:32.746139 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 17:51:32.746139 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 17:51:32.754799 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 17:51:32.754799 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 17:51:32.754799 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:51:32.754799 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:51:32.754799 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 17:51:32.754799 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 17:51:32.754799 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:51:32.754799 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:51:32.754799 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:51:32.754799 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:51:32.754799 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:51:32.754799 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:51:32.754799 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:51:32.754799 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:51:32.754799 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:51:32.754799 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:51:32.754799 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 17:51:32.754799 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 17:51:32.754799 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 17:51:32.754799 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 17:51:32.754799 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 17:51:32.754799 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 17:51:32.754799 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 17:51:32.754799 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 17:51:32.754799 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 17:51:32.754799 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 17:51:32.754799 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 17:51:32.754799 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 17:51:32.754799 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 17:51:32.754799 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 17:51:32.754799 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 17:51:32.754799 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 17:51:32.754799 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 17:51:32.754799 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 17:51:32.754799 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 17:51:32.754799 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 17:51:32.754799 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 17:51:32.754799 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 17:51:32.754799 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 17:51:32.754799 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 17:51:32.754799 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 17:51:32.754799 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 17:51:32.754799 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-948a5225-018c-48a8-b418-d3f1bf493881) Aug 10 17:51:32.754799 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:51:32.754799 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:51:32.754799 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:51:32.754799 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:51:32.754799 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:51:32.754799 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:51:32.754799 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:51:32.754799 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:51:32.754799 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 10 17:51:32.754799 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 10 17:51:32.758016 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:51:32.758016 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:51:32.758016 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:51:32.758016 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:51:32.758016 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:51:32.758016 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:51:32.758016 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:51:32.758016 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:51:32.758016 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:51:32.758016 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:51:32.758016 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:51:32.758016 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:51:32.758016 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:51:32.758016 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-e03bec52-329d-4994-ab20-87d846e513b7 tempest-LiveMigrationTest-599680963 tempest-LiveMigrationTest-599680963-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:51:32.758016 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:51:32.758016 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-e03bec52-329d-4994-ab20-87d846e513b7 tempest-LiveMigrationTest-599680963 tempest-LiveMigrationTest-599680963-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.560040 Aug 10 17:51:32.758016 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 274/569] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 17:51:32 2022] POST /compute/v2.1/servers => generated 214 bytes in 562 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 10 17:51:32.760188 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-7cfaa22d-85c0-463e-a888-ea6470efbf74 tempest-SecurityGroupsTestAdminJSON-579284065 tempest-SecurityGroupsTestAdminJSON-579284065-project-admin] Action: 'create', calling method: .version_select at 0x7fb346598670>, body: {"security_group": {"name": "tempest-securitygroup-1463147202", "description": "tempest-description-512438191"}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:51:32.762788 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-8abb6c40-35b7-45fc-bc8c-d5bcaf1b93b0 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:32.763573 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-8abb6c40-35b7-45fc-bc8c-d5bcaf1b93b0 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:32.767137 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-8abb6c40-35b7-45fc-bc8c-d5bcaf1b93b0 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:32.767137 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-8abb6c40-35b7-45fc-bc8c-d5bcaf1b93b0 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:32.767137 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-8abb6c40-35b7-45fc-bc8c-d5bcaf1b93b0 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:32.767137 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-8abb6c40-35b7-45fc-bc8c-d5bcaf1b93b0 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:33.046620 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-8abb6c40-35b7-45fc-bc8c-d5bcaf1b93b0 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2fd6acf18d4218ad143ccee2d0bb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7c2481a908406fa9c4562513fff665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:51:33.054639 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-8abb6c40-35b7-45fc-bc8c-d5bcaf1b93b0 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] 10.222.0.50 "GET /compute/v2.1/servers/4db20dd7-9c34-41ea-a53f-e61c197ca66c" status: 200 len: 1314 microversion: 2.1 time: 0.313177 Aug 10 17:51:33.055220 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 296/570] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:51:32 2022] GET /compute/v2.1/servers/4db20dd7-9c34-41ea-a53f-e61c197ca66c => generated 1314 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:51:33.059925 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-9155b4b5-6106-4e3d-a3ce-a1a2eb48ff56 tempest-SecurityGroupRulesNegativeTestJSON-666555183 tempest-SecurityGroupRulesNegativeTestJSON-666555183-project] Calling method '.version_select at 0x7fb346352430>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:33.262473 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-7cfaa22d-85c0-463e-a888-ea6470efbf74 tempest-SecurityGroupsTestAdminJSON-579284065 tempest-SecurityGroupsTestAdminJSON-579284065-project-admin] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.507858 Aug 10 17:51:33.262473 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 275/571] 10.222.0.50 () {60 vars in 1180 bytes} [Wed Aug 10 17:51:32 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:51:33.268342 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-1f9e3443-7b6a-4011-9df4-1f01e62f16f9 tempest-QuotasAdminTestV236-429108018 tempest-QuotasAdminTestV236-429108018-project-admin] Calling method '.version_select at 0x7fb346703a60>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:33.474392 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_cell0:SELECT=2 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:51:33.555782 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-1f9e3443-7b6a-4011-9df4-1f01e62f16f9 tempest-QuotasAdminTestV236-429108018 tempest-QuotasAdminTestV236-429108018-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:33.556593 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-1f9e3443-7b6a-4011-9df4-1f01e62f16f9 tempest-QuotasAdminTestV236-429108018 tempest-QuotasAdminTestV236-429108018-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:33.557388 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-1f9e3443-7b6a-4011-9df4-1f01e62f16f9 tempest-QuotasAdminTestV236-429108018 tempest-QuotasAdminTestV236-429108018-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:33.558307 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-1f9e3443-7b6a-4011-9df4-1f01e62f16f9 tempest-QuotasAdminTestV236-429108018 tempest-QuotasAdminTestV236-429108018-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:33.558978 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-1f9e3443-7b6a-4011-9df4-1f01e62f16f9 tempest-QuotasAdminTestV236-429108018 tempest-QuotasAdminTestV236-429108018-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:33.559590 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-1f9e3443-7b6a-4011-9df4-1f01e62f16f9 tempest-QuotasAdminTestV236-429108018 tempest-QuotasAdminTestV236-429108018-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:33.587276 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-1f9e3443-7b6a-4011-9df4-1f01e62f16f9 tempest-QuotasAdminTestV236-429108018 tempest-QuotasAdminTestV236-429108018-project-admin] 10.222.0.50 "GET /compute/v2.1/os-quota-sets/12c7f221ea964170b2f959bfe10acad2/detail" status: 200 len: 672 microversion: 2.36 time: 0.325112 Aug 10 17:51:33.588332 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 276/572] 10.222.0.50 () {60 vars in 1304 bytes} [Wed Aug 10 17:51:33 2022] GET /compute/v2.1/os-quota-sets/12c7f221ea964170b2f959bfe10acad2/detail => generated 672 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 17:51:33.597251 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [req-4bc6678a-9246-4903-8a65-e4133da02650 req-d8c54beb-fc4f-485e-8a36-1f09089416f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4db20dd7-9c34-41ea-a53f-e61c197ca66c", "tag": "b5482a58-669d-4814-9cde-e98d0998e7fe"}]} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:51:33.602856 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-9155b4b5-6106-4e3d-a3ce-a1a2eb48ff56 tempest-SecurityGroupRulesNegativeTestJSON-666555183 tempest-SecurityGroupRulesNegativeTestJSON-666555183-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/a919fb6e-19ca-47d6-b3f1-d6398adeac12" status: 202 len: 0 microversion: 2.1 time: 0.546079 Aug 10 17:51:33.604056 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 297/573] 10.222.0.50 () {58 vars in 1272 bytes} [Wed Aug 10 17:51:33 2022] DELETE /compute/v2.1/os-security-groups/a919fb6e-19ca-47d6-b3f1-d6398adeac12 => generated 0 bytes in 548 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 17:51:33.608199 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-4bc6678a-9246-4903-8a65-e4133da02650 req-d8c54beb-fc4f-485e-8a36-1f09089416f4 service nova] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:33.608518 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-4bc6678a-9246-4903-8a65-e4133da02650 req-d8c54beb-fc4f-485e-8a36-1f09089416f4 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:33.609666 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-4bc6678a-9246-4903-8a65-e4133da02650 req-d8c54beb-fc4f-485e-8a36-1f09089416f4 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:33.614390 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-5c195ab8-162f-420c-ac6a-b484d43e21a7 tempest-LiveMigrationTest-599680963 tempest-LiveMigrationTest-599680963-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1067592390", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "623c412b-148c-4a37-96d8-0a1f84e37887"}]}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:51:33.625719 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.compute.server_external_events [req-4bc6678a-9246-4903-8a65-e4133da02650 req-d8c54beb-fc4f-485e-8a36-1f09089416f4 service nova] Creating event network-changed:b5482a58-669d-4814-9cde-e98d0998e7fe for instance 4db20dd7-9c34-41ea-a53f-e61c197ca66c on n-h2-852296-2 Aug 10 17:51:33.631996 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [req-4bc6678a-9246-4903-8a65-e4133da02650 req-d8c54beb-fc4f-485e-8a36-1f09089416f4 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042241 Aug 10 17:51:33.633214 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 277/574] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 10 17:51:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:51:33.638997 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-72fecb38-187a-48c8-8fec-d054bd87ca0c tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:33.640439 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-72fecb38-187a-48c8-8fec-d054bd87ca0c tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: f174eccc-36df-40a9-9831-0fb5848664ba] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:51:33.648932 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-72fecb38-187a-48c8-8fec-d054bd87ca0c tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:33.649802 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-72fecb38-187a-48c8-8fec-d054bd87ca0c tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:33.650402 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-72fecb38-187a-48c8-8fec-d054bd87ca0c tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:33.652460 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-72fecb38-187a-48c8-8fec-d054bd87ca0c tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:33.653085 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-72fecb38-187a-48c8-8fec-d054bd87ca0c tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:33.653669 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-72fecb38-187a-48c8-8fec-d054bd87ca0c tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:33.737945 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.network.neutron [None req-5c195ab8-162f-420c-ac6a-b484d43e21a7 tempest-LiveMigrationTest-599680963 tempest-LiveMigrationTest-599680963-project] validate_networks() for [('623c412b-148c-4a37-96d8-0a1f84e37887', None, None, None, None, None)] {{(pid=129410) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 17:51:34.026843 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-72fecb38-187a-48c8-8fec-d054bd87ca0c tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:51:34.039108 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-72fecb38-187a-48c8-8fec-d054bd87ca0c tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/f174eccc-36df-40a9-9831-0fb5848664ba" status: 200 len: 1468 microversion: 2.1 time: 0.404243 Aug 10 17:51:34.040531 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 278/575] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:51:33 2022] GET /compute/v2.1/servers/f174eccc-36df-40a9-9831-0fb5848664ba => generated 1468 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:51:34.045732 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-b33ce9e3-482c-44b3-b987-8e40e45efcba tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:34.046741 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-b33ce9e3-482c-44b3-b987-8e40e45efcba tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] [instance: 37934416-f4a8-4fee-8f7f-53c9df0f6c72] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:51:34.059203 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-b33ce9e3-482c-44b3-b987-8e40e45efcba tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:34.060879 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-b33ce9e3-482c-44b3-b987-8e40e45efcba tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:34.061392 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-b33ce9e3-482c-44b3-b987-8e40e45efcba tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:34.062189 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-b33ce9e3-482c-44b3-b987-8e40e45efcba tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:34.062853 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-b33ce9e3-482c-44b3-b987-8e40e45efcba tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:34.063339 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-b33ce9e3-482c-44b3-b987-8e40e45efcba tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:34.218255 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [None req-5c195ab8-162f-420c-ac6a-b484d43e21a7 tempest-LiveMigrationTest-599680963 tempest-LiveMigrationTest-599680963-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-b19b52cc-6c31-4195-925c-13ff68bca9af) Aug 10 17:51:34.218255 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:51:34.218255 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:51:34.218255 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:51:34.218255 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:51:34.218255 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:51:34.218255 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:51:34.218255 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:51:34.218255 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:51:34.218255 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:51:34.218255 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 17:51:34.218255 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 17:51:34.218255 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 17:51:34.218255 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 17:51:34.218255 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 17:51:34.218255 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 17:51:34.218255 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 17:51:34.218255 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 17:51:34.218255 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 17:51:34.218255 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 17:51:34.218255 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 17:51:34.218255 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 17:51:34.218255 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 17:51:34.218255 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 17:51:34.218255 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 17:51:34.218255 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 17:51:34.218255 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 17:51:34.218255 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:51:34.218255 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:51:34.218255 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 17:51:34.218255 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 17:51:34.218255 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:51:34.218255 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:51:34.218255 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:51:34.218255 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:51:34.218255 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:51:34.218255 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:51:34.218255 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:51:34.218255 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:51:34.218255 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:51:34.218255 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:51:34.218255 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 17:51:34.218255 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 17:51:34.218255 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 17:51:34.218255 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 17:51:34.218255 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 17:51:34.218255 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 17:51:34.218255 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 17:51:34.218255 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 17:51:34.218255 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 17:51:34.218255 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 17:51:34.218255 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 17:51:34.218255 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 17:51:34.223655 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 17:51:34.223655 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 17:51:34.223655 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 17:51:34.223655 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 17:51:34.223655 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 17:51:34.223655 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 17:51:34.223655 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 17:51:34.223655 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 17:51:34.223655 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 17:51:34.223655 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 17:51:34.223655 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 17:51:34.223655 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 17:51:34.223655 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 17:51:34.223655 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 17:51:34.223655 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-b19b52cc-6c31-4195-925c-13ff68bca9af) Aug 10 17:51:34.223655 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:51:34.223655 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-5c195ab8-162f-420c-ac6a-b484d43e21a7 tempest-LiveMigrationTest-599680963 tempest-LiveMigrationTest-599680963-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:51:34.223655 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 17:51:34.223655 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-5c195ab8-162f-420c-ac6a-b484d43e21a7 tempest-LiveMigrationTest-599680963 tempest-LiveMigrationTest-599680963-project] Request method failure captured: Aug 10 17:51:34.223655 n-d-852296-2 devstack@n-api.service[129410]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 17:51:34.223655 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 17:51:34.223655 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 17:51:34.223655 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 17:51:34.223655 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 203 Aug 10 17:51:34.223655 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 17:51:34.223655 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 17:51:34.223655 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 17:51:34.223655 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 17:51:34.223655 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8_AO3YZ0wNOhHSEtDBEZBVvtYn7m6Qn_F_DYGySZEUrfUaziWiB7goSICh-3pRLhBRcEAIanjg5W_oTgET_b2RlFYHQdLGmCYcb8a6bIZVqdupYVhdSkNWUTJ-LpZ5JXV49BiMsKoTfQpe-UPgKB-l6zUjTDW3HDMYqVsazAtUHA70M Aug 10 17:51:34.223655 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 17:51:34.223655 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 17:51:34.223655 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 17:51:34.223655 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 17:51:34.223655 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 17:51:34.223655 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 17:51:34.223655 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: c330e5bdaec74dbca34fe733a9d9d2f7 Aug 10 17:51:34.223655 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-LiveMigrationTest-599680963 Aug 10 17:51:34.223655 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 17:51:34.223655 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 17:51:34.223655 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c330e5bdaec74dbca34fe733a9d9d2f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c330e5bdaec74dbca34fe733a9d9d2f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c330e5bdaec74dbca34fe733a9d9d2f7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c330e5bdaec74dbca34fe733a9d9d2f7", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:51:34.223655 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-LiveMigrationTest-599680963 Aug 10 17:51:34.223655 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: c330e5bdaec74dbca34fe733a9d9d2f7 Aug 10 17:51:34.223655 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-LiveMigrationTest-599680963 Aug 10 17:51:34.223655 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-LiveMigrationTest-599680963-project Aug 10 17:51:34.223655 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 17:51:34.223655 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 17:51:34.223655 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: f3bca1f64dd44e6bb6e1427d5e28075f Aug 10 17:51:34.223655 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-LiveMigrationTest-599680963-project Aug 10 17:51:34.223655 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 17:51:34.223655 n-d-852296-2 devstack@n-api.service[129410]: {"server": {"name": "tempest-LiveMigrationTest-server-1067592390", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "623c412b-148c-4a37-96d8-0a1f84e37887"}]}} Aug 10 17:51:34.223655 n-d-852296-2 devstack@n-api.service[129410]: method: > Aug 10 17:51:34.223655 n-d-852296-2 devstack@n-api.service[129410]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:51:34.223655 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 17:51:34.223655 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'body': {'server': {'name': 'tempest-LiveMigrationTest-server-1067592390', 'imageRef': 'a735ff26-463a-4ffe-a981-ab9d9baa494f', 'flavorRef': '452', 'networks': [{'uuid': '623c412b-148c-4a37-96d8-0a1f84e37887'}]}}} Aug 10 17:51:34.223655 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:51:34.223655 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:51:34.230623 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:51:34.230623 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:51:34.230623 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:51:34.230623 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:51:34.230623 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:51:34.230623 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:51:34.230623 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:51:34.230623 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:51:34.230623 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 17:51:34.230623 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 17:51:34.230623 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 17:51:34.230623 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 17:51:34.230623 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 17:51:34.230623 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 17:51:34.230623 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 17:51:34.230623 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 17:51:34.230623 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 17:51:34.230623 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 17:51:34.230623 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 17:51:34.230623 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 17:51:34.230623 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 17:51:34.230623 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 17:51:34.230623 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 17:51:34.230623 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 17:51:34.230623 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 17:51:34.230623 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:51:34.230623 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:51:34.230623 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 17:51:34.230623 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 17:51:34.230623 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:51:34.230623 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:51:34.230623 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:51:34.230623 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:51:34.230623 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:51:34.230623 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:51:34.230623 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:51:34.230623 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:51:34.230623 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:51:34.230623 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:51:34.230623 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 17:51:34.230623 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 17:51:34.230623 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 17:51:34.230623 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 17:51:34.230623 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 17:51:34.230623 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 17:51:34.230623 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 17:51:34.230623 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 17:51:34.230623 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 17:51:34.230623 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 17:51:34.230623 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 17:51:34.230623 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 17:51:34.230623 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 17:51:34.230623 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 17:51:34.230623 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 17:51:34.230623 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 17:51:34.239309 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 17:51:34.239309 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 17:51:34.239309 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 17:51:34.239309 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 17:51:34.239309 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 17:51:34.239309 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 17:51:34.239309 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 17:51:34.239309 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 17:51:34.239309 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 17:51:34.239309 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 17:51:34.239309 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-b19b52cc-6c31-4195-925c-13ff68bca9af) Aug 10 17:51:34.239309 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:51:34.239309 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:51:34.239309 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:51:34.239309 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:51:34.239309 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:51:34.239309 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:51:34.239309 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:51:34.239309 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:51:34.239309 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 10 17:51:34.239309 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 10 17:51:34.239309 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:51:34.239309 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:51:34.239309 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:51:34.239309 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:51:34.239309 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:51:34.239309 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:51:34.239309 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:51:34.239309 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:51:34.239309 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:51:34.239309 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:51:34.239309 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:51:34.239309 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:51:34.239309 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:51:34.239309 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-5c195ab8-162f-420c-ac6a-b484d43e21a7 tempest-LiveMigrationTest-599680963 tempest-LiveMigrationTest-599680963-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:51:34.239309 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:51:34.239309 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-5c195ab8-162f-420c-ac6a-b484d43e21a7 tempest-LiveMigrationTest-599680963 tempest-LiveMigrationTest-599680963-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.617128 Aug 10 17:51:34.239309 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 298/576] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 17:51:33 2022] POST /compute/v2.1/servers => generated 214 bytes in 619 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 10 17:51:34.243783 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-71d67096-5c61-455b-baf7-e8ca7fcce65c tempest-SecurityGroupsTestAdminJSON-579284065 tempest-SecurityGroupsTestAdminJSON-579284065-project-admin] Calling method '.version_select at 0x7fb3463cb9d0>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:34.570986 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-b33ce9e3-482c-44b3-b987-8e40e45efcba tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e109c3dcd0574faaa3d7ec31dd4edd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48bbb92998f54ebeb624bc794d406896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:51:34.576421 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-b33ce9e3-482c-44b3-b987-8e40e45efcba tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] 10.222.0.50 "GET /compute/v2.1/servers/37934416-f4a8-4fee-8f7f-53c9df0f6c72" status: 200 len: 1313 microversion: 2.1 time: 0.533924 Aug 10 17:51:34.579358 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 279/577] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:51:34 2022] GET /compute/v2.1/servers/37934416-f4a8-4fee-8f7f-53c9df0f6c72 => generated 1313 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:51:34.592682 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-c4c90666-1cc5-49fc-9ecc-70506e20446a tempest-QuotasAdminTestV236-429108018 tempest-QuotasAdminTestV236-429108018-project-admin] Action: 'update', calling method: .version_select at 0x7fb3465e89d0>, body: {"quota_set": {"ram": "2048"}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:51:34.684587 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c4c90666-1cc5-49fc-9ecc-70506e20446a tempest-QuotasAdminTestV236-429108018 tempest-QuotasAdminTestV236-429108018-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:34.685078 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c4c90666-1cc5-49fc-9ecc-70506e20446a tempest-QuotasAdminTestV236-429108018 tempest-QuotasAdminTestV236-429108018-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:34.685511 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c4c90666-1cc5-49fc-9ecc-70506e20446a tempest-QuotasAdminTestV236-429108018 tempest-QuotasAdminTestV236-429108018-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:34.686432 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c4c90666-1cc5-49fc-9ecc-70506e20446a tempest-QuotasAdminTestV236-429108018 tempest-QuotasAdminTestV236-429108018-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:34.686945 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c4c90666-1cc5-49fc-9ecc-70506e20446a tempest-QuotasAdminTestV236-429108018 tempest-QuotasAdminTestV236-429108018-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:34.687568 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c4c90666-1cc5-49fc-9ecc-70506e20446a tempest-QuotasAdminTestV236-429108018 tempest-QuotasAdminTestV236-429108018-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:34.699730 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_cell1:SELECT=83 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:51:34.727382 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c4c90666-1cc5-49fc-9ecc-70506e20446a tempest-QuotasAdminTestV236-429108018 tempest-QuotasAdminTestV236-429108018-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:34.728127 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c4c90666-1cc5-49fc-9ecc-70506e20446a tempest-QuotasAdminTestV236-429108018 tempest-QuotasAdminTestV236-429108018-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:34.728757 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c4c90666-1cc5-49fc-9ecc-70506e20446a tempest-QuotasAdminTestV236-429108018 tempest-QuotasAdminTestV236-429108018-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:34.729647 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c4c90666-1cc5-49fc-9ecc-70506e20446a tempest-QuotasAdminTestV236-429108018 tempest-QuotasAdminTestV236-429108018-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:34.730269 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c4c90666-1cc5-49fc-9ecc-70506e20446a tempest-QuotasAdminTestV236-429108018 tempest-QuotasAdminTestV236-429108018-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:34.730853 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c4c90666-1cc5-49fc-9ecc-70506e20446a tempest-QuotasAdminTestV236-429108018 tempest-QuotasAdminTestV236-429108018-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:35.024855 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-c4c90666-1cc5-49fc-9ecc-70506e20446a tempest-QuotasAdminTestV236-429108018 tempest-QuotasAdminTestV236-429108018-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-quota-sets/12c7f221ea964170b2f959bfe10acad2?user_id=0bf352d1ebec482592e174c482d8977c" status: 200 len: 240 microversion: 2.36 time: 0.443279 Aug 10 17:51:35.026025 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 280/578] 10.222.0.50 () {62 vars in 1384 bytes} [Wed Aug 10 17:51:34 2022] PUT /compute/v2.1/os-quota-sets/12c7f221ea964170b2f959bfe10acad2?user_id=0bf352d1ebec482592e174c482d8977c => generated 240 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 17:51:35.030981 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [req-e38826dc-2c0e-4943-944c-5a345eb19415 req-36d06d81-e0c1-4621-b75a-f3249a3acfb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c7e2e8c-4638-4952-9474-acc6ef457abc", "name": "network-vif-plugged", "status": "completed", "tag": "c1c98211-758c-4205-9ef2-cb54d2f38b9a"}]} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:51:35.042686 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-e38826dc-2c0e-4943-944c-5a345eb19415 req-36d06d81-e0c1-4621-b75a-f3249a3acfb4 service nova] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:35.043829 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-e38826dc-2c0e-4943-944c-5a345eb19415 req-36d06d81-e0c1-4621-b75a-f3249a3acfb4 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:35.044698 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-e38826dc-2c0e-4943-944c-5a345eb19415 req-36d06d81-e0c1-4621-b75a-f3249a3acfb4 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:35.058822 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.compute.server_external_events [req-e38826dc-2c0e-4943-944c-5a345eb19415 req-36d06d81-e0c1-4621-b75a-f3249a3acfb4 service nova] Creating event network-vif-plugged:c1c98211-758c-4205-9ef2-cb54d2f38b9a for instance 6c7e2e8c-4638-4952-9474-acc6ef457abc on n-h1-852296-2 Aug 10 17:51:35.064417 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [req-e38826dc-2c0e-4943-944c-5a345eb19415 req-36d06d81-e0c1-4621-b75a-f3249a3acfb4 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036832 Aug 10 17:51:35.065479 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 281/579] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 10 17:51:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:51:35.070975 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-3db472fe-9f44-45aa-8511-d226e3739418 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:35.072951 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-3db472fe-9f44-45aa-8511-d226e3739418 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: 6c7e2e8c-4638-4952-9474-acc6ef457abc] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:51:35.082375 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-3db472fe-9f44-45aa-8511-d226e3739418 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:35.083446 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-3db472fe-9f44-45aa-8511-d226e3739418 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:35.083446 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-3db472fe-9f44-45aa-8511-d226e3739418 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:35.084233 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-3db472fe-9f44-45aa-8511-d226e3739418 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:35.084809 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-3db472fe-9f44-45aa-8511-d226e3739418 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:35.085370 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-3db472fe-9f44-45aa-8511-d226e3739418 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:35.868839 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-3db472fe-9f44-45aa-8511-d226e3739418 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:51:35.888331 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-3db472fe-9f44-45aa-8511-d226e3739418 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/6c7e2e8c-4638-4952-9474-acc6ef457abc" status: 200 len: 1318 microversion: 2.1 time: 0.821343 Aug 10 17:51:35.889163 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 282/580] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:51:35 2022] GET /compute/v2.1/servers/6c7e2e8c-4638-4952-9474-acc6ef457abc => generated 1318 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:51:35.902808 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-e0cba9ac-c5ce-4e0a-8201-35098a79fb90 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:35.903634 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-e0cba9ac-c5ce-4e0a-8201-35098a79fb90 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] [instance: 4db20dd7-9c34-41ea-a53f-e61c197ca66c] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:51:35.917477 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e0cba9ac-c5ce-4e0a-8201-35098a79fb90 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:35.917974 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e0cba9ac-c5ce-4e0a-8201-35098a79fb90 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:35.918412 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e0cba9ac-c5ce-4e0a-8201-35098a79fb90 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:35.919116 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e0cba9ac-c5ce-4e0a-8201-35098a79fb90 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:35.919569 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e0cba9ac-c5ce-4e0a-8201-35098a79fb90 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:35.921702 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e0cba9ac-c5ce-4e0a-8201-35098a79fb90 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:36.156297 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-e0cba9ac-c5ce-4e0a-8201-35098a79fb90 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2fd6acf18d4218ad143ccee2d0bb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7c2481a908406fa9c4562513fff665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:51:36.164756 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-e0cba9ac-c5ce-4e0a-8201-35098a79fb90 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] 10.222.0.50 "GET /compute/v2.1/servers/4db20dd7-9c34-41ea-a53f-e61c197ca66c" status: 200 len: 1314 microversion: 2.1 time: 0.274742 Aug 10 17:51:36.165328 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 283/581] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:51:35 2022] GET /compute/v2.1/servers/4db20dd7-9c34-41ea-a53f-e61c197ca66c => generated 1314 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:51:36.181692 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-cc741355-340e-4ea4-b915-467ca97d8920 tempest-LiveMigrationTest-599680963 tempest-LiveMigrationTest-599680963-project] Action: 'create', calling method: .version_select at 0x7fb346621ee0>, body: {"keypair": {"name": "tempest-keypair-2040684976", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPSP7MxWVQ69g3I/pkUYffRhRPYjuRmCDcD30w+a4ATOx7M/vMiOsyAM0ng19ZtWFzuPXN4Yn3U6rCV+cS7KMZMf8s9Q+4vmZqogT/iDvEWurqILEa2yOnloTiYCESRCQg=="}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:51:36.207971 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-cc741355-340e-4ea4-b915-467ca97d8920 tempest-LiveMigrationTest-599680963 tempest-LiveMigrationTest-599680963-project] Getting quotas for project c330e5bdaec74dbca34fe733a9d9d2f7. Resources: {'key_pairs'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:51:36.213687 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-cc741355-340e-4ea4-b915-467ca97d8920 tempest-LiveMigrationTest-599680963 tempest-LiveMigrationTest-599680963-project] Getting quotas for user f3bca1f64dd44e6bb6e1427d5e28075f and project c330e5bdaec74dbca34fe733a9d9d2f7. Resources: {'key_pairs'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:51:36.398462 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-cc741355-340e-4ea4-b915-467ca97d8920 tempest-LiveMigrationTest-599680963 tempest-LiveMigrationTest-599680963-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.231759 Aug 10 17:51:36.401923 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 284/582] 10.222.0.50 () {60 vars in 1159 bytes} [Wed Aug 10 17:51:36 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:51:36.411952 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-137c66df-89a8-47b8-8d6f-aead3d4378de tempest-QuotasAdminTestV236-429108018 tempest-QuotasAdminTestV236-429108018-project-admin] Calling method '.version_select at 0x7fb3465e8310>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:36.523142 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-137c66df-89a8-47b8-8d6f-aead3d4378de tempest-QuotasAdminTestV236-429108018 tempest-QuotasAdminTestV236-429108018-project-admin] 10.222.0.50 "GET /compute/v2.1/os-quota-sets/12c7f221ea964170b2f959bfe10acad2?user_id=0bf352d1ebec482592e174c482d8977c" status: 200 len: 282 microversion: 2.36 time: 0.118959 Aug 10 17:51:36.525855 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 285/583] 10.222.0.50 () {60 vars in 1364 bytes} [Wed Aug 10 17:51:36 2022] GET /compute/v2.1/os-quota-sets/12c7f221ea964170b2f959bfe10acad2?user_id=0bf352d1ebec482592e174c482d8977c => generated 282 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 17:51:36.532596 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [req-63aad676-7e6d-4468-b248-01ba1508ded6 req-15009b00-ebd8-4846-9c4d-2bf728397f72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37934416-f4a8-4fee-8f7f-53c9df0f6c72", "tag": "3cbaf3c0-cf29-4559-9947-0b6b1c26bf4b"}]} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:51:36.546096 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-63aad676-7e6d-4468-b248-01ba1508ded6 req-15009b00-ebd8-4846-9c4d-2bf728397f72 service nova] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:36.546823 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-63aad676-7e6d-4468-b248-01ba1508ded6 req-15009b00-ebd8-4846-9c4d-2bf728397f72 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:36.547431 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-63aad676-7e6d-4468-b248-01ba1508ded6 req-15009b00-ebd8-4846-9c4d-2bf728397f72 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:36.564021 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.compute.server_external_events [req-63aad676-7e6d-4468-b248-01ba1508ded6 req-15009b00-ebd8-4846-9c4d-2bf728397f72 service nova] Creating event network-changed:3cbaf3c0-cf29-4559-9947-0b6b1c26bf4b for instance 37934416-f4a8-4fee-8f7f-53c9df0f6c72 on n-h1-852296-2 Aug 10 17:51:36.571959 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [req-63aad676-7e6d-4468-b248-01ba1508ded6 req-15009b00-ebd8-4846-9c4d-2bf728397f72 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043883 Aug 10 17:51:36.572940 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 286/584] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 10 17:51:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:51:36.592126 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-97ba185c-7e1f-48c6-8261-553d3876be8f tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:36.592126 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-97ba185c-7e1f-48c6-8261-553d3876be8f tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] [instance: 37934416-f4a8-4fee-8f7f-53c9df0f6c72] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:51:36.593766 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-97ba185c-7e1f-48c6-8261-553d3876be8f tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:36.594970 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-97ba185c-7e1f-48c6-8261-553d3876be8f tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:36.595643 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-97ba185c-7e1f-48c6-8261-553d3876be8f tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:36.597245 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-97ba185c-7e1f-48c6-8261-553d3876be8f tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:36.598031 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-97ba185c-7e1f-48c6-8261-553d3876be8f tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:36.598617 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-97ba185c-7e1f-48c6-8261-553d3876be8f tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:36.774754 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-71d67096-5c61-455b-baf7-e8ca7fcce65c tempest-SecurityGroupsTestAdminJSON-579284065 tempest-SecurityGroupsTestAdminJSON-579284065-project-admin] 10.222.0.50 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 9747 microversion: 2.1 time: 2.550150 Aug 10 17:51:36.775386 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 299/585] 10.222.0.50 () {58 vars in 1191 bytes} [Wed Aug 10 17:51:34 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 9747 bytes in 2551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:51:36.796545 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-d45c319f-f971-4dc1-945f-c29267ea6114 tempest-SecurityGroupsTestAdminJSON-2116476668 tempest-SecurityGroupsTestAdminJSON-2116476668-project] Calling method '.version_select at 0x7fb3463cb790>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:36.934488 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-97ba185c-7e1f-48c6-8261-553d3876be8f tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e109c3dcd0574faaa3d7ec31dd4edd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48bbb92998f54ebeb624bc794d406896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:51:36.946290 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-97ba185c-7e1f-48c6-8261-553d3876be8f tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] 10.222.0.50 "GET /compute/v2.1/servers/37934416-f4a8-4fee-8f7f-53c9df0f6c72" status: 200 len: 1313 microversion: 2.1 time: 0.371655 Aug 10 17:51:36.947231 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 287/586] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:51:36 2022] GET /compute/v2.1/servers/37934416-f4a8-4fee-8f7f-53c9df0f6c72 => generated 1313 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:51:36.956574 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-f1dae244-4d30-46c4-9cff-5a53e16b1f33 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:36.957534 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-f1dae244-4d30-46c4-9cff-5a53e16b1f33 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: 6c7e2e8c-4638-4952-9474-acc6ef457abc] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:51:36.971833 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-f1dae244-4d30-46c4-9cff-5a53e16b1f33 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:36.974017 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-f1dae244-4d30-46c4-9cff-5a53e16b1f33 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:36.974453 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-f1dae244-4d30-46c4-9cff-5a53e16b1f33 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:36.975518 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-f1dae244-4d30-46c4-9cff-5a53e16b1f33 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:36.975973 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-f1dae244-4d30-46c4-9cff-5a53e16b1f33 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:36.976429 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-f1dae244-4d30-46c4-9cff-5a53e16b1f33 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:37.041292 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-d45c319f-f971-4dc1-945f-c29267ea6114 tempest-SecurityGroupsTestAdminJSON-2116476668 tempest-SecurityGroupsTestAdminJSON-2116476668-project] 10.222.0.50 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1111 microversion: 2.1 time: 0.248591 Aug 10 17:51:37.042150 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 300/587] 10.222.0.50 () {58 vars in 1191 bytes} [Wed Aug 10 17:51:36 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1111 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:51:37.055436 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-1e7b5438-4276-46fa-b457-d45e316c96ca tempest-SecurityGroupsTestAdminJSON-579284065 tempest-SecurityGroupsTestAdminJSON-579284065-project-admin] Calling method '.version_select at 0x7fb3463ad280>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:37.268433 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-f1dae244-4d30-46c4-9cff-5a53e16b1f33 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:51:37.278207 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-f1dae244-4d30-46c4-9cff-5a53e16b1f33 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/6c7e2e8c-4638-4952-9474-acc6ef457abc" status: 200 len: 1318 microversion: 2.1 time: 0.328320 Aug 10 17:51:37.279846 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 288/588] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:51:36 2022] GET /compute/v2.1/servers/6c7e2e8c-4638-4952-9474-acc6ef457abc => generated 1318 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:51:37.288349 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-d90be76c-ffb2-4390-97c6-6f9dc5b22511 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:37.289344 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-d90be76c-ffb2-4390-97c6-6f9dc5b22511 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] [instance: 4db20dd7-9c34-41ea-a53f-e61c197ca66c] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:51:37.309451 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-d90be76c-ffb2-4390-97c6-6f9dc5b22511 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:37.309965 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-d90be76c-ffb2-4390-97c6-6f9dc5b22511 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:37.310414 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-d90be76c-ffb2-4390-97c6-6f9dc5b22511 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:37.311743 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-d90be76c-ffb2-4390-97c6-6f9dc5b22511 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:37.312416 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-d90be76c-ffb2-4390-97c6-6f9dc5b22511 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:37.313006 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-d90be76c-ffb2-4390-97c6-6f9dc5b22511 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:37.370098 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-1e7b5438-4276-46fa-b457-d45e316c96ca tempest-SecurityGroupsTestAdminJSON-579284065 tempest-SecurityGroupsTestAdminJSON-579284065-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/f6bce833-4de7-4dd2-adbd-ffaa7d30263c" status: 202 len: 0 microversion: 2.1 time: 0.318403 Aug 10 17:51:37.374352 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 301/589] 10.222.0.50 () {58 vars in 1272 bytes} [Wed Aug 10 17:51:37 2022] DELETE /compute/v2.1/os-security-groups/f6bce833-4de7-4dd2-adbd-ffaa7d30263c => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 17:51:37.381839 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-0e2612b6-6ea5-42bf-923b-d8b5be321311 tempest-SecurityGroupsTestAdminJSON-579284065 tempest-SecurityGroupsTestAdminJSON-579284065-project-admin] Calling method '.version_select at 0x7fb3465aa430>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:37.563089 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-d90be76c-ffb2-4390-97c6-6f9dc5b22511 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2fd6acf18d4218ad143ccee2d0bb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7c2481a908406fa9c4562513fff665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:51:37.576263 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-d90be76c-ffb2-4390-97c6-6f9dc5b22511 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] 10.222.0.50 "GET /compute/v2.1/servers/4db20dd7-9c34-41ea-a53f-e61c197ca66c" status: 200 len: 1314 microversion: 2.1 time: 0.294189 Aug 10 17:51:37.591700 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 289/590] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:51:37 2022] GET /compute/v2.1/servers/4db20dd7-9c34-41ea-a53f-e61c197ca66c => generated 1314 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:51:37.794764 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-0a0c2fc4-d0cb-4863-8bd5-531878298350 tempest-QuotasTestJSON-439632499 tempest-QuotasTestJSON-439632499-project] Calling method '.version_select at 0x7fb346679ca0>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:37.862461 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-0a0c2fc4-d0cb-4863-8bd5-531878298350 tempest-QuotasTestJSON-439632499 tempest-QuotasTestJSON-439632499-project] 10.222.0.50 "GET /compute/v2.1/os-quota-sets/9769085b9f064fb0a6dd06b4eecbd000/defaults" status: 200 len: 371 microversion: 2.1 time: 0.267783 Aug 10 17:51:37.863475 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 290/591] 10.222.0.50 () {58 vars in 1269 bytes} [Wed Aug 10 17:51:37 2022] GET /compute/v2.1/os-quota-sets/9769085b9f064fb0a6dd06b4eecbd000/defaults => generated 371 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:51:37.876115 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-638e56d2-d96e-4363-bd20-b2ffcf2f9390 tempest-QuotasTestJSON-439632499 tempest-QuotasTestJSON-439632499-project] Calling method '.version_select at 0x7fb3465e8430>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:37.946470 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-638e56d2-d96e-4363-bd20-b2ffcf2f9390 tempest-QuotasTestJSON-439632499 tempest-QuotasTestJSON-439632499-project] 10.222.0.50 "GET /compute/v2.1/os-quota-sets/9769085b9f064fb0a6dd06b4eecbd000" status: 200 len: 371 microversion: 2.1 time: 0.074223 Aug 10 17:51:37.947402 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 291/592] 10.222.0.50 () {58 vars in 1242 bytes} [Wed Aug 10 17:51:37 2022] GET /compute/v2.1/os-quota-sets/9769085b9f064fb0a6dd06b4eecbd000 => generated 371 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:51:37.961467 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-6c10899d-d97a-4479-b4df-616694922784 tempest-QuotasTestJSON-439632499 tempest-QuotasTestJSON-439632499-project] Calling method '.version_select at 0x7fb346533280>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:38.020542 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-6c10899d-d97a-4479-b4df-616694922784 tempest-QuotasTestJSON-439632499 tempest-QuotasTestJSON-439632499-project] 10.222.0.50 "GET /compute/v2.1/os-quota-sets/9769085b9f064fb0a6dd06b4eecbd000/defaults" status: 200 len: 371 microversion: 2.1 time: 0.063078 Aug 10 17:51:38.021126 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 292/593] 10.222.0.50 () {58 vars in 1269 bytes} [Wed Aug 10 17:51:37 2022] GET /compute/v2.1/os-quota-sets/9769085b9f064fb0a6dd06b4eecbd000/defaults => generated 371 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:51:38.043660 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-1a74f53d-492e-486b-9059-34c0ec2fc6dd tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:38.043660 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-1a74f53d-492e-486b-9059-34c0ec2fc6dd tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] [instance: 37934416-f4a8-4fee-8f7f-53c9df0f6c72] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:51:38.043660 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-1a74f53d-492e-486b-9059-34c0ec2fc6dd tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:38.043660 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-1a74f53d-492e-486b-9059-34c0ec2fc6dd tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:38.043660 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-1a74f53d-492e-486b-9059-34c0ec2fc6dd tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:38.043660 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-1a74f53d-492e-486b-9059-34c0ec2fc6dd tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:38.043660 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-1a74f53d-492e-486b-9059-34c0ec2fc6dd tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:38.043660 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-1a74f53d-492e-486b-9059-34c0ec2fc6dd tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:38.102952 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-0e2612b6-6ea5-42bf-923b-d8b5be321311 tempest-SecurityGroupsTestAdminJSON-579284065 tempest-SecurityGroupsTestAdminJSON-579284065-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/00d5ec22-017a-42fb-92a4-a3ad574b2df8" status: 202 len: 0 microversion: 2.1 time: 0.726356 Aug 10 17:51:38.110149 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 302/594] 10.222.0.50 () {58 vars in 1272 bytes} [Wed Aug 10 17:51:37 2022] DELETE /compute/v2.1/os-security-groups/00d5ec22-017a-42fb-92a4-a3ad574b2df8 => generated 0 bytes in 729 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 17:51:38.110149 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-2d5076bf-6e27-46d1-9cf6-f122f68fbc6e tempest-QuotasTestJSON-439632499 tempest-QuotasTestJSON-439632499-project] Calling method '.version_select at 0x7fb3463fd550>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:38.236929 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-1a74f53d-492e-486b-9059-34c0ec2fc6dd tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e109c3dcd0574faaa3d7ec31dd4edd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48bbb92998f54ebeb624bc794d406896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:51:38.238215 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-2d5076bf-6e27-46d1-9cf6-f122f68fbc6e tempest-QuotasTestJSON-439632499 tempest-QuotasTestJSON-439632499-project] 10.222.0.50 "GET /compute/v2.1/os-quota-sets/9769085b9f064fb0a6dd06b4eecbd000" status: 200 len: 371 microversion: 2.1 time: 0.132130 Aug 10 17:51:38.239110 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 303/595] 10.222.0.50 () {58 vars in 1242 bytes} [Wed Aug 10 17:51:38 2022] GET /compute/v2.1/os-quota-sets/9769085b9f064fb0a6dd06b4eecbd000 => generated 371 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:51:38.246319 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-e6f4d600-92bc-460d-88b4-1790bede2f4d tempest-SecurityGroupsTestAdminJSON-2116476668 tempest-SecurityGroupsTestAdminJSON-2116476668-project] Calling method '.version_select at 0x7fb3463adee0>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:38.246513 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-1a74f53d-492e-486b-9059-34c0ec2fc6dd tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] 10.222.0.50 "GET /compute/v2.1/servers/37934416-f4a8-4fee-8f7f-53c9df0f6c72" status: 200 len: 1313 microversion: 2.1 time: 0.224037 Aug 10 17:51:38.247002 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 293/596] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:51:38 2022] GET /compute/v2.1/servers/37934416-f4a8-4fee-8f7f-53c9df0f6c72 => generated 1313 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:51:38.251873 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-f7eea192-e317-4fb1-8ef2-2137a0738a31 tempest-QuotasTestJSON-439632499 tempest-QuotasTestJSON-439632499-project] Calling method '.version_select at 0x7fb346679c10>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:38.312805 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:51:38.350626 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-f7eea192-e317-4fb1-8ef2-2137a0738a31 tempest-QuotasTestJSON-439632499 tempest-QuotasTestJSON-439632499-project] 10.222.0.50 "GET /compute/v2.1/os-quota-sets/9769085b9f064fb0a6dd06b4eecbd000?user_id=da0900a1bf4a4f56886590f82dcdabc7" status: 200 len: 371 microversion: 2.1 time: 0.102185 Aug 10 17:51:38.351827 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 294/597] 10.222.0.50 () {58 vars in 1323 bytes} [Wed Aug 10 17:51:38 2022] GET /compute/v2.1/os-quota-sets/9769085b9f064fb0a6dd06b4eecbd000?user_id=da0900a1bf4a4f56886590f82dcdabc7 => generated 371 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:51:38.357755 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-bc8c6c16-7667-4c4c-8230-d0ebfa046e3c tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:38.358655 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-bc8c6c16-7667-4c4c-8230-d0ebfa046e3c tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: 6c7e2e8c-4638-4952-9474-acc6ef457abc] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:51:38.375839 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-bc8c6c16-7667-4c4c-8230-d0ebfa046e3c tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:38.379620 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-bc8c6c16-7667-4c4c-8230-d0ebfa046e3c tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:38.379620 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-bc8c6c16-7667-4c4c-8230-d0ebfa046e3c tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:38.379620 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-bc8c6c16-7667-4c4c-8230-d0ebfa046e3c tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:38.379620 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-bc8c6c16-7667-4c4c-8230-d0ebfa046e3c tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:38.379620 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-bc8c6c16-7667-4c4c-8230-d0ebfa046e3c tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:38.567922 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-bc8c6c16-7667-4c4c-8230-d0ebfa046e3c tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:51:38.588286 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-bc8c6c16-7667-4c4c-8230-d0ebfa046e3c tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/6c7e2e8c-4638-4952-9474-acc6ef457abc" status: 200 len: 1318 microversion: 2.1 time: 0.235084 Aug 10 17:51:38.591866 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 295/598] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:51:38 2022] GET /compute/v2.1/servers/6c7e2e8c-4638-4952-9474-acc6ef457abc => generated 1318 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:51:38.598681 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-4022f306-fb70-446a-9f81-f67519eb77b7 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:38.602384 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-4022f306-fb70-446a-9f81-f67519eb77b7 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] [instance: 4db20dd7-9c34-41ea-a53f-e61c197ca66c] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:51:38.609412 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-4022f306-fb70-446a-9f81-f67519eb77b7 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:38.610255 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-4022f306-fb70-446a-9f81-f67519eb77b7 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:38.610929 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-4022f306-fb70-446a-9f81-f67519eb77b7 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:38.613226 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-4022f306-fb70-446a-9f81-f67519eb77b7 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:38.614522 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-4022f306-fb70-446a-9f81-f67519eb77b7 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:38.615421 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-4022f306-fb70-446a-9f81-f67519eb77b7 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:38.738944 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-e6f4d600-92bc-460d-88b4-1790bede2f4d tempest-SecurityGroupsTestAdminJSON-2116476668 tempest-SecurityGroupsTestAdminJSON-2116476668-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/65699b75-3b56-443f-998a-9e6449b39df0" status: 202 len: 0 microversion: 2.1 time: 0.492448 Aug 10 17:51:38.738944 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 304/599] 10.222.0.50 () {58 vars in 1272 bytes} [Wed Aug 10 17:51:38 2022] DELETE /compute/v2.1/os-security-groups/65699b75-3b56-443f-998a-9e6449b39df0 => generated 0 bytes in 495 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 17:51:38.745696 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-f530f9a3-1877-473a-b81e-33553bf55405 tempest-SecurityGroupsTestAdminJSON-2116476668 tempest-SecurityGroupsTestAdminJSON-2116476668-project] Calling method '.version_select at 0x7fb3463ad430>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:38.797339 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-4022f306-fb70-446a-9f81-f67519eb77b7 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2fd6acf18d4218ad143ccee2d0bb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7c2481a908406fa9c4562513fff665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:51:38.806775 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-4022f306-fb70-446a-9f81-f67519eb77b7 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] 10.222.0.50 "GET /compute/v2.1/servers/4db20dd7-9c34-41ea-a53f-e61c197ca66c" status: 200 len: 1314 microversion: 2.1 time: 0.212781 Aug 10 17:51:38.807369 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 296/600] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:51:38 2022] GET /compute/v2.1/servers/4db20dd7-9c34-41ea-a53f-e61c197ca66c => generated 1314 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:51:38.927547 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [req-b9157ef8-72f9-4fe4-976f-55cb93489614 req-346fd609-889f-4d76-af24-62dde86c0cce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4db20dd7-9c34-41ea-a53f-e61c197ca66c", "name": "network-vif-plugged", "status": "completed", "tag": "b5482a58-669d-4814-9cde-e98d0998e7fe"}]} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:51:38.947394 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-b9157ef8-72f9-4fe4-976f-55cb93489614 req-346fd609-889f-4d76-af24-62dde86c0cce service nova] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:38.947983 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-b9157ef8-72f9-4fe4-976f-55cb93489614 req-346fd609-889f-4d76-af24-62dde86c0cce service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:38.948925 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-b9157ef8-72f9-4fe4-976f-55cb93489614 req-346fd609-889f-4d76-af24-62dde86c0cce service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:38.962835 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.compute.server_external_events [req-b9157ef8-72f9-4fe4-976f-55cb93489614 req-346fd609-889f-4d76-af24-62dde86c0cce service nova] Creating event network-vif-plugged:b5482a58-669d-4814-9cde-e98d0998e7fe for instance 4db20dd7-9c34-41ea-a53f-e61c197ca66c on n-h2-852296-2 Aug 10 17:51:38.974376 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [req-b9157ef8-72f9-4fe4-976f-55cb93489614 req-346fd609-889f-4d76-af24-62dde86c0cce service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051142 Aug 10 17:51:38.975622 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 297/601] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 10 17:51:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:51:39.275482 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-72715a23-559c-4377-a0fc-5da2568a76b5 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:39.286009 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-72715a23-559c-4377-a0fc-5da2568a76b5 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] [instance: 37934416-f4a8-4fee-8f7f-53c9df0f6c72] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:51:39.298908 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-72715a23-559c-4377-a0fc-5da2568a76b5 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:39.299484 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-72715a23-559c-4377-a0fc-5da2568a76b5 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:39.299985 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-72715a23-559c-4377-a0fc-5da2568a76b5 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:39.300775 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-72715a23-559c-4377-a0fc-5da2568a76b5 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:39.301542 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-72715a23-559c-4377-a0fc-5da2568a76b5 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:39.302156 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-72715a23-559c-4377-a0fc-5da2568a76b5 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:39.569034 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-f530f9a3-1877-473a-b81e-33553bf55405 tempest-SecurityGroupsTestAdminJSON-2116476668 tempest-SecurityGroupsTestAdminJSON-2116476668-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/b4166fdb-1b3b-4e85-80f6-91556948e29b" status: 202 len: 0 microversion: 2.1 time: 0.826978 Aug 10 17:51:39.575164 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 305/602] 10.222.0.50 () {58 vars in 1272 bytes} [Wed Aug 10 17:51:38 2022] DELETE /compute/v2.1/os-security-groups/b4166fdb-1b3b-4e85-80f6-91556948e29b => generated 0 bytes in 835 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 17:51:39.619821 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-a0c0bebb-e478-428e-8359-40b779146974 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:39.620713 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-a0c0bebb-e478-428e-8359-40b779146974 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: 6c7e2e8c-4638-4952-9474-acc6ef457abc] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:51:39.649767 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a0c0bebb-e478-428e-8359-40b779146974 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:39.652790 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a0c0bebb-e478-428e-8359-40b779146974 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:39.653238 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a0c0bebb-e478-428e-8359-40b779146974 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:39.653962 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a0c0bebb-e478-428e-8359-40b779146974 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:39.654420 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a0c0bebb-e478-428e-8359-40b779146974 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:39.654839 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a0c0bebb-e478-428e-8359-40b779146974 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:39.715229 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-72715a23-559c-4377-a0fc-5da2568a76b5 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e109c3dcd0574faaa3d7ec31dd4edd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48bbb92998f54ebeb624bc794d406896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:51:39.730802 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-72715a23-559c-4377-a0fc-5da2568a76b5 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] 10.222.0.50 "GET /compute/v2.1/servers/37934416-f4a8-4fee-8f7f-53c9df0f6c72" status: 200 len: 1313 microversion: 2.1 time: 0.465322 Aug 10 17:51:39.748709 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 298/603] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:51:39 2022] GET /compute/v2.1/servers/37934416-f4a8-4fee-8f7f-53c9df0f6c72 => generated 1313 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:51:39.828385 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-99fef26b-ce7c-48db-8e2f-9c5bd5081a42 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:39.828934 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-99fef26b-ce7c-48db-8e2f-9c5bd5081a42 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] [instance: 4db20dd7-9c34-41ea-a53f-e61c197ca66c] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:51:39.838708 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-99fef26b-ce7c-48db-8e2f-9c5bd5081a42 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:39.839204 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-99fef26b-ce7c-48db-8e2f-9c5bd5081a42 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:39.841285 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-99fef26b-ce7c-48db-8e2f-9c5bd5081a42 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:39.842275 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-99fef26b-ce7c-48db-8e2f-9c5bd5081a42 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:39.842742 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-99fef26b-ce7c-48db-8e2f-9c5bd5081a42 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:39.843230 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-99fef26b-ce7c-48db-8e2f-9c5bd5081a42 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:40.059428 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-99fef26b-ce7c-48db-8e2f-9c5bd5081a42 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2fd6acf18d4218ad143ccee2d0bb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7c2481a908406fa9c4562513fff665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:51:40.071082 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-99fef26b-ce7c-48db-8e2f-9c5bd5081a42 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] 10.222.0.50 "GET /compute/v2.1/servers/4db20dd7-9c34-41ea-a53f-e61c197ca66c" status: 200 len: 1314 microversion: 2.1 time: 0.246622 Aug 10 17:51:40.073363 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 299/604] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:51:39 2022] GET /compute/v2.1/servers/4db20dd7-9c34-41ea-a53f-e61c197ca66c => generated 1314 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:51:40.347979 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-a0c0bebb-e478-428e-8359-40b779146974 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:51:40.380950 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-a0c0bebb-e478-428e-8359-40b779146974 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/6c7e2e8c-4638-4952-9474-acc6ef457abc" status: 200 len: 1318 microversion: 2.1 time: 0.773661 Aug 10 17:51:40.389177 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 306/605] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:51:39 2022] GET /compute/v2.1/servers/6c7e2e8c-4638-4952-9474-acc6ef457abc => generated 1318 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:51:40.758858 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-dc70193f-a9a5-4236-9177-393206a511bc tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:40.759959 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-dc70193f-a9a5-4236-9177-393206a511bc tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] [instance: 37934416-f4a8-4fee-8f7f-53c9df0f6c72] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:51:40.771326 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-dc70193f-a9a5-4236-9177-393206a511bc tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:40.774696 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-dc70193f-a9a5-4236-9177-393206a511bc tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:40.776595 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-dc70193f-a9a5-4236-9177-393206a511bc tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:40.781879 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-dc70193f-a9a5-4236-9177-393206a511bc tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:40.784052 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-dc70193f-a9a5-4236-9177-393206a511bc tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:40.784702 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-dc70193f-a9a5-4236-9177-393206a511bc tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:40.993794 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [req-b17cf122-68ec-4c86-8c5f-48e66332826a req-21bafad2-9482-4e23-8ef5-c99b95b84b65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bee3148a-3834-41bd-99e7-b5da75217256", "name": "network-vif-plugged", "status": "completed", "tag": "2f16a409-b711-4b31-9eb5-9884dbbe9489"}]} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:51:41.015700 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-b17cf122-68ec-4c86-8c5f-48e66332826a req-21bafad2-9482-4e23-8ef5-c99b95b84b65 service nova] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:41.015700 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-b17cf122-68ec-4c86-8c5f-48e66332826a req-21bafad2-9482-4e23-8ef5-c99b95b84b65 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:41.015700 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-b17cf122-68ec-4c86-8c5f-48e66332826a req-21bafad2-9482-4e23-8ef5-c99b95b84b65 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:41.024574 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.compute.server_external_events [req-b17cf122-68ec-4c86-8c5f-48e66332826a req-21bafad2-9482-4e23-8ef5-c99b95b84b65 service nova] Creating event network-vif-plugged:2f16a409-b711-4b31-9eb5-9884dbbe9489 for instance bee3148a-3834-41bd-99e7-b5da75217256 on n-h2-852296-2 Aug 10 17:51:41.030203 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [req-b17cf122-68ec-4c86-8c5f-48e66332826a req-21bafad2-9482-4e23-8ef5-c99b95b84b65 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040433 Aug 10 17:51:41.031392 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 307/606] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 10 17:51:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:51:41.099503 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-5a3fd29f-f572-4178-96c5-726e9d26a7f8 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:41.100676 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-5a3fd29f-f572-4178-96c5-726e9d26a7f8 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] [instance: 4db20dd7-9c34-41ea-a53f-e61c197ca66c] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:51:41.109527 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-5a3fd29f-f572-4178-96c5-726e9d26a7f8 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:41.110236 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-5a3fd29f-f572-4178-96c5-726e9d26a7f8 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:41.111678 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-5a3fd29f-f572-4178-96c5-726e9d26a7f8 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:41.114172 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-5a3fd29f-f572-4178-96c5-726e9d26a7f8 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:41.114925 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-5a3fd29f-f572-4178-96c5-726e9d26a7f8 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:41.115670 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-5a3fd29f-f572-4178-96c5-726e9d26a7f8 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:41.471951 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-5a3fd29f-f572-4178-96c5-726e9d26a7f8 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2fd6acf18d4218ad143ccee2d0bb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7c2481a908406fa9c4562513fff665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:51:41.489548 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-5a3fd29f-f572-4178-96c5-726e9d26a7f8 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] 10.222.0.50 "GET /compute/v2.1/servers/4db20dd7-9c34-41ea-a53f-e61c197ca66c" status: 200 len: 1464 microversion: 2.1 time: 0.395421 Aug 10 17:51:41.490576 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 308/607] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:51:41 2022] GET /compute/v2.1/servers/4db20dd7-9c34-41ea-a53f-e61c197ca66c => generated 1464 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:51:41.513415 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-44d15172-7d5e-4364-aae7-a5a3baa86080 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:41.514109 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-44d15172-7d5e-4364-aae7-a5a3baa86080 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: 6c7e2e8c-4638-4952-9474-acc6ef457abc] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:51:41.521406 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-44d15172-7d5e-4364-aae7-a5a3baa86080 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:41.522507 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-44d15172-7d5e-4364-aae7-a5a3baa86080 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:41.523139 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-44d15172-7d5e-4364-aae7-a5a3baa86080 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:41.526894 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-44d15172-7d5e-4364-aae7-a5a3baa86080 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:41.526894 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-44d15172-7d5e-4364-aae7-a5a3baa86080 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:41.526894 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-44d15172-7d5e-4364-aae7-a5a3baa86080 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:41.534916 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-dc70193f-a9a5-4236-9177-393206a511bc tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e109c3dcd0574faaa3d7ec31dd4edd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48bbb92998f54ebeb624bc794d406896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:51:41.545828 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-dc70193f-a9a5-4236-9177-393206a511bc tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] 10.222.0.50 "GET /compute/v2.1/servers/37934416-f4a8-4fee-8f7f-53c9df0f6c72" status: 200 len: 1313 microversion: 2.1 time: 0.792466 Aug 10 17:51:41.546716 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 300/608] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:51:40 2022] GET /compute/v2.1/servers/37934416-f4a8-4fee-8f7f-53c9df0f6c72 => generated 1313 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:51:41.553971 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-9be257b5-6dce-4a35-9c92-1e830b58bbeb tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:41.554487 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-9be257b5-6dce-4a35-9c92-1e830b58bbeb tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] [instance: bee3148a-3834-41bd-99e7-b5da75217256] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:51:41.567016 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-9be257b5-6dce-4a35-9c92-1e830b58bbeb tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:41.571126 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-9be257b5-6dce-4a35-9c92-1e830b58bbeb tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:41.571598 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-9be257b5-6dce-4a35-9c92-1e830b58bbeb tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:41.573577 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-9be257b5-6dce-4a35-9c92-1e830b58bbeb tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:41.575342 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-9be257b5-6dce-4a35-9c92-1e830b58bbeb tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:41.575782 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-9be257b5-6dce-4a35-9c92-1e830b58bbeb tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:41.735653 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-9be257b5-6dce-4a35-9c92-1e830b58bbeb tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2fd6acf18d4218ad143ccee2d0bb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7c2481a908406fa9c4562513fff665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:51:41.736739 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-44d15172-7d5e-4364-aae7-a5a3baa86080 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:51:41.745446 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-9be257b5-6dce-4a35-9c92-1e830b58bbeb tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] 10.222.0.50 "GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256" status: 200 len: 1313 microversion: 2.1 time: 0.197477 Aug 10 17:51:41.746392 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 301/609] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:51:41 2022] GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256 => generated 1313 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:51:41.749670 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-44d15172-7d5e-4364-aae7-a5a3baa86080 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/6c7e2e8c-4638-4952-9474-acc6ef457abc" status: 200 len: 1467 microversion: 2.1 time: 0.257854 Aug 10 17:51:41.752230 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-1cbbc928-2e28-4adc-94ed-5064f1c11735 tempest-LiveMigrationTest-599680963 tempest-LiveMigrationTest-599680963-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-982163532", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "623c412b-148c-4a37-96d8-0a1f84e37887"}], "security_groups": [{"name": "tempest-securitygroup--1402540128"}], "key_name": "tempest-keypair-2040684976", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:51:41.763554 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 309/610] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:51:41 2022] GET /compute/v2.1/servers/6c7e2e8c-4638-4952-9474-acc6ef457abc => generated 1467 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:51:41.784931 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-153b81db-00ac-46fc-8eb4-7758cea8f7e3 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:41.790584 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-153b81db-00ac-46fc-8eb4-7758cea8f7e3 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:51:41.791520 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-153b81db-00ac-46fc-8eb4-7758cea8f7e3 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Searching by: {'reservation_id': 'r-d8lcykr8', 'deleted': False, 'project_id': '0638146d08704b2983761619745290b3'} {{(pid=129410) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 10 17:51:41.798931 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-153b81db-00ac-46fc-8eb4-7758cea8f7e3 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:41.799427 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-153b81db-00ac-46fc-8eb4-7758cea8f7e3 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:41.799910 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-153b81db-00ac-46fc-8eb4-7758cea8f7e3 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:41.801001 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-153b81db-00ac-46fc-8eb4-7758cea8f7e3 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:41.801634 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-153b81db-00ac-46fc-8eb4-7758cea8f7e3 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:41.802226 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-153b81db-00ac-46fc-8eb4-7758cea8f7e3 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:41.925381 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.network.neutron [None req-1cbbc928-2e28-4adc-94ed-5064f1c11735 tempest-LiveMigrationTest-599680963 tempest-LiveMigrationTest-599680963-project] validate_networks() for [('623c412b-148c-4a37-96d8-0a1f84e37887', None, None, None, None, None)] {{(pid=129409) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 17:51:42.005728 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.multi_cell_list [None req-153b81db-00ac-46fc-8eb4-7758cea8f7e3 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=129410) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 10 17:51:42.011440 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_cell1:SELECT=100 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:51:42.094471 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-153b81db-00ac-46fc-8eb4-7758cea8f7e3 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:51:42.102230 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-153b81db-00ac-46fc-8eb4-7758cea8f7e3 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:42.102931 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-153b81db-00ac-46fc-8eb4-7758cea8f7e3 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:42.103513 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-153b81db-00ac-46fc-8eb4-7758cea8f7e3 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:42.258273 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-153b81db-00ac-46fc-8eb4-7758cea8f7e3 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/detail?reservation_id=r-d8lcykr8" status: 200 len: 2928 microversion: 2.1 time: 0.489193 Aug 10 17:51:42.260863 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 310/611] 10.222.0.50 () {58 vars in 1197 bytes} [Wed Aug 10 17:51:41 2022] GET /compute/v2.1/servers/detail?reservation_id=r-d8lcykr8 => generated 2928 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:51:42.280858 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-521ab392-27eb-4cfc-913e-3f57db9ed2c5 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:42.308433 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.compute.server_groups [None req-521ab392-27eb-4cfc-913e-3f57db9ed2c5 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Querying cell eb80cdf1-5ac7-4611-abc6-59802fe86dfd(cell1) for 2 instances {{(pid=129410) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 10 17:51:42.309466 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-521ab392-27eb-4cfc-913e-3f57db9ed2c5 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:42.309973 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-521ab392-27eb-4cfc-913e-3f57db9ed2c5 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:42.310401 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-521ab392-27eb-4cfc-913e-3f57db9ed2c5 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:42.347850 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-521ab392-27eb-4cfc-913e-3f57db9ed2c5 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/os-server-groups/206e4d1a-3cdd-468f-8feb-a78dff8ee33c" status: 200 len: 265 microversion: 2.1 time: 0.070858 Aug 10 17:51:42.354427 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 311/612] 10.222.0.50 () {58 vars in 1263 bytes} [Wed Aug 10 17:51:42 2022] GET /compute/v2.1/os-server-groups/206e4d1a-3cdd-468f-8feb-a78dff8ee33c => generated 265 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:51:42.362179 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-dd80f9ea-6cb9-4b12-a956-71d903a3e4cb tempest-ServersOnMultiNodesTest-116104069 tempest-ServersOnMultiNodesTest-116104069-project-admin] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:42.365923 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-dd80f9ea-6cb9-4b12-a956-71d903a3e4cb tempest-ServersOnMultiNodesTest-116104069 tempest-ServersOnMultiNodesTest-116104069-project-admin] [instance: f174eccc-36df-40a9-9831-0fb5848664ba] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:51:42.373195 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-dd80f9ea-6cb9-4b12-a956-71d903a3e4cb tempest-ServersOnMultiNodesTest-116104069 tempest-ServersOnMultiNodesTest-116104069-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:42.373391 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-dd80f9ea-6cb9-4b12-a956-71d903a3e4cb tempest-ServersOnMultiNodesTest-116104069 tempest-ServersOnMultiNodesTest-116104069-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:42.373942 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-dd80f9ea-6cb9-4b12-a956-71d903a3e4cb tempest-ServersOnMultiNodesTest-116104069 tempest-ServersOnMultiNodesTest-116104069-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:42.374823 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-dd80f9ea-6cb9-4b12-a956-71d903a3e4cb tempest-ServersOnMultiNodesTest-116104069 tempest-ServersOnMultiNodesTest-116104069-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:42.375439 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-dd80f9ea-6cb9-4b12-a956-71d903a3e4cb tempest-ServersOnMultiNodesTest-116104069 tempest-ServersOnMultiNodesTest-116104069-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:42.377106 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-dd80f9ea-6cb9-4b12-a956-71d903a3e4cb tempest-ServersOnMultiNodesTest-116104069 tempest-ServersOnMultiNodesTest-116104069-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:42.567071 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-dd80f9ea-6cb9-4b12-a956-71d903a3e4cb tempest-ServersOnMultiNodesTest-116104069 tempest-ServersOnMultiNodesTest-116104069-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/f174eccc-36df-40a9-9831-0fb5848664ba" status: 200 len: 1619 microversion: 2.1 time: 0.210090 Aug 10 17:51:42.567875 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 312/613] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:51:42 2022] GET /compute/v2.1/servers/f174eccc-36df-40a9-9831-0fb5848664ba => generated 1619 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:51:42.577137 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-337e16e3-e20c-4f66-85fc-39980b40581d tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:42.586750 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-337e16e3-e20c-4f66-85fc-39980b40581d tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] [instance: 37934416-f4a8-4fee-8f7f-53c9df0f6c72] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:51:42.586750 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-337e16e3-e20c-4f66-85fc-39980b40581d tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:42.586750 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-337e16e3-e20c-4f66-85fc-39980b40581d tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:42.586750 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-337e16e3-e20c-4f66-85fc-39980b40581d tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:42.586750 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-337e16e3-e20c-4f66-85fc-39980b40581d tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:42.587789 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-337e16e3-e20c-4f66-85fc-39980b40581d tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:42.587789 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-337e16e3-e20c-4f66-85fc-39980b40581d tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:42.754549 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [None req-1cbbc928-2e28-4adc-94ed-5064f1c11735 tempest-LiveMigrationTest-599680963 tempest-LiveMigrationTest-599680963-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-4c329834-1621-4ec2-910e-4d5805165841) Aug 10 17:51:42.754549 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:51:42.754549 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:51:42.754549 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:51:42.754549 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:51:42.754549 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:51:42.754549 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:51:42.754549 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:51:42.754549 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:51:42.754549 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:51:42.754549 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 17:51:42.754549 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 17:51:42.754549 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 17:51:42.754549 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 17:51:42.754549 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 17:51:42.754549 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 17:51:42.754549 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 17:51:42.754549 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 17:51:42.754549 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 17:51:42.754549 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 17:51:42.754549 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 17:51:42.754549 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 17:51:42.754549 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 17:51:42.754549 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 17:51:42.754549 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 17:51:42.754549 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 17:51:42.754549 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 17:51:42.754549 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:51:42.754549 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:51:42.754549 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 17:51:42.754549 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 17:51:42.754549 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:51:42.754549 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:51:42.754549 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:51:42.754549 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:51:42.754549 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:51:42.754549 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:51:42.754549 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:51:42.754549 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:51:42.754549 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:51:42.754549 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:51:42.754549 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 17:51:42.754549 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 17:51:42.754549 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 17:51:42.754549 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 17:51:42.754549 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 17:51:42.754549 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 17:51:42.754549 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 17:51:42.754549 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 17:51:42.754549 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 17:51:42.754549 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 17:51:42.754549 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 17:51:42.754549 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 17:51:42.758807 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 17:51:42.758807 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 17:51:42.758807 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 17:51:42.758807 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 17:51:42.758807 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 17:51:42.758807 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 17:51:42.758807 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 17:51:42.758807 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 17:51:42.758807 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 17:51:42.758807 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 17:51:42.758807 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 17:51:42.758807 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 17:51:42.758807 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 17:51:42.758807 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 17:51:42.758807 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-4c329834-1621-4ec2-910e-4d5805165841) Aug 10 17:51:42.758807 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:51:42.758807 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-1cbbc928-2e28-4adc-94ed-5064f1c11735 tempest-LiveMigrationTest-599680963 tempest-LiveMigrationTest-599680963-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:51:42.758807 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:51:42.758807 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-1cbbc928-2e28-4adc-94ed-5064f1c11735 tempest-LiveMigrationTest-599680963 tempest-LiveMigrationTest-599680963-project] Request method failure captured: Aug 10 17:51:42.758807 n-d-852296-2 devstack@n-api.service[129409]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 17:51:42.758807 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 17:51:42.758807 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 17:51:42.758807 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 17:51:42.758807 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 457 Aug 10 17:51:42.758807 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 17:51:42.758807 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 17:51:42.758807 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 17:51:42.758807 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 17:51:42.758807 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8_AO3YZ0wNOhHSEtDBEZBVvtYn7m6Qn_F_DYGySZEUrfUaziWiB7goSICh-3pRLhBRcEAIanjg5W_oTgET_b2RlFYHQdLGmCYcb8a6bIZVqdupYVhdSkNWUTJ-LpZ5JXV49BiMsKoTfQpe-UPgKB-l6zUjTDW3HDMYqVsazAtUHA70M Aug 10 17:51:42.758807 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 17:51:42.758807 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 17:51:42.758807 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 17:51:42.758807 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 17:51:42.758807 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 17:51:42.758807 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 17:51:42.758807 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: c330e5bdaec74dbca34fe733a9d9d2f7 Aug 10 17:51:42.758807 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-LiveMigrationTest-599680963 Aug 10 17:51:42.758807 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 17:51:42.758807 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 17:51:42.758807 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c330e5bdaec74dbca34fe733a9d9d2f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c330e5bdaec74dbca34fe733a9d9d2f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c330e5bdaec74dbca34fe733a9d9d2f7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c330e5bdaec74dbca34fe733a9d9d2f7", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:51:42.758807 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-LiveMigrationTest-599680963 Aug 10 17:51:42.758807 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: c330e5bdaec74dbca34fe733a9d9d2f7 Aug 10 17:51:42.758807 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-LiveMigrationTest-599680963 Aug 10 17:51:42.758807 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-LiveMigrationTest-599680963-project Aug 10 17:51:42.758807 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 17:51:42.758807 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 17:51:42.758807 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: f3bca1f64dd44e6bb6e1427d5e28075f Aug 10 17:51:42.758807 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-LiveMigrationTest-599680963-project Aug 10 17:51:42.758807 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:51:42.758807 n-d-852296-2 devstack@n-api.service[129409]: {"server": {"name": "tempest-LiveMigrationTest-server-982163532", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "623c412b-148c-4a37-96d8-0a1f84e37887"}], "security_groups": [{"name": "tempest-securitygroup--1402540128"}], "key_name": "tempest-keypair-2040684976", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} Aug 10 17:51:42.758807 n-d-852296-2 devstack@n-api.service[129409]: method: > Aug 10 17:51:42.758807 n-d-852296-2 devstack@n-api.service[129409]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:51:42.758807 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:51:42.762726 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'body': {'server': {'name': 'tempest-LiveMigrationTest-server-982163532', 'imageRef': 'a735ff26-463a-4ffe-a981-ab9d9baa494f', 'flavorRef': '452', 'networks': [{'uuid': '623c412b-148c-4a37-96d8-0a1f84e37887'}], 'security_groups': [{'name': 'tempest-securitygroup--1402540128'}], 'key_name': 'tempest-keypair-2040684976', 'user_data': 'IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo='}}} Aug 10 17:51:42.762726 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:51:42.762726 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:51:42.762726 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:51:42.762726 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:51:42.762726 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:51:42.762726 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:51:42.762726 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:51:42.762726 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:51:42.762726 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:51:42.762726 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:51:42.762726 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 17:51:42.762726 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 17:51:42.762726 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 17:51:42.762726 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 17:51:42.762726 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 17:51:42.762726 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 17:51:42.762726 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 17:51:42.762726 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 17:51:42.762726 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 17:51:42.762726 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 17:51:42.762726 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 17:51:42.762726 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 17:51:42.762726 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 17:51:42.762726 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 17:51:42.762726 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 17:51:42.762726 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 17:51:42.762726 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 17:51:42.762726 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:51:42.762726 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:51:42.762726 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 17:51:42.762726 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 17:51:42.762726 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:51:42.762726 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:51:42.762726 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:51:42.762726 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:51:42.762726 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:51:42.762726 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:51:42.762726 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:51:42.762726 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:51:42.762726 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:51:42.762726 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:51:42.762726 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 17:51:42.762726 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 17:51:42.762726 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 17:51:42.762726 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 17:51:42.762726 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 17:51:42.762726 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 17:51:42.762726 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 17:51:42.762726 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 17:51:42.762726 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 17:51:42.762726 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 17:51:42.762726 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 17:51:42.769975 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 17:51:42.769975 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 17:51:42.769975 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 17:51:42.769975 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 17:51:42.769975 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 17:51:42.769975 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 17:51:42.769975 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 17:51:42.769975 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 17:51:42.769975 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 17:51:42.769975 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 17:51:42.769975 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 17:51:42.769975 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 17:51:42.769975 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 17:51:42.769975 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 17:51:42.769975 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 17:51:42.769975 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-4c329834-1621-4ec2-910e-4d5805165841) Aug 10 17:51:42.769975 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:51:42.769975 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:51:42.769975 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:51:42.769975 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:51:42.769975 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:51:42.769975 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:51:42.769975 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:51:42.769975 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:51:42.769975 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 10 17:51:42.769975 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 10 17:51:42.769975 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:51:42.769975 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:51:42.769975 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:51:42.769975 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:51:42.769975 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:51:42.769975 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:51:42.769975 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:51:42.769975 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:51:42.769975 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:51:42.769975 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:51:42.769975 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:51:42.769975 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:51:42.769975 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:51:42.769975 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-1cbbc928-2e28-4adc-94ed-5064f1c11735 tempest-LiveMigrationTest-599680963 tempest-LiveMigrationTest-599680963-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:51:42.769975 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:51:42.769975 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-1cbbc928-2e28-4adc-94ed-5064f1c11735 tempest-LiveMigrationTest-599680963 tempest-LiveMigrationTest-599680963-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.012159 Aug 10 17:51:42.769975 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 302/614] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 17:51:41 2022] POST /compute/v2.1/servers => generated 214 bytes in 1014 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 10 17:51:42.775525 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-74fecb19-e42d-4a6b-8452-ca7e493fd7ee tempest-ServersOnMultiNodesTest-116104069 tempest-ServersOnMultiNodesTest-116104069-project-admin] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:42.775525 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-74fecb19-e42d-4a6b-8452-ca7e493fd7ee tempest-ServersOnMultiNodesTest-116104069 tempest-ServersOnMultiNodesTest-116104069-project-admin] [instance: 6c7e2e8c-4638-4952-9474-acc6ef457abc] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:51:42.783468 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-74fecb19-e42d-4a6b-8452-ca7e493fd7ee tempest-ServersOnMultiNodesTest-116104069 tempest-ServersOnMultiNodesTest-116104069-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:42.784198 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-74fecb19-e42d-4a6b-8452-ca7e493fd7ee tempest-ServersOnMultiNodesTest-116104069 tempest-ServersOnMultiNodesTest-116104069-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:42.784755 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-74fecb19-e42d-4a6b-8452-ca7e493fd7ee tempest-ServersOnMultiNodesTest-116104069 tempest-ServersOnMultiNodesTest-116104069-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:42.785475 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-74fecb19-e42d-4a6b-8452-ca7e493fd7ee tempest-ServersOnMultiNodesTest-116104069 tempest-ServersOnMultiNodesTest-116104069-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:42.800886 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-74fecb19-e42d-4a6b-8452-ca7e493fd7ee tempest-ServersOnMultiNodesTest-116104069 tempest-ServersOnMultiNodesTest-116104069-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:42.801328 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-74fecb19-e42d-4a6b-8452-ca7e493fd7ee tempest-ServersOnMultiNodesTest-116104069 tempest-ServersOnMultiNodesTest-116104069-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:42.813240 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-337e16e3-e20c-4f66-85fc-39980b40581d tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e109c3dcd0574faaa3d7ec31dd4edd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48bbb92998f54ebeb624bc794d406896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:51:42.829298 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-337e16e3-e20c-4f66-85fc-39980b40581d tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] 10.222.0.50 "GET /compute/v2.1/servers/37934416-f4a8-4fee-8f7f-53c9df0f6c72" status: 200 len: 1313 microversion: 2.1 time: 0.259876 Aug 10 17:51:42.841511 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 313/615] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:51:42 2022] GET /compute/v2.1/servers/37934416-f4a8-4fee-8f7f-53c9df0f6c72 => generated 1313 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:51:42.844176 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-075fba0f-620e-46f7-874b-4205ae00b14b tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:42.845086 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-075fba0f-620e-46f7-874b-4205ae00b14b tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] [instance: bee3148a-3834-41bd-99e7-b5da75217256] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:51:42.852374 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-075fba0f-620e-46f7-874b-4205ae00b14b tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:42.852934 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-075fba0f-620e-46f7-874b-4205ae00b14b tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:42.853439 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-075fba0f-620e-46f7-874b-4205ae00b14b tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:42.854248 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-075fba0f-620e-46f7-874b-4205ae00b14b tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:42.854765 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-075fba0f-620e-46f7-874b-4205ae00b14b tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:42.855374 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-075fba0f-620e-46f7-874b-4205ae00b14b tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:42.981344 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-74fecb19-e42d-4a6b-8452-ca7e493fd7ee tempest-ServersOnMultiNodesTest-116104069 tempest-ServersOnMultiNodesTest-116104069-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/6c7e2e8c-4638-4952-9474-acc6ef457abc" status: 200 len: 1618 microversion: 2.1 time: 0.217927 Aug 10 17:51:42.981789 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 303/616] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:51:42 2022] GET /compute/v2.1/servers/6c7e2e8c-4638-4952-9474-acc6ef457abc => generated 1618 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:51:43.006131 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-be404b12-c7f0-42aa-bb18-9e5530f2f84d tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Action: 'create', calling method: .version_select at 0x7fb3465a1a60>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-645652162", "policies": ["anti-affinity"]}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:51:43.024488 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-be404b12-c7f0-42aa-bb18-9e5530f2f84d tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Getting quotas for project 0638146d08704b2983761619745290b3. Resources: {'server_groups'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:51:43.029606 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-be404b12-c7f0-42aa-bb18-9e5530f2f84d tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Getting quotas for user f76b870a54454956b3926c34f9f27442 and project 0638146d08704b2983761619745290b3. Resources: {'server_groups'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:51:43.040117 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-075fba0f-620e-46f7-874b-4205ae00b14b tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2fd6acf18d4218ad143ccee2d0bb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7c2481a908406fa9c4562513fff665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:51:43.045212 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-075fba0f-620e-46f7-874b-4205ae00b14b tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] 10.222.0.50 "GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256" status: 200 len: 1313 microversion: 2.1 time: 0.207021 Aug 10 17:51:43.045782 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 314/617] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:51:42 2022] GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256 => generated 1313 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:51:43.051043 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [req-85fc20ea-fbdd-40d6-9c00-169920e381db req-ce87db11-abec-4a9e-96ee-2a0858e90296 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37934416-f4a8-4fee-8f7f-53c9df0f6c72", "name": "network-vif-plugged", "status": "completed", "tag": "3cbaf3c0-cf29-4559-9947-0b6b1c26bf4b"}]} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:51:43.076744 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-85fc20ea-fbdd-40d6-9c00-169920e381db req-ce87db11-abec-4a9e-96ee-2a0858e90296 service nova] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:43.077455 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-85fc20ea-fbdd-40d6-9c00-169920e381db req-ce87db11-abec-4a9e-96ee-2a0858e90296 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:43.078196 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-85fc20ea-fbdd-40d6-9c00-169920e381db req-ce87db11-abec-4a9e-96ee-2a0858e90296 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:43.090997 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.compute.server_external_events [req-85fc20ea-fbdd-40d6-9c00-169920e381db req-ce87db11-abec-4a9e-96ee-2a0858e90296 service nova] Creating event network-vif-plugged:3cbaf3c0-cf29-4559-9947-0b6b1c26bf4b for instance 37934416-f4a8-4fee-8f7f-53c9df0f6c72 on n-h1-852296-2 Aug 10 17:51:43.097321 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [req-85fc20ea-fbdd-40d6-9c00-169920e381db req-ce87db11-abec-4a9e-96ee-2a0858e90296 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049660 Aug 10 17:51:43.102592 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 315/618] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 10 17:51:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:51:43.189717 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-be404b12-c7f0-42aa-bb18-9e5530f2f84d tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Getting quotas for project 0638146d08704b2983761619745290b3. Resources: {'server_groups'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:51:43.199084 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-be404b12-c7f0-42aa-bb18-9e5530f2f84d tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Getting quotas for user f76b870a54454956b3926c34f9f27442 and project 0638146d08704b2983761619745290b3. Resources: {'server_groups'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:51:43.222355 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-be404b12-c7f0-42aa-bb18-9e5530f2f84d tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "POST /compute/v2.1/os-server-groups" status: 200 len: 192 microversion: 2.1 time: 0.220748 Aug 10 17:51:43.223146 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 304/619] 10.222.0.50 () {60 vars in 1174 bytes} [Wed Aug 10 17:51:43 2022] POST /compute/v2.1/os-server-groups => generated 192 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:51:43.602921 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-044835eb-fc82-43b3-a5a8-bd333312766f tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1534579132", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "d19eb39d-b249-4bed-928d-da2a8027d1dc"}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:51:43.659798 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.network.neutron [None req-044835eb-fc82-43b3-a5a8-bd333312766f tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] validate_networks() for None {{(pid=129410) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 17:51:43.863416 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-b15e9135-ef48-4de5-be7b-7f656c80d292 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:43.864038 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-b15e9135-ef48-4de5-be7b-7f656c80d292 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] [instance: 37934416-f4a8-4fee-8f7f-53c9df0f6c72] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:51:43.872209 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-b15e9135-ef48-4de5-be7b-7f656c80d292 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:43.878567 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-b15e9135-ef48-4de5-be7b-7f656c80d292 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:43.882618 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-b15e9135-ef48-4de5-be7b-7f656c80d292 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:43.883687 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-b15e9135-ef48-4de5-be7b-7f656c80d292 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:43.884356 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-b15e9135-ef48-4de5-be7b-7f656c80d292 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:43.885074 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-b15e9135-ef48-4de5-be7b-7f656c80d292 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:43.927164 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.virt.hardware [None req-044835eb-fc82-43b3-a5a8-bd333312766f tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Flavor limits 0:0:0 {{(pid=129410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 17:51:43.927577 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.virt.hardware [None req-044835eb-fc82-43b3-a5a8-bd333312766f tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Image limits 0:0:0 {{(pid=129410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 17:51:43.928203 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.virt.hardware [None req-044835eb-fc82-43b3-a5a8-bd333312766f tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Flavor pref 0:0:0 {{(pid=129410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 17:51:43.928924 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.virt.hardware [None req-044835eb-fc82-43b3-a5a8-bd333312766f tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Image pref 0:0:0 {{(pid=129410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 17:51:43.929340 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.virt.hardware [None req-044835eb-fc82-43b3-a5a8-bd333312766f tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 17:51:43.945957 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-044835eb-fc82-43b3-a5a8-bd333312766f tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:43.946626 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-044835eb-fc82-43b3-a5a8-bd333312766f tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:43.955615 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-044835eb-fc82-43b3-a5a8-bd333312766f tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:43.961437 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-044835eb-fc82-43b3-a5a8-bd333312766f tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:43.961437 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-044835eb-fc82-43b3-a5a8-bd333312766f tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:43.961437 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-044835eb-fc82-43b3-a5a8-bd333312766f tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:43.976943 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.quota [None req-044835eb-fc82-43b3-a5a8-bd333312766f tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Getting quotas for project 0638146d08704b2983761619745290b3. Resources: {'instances', 'ram', 'cores'} {{(pid=129410) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:51:43.982056 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.quota [None req-044835eb-fc82-43b3-a5a8-bd333312766f tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Getting quotas for user f76b870a54454956b3926c34f9f27442 and project 0638146d08704b2983761619745290b3. Resources: {'instances', 'ram', 'cores'} {{(pid=129410) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:51:43.994507 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-044835eb-fc82-43b3-a5a8-bd333312766f tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Going to run 2 instances... {{(pid=129410) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 17:51:43.999857 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-044835eb-fc82-43b3-a5a8-bd333312766f tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: 0d821054-dce7-4015-8eaa-d8c56e7c3cd3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a735ff26-463a-4ffe-a981-ab9d9baa494f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129410) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 17:51:44.041317 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-b15e9135-ef48-4de5-be7b-7f656c80d292 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e109c3dcd0574faaa3d7ec31dd4edd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48bbb92998f54ebeb624bc794d406896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:51:44.049519 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-b15e9135-ef48-4de5-be7b-7f656c80d292 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] 10.222.0.50 "GET /compute/v2.1/servers/37934416-f4a8-4fee-8f7f-53c9df0f6c72" status: 200 len: 1313 microversion: 2.1 time: 0.191400 Aug 10 17:51:44.050149 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 305/620] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:51:43 2022] GET /compute/v2.1/servers/37934416-f4a8-4fee-8f7f-53c9df0f6c72 => generated 1313 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:51:44.069076 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-ee7fb9b4-38c6-4f04-b378-ba8c8c019e20 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:44.069711 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-ee7fb9b4-38c6-4f04-b378-ba8c8c019e20 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] [instance: bee3148a-3834-41bd-99e7-b5da75217256] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:51:44.075840 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-ee7fb9b4-38c6-4f04-b378-ba8c8c019e20 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:44.076369 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-ee7fb9b4-38c6-4f04-b378-ba8c8c019e20 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:44.076810 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-ee7fb9b4-38c6-4f04-b378-ba8c8c019e20 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:44.077537 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-ee7fb9b4-38c6-4f04-b378-ba8c8c019e20 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:44.077998 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-ee7fb9b4-38c6-4f04-b378-ba8c8c019e20 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:44.078543 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-ee7fb9b4-38c6-4f04-b378-ba8c8c019e20 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:44.179899 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.quota [None req-044835eb-fc82-43b3-a5a8-bd333312766f tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=129410) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Aug 10 17:51:44.201951 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.quota [None req-044835eb-fc82-43b3-a5a8-bd333312766f tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Getting quotas for project 0638146d08704b2983761619745290b3. Resources: {'server_group_members'} {{(pid=129410) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:51:44.210637 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.quota [None req-044835eb-fc82-43b3-a5a8-bd333312766f tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Getting quotas for user f76b870a54454956b3926c34f9f27442 and project 0638146d08704b2983761619745290b3. Resources: {'server_group_members'} {{(pid=129410) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:51:44.259722 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-ee7fb9b4-38c6-4f04-b378-ba8c8c019e20 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2fd6acf18d4218ad143ccee2d0bb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7c2481a908406fa9c4562513fff665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:51:44.265165 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_cell1:SELECT=100 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:51:44.268815 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-ee7fb9b4-38c6-4f04-b378-ba8c8c019e20 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] 10.222.0.50 "GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256" status: 200 len: 1462 microversion: 2.1 time: 0.203497 Aug 10 17:51:44.269411 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 306/621] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:51:44 2022] GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256 => generated 1462 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:51:44.558369 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.quota [None req-044835eb-fc82-43b3-a5a8-bd333312766f tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Getting quotas for project 0638146d08704b2983761619745290b3. Resources: {'server_group_members'} {{(pid=129410) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:51:44.564528 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.quota [None req-044835eb-fc82-43b3-a5a8-bd333312766f tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Getting quotas for user f76b870a54454956b3926c34f9f27442 and project 0638146d08704b2983761619745290b3. Resources: {'server_group_members'} {{(pid=129410) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:51:44.581224 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-044835eb-fc82-43b3-a5a8-bd333312766f tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: 83268d7f-5375-4b01-9b5c-519be7daf0a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a735ff26-463a-4ffe-a981-ab9d9baa494f',instance=,instance_uuid=0d821054-dce7-4015-8eaa-d8c56e7c3cd3,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129410) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 17:51:44.639833 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-28b34cfe-380c-49d6-b1b8-f504dc20bb0c tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-921058176", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "bee3148a-3834-41bd-99e7-b5da75217256"}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:51:44.711659 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.network.neutron [None req-28b34cfe-380c-49d6-b1b8-f504dc20bb0c tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] validate_networks() for None {{(pid=129409) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 17:51:44.763311 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_cell0:SELECT=7 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:51:44.767366 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.quota [None req-044835eb-fc82-43b3-a5a8-bd333312766f tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Getting quotas for project 0638146d08704b2983761619745290b3. Resources: {'server_group_members'} {{(pid=129410) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:51:44.778127 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:51:44.784764 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.quota [None req-044835eb-fc82-43b3-a5a8-bd333312766f tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Getting quotas for user f76b870a54454956b3926c34f9f27442 and project 0638146d08704b2983761619745290b3. Resources: {'server_group_members'} {{(pid=129410) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:51:44.921567 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.quota [None req-044835eb-fc82-43b3-a5a8-bd333312766f tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Getting quotas for project 0638146d08704b2983761619745290b3. Resources: {'server_group_members'} {{(pid=129410) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:51:44.934644 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.quota [None req-044835eb-fc82-43b3-a5a8-bd333312766f tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Getting quotas for user f76b870a54454956b3926c34f9f27442 and project 0638146d08704b2983761619745290b3. Resources: {'server_group_members'} {{(pid=129410) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:51:44.981711 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-044835eb-fc82-43b3-a5a8-bd333312766f tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.382118 Aug 10 17:51:45.002158 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 316/622] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 17:51:43 2022] POST /compute/v2.1/servers => generated 32 bytes in 1405 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Aug 10 17:51:45.015876 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-3ee25221-c786-4d57-a843-e33a2ee244e9 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:45.041021 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-3ee25221-c786-4d57-a843-e33a2ee244e9 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:51:45.042536 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-3ee25221-c786-4d57-a843-e33a2ee244e9 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Searching by: {'deleted': False, 'project_id': '0638146d08704b2983761619745290b3'} {{(pid=129410) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 10 17:51:45.107701 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.virt.hardware [None req-28b34cfe-380c-49d6-b1b8-f504dc20bb0c tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Flavor limits 0:0:0 {{(pid=129409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 17:51:45.108160 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.virt.hardware [None req-28b34cfe-380c-49d6-b1b8-f504dc20bb0c tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Image limits 0:0:0 {{(pid=129409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 17:51:45.108615 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.virt.hardware [None req-28b34cfe-380c-49d6-b1b8-f504dc20bb0c tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Flavor pref 0:0:0 {{(pid=129409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 17:51:45.109328 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.virt.hardware [None req-28b34cfe-380c-49d6-b1b8-f504dc20bb0c tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Image pref 0:0:0 {{(pid=129409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 17:51:45.109916 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.virt.hardware [None req-28b34cfe-380c-49d6-b1b8-f504dc20bb0c tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 17:51:45.114653 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-3ee25221-c786-4d57-a843-e33a2ee244e9 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:45.125066 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-3ee25221-c786-4d57-a843-e33a2ee244e9 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:45.125066 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-3ee25221-c786-4d57-a843-e33a2ee244e9 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:45.125066 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-3ee25221-c786-4d57-a843-e33a2ee244e9 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:45.125066 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-3ee25221-c786-4d57-a843-e33a2ee244e9 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:45.125066 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-3ee25221-c786-4d57-a843-e33a2ee244e9 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:45.125924 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-28b34cfe-380c-49d6-b1b8-f504dc20bb0c tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:45.127482 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-28b34cfe-380c-49d6-b1b8-f504dc20bb0c tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:45.128030 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-28b34cfe-380c-49d6-b1b8-f504dc20bb0c tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:45.131198 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-28b34cfe-380c-49d6-b1b8-f504dc20bb0c tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:45.131926 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-28b34cfe-380c-49d6-b1b8-f504dc20bb0c tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:45.132539 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-28b34cfe-380c-49d6-b1b8-f504dc20bb0c tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:45.178661 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-28b34cfe-380c-49d6-b1b8-f504dc20bb0c tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Getting quotas for project 6b7c2481a908406fa9c4562513fff665. Resources: {'instances', 'ram', 'cores'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:51:45.187756 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.multi_cell_list [None req-3ee25221-c786-4d57-a843-e33a2ee244e9 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=129410) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 10 17:51:45.196364 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-28b34cfe-380c-49d6-b1b8-f504dc20bb0c tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Getting quotas for user 1b2fd6acf18d4218ad143ccee2d0bb5b and project 6b7c2481a908406fa9c4562513fff665. Resources: {'instances', 'ram', 'cores'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:51:45.218865 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-28b34cfe-380c-49d6-b1b8-f504dc20bb0c tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Going to run 1 instances... {{(pid=129409) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 17:51:45.223593 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-28b34cfe-380c-49d6-b1b8-f504dc20bb0c tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] [instance: 12eda82b-051e-446c-b78b-6c9c9f6f78d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a735ff26-463a-4ffe-a981-ab9d9baa494f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 17:51:45.279455 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-3ee25221-c786-4d57-a843-e33a2ee244e9 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers" status: 200 len: 1663 microversion: 2.1 time: 0.275723 Aug 10 17:51:45.281723 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 317/623] 10.222.0.50 () {58 vars in 1125 bytes} [Wed Aug 10 17:51:45 2022] GET /compute/v2.1/servers => generated 1663 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:51:45.287194 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-4bd1d861-05b0-4e88-98e3-3e1b06ace574 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:45.288412 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-4bd1d861-05b0-4e88-98e3-3e1b06ace574 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] [instance: 37934416-f4a8-4fee-8f7f-53c9df0f6c72] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:51:45.295500 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-4bd1d861-05b0-4e88-98e3-3e1b06ace574 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:45.296371 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-4bd1d861-05b0-4e88-98e3-3e1b06ace574 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:45.296983 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-4bd1d861-05b0-4e88-98e3-3e1b06ace574 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:45.297849 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-4bd1d861-05b0-4e88-98e3-3e1b06ace574 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:45.298487 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-4bd1d861-05b0-4e88-98e3-3e1b06ace574 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:45.299373 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-4bd1d861-05b0-4e88-98e3-3e1b06ace574 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:45.438451 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-28b34cfe-380c-49d6-b1b8-f504dc20bb0c tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.802639 Aug 10 17:51:45.439992 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 307/624] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 17:51:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 805 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 17:51:45.457034 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-07531110-25d6-4de5-84cf-00465b5e28ef tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:45.458335 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-07531110-25d6-4de5-84cf-00465b5e28ef tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: 83268d7f-5375-4b01-9b5c-519be7daf0a4] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:51:45.540654 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-4bd1d861-05b0-4e88-98e3-3e1b06ace574 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e109c3dcd0574faaa3d7ec31dd4edd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48bbb92998f54ebeb624bc794d406896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:51:45.569671 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-4bd1d861-05b0-4e88-98e3-3e1b06ace574 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] 10.222.0.50 "GET /compute/v2.1/servers/37934416-f4a8-4fee-8f7f-53c9df0f6c72" status: 200 len: 1463 microversion: 2.1 time: 0.283652 Aug 10 17:51:45.580687 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 318/625] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:51:45 2022] GET /compute/v2.1/servers/37934416-f4a8-4fee-8f7f-53c9df0f6c72 => generated 1463 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:51:45.593238 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-bd942e56-f30e-4f81-a7d2-e545554fa2b2 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:45.594881 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-bd942e56-f30e-4f81-a7d2-e545554fa2b2 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] [instance: 12eda82b-051e-446c-b78b-6c9c9f6f78d0] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:51:45.661483 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-07531110-25d6-4de5-84cf-00465b5e28ef tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:51:45.671256 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-07531110-25d6-4de5-84cf-00465b5e28ef tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/83268d7f-5375-4b01-9b5c-519be7daf0a4" status: 200 len: 1219 microversion: 2.1 time: 0.229427 Aug 10 17:51:45.675181 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 308/626] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:51:45 2022] GET /compute/v2.1/servers/83268d7f-5375-4b01-9b5c-519be7daf0a4 => generated 1219 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:51:45.750052 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-bd942e56-f30e-4f81-a7d2-e545554fa2b2 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2fd6acf18d4218ad143ccee2d0bb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7c2481a908406fa9c4562513fff665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:51:45.770093 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-bd942e56-f30e-4f81-a7d2-e545554fa2b2 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] 10.222.0.50 "GET /compute/v2.1/servers/12eda82b-051e-446c-b78b-6c9c9f6f78d0" status: 200 len: 1213 microversion: 2.1 time: 0.187475 Aug 10 17:51:45.785134 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 319/627] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:51:45 2022] GET /compute/v2.1/servers/12eda82b-051e-446c-b78b-6c9c9f6f78d0 => generated 1213 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:51:45.794277 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-4ab9a50d-c28e-4add-8ab3-2f779995ff37 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:51:45.797800 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-4ab9a50d-c28e-4add-8ab3-2f779995ff37 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] [instance: 37934416-f4a8-4fee-8f7f-53c9df0f6c72] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:51:45.806497 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-4ab9a50d-c28e-4add-8ab3-2f779995ff37 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:45.812376 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-4ab9a50d-c28e-4add-8ab3-2f779995ff37 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:45.812376 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-4ab9a50d-c28e-4add-8ab3-2f779995ff37 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:45.812376 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-4ab9a50d-c28e-4add-8ab3-2f779995ff37 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:45.812376 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-4ab9a50d-c28e-4add-8ab3-2f779995ff37 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:45.812376 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-4ab9a50d-c28e-4add-8ab3-2f779995ff37 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:46.247930 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-61d441a7-b6d2-4d25-8b72-c9c232dd762b tempest-AZV2TestJSON-972475451 tempest-AZV2TestJSON-972475451-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:46.255848 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-61d441a7-b6d2-4d25-8b72-c9c232dd762b tempest-AZV2TestJSON-972475451 tempest-AZV2TestJSON-972475451-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:46.255848 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-61d441a7-b6d2-4d25-8b72-c9c232dd762b tempest-AZV2TestJSON-972475451 tempest-AZV2TestJSON-972475451-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:46.255848 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-61d441a7-b6d2-4d25-8b72-c9c232dd762b tempest-AZV2TestJSON-972475451 tempest-AZV2TestJSON-972475451-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:46.255848 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-61d441a7-b6d2-4d25-8b72-c9c232dd762b tempest-AZV2TestJSON-972475451 tempest-AZV2TestJSON-972475451-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:46.255848 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-61d441a7-b6d2-4d25-8b72-c9c232dd762b tempest-AZV2TestJSON-972475451 tempest-AZV2TestJSON-972475451-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:46.255848 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-61d441a7-b6d2-4d25-8b72-c9c232dd762b tempest-AZV2TestJSON-972475451 tempest-AZV2TestJSON-972475451-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:46.287196 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [None req-4ab9a50d-c28e-4add-8ab3-2f779995ff37 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-d23ad037-487e-4a76-a6b0-278b45c25c6e) Aug 10 17:51:46.287196 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:51:46.287196 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:51:46.287196 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:51:46.287196 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:51:46.287196 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:51:46.287196 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 10 17:51:46.287196 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 10 17:51:46.287196 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 10 17:51:46.287196 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 10 17:51:46.287196 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 368, in inner Aug 10 17:51:46.287196 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi if self.network_api.instance_has_extended_resource_request( Aug 10 17:51:46.287196 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1035, in instance_has_extended_resource_request Aug 10 17:51:46.287196 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi if not self.has_extended_resource_request_extension(admin_context): Aug 10 17:51:46.287196 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 17:51:46.287196 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 17:51:46.287196 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 17:51:46.287196 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 17:51:46.287196 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 17:51:46.287196 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 17:51:46.287196 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:51:46.287196 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:51:46.287196 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 17:51:46.287196 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 17:51:46.287196 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:51:46.287196 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:51:46.287196 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:51:46.287196 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:51:46.287196 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:51:46.287196 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:51:46.287196 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:51:46.287196 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:51:46.287196 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:51:46.287196 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:51:46.287196 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 17:51:46.287196 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 17:51:46.287196 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 17:51:46.287196 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 17:51:46.287196 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 17:51:46.287196 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 17:51:46.287196 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 17:51:46.287196 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 17:51:46.287196 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 17:51:46.287196 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 17:51:46.287196 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 17:51:46.287196 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 17:51:46.287196 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 17:51:46.287196 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 17:51:46.287196 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 17:51:46.287196 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 17:51:46.287196 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 17:51:46.291411 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 17:51:46.291411 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 17:51:46.291411 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 17:51:46.291411 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 17:51:46.291411 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 17:51:46.291411 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 17:51:46.291411 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 17:51:46.291411 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 17:51:46.291411 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 17:51:46.291411 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-d23ad037-487e-4a76-a6b0-278b45c25c6e) Aug 10 17:51:46.291411 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:51:46.291411 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-4ab9a50d-c28e-4add-8ab3-2f779995ff37 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:51:46.291411 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 17:51:46.295910 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-4ab9a50d-c28e-4add-8ab3-2f779995ff37 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Request method failure captured: Aug 10 17:51:46.295910 n-d-852296-2 devstack@n-api.service[129410]: request: POST /compute/v2.1/servers/37934416-f4a8-4fee-8f7f-53c9df0f6c72/action HTTP/1.1 Aug 10 17:51:46.295910 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 17:51:46.295910 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 17:51:46.295910 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 17:51:46.295910 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 32 Aug 10 17:51:46.295910 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 17:51:46.295910 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 17:51:46.295910 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 17:51:46.295910 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 17:51:46.295910 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8-_0hr6nliTkkjEq4POLxTS39b7AKRzs5IHoadOFYk-Avq_EhHZhiXBqUGkDcgCWPqhSAgOsv1fUEScaBilJPZ4n8-MqEuqv4LzNqxeh_dhY8n5FOoRyMW4xdBlwKatTDuceji8cWTk46ZLZhXUEi0tZyObBcD9QSkhHyY2UTCtQ3Ok Aug 10 17:51:46.295910 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 17:51:46.295910 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 17:51:46.295910 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 17:51:46.295910 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 17:51:46.295910 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 17:51:46.295910 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 17:51:46.295910 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: 48bbb92998f54ebeb624bc794d406896 Aug 10 17:51:46.295910 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-MigrationsAdminTest-561431726 Aug 10 17:51:46.295910 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 17:51:46.295910 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 17:51:46.295910 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/48bbb92998f54ebeb624bc794d406896"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/48bbb92998f54ebeb624bc794d406896"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/48bbb92998f54ebeb624bc794d406896"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_48bbb92998f54ebeb624bc794d406896", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:51:46.295910 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-MigrationsAdminTest-561431726 Aug 10 17:51:46.295910 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: 48bbb92998f54ebeb624bc794d406896 Aug 10 17:51:46.295910 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-MigrationsAdminTest-561431726 Aug 10 17:51:46.295910 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-MigrationsAdminTest-561431726-project Aug 10 17:51:46.295910 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 17:51:46.295910 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 17:51:46.295910 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: e109c3dcd0574faaa3d7ec31dd4edd24 Aug 10 17:51:46.295910 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-MigrationsAdminTest-561431726-project Aug 10 17:51:46.295910 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 17:51:46.295910 n-d-852296-2 devstack@n-api.service[129410]: {"resize": {"flavorRef": "451"}} Aug 10 17:51:46.295910 n-d-852296-2 devstack@n-api.service[129410]: method: > Aug 10 17:51:46.295910 n-d-852296-2 devstack@n-api.service[129410]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:51:46.295910 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 17:51:46.295910 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'id': '37934416-f4a8-4fee-8f7f-53c9df0f6c72', 'body': {'resize': {'flavorRef': '451'}}} Aug 10 17:51:46.295910 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:51:46.295910 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:51:46.295910 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:51:46.295910 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:51:46.295910 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:51:46.295910 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:51:46.295910 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 10 17:51:46.295910 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 10 17:51:46.295910 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 10 17:51:46.295910 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 10 17:51:46.295910 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 368, in inner Aug 10 17:51:46.295910 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi if self.network_api.instance_has_extended_resource_request( Aug 10 17:51:46.295910 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1035, in instance_has_extended_resource_request Aug 10 17:51:46.295910 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi if not self.has_extended_resource_request_extension(admin_context): Aug 10 17:51:46.295910 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 17:51:46.295910 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 17:51:46.295910 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 17:51:46.295910 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 17:51:46.295910 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 17:51:46.295910 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 17:51:46.295910 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:51:46.295910 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:51:46.295910 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 17:51:46.295910 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 17:51:46.295910 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:51:46.295910 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:51:46.309098 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:51:46.309098 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:51:46.309098 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:51:46.309098 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:51:46.309098 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:51:46.309098 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:51:46.309098 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:51:46.309098 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:51:46.309098 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 17:51:46.309098 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 17:51:46.309098 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 17:51:46.309098 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 17:51:46.309098 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 17:51:46.309098 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 17:51:46.309098 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 17:51:46.309098 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 17:51:46.309098 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 17:51:46.309098 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 17:51:46.309098 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 17:51:46.309098 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 17:51:46.309098 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 17:51:46.309098 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 17:51:46.309098 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 17:51:46.309098 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 17:51:46.309098 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 17:51:46.309098 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 17:51:46.309098 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 17:51:46.309098 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 17:51:46.309098 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 17:51:46.309098 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 17:51:46.309098 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 17:51:46.309098 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 17:51:46.309098 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 17:51:46.309098 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 17:51:46.309098 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-d23ad037-487e-4a76-a6b0-278b45c25c6e) Aug 10 17:51:46.309098 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:51:46.309098 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:51:46.309098 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:51:46.309098 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:51:46.309098 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:51:46.309098 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:51:46.309098 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:51:46.309098 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:51:46.309098 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 10 17:51:46.309098 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 10 17:51:46.309098 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:51:46.309098 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:51:46.309098 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:51:46.309098 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:51:46.309098 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:51:46.309098 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:51:46.309098 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:51:46.309098 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:51:46.309098 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:51:46.312221 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:51:46.312221 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:51:46.312221 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:51:46.312221 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:51:46.312221 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-4ab9a50d-c28e-4add-8ab3-2f779995ff37 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:51:46.312221 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:51:46.312221 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-4ab9a50d-c28e-4add-8ab3-2f779995ff37 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] 10.222.0.50 "POST /compute/v2.1/servers/37934416-f4a8-4fee-8f7f-53c9df0f6c72/action" status: 500 len: 214 microversion: 2.1 time: 0.512862 Aug 10 17:51:46.312221 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 320/628] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 10 17:51:45 2022] POST /compute/v2.1/servers/37934416-f4a8-4fee-8f7f-53c9df0f6c72/action => generated 214 bytes in 515 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 10 17:51:46.323723 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-394643a3-fe03-44f0-a785-f0cdaea556c9 tempest-MigrationsAdminTest-964085913 tempest-MigrationsAdminTest-964085913-project-admin] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:46.332200 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-61d441a7-b6d2-4d25-8b72-c9c232dd762b tempest-AZV2TestJSON-972475451 tempest-AZV2TestJSON-972475451-project] 10.222.0.50 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.655585 Aug 10 17:51:46.337223 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 309/629] 10.222.0.50 () {58 vars in 1164 bytes} [Wed Aug 10 17:51:45 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 17:51:46.362837 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-394643a3-fe03-44f0-a785-f0cdaea556c9 tempest-MigrationsAdminTest-964085913 tempest-MigrationsAdminTest-964085913-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.054110 Aug 10 17:51:46.380611 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-393de20e-c0bd-4c19-b77a-eb089e585256 tempest-MigrationsAdminTest-964085913 tempest-MigrationsAdminTest-964085913-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-1619931457", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:51:46.380835 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 321/630] 10.222.0.50 () {58 vars in 1137 bytes} [Wed Aug 10 17:51:46 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:51:46.385837 n-d-852296-2 devstack@n-api.service[129409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:51:46.385837 n-d-852296-2 devstack@n-api.service[129409]: warnings.warn(msg) Aug 10 17:51:46.647199 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-393de20e-c0bd-4c19-b77a-eb089e585256 tempest-MigrationsAdminTest-964085913 tempest-MigrationsAdminTest-964085913-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 499 microversion: 2.1 time: 0.275461 Aug 10 17:51:46.654381 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 310/631] 10.222.0.50 () {60 vars in 1146 bytes} [Wed Aug 10 17:51:46 2022] POST /compute/v2.1/flavors => generated 499 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:51:46.659310 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-a85d3e7f-fe54-43f8-94d4-b0f57a8d9b04 tempest-MigrationsAdminTest-964085913 tempest-MigrationsAdminTest-964085913-project-admin] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:46.668390 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-a85d3e7f-fe54-43f8-94d4-b0f57a8d9b04 tempest-MigrationsAdminTest-964085913 tempest-MigrationsAdminTest-964085913-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.013180 Aug 10 17:51:46.669242 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 322/632] 10.222.0.50 () {58 vars in 1182 bytes} [Wed Aug 10 17:51:46 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 10 17:51:46.711124 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-0351554e-90f7-4cc0-acd5-f2bae64c0057 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:46.711736 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-0351554e-90f7-4cc0-acd5-f2bae64c0057 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: 83268d7f-5375-4b01-9b5c-519be7daf0a4] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:51:46.800056 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-34a937da-5e63-4402-9dc6-7a692968453f tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:46.801065 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-34a937da-5e63-4402-9dc6-7a692968453f tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] [instance: 12eda82b-051e-446c-b78b-6c9c9f6f78d0] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:51:46.833481 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-0351554e-90f7-4cc0-acd5-f2bae64c0057 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:51:46.846293 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-0351554e-90f7-4cc0-acd5-f2bae64c0057 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/83268d7f-5375-4b01-9b5c-519be7daf0a4" status: 200 len: 1219 microversion: 2.1 time: 0.133298 Aug 10 17:51:46.846293 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 311/633] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:51:46 2022] GET /compute/v2.1/servers/83268d7f-5375-4b01-9b5c-519be7daf0a4 => generated 1219 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:51:46.943901 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-34a937da-5e63-4402-9dc6-7a692968453f tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2fd6acf18d4218ad143ccee2d0bb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7c2481a908406fa9c4562513fff665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:51:46.950063 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-227360cf-600c-4ca7-82eb-c0110f3216b8 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1040826665", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "ecb11648-6e2f-4ee1-97ae-15f83859e423"}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:51:46.957152 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-34a937da-5e63-4402-9dc6-7a692968453f tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] 10.222.0.50 "GET /compute/v2.1/servers/12eda82b-051e-446c-b78b-6c9c9f6f78d0" status: 200 len: 1213 microversion: 2.1 time: 0.163293 Aug 10 17:51:46.961231 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 323/634] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:51:46 2022] GET /compute/v2.1/servers/12eda82b-051e-446c-b78b-6c9c9f6f78d0 => generated 1213 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:51:47.050875 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.network.neutron [None req-227360cf-600c-4ca7-82eb-c0110f3216b8 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] validate_networks() for None {{(pid=129409) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 17:51:47.309352 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.virt.hardware [None req-227360cf-600c-4ca7-82eb-c0110f3216b8 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Flavor limits 0:0:0 {{(pid=129409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 17:51:47.309972 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.virt.hardware [None req-227360cf-600c-4ca7-82eb-c0110f3216b8 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Image limits 0:0:0 {{(pid=129409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 17:51:47.310448 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.virt.hardware [None req-227360cf-600c-4ca7-82eb-c0110f3216b8 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Flavor pref 0:0:0 {{(pid=129409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 17:51:47.311370 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.virt.hardware [None req-227360cf-600c-4ca7-82eb-c0110f3216b8 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Image pref 0:0:0 {{(pid=129409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 17:51:47.311775 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.virt.hardware [None req-227360cf-600c-4ca7-82eb-c0110f3216b8 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 17:51:47.328649 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-227360cf-600c-4ca7-82eb-c0110f3216b8 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:47.329200 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-227360cf-600c-4ca7-82eb-c0110f3216b8 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:47.329727 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-227360cf-600c-4ca7-82eb-c0110f3216b8 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:47.330641 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-227360cf-600c-4ca7-82eb-c0110f3216b8 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:47.331111 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-227360cf-600c-4ca7-82eb-c0110f3216b8 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:47.331789 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-227360cf-600c-4ca7-82eb-c0110f3216b8 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:47.386534 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-227360cf-600c-4ca7-82eb-c0110f3216b8 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Getting quotas for project 48bbb92998f54ebeb624bc794d406896. Resources: {'instances', 'ram', 'cores'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:51:47.418234 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-227360cf-600c-4ca7-82eb-c0110f3216b8 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Getting quotas for user e109c3dcd0574faaa3d7ec31dd4edd24 and project 48bbb92998f54ebeb624bc794d406896. Resources: {'instances', 'ram', 'cores'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:51:47.456181 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:51:47.457518 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-227360cf-600c-4ca7-82eb-c0110f3216b8 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Going to run 1 instances... {{(pid=129409) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 17:51:47.470779 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-227360cf-600c-4ca7-82eb-c0110f3216b8 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] [instance: 43ff4d86-8c12-48ce-bcf5-c607c9bcaa05] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a735ff26-463a-4ffe-a981-ab9d9baa494f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 17:51:47.713935 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-227360cf-600c-4ca7-82eb-c0110f3216b8 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.775466 Aug 10 17:51:47.718384 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 312/635] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 17:51:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 780 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 17:51:47.728738 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-12e38e4f-1a84-4908-bcf2-4c7b0c92a465 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:47.729343 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-12e38e4f-1a84-4908-bcf2-4c7b0c92a465 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] [instance: 43ff4d86-8c12-48ce-bcf5-c607c9bcaa05] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:51:47.874602 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-f77c0f33-d00a-4412-89b5-284c0c1e14c5 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:47.878628 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-f77c0f33-d00a-4412-89b5-284c0c1e14c5 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: 83268d7f-5375-4b01-9b5c-519be7daf0a4] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:51:47.962821 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-12e38e4f-1a84-4908-bcf2-4c7b0c92a465 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e109c3dcd0574faaa3d7ec31dd4edd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48bbb92998f54ebeb624bc794d406896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:51:47.979267 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-12e38e4f-1a84-4908-bcf2-4c7b0c92a465 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] 10.222.0.50 "GET /compute/v2.1/servers/43ff4d86-8c12-48ce-bcf5-c607c9bcaa05" status: 200 len: 1279 microversion: 2.1 time: 0.255553 Aug 10 17:51:47.982294 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 324/636] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:51:47 2022] GET /compute/v2.1/servers/43ff4d86-8c12-48ce-bcf5-c607c9bcaa05 => generated 1279 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:51:48.002825 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-8a5cee4c-78a1-4c68-afa0-40a643ae481a tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:48.007135 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-8a5cee4c-78a1-4c68-afa0-40a643ae481a tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] [instance: 12eda82b-051e-446c-b78b-6c9c9f6f78d0] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:51:48.018245 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-8a5cee4c-78a1-4c68-afa0-40a643ae481a tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:48.020874 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-8a5cee4c-78a1-4c68-afa0-40a643ae481a tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:48.020874 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-8a5cee4c-78a1-4c68-afa0-40a643ae481a tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:48.025617 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-8a5cee4c-78a1-4c68-afa0-40a643ae481a tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:48.026742 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-8a5cee4c-78a1-4c68-afa0-40a643ae481a tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:48.028529 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-8a5cee4c-78a1-4c68-afa0-40a643ae481a tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:48.139162 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-f77c0f33-d00a-4412-89b5-284c0c1e14c5 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:51:48.155289 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-f77c0f33-d00a-4412-89b5-284c0c1e14c5 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/83268d7f-5375-4b01-9b5c-519be7daf0a4" status: 200 len: 1219 microversion: 2.1 time: 0.293251 Aug 10 17:51:48.157747 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 313/637] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:51:47 2022] GET /compute/v2.1/servers/83268d7f-5375-4b01-9b5c-519be7daf0a4 => generated 1219 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:51:48.241438 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-8a5cee4c-78a1-4c68-afa0-40a643ae481a tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2fd6acf18d4218ad143ccee2d0bb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7c2481a908406fa9c4562513fff665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:51:48.255758 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-8a5cee4c-78a1-4c68-afa0-40a643ae481a tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] 10.222.0.50 "GET /compute/v2.1/servers/12eda82b-051e-446c-b78b-6c9c9f6f78d0" status: 200 len: 1209 microversion: 2.1 time: 0.258765 Aug 10 17:51:48.256741 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 325/638] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:51:47 2022] GET /compute/v2.1/servers/12eda82b-051e-446c-b78b-6c9c9f6f78d0 => generated 1209 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:51:48.736867 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-98499c23-db24-4eaf-af97-880d7956ad19 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-200313908", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452"}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:51:48.852635 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.network.neutron [None req-98499c23-db24-4eaf-af97-880d7956ad19 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] validate_networks() for None {{(pid=129409) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 17:51:48.901884 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-5ba7bcac-9d1a-41e9-b119-11aff4f7a358 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-28277861", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": "none"}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:51:48.998727 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.virt.hardware [None req-5ba7bcac-9d1a-41e9-b119-11aff4f7a358 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Flavor limits 0:0:0 {{(pid=129410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 17:51:48.999605 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.virt.hardware [None req-5ba7bcac-9d1a-41e9-b119-11aff4f7a358 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Image limits 0:0:0 {{(pid=129410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 17:51:49.003474 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.virt.hardware [None req-5ba7bcac-9d1a-41e9-b119-11aff4f7a358 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Flavor pref 0:0:0 {{(pid=129410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 17:51:49.012037 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.virt.hardware [None req-5ba7bcac-9d1a-41e9-b119-11aff4f7a358 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Image pref 0:0:0 {{(pid=129410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 17:51:49.012037 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.virt.hardware [None req-5ba7bcac-9d1a-41e9-b119-11aff4f7a358 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 17:51:49.050298 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-5ba7bcac-9d1a-41e9-b119-11aff4f7a358 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:49.055191 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-5ba7bcac-9d1a-41e9-b119-11aff4f7a358 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:49.056620 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-5ba7bcac-9d1a-41e9-b119-11aff4f7a358 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:49.061176 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-5ba7bcac-9d1a-41e9-b119-11aff4f7a358 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:49.062679 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-5ba7bcac-9d1a-41e9-b119-11aff4f7a358 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:49.063266 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-5ba7bcac-9d1a-41e9-b119-11aff4f7a358 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:49.137519 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.quota [None req-5ba7bcac-9d1a-41e9-b119-11aff4f7a358 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Getting quotas for project 6d9baf8d84414bc18598097e20d1966d. Resources: {'instances', 'ram', 'cores'} {{(pid=129410) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:51:49.153627 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.quota [None req-5ba7bcac-9d1a-41e9-b119-11aff4f7a358 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Getting quotas for user b72fc939efd547ceb97257ee1c528d13 and project 6d9baf8d84414bc18598097e20d1966d. Resources: {'instances', 'ram', 'cores'} {{(pid=129410) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:51:49.183606 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-5ba7bcac-9d1a-41e9-b119-11aff4f7a358 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Going to run 1 instances... {{(pid=129410) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 17:51:49.185206 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-5ba7bcac-9d1a-41e9-b119-11aff4f7a358 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] [instance: e2777988-0bbf-496c-9c97-b206dbc94a62] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a735ff26-463a-4ffe-a981-ab9d9baa494f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129410) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 17:51:49.296774 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.virt.hardware [None req-98499c23-db24-4eaf-af97-880d7956ad19 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Flavor limits 0:0:0 {{(pid=129409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 17:51:49.297368 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.virt.hardware [None req-98499c23-db24-4eaf-af97-880d7956ad19 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Image limits 0:0:0 {{(pid=129409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 17:51:49.297850 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.virt.hardware [None req-98499c23-db24-4eaf-af97-880d7956ad19 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Flavor pref 0:0:0 {{(pid=129409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 17:51:49.299067 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.virt.hardware [None req-98499c23-db24-4eaf-af97-880d7956ad19 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Image pref 0:0:0 {{(pid=129409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 17:51:49.299558 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.virt.hardware [None req-98499c23-db24-4eaf-af97-880d7956ad19 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 17:51:49.313560 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-98499c23-db24-4eaf-af97-880d7956ad19 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:49.316306 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-98499c23-db24-4eaf-af97-880d7956ad19 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:49.317009 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-98499c23-db24-4eaf-af97-880d7956ad19 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:49.317932 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-98499c23-db24-4eaf-af97-880d7956ad19 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:49.322286 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-98499c23-db24-4eaf-af97-880d7956ad19 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:49.322286 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-98499c23-db24-4eaf-af97-880d7956ad19 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:49.343103 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-98499c23-db24-4eaf-af97-880d7956ad19 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Getting quotas for project 9df088e5a610436ea21b8a360e2bb527. Resources: {'instances', 'ram', 'cores'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:51:49.349568 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-98499c23-db24-4eaf-af97-880d7956ad19 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Getting quotas for user e83a3e198e21476eb12fcf417aea62de and project 9df088e5a610436ea21b8a360e2bb527. Resources: {'instances', 'ram', 'cores'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:51:49.366604 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-98499c23-db24-4eaf-af97-880d7956ad19 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Going to run 1 instances... {{(pid=129409) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 17:51:49.375639 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-98499c23-db24-4eaf-af97-880d7956ad19 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] [instance: 25b28585-a586-423f-8f04-2b2f4d28f16c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a735ff26-463a-4ffe-a981-ab9d9baa494f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 17:51:49.456902 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-5ba7bcac-9d1a-41e9-b119-11aff4f7a358 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.814672 Aug 10 17:51:49.469357 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 326/639] 10.222.0.50 () {62 vars in 1188 bytes} [Wed Aug 10 17:51:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 828 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 10 17:51:49.492216 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-abb0f6ba-6bc8-4769-81d9-b3179f4c41b4 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:49.492216 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-abb0f6ba-6bc8-4769-81d9-b3179f4c41b4 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] [instance: 43ff4d86-8c12-48ce-bcf5-c607c9bcaa05] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:51:49.628643 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-98499c23-db24-4eaf-af97-880d7956ad19 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.210912 Aug 10 17:51:49.634043 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 314/640] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 17:51:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1217 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 17:51:49.659608 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-e195f272-ebeb-4605-add5-423570d4ffbf tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:49.681468 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-e195f272-ebeb-4605-add5-423570d4ffbf tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: 83268d7f-5375-4b01-9b5c-519be7daf0a4] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:51:49.786163 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e195f272-ebeb-4605-add5-423570d4ffbf tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:49.786163 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e195f272-ebeb-4605-add5-423570d4ffbf tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:49.786163 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e195f272-ebeb-4605-add5-423570d4ffbf tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:49.786163 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e195f272-ebeb-4605-add5-423570d4ffbf tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:49.786163 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e195f272-ebeb-4605-add5-423570d4ffbf tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:49.786163 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e195f272-ebeb-4605-add5-423570d4ffbf tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:49.860810 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-abb0f6ba-6bc8-4769-81d9-b3179f4c41b4 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e109c3dcd0574faaa3d7ec31dd4edd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48bbb92998f54ebeb624bc794d406896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:51:49.870262 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-abb0f6ba-6bc8-4769-81d9-b3179f4c41b4 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] 10.222.0.50 "GET /compute/v2.1/servers/43ff4d86-8c12-48ce-bcf5-c607c9bcaa05" status: 200 len: 1279 microversion: 2.1 time: 0.395674 Aug 10 17:51:49.877819 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 327/641] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:51:49 2022] GET /compute/v2.1/servers/43ff4d86-8c12-48ce-bcf5-c607c9bcaa05 => generated 1279 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:51:49.914205 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-7b193578-29a1-47b2-a38c-3da8bd6a4ad5 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:49.917338 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-7b193578-29a1-47b2-a38c-3da8bd6a4ad5 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] [instance: 12eda82b-051e-446c-b78b-6c9c9f6f78d0] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:51:49.930778 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-7b193578-29a1-47b2-a38c-3da8bd6a4ad5 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:49.931264 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-7b193578-29a1-47b2-a38c-3da8bd6a4ad5 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:49.931698 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-7b193578-29a1-47b2-a38c-3da8bd6a4ad5 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:49.937677 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-7b193578-29a1-47b2-a38c-3da8bd6a4ad5 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:49.956597 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-7b193578-29a1-47b2-a38c-3da8bd6a4ad5 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:49.956597 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-7b193578-29a1-47b2-a38c-3da8bd6a4ad5 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:50.035457 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-e195f272-ebeb-4605-add5-423570d4ffbf tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:51:50.049935 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-e195f272-ebeb-4605-add5-423570d4ffbf tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/83268d7f-5375-4b01-9b5c-519be7daf0a4" status: 200 len: 1271 microversion: 2.1 time: 0.412125 Aug 10 17:51:50.057131 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 315/642] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:51:49 2022] GET /compute/v2.1/servers/83268d7f-5375-4b01-9b5c-519be7daf0a4 => generated 1271 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:51:50.062785 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-c1577096-55d5-4110-9f8e-98dbddb8f64d tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:51:50.070323 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-c1577096-55d5-4110-9f8e-98dbddb8f64d tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] [instance: e2777988-0bbf-496c-9c97-b206dbc94a62] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:51:50.306619 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-c1577096-55d5-4110-9f8e-98dbddb8f64d tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:51:50.323645 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-c1577096-55d5-4110-9f8e-98dbddb8f64d tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:51:50.327534 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-7b193578-29a1-47b2-a38c-3da8bd6a4ad5 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2fd6acf18d4218ad143ccee2d0bb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7c2481a908406fa9c4562513fff665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:51:50.327941 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-c1577096-55d5-4110-9f8e-98dbddb8f64d tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:51:50.337558 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-c1577096-55d5-4110-9f8e-98dbddb8f64d tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] 10.222.0.50 "PUT /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62" status: 200 len: 1357 microversion: 2.75 time: 0.284988 Aug 10 17:51:50.339220 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 316/643] 10.222.0.50 () {62 vars in 1297 bytes} [Wed Aug 10 17:51:50 2022] PUT /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62 => generated 1357 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:51:50.346435 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-eaf0d065-09b5-4eca-b362-8451e95e86a8 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:50.347629 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-eaf0d065-09b5-4eca-b362-8451e95e86a8 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] [instance: 25b28585-a586-423f-8f04-2b2f4d28f16c] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:51:50.361864 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-7b193578-29a1-47b2-a38c-3da8bd6a4ad5 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] 10.222.0.50 "GET /compute/v2.1/servers/12eda82b-051e-446c-b78b-6c9c9f6f78d0" status: 200 len: 1273 microversion: 2.1 time: 0.481920 Aug 10 17:51:50.362468 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 328/644] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:51:49 2022] GET /compute/v2.1/servers/12eda82b-051e-446c-b78b-6c9c9f6f78d0 => generated 1273 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:51:50.372301 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-8d9ff10d-a5c8-44d2-a65a-e6a923c0ce53 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:50.372940 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-8d9ff10d-a5c8-44d2-a65a-e6a923c0ce53 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] [instance: e2777988-0bbf-496c-9c97-b206dbc94a62] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:51:50.474325 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-eaf0d065-09b5-4eca-b362-8451e95e86a8 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83a3e198e21476eb12fcf417aea62de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df088e5a610436ea21b8a360e2bb527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:51:50.488866 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-eaf0d065-09b5-4eca-b362-8451e95e86a8 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] 10.222.0.50 "GET /compute/v2.1/servers/25b28585-a586-423f-8f04-2b2f4d28f16c" status: 200 len: 1221 microversion: 2.1 time: 0.146617 Aug 10 17:51:50.492714 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-8d9ff10d-a5c8-44d2-a65a-e6a923c0ce53 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:51:50.502548 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 317/645] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:51:50 2022] GET /compute/v2.1/servers/25b28585-a586-423f-8f04-2b2f4d28f16c => generated 1221 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:51:50.505609 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-8d9ff10d-a5c8-44d2-a65a-e6a923c0ce53 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:51:50.507662 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-8d9ff10d-a5c8-44d2-a65a-e6a923c0ce53 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:51:50.517421 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-8d9ff10d-a5c8-44d2-a65a-e6a923c0ce53 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] 10.222.0.50 "GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62" status: 200 len: 1357 microversion: 2.75 time: 0.150941 Aug 10 17:51:50.518331 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 329/646] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:51:50 2022] GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62 => generated 1357 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:51:50.902502 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-d0794cdc-e227-4050-8c4e-bf610a169087 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:50.903335 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-d0794cdc-e227-4050-8c4e-bf610a169087 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] [instance: 43ff4d86-8c12-48ce-bcf5-c607c9bcaa05] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:51:50.920842 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-d0794cdc-e227-4050-8c4e-bf610a169087 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:50.921348 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-d0794cdc-e227-4050-8c4e-bf610a169087 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:50.923542 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-d0794cdc-e227-4050-8c4e-bf610a169087 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:50.926370 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-d0794cdc-e227-4050-8c4e-bf610a169087 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:50.928321 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-d0794cdc-e227-4050-8c4e-bf610a169087 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:50.933592 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-d0794cdc-e227-4050-8c4e-bf610a169087 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:51.078634 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-17cdc5be-270e-4e36-9791-8769a5c63d07 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:51.079376 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-17cdc5be-270e-4e36-9791-8769a5c63d07 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: 83268d7f-5375-4b01-9b5c-519be7daf0a4] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:51:51.108080 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-17cdc5be-270e-4e36-9791-8769a5c63d07 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:51.110555 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-17cdc5be-270e-4e36-9791-8769a5c63d07 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:51.111008 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-17cdc5be-270e-4e36-9791-8769a5c63d07 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:51.111845 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-17cdc5be-270e-4e36-9791-8769a5c63d07 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:51.120973 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-17cdc5be-270e-4e36-9791-8769a5c63d07 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:51.121434 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-17cdc5be-270e-4e36-9791-8769a5c63d07 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:51.188049 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-d0794cdc-e227-4050-8c4e-bf610a169087 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e109c3dcd0574faaa3d7ec31dd4edd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48bbb92998f54ebeb624bc794d406896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:51:51.199159 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-d0794cdc-e227-4050-8c4e-bf610a169087 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] 10.222.0.50 "GET /compute/v2.1/servers/43ff4d86-8c12-48ce-bcf5-c607c9bcaa05" status: 200 len: 1275 microversion: 2.1 time: 0.311852 Aug 10 17:51:51.211732 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 318/647] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:51:50 2022] GET /compute/v2.1/servers/43ff4d86-8c12-48ce-bcf5-c607c9bcaa05 => generated 1275 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:51:51.366305 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-17cdc5be-270e-4e36-9791-8769a5c63d07 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:51:51.376697 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-17cdc5be-270e-4e36-9791-8769a5c63d07 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/83268d7f-5375-4b01-9b5c-519be7daf0a4" status: 200 len: 1279 microversion: 2.1 time: 0.302145 Aug 10 17:51:51.378050 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 330/648] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:51:51 2022] GET /compute/v2.1/servers/83268d7f-5375-4b01-9b5c-519be7daf0a4 => generated 1279 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:51:51.386985 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-c701909e-1a88-4280-afc9-0e7d2e88d4bb tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:51.387728 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-c701909e-1a88-4280-afc9-0e7d2e88d4bb tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] [instance: 12eda82b-051e-446c-b78b-6c9c9f6f78d0] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:51:51.398658 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c701909e-1a88-4280-afc9-0e7d2e88d4bb tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:51.405438 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c701909e-1a88-4280-afc9-0e7d2e88d4bb tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:51.405438 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c701909e-1a88-4280-afc9-0e7d2e88d4bb tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:51.405438 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c701909e-1a88-4280-afc9-0e7d2e88d4bb tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:51.405438 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c701909e-1a88-4280-afc9-0e7d2e88d4bb tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:51.405438 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c701909e-1a88-4280-afc9-0e7d2e88d4bb tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:51.505118 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-c701909e-1a88-4280-afc9-0e7d2e88d4bb tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2fd6acf18d4218ad143ccee2d0bb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7c2481a908406fa9c4562513fff665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:51:51.530413 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-8e776246-9326-4db2-aabe-4756a663a648 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:51.530413 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-8e776246-9326-4db2-aabe-4756a663a648 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] [instance: 25b28585-a586-423f-8f04-2b2f4d28f16c] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:51:51.530632 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-c701909e-1a88-4280-afc9-0e7d2e88d4bb tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] 10.222.0.50 "GET /compute/v2.1/servers/12eda82b-051e-446c-b78b-6c9c9f6f78d0" status: 200 len: 1271 microversion: 2.1 time: 0.131512 Aug 10 17:51:51.537113 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 319/649] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:51:51 2022] GET /compute/v2.1/servers/12eda82b-051e-446c-b78b-6c9c9f6f78d0 => generated 1271 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:51:51.545382 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-48e72d43-de2b-4e45-b8a8-725c3d38b729 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:51.552843 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-48e72d43-de2b-4e45-b8a8-725c3d38b729 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] [instance: e2777988-0bbf-496c-9c97-b206dbc94a62] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:51:51.650728 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-8e776246-9326-4db2-aabe-4756a663a648 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83a3e198e21476eb12fcf417aea62de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df088e5a610436ea21b8a360e2bb527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:51:51.651330 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-48e72d43-de2b-4e45-b8a8-725c3d38b729 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:51:51.661914 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-48e72d43-de2b-4e45-b8a8-725c3d38b729 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:51:51.665318 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-48e72d43-de2b-4e45-b8a8-725c3d38b729 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:51:51.679677 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-48e72d43-de2b-4e45-b8a8-725c3d38b729 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] 10.222.0.50 "GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62" status: 200 len: 1357 microversion: 2.75 time: 0.138005 Aug 10 17:51:51.679926 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-8e776246-9326-4db2-aabe-4756a663a648 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] 10.222.0.50 "GET /compute/v2.1/servers/25b28585-a586-423f-8f04-2b2f4d28f16c" status: 200 len: 1221 microversion: 2.1 time: 0.173041 Aug 10 17:51:51.681447 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 320/650] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:51:51 2022] GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62 => generated 1357 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:51:51.698834 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 331/651] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:51:51 2022] GET /compute/v2.1/servers/25b28585-a586-423f-8f04-2b2f4d28f16c => generated 1221 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:51:52.238154 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-67be0655-e656-4cd9-86cf-67d2d2f7ce2b tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:52.240511 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-67be0655-e656-4cd9-86cf-67d2d2f7ce2b tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] [instance: 43ff4d86-8c12-48ce-bcf5-c607c9bcaa05] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:51:52.252533 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-67be0655-e656-4cd9-86cf-67d2d2f7ce2b tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:52.256602 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-67be0655-e656-4cd9-86cf-67d2d2f7ce2b tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:52.257649 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-67be0655-e656-4cd9-86cf-67d2d2f7ce2b tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:52.258607 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-67be0655-e656-4cd9-86cf-67d2d2f7ce2b tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:52.261540 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-67be0655-e656-4cd9-86cf-67d2d2f7ce2b tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:52.262238 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-67be0655-e656-4cd9-86cf-67d2d2f7ce2b tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:52.405538 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-017a935f-0b3c-48e3-84d8-aaa90a8c8048 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:52.406941 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-017a935f-0b3c-48e3-84d8-aaa90a8c8048 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: 83268d7f-5375-4b01-9b5c-519be7daf0a4] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:51:52.433298 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-017a935f-0b3c-48e3-84d8-aaa90a8c8048 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:52.434929 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-017a935f-0b3c-48e3-84d8-aaa90a8c8048 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:52.435386 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-017a935f-0b3c-48e3-84d8-aaa90a8c8048 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:52.455582 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-017a935f-0b3c-48e3-84d8-aaa90a8c8048 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:52.458938 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-017a935f-0b3c-48e3-84d8-aaa90a8c8048 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:52.467444 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-017a935f-0b3c-48e3-84d8-aaa90a8c8048 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:52.691435 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-017a935f-0b3c-48e3-84d8-aaa90a8c8048 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:51:52.704601 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-017a935f-0b3c-48e3-84d8-aaa90a8c8048 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/83268d7f-5375-4b01-9b5c-519be7daf0a4" status: 200 len: 1277 microversion: 2.1 time: 0.307890 Aug 10 17:51:52.705283 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 332/652] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:51:52 2022] GET /compute/v2.1/servers/83268d7f-5375-4b01-9b5c-519be7daf0a4 => generated 1277 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:51:52.732885 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-3e2df701-0d34-43c5-8dc2-2b8bcb3483f0 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:52.733837 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-3e2df701-0d34-43c5-8dc2-2b8bcb3483f0 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] [instance: 12eda82b-051e-446c-b78b-6c9c9f6f78d0] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:51:52.750552 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-3e2df701-0d34-43c5-8dc2-2b8bcb3483f0 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:52.752101 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-3e2df701-0d34-43c5-8dc2-2b8bcb3483f0 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:52.752770 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-3e2df701-0d34-43c5-8dc2-2b8bcb3483f0 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:52.754249 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-3e2df701-0d34-43c5-8dc2-2b8bcb3483f0 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:52.762117 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-3e2df701-0d34-43c5-8dc2-2b8bcb3483f0 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:52.762775 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-3e2df701-0d34-43c5-8dc2-2b8bcb3483f0 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:52.848837 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-67be0655-e656-4cd9-86cf-67d2d2f7ce2b tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e109c3dcd0574faaa3d7ec31dd4edd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48bbb92998f54ebeb624bc794d406896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:51:52.865145 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-67be0655-e656-4cd9-86cf-67d2d2f7ce2b tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] 10.222.0.50 "GET /compute/v2.1/servers/43ff4d86-8c12-48ce-bcf5-c607c9bcaa05" status: 200 len: 1339 microversion: 2.1 time: 0.632666 Aug 10 17:51:52.865994 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 321/653] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:51:52 2022] GET /compute/v2.1/servers/43ff4d86-8c12-48ce-bcf5-c607c9bcaa05 => generated 1339 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:51:52.884866 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-7ea349b1-f421-403f-9438-49feddbdedd1 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:52.885373 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-7ea349b1-f421-403f-9438-49feddbdedd1 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] [instance: e2777988-0bbf-496c-9c97-b206dbc94a62] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:51:52.904049 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7ea349b1-f421-403f-9438-49feddbdedd1 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:52.904588 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7ea349b1-f421-403f-9438-49feddbdedd1 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:52.905199 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7ea349b1-f421-403f-9438-49feddbdedd1 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:52.906055 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7ea349b1-f421-403f-9438-49feddbdedd1 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:52.906687 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7ea349b1-f421-403f-9438-49feddbdedd1 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:52.907351 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7ea349b1-f421-403f-9438-49feddbdedd1 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:53.047459 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-3e2df701-0d34-43c5-8dc2-2b8bcb3483f0 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2fd6acf18d4218ad143ccee2d0bb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7c2481a908406fa9c4562513fff665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:51:53.062319 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-3e2df701-0d34-43c5-8dc2-2b8bcb3483f0 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] 10.222.0.50 "GET /compute/v2.1/servers/12eda82b-051e-446c-b78b-6c9c9f6f78d0" status: 200 len: 1313 microversion: 2.1 time: 0.340009 Aug 10 17:51:53.065211 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 333/654] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:51:52 2022] GET /compute/v2.1/servers/12eda82b-051e-446c-b78b-6c9c9f6f78d0 => generated 1313 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:51:53.072736 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-457b60c2-f58f-4918-8b2a-66a72a8e2056 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:53.073359 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-457b60c2-f58f-4918-8b2a-66a72a8e2056 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] [instance: 25b28585-a586-423f-8f04-2b2f4d28f16c] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:51:53.081130 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-457b60c2-f58f-4918-8b2a-66a72a8e2056 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:53.081621 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-457b60c2-f58f-4918-8b2a-66a72a8e2056 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:53.082258 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-457b60c2-f58f-4918-8b2a-66a72a8e2056 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:53.083270 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-457b60c2-f58f-4918-8b2a-66a72a8e2056 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:53.083739 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-457b60c2-f58f-4918-8b2a-66a72a8e2056 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:53.086142 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-457b60c2-f58f-4918-8b2a-66a72a8e2056 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:53.226494 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-457b60c2-f58f-4918-8b2a-66a72a8e2056 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83a3e198e21476eb12fcf417aea62de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df088e5a610436ea21b8a360e2bb527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:51:53.240840 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-457b60c2-f58f-4918-8b2a-66a72a8e2056 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] 10.222.0.50 "GET /compute/v2.1/servers/25b28585-a586-423f-8f04-2b2f4d28f16c" status: 200 len: 1217 microversion: 2.1 time: 0.172170 Aug 10 17:51:53.242574 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 334/655] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:51:53 2022] GET /compute/v2.1/servers/25b28585-a586-423f-8f04-2b2f4d28f16c => generated 1217 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:51:53.269734 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-7ea349b1-f421-403f-9438-49feddbdedd1 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:51:53.281444 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-7ea349b1-f421-403f-9438-49feddbdedd1 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:51:53.283021 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-7ea349b1-f421-403f-9438-49feddbdedd1 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:51:53.300161 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-7ea349b1-f421-403f-9438-49feddbdedd1 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] 10.222.0.50 "GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62" status: 200 len: 1353 microversion: 2.75 time: 0.419326 Aug 10 17:51:53.301213 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 322/656] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:51:52 2022] GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62 => generated 1353 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:51:53.733833 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-f3fccdd3-c176-437f-9997-6b2d2dc9bb8f tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:53.734445 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-f3fccdd3-c176-437f-9997-6b2d2dc9bb8f tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: 83268d7f-5375-4b01-9b5c-519be7daf0a4] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:51:53.757949 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-f3fccdd3-c176-437f-9997-6b2d2dc9bb8f tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:53.761373 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-f3fccdd3-c176-437f-9997-6b2d2dc9bb8f tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:53.762120 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-f3fccdd3-c176-437f-9997-6b2d2dc9bb8f tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:53.763774 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-f3fccdd3-c176-437f-9997-6b2d2dc9bb8f tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:53.767533 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-f3fccdd3-c176-437f-9997-6b2d2dc9bb8f tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:53.768451 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-f3fccdd3-c176-437f-9997-6b2d2dc9bb8f tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:53.887109 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-2c40c526-6a4c-4239-9b41-31a57ae5a0f3 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:53.887722 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-2c40c526-6a4c-4239-9b41-31a57ae5a0f3 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] [instance: 43ff4d86-8c12-48ce-bcf5-c607c9bcaa05] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:51:53.906526 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-2c40c526-6a4c-4239-9b41-31a57ae5a0f3 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:53.907369 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-2c40c526-6a4c-4239-9b41-31a57ae5a0f3 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:53.908021 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-2c40c526-6a4c-4239-9b41-31a57ae5a0f3 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:53.909282 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-2c40c526-6a4c-4239-9b41-31a57ae5a0f3 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:53.909991 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-2c40c526-6a4c-4239-9b41-31a57ae5a0f3 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:53.910897 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-2c40c526-6a4c-4239-9b41-31a57ae5a0f3 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:53.950125 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-f3fccdd3-c176-437f-9997-6b2d2dc9bb8f tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:51:53.967074 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-f3fccdd3-c176-437f-9997-6b2d2dc9bb8f tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/83268d7f-5375-4b01-9b5c-519be7daf0a4" status: 200 len: 1277 microversion: 2.1 time: 0.237155 Aug 10 17:51:53.972599 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 335/657] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:51:53 2022] GET /compute/v2.1/servers/83268d7f-5375-4b01-9b5c-519be7daf0a4 => generated 1277 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:51:54.100002 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-2c40c526-6a4c-4239-9b41-31a57ae5a0f3 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e109c3dcd0574faaa3d7ec31dd4edd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48bbb92998f54ebeb624bc794d406896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:51:54.100002 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-2c40c526-6a4c-4239-9b41-31a57ae5a0f3 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] 10.222.0.50 "GET /compute/v2.1/servers/43ff4d86-8c12-48ce-bcf5-c607c9bcaa05" status: 200 len: 1337 microversion: 2.1 time: 0.170629 Aug 10 17:51:54.100002 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 323/658] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:51:53 2022] GET /compute/v2.1/servers/43ff4d86-8c12-48ce-bcf5-c607c9bcaa05 => generated 1337 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:51:54.100439 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-7cbcde94-51ac-42ec-a500-fb744e186bbd tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:54.100439 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-7cbcde94-51ac-42ec-a500-fb744e186bbd tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] [instance: 12eda82b-051e-446c-b78b-6c9c9f6f78d0] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:51:54.100439 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-7cbcde94-51ac-42ec-a500-fb744e186bbd tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:54.100439 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-7cbcde94-51ac-42ec-a500-fb744e186bbd tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:54.100439 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-7cbcde94-51ac-42ec-a500-fb744e186bbd tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:54.100439 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-7cbcde94-51ac-42ec-a500-fb744e186bbd tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:54.100439 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-7cbcde94-51ac-42ec-a500-fb744e186bbd tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:54.102641 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-7cbcde94-51ac-42ec-a500-fb744e186bbd tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:54.264511 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-7892b927-c2ff-4463-b51e-84bee32bd9f8 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:54.265694 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-7892b927-c2ff-4463-b51e-84bee32bd9f8 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] [instance: 25b28585-a586-423f-8f04-2b2f4d28f16c] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:51:54.278100 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7892b927-c2ff-4463-b51e-84bee32bd9f8 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:54.279589 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7892b927-c2ff-4463-b51e-84bee32bd9f8 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:54.280218 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7892b927-c2ff-4463-b51e-84bee32bd9f8 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:54.285097 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7892b927-c2ff-4463-b51e-84bee32bd9f8 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:54.286058 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7892b927-c2ff-4463-b51e-84bee32bd9f8 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:54.286918 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7892b927-c2ff-4463-b51e-84bee32bd9f8 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:54.436702 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-7cbcde94-51ac-42ec-a500-fb744e186bbd tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2fd6acf18d4218ad143ccee2d0bb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7c2481a908406fa9c4562513fff665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:51:54.474774 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-7cbcde94-51ac-42ec-a500-fb744e186bbd tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] 10.222.0.50 "GET /compute/v2.1/servers/12eda82b-051e-446c-b78b-6c9c9f6f78d0" status: 200 len: 1313 microversion: 2.1 time: 0.373525 Aug 10 17:51:54.474774 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 336/659] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:51:54 2022] GET /compute/v2.1/servers/12eda82b-051e-446c-b78b-6c9c9f6f78d0 => generated 1313 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:51:54.474774 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-e865911c-304e-4219-89f2-d50791b2347a tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:54.479278 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-e865911c-304e-4219-89f2-d50791b2347a tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] [instance: e2777988-0bbf-496c-9c97-b206dbc94a62] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:51:54.514091 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e865911c-304e-4219-89f2-d50791b2347a tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:54.514625 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e865911c-304e-4219-89f2-d50791b2347a tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:54.515083 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e865911c-304e-4219-89f2-d50791b2347a tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:54.523944 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e865911c-304e-4219-89f2-d50791b2347a tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:54.524512 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e865911c-304e-4219-89f2-d50791b2347a tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:54.524959 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e865911c-304e-4219-89f2-d50791b2347a tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:54.722553 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-7892b927-c2ff-4463-b51e-84bee32bd9f8 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83a3e198e21476eb12fcf417aea62de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df088e5a610436ea21b8a360e2bb527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:51:54.733135 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-7892b927-c2ff-4463-b51e-84bee32bd9f8 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] 10.222.0.50 "GET /compute/v2.1/servers/25b28585-a586-423f-8f04-2b2f4d28f16c" status: 200 len: 1273 microversion: 2.1 time: 0.473952 Aug 10 17:51:54.740931 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 324/660] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:51:54 2022] GET /compute/v2.1/servers/25b28585-a586-423f-8f04-2b2f4d28f16c => generated 1273 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:51:54.758979 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_cell1:SELECT=100 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:51:54.874069 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-e865911c-304e-4219-89f2-d50791b2347a tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:51:54.887333 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-e865911c-304e-4219-89f2-d50791b2347a tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:51:54.896593 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-e865911c-304e-4219-89f2-d50791b2347a tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:51:54.917256 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-e865911c-304e-4219-89f2-d50791b2347a tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] 10.222.0.50 "GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62" status: 200 len: 1417 microversion: 2.75 time: 0.452099 Aug 10 17:51:54.918540 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 337/661] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:51:54 2022] GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62 => generated 1417 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:51:54.997085 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-4d80d73a-2696-4cdc-ae4b-b897f80fdda9 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:54.999689 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-4d80d73a-2696-4cdc-ae4b-b897f80fdda9 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: 83268d7f-5375-4b01-9b5c-519be7daf0a4] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:51:55.011330 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-4d80d73a-2696-4cdc-ae4b-b897f80fdda9 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:55.011921 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-4d80d73a-2696-4cdc-ae4b-b897f80fdda9 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:55.012625 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-4d80d73a-2696-4cdc-ae4b-b897f80fdda9 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:55.013845 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-4d80d73a-2696-4cdc-ae4b-b897f80fdda9 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:55.014300 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-4d80d73a-2696-4cdc-ae4b-b897f80fdda9 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:55.014899 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-4d80d73a-2696-4cdc-ae4b-b897f80fdda9 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:55.120167 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-3e04212f-2b87-43b0-9e2e-ac33e4818e45 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:55.120875 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-3e04212f-2b87-43b0-9e2e-ac33e4818e45 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] [instance: 43ff4d86-8c12-48ce-bcf5-c607c9bcaa05] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:51:55.131457 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-3e04212f-2b87-43b0-9e2e-ac33e4818e45 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:55.133441 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-3e04212f-2b87-43b0-9e2e-ac33e4818e45 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:55.135296 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-3e04212f-2b87-43b0-9e2e-ac33e4818e45 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:55.136286 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-3e04212f-2b87-43b0-9e2e-ac33e4818e45 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:55.137613 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-3e04212f-2b87-43b0-9e2e-ac33e4818e45 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:55.138246 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-3e04212f-2b87-43b0-9e2e-ac33e4818e45 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:55.401494 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-3e04212f-2b87-43b0-9e2e-ac33e4818e45 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e109c3dcd0574faaa3d7ec31dd4edd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48bbb92998f54ebeb624bc794d406896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:51:55.418195 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-3e04212f-2b87-43b0-9e2e-ac33e4818e45 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] 10.222.0.50 "GET /compute/v2.1/servers/43ff4d86-8c12-48ce-bcf5-c607c9bcaa05" status: 200 len: 1337 microversion: 2.1 time: 0.302469 Aug 10 17:51:55.420545 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 338/662] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:51:55 2022] GET /compute/v2.1/servers/43ff4d86-8c12-48ce-bcf5-c607c9bcaa05 => generated 1337 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:51:55.488344 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-ad5e97b1-2d83-4b2d-aa57-832b01f625ad tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:55.491905 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-ad5e97b1-2d83-4b2d-aa57-832b01f625ad tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] [instance: 12eda82b-051e-446c-b78b-6c9c9f6f78d0] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:51:55.499087 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-ad5e97b1-2d83-4b2d-aa57-832b01f625ad tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:55.499617 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-ad5e97b1-2d83-4b2d-aa57-832b01f625ad tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:55.500050 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-ad5e97b1-2d83-4b2d-aa57-832b01f625ad tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:55.508665 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-ad5e97b1-2d83-4b2d-aa57-832b01f625ad tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:55.523821 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-ad5e97b1-2d83-4b2d-aa57-832b01f625ad tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:55.524367 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-ad5e97b1-2d83-4b2d-aa57-832b01f625ad tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:55.726218 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-4d80d73a-2696-4cdc-ae4b-b897f80fdda9 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:51:55.754191 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-4d80d73a-2696-4cdc-ae4b-b897f80fdda9 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/83268d7f-5375-4b01-9b5c-519be7daf0a4" status: 200 len: 1319 microversion: 2.1 time: 0.763685 Aug 10 17:51:55.762430 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 325/663] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:51:54 2022] GET /compute/v2.1/servers/83268d7f-5375-4b01-9b5c-519be7daf0a4 => generated 1319 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:51:55.777126 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-4da60f47-92e0-4c23-b1d0-f5b766884a12 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:55.790183 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-4da60f47-92e0-4c23-b1d0-f5b766884a12 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] [instance: 25b28585-a586-423f-8f04-2b2f4d28f16c] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:51:55.803601 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-4da60f47-92e0-4c23-b1d0-f5b766884a12 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:55.804269 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-4da60f47-92e0-4c23-b1d0-f5b766884a12 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:55.809576 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-4da60f47-92e0-4c23-b1d0-f5b766884a12 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:55.810642 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-4da60f47-92e0-4c23-b1d0-f5b766884a12 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:55.811337 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-4da60f47-92e0-4c23-b1d0-f5b766884a12 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:55.812039 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-4da60f47-92e0-4c23-b1d0-f5b766884a12 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:56.149108 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-4da60f47-92e0-4c23-b1d0-f5b766884a12 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83a3e198e21476eb12fcf417aea62de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df088e5a610436ea21b8a360e2bb527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:51:56.166023 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-4da60f47-92e0-4c23-b1d0-f5b766884a12 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] 10.222.0.50 "GET /compute/v2.1/servers/25b28585-a586-423f-8f04-2b2f4d28f16c" status: 200 len: 1279 microversion: 2.1 time: 0.388629 Aug 10 17:51:56.166023 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 326/664] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:51:55 2022] GET /compute/v2.1/servers/25b28585-a586-423f-8f04-2b2f4d28f16c => generated 1279 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:51:56.166493 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-ad5e97b1-2d83-4b2d-aa57-832b01f625ad tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2fd6acf18d4218ad143ccee2d0bb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7c2481a908406fa9c4562513fff665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:51:56.173564 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-0716fa38-5c37-498b-91ee-73d802784e30 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:56.174293 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-0716fa38-5c37-498b-91ee-73d802784e30 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] [instance: e2777988-0bbf-496c-9c97-b206dbc94a62] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:51:56.183278 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-ad5e97b1-2d83-4b2d-aa57-832b01f625ad tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] 10.222.0.50 "GET /compute/v2.1/servers/12eda82b-051e-446c-b78b-6c9c9f6f78d0" status: 200 len: 1313 microversion: 2.1 time: 0.701571 Aug 10 17:51:56.184726 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 339/665] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:51:55 2022] GET /compute/v2.1/servers/12eda82b-051e-446c-b78b-6c9c9f6f78d0 => generated 1313 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:51:56.192793 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-0716fa38-5c37-498b-91ee-73d802784e30 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:56.197835 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-0716fa38-5c37-498b-91ee-73d802784e30 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:56.198497 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-0716fa38-5c37-498b-91ee-73d802784e30 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:56.199493 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-0716fa38-5c37-498b-91ee-73d802784e30 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:56.199970 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-0716fa38-5c37-498b-91ee-73d802784e30 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:56.200594 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-0716fa38-5c37-498b-91ee-73d802784e30 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:56.326438 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-0716fa38-5c37-498b-91ee-73d802784e30 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:51:56.341541 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-0716fa38-5c37-498b-91ee-73d802784e30 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:51:56.343519 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-0716fa38-5c37-498b-91ee-73d802784e30 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:51:56.350241 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-0716fa38-5c37-498b-91ee-73d802784e30 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] 10.222.0.50 "GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62" status: 200 len: 1415 microversion: 2.75 time: 0.186189 Aug 10 17:51:56.366420 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 327/666] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:51:56 2022] GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62 => generated 1415 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:51:56.449111 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-24d73e6d-ce77-4295-a25b-8000934715c6 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:56.450945 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-24d73e6d-ce77-4295-a25b-8000934715c6 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] [instance: 43ff4d86-8c12-48ce-bcf5-c607c9bcaa05] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:51:56.481957 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-24d73e6d-ce77-4295-a25b-8000934715c6 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:56.483029 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-24d73e6d-ce77-4295-a25b-8000934715c6 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:56.483756 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-24d73e6d-ce77-4295-a25b-8000934715c6 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:56.485739 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-24d73e6d-ce77-4295-a25b-8000934715c6 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:56.487509 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-24d73e6d-ce77-4295-a25b-8000934715c6 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:56.491348 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-24d73e6d-ce77-4295-a25b-8000934715c6 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:56.737810 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [req-119061de-3e88-4724-a243-6e0b6f0f12a9 req-159965f2-b95b-4706-b047-d45f69e75acd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12eda82b-051e-446c-b78b-6c9c9f6f78d0", "tag": "178a85c3-8f3f-4fb1-89ab-d84c805185db"}]} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:51:56.760114 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-119061de-3e88-4724-a243-6e0b6f0f12a9 req-159965f2-b95b-4706-b047-d45f69e75acd service nova] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:56.760624 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-119061de-3e88-4724-a243-6e0b6f0f12a9 req-159965f2-b95b-4706-b047-d45f69e75acd service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:56.761984 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-119061de-3e88-4724-a243-6e0b6f0f12a9 req-159965f2-b95b-4706-b047-d45f69e75acd service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:56.784556 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.compute.server_external_events [req-119061de-3e88-4724-a243-6e0b6f0f12a9 req-159965f2-b95b-4706-b047-d45f69e75acd service nova] Creating event network-changed:178a85c3-8f3f-4fb1-89ab-d84c805185db for instance 12eda82b-051e-446c-b78b-6c9c9f6f78d0 on n-h2-852296-2 Aug 10 17:51:56.796272 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [req-119061de-3e88-4724-a243-6e0b6f0f12a9 req-159965f2-b95b-4706-b047-d45f69e75acd service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063996 Aug 10 17:51:56.800362 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 328/667] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 10 17:51:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:51:56.825327 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-200b1510-56a8-4a14-9058-9087b48f1668 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:56.837470 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-200b1510-56a8-4a14-9058-9087b48f1668 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: 83268d7f-5375-4b01-9b5c-519be7daf0a4] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:51:56.844180 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-24d73e6d-ce77-4295-a25b-8000934715c6 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e109c3dcd0574faaa3d7ec31dd4edd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48bbb92998f54ebeb624bc794d406896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:51:56.866865 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-24d73e6d-ce77-4295-a25b-8000934715c6 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] 10.222.0.50 "GET /compute/v2.1/servers/43ff4d86-8c12-48ce-bcf5-c607c9bcaa05" status: 200 len: 1337 microversion: 2.1 time: 0.424377 Aug 10 17:51:56.873031 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-200b1510-56a8-4a14-9058-9087b48f1668 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:56.873456 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-200b1510-56a8-4a14-9058-9087b48f1668 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:56.873903 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-200b1510-56a8-4a14-9058-9087b48f1668 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:56.874759 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-200b1510-56a8-4a14-9058-9087b48f1668 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:56.875068 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-200b1510-56a8-4a14-9058-9087b48f1668 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:56.878974 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 340/668] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:51:56 2022] GET /compute/v2.1/servers/43ff4d86-8c12-48ce-bcf5-c607c9bcaa05 => generated 1337 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:51:56.880852 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-200b1510-56a8-4a14-9058-9087b48f1668 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:57.186388 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-f30a4835-8643-4520-b20d-63c6d3a88c94 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:57.271516 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-f30a4835-8643-4520-b20d-63c6d3a88c94 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] [instance: 25b28585-a586-423f-8f04-2b2f4d28f16c] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:51:57.271516 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-f30a4835-8643-4520-b20d-63c6d3a88c94 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:57.271516 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-f30a4835-8643-4520-b20d-63c6d3a88c94 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:57.271516 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-f30a4835-8643-4520-b20d-63c6d3a88c94 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:57.271516 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-f30a4835-8643-4520-b20d-63c6d3a88c94 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:57.271516 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-f30a4835-8643-4520-b20d-63c6d3a88c94 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:57.271516 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-f30a4835-8643-4520-b20d-63c6d3a88c94 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:57.460557 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-f30a4835-8643-4520-b20d-63c6d3a88c94 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83a3e198e21476eb12fcf417aea62de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df088e5a610436ea21b8a360e2bb527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:51:57.471377 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-f30a4835-8643-4520-b20d-63c6d3a88c94 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] 10.222.0.50 "GET /compute/v2.1/servers/25b28585-a586-423f-8f04-2b2f4d28f16c" status: 200 len: 1279 microversion: 2.1 time: 0.289163 Aug 10 17:51:57.473544 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 341/669] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:51:57 2022] GET /compute/v2.1/servers/25b28585-a586-423f-8f04-2b2f4d28f16c => generated 1279 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:51:57.480801 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-919d665a-e9f6-4233-9cdc-2087896d8c67 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:57.489714 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-919d665a-e9f6-4233-9cdc-2087896d8c67 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] [instance: 12eda82b-051e-446c-b78b-6c9c9f6f78d0] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:51:57.494577 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-919d665a-e9f6-4233-9cdc-2087896d8c67 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:57.506207 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-919d665a-e9f6-4233-9cdc-2087896d8c67 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:57.507461 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-919d665a-e9f6-4233-9cdc-2087896d8c67 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:57.511138 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-919d665a-e9f6-4233-9cdc-2087896d8c67 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:57.512848 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-919d665a-e9f6-4233-9cdc-2087896d8c67 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:57.513803 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-919d665a-e9f6-4233-9cdc-2087896d8c67 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:58.099517 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-200b1510-56a8-4a14-9058-9087b48f1668 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:51:58.116783 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-200b1510-56a8-4a14-9058-9087b48f1668 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/83268d7f-5375-4b01-9b5c-519be7daf0a4" status: 200 len: 1319 microversion: 2.1 time: 1.306040 Aug 10 17:51:58.117608 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 329/670] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:51:56 2022] GET /compute/v2.1/servers/83268d7f-5375-4b01-9b5c-519be7daf0a4 => generated 1319 bytes in 1316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:51:58.129066 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-9b3178d0-d34b-4446-a922-efd0041b16f9 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:58.133380 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-9b3178d0-d34b-4446-a922-efd0041b16f9 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] [instance: e2777988-0bbf-496c-9c97-b206dbc94a62] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:51:58.143552 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-9b3178d0-d34b-4446-a922-efd0041b16f9 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:58.144153 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-9b3178d0-d34b-4446-a922-efd0041b16f9 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:58.144720 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-9b3178d0-d34b-4446-a922-efd0041b16f9 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:58.145535 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-9b3178d0-d34b-4446-a922-efd0041b16f9 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:58.146104 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-9b3178d0-d34b-4446-a922-efd0041b16f9 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:58.146621 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-9b3178d0-d34b-4446-a922-efd0041b16f9 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:58.240486 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-919d665a-e9f6-4233-9cdc-2087896d8c67 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2fd6acf18d4218ad143ccee2d0bb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7c2481a908406fa9c4562513fff665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:51:58.278026 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-919d665a-e9f6-4233-9cdc-2087896d8c67 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] 10.222.0.50 "GET /compute/v2.1/servers/12eda82b-051e-446c-b78b-6c9c9f6f78d0" status: 200 len: 1313 microversion: 2.1 time: 0.802379 Aug 10 17:51:58.282329 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 342/671] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:51:57 2022] GET /compute/v2.1/servers/12eda82b-051e-446c-b78b-6c9c9f6f78d0 => generated 1313 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:51:58.284547 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-f5abebe2-cc3a-408c-886d-67b92acc5af4 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:58.286069 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-f5abebe2-cc3a-408c-886d-67b92acc5af4 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] [instance: 43ff4d86-8c12-48ce-bcf5-c607c9bcaa05] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:51:58.314782 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-9b3178d0-d34b-4446-a922-efd0041b16f9 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:51:58.321677 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:51:58.323392 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-f5abebe2-cc3a-408c-886d-67b92acc5af4 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:58.324067 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-f5abebe2-cc3a-408c-886d-67b92acc5af4 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:58.325059 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-f5abebe2-cc3a-408c-886d-67b92acc5af4 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:58.325950 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-f5abebe2-cc3a-408c-886d-67b92acc5af4 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:58.326635 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-f5abebe2-cc3a-408c-886d-67b92acc5af4 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:58.326758 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-9b3178d0-d34b-4446-a922-efd0041b16f9 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:51:58.327356 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-f5abebe2-cc3a-408c-886d-67b92acc5af4 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:58.330445 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-9b3178d0-d34b-4446-a922-efd0041b16f9 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:51:58.350703 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-9b3178d0-d34b-4446-a922-efd0041b16f9 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] 10.222.0.50 "GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62" status: 200 len: 1415 microversion: 2.75 time: 0.228740 Aug 10 17:51:58.350703 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 330/672] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:51:58 2022] GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62 => generated 1415 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:51:58.496197 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-22a35360-8996-41df-83c4-29d00d7355ba tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:58.497124 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-22a35360-8996-41df-83c4-29d00d7355ba tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] [instance: 25b28585-a586-423f-8f04-2b2f4d28f16c] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:51:58.505099 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-22a35360-8996-41df-83c4-29d00d7355ba tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:58.511401 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-22a35360-8996-41df-83c4-29d00d7355ba tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:58.511401 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-22a35360-8996-41df-83c4-29d00d7355ba tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:58.511401 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-22a35360-8996-41df-83c4-29d00d7355ba tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:58.511401 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-22a35360-8996-41df-83c4-29d00d7355ba tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:58.511401 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-22a35360-8996-41df-83c4-29d00d7355ba tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:58.685028 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-22a35360-8996-41df-83c4-29d00d7355ba tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83a3e198e21476eb12fcf417aea62de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df088e5a610436ea21b8a360e2bb527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:51:58.697514 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-22a35360-8996-41df-83c4-29d00d7355ba tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] 10.222.0.50 "GET /compute/v2.1/servers/25b28585-a586-423f-8f04-2b2f4d28f16c" status: 200 len: 1279 microversion: 2.1 time: 0.205009 Aug 10 17:51:58.700321 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 331/673] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:51:58 2022] GET /compute/v2.1/servers/25b28585-a586-423f-8f04-2b2f4d28f16c => generated 1279 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:51:58.853413 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-f5abebe2-cc3a-408c-886d-67b92acc5af4 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e109c3dcd0574faaa3d7ec31dd4edd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48bbb92998f54ebeb624bc794d406896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:51:58.878735 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-f5abebe2-cc3a-408c-886d-67b92acc5af4 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] 10.222.0.50 "GET /compute/v2.1/servers/43ff4d86-8c12-48ce-bcf5-c607c9bcaa05" status: 200 len: 1379 microversion: 2.1 time: 0.598344 Aug 10 17:51:58.889798 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 343/674] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:51:58 2022] GET /compute/v2.1/servers/43ff4d86-8c12-48ce-bcf5-c607c9bcaa05 => generated 1379 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:51:59.141925 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-fcaa1781-8f13-4a37-8c1c-f37a1ca05344 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:59.142686 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-fcaa1781-8f13-4a37-8c1c-f37a1ca05344 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: 83268d7f-5375-4b01-9b5c-519be7daf0a4] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:51:59.152135 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-fcaa1781-8f13-4a37-8c1c-f37a1ca05344 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:59.157758 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-fcaa1781-8f13-4a37-8c1c-f37a1ca05344 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:59.157758 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-fcaa1781-8f13-4a37-8c1c-f37a1ca05344 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:59.157758 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-fcaa1781-8f13-4a37-8c1c-f37a1ca05344 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:59.157758 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-fcaa1781-8f13-4a37-8c1c-f37a1ca05344 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:59.157758 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-fcaa1781-8f13-4a37-8c1c-f37a1ca05344 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:59.307373 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-b37455d9-cc42-48d8-8897-fca4acc7e3f5 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:59.309282 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-b37455d9-cc42-48d8-8897-fca4acc7e3f5 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] [instance: 12eda82b-051e-446c-b78b-6c9c9f6f78d0] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:51:59.317439 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_cell0:SELECT=9 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:51:59.319157 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b37455d9-cc42-48d8-8897-fca4acc7e3f5 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:59.319914 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b37455d9-cc42-48d8-8897-fca4acc7e3f5 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:59.320560 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b37455d9-cc42-48d8-8897-fca4acc7e3f5 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:59.324460 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b37455d9-cc42-48d8-8897-fca4acc7e3f5 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:59.324460 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b37455d9-cc42-48d8-8897-fca4acc7e3f5 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:59.325161 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b37455d9-cc42-48d8-8897-fca4acc7e3f5 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:59.334452 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_cell0:SELECT=8 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:51:59.950450 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-b37455d9-cc42-48d8-8897-fca4acc7e3f5 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2fd6acf18d4218ad143ccee2d0bb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7c2481a908406fa9c4562513fff665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:51:59.965906 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-b37455d9-cc42-48d8-8897-fca4acc7e3f5 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] 10.222.0.50 "GET /compute/v2.1/servers/12eda82b-051e-446c-b78b-6c9c9f6f78d0" status: 200 len: 1313 microversion: 2.1 time: 0.666174 Aug 10 17:51:59.967993 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 344/675] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:51:59 2022] GET /compute/v2.1/servers/12eda82b-051e-446c-b78b-6c9c9f6f78d0 => generated 1313 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:51:59.974556 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-ac09b9af-57a4-40af-b2b2-666deeb659cb tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:51:59.976763 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-ac09b9af-57a4-40af-b2b2-666deeb659cb tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] [instance: e2777988-0bbf-496c-9c97-b206dbc94a62] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:51:59.986495 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-fcaa1781-8f13-4a37-8c1c-f37a1ca05344 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:51:59.986776 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-ac09b9af-57a4-40af-b2b2-666deeb659cb tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:59.987456 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-ac09b9af-57a4-40af-b2b2-666deeb659cb tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:59.988337 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-ac09b9af-57a4-40af-b2b2-666deeb659cb tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:59.989238 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-ac09b9af-57a4-40af-b2b2-666deeb659cb tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:51:59.990907 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-ac09b9af-57a4-40af-b2b2-666deeb659cb tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:51:59.991747 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-ac09b9af-57a4-40af-b2b2-666deeb659cb tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:51:59.996337 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-fcaa1781-8f13-4a37-8c1c-f37a1ca05344 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/83268d7f-5375-4b01-9b5c-519be7daf0a4" status: 200 len: 1319 microversion: 2.1 time: 0.861865 Aug 10 17:51:59.997361 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 332/676] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:51:59 2022] GET /compute/v2.1/servers/83268d7f-5375-4b01-9b5c-519be7daf0a4 => generated 1319 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:00.006092 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [req-7cfd1776-e3c2-4432-9eb6-215e096147bb req-e22b9bf8-b629-47f4-8844-361fde049b91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d821054-dce7-4015-8eaa-d8c56e7c3cd3", "tag": "b2611f6e-dc7c-4074-b71e-211cff945882"}]} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:52:00.039202 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-7cfd1776-e3c2-4432-9eb6-215e096147bb req-e22b9bf8-b629-47f4-8844-361fde049b91 service nova] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:00.040051 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-7cfd1776-e3c2-4432-9eb6-215e096147bb req-e22b9bf8-b629-47f4-8844-361fde049b91 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:00.040742 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-7cfd1776-e3c2-4432-9eb6-215e096147bb req-e22b9bf8-b629-47f4-8844-361fde049b91 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:00.073264 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.compute.server_external_events [req-7cfd1776-e3c2-4432-9eb6-215e096147bb req-e22b9bf8-b629-47f4-8844-361fde049b91 service nova] Creating event network-changed:b2611f6e-dc7c-4074-b71e-211cff945882 for instance 0d821054-dce7-4015-8eaa-d8c56e7c3cd3 on n-h2-852296-2 Aug 10 17:52:00.091979 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [req-7cfd1776-e3c2-4432-9eb6-215e096147bb req-e22b9bf8-b629-47f4-8844-361fde049b91 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090919 Aug 10 17:52:00.093956 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 333/677] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 10 17:51:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:52:00.109613 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-21624a82-26a0-4295-9274-0d1488964e76 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:00.111474 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-21624a82-26a0-4295-9274-0d1488964e76 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] [instance: 25b28585-a586-423f-8f04-2b2f4d28f16c] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:00.117900 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-21624a82-26a0-4295-9274-0d1488964e76 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:00.118396 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-21624a82-26a0-4295-9274-0d1488964e76 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:00.118829 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-21624a82-26a0-4295-9274-0d1488964e76 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:00.119734 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-21624a82-26a0-4295-9274-0d1488964e76 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:00.120488 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-21624a82-26a0-4295-9274-0d1488964e76 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:00.121081 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-21624a82-26a0-4295-9274-0d1488964e76 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:00.143058 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_cell1:SELECT=100 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:52:00.171858 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-ac09b9af-57a4-40af-b2b2-666deeb659cb tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:00.183803 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-ac09b9af-57a4-40af-b2b2-666deeb659cb tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:00.186794 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-ac09b9af-57a4-40af-b2b2-666deeb659cb tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:00.200463 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-ac09b9af-57a4-40af-b2b2-666deeb659cb tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] 10.222.0.50 "GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62" status: 200 len: 1415 microversion: 2.75 time: 0.230963 Aug 10 17:52:00.203413 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 345/678] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:51:59 2022] GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62 => generated 1415 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:52:00.208020 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-41b8d14f-9c4e-49b6-a39e-698abebc2824 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:00.208827 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-41b8d14f-9c4e-49b6-a39e-698abebc2824 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] [instance: 43ff4d86-8c12-48ce-bcf5-c607c9bcaa05] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:00.217878 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-41b8d14f-9c4e-49b6-a39e-698abebc2824 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:00.218592 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-41b8d14f-9c4e-49b6-a39e-698abebc2824 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:00.219788 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-41b8d14f-9c4e-49b6-a39e-698abebc2824 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:00.220577 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-41b8d14f-9c4e-49b6-a39e-698abebc2824 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:00.221185 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-41b8d14f-9c4e-49b6-a39e-698abebc2824 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:00.222067 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-41b8d14f-9c4e-49b6-a39e-698abebc2824 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:00.285765 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-21624a82-26a0-4295-9274-0d1488964e76 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83a3e198e21476eb12fcf417aea62de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df088e5a610436ea21b8a360e2bb527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:00.297682 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-21624a82-26a0-4295-9274-0d1488964e76 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] 10.222.0.50 "GET /compute/v2.1/servers/25b28585-a586-423f-8f04-2b2f4d28f16c" status: 200 len: 1279 microversion: 2.1 time: 0.191893 Aug 10 17:52:00.306549 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 334/679] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:00 2022] GET /compute/v2.1/servers/25b28585-a586-423f-8f04-2b2f4d28f16c => generated 1279 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:00.805603 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-c65d484e-b0e8-4b66-b1af-64f4f867e5c4 tempest-AttachVolumeShelveTestJSON-21911967 tempest-AttachVolumeShelveTestJSON-21911967-project] Action: 'create', calling method: .version_select at 0x7fb346791430>, body: {"keypair": {"name": "tempest-keypair-212280872", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHYYtbmL5kvAaJa/HLCb9YTrVgnjVLd+ClCIDiisxzvDjSS0ZOfQwxBl0R3McXi/uBv79wWyBp0jW1BHvZ9Uf0qEYrtqnTMF+3waFKu57tZqzImBR4iqGKEbHFes0ovN6g=="}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:52:00.939002 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-c65d484e-b0e8-4b66-b1af-64f4f867e5c4 tempest-AttachVolumeShelveTestJSON-21911967 tempest-AttachVolumeShelveTestJSON-21911967-project] Getting quotas for project 81e24e5e4b5946af87ed8621126ca737. Resources: {'key_pairs'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:52:00.939002 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-c65d484e-b0e8-4b66-b1af-64f4f867e5c4 tempest-AttachVolumeShelveTestJSON-21911967 tempest-AttachVolumeShelveTestJSON-21911967-project] Getting quotas for user 2f42cb7cd86e497ab532c5cd5e05c99d and project 81e24e5e4b5946af87ed8621126ca737. Resources: {'key_pairs'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:52:01.067227 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-41b8d14f-9c4e-49b6-a39e-698abebc2824 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e109c3dcd0574faaa3d7ec31dd4edd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48bbb92998f54ebeb624bc794d406896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:01.080801 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-41b8d14f-9c4e-49b6-a39e-698abebc2824 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] 10.222.0.50 "GET /compute/v2.1/servers/43ff4d86-8c12-48ce-bcf5-c607c9bcaa05" status: 200 len: 1379 microversion: 2.1 time: 0.878032 Aug 10 17:52:01.081435 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 346/680] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:00 2022] GET /compute/v2.1/servers/43ff4d86-8c12-48ce-bcf5-c607c9bcaa05 => generated 1379 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:01.097516 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [req-16defbeb-327a-473e-a0c9-e8e802ce5e47 req-57358d73-dfbc-46b5-906f-78d5c6f14d3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83268d7f-5375-4b01-9b5c-519be7daf0a4", "tag": "7e62831c-3860-4779-a6c1-a2c8317ac744"}]} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:52:01.118563 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-16defbeb-327a-473e-a0c9-e8e802ce5e47 req-57358d73-dfbc-46b5-906f-78d5c6f14d3c service nova] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:01.120358 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-16defbeb-327a-473e-a0c9-e8e802ce5e47 req-57358d73-dfbc-46b5-906f-78d5c6f14d3c service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:01.122069 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-16defbeb-327a-473e-a0c9-e8e802ce5e47 req-57358d73-dfbc-46b5-906f-78d5c6f14d3c service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:01.161737 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.compute.server_external_events [req-16defbeb-327a-473e-a0c9-e8e802ce5e47 req-57358d73-dfbc-46b5-906f-78d5c6f14d3c service nova] Creating event network-changed:7e62831c-3860-4779-a6c1-a2c8317ac744 for instance 83268d7f-5375-4b01-9b5c-519be7daf0a4 on n-h1-852296-2 Aug 10 17:52:01.180072 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [req-16defbeb-327a-473e-a0c9-e8e802ce5e47 req-57358d73-dfbc-46b5-906f-78d5c6f14d3c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097125 Aug 10 17:52:01.181228 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 347/681] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 10 17:52:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:52:01.189990 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-d3df0e84-dc10-42c8-aeb6-349dc779cdf8 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:01.195604 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-d3df0e84-dc10-42c8-aeb6-349dc779cdf8 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] [instance: 12eda82b-051e-446c-b78b-6c9c9f6f78d0] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:01.219997 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d3df0e84-dc10-42c8-aeb6-349dc779cdf8 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:01.219997 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d3df0e84-dc10-42c8-aeb6-349dc779cdf8 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:01.220381 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d3df0e84-dc10-42c8-aeb6-349dc779cdf8 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:01.221238 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d3df0e84-dc10-42c8-aeb6-349dc779cdf8 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:01.222131 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d3df0e84-dc10-42c8-aeb6-349dc779cdf8 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:01.222630 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d3df0e84-dc10-42c8-aeb6-349dc779cdf8 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:01.526892 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-d3df0e84-dc10-42c8-aeb6-349dc779cdf8 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2fd6acf18d4218ad143ccee2d0bb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7c2481a908406fa9c4562513fff665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:01.535247 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-d3df0e84-dc10-42c8-aeb6-349dc779cdf8 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] 10.222.0.50 "GET /compute/v2.1/servers/12eda82b-051e-446c-b78b-6c9c9f6f78d0" status: 200 len: 1313 microversion: 2.1 time: 0.352550 Aug 10 17:52:01.536091 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 348/682] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:01 2022] GET /compute/v2.1/servers/12eda82b-051e-446c-b78b-6c9c9f6f78d0 => generated 1313 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:01.540744 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-87a48970-a302-4d23-9624-63b676ffdbbe tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:01.541346 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-87a48970-a302-4d23-9624-63b676ffdbbe tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: 83268d7f-5375-4b01-9b5c-519be7daf0a4] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:01.547093 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-87a48970-a302-4d23-9624-63b676ffdbbe tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:01.547646 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-87a48970-a302-4d23-9624-63b676ffdbbe tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:01.548077 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-87a48970-a302-4d23-9624-63b676ffdbbe tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:01.548803 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-87a48970-a302-4d23-9624-63b676ffdbbe tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:01.549257 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-87a48970-a302-4d23-9624-63b676ffdbbe tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:01.549681 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-87a48970-a302-4d23-9624-63b676ffdbbe tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:01.667730 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_cell0:SELECT=45 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:52:01.782357 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-87a48970-a302-4d23-9624-63b676ffdbbe tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:01.782357 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-87a48970-a302-4d23-9624-63b676ffdbbe tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/83268d7f-5375-4b01-9b5c-519be7daf0a4" status: 200 len: 1319 microversion: 2.1 time: 0.185863 Aug 10 17:52:01.782357 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 349/683] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:01 2022] GET /compute/v2.1/servers/83268d7f-5375-4b01-9b5c-519be7daf0a4 => generated 1319 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:01.782357 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-ef0f1694-8782-4966-8441-067aff5a063a tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:01.782357 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-ef0f1694-8782-4966-8441-067aff5a063a tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] [instance: e2777988-0bbf-496c-9c97-b206dbc94a62] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:01.782357 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-ef0f1694-8782-4966-8441-067aff5a063a tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:01.782357 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-ef0f1694-8782-4966-8441-067aff5a063a tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:01.782357 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-ef0f1694-8782-4966-8441-067aff5a063a tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:01.782357 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-ef0f1694-8782-4966-8441-067aff5a063a tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:01.782357 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-ef0f1694-8782-4966-8441-067aff5a063a tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:01.782357 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-ef0f1694-8782-4966-8441-067aff5a063a tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:01.819664 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-ef0f1694-8782-4966-8441-067aff5a063a tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:01.829514 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-ef0f1694-8782-4966-8441-067aff5a063a tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:01.831047 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-ef0f1694-8782-4966-8441-067aff5a063a tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:01.836117 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-ef0f1694-8782-4966-8441-067aff5a063a tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] 10.222.0.50 "GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62" status: 200 len: 1436 microversion: 2.75 time: 0.111344 Aug 10 17:52:01.837039 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 350/684] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:52:01 2022] GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62 => generated 1436 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:52:01.841444 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-fef6d811-c5b5-4991-84b9-50b2a52b75d8 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:01.842237 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-fef6d811-c5b5-4991-84b9-50b2a52b75d8 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] [instance: 25b28585-a586-423f-8f04-2b2f4d28f16c] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:01.848383 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-fef6d811-c5b5-4991-84b9-50b2a52b75d8 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:01.849208 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-fef6d811-c5b5-4991-84b9-50b2a52b75d8 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:01.849944 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-fef6d811-c5b5-4991-84b9-50b2a52b75d8 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:01.850954 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-fef6d811-c5b5-4991-84b9-50b2a52b75d8 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:01.851554 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-fef6d811-c5b5-4991-84b9-50b2a52b75d8 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:01.852346 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-fef6d811-c5b5-4991-84b9-50b2a52b75d8 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:02.056193 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-fef6d811-c5b5-4991-84b9-50b2a52b75d8 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83a3e198e21476eb12fcf417aea62de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df088e5a610436ea21b8a360e2bb527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:02.065831 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-fef6d811-c5b5-4991-84b9-50b2a52b75d8 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] 10.222.0.50 "GET /compute/v2.1/servers/25b28585-a586-423f-8f04-2b2f4d28f16c" status: 200 len: 1321 microversion: 2.1 time: 0.227761 Aug 10 17:52:02.076299 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 351/685] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:01 2022] GET /compute/v2.1/servers/25b28585-a586-423f-8f04-2b2f4d28f16c => generated 1321 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:02.076299 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-ff7c9d42-d36d-4baf-a756-49a8fc453280 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f"}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:52:02.076299 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-ff7c9d42-d36d-4baf-a756-49a8fc453280 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] [instance: e2777988-0bbf-496c-9c97-b206dbc94a62] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:02.085295 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-ff7c9d42-d36d-4baf-a756-49a8fc453280 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:02.085295 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-ff7c9d42-d36d-4baf-a756-49a8fc453280 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:02.085609 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-ff7c9d42-d36d-4baf-a756-49a8fc453280 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:02.086199 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-ff7c9d42-d36d-4baf-a756-49a8fc453280 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:02.086667 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-ff7c9d42-d36d-4baf-a756-49a8fc453280 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:02.087102 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-ff7c9d42-d36d-4baf-a756-49a8fc453280 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:02.196479 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.virt.hardware [None req-ff7c9d42-d36d-4baf-a756-49a8fc453280 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Flavor limits 0:0:0 {{(pid=129410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 17:52:02.196903 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.virt.hardware [None req-ff7c9d42-d36d-4baf-a756-49a8fc453280 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Image limits 0:0:0 {{(pid=129410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 17:52:02.197381 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.virt.hardware [None req-ff7c9d42-d36d-4baf-a756-49a8fc453280 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Flavor pref 0:0:0 {{(pid=129410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 17:52:02.197785 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.virt.hardware [None req-ff7c9d42-d36d-4baf-a756-49a8fc453280 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Image pref 0:0:0 {{(pid=129410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 17:52:02.198197 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.virt.hardware [None req-ff7c9d42-d36d-4baf-a756-49a8fc453280 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 17:52:02.471601 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-c65d484e-b0e8-4b66-b1af-64f4f867e5c4 tempest-AttachVolumeShelveTestJSON-21911967 tempest-AttachVolumeShelveTestJSON-21911967-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 1.915523 Aug 10 17:52:02.472217 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 335/686] 10.222.0.50 () {62 vars in 1200 bytes} [Wed Aug 10 17:52:00 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 1917 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Aug 10 17:52:02.489751 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-c7fd64cc-f934-46f9-86dc-590f619fe566 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:02.490367 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-c7fd64cc-f934-46f9-86dc-590f619fe566 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] [instance: 43ff4d86-8c12-48ce-bcf5-c607c9bcaa05] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:02.526937 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c7fd64cc-f934-46f9-86dc-590f619fe566 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:02.528358 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c7fd64cc-f934-46f9-86dc-590f619fe566 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:02.529020 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c7fd64cc-f934-46f9-86dc-590f619fe566 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:02.532236 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c7fd64cc-f934-46f9-86dc-590f619fe566 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:02.537999 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c7fd64cc-f934-46f9-86dc-590f619fe566 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:02.538718 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c7fd64cc-f934-46f9-86dc-590f619fe566 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:02.775355 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-ff7c9d42-d36d-4baf-a756-49a8fc453280 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] [instance: e2777988-0bbf-496c-9c97-b206dbc94a62] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:02.787983 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-ff7c9d42-d36d-4baf-a756-49a8fc453280 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:02.789113 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-ff7c9d42-d36d-4baf-a756-49a8fc453280 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:02.789955 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-ff7c9d42-d36d-4baf-a756-49a8fc453280 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:02.792182 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-ff7c9d42-d36d-4baf-a756-49a8fc453280 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:02.793211 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-ff7c9d42-d36d-4baf-a756-49a8fc453280 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:02.794445 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-ff7c9d42-d36d-4baf-a756-49a8fc453280 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:02.804208 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:52:03.132669 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-ff7c9d42-d36d-4baf-a756-49a8fc453280 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:03.143235 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-ff7c9d42-d36d-4baf-a756-49a8fc453280 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:03.144852 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-ff7c9d42-d36d-4baf-a756-49a8fc453280 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:03.159369 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-ff7c9d42-d36d-4baf-a756-49a8fc453280 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] 10.222.0.50 "POST /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62/action" status: 202 len: 1493 microversion: 2.75 time: 1.091551 Aug 10 17:52:03.160017 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 352/687] 10.222.0.50 () {62 vars in 1319 bytes} [Wed Aug 10 17:52:02 2022] POST /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62/action => generated 1493 bytes in 1093 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 10 17:52:03.188384 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-9d4bfec2-1499-4a0c-b6d2-d672b7812cec tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:03.189303 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-9d4bfec2-1499-4a0c-b6d2-d672b7812cec tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] [instance: 12eda82b-051e-446c-b78b-6c9c9f6f78d0] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:03.197101 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-9d4bfec2-1499-4a0c-b6d2-d672b7812cec tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:03.197588 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-9d4bfec2-1499-4a0c-b6d2-d672b7812cec tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:03.198346 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-9d4bfec2-1499-4a0c-b6d2-d672b7812cec tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:03.199117 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-9d4bfec2-1499-4a0c-b6d2-d672b7812cec tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:03.199568 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-9d4bfec2-1499-4a0c-b6d2-d672b7812cec tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:03.200084 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-9d4bfec2-1499-4a0c-b6d2-d672b7812cec tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:03.243657 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-c7fd64cc-f934-46f9-86dc-590f619fe566 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e109c3dcd0574faaa3d7ec31dd4edd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48bbb92998f54ebeb624bc794d406896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:03.258723 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-c7fd64cc-f934-46f9-86dc-590f619fe566 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] 10.222.0.50 "GET /compute/v2.1/servers/43ff4d86-8c12-48ce-bcf5-c607c9bcaa05" status: 200 len: 1379 microversion: 2.1 time: 0.782222 Aug 10 17:52:03.260647 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 336/688] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:02 2022] GET /compute/v2.1/servers/43ff4d86-8c12-48ce-bcf5-c607c9bcaa05 => generated 1379 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:03.273485 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-5b2f24ba-9058-40d7-a83d-0a59cd0ca575 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:03.277031 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-5b2f24ba-9058-40d7-a83d-0a59cd0ca575 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: 83268d7f-5375-4b01-9b5c-519be7daf0a4] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:03.280112 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:52:03.295025 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-5b2f24ba-9058-40d7-a83d-0a59cd0ca575 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:03.295512 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-5b2f24ba-9058-40d7-a83d-0a59cd0ca575 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:03.302104 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-5b2f24ba-9058-40d7-a83d-0a59cd0ca575 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:03.303755 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-5b2f24ba-9058-40d7-a83d-0a59cd0ca575 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:03.304084 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-5b2f24ba-9058-40d7-a83d-0a59cd0ca575 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:03.304548 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-5b2f24ba-9058-40d7-a83d-0a59cd0ca575 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:04.058098 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-5b2f24ba-9058-40d7-a83d-0a59cd0ca575 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:04.075501 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-5b2f24ba-9058-40d7-a83d-0a59cd0ca575 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/83268d7f-5375-4b01-9b5c-519be7daf0a4" status: 200 len: 1319 microversion: 2.1 time: 0.809520 Aug 10 17:52:04.076152 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 337/689] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:03 2022] GET /compute/v2.1/servers/83268d7f-5375-4b01-9b5c-519be7daf0a4 => generated 1319 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:04.099463 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-87ef5ac8-8fc6-4881-ba49-070b801b7736 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:04.100061 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-87ef5ac8-8fc6-4881-ba49-070b801b7736 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] [instance: 25b28585-a586-423f-8f04-2b2f4d28f16c] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:04.107467 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-87ef5ac8-8fc6-4881-ba49-070b801b7736 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:04.108303 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-87ef5ac8-8fc6-4881-ba49-070b801b7736 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:04.108617 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-87ef5ac8-8fc6-4881-ba49-070b801b7736 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:04.113708 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-87ef5ac8-8fc6-4881-ba49-070b801b7736 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:04.114360 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-87ef5ac8-8fc6-4881-ba49-070b801b7736 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:04.114917 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-87ef5ac8-8fc6-4881-ba49-070b801b7736 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:04.120839 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-9d4bfec2-1499-4a0c-b6d2-d672b7812cec tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2fd6acf18d4218ad143ccee2d0bb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7c2481a908406fa9c4562513fff665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:04.137352 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-9d4bfec2-1499-4a0c-b6d2-d672b7812cec tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] 10.222.0.50 "GET /compute/v2.1/servers/12eda82b-051e-446c-b78b-6c9c9f6f78d0" status: 200 len: 1313 microversion: 2.1 time: 0.962981 Aug 10 17:52:04.147476 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 353/690] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:03 2022] GET /compute/v2.1/servers/12eda82b-051e-446c-b78b-6c9c9f6f78d0 => generated 1313 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:04.158152 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-55d944f3-2714-4bdb-bc14-b7b330c375c3 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:04.159314 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-55d944f3-2714-4bdb-bc14-b7b330c375c3 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] [instance: e2777988-0bbf-496c-9c97-b206dbc94a62] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:04.166034 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-55d944f3-2714-4bdb-bc14-b7b330c375c3 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:04.169018 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-55d944f3-2714-4bdb-bc14-b7b330c375c3 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:04.169456 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-55d944f3-2714-4bdb-bc14-b7b330c375c3 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:04.170345 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-55d944f3-2714-4bdb-bc14-b7b330c375c3 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:04.170815 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-55d944f3-2714-4bdb-bc14-b7b330c375c3 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:04.171235 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-55d944f3-2714-4bdb-bc14-b7b330c375c3 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:04.386211 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-55d944f3-2714-4bdb-bc14-b7b330c375c3 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:04.404609 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-55d944f3-2714-4bdb-bc14-b7b330c375c3 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:04.407040 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-55d944f3-2714-4bdb-bc14-b7b330c375c3 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:04.423166 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-55d944f3-2714-4bdb-bc14-b7b330c375c3 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] 10.222.0.50 "GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62" status: 200 len: 1445 microversion: 2.75 time: 0.272642 Aug 10 17:52:04.426551 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 354/691] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:52:04 2022] GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62 => generated 1445 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:52:04.444528 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-4503d199-2bce-4583-a8de-a488195a08b4 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:04.447449 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-4503d199-2bce-4583-a8de-a488195a08b4 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] [instance: 43ff4d86-8c12-48ce-bcf5-c607c9bcaa05] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:04.463513 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-4503d199-2bce-4583-a8de-a488195a08b4 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:04.467537 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-4503d199-2bce-4583-a8de-a488195a08b4 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:04.467934 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-4503d199-2bce-4583-a8de-a488195a08b4 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:04.468775 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-4503d199-2bce-4583-a8de-a488195a08b4 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:04.469332 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-4503d199-2bce-4583-a8de-a488195a08b4 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:04.469835 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-4503d199-2bce-4583-a8de-a488195a08b4 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:04.622122 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-87ef5ac8-8fc6-4881-ba49-070b801b7736 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83a3e198e21476eb12fcf417aea62de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df088e5a610436ea21b8a360e2bb527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:04.645966 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-87ef5ac8-8fc6-4881-ba49-070b801b7736 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] 10.222.0.50 "GET /compute/v2.1/servers/25b28585-a586-423f-8f04-2b2f4d28f16c" status: 200 len: 1321 microversion: 2.1 time: 0.544263 Aug 10 17:52:04.647671 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 338/692] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:04 2022] GET /compute/v2.1/servers/25b28585-a586-423f-8f04-2b2f4d28f16c => generated 1321 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:04.655821 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [req-ae889484-6e7f-43ba-a7a5-21622fe04a15 req-ebc03fa3-bb93-442e-b4ed-f9c53d00a438 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43ff4d86-8c12-48ce-bcf5-c607c9bcaa05", "tag": "50148ea5-cdd9-47b3-8521-2b838cc4745f"}]} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:52:04.683742 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-ae889484-6e7f-43ba-a7a5-21622fe04a15 req-ebc03fa3-bb93-442e-b4ed-f9c53d00a438 service nova] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:04.686194 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-ae889484-6e7f-43ba-a7a5-21622fe04a15 req-ebc03fa3-bb93-442e-b4ed-f9c53d00a438 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:04.692360 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-ae889484-6e7f-43ba-a7a5-21622fe04a15 req-ebc03fa3-bb93-442e-b4ed-f9c53d00a438 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:04.751850 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.compute.server_external_events [req-ae889484-6e7f-43ba-a7a5-21622fe04a15 req-ebc03fa3-bb93-442e-b4ed-f9c53d00a438 service nova] Creating event network-changed:50148ea5-cdd9-47b3-8521-2b838cc4745f for instance 43ff4d86-8c12-48ce-bcf5-c607c9bcaa05 on n-h2-852296-2 Aug 10 17:52:04.767696 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [req-ae889484-6e7f-43ba-a7a5-21622fe04a15 req-ebc03fa3-bb93-442e-b4ed-f9c53d00a438 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114440 Aug 10 17:52:04.772346 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 339/693] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 10 17:52:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:52:05.104037 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-7d388b8b-e6fe-4259-8d2f-14d66b789117 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:05.107551 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-7d388b8b-e6fe-4259-8d2f-14d66b789117 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: 83268d7f-5375-4b01-9b5c-519be7daf0a4] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:05.135892 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7d388b8b-e6fe-4259-8d2f-14d66b789117 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:05.135892 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7d388b8b-e6fe-4259-8d2f-14d66b789117 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:05.135892 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7d388b8b-e6fe-4259-8d2f-14d66b789117 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:05.137625 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7d388b8b-e6fe-4259-8d2f-14d66b789117 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:05.138844 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7d388b8b-e6fe-4259-8d2f-14d66b789117 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:05.140121 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7d388b8b-e6fe-4259-8d2f-14d66b789117 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:05.351610 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-4503d199-2bce-4583-a8de-a488195a08b4 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e109c3dcd0574faaa3d7ec31dd4edd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48bbb92998f54ebeb624bc794d406896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:05.364776 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-4503d199-2bce-4583-a8de-a488195a08b4 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] 10.222.0.50 "GET /compute/v2.1/servers/43ff4d86-8c12-48ce-bcf5-c607c9bcaa05" status: 200 len: 1379 microversion: 2.1 time: 0.934447 Aug 10 17:52:05.365518 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 355/694] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:04 2022] GET /compute/v2.1/servers/43ff4d86-8c12-48ce-bcf5-c607c9bcaa05 => generated 1379 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:05.401159 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-b1278708-3628-4e5d-b767-098b8714c89b tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:05.404829 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-b1278708-3628-4e5d-b767-098b8714c89b tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] [instance: 12eda82b-051e-446c-b78b-6c9c9f6f78d0] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:05.429290 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b1278708-3628-4e5d-b767-098b8714c89b tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:05.432695 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b1278708-3628-4e5d-b767-098b8714c89b tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:05.434925 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b1278708-3628-4e5d-b767-098b8714c89b tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:05.436811 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b1278708-3628-4e5d-b767-098b8714c89b tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:05.438906 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b1278708-3628-4e5d-b767-098b8714c89b tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:05.442721 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b1278708-3628-4e5d-b767-098b8714c89b tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:05.688032 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-7d388b8b-e6fe-4259-8d2f-14d66b789117 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:05.696670 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-7d388b8b-e6fe-4259-8d2f-14d66b789117 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/83268d7f-5375-4b01-9b5c-519be7daf0a4" status: 200 len: 1319 microversion: 2.1 time: 0.601693 Aug 10 17:52:05.697250 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 340/695] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:05 2022] GET /compute/v2.1/servers/83268d7f-5375-4b01-9b5c-519be7daf0a4 => generated 1319 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:05.708682 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-c8c1c039-3b31-4993-8ed0-cad921555003 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:05.711844 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-c8c1c039-3b31-4993-8ed0-cad921555003 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] [instance: e2777988-0bbf-496c-9c97-b206dbc94a62] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:05.728577 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c8c1c039-3b31-4993-8ed0-cad921555003 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:05.739690 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c8c1c039-3b31-4993-8ed0-cad921555003 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:05.739690 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c8c1c039-3b31-4993-8ed0-cad921555003 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:05.739690 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c8c1c039-3b31-4993-8ed0-cad921555003 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:05.739690 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c8c1c039-3b31-4993-8ed0-cad921555003 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:05.739690 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c8c1c039-3b31-4993-8ed0-cad921555003 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:05.831724 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-c8c1c039-3b31-4993-8ed0-cad921555003 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:05.847396 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-c8c1c039-3b31-4993-8ed0-cad921555003 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:05.851314 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-c8c1c039-3b31-4993-8ed0-cad921555003 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:05.871227 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-c8c1c039-3b31-4993-8ed0-cad921555003 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] 10.222.0.50 "GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62" status: 200 len: 1445 microversion: 2.75 time: 0.167305 Aug 10 17:52:05.873641 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 341/696] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:52:05 2022] GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62 => generated 1445 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:52:05.881966 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [req-be48fc3d-0039-402f-9841-07c90aa4598f req-5a7ae973-4234-4ba0-8724-48368d4bcedb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25b28585-a586-423f-8f04-2b2f4d28f16c", "tag": "9b21b54b-64c6-42f3-892e-f4d109dd851a"}]} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:52:05.896645 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-be48fc3d-0039-402f-9841-07c90aa4598f req-5a7ae973-4234-4ba0-8724-48368d4bcedb service nova] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:05.900424 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-be48fc3d-0039-402f-9841-07c90aa4598f req-5a7ae973-4234-4ba0-8724-48368d4bcedb service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:05.900424 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-be48fc3d-0039-402f-9841-07c90aa4598f req-5a7ae973-4234-4ba0-8724-48368d4bcedb service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:05.931338 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.compute.server_external_events [req-be48fc3d-0039-402f-9841-07c90aa4598f req-5a7ae973-4234-4ba0-8724-48368d4bcedb service nova] Creating event network-changed:9b21b54b-64c6-42f3-892e-f4d109dd851a for instance 25b28585-a586-423f-8f04-2b2f4d28f16c on n-h1-852296-2 Aug 10 17:52:05.941253 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [req-be48fc3d-0039-402f-9841-07c90aa4598f req-5a7ae973-4234-4ba0-8724-48368d4bcedb service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065163 Aug 10 17:52:05.942382 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 342/697] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 10 17:52:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:52:05.965566 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-dd45bd06-6dea-4069-a570-75e0e5562fba tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:05.967400 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-dd45bd06-6dea-4069-a570-75e0e5562fba tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] [instance: 25b28585-a586-423f-8f04-2b2f4d28f16c] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:05.979139 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-dd45bd06-6dea-4069-a570-75e0e5562fba tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:05.979637 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-dd45bd06-6dea-4069-a570-75e0e5562fba tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:05.980071 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-dd45bd06-6dea-4069-a570-75e0e5562fba tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:05.981924 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-b1278708-3628-4e5d-b767-098b8714c89b tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2fd6acf18d4218ad143ccee2d0bb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7c2481a908406fa9c4562513fff665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:05.986720 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-dd45bd06-6dea-4069-a570-75e0e5562fba tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:05.987233 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-dd45bd06-6dea-4069-a570-75e0e5562fba tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:05.987678 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-dd45bd06-6dea-4069-a570-75e0e5562fba tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:05.991226 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-b1278708-3628-4e5d-b767-098b8714c89b tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] 10.222.0.50 "GET /compute/v2.1/servers/12eda82b-051e-446c-b78b-6c9c9f6f78d0" status: 200 len: 1313 microversion: 2.1 time: 0.612153 Aug 10 17:52:05.997637 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 356/698] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:05 2022] GET /compute/v2.1/servers/12eda82b-051e-446c-b78b-6c9c9f6f78d0 => generated 1313 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:06.238125 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-dd45bd06-6dea-4069-a570-75e0e5562fba tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83a3e198e21476eb12fcf417aea62de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df088e5a610436ea21b8a360e2bb527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:06.248940 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-dd45bd06-6dea-4069-a570-75e0e5562fba tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] 10.222.0.50 "GET /compute/v2.1/servers/25b28585-a586-423f-8f04-2b2f4d28f16c" status: 200 len: 1321 microversion: 2.1 time: 0.302987 Aug 10 17:52:06.261755 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 343/699] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:05 2022] GET /compute/v2.1/servers/25b28585-a586-423f-8f04-2b2f4d28f16c => generated 1321 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:06.391095 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-070108d6-e915-4923-827b-0738e7198f59 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:06.392435 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-070108d6-e915-4923-827b-0738e7198f59 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] [instance: 43ff4d86-8c12-48ce-bcf5-c607c9bcaa05] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:06.407400 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-070108d6-e915-4923-827b-0738e7198f59 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:06.408227 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-070108d6-e915-4923-827b-0738e7198f59 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:06.409462 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-070108d6-e915-4923-827b-0738e7198f59 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:06.410846 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-070108d6-e915-4923-827b-0738e7198f59 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:06.411471 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-070108d6-e915-4923-827b-0738e7198f59 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:06.412072 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-070108d6-e915-4923-827b-0738e7198f59 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:06.722792 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-abb7a29d-cf14-4c91-ba1d-60b0f60a8eb2 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:06.726229 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-abb7a29d-cf14-4c91-ba1d-60b0f60a8eb2 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: 83268d7f-5375-4b01-9b5c-519be7daf0a4] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:06.734830 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-abb7a29d-cf14-4c91-ba1d-60b0f60a8eb2 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:06.739449 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-abb7a29d-cf14-4c91-ba1d-60b0f60a8eb2 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:06.740100 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-abb7a29d-cf14-4c91-ba1d-60b0f60a8eb2 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:06.741092 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-abb7a29d-cf14-4c91-ba1d-60b0f60a8eb2 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:06.743176 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-abb7a29d-cf14-4c91-ba1d-60b0f60a8eb2 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:06.746895 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-abb7a29d-cf14-4c91-ba1d-60b0f60a8eb2 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:06.806333 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-070108d6-e915-4923-827b-0738e7198f59 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e109c3dcd0574faaa3d7ec31dd4edd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48bbb92998f54ebeb624bc794d406896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:06.820499 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-070108d6-e915-4923-827b-0738e7198f59 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] 10.222.0.50 "GET /compute/v2.1/servers/43ff4d86-8c12-48ce-bcf5-c607c9bcaa05" status: 200 len: 1379 microversion: 2.1 time: 0.433831 Aug 10 17:52:06.822021 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 357/700] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:06 2022] GET /compute/v2.1/servers/43ff4d86-8c12-48ce-bcf5-c607c9bcaa05 => generated 1379 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:06.910122 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-0304c884-0382-47fa-9f36-5fe671762223 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:06.911411 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-0304c884-0382-47fa-9f36-5fe671762223 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] [instance: e2777988-0bbf-496c-9c97-b206dbc94a62] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:06.925303 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-0304c884-0382-47fa-9f36-5fe671762223 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:06.929114 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-0304c884-0382-47fa-9f36-5fe671762223 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:06.929579 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-0304c884-0382-47fa-9f36-5fe671762223 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:06.930303 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-0304c884-0382-47fa-9f36-5fe671762223 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:06.931082 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-0304c884-0382-47fa-9f36-5fe671762223 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:06.931622 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-0304c884-0382-47fa-9f36-5fe671762223 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:07.024736 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-abb7a29d-cf14-4c91-ba1d-60b0f60a8eb2 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:07.034000 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-abb7a29d-cf14-4c91-ba1d-60b0f60a8eb2 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/83268d7f-5375-4b01-9b5c-519be7daf0a4" status: 200 len: 1319 microversion: 2.1 time: 0.317132 Aug 10 17:52:07.053344 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 344/701] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:06 2022] GET /compute/v2.1/servers/83268d7f-5375-4b01-9b5c-519be7daf0a4 => generated 1319 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:52:07.053344 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-d293d4b2-600c-4eec-a038-b13df9025984 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:07.053344 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-d293d4b2-600c-4eec-a038-b13df9025984 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] [instance: 12eda82b-051e-446c-b78b-6c9c9f6f78d0] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:07.053750 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-d293d4b2-600c-4eec-a038-b13df9025984 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:07.054133 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-d293d4b2-600c-4eec-a038-b13df9025984 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:07.054692 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-d293d4b2-600c-4eec-a038-b13df9025984 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:07.057395 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-0304c884-0382-47fa-9f36-5fe671762223 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:07.069103 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-d293d4b2-600c-4eec-a038-b13df9025984 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:07.073337 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-d293d4b2-600c-4eec-a038-b13df9025984 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:07.075318 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-0304c884-0382-47fa-9f36-5fe671762223 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:07.079869 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-0304c884-0382-47fa-9f36-5fe671762223 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:07.080035 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-d293d4b2-600c-4eec-a038-b13df9025984 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:07.087843 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-0304c884-0382-47fa-9f36-5fe671762223 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] 10.222.0.50 "GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62" status: 200 len: 1445 microversion: 2.75 time: 0.183305 Aug 10 17:52:07.103161 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 358/702] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:52:06 2022] GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62 => generated 1445 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 17:52:07.274714 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-9bf439ef-2fae-4a47-88ef-b74de76f5432 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:07.275771 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-9bf439ef-2fae-4a47-88ef-b74de76f5432 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] [instance: 25b28585-a586-423f-8f04-2b2f4d28f16c] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:07.299891 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-9bf439ef-2fae-4a47-88ef-b74de76f5432 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:07.300818 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-9bf439ef-2fae-4a47-88ef-b74de76f5432 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:07.302097 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-9bf439ef-2fae-4a47-88ef-b74de76f5432 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:07.305878 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-9bf439ef-2fae-4a47-88ef-b74de76f5432 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:07.306620 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-9bf439ef-2fae-4a47-88ef-b74de76f5432 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:07.307248 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-9bf439ef-2fae-4a47-88ef-b74de76f5432 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:07.732285 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-d293d4b2-600c-4eec-a038-b13df9025984 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2fd6acf18d4218ad143ccee2d0bb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7c2481a908406fa9c4562513fff665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:07.749711 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-d293d4b2-600c-4eec-a038-b13df9025984 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] 10.222.0.50 "GET /compute/v2.1/servers/12eda82b-051e-446c-b78b-6c9c9f6f78d0" status: 200 len: 1313 microversion: 2.1 time: 0.708636 Aug 10 17:52:07.764780 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 345/703] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:07 2022] GET /compute/v2.1/servers/12eda82b-051e-446c-b78b-6c9c9f6f78d0 => generated 1313 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:07.787364 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-9bf439ef-2fae-4a47-88ef-b74de76f5432 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83a3e198e21476eb12fcf417aea62de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df088e5a610436ea21b8a360e2bb527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:07.798815 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-9bf439ef-2fae-4a47-88ef-b74de76f5432 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] 10.222.0.50 "GET /compute/v2.1/servers/25b28585-a586-423f-8f04-2b2f4d28f16c" status: 200 len: 1321 microversion: 2.1 time: 0.529016 Aug 10 17:52:07.799884 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 359/704] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:07 2022] GET /compute/v2.1/servers/25b28585-a586-423f-8f04-2b2f4d28f16c => generated 1321 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:52:07.843287 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-5ef6f2ae-f204-414d-af2c-76d12332d304 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:07.844498 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-5ef6f2ae-f204-414d-af2c-76d12332d304 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] [instance: 43ff4d86-8c12-48ce-bcf5-c607c9bcaa05] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:07.862227 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-5ef6f2ae-f204-414d-af2c-76d12332d304 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:07.862726 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-5ef6f2ae-f204-414d-af2c-76d12332d304 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:07.863276 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-5ef6f2ae-f204-414d-af2c-76d12332d304 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:07.866560 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-5ef6f2ae-f204-414d-af2c-76d12332d304 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:07.868388 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-5ef6f2ae-f204-414d-af2c-76d12332d304 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:07.873508 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-5ef6f2ae-f204-414d-af2c-76d12332d304 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:08.060866 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-be2812b8-a66c-4b72-96dc-6b66f8fb24ba tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:08.061478 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-be2812b8-a66c-4b72-96dc-6b66f8fb24ba tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: 83268d7f-5375-4b01-9b5c-519be7daf0a4] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:08.073280 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-be2812b8-a66c-4b72-96dc-6b66f8fb24ba tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:08.079859 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-be2812b8-a66c-4b72-96dc-6b66f8fb24ba tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:08.079859 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-be2812b8-a66c-4b72-96dc-6b66f8fb24ba tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:08.079859 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-be2812b8-a66c-4b72-96dc-6b66f8fb24ba tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:08.079859 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-be2812b8-a66c-4b72-96dc-6b66f8fb24ba tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:08.079859 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-be2812b8-a66c-4b72-96dc-6b66f8fb24ba tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:08.386214 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-5ef6f2ae-f204-414d-af2c-76d12332d304 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e109c3dcd0574faaa3d7ec31dd4edd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48bbb92998f54ebeb624bc794d406896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:08.398027 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-5ef6f2ae-f204-414d-af2c-76d12332d304 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] 10.222.0.50 "GET /compute/v2.1/servers/43ff4d86-8c12-48ce-bcf5-c607c9bcaa05" status: 200 len: 1379 microversion: 2.1 time: 0.559014 Aug 10 17:52:08.399767 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 346/705] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:07 2022] GET /compute/v2.1/servers/43ff4d86-8c12-48ce-bcf5-c607c9bcaa05 => generated 1379 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:08.410100 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-d3b3d5e1-55ff-4581-a190-98acab933e6d tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:08.415852 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-d3b3d5e1-55ff-4581-a190-98acab933e6d tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] [instance: e2777988-0bbf-496c-9c97-b206dbc94a62] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:08.430487 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-d3b3d5e1-55ff-4581-a190-98acab933e6d tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:08.431012 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-d3b3d5e1-55ff-4581-a190-98acab933e6d tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:08.431462 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-d3b3d5e1-55ff-4581-a190-98acab933e6d tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:08.432200 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-d3b3d5e1-55ff-4581-a190-98acab933e6d tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:08.435214 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-d3b3d5e1-55ff-4581-a190-98acab933e6d tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:08.435884 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-d3b3d5e1-55ff-4581-a190-98acab933e6d tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:08.671017 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-d3b3d5e1-55ff-4581-a190-98acab933e6d tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:08.688803 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-d3b3d5e1-55ff-4581-a190-98acab933e6d tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:08.691855 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-d3b3d5e1-55ff-4581-a190-98acab933e6d tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:08.708846 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-d3b3d5e1-55ff-4581-a190-98acab933e6d tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] 10.222.0.50 "GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62" status: 200 len: 1445 microversion: 2.75 time: 0.307110 Aug 10 17:52:08.710216 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 347/706] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:52:08 2022] GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62 => generated 1445 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:52:08.772044 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-d6b701c6-f6af-4a85-a5c8-35eedac91494 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:08.773433 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-d6b701c6-f6af-4a85-a5c8-35eedac91494 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] [instance: 12eda82b-051e-446c-b78b-6c9c9f6f78d0] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:08.786676 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-d6b701c6-f6af-4a85-a5c8-35eedac91494 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:08.787784 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-d6b701c6-f6af-4a85-a5c8-35eedac91494 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:08.791559 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-d6b701c6-f6af-4a85-a5c8-35eedac91494 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:08.792547 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-d6b701c6-f6af-4a85-a5c8-35eedac91494 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:08.793185 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-d6b701c6-f6af-4a85-a5c8-35eedac91494 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:08.793774 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-d6b701c6-f6af-4a85-a5c8-35eedac91494 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:08.985160 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-be2812b8-a66c-4b72-96dc-6b66f8fb24ba tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:08.996984 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-be2812b8-a66c-4b72-96dc-6b66f8fb24ba tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/83268d7f-5375-4b01-9b5c-519be7daf0a4" status: 200 len: 1319 microversion: 2.1 time: 0.940110 Aug 10 17:52:09.008717 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 360/707] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:08 2022] GET /compute/v2.1/servers/83268d7f-5375-4b01-9b5c-519be7daf0a4 => generated 1319 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:09.020773 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-c99c4d60-8abc-4753-9aab-68281a41e79f tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:09.020773 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-c99c4d60-8abc-4753-9aab-68281a41e79f tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] [instance: 25b28585-a586-423f-8f04-2b2f4d28f16c] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:09.025338 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-c99c4d60-8abc-4753-9aab-68281a41e79f tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:09.026039 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-c99c4d60-8abc-4753-9aab-68281a41e79f tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:09.026827 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-c99c4d60-8abc-4753-9aab-68281a41e79f tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:09.027958 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-c99c4d60-8abc-4753-9aab-68281a41e79f tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:09.028644 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-c99c4d60-8abc-4753-9aab-68281a41e79f tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:09.029232 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-c99c4d60-8abc-4753-9aab-68281a41e79f tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:09.325577 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-c99c4d60-8abc-4753-9aab-68281a41e79f tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83a3e198e21476eb12fcf417aea62de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df088e5a610436ea21b8a360e2bb527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:09.331222 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-d6b701c6-f6af-4a85-a5c8-35eedac91494 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2fd6acf18d4218ad143ccee2d0bb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7c2481a908406fa9c4562513fff665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:09.367929 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-c99c4d60-8abc-4753-9aab-68281a41e79f tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] 10.222.0.50 "GET /compute/v2.1/servers/25b28585-a586-423f-8f04-2b2f4d28f16c" status: 200 len: 1321 microversion: 2.1 time: 0.357689 Aug 10 17:52:09.369974 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-d6b701c6-f6af-4a85-a5c8-35eedac91494 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] 10.222.0.50 "GET /compute/v2.1/servers/12eda82b-051e-446c-b78b-6c9c9f6f78d0" status: 200 len: 1313 microversion: 2.1 time: 0.601501 Aug 10 17:52:09.380107 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 348/708] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:08 2022] GET /compute/v2.1/servers/12eda82b-051e-446c-b78b-6c9c9f6f78d0 => generated 1313 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:52:09.380786 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 361/709] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:09 2022] GET /compute/v2.1/servers/25b28585-a586-423f-8f04-2b2f4d28f16c => generated 1321 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:09.387946 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [req-d527b616-67d1-4b6b-b9f6-62390e263d19 req-4f881c9e-0efe-47f4-b819-449fee713715 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12eda82b-051e-446c-b78b-6c9c9f6f78d0", "name": "network-vif-plugged", "status": "completed", "tag": "178a85c3-8f3f-4fb1-89ab-d84c805185db"}]} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:52:09.424862 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-98e3d1be-2718-46df-a406-dc996ff6001f tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:09.425754 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-98e3d1be-2718-46df-a406-dc996ff6001f tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] [instance: 43ff4d86-8c12-48ce-bcf5-c607c9bcaa05] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:09.439839 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-98e3d1be-2718-46df-a406-dc996ff6001f tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:09.443324 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-d527b616-67d1-4b6b-b9f6-62390e263d19 req-4f881c9e-0efe-47f4-b819-449fee713715 service nova] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:09.444762 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-98e3d1be-2718-46df-a406-dc996ff6001f tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:09.445121 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-d527b616-67d1-4b6b-b9f6-62390e263d19 req-4f881c9e-0efe-47f4-b819-449fee713715 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:09.451945 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-98e3d1be-2718-46df-a406-dc996ff6001f tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:09.451945 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-98e3d1be-2718-46df-a406-dc996ff6001f tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:09.451945 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-98e3d1be-2718-46df-a406-dc996ff6001f tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:09.451945 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-98e3d1be-2718-46df-a406-dc996ff6001f tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:09.452467 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-d527b616-67d1-4b6b-b9f6-62390e263d19 req-4f881c9e-0efe-47f4-b819-449fee713715 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:09.478124 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.compute.server_external_events [req-d527b616-67d1-4b6b-b9f6-62390e263d19 req-4f881c9e-0efe-47f4-b819-449fee713715 service nova] Creating event network-vif-plugged:178a85c3-8f3f-4fb1-89ab-d84c805185db for instance 12eda82b-051e-446c-b78b-6c9c9f6f78d0 on n-h2-852296-2 Aug 10 17:52:09.496202 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [req-d527b616-67d1-4b6b-b9f6-62390e263d19 req-4f881c9e-0efe-47f4-b819-449fee713715 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113897 Aug 10 17:52:09.509012 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 349/710] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 10 17:52:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:52:09.690145 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-abcbb94d-e833-4479-b688-3e6f0ae1b519 tempest-AttachVolumeShelveTestJSON-21911967 tempest-AttachVolumeShelveTestJSON-21911967-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-575702701", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4b4e0ed7-31a8-46e4-8e64-4d58423ae488"}], "security_groups": [{"name": "tempest-securitygroup--1839262728"}], "key_name": "tempest-keypair-212280872", "user_data": "}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:52:09.856654 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.network.neutron [None req-abcbb94d-e833-4479-b688-3e6f0ae1b519 tempest-AttachVolumeShelveTestJSON-21911967 tempest-AttachVolumeShelveTestJSON-21911967-project] validate_networks() for [('4b4e0ed7-31a8-46e4-8e64-4d58423ae488', None, None, None, None, None)] {{(pid=129409) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 17:52:10.001763 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-98e3d1be-2718-46df-a406-dc996ff6001f tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e109c3dcd0574faaa3d7ec31dd4edd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48bbb92998f54ebeb624bc794d406896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:10.014243 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-98e3d1be-2718-46df-a406-dc996ff6001f tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] 10.222.0.50 "GET /compute/v2.1/servers/43ff4d86-8c12-48ce-bcf5-c607c9bcaa05" status: 200 len: 1379 microversion: 2.1 time: 0.594694 Aug 10 17:52:10.029200 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 362/711] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:09 2022] GET /compute/v2.1/servers/43ff4d86-8c12-48ce-bcf5-c607c9bcaa05 => generated 1379 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:52:10.036151 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-2e3b08a6-9fde-44f1-b50c-db760711fa1c tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:10.037489 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-2e3b08a6-9fde-44f1-b50c-db760711fa1c tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] [instance: e2777988-0bbf-496c-9c97-b206dbc94a62] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:10.044572 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2e3b08a6-9fde-44f1-b50c-db760711fa1c tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:10.045255 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2e3b08a6-9fde-44f1-b50c-db760711fa1c tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:10.045801 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2e3b08a6-9fde-44f1-b50c-db760711fa1c tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:10.046979 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2e3b08a6-9fde-44f1-b50c-db760711fa1c tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:10.047570 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2e3b08a6-9fde-44f1-b50c-db760711fa1c tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:10.048094 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2e3b08a6-9fde-44f1-b50c-db760711fa1c tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:10.133012 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-2e3b08a6-9fde-44f1-b50c-db760711fa1c tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:10.141646 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [None req-abcbb94d-e833-4479-b688-3e6f0ae1b519 tempest-AttachVolumeShelveTestJSON-21911967 tempest-AttachVolumeShelveTestJSON-21911967-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-e66a8177-e806-487c-ba5f-7fd214721873) Aug 10 17:52:10.141646 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:52:10.141646 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:52:10.141646 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:52:10.141646 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:52:10.141646 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:52:10.141646 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:52:10.141646 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:52:10.141646 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:52:10.141646 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:52:10.141646 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 17:52:10.141646 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 17:52:10.141646 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 17:52:10.141646 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 17:52:10.141646 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 17:52:10.141646 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 17:52:10.141646 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 17:52:10.141646 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 17:52:10.141646 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 17:52:10.141646 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 17:52:10.141646 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 17:52:10.141646 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 17:52:10.141646 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 17:52:10.141646 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 17:52:10.141646 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 17:52:10.141646 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 17:52:10.141646 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 17:52:10.141646 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:52:10.141646 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:52:10.141646 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 17:52:10.141646 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 17:52:10.141646 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:52:10.141646 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:52:10.141646 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:52:10.141646 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:52:10.141646 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:52:10.141646 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:52:10.141646 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:52:10.141646 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:52:10.141646 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:52:10.141646 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:52:10.141646 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 17:52:10.141646 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 17:52:10.141646 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 17:52:10.141646 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 17:52:10.141646 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 17:52:10.141646 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 17:52:10.141646 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 17:52:10.141646 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 17:52:10.141646 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 17:52:10.141646 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 17:52:10.141646 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 17:52:10.145400 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 17:52:10.145400 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 17:52:10.145400 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 17:52:10.145400 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 17:52:10.145400 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 17:52:10.145400 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 17:52:10.145400 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 17:52:10.145400 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 17:52:10.145400 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 17:52:10.145400 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 17:52:10.145400 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 17:52:10.145400 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 17:52:10.145400 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 17:52:10.145400 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 17:52:10.145400 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 17:52:10.145400 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-e66a8177-e806-487c-ba5f-7fd214721873) Aug 10 17:52:10.145400 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:52:10.145400 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-abcbb94d-e833-4479-b688-3e6f0ae1b519 tempest-AttachVolumeShelveTestJSON-21911967 tempest-AttachVolumeShelveTestJSON-21911967-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:52:10.145400 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:52:10.146999 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-abcbb94d-e833-4479-b688-3e6f0ae1b519 tempest-AttachVolumeShelveTestJSON-21911967 tempest-AttachVolumeShelveTestJSON-21911967-project] Request method failure captured: Aug 10 17:52:10.146999 n-d-852296-2 devstack@n-api.service[129409]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 17:52:10.146999 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 17:52:10.146999 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 17:52:10.146999 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 17:52:10.146999 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 490 Aug 10 17:52:10.146999 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 17:52:10.146999 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 17:52:10.146999 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 17:52:10.146999 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 17:52:10.146999 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8_BAZh9IjFuRHA25NBlOF3-ODfYLR4DJnvJme7tmKJtFCJtylq_7UmAyxfd5tYk2umx_fwUMh-cSuC-FNPCiZP6Nud1bWTs0CCCd6VkXC1v-A0YS3HpIDJ_31eLu0kw04oK8dPbbek2iNv4TfHA9jQnqy2OS8pZZMpReC7rD9d6bIMk Aug 10 17:52:10.146999 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 17:52:10.146999 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 17:52:10.146999 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 17:52:10.146999 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 17:52:10.146999 n-d-852296-2 devstack@n-api.service[129409]: X-Openstack-Nova-Api-Version: 2.20 Aug 10 17:52:10.146999 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 17:52:10.146999 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 17:52:10.146999 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: 81e24e5e4b5946af87ed8621126ca737 Aug 10 17:52:10.146999 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-21911967 Aug 10 17:52:10.146999 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 17:52:10.146999 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 17:52:10.146999 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/81e24e5e4b5946af87ed8621126ca737"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/81e24e5e4b5946af87ed8621126ca737"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/81e24e5e4b5946af87ed8621126ca737"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_81e24e5e4b5946af87ed8621126ca737", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:52:10.146999 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-AttachVolumeShelveTestJSON-21911967 Aug 10 17:52:10.146999 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: 81e24e5e4b5946af87ed8621126ca737 Aug 10 17:52:10.146999 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-21911967 Aug 10 17:52:10.146999 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-AttachVolumeShelveTestJSON-21911967-project Aug 10 17:52:10.146999 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 17:52:10.146999 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 17:52:10.146999 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: 2f42cb7cd86e497ab532c5cd5e05c99d Aug 10 17:52:10.146999 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-AttachVolumeShelveTestJSON-21911967-project Aug 10 17:52:10.146999 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:52:10.146999 n-d-852296-2 devstack@n-api.service[129409]: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-575702701", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "adminPass": "password", "networks": [{"uuid": "4b4e0ed7-31a8-46e4-8e64-4d58423ae488"}], "security_groups": [{"name": "tempest-securitygroup--1839262728"}], "key_name": "tempest-keypair-212280872", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} Aug 10 17:52:10.146999 n-d-852296-2 devstack@n-api.service[129409]: method: > Aug 10 17:52:10.146999 n-d-852296-2 devstack@n-api.service[129409]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:52:10.146999 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:52:10.146999 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'body': {'server': {'name': 'tempest-AttachVolumeShelveTestJSON-server-575702701', 'imageRef': 'a735ff26-463a-4ffe-a981-ab9d9baa494f', 'flavorRef': '452', 'adminPass': 'password', 'networks': [{'uuid': '4b4e0ed7-31a8-46e4-8e64-4d58423ae488'}], 'security_groups': [{'name': 'tempest-securitygroup--1839262728'}], 'key_name': 'tempest-keypair-212280872', 'user_data': 'IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo='}}} Aug 10 17:52:10.146999 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:52:10.146999 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:52:10.146999 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:52:10.146999 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:52:10.146999 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:52:10.146999 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:52:10.146999 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:52:10.146999 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:52:10.146999 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:52:10.146999 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:52:10.146999 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 17:52:10.146999 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 17:52:10.146999 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 17:52:10.146999 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 17:52:10.146999 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 17:52:10.146999 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 17:52:10.146999 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 17:52:10.146999 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 17:52:10.146999 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 17:52:10.146999 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 17:52:10.151179 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 17:52:10.151179 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 17:52:10.151179 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 17:52:10.151179 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 17:52:10.151179 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 17:52:10.151179 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 17:52:10.151179 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 17:52:10.151179 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:52:10.151179 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:52:10.151179 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 17:52:10.151179 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 17:52:10.151179 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:52:10.151179 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:52:10.151179 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:52:10.151179 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:52:10.151179 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:52:10.151179 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:52:10.151179 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:52:10.151179 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:52:10.151179 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:52:10.151179 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:52:10.151179 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 17:52:10.151179 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 17:52:10.151179 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 17:52:10.151179 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 17:52:10.151179 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 17:52:10.151179 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 17:52:10.151179 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 17:52:10.151179 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 17:52:10.151179 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 17:52:10.151179 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 17:52:10.151179 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 17:52:10.151179 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 17:52:10.151179 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 17:52:10.151179 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 17:52:10.151179 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 17:52:10.151179 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 17:52:10.151179 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 17:52:10.151179 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 17:52:10.151179 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 17:52:10.151179 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 17:52:10.151179 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 17:52:10.151179 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 17:52:10.151179 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 17:52:10.151179 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 17:52:10.151179 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 17:52:10.151179 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 17:52:10.151179 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-e66a8177-e806-487c-ba5f-7fd214721873) Aug 10 17:52:10.151179 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:52:10.151179 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:52:10.151179 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:52:10.151179 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:52:10.151179 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:52:10.159016 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:52:10.159016 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:52:10.159016 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:52:10.159016 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 10 17:52:10.159016 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 10 17:52:10.159016 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:52:10.159016 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:52:10.159016 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:52:10.159016 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:52:10.159016 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:52:10.159016 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:52:10.159016 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:52:10.159016 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:52:10.159016 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:52:10.159016 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:52:10.159016 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:52:10.159016 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:52:10.159016 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:52:10.159016 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-abcbb94d-e833-4479-b688-3e6f0ae1b519 tempest-AttachVolumeShelveTestJSON-21911967 tempest-AttachVolumeShelveTestJSON-21911967-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:52:10.159016 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:52:10.159016 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-abcbb94d-e833-4479-b688-3e6f0ae1b519 tempest-AttachVolumeShelveTestJSON-21911967 tempest-AttachVolumeShelveTestJSON-21911967-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.20 time: 0.467160 Aug 10 17:52:10.159016 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 350/712] 10.222.0.50 () {62 vars in 1188 bytes} [Wed Aug 10 17:52:09 2022] POST /compute/v2.1/servers => generated 214 bytes in 469 msecs (HTTP/1.1 500) 9 headers in 393 bytes (1 switches on core 0) Aug 10 17:52:10.167003 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-88e884e1-93b5-411f-878d-4dc878870620 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:10.167088 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-2e3b08a6-9fde-44f1-b50c-db760711fa1c tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:10.167185 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-88e884e1-93b5-411f-878d-4dc878870620 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: 83268d7f-5375-4b01-9b5c-519be7daf0a4] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:10.169140 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-2e3b08a6-9fde-44f1-b50c-db760711fa1c tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:10.179776 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-88e884e1-93b5-411f-878d-4dc878870620 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:10.180734 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-88e884e1-93b5-411f-878d-4dc878870620 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:10.181180 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-88e884e1-93b5-411f-878d-4dc878870620 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:10.185523 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-2e3b08a6-9fde-44f1-b50c-db760711fa1c tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] 10.222.0.50 "GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62" status: 200 len: 1445 microversion: 2.75 time: 0.154440 Aug 10 17:52:10.186482 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-88e884e1-93b5-411f-878d-4dc878870620 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:10.187129 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-88e884e1-93b5-411f-878d-4dc878870620 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:10.187792 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-88e884e1-93b5-411f-878d-4dc878870620 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:10.187973 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 363/713] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:52:10 2022] GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62 => generated 1445 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:52:10.199264 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-c4df5857-3300-4102-84ae-14e067f99751 tempest-AttachVolumeShelveTestJSON-21911967 tempest-AttachVolumeShelveTestJSON-21911967-project] Calling method '.version_select at 0x7fb3460d4670>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:10.321870 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-c4df5857-3300-4102-84ae-14e067f99751 tempest-AttachVolumeShelveTestJSON-21911967 tempest-AttachVolumeShelveTestJSON-21911967-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-212280872" status: 204 len: 0 microversion: 2.20 time: 0.131828 Aug 10 17:52:10.326096 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 364/714] 10.222.0.50 () {60 vars in 1259 bytes} [Wed Aug 10 17:52:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-212280872 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 10 17:52:10.399825 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-2ca55b30-8b80-4ecf-8621-c2502e099a4d tempest-ServersTestBootFromVolume-1380572823 tempest-ServersTestBootFromVolume-1380572823-project] Action: 'create', calling method: .version_select at 0x7fb346104160>, body: {"keypair": {"name": "tempest-keypair-80691101", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOJcYcUMszfHxhRJcFBdxV9C2H7A6ICfWt5mUbwXu0iBgOaKQDZApFb0fjCB1yZ2hLHwYKBIB9ceKkpo0vOCfghslcmfkGEH4izs4qvgly49zB5oELlvw6QT2kwAzT7gbg=="}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:52:10.420091 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.quota [None req-2ca55b30-8b80-4ecf-8621-c2502e099a4d tempest-ServersTestBootFromVolume-1380572823 tempest-ServersTestBootFromVolume-1380572823-project] Getting quotas for project 065cbd9235f3459ab207302019d19a60. Resources: {'key_pairs'} {{(pid=129410) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:52:10.424855 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-88e884e1-93b5-411f-878d-4dc878870620 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:10.429812 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.quota [None req-2ca55b30-8b80-4ecf-8621-c2502e099a4d tempest-ServersTestBootFromVolume-1380572823 tempest-ServersTestBootFromVolume-1380572823-project] Getting quotas for user 7876521dc1b54398ac3fae72846211c6 and project 065cbd9235f3459ab207302019d19a60. Resources: {'key_pairs'} {{(pid=129410) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:52:10.435231 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-88e884e1-93b5-411f-878d-4dc878870620 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/83268d7f-5375-4b01-9b5c-519be7daf0a4" status: 200 len: 1319 microversion: 2.1 time: 0.283044 Aug 10 17:52:10.439800 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 351/715] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:10 2022] GET /compute/v2.1/servers/83268d7f-5375-4b01-9b5c-519be7daf0a4 => generated 1319 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:10.451032 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-d18e403d-985e-4a47-8335-826b16e2e4cb tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:10.451918 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-d18e403d-985e-4a47-8335-826b16e2e4cb tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] [instance: 12eda82b-051e-446c-b78b-6c9c9f6f78d0] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:10.469913 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-d18e403d-985e-4a47-8335-826b16e2e4cb tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:10.472896 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-d18e403d-985e-4a47-8335-826b16e2e4cb tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:10.473712 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-d18e403d-985e-4a47-8335-826b16e2e4cb tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:10.474699 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-d18e403d-985e-4a47-8335-826b16e2e4cb tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:10.476273 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-d18e403d-985e-4a47-8335-826b16e2e4cb tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:10.479377 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-d18e403d-985e-4a47-8335-826b16e2e4cb tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:10.628848 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-2ca55b30-8b80-4ecf-8621-c2502e099a4d tempest-ServersTestBootFromVolume-1380572823 tempest-ServersTestBootFromVolume-1380572823-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.300753 Aug 10 17:52:10.630025 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 365/716] 10.222.0.50 () {60 vars in 1159 bytes} [Wed Aug 10 17:52:10 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:52:10.635846 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-1acfbdc0-ad91-4dad-9a82-90be4c310e43 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:10.636880 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-1acfbdc0-ad91-4dad-9a82-90be4c310e43 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] [instance: 25b28585-a586-423f-8f04-2b2f4d28f16c] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:10.644375 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-1acfbdc0-ad91-4dad-9a82-90be4c310e43 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:10.645197 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-1acfbdc0-ad91-4dad-9a82-90be4c310e43 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:10.645916 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-1acfbdc0-ad91-4dad-9a82-90be4c310e43 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:10.646944 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-1acfbdc0-ad91-4dad-9a82-90be4c310e43 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:10.648016 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-1acfbdc0-ad91-4dad-9a82-90be4c310e43 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:10.652869 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-1acfbdc0-ad91-4dad-9a82-90be4c310e43 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:10.749528 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-d18e403d-985e-4a47-8335-826b16e2e4cb tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2fd6acf18d4218ad143ccee2d0bb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7c2481a908406fa9c4562513fff665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:10.774613 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-d18e403d-985e-4a47-8335-826b16e2e4cb tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] 10.222.0.50 "GET /compute/v2.1/servers/12eda82b-051e-446c-b78b-6c9c9f6f78d0" status: 200 len: 1313 microversion: 2.1 time: 0.333110 Aug 10 17:52:10.799575 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 352/717] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:10 2022] GET /compute/v2.1/servers/12eda82b-051e-446c-b78b-6c9c9f6f78d0 => generated 1313 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:11.038184 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-988533da-99d9-4054-8970-4b5be62a82a8 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:11.038824 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-988533da-99d9-4054-8970-4b5be62a82a8 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] [instance: 43ff4d86-8c12-48ce-bcf5-c607c9bcaa05] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:11.041881 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_cell0:SELECT=70 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:52:11.052001 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-988533da-99d9-4054-8970-4b5be62a82a8 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:11.052681 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-988533da-99d9-4054-8970-4b5be62a82a8 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:11.053134 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-988533da-99d9-4054-8970-4b5be62a82a8 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:11.057874 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-988533da-99d9-4054-8970-4b5be62a82a8 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:11.058433 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-988533da-99d9-4054-8970-4b5be62a82a8 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:11.062240 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-988533da-99d9-4054-8970-4b5be62a82a8 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:11.278449 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-988533da-99d9-4054-8970-4b5be62a82a8 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e109c3dcd0574faaa3d7ec31dd4edd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48bbb92998f54ebeb624bc794d406896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:11.294454 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-988533da-99d9-4054-8970-4b5be62a82a8 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] 10.222.0.50 "GET /compute/v2.1/servers/43ff4d86-8c12-48ce-bcf5-c607c9bcaa05" status: 200 len: 1379 microversion: 2.1 time: 0.257907 Aug 10 17:52:11.297343 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 353/718] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:11 2022] GET /compute/v2.1/servers/43ff4d86-8c12-48ce-bcf5-c607c9bcaa05 => generated 1379 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:11.317195 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-93e3aa83-ca2b-408e-9fb0-523e621fb009 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:11.319219 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-93e3aa83-ca2b-408e-9fb0-523e621fb009 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] [instance: e2777988-0bbf-496c-9c97-b206dbc94a62] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:11.339966 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-93e3aa83-ca2b-408e-9fb0-523e621fb009 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:11.345446 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-93e3aa83-ca2b-408e-9fb0-523e621fb009 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:11.348456 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-93e3aa83-ca2b-408e-9fb0-523e621fb009 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:11.352202 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-93e3aa83-ca2b-408e-9fb0-523e621fb009 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:11.353414 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-93e3aa83-ca2b-408e-9fb0-523e621fb009 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:11.357412 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-93e3aa83-ca2b-408e-9fb0-523e621fb009 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:11.420088 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-1acfbdc0-ad91-4dad-9a82-90be4c310e43 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83a3e198e21476eb12fcf417aea62de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df088e5a610436ea21b8a360e2bb527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:11.433994 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-1acfbdc0-ad91-4dad-9a82-90be4c310e43 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] 10.222.0.50 "GET /compute/v2.1/servers/25b28585-a586-423f-8f04-2b2f4d28f16c" status: 200 len: 1321 microversion: 2.1 time: 0.802226 Aug 10 17:52:11.442103 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 366/719] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:10 2022] GET /compute/v2.1/servers/25b28585-a586-423f-8f04-2b2f4d28f16c => generated 1321 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:11.459881 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-805b0abe-834d-4e5a-8513-f164728cce8e tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:11.460834 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-805b0abe-834d-4e5a-8513-f164728cce8e tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: 83268d7f-5375-4b01-9b5c-519be7daf0a4] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:11.497171 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-805b0abe-834d-4e5a-8513-f164728cce8e tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:11.497902 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-805b0abe-834d-4e5a-8513-f164728cce8e tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:11.498354 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-805b0abe-834d-4e5a-8513-f164728cce8e tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:11.499121 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-805b0abe-834d-4e5a-8513-f164728cce8e tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:11.505023 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-805b0abe-834d-4e5a-8513-f164728cce8e tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:11.505687 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-805b0abe-834d-4e5a-8513-f164728cce8e tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:11.571154 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-93e3aa83-ca2b-408e-9fb0-523e621fb009 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:11.582891 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-93e3aa83-ca2b-408e-9fb0-523e621fb009 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:11.586220 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-93e3aa83-ca2b-408e-9fb0-523e621fb009 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:11.593340 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-93e3aa83-ca2b-408e-9fb0-523e621fb009 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] 10.222.0.50 "GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62" status: 200 len: 1445 microversion: 2.75 time: 0.292574 Aug 10 17:52:11.595383 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 354/720] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:52:11 2022] GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62 => generated 1445 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:52:11.600588 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [req-7880390e-2723-4244-9ac5-854dd675a3a7 req-39c67695-891a-448c-823c-0e08f8cd18a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d821054-dce7-4015-8eaa-d8c56e7c3cd3", "name": "network-vif-plugged", "status": "completed", "tag": "b2611f6e-dc7c-4074-b71e-211cff945882"}, {"server_uuid": "83268d7f-5375-4b01-9b5c-519be7daf0a4", "name": "network-vif-plugged", "status": "completed", "tag": "7e62831c-3860-4779-a6c1-a2c8317ac744"}]} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:52:11.620707 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-7880390e-2723-4244-9ac5-854dd675a3a7 req-39c67695-891a-448c-823c-0e08f8cd18a8 service nova] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:11.621194 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-7880390e-2723-4244-9ac5-854dd675a3a7 req-39c67695-891a-448c-823c-0e08f8cd18a8 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:11.621630 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-7880390e-2723-4244-9ac5-854dd675a3a7 req-39c67695-891a-448c-823c-0e08f8cd18a8 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:11.639134 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_cell1:SELECT=100 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:52:11.660931 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.compute.server_external_events [req-7880390e-2723-4244-9ac5-854dd675a3a7 req-39c67695-891a-448c-823c-0e08f8cd18a8 service nova] Creating event network-vif-plugged:b2611f6e-dc7c-4074-b71e-211cff945882 for instance 0d821054-dce7-4015-8eaa-d8c56e7c3cd3 on n-h2-852296-2 Aug 10 17:52:11.661498 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.compute.server_external_events [req-7880390e-2723-4244-9ac5-854dd675a3a7 req-39c67695-891a-448c-823c-0e08f8cd18a8 service nova] Creating event network-vif-plugged:7e62831c-3860-4779-a6c1-a2c8317ac744 for instance 83268d7f-5375-4b01-9b5c-519be7daf0a4 on n-h1-852296-2 Aug 10 17:52:11.684589 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [req-7880390e-2723-4244-9ac5-854dd675a3a7 req-39c67695-891a-448c-823c-0e08f8cd18a8 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.085130 Aug 10 17:52:11.686923 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 355/721] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 10 17:52:11 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:52:11.797172 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-1af04c74-e262-4cbf-a061-5a18816886e5 tempest-AttachVolumeShelveTestJSON-21911967 tempest-AttachVolumeShelveTestJSON-21911967-project] Action: 'create', calling method: .version_select at 0x7fb3464c7e50>, body: {"keypair": {"name": "tempest-keypair-1681549841", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBob+CAV8o6D5oSUFRztWOSLkjaefBJSidqQrLUgSEdSFY8vk4lStrQ9lL7z6Sx9Ut1WFRuGAod1zwGv1z21bIWSSB+mq17du/kg/aXhad0byekL2zlnSseXDaRpfj72ig=="}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:52:11.813916 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-1af04c74-e262-4cbf-a061-5a18816886e5 tempest-AttachVolumeShelveTestJSON-21911967 tempest-AttachVolumeShelveTestJSON-21911967-project] Getting quotas for project 81e24e5e4b5946af87ed8621126ca737. Resources: {'key_pairs'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:52:11.818880 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-1af04c74-e262-4cbf-a061-5a18816886e5 tempest-AttachVolumeShelveTestJSON-21911967 tempest-AttachVolumeShelveTestJSON-21911967-project] Getting quotas for user 2f42cb7cd86e497ab532c5cd5e05c99d and project 81e24e5e4b5946af87ed8621126ca737. Resources: {'key_pairs'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:52:11.884213 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-805b0abe-834d-4e5a-8513-f164728cce8e tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:11.910799 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-805b0abe-834d-4e5a-8513-f164728cce8e tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/83268d7f-5375-4b01-9b5c-519be7daf0a4" status: 200 len: 1319 microversion: 2.1 time: 0.454771 Aug 10 17:52:11.914643 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 367/722] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:11 2022] GET /compute/v2.1/servers/83268d7f-5375-4b01-9b5c-519be7daf0a4 => generated 1319 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:52:11.934676 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-9f2cb372-1d41-48af-a738-defac025bafa tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:11.935224 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-9f2cb372-1d41-48af-a738-defac025bafa tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] [instance: 12eda82b-051e-446c-b78b-6c9c9f6f78d0] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:11.942375 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-1af04c74-e262-4cbf-a061-5a18816886e5 tempest-AttachVolumeShelveTestJSON-21911967 tempest-AttachVolumeShelveTestJSON-21911967-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.150472 Aug 10 17:52:11.943188 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 356/723] 10.222.0.50 () {62 vars in 1200 bytes} [Wed Aug 10 17:52:11 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 152 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 10 17:52:11.944432 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-9f2cb372-1d41-48af-a738-defac025bafa tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:11.951412 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-9f2cb372-1d41-48af-a738-defac025bafa tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:11.951957 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-9f2cb372-1d41-48af-a738-defac025bafa tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:11.953419 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-9f2cb372-1d41-48af-a738-defac025bafa tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:11.954161 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-9f2cb372-1d41-48af-a738-defac025bafa tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:11.954971 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-9f2cb372-1d41-48af-a738-defac025bafa tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:12.129324 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-9f2cb372-1d41-48af-a738-defac025bafa tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2fd6acf18d4218ad143ccee2d0bb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7c2481a908406fa9c4562513fff665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:12.139480 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-9f2cb372-1d41-48af-a738-defac025bafa tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] 10.222.0.50 "GET /compute/v2.1/servers/12eda82b-051e-446c-b78b-6c9c9f6f78d0" status: 200 len: 1462 microversion: 2.1 time: 0.223435 Aug 10 17:52:12.140517 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 368/724] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:11 2022] GET /compute/v2.1/servers/12eda82b-051e-446c-b78b-6c9c9f6f78d0 => generated 1462 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:12.318748 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-edc154ff-6c10-4510-88c3-0c33dfec836b tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:12.319900 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-edc154ff-6c10-4510-88c3-0c33dfec836b tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] [instance: 43ff4d86-8c12-48ce-bcf5-c607c9bcaa05] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:12.327507 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-edc154ff-6c10-4510-88c3-0c33dfec836b tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:12.331842 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-edc154ff-6c10-4510-88c3-0c33dfec836b tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:12.332014 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-edc154ff-6c10-4510-88c3-0c33dfec836b tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:12.332679 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-edc154ff-6c10-4510-88c3-0c33dfec836b tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:12.335336 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-edc154ff-6c10-4510-88c3-0c33dfec836b tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:12.335483 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-edc154ff-6c10-4510-88c3-0c33dfec836b tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:12.354483 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-1ee91821-1ec8-420b-997e-2eb77282a69d tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:12.362760 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-1ee91821-1ec8-420b-997e-2eb77282a69d tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Searching by: {'deleted': False, 'project_id': '779923a7546e45418b522b71e9127256'} {{(pid=129409) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 10 17:52:12.370809 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-1ee91821-1ec8-420b-997e-2eb77282a69d tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:12.371544 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-1ee91821-1ec8-420b-997e-2eb77282a69d tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:12.372856 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-1ee91821-1ec8-420b-997e-2eb77282a69d tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:12.373840 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-1ee91821-1ec8-420b-997e-2eb77282a69d tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:12.374734 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-1ee91821-1ec8-420b-997e-2eb77282a69d tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:12.375407 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-1ee91821-1ec8-420b-997e-2eb77282a69d tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:12.504453 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-1ee91821-1ec8-420b-997e-2eb77282a69d tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.342893 Aug 10 17:52:12.505155 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 357/725] 10.222.0.50 () {58 vars in 1146 bytes} [Wed Aug 10 17:52:12 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 17:52:12.517477 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-db20f956-7c16-40e2-b665-9fb4f444d446 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:12.517477 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-db20f956-7c16-40e2-b665-9fb4f444d446 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] [instance: 25b28585-a586-423f-8f04-2b2f4d28f16c] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:12.525848 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-db20f956-7c16-40e2-b665-9fb4f444d446 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:12.526356 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-db20f956-7c16-40e2-b665-9fb4f444d446 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:12.528877 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-db20f956-7c16-40e2-b665-9fb4f444d446 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:12.530845 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-db20f956-7c16-40e2-b665-9fb4f444d446 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:12.532845 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-db20f956-7c16-40e2-b665-9fb4f444d446 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:12.533546 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-db20f956-7c16-40e2-b665-9fb4f444d446 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:12.700201 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-edc154ff-6c10-4510-88c3-0c33dfec836b tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e109c3dcd0574faaa3d7ec31dd4edd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48bbb92998f54ebeb624bc794d406896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:12.711549 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-edc154ff-6c10-4510-88c3-0c33dfec836b tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] 10.222.0.50 "GET /compute/v2.1/servers/43ff4d86-8c12-48ce-bcf5-c607c9bcaa05" status: 200 len: 1379 microversion: 2.1 time: 0.397527 Aug 10 17:52:12.725381 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 369/726] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:12 2022] GET /compute/v2.1/servers/43ff4d86-8c12-48ce-bcf5-c607c9bcaa05 => generated 1379 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:12.730398 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-d523e7d5-5a18-4d90-ab4b-7d32586dc8fc tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:12.747615 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-d523e7d5-5a18-4d90-ab4b-7d32586dc8fc tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Searching by: {'deleted': False} {{(pid=129410) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 10 17:52:12.756415 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d523e7d5-5a18-4d90-ab4b-7d32586dc8fc tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:12.757266 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d523e7d5-5a18-4d90-ab4b-7d32586dc8fc tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:12.757929 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d523e7d5-5a18-4d90-ab4b-7d32586dc8fc tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:12.758883 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d523e7d5-5a18-4d90-ab4b-7d32586dc8fc tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:12.759544 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d523e7d5-5a18-4d90-ab4b-7d32586dc8fc tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:12.760184 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d523e7d5-5a18-4d90-ab4b-7d32586dc8fc tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:12.845407 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-db20f956-7c16-40e2-b665-9fb4f444d446 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83a3e198e21476eb12fcf417aea62de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df088e5a610436ea21b8a360e2bb527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:12.858682 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-db20f956-7c16-40e2-b665-9fb4f444d446 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] 10.222.0.50 "GET /compute/v2.1/servers/25b28585-a586-423f-8f04-2b2f4d28f16c" status: 200 len: 1321 microversion: 2.1 time: 0.350207 Aug 10 17:52:12.873560 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 358/727] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:12 2022] GET /compute/v2.1/servers/25b28585-a586-423f-8f04-2b2f4d28f16c => generated 1321 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:12.887977 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-70d23b36-6041-4cd3-992d-6b4af323c5c0 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:12.888852 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-70d23b36-6041-4cd3-992d-6b4af323c5c0 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] [instance: e2777988-0bbf-496c-9c97-b206dbc94a62] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:12.903445 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-70d23b36-6041-4cd3-992d-6b4af323c5c0 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:12.906202 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-70d23b36-6041-4cd3-992d-6b4af323c5c0 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:12.924003 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-70d23b36-6041-4cd3-992d-6b4af323c5c0 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:12.925325 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-70d23b36-6041-4cd3-992d-6b4af323c5c0 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:12.925654 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-70d23b36-6041-4cd3-992d-6b4af323c5c0 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:12.929913 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-70d23b36-6041-4cd3-992d-6b4af323c5c0 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:12.988724 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.multi_cell_list [None req-d523e7d5-5a18-4d90-ab4b-7d32586dc8fc tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Listed batch of 13 results from cell out of 1000 limit. Returned 13 total so far. {{(pid=129410) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 10 17:52:13.021623 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_cell1:SELECT=100 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:52:13.045308 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-70d23b36-6041-4cd3-992d-6b4af323c5c0 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:13.061111 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-70d23b36-6041-4cd3-992d-6b4af323c5c0 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:13.063350 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-70d23b36-6041-4cd3-992d-6b4af323c5c0 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:13.079927 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-70d23b36-6041-4cd3-992d-6b4af323c5c0 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] 10.222.0.50 "GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62" status: 200 len: 1445 microversion: 2.75 time: 0.204928 Aug 10 17:52:13.096285 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 359/728] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:52:12 2022] GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62 => generated 1445 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:52:13.096285 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-37de8288-199e-4b43-a4b5-942f416b82b2 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:13.096285 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-37de8288-199e-4b43-a4b5-942f416b82b2 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: 83268d7f-5375-4b01-9b5c-519be7daf0a4] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:13.104953 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-37de8288-199e-4b43-a4b5-942f416b82b2 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:13.104953 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-37de8288-199e-4b43-a4b5-942f416b82b2 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:13.104953 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-37de8288-199e-4b43-a4b5-942f416b82b2 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:13.109611 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-37de8288-199e-4b43-a4b5-942f416b82b2 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:13.110229 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-37de8288-199e-4b43-a4b5-942f416b82b2 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:13.110681 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-37de8288-199e-4b43-a4b5-942f416b82b2 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:13.192926 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d523e7d5-5a18-4d90-ab4b-7d32586dc8fc tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:13.193732 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d523e7d5-5a18-4d90-ab4b-7d32586dc8fc tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:13.194706 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d523e7d5-5a18-4d90-ab4b-7d32586dc8fc tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:13.682959 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-37de8288-199e-4b43-a4b5-942f416b82b2 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:13.709500 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-37de8288-199e-4b43-a4b5-942f416b82b2 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/83268d7f-5375-4b01-9b5c-519be7daf0a4" status: 200 len: 1319 microversion: 2.1 time: 0.620590 Aug 10 17:52:13.709500 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 360/729] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:13 2022] GET /compute/v2.1/servers/83268d7f-5375-4b01-9b5c-519be7daf0a4 => generated 1319 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:13.709500 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [req-21b4da18-5f80-45eb-a381-12a121ff6f08 req-e84ccec3-fc7b-4c2c-aef8-39ba3a389d1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43ff4d86-8c12-48ce-bcf5-c607c9bcaa05", "name": "network-vif-plugged", "status": "completed", "tag": "50148ea5-cdd9-47b3-8521-2b838cc4745f"}]} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:52:13.720647 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-21b4da18-5f80-45eb-a381-12a121ff6f08 req-e84ccec3-fc7b-4c2c-aef8-39ba3a389d1f service nova] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:13.721334 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-21b4da18-5f80-45eb-a381-12a121ff6f08 req-e84ccec3-fc7b-4c2c-aef8-39ba3a389d1f service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:13.722427 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-21b4da18-5f80-45eb-a381-12a121ff6f08 req-e84ccec3-fc7b-4c2c-aef8-39ba3a389d1f service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:13.746878 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.compute.server_external_events [req-21b4da18-5f80-45eb-a381-12a121ff6f08 req-e84ccec3-fc7b-4c2c-aef8-39ba3a389d1f service nova] Creating event network-vif-plugged:50148ea5-cdd9-47b3-8521-2b838cc4745f for instance 43ff4d86-8c12-48ce-bcf5-c607c9bcaa05 on n-h2-852296-2 Aug 10 17:52:13.753466 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [req-21b4da18-5f80-45eb-a381-12a121ff6f08 req-e84ccec3-fc7b-4c2c-aef8-39ba3a389d1f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048762 Aug 10 17:52:13.768870 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 361/730] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 10 17:52:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:52:13.770619 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-fc1adb74-6d3a-46db-9edf-22c3de3f057b tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:13.772144 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-fc1adb74-6d3a-46db-9edf-22c3de3f057b tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] [instance: 43ff4d86-8c12-48ce-bcf5-c607c9bcaa05] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:13.779510 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-fc1adb74-6d3a-46db-9edf-22c3de3f057b tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:13.779997 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-fc1adb74-6d3a-46db-9edf-22c3de3f057b tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:13.780479 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-fc1adb74-6d3a-46db-9edf-22c3de3f057b tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:13.781743 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-fc1adb74-6d3a-46db-9edf-22c3de3f057b tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:13.782197 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-fc1adb74-6d3a-46db-9edf-22c3de3f057b tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:13.782672 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-fc1adb74-6d3a-46db-9edf-22c3de3f057b tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:13.792008 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-d523e7d5-5a18-4d90-ab4b-7d32586dc8fc tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 20198 microversion: 2.1 time: 1.065190 Aug 10 17:52:13.792884 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 370/731] 10.222.0.50 () {58 vars in 1171 bytes} [Wed Aug 10 17:52:12 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 20198 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 17:52:13.840100 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-46a9c263-8ac0-4521-87d6-2493ffd0ba6d tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:13.850157 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-46a9c263-8ac0-4521-87d6-2493ffd0ba6d tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Searching by: {'deleted': False, 'project_id': '779923a7546e45418b522b71e9127256'} {{(pid=129410) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 10 17:52:13.858480 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-46a9c263-8ac0-4521-87d6-2493ffd0ba6d tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:13.860551 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-46a9c263-8ac0-4521-87d6-2493ffd0ba6d tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:13.861227 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-46a9c263-8ac0-4521-87d6-2493ffd0ba6d tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:13.862066 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-46a9c263-8ac0-4521-87d6-2493ffd0ba6d tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:13.862589 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-46a9c263-8ac0-4521-87d6-2493ffd0ba6d tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:13.868771 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-46a9c263-8ac0-4521-87d6-2493ffd0ba6d tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:14.052978 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-fc1adb74-6d3a-46db-9edf-22c3de3f057b tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e109c3dcd0574faaa3d7ec31dd4edd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48bbb92998f54ebeb624bc794d406896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:14.061665 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-fc1adb74-6d3a-46db-9edf-22c3de3f057b tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] 10.222.0.50 "GET /compute/v2.1/servers/43ff4d86-8c12-48ce-bcf5-c607c9bcaa05" status: 200 len: 1379 microversion: 2.1 time: 0.298882 Aug 10 17:52:14.063520 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 362/732] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:13 2022] GET /compute/v2.1/servers/43ff4d86-8c12-48ce-bcf5-c607c9bcaa05 => generated 1379 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:14.068728 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-b887d965-d969-43da-8ea6-25bc099cffdb tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:14.069570 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-b887d965-d969-43da-8ea6-25bc099cffdb tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] [instance: 25b28585-a586-423f-8f04-2b2f4d28f16c] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:14.076926 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-b887d965-d969-43da-8ea6-25bc099cffdb tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:14.078483 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-b887d965-d969-43da-8ea6-25bc099cffdb tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:14.078483 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-b887d965-d969-43da-8ea6-25bc099cffdb tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:14.079511 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-b887d965-d969-43da-8ea6-25bc099cffdb tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:14.080148 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-b887d965-d969-43da-8ea6-25bc099cffdb tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:14.080776 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-b887d965-d969-43da-8ea6-25bc099cffdb tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:14.208340 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-46a9c263-8ac0-4521-87d6-2493ffd0ba6d tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/detail?tenant_id=6b7c2481a908406fa9c4562513fff665" status: 200 len: 15 microversion: 2.1 time: 0.361548 Aug 10 17:52:14.208340 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 371/733] 10.222.0.50 () {58 vars in 1231 bytes} [Wed Aug 10 17:52:13 2022] GET /compute/v2.1/servers/detail?tenant_id=6b7c2481a908406fa9c4562513fff665 => generated 15 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 10 17:52:14.208340 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-d3243568-cfd0-4065-bda6-e7be47a7423d tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:14.208340 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-d3243568-cfd0-4065-bda6-e7be47a7423d tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] [instance: e2777988-0bbf-496c-9c97-b206dbc94a62] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:14.213110 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d3243568-cfd0-4065-bda6-e7be47a7423d tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:14.213613 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d3243568-cfd0-4065-bda6-e7be47a7423d tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:14.214209 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d3243568-cfd0-4065-bda6-e7be47a7423d tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:14.214908 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d3243568-cfd0-4065-bda6-e7be47a7423d tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:14.215598 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d3243568-cfd0-4065-bda6-e7be47a7423d tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:14.215835 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d3243568-cfd0-4065-bda6-e7be47a7423d tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:14.275076 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-b887d965-d969-43da-8ea6-25bc099cffdb tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83a3e198e21476eb12fcf417aea62de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df088e5a610436ea21b8a360e2bb527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:14.289279 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-b887d965-d969-43da-8ea6-25bc099cffdb tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] 10.222.0.50 "GET /compute/v2.1/servers/25b28585-a586-423f-8f04-2b2f4d28f16c" status: 200 len: 1321 microversion: 2.1 time: 0.224166 Aug 10 17:52:14.290934 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 363/734] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:14 2022] GET /compute/v2.1/servers/25b28585-a586-423f-8f04-2b2f4d28f16c => generated 1321 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:14.294428 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-d3243568-cfd0-4065-bda6-e7be47a7423d tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:14.309082 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-1003b9b6-fc9b-4652-aa68-fec0bebdb42d tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:14.317582 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-d3243568-cfd0-4065-bda6-e7be47a7423d tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:14.319485 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-d3243568-cfd0-4065-bda6-e7be47a7423d tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:14.323965 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-1003b9b6-fc9b-4652-aa68-fec0bebdb42d tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Searching by: {'tenant_id': '6b7c2481a908406fa9c4562513fff665', 'deleted': False} {{(pid=129409) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 10 17:52:14.334139 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-1003b9b6-fc9b-4652-aa68-fec0bebdb42d tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:14.335316 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-d3243568-cfd0-4065-bda6-e7be47a7423d tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] 10.222.0.50 "GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62" status: 200 len: 1445 microversion: 2.75 time: 0.134240 Aug 10 17:52:14.336090 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 372/735] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:52:14 2022] GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62 => generated 1445 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:52:14.336782 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-1003b9b6-fc9b-4652-aa68-fec0bebdb42d tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:14.337434 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-1003b9b6-fc9b-4652-aa68-fec0bebdb42d tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:14.338366 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-1003b9b6-fc9b-4652-aa68-fec0bebdb42d tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:14.338982 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-1003b9b6-fc9b-4652-aa68-fec0bebdb42d tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:14.339547 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-1003b9b6-fc9b-4652-aa68-fec0bebdb42d tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:14.391617 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.multi_cell_list [None req-1003b9b6-fc9b-4652-aa68-fec0bebdb42d tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=129409) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 10 17:52:14.515270 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-1003b9b6-fc9b-4652-aa68-fec0bebdb42d tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:14.516642 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-1003b9b6-fc9b-4652-aa68-fec0bebdb42d tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:14.517120 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-1003b9b6-fc9b-4652-aa68-fec0bebdb42d tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:14.694302 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-1003b9b6-fc9b-4652-aa68-fec0bebdb42d tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=6b7c2481a908406fa9c4562513fff665" status: 200 len: 4824 microversion: 2.1 time: 0.397831 Aug 10 17:52:14.694995 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 364/736] 10.222.0.50 () {58 vars in 1257 bytes} [Wed Aug 10 17:52:14 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=6b7c2481a908406fa9c4562513fff665 => generated 4824 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:14.720078 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-4ec67b15-10af-48d9-9d90-bb44a6c7bdb9 tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:14.724219 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-d7658acb-14ac-40de-af06-da629dd0a917 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:14.724983 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-d7658acb-14ac-40de-af06-da629dd0a917 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: 83268d7f-5375-4b01-9b5c-519be7daf0a4] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:14.727353 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-4ec67b15-10af-48d9-9d90-bb44a6c7bdb9 tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Searching by: {'tenant_id': '779923a7546e45418b522b71e9127256', 'deleted': False} {{(pid=129410) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 10 17:52:14.731211 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-d7658acb-14ac-40de-af06-da629dd0a917 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:14.732793 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-d7658acb-14ac-40de-af06-da629dd0a917 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:14.733418 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-d7658acb-14ac-40de-af06-da629dd0a917 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:14.734506 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-4ec67b15-10af-48d9-9d90-bb44a6c7bdb9 tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:14.735903 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-4ec67b15-10af-48d9-9d90-bb44a6c7bdb9 tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:14.736038 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-d7658acb-14ac-40de-af06-da629dd0a917 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:14.736614 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-d7658acb-14ac-40de-af06-da629dd0a917 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:14.736823 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-4ec67b15-10af-48d9-9d90-bb44a6c7bdb9 tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:14.737043 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-d7658acb-14ac-40de-af06-da629dd0a917 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:14.737940 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-4ec67b15-10af-48d9-9d90-bb44a6c7bdb9 tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:14.738582 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-4ec67b15-10af-48d9-9d90-bb44a6c7bdb9 tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:14.739451 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-4ec67b15-10af-48d9-9d90-bb44a6c7bdb9 tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:14.790977 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-4ec67b15-10af-48d9-9d90-bb44a6c7bdb9 tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=779923a7546e45418b522b71e9127256" status: 200 len: 15 microversion: 2.1 time: 0.074682 Aug 10 17:52:14.792099 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 373/737] 10.222.0.50 () {58 vars in 1257 bytes} [Wed Aug 10 17:52:14 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=779923a7546e45418b522b71e9127256 => generated 15 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 17:52:14.820094 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-20839ec3-431a-4987-8fe9-7342bb21fcc0 tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:14.828734 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-20839ec3-431a-4987-8fe9-7342bb21fcc0 tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.018270 Aug 10 17:52:14.836987 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 374/738] 10.222.0.50 () {58 vars in 1189 bytes} [Wed Aug 10 17:52:14 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 17:52:14.851937 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-8e7763f2-4de8-445d-8079-8a71a5ea113a tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:52:14.860000 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-8e7763f2-4de8-445d-8079-8a71a5ea113a tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] [instance: bee3148a-3834-41bd-99e7-b5da75217256] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:14.882128 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-8e7763f2-4de8-445d-8079-8a71a5ea113a tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:14.882640 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-8e7763f2-4de8-445d-8079-8a71a5ea113a tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:14.883087 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-8e7763f2-4de8-445d-8079-8a71a5ea113a tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:14.883810 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-8e7763f2-4de8-445d-8079-8a71a5ea113a tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:14.884294 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-8e7763f2-4de8-445d-8079-8a71a5ea113a tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:14.884724 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-8e7763f2-4de8-445d-8079-8a71a5ea113a tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:14.999527 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-d7658acb-14ac-40de-af06-da629dd0a917 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:15.012185 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-d7658acb-14ac-40de-af06-da629dd0a917 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/83268d7f-5375-4b01-9b5c-519be7daf0a4" status: 200 len: 1319 microversion: 2.1 time: 0.292264 Aug 10 17:52:15.016658 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 365/739] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:14 2022] GET /compute/v2.1/servers/83268d7f-5375-4b01-9b5c-519be7daf0a4 => generated 1319 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:52:15.084563 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-fd954929-7c7d-46df-8958-6f8c4d0cffe9 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:15.085322 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-fd954929-7c7d-46df-8958-6f8c4d0cffe9 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] [instance: 43ff4d86-8c12-48ce-bcf5-c607c9bcaa05] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:15.095390 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-fd954929-7c7d-46df-8958-6f8c4d0cffe9 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:15.095982 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-fd954929-7c7d-46df-8958-6f8c4d0cffe9 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:15.096512 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-fd954929-7c7d-46df-8958-6f8c4d0cffe9 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:15.097284 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-fd954929-7c7d-46df-8958-6f8c4d0cffe9 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:15.097987 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-fd954929-7c7d-46df-8958-6f8c4d0cffe9 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:15.098480 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-fd954929-7c7d-46df-8958-6f8c4d0cffe9 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:15.294557 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-fd954929-7c7d-46df-8958-6f8c4d0cffe9 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e109c3dcd0574faaa3d7ec31dd4edd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48bbb92998f54ebeb624bc794d406896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:15.302418 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-fd954929-7c7d-46df-8958-6f8c4d0cffe9 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] 10.222.0.50 "GET /compute/v2.1/servers/43ff4d86-8c12-48ce-bcf5-c607c9bcaa05" status: 200 len: 1379 microversion: 2.1 time: 0.221729 Aug 10 17:52:15.303795 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 366/740] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:15 2022] GET /compute/v2.1/servers/43ff4d86-8c12-48ce-bcf5-c607c9bcaa05 => generated 1379 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:52:15.310667 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-31c042b4-3a70-4022-b235-6b787c927191 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:15.313766 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-31c042b4-3a70-4022-b235-6b787c927191 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] [instance: 25b28585-a586-423f-8f04-2b2f4d28f16c] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:15.318531 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-31c042b4-3a70-4022-b235-6b787c927191 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:15.319132 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-31c042b4-3a70-4022-b235-6b787c927191 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:15.319830 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-31c042b4-3a70-4022-b235-6b787c927191 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:15.321121 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-31c042b4-3a70-4022-b235-6b787c927191 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:15.321786 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-31c042b4-3a70-4022-b235-6b787c927191 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:15.322225 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-31c042b4-3a70-4022-b235-6b787c927191 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:15.489983 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-31c042b4-3a70-4022-b235-6b787c927191 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83a3e198e21476eb12fcf417aea62de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df088e5a610436ea21b8a360e2bb527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:15.497602 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-31c042b4-3a70-4022-b235-6b787c927191 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] 10.222.0.50 "GET /compute/v2.1/servers/25b28585-a586-423f-8f04-2b2f4d28f16c" status: 200 len: 1321 microversion: 2.1 time: 0.190482 Aug 10 17:52:15.498457 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 367/741] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:15 2022] GET /compute/v2.1/servers/25b28585-a586-423f-8f04-2b2f4d28f16c => generated 1321 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:15.504339 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-a989fa37-a4ff-47c0-8a1b-2e823bd9f995 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:15.505642 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-a989fa37-a4ff-47c0-8a1b-2e823bd9f995 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] [instance: e2777988-0bbf-496c-9c97-b206dbc94a62] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:15.512056 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a989fa37-a4ff-47c0-8a1b-2e823bd9f995 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:15.512690 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a989fa37-a4ff-47c0-8a1b-2e823bd9f995 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:15.513076 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a989fa37-a4ff-47c0-8a1b-2e823bd9f995 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:15.520095 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a989fa37-a4ff-47c0-8a1b-2e823bd9f995 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:15.520095 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a989fa37-a4ff-47c0-8a1b-2e823bd9f995 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:15.520095 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a989fa37-a4ff-47c0-8a1b-2e823bd9f995 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:15.582522 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-a989fa37-a4ff-47c0-8a1b-2e823bd9f995 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:15.593274 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-a989fa37-a4ff-47c0-8a1b-2e823bd9f995 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:15.595152 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-a989fa37-a4ff-47c0-8a1b-2e823bd9f995 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:15.600423 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-a989fa37-a4ff-47c0-8a1b-2e823bd9f995 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] 10.222.0.50 "GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62" status: 200 len: 1445 microversion: 2.75 time: 0.100693 Aug 10 17:52:15.601197 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 368/742] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:52:15 2022] GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62 => generated 1445 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:52:15.609761 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-8e7763f2-4de8-445d-8079-8a71a5ea113a tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256/action" status: 202 len: 0 microversion: 2.1 time: 0.759688 Aug 10 17:52:15.609761 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 375/743] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 10 17:52:14 2022] POST /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256/action => generated 0 bytes in 761 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 17:52:15.631117 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-bf1bee63-b873-4689-bf04-3c2d9aa8d905 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:15.638797 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-bf1bee63-b873-4689-bf04-3c2d9aa8d905 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1b2fd6acf18d4218ad143ccee2d0bb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7c2481a908406fa9c4562513fff665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:15.639547 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-bf1bee63-b873-4689-bf04-3c2d9aa8d905 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '6b7c2481a908406fa9c4562513fff665'} {{(pid=129409) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 10 17:52:15.649240 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-bf1bee63-b873-4689-bf04-3c2d9aa8d905 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:15.649240 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-bf1bee63-b873-4689-bf04-3c2d9aa8d905 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:15.649240 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-bf1bee63-b873-4689-bf04-3c2d9aa8d905 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:15.649559 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-bf1bee63-b873-4689-bf04-3c2d9aa8d905 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:15.650209 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-bf1bee63-b873-4689-bf04-3c2d9aa8d905 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:15.650638 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-bf1bee63-b873-4689-bf04-3c2d9aa8d905 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:15.745232 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.multi_cell_list [None req-bf1bee63-b873-4689-bf04-3c2d9aa8d905 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=129409) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 10 17:52:15.806865 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-bf1bee63-b873-4689-bf04-3c2d9aa8d905 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] 10.222.0.50 "GET /compute/v2.1/servers?status=error" status: 200 len: 338 microversion: 2.1 time: 0.193439 Aug 10 17:52:15.807654 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 369/744] 10.222.0.50 () {58 vars in 1150 bytes} [Wed Aug 10 17:52:15 2022] GET /compute/v2.1/servers?status=error => generated 338 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:52:15.819062 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-d7aff0dd-1018-40ef-9eb5-72bf0dd9d00f tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:52:15.821297 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-d7aff0dd-1018-40ef-9eb5-72bf0dd9d00f tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] [instance: bee3148a-3834-41bd-99e7-b5da75217256] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:15.824870 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:52:15.828339 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d7aff0dd-1018-40ef-9eb5-72bf0dd9d00f tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:15.828812 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d7aff0dd-1018-40ef-9eb5-72bf0dd9d00f tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:15.829242 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d7aff0dd-1018-40ef-9eb5-72bf0dd9d00f tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:15.829933 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d7aff0dd-1018-40ef-9eb5-72bf0dd9d00f tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:15.830440 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d7aff0dd-1018-40ef-9eb5-72bf0dd9d00f tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:15.831054 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d7aff0dd-1018-40ef-9eb5-72bf0dd9d00f tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:15.917844 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-44a00983-a834-4fbd-b5a8-45c52d9f943d tempest-AttachVolumeShelveTestJSON-21911967 tempest-AttachVolumeShelveTestJSON-21911967-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-731717355", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4b4e0ed7-31a8-46e4-8e64-4d58423ae488"}], "security_groups": [{"name": "tempest-securitygroup--1970605904"}], "key_name": "tempest-keypair-1681549841", "user_data": "}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:52:16.024603 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.network.neutron [None req-44a00983-a834-4fbd-b5a8-45c52d9f943d tempest-AttachVolumeShelveTestJSON-21911967 tempest-AttachVolumeShelveTestJSON-21911967-project] validate_networks() for [('4b4e0ed7-31a8-46e4-8e64-4d58423ae488', None, None, None, None, None)] {{(pid=129409) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 17:52:16.233796 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [None req-44a00983-a834-4fbd-b5a8-45c52d9f943d tempest-AttachVolumeShelveTestJSON-21911967 tempest-AttachVolumeShelveTestJSON-21911967-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-68f2eeee-4709-4415-bf14-04164c119b26) Aug 10 17:52:16.233796 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:52:16.233796 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:52:16.233796 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:52:16.233796 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:52:16.233796 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:52:16.233796 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:52:16.233796 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:52:16.233796 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:52:16.233796 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:52:16.233796 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 17:52:16.233796 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 17:52:16.233796 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 17:52:16.233796 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 17:52:16.233796 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 17:52:16.233796 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 17:52:16.233796 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 17:52:16.233796 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 17:52:16.233796 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 17:52:16.233796 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 17:52:16.233796 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 17:52:16.233796 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 17:52:16.233796 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 17:52:16.233796 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 17:52:16.233796 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 17:52:16.233796 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 17:52:16.233796 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 17:52:16.233796 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:52:16.233796 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:52:16.233796 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 17:52:16.233796 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 17:52:16.233796 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:52:16.233796 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:52:16.233796 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:52:16.233796 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:52:16.233796 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:52:16.233796 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:52:16.233796 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:52:16.233796 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:52:16.233796 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:52:16.233796 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:52:16.233796 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 17:52:16.233796 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 17:52:16.233796 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 17:52:16.233796 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 17:52:16.233796 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 17:52:16.233796 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 17:52:16.233796 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 17:52:16.233796 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 17:52:16.233796 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 17:52:16.233796 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 17:52:16.233796 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 17:52:16.238068 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 17:52:16.238068 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 17:52:16.238068 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 17:52:16.238068 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 17:52:16.238068 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 17:52:16.238068 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 17:52:16.238068 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 17:52:16.238068 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 17:52:16.238068 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 17:52:16.238068 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 17:52:16.238068 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 17:52:16.238068 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 17:52:16.238068 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 17:52:16.238068 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 17:52:16.238068 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 17:52:16.238068 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-68f2eeee-4709-4415-bf14-04164c119b26) Aug 10 17:52:16.238068 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:52:16.238068 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-44a00983-a834-4fbd-b5a8-45c52d9f943d tempest-AttachVolumeShelveTestJSON-21911967 tempest-AttachVolumeShelveTestJSON-21911967-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:52:16.238068 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:52:16.238068 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-44a00983-a834-4fbd-b5a8-45c52d9f943d tempest-AttachVolumeShelveTestJSON-21911967 tempest-AttachVolumeShelveTestJSON-21911967-project] Request method failure captured: Aug 10 17:52:16.238068 n-d-852296-2 devstack@n-api.service[129409]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 17:52:16.238068 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 17:52:16.238068 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 17:52:16.238068 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 17:52:16.238068 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 491 Aug 10 17:52:16.238068 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 17:52:16.238068 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 17:52:16.238068 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 17:52:16.238068 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 17:52:16.238068 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8_BAZh9IjFuRHA25NBlOF3-ODfYLR4DJnvJme7tmKJtFCJtylq_7UmAyxfd5tYk2umx_fwUMh-cSuC-FNPCiZP6Nud1bWTs0CCCd6VkXC1v-A0YS3HpIDJ_31eLu0kw04oK8dPbbek2iNv4TfHA9jQnqy2OS8pZZMpReC7rD9d6bIMk Aug 10 17:52:16.238068 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 17:52:16.238068 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 17:52:16.238068 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 17:52:16.238068 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 17:52:16.238068 n-d-852296-2 devstack@n-api.service[129409]: X-Openstack-Nova-Api-Version: 2.20 Aug 10 17:52:16.238068 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 17:52:16.238068 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 17:52:16.238068 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: 81e24e5e4b5946af87ed8621126ca737 Aug 10 17:52:16.238068 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-21911967 Aug 10 17:52:16.238068 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 17:52:16.238068 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 17:52:16.238068 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/81e24e5e4b5946af87ed8621126ca737"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/81e24e5e4b5946af87ed8621126ca737"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/81e24e5e4b5946af87ed8621126ca737"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_81e24e5e4b5946af87ed8621126ca737", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:52:16.238068 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-AttachVolumeShelveTestJSON-21911967 Aug 10 17:52:16.238068 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: 81e24e5e4b5946af87ed8621126ca737 Aug 10 17:52:16.238068 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-21911967 Aug 10 17:52:16.238068 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-AttachVolumeShelveTestJSON-21911967-project Aug 10 17:52:16.238068 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 17:52:16.238068 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 17:52:16.238068 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: 2f42cb7cd86e497ab532c5cd5e05c99d Aug 10 17:52:16.238068 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-AttachVolumeShelveTestJSON-21911967-project Aug 10 17:52:16.238068 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:52:16.238068 n-d-852296-2 devstack@n-api.service[129409]: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-731717355", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "adminPass": "password", "networks": [{"uuid": "4b4e0ed7-31a8-46e4-8e64-4d58423ae488"}], "security_groups": [{"name": "tempest-securitygroup--1970605904"}], "key_name": "tempest-keypair-1681549841", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} Aug 10 17:52:16.238068 n-d-852296-2 devstack@n-api.service[129409]: method: > Aug 10 17:52:16.238068 n-d-852296-2 devstack@n-api.service[129409]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:52:16.242119 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:52:16.242119 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'body': {'server': {'name': 'tempest-AttachVolumeShelveTestJSON-server-731717355', 'imageRef': 'a735ff26-463a-4ffe-a981-ab9d9baa494f', 'flavorRef': '452', 'adminPass': 'password', 'networks': [{'uuid': '4b4e0ed7-31a8-46e4-8e64-4d58423ae488'}], 'security_groups': [{'name': 'tempest-securitygroup--1970605904'}], 'key_name': 'tempest-keypair-1681549841', 'user_data': 'IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo='}}} Aug 10 17:52:16.242119 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:52:16.242119 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:52:16.242119 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:52:16.242119 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:52:16.242119 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:52:16.242119 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:52:16.242119 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:52:16.242119 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:52:16.242119 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:52:16.242119 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:52:16.242119 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 17:52:16.242119 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 17:52:16.242119 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 17:52:16.242119 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 17:52:16.242119 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 17:52:16.242119 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 17:52:16.242119 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 17:52:16.242119 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 17:52:16.242119 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 17:52:16.242119 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 17:52:16.242119 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 17:52:16.242119 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 17:52:16.242119 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 17:52:16.242119 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 17:52:16.242119 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 17:52:16.242119 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 17:52:16.242119 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 17:52:16.242119 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:52:16.242119 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:52:16.242119 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 17:52:16.242119 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 17:52:16.242119 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:52:16.242119 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:52:16.242119 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:52:16.242119 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:52:16.242119 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:52:16.242119 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:52:16.242119 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:52:16.242119 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:52:16.242119 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:52:16.242119 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:52:16.242119 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 17:52:16.242119 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 17:52:16.242119 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 17:52:16.242119 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 17:52:16.242119 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 17:52:16.242119 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 17:52:16.242119 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 17:52:16.242119 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 17:52:16.242119 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 17:52:16.242119 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 17:52:16.246440 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 17:52:16.246440 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 17:52:16.246440 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 17:52:16.246440 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 17:52:16.246440 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 17:52:16.246440 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 17:52:16.246440 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 17:52:16.246440 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 17:52:16.246440 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 17:52:16.246440 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 17:52:16.246440 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 17:52:16.246440 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 17:52:16.246440 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 17:52:16.246440 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 17:52:16.246440 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 17:52:16.246440 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 17:52:16.246440 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-68f2eeee-4709-4415-bf14-04164c119b26) Aug 10 17:52:16.246440 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:52:16.246440 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:52:16.246440 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:52:16.246440 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:52:16.246440 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:52:16.246440 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:52:16.246440 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:52:16.246440 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:52:16.246440 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 10 17:52:16.246440 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 10 17:52:16.246440 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:52:16.246440 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:52:16.246440 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:52:16.246440 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:52:16.246440 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:52:16.246440 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:52:16.246440 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:52:16.246440 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:52:16.246440 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:52:16.246440 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:52:16.246440 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:52:16.246440 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:52:16.246440 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:52:16.246440 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-44a00983-a834-4fbd-b5a8-45c52d9f943d tempest-AttachVolumeShelveTestJSON-21911967 tempest-AttachVolumeShelveTestJSON-21911967-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:52:16.246440 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:52:16.246440 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-44a00983-a834-4fbd-b5a8-45c52d9f943d tempest-AttachVolumeShelveTestJSON-21911967 tempest-AttachVolumeShelveTestJSON-21911967-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.20 time: 0.324775 Aug 10 17:52:16.246440 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 370/745] 10.222.0.50 () {62 vars in 1188 bytes} [Wed Aug 10 17:52:15 2022] POST /compute/v2.1/servers => generated 214 bytes in 326 msecs (HTTP/1.1 500) 9 headers in 393 bytes (2 switches on core 0) Aug 10 17:52:16.250555 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-56192231-4910-4c9e-bf57-d781c7a3ed1b tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:16.250555 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-56192231-4910-4c9e-bf57-d781c7a3ed1b tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: 83268d7f-5375-4b01-9b5c-519be7daf0a4] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:16.255556 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-56192231-4910-4c9e-bf57-d781c7a3ed1b tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:16.262746 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-56192231-4910-4c9e-bf57-d781c7a3ed1b tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:16.262746 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-56192231-4910-4c9e-bf57-d781c7a3ed1b tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:16.262746 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-56192231-4910-4c9e-bf57-d781c7a3ed1b tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:16.262746 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-56192231-4910-4c9e-bf57-d781c7a3ed1b tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:16.262746 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-56192231-4910-4c9e-bf57-d781c7a3ed1b tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:16.321982 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-d7aff0dd-1018-40ef-9eb5-72bf0dd9d00f tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256/action" status: 202 len: 0 microversion: 2.1 time: 0.506564 Aug 10 17:52:16.322733 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 376/746] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 10 17:52:15 2022] POST /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256/action => generated 0 bytes in 508 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 17:52:16.328717 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-ba180220-3f55-42f7-b074-6fe52e4843cf tempest-AttachVolumeShelveTestJSON-21911967 tempest-AttachVolumeShelveTestJSON-21911967-project] Calling method '.version_select at 0x7fb3463e9c10>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:16.393183 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-56192231-4910-4c9e-bf57-d781c7a3ed1b tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:16.400730 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-56192231-4910-4c9e-bf57-d781c7a3ed1b tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/83268d7f-5375-4b01-9b5c-519be7daf0a4" status: 200 len: 1469 microversion: 2.1 time: 0.157471 Aug 10 17:52:16.404193 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 371/747] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:16 2022] GET /compute/v2.1/servers/83268d7f-5375-4b01-9b5c-519be7daf0a4 => generated 1469 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:16.406426 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-e4620d5c-3eec-4b3b-8f5f-4641a5d4aa13 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:16.407062 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-e4620d5c-3eec-4b3b-8f5f-4641a5d4aa13 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] [instance: 43ff4d86-8c12-48ce-bcf5-c607c9bcaa05] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:16.413042 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e4620d5c-3eec-4b3b-8f5f-4641a5d4aa13 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:16.413523 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e4620d5c-3eec-4b3b-8f5f-4641a5d4aa13 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:16.413974 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e4620d5c-3eec-4b3b-8f5f-4641a5d4aa13 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:16.414666 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e4620d5c-3eec-4b3b-8f5f-4641a5d4aa13 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:16.415135 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e4620d5c-3eec-4b3b-8f5f-4641a5d4aa13 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:16.415557 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e4620d5c-3eec-4b3b-8f5f-4641a5d4aa13 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:16.438022 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-ba180220-3f55-42f7-b074-6fe52e4843cf tempest-AttachVolumeShelveTestJSON-21911967 tempest-AttachVolumeShelveTestJSON-21911967-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1681549841" status: 204 len: 0 microversion: 2.20 time: 0.113654 Aug 10 17:52:16.438721 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 377/748] 10.222.0.50 () {60 vars in 1262 bytes} [Wed Aug 10 17:52:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1681549841 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 10 17:52:16.450270 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-4e0e8fd1-b8f6-4684-8271-b3d5b5fc5c19 tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:16.450270 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-4e0e8fd1-b8f6-4684-8271-b3d5b5fc5c19 tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] [instance: bee3148a-3834-41bd-99e7-b5da75217256] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:16.451011 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-4e0e8fd1-b8f6-4684-8271-b3d5b5fc5c19 tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:16.451457 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-4e0e8fd1-b8f6-4684-8271-b3d5b5fc5c19 tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:16.451942 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-4e0e8fd1-b8f6-4684-8271-b3d5b5fc5c19 tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:16.453535 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-4e0e8fd1-b8f6-4684-8271-b3d5b5fc5c19 tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:16.454090 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-4e0e8fd1-b8f6-4684-8271-b3d5b5fc5c19 tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:16.454593 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-4e0e8fd1-b8f6-4684-8271-b3d5b5fc5c19 tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:16.562998 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-e4620d5c-3eec-4b3b-8f5f-4641a5d4aa13 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e109c3dcd0574faaa3d7ec31dd4edd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48bbb92998f54ebeb624bc794d406896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:16.571910 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-e4620d5c-3eec-4b3b-8f5f-4641a5d4aa13 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] 10.222.0.50 "GET /compute/v2.1/servers/43ff4d86-8c12-48ce-bcf5-c607c9bcaa05" status: 200 len: 1529 microversion: 2.1 time: 0.169478 Aug 10 17:52:16.572524 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 372/749] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:16 2022] GET /compute/v2.1/servers/43ff4d86-8c12-48ce-bcf5-c607c9bcaa05 => generated 1529 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:16.577020 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-4ed65f20-4633-4c78-93ad-b94f297ff615 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:16.578231 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-4ed65f20-4633-4c78-93ad-b94f297ff615 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: 0d821054-dce7-4015-8eaa-d8c56e7c3cd3] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:16.581251 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:52:16.584647 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-4ed65f20-4633-4c78-93ad-b94f297ff615 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:16.585114 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-4ed65f20-4633-4c78-93ad-b94f297ff615 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:16.585710 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-4ed65f20-4633-4c78-93ad-b94f297ff615 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:16.586552 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-4ed65f20-4633-4c78-93ad-b94f297ff615 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:16.587167 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-4ed65f20-4633-4c78-93ad-b94f297ff615 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:16.587593 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-4ed65f20-4633-4c78-93ad-b94f297ff615 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:16.650766 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-4e0e8fd1-b8f6-4684-8271-b3d5b5fc5c19 tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256" status: 200 len: 1613 microversion: 2.1 time: 0.210757 Aug 10 17:52:16.651405 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 378/750] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:16 2022] GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256 => generated 1613 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:16.656888 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-731df084-6e10-46be-9b05-0ef1b023b6e7 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:16.657681 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-731df084-6e10-46be-9b05-0ef1b023b6e7 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] [instance: 25b28585-a586-423f-8f04-2b2f4d28f16c] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:16.663915 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-731df084-6e10-46be-9b05-0ef1b023b6e7 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:16.664914 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-731df084-6e10-46be-9b05-0ef1b023b6e7 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:16.665529 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-731df084-6e10-46be-9b05-0ef1b023b6e7 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:16.666448 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-731df084-6e10-46be-9b05-0ef1b023b6e7 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:16.667366 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-731df084-6e10-46be-9b05-0ef1b023b6e7 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:16.667990 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-731df084-6e10-46be-9b05-0ef1b023b6e7 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:16.747703 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-4ed65f20-4633-4c78-93ad-b94f297ff615 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:16.757680 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-4ed65f20-4633-4c78-93ad-b94f297ff615 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/0d821054-dce7-4015-8eaa-d8c56e7c3cd3" status: 200 len: 1469 microversion: 2.1 time: 0.183968 Aug 10 17:52:16.760315 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 373/751] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:16 2022] GET /compute/v2.1/servers/0d821054-dce7-4015-8eaa-d8c56e7c3cd3 => generated 1469 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:16.765749 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-76572627-bf72-4083-a29c-07f93c56c52f tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:16.766533 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-76572627-bf72-4083-a29c-07f93c56c52f tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] [instance: 43ff4d86-8c12-48ce-bcf5-c607c9bcaa05] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:16.774293 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-76572627-bf72-4083-a29c-07f93c56c52f tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:16.774293 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-76572627-bf72-4083-a29c-07f93c56c52f tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:16.774991 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-76572627-bf72-4083-a29c-07f93c56c52f tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:16.775871 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-76572627-bf72-4083-a29c-07f93c56c52f tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:16.776838 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-76572627-bf72-4083-a29c-07f93c56c52f tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:16.777447 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-76572627-bf72-4083-a29c-07f93c56c52f tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:16.827361 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-731df084-6e10-46be-9b05-0ef1b023b6e7 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83a3e198e21476eb12fcf417aea62de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df088e5a610436ea21b8a360e2bb527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:16.846797 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-731df084-6e10-46be-9b05-0ef1b023b6e7 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] 10.222.0.50 "GET /compute/v2.1/servers/25b28585-a586-423f-8f04-2b2f4d28f16c" status: 200 len: 1321 microversion: 2.1 time: 0.194099 Aug 10 17:52:16.847629 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 379/752] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:16 2022] GET /compute/v2.1/servers/25b28585-a586-423f-8f04-2b2f4d28f16c => generated 1321 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:16.853361 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-810f762e-b24a-4b6e-86c7-6ed1724d7d2f tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:16.854452 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-810f762e-b24a-4b6e-86c7-6ed1724d7d2f tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] [instance: e2777988-0bbf-496c-9c97-b206dbc94a62] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:16.862044 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-810f762e-b24a-4b6e-86c7-6ed1724d7d2f tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:16.862598 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-810f762e-b24a-4b6e-86c7-6ed1724d7d2f tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:16.863049 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-810f762e-b24a-4b6e-86c7-6ed1724d7d2f tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:16.863798 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-810f762e-b24a-4b6e-86c7-6ed1724d7d2f tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:16.864370 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-810f762e-b24a-4b6e-86c7-6ed1724d7d2f tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:16.864796 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-810f762e-b24a-4b6e-86c7-6ed1724d7d2f tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:16.934486 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-810f762e-b24a-4b6e-86c7-6ed1724d7d2f tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:16.944500 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-810f762e-b24a-4b6e-86c7-6ed1724d7d2f tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:16.946593 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-810f762e-b24a-4b6e-86c7-6ed1724d7d2f tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:16.953851 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-810f762e-b24a-4b6e-86c7-6ed1724d7d2f tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] 10.222.0.50 "GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62" status: 200 len: 1445 microversion: 2.75 time: 0.104506 Aug 10 17:52:16.959043 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 380/753] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:52:16 2022] GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62 => generated 1445 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:52:16.960963 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-360ab2fb-3d78-43f4-bdaa-6ba1f041d478 tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:16.961966 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-360ab2fb-3d78-43f4-bdaa-6ba1f041d478 tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] [instance: bee3148a-3834-41bd-99e7-b5da75217256] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:16.969750 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-360ab2fb-3d78-43f4-bdaa-6ba1f041d478 tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:16.970465 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-360ab2fb-3d78-43f4-bdaa-6ba1f041d478 tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:16.971100 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-360ab2fb-3d78-43f4-bdaa-6ba1f041d478 tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:16.972055 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-360ab2fb-3d78-43f4-bdaa-6ba1f041d478 tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:16.972757 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-360ab2fb-3d78-43f4-bdaa-6ba1f041d478 tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:16.973531 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-360ab2fb-3d78-43f4-bdaa-6ba1f041d478 tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:17.059503 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-76572627-bf72-4083-a29c-07f93c56c52f tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e109c3dcd0574faaa3d7ec31dd4edd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48bbb92998f54ebeb624bc794d406896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:17.066385 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_cell1:SELECT=100 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:52:17.069011 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-76572627-bf72-4083-a29c-07f93c56c52f tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] 10.222.0.50 "GET /compute/v2.1/servers/43ff4d86-8c12-48ce-bcf5-c607c9bcaa05" status: 200 len: 1529 microversion: 2.1 time: 0.307563 Aug 10 17:52:17.069931 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 374/754] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:16 2022] GET /compute/v2.1/servers/43ff4d86-8c12-48ce-bcf5-c607c9bcaa05 => generated 1529 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:17.075193 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-94d2f96c-f9de-426e-9689-c1cedf46b5a8 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:17.081956 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-94d2f96c-f9de-426e-9689-c1cedf46b5a8 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:17.082992 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-94d2f96c-f9de-426e-9689-c1cedf46b5a8 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Searching by: {'reservation_id': 'r-78lsc7xv', 'deleted': False, 'project_id': '0638146d08704b2983761619745290b3'} {{(pid=129409) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 10 17:52:17.089210 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-94d2f96c-f9de-426e-9689-c1cedf46b5a8 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:17.089699 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-94d2f96c-f9de-426e-9689-c1cedf46b5a8 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:17.090147 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-94d2f96c-f9de-426e-9689-c1cedf46b5a8 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:17.090878 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-94d2f96c-f9de-426e-9689-c1cedf46b5a8 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:17.091358 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-94d2f96c-f9de-426e-9689-c1cedf46b5a8 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:17.091856 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-94d2f96c-f9de-426e-9689-c1cedf46b5a8 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:17.122715 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-360ab2fb-3d78-43f4-bdaa-6ba1f041d478 tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256" status: 200 len: 1613 microversion: 2.1 time: 0.166446 Aug 10 17:52:17.123393 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 381/755] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:16 2022] GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256 => generated 1613 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:17.142032 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-3377276f-3eff-4f9c-a2ab-723a1e1d05d1 tempest-MigrationsAdminTest-964085913 tempest-MigrationsAdminTest-964085913-project-admin] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:17.142899 n-d-852296-2 devstack@n-api.service[129410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:52:17.142899 n-d-852296-2 devstack@n-api.service[129410]: warnings.warn(msg) Aug 10 17:52:17.197851 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.multi_cell_list [None req-94d2f96c-f9de-426e-9689-c1cedf46b5a8 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=129409) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 10 17:52:17.246423 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-3377276f-3eff-4f9c-a2ab-723a1e1d05d1 tempest-MigrationsAdminTest-964085913 tempest-MigrationsAdminTest-964085913-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/ecb11648-6e2f-4ee1-97ae-15f83859e423" status: 202 len: 0 microversion: 2.1 time: 0.108565 Aug 10 17:52:17.247020 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 382/756] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 10 17:52:17 2022] DELETE /compute/v2.1/flavors/ecb11648-6e2f-4ee1-97ae-15f83859e423 => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 17:52:17.252979 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-b19dbe35-9b07-49b9-a3b9-e3bc2f46ad11 tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:17.259493 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-b19dbe35-9b07-49b9-a3b9-e3bc2f46ad11 tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Searching by: {'host': 'n-h2-852296-2', 'deleted': False} {{(pid=129410) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 10 17:52:17.266189 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b19dbe35-9b07-49b9-a3b9-e3bc2f46ad11 tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:17.268766 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b19dbe35-9b07-49b9-a3b9-e3bc2f46ad11 tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:17.269390 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b19dbe35-9b07-49b9-a3b9-e3bc2f46ad11 tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:17.270321 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b19dbe35-9b07-49b9-a3b9-e3bc2f46ad11 tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:17.270807 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b19dbe35-9b07-49b9-a3b9-e3bc2f46ad11 tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:17.271240 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b19dbe35-9b07-49b9-a3b9-e3bc2f46ad11 tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:17.272633 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-94d2f96c-f9de-426e-9689-c1cedf46b5a8 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:17.279303 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-94d2f96c-f9de-426e-9689-c1cedf46b5a8 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:17.279785 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-94d2f96c-f9de-426e-9689-c1cedf46b5a8 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:17.280452 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-94d2f96c-f9de-426e-9689-c1cedf46b5a8 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:17.400008 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.multi_cell_list [None req-b19dbe35-9b07-49b9-a3b9-e3bc2f46ad11 tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Listed batch of 6 results from cell out of 1000 limit. Returned 6 total so far. {{(pid=129410) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 10 17:52:17.446890 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-94d2f96c-f9de-426e-9689-c1cedf46b5a8 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/detail?reservation_id=r-78lsc7xv" status: 200 len: 2931 microversion: 2.1 time: 0.375723 Aug 10 17:52:17.447560 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 375/757] 10.222.0.50 () {58 vars in 1197 bytes} [Wed Aug 10 17:52:17 2022] GET /compute/v2.1/servers/detail?reservation_id=r-78lsc7xv => generated 2931 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:17.452283 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-9c1f3799-1585-460c-960d-e0392fdb846e tempest-MigrationsAdminTest-964085913 tempest-MigrationsAdminTest-964085913-project-admin] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:17.481363 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-b19dbe35-9b07-49b9-a3b9-e3bc2f46ad11 tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] 10.222.0.50 "GET /compute/v2.1/servers?host=n-h2-852296-2&all_tenants=1" status: 200 len: 1970 microversion: 2.1 time: 0.230522 Aug 10 17:52:17.481363 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 383/758] 10.222.0.50 () {58 vars in 1190 bytes} [Wed Aug 10 17:52:17 2022] GET /compute/v2.1/servers?host=n-h2-852296-2&all_tenants=1 => generated 1970 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:17.486122 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-8465f2ee-e006-4df8-aac6-9c6814ef43cf tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:17.504728 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.compute.server_groups [None req-8465f2ee-e006-4df8-aac6-9c6814ef43cf tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Querying cell eb80cdf1-5ac7-4611-abc6-59802fe86dfd(cell1) for 2 instances {{(pid=129410) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 10 17:52:17.505665 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-8465f2ee-e006-4df8-aac6-9c6814ef43cf tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:17.506130 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-8465f2ee-e006-4df8-aac6-9c6814ef43cf tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:17.506562 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-8465f2ee-e006-4df8-aac6-9c6814ef43cf tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:17.531495 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-8465f2ee-e006-4df8-aac6-9c6814ef43cf tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/os-server-groups/d19eb39d-b249-4bed-928d-da2a8027d1dc" status: 200 len: 270 microversion: 2.1 time: 0.049306 Aug 10 17:52:17.532558 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 384/759] 10.222.0.50 () {58 vars in 1263 bytes} [Wed Aug 10 17:52:17 2022] GET /compute/v2.1/os-server-groups/d19eb39d-b249-4bed-928d-da2a8027d1dc => generated 270 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:52:17.545561 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-1cbe5106-247c-4fcf-be63-5acb3a56b514 tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:17.552561 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-1cbe5106-247c-4fcf-be63-5acb3a56b514 tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=129410) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 10 17:52:17.558419 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-1cbe5106-247c-4fcf-be63-5acb3a56b514 tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:17.559007 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-1cbe5106-247c-4fcf-be63-5acb3a56b514 tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:17.559739 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-1cbe5106-247c-4fcf-be63-5acb3a56b514 tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:17.560625 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-1cbe5106-247c-4fcf-be63-5acb3a56b514 tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:17.561153 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-1cbe5106-247c-4fcf-be63-5acb3a56b514 tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:17.561665 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-1cbe5106-247c-4fcf-be63-5acb3a56b514 tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:17.604454 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-1cbe5106-247c-4fcf-be63-5acb3a56b514 tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] 10.222.0.50 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.060040 Aug 10 17:52:17.606176 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 385/760] 10.222.0.50 () {58 vars in 1196 bytes} [Wed Aug 10 17:52:17 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 17:52:17.619689 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-15b2fa3d-3931-4766-82b7-b421ceda6723 tempest-ServersOnMultiNodesTest-116104069 tempest-ServersOnMultiNodesTest-116104069-project-admin] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:17.620344 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-15b2fa3d-3931-4766-82b7-b421ceda6723 tempest-ServersOnMultiNodesTest-116104069 tempest-ServersOnMultiNodesTest-116104069-project-admin] [instance: 0d821054-dce7-4015-8eaa-d8c56e7c3cd3] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:17.633752 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-15b2fa3d-3931-4766-82b7-b421ceda6723 tempest-ServersOnMultiNodesTest-116104069 tempest-ServersOnMultiNodesTest-116104069-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:17.637625 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-15b2fa3d-3931-4766-82b7-b421ceda6723 tempest-ServersOnMultiNodesTest-116104069 tempest-ServersOnMultiNodesTest-116104069-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:17.638087 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-15b2fa3d-3931-4766-82b7-b421ceda6723 tempest-ServersOnMultiNodesTest-116104069 tempest-ServersOnMultiNodesTest-116104069-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:17.646469 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-15b2fa3d-3931-4766-82b7-b421ceda6723 tempest-ServersOnMultiNodesTest-116104069 tempest-ServersOnMultiNodesTest-116104069-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:17.646469 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-15b2fa3d-3931-4766-82b7-b421ceda6723 tempest-ServersOnMultiNodesTest-116104069 tempest-ServersOnMultiNodesTest-116104069-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:17.646469 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-15b2fa3d-3931-4766-82b7-b421ceda6723 tempest-ServersOnMultiNodesTest-116104069 tempest-ServersOnMultiNodesTest-116104069-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:17.732001 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-9c1f3799-1585-460c-960d-e0392fdb846e tempest-MigrationsAdminTest-964085913 tempest-MigrationsAdminTest-964085913-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.283040 Aug 10 17:52:17.732748 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 376/761] 10.222.0.50 () {58 vars in 1146 bytes} [Wed Aug 10 17:52:17 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:17.738457 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-1cab98e0-0f57-4b06-93c7-6d52fe4fee3b tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:52:17.741127 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-1cab98e0-0f57-4b06-93c7-6d52fe4fee3b tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] [instance: bee3148a-3834-41bd-99e7-b5da75217256] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:17.747360 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-1cab98e0-0f57-4b06-93c7-6d52fe4fee3b tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:17.748118 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-1cab98e0-0f57-4b06-93c7-6d52fe4fee3b tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:17.749291 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-1cab98e0-0f57-4b06-93c7-6d52fe4fee3b tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:17.750325 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-1cab98e0-0f57-4b06-93c7-6d52fe4fee3b tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:17.751212 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-1cab98e0-0f57-4b06-93c7-6d52fe4fee3b tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:17.751826 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-1cab98e0-0f57-4b06-93c7-6d52fe4fee3b tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:17.875991 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-15b2fa3d-3931-4766-82b7-b421ceda6723 tempest-ServersOnMultiNodesTest-116104069 tempest-ServersOnMultiNodesTest-116104069-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/0d821054-dce7-4015-8eaa-d8c56e7c3cd3" status: 200 len: 1620 microversion: 2.1 time: 0.260106 Aug 10 17:52:17.880486 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 386/762] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:17 2022] GET /compute/v2.1/servers/0d821054-dce7-4015-8eaa-d8c56e7c3cd3 => generated 1620 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:17.889122 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [req-f0633e51-0eaa-4aca-951a-80b1dfbdecae req-6a90b15e-16e4-4cff-8f3f-2486e98a171f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25b28585-a586-423f-8f04-2b2f4d28f16c", "name": "network-vif-plugged", "status": "completed", "tag": "9b21b54b-64c6-42f3-892e-f4d109dd851a"}]} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:52:17.912390 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-f0633e51-0eaa-4aca-951a-80b1dfbdecae req-6a90b15e-16e4-4cff-8f3f-2486e98a171f service nova] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:17.913063 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-f0633e51-0eaa-4aca-951a-80b1dfbdecae req-6a90b15e-16e4-4cff-8f3f-2486e98a171f service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:17.913743 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-f0633e51-0eaa-4aca-951a-80b1dfbdecae req-6a90b15e-16e4-4cff-8f3f-2486e98a171f service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:17.932095 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.compute.server_external_events [req-f0633e51-0eaa-4aca-951a-80b1dfbdecae req-6a90b15e-16e4-4cff-8f3f-2486e98a171f service nova] Creating event network-vif-plugged:9b21b54b-64c6-42f3-892e-f4d109dd851a for instance 25b28585-a586-423f-8f04-2b2f4d28f16c on n-h1-852296-2 Aug 10 17:52:17.938437 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [req-f0633e51-0eaa-4aca-951a-80b1dfbdecae req-6a90b15e-16e4-4cff-8f3f-2486e98a171f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056163 Aug 10 17:52:17.939129 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 387/763] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 10 17:52:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:52:17.944904 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-94cf7f4e-a322-421e-8ca7-18ebe76a5e57 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:52:17.948189 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-94cf7f4e-a322-421e-8ca7-18ebe76a5e57 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] [instance: 43ff4d86-8c12-48ce-bcf5-c607c9bcaa05] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:17.961393 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-94cf7f4e-a322-421e-8ca7-18ebe76a5e57 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:17.961887 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-94cf7f4e-a322-421e-8ca7-18ebe76a5e57 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:17.962325 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-94cf7f4e-a322-421e-8ca7-18ebe76a5e57 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:17.963097 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-94cf7f4e-a322-421e-8ca7-18ebe76a5e57 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:17.963729 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-94cf7f4e-a322-421e-8ca7-18ebe76a5e57 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:17.964295 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-94cf7f4e-a322-421e-8ca7-18ebe76a5e57 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:18.021000 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [None req-94cf7f4e-a322-421e-8ca7-18ebe76a5e57 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-323d54b6-a461-4d90-9a60-5a4d9821ff0e) Aug 10 17:52:18.021000 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:52:18.021000 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:52:18.021000 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:52:18.021000 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:52:18.021000 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:52:18.021000 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 10 17:52:18.021000 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 10 17:52:18.021000 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 10 17:52:18.021000 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 10 17:52:18.021000 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 368, in inner Aug 10 17:52:18.021000 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi if self.network_api.instance_has_extended_resource_request( Aug 10 17:52:18.021000 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1035, in instance_has_extended_resource_request Aug 10 17:52:18.021000 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi if not self.has_extended_resource_request_extension(admin_context): Aug 10 17:52:18.021000 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 17:52:18.021000 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 17:52:18.021000 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 17:52:18.021000 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 17:52:18.021000 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 17:52:18.021000 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 17:52:18.021000 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:52:18.021000 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:52:18.021000 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 17:52:18.021000 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 17:52:18.021000 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:52:18.021000 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:52:18.021000 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:52:18.021000 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:52:18.021000 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:52:18.021000 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:52:18.021000 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:52:18.021000 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:52:18.021000 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:52:18.021000 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:52:18.021000 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 17:52:18.021000 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 17:52:18.021000 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 17:52:18.021000 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 17:52:18.021000 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 17:52:18.021000 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 17:52:18.021000 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 17:52:18.021000 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 17:52:18.021000 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 17:52:18.021000 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 17:52:18.021000 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 17:52:18.021000 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 17:52:18.021000 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 17:52:18.021000 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 17:52:18.021000 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 17:52:18.021000 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 17:52:18.021000 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 17:52:18.024987 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 17:52:18.024987 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 17:52:18.024987 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 17:52:18.024987 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 17:52:18.024987 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 17:52:18.024987 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 17:52:18.024987 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 17:52:18.024987 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 17:52:18.024987 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 17:52:18.024987 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-323d54b6-a461-4d90-9a60-5a4d9821ff0e) Aug 10 17:52:18.024987 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:52:18.024987 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-94cf7f4e-a322-421e-8ca7-18ebe76a5e57 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:52:18.024987 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 17:52:18.024987 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-94cf7f4e-a322-421e-8ca7-18ebe76a5e57 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Request method failure captured: Aug 10 17:52:18.024987 n-d-852296-2 devstack@n-api.service[129410]: request: POST /compute/v2.1/servers/43ff4d86-8c12-48ce-bcf5-c607c9bcaa05/action HTTP/1.1 Aug 10 17:52:18.024987 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 17:52:18.024987 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 17:52:18.024987 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 17:52:18.024987 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 32 Aug 10 17:52:18.024987 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 17:52:18.024987 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 17:52:18.024987 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 17:52:18.024987 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 17:52:18.024987 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8-_0hr6nliTkkjEq4POLxTS39b7AKRzs5IHoadOFYk-Avq_EhHZhiXBqUGkDcgCWPqhSAgOsv1fUEScaBilJPZ4n8-MqEuqv4LzNqxeh_dhY8n5FOoRyMW4xdBlwKatTDuceji8cWTk46ZLZhXUEi0tZyObBcD9QSkhHyY2UTCtQ3Ok Aug 10 17:52:18.024987 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 17:52:18.024987 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 17:52:18.024987 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 17:52:18.024987 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 17:52:18.024987 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 17:52:18.024987 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 17:52:18.024987 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: 48bbb92998f54ebeb624bc794d406896 Aug 10 17:52:18.024987 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-MigrationsAdminTest-561431726 Aug 10 17:52:18.024987 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 17:52:18.024987 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 17:52:18.024987 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/48bbb92998f54ebeb624bc794d406896"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/48bbb92998f54ebeb624bc794d406896"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/48bbb92998f54ebeb624bc794d406896"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_48bbb92998f54ebeb624bc794d406896", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:52:18.024987 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-MigrationsAdminTest-561431726 Aug 10 17:52:18.024987 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: 48bbb92998f54ebeb624bc794d406896 Aug 10 17:52:18.024987 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-MigrationsAdminTest-561431726 Aug 10 17:52:18.024987 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-MigrationsAdminTest-561431726-project Aug 10 17:52:18.024987 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 17:52:18.024987 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 17:52:18.024987 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: e109c3dcd0574faaa3d7ec31dd4edd24 Aug 10 17:52:18.024987 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-MigrationsAdminTest-561431726-project Aug 10 17:52:18.024987 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 17:52:18.024987 n-d-852296-2 devstack@n-api.service[129410]: {"resize": {"flavorRef": "451"}} Aug 10 17:52:18.024987 n-d-852296-2 devstack@n-api.service[129410]: method: > Aug 10 17:52:18.024987 n-d-852296-2 devstack@n-api.service[129410]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:52:18.024987 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 17:52:18.024987 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'id': '43ff4d86-8c12-48ce-bcf5-c607c9bcaa05', 'body': {'resize': {'flavorRef': '451'}}} Aug 10 17:52:18.024987 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:52:18.024987 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:52:18.024987 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:52:18.024987 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:52:18.024987 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:52:18.024987 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:52:18.024987 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 10 17:52:18.024987 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 10 17:52:18.024987 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 10 17:52:18.024987 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 10 17:52:18.038526 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 368, in inner Aug 10 17:52:18.038526 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi if self.network_api.instance_has_extended_resource_request( Aug 10 17:52:18.038526 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1035, in instance_has_extended_resource_request Aug 10 17:52:18.038526 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi if not self.has_extended_resource_request_extension(admin_context): Aug 10 17:52:18.038526 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 17:52:18.038526 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 17:52:18.038526 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 17:52:18.038526 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 17:52:18.038526 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 17:52:18.038526 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 17:52:18.038526 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:52:18.038526 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:52:18.038526 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 17:52:18.038526 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 17:52:18.038526 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:52:18.038526 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:52:18.038526 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:52:18.038526 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:52:18.038526 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:52:18.038526 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:52:18.038526 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:52:18.038526 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:52:18.038526 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:52:18.038526 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:52:18.038526 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 17:52:18.038526 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 17:52:18.038526 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 17:52:18.038526 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 17:52:18.038526 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 17:52:18.038526 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 17:52:18.038526 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 17:52:18.038526 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 17:52:18.038526 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 17:52:18.038526 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 17:52:18.038526 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 17:52:18.038526 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 17:52:18.038526 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 17:52:18.038526 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 17:52:18.038526 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 17:52:18.038526 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 17:52:18.038526 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 17:52:18.038526 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 17:52:18.038526 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 17:52:18.038526 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 17:52:18.038526 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 17:52:18.038526 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 17:52:18.038526 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 17:52:18.038526 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 17:52:18.038526 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 17:52:18.038526 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 17:52:18.038526 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-323d54b6-a461-4d90-9a60-5a4d9821ff0e) Aug 10 17:52:18.038526 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:52:18.049744 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:52:18.049744 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:52:18.049744 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:52:18.049744 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:52:18.049744 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:52:18.049744 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:52:18.049744 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:52:18.049744 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 10 17:52:18.049744 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 10 17:52:18.049744 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:52:18.049744 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:52:18.049744 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:52:18.049744 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:52:18.049744 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:52:18.049744 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:52:18.049744 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:52:18.049744 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:52:18.049744 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:52:18.049744 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:52:18.049744 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:52:18.049744 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:52:18.049744 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:52:18.049744 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-94cf7f4e-a322-421e-8ca7-18ebe76a5e57 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:52:18.049744 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:52:18.049744 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-94cf7f4e-a322-421e-8ca7-18ebe76a5e57 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] 10.222.0.50 "POST /compute/v2.1/servers/43ff4d86-8c12-48ce-bcf5-c607c9bcaa05/action" status: 500 len: 214 microversion: 2.1 time: 0.085691 Aug 10 17:52:18.049744 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 388/764] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 10 17:52:17 2022] POST /compute/v2.1/servers/43ff4d86-8c12-48ce-bcf5-c607c9bcaa05/action => generated 214 bytes in 87 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 10 17:52:18.049744 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-48ea4712-36de-4ec5-9bd8-27b7e8d76465 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:18.049744 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-48ea4712-36de-4ec5-9bd8-27b7e8d76465 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] [instance: 25b28585-a586-423f-8f04-2b2f4d28f16c] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:18.052930 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-48ea4712-36de-4ec5-9bd8-27b7e8d76465 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:18.053721 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-48ea4712-36de-4ec5-9bd8-27b7e8d76465 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:18.054132 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-48ea4712-36de-4ec5-9bd8-27b7e8d76465 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:18.054882 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-48ea4712-36de-4ec5-9bd8-27b7e8d76465 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:18.055341 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-48ea4712-36de-4ec5-9bd8-27b7e8d76465 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:18.055840 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-48ea4712-36de-4ec5-9bd8-27b7e8d76465 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:18.179149 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-1cab98e0-0f57-4b06-93c7-6d52fe4fee3b tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256/action" status: 202 len: 0 microversion: 2.1 time: 0.445049 Aug 10 17:52:18.179792 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 377/765] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 10 17:52:17 2022] POST /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256/action => generated 0 bytes in 446 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 17:52:18.184628 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-5ea64949-47b3-4a47-8ba4-0dd0df9b7c22 tempest-ServersOnMultiNodesTest-116104069 tempest-ServersOnMultiNodesTest-116104069-project-admin] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:18.185241 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-5ea64949-47b3-4a47-8ba4-0dd0df9b7c22 tempest-ServersOnMultiNodesTest-116104069 tempest-ServersOnMultiNodesTest-116104069-project-admin] [instance: 83268d7f-5375-4b01-9b5c-519be7daf0a4] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:18.192857 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-5ea64949-47b3-4a47-8ba4-0dd0df9b7c22 tempest-ServersOnMultiNodesTest-116104069 tempest-ServersOnMultiNodesTest-116104069-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:18.193614 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-5ea64949-47b3-4a47-8ba4-0dd0df9b7c22 tempest-ServersOnMultiNodesTest-116104069 tempest-ServersOnMultiNodesTest-116104069-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:18.194453 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-5ea64949-47b3-4a47-8ba4-0dd0df9b7c22 tempest-ServersOnMultiNodesTest-116104069 tempest-ServersOnMultiNodesTest-116104069-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:18.195458 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-5ea64949-47b3-4a47-8ba4-0dd0df9b7c22 tempest-ServersOnMultiNodesTest-116104069 tempest-ServersOnMultiNodesTest-116104069-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:18.196172 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-5ea64949-47b3-4a47-8ba4-0dd0df9b7c22 tempest-ServersOnMultiNodesTest-116104069 tempest-ServersOnMultiNodesTest-116104069-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:18.197048 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-5ea64949-47b3-4a47-8ba4-0dd0df9b7c22 tempest-ServersOnMultiNodesTest-116104069 tempest-ServersOnMultiNodesTest-116104069-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:18.234058 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-48ea4712-36de-4ec5-9bd8-27b7e8d76465 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83a3e198e21476eb12fcf417aea62de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df088e5a610436ea21b8a360e2bb527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:18.236686 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:52:18.244596 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-48ea4712-36de-4ec5-9bd8-27b7e8d76465 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] 10.222.0.50 "GET /compute/v2.1/servers/25b28585-a586-423f-8f04-2b2f4d28f16c" status: 200 len: 1321 microversion: 2.1 time: 0.216686 Aug 10 17:52:18.245184 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 389/766] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:18 2022] GET /compute/v2.1/servers/25b28585-a586-423f-8f04-2b2f4d28f16c => generated 1321 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:18.250314 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-fa4391d9-b3af-4d69-88fb-7bcfe601e8ff tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:18.250912 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-fa4391d9-b3af-4d69-88fb-7bcfe601e8ff tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] [instance: e2777988-0bbf-496c-9c97-b206dbc94a62] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:18.261423 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-fa4391d9-b3af-4d69-88fb-7bcfe601e8ff tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:18.262180 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-fa4391d9-b3af-4d69-88fb-7bcfe601e8ff tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:18.262621 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-fa4391d9-b3af-4d69-88fb-7bcfe601e8ff tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:18.263485 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-fa4391d9-b3af-4d69-88fb-7bcfe601e8ff tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:18.263949 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-fa4391d9-b3af-4d69-88fb-7bcfe601e8ff tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:18.264465 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-fa4391d9-b3af-4d69-88fb-7bcfe601e8ff tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:18.341426 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-fa4391d9-b3af-4d69-88fb-7bcfe601e8ff tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:18.350739 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-fa4391d9-b3af-4d69-88fb-7bcfe601e8ff tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:18.352270 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-fa4391d9-b3af-4d69-88fb-7bcfe601e8ff tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:18.357732 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-fa4391d9-b3af-4d69-88fb-7bcfe601e8ff tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] 10.222.0.50 "GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62" status: 200 len: 1445 microversion: 2.75 time: 0.111506 Aug 10 17:52:18.360055 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 390/767] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:52:18 2022] GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62 => generated 1445 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:52:18.364529 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-e736d224-e6b7-47db-9a7e-2bd773cd79bf tempest-MigrationsAdminTest-964085913 tempest-MigrationsAdminTest-964085913-project-admin] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:18.365359 n-d-852296-2 devstack@n-api.service[129410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:52:18.365359 n-d-852296-2 devstack@n-api.service[129410]: warnings.warn(msg) Aug 10 17:52:18.371252 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-e736d224-e6b7-47db-9a7e-2bd773cd79bf tempest-MigrationsAdminTest-964085913 tempest-MigrationsAdminTest-964085913-project-admin] HTTP exception thrown: Flavor ecb11648-6e2f-4ee1-97ae-15f83859e423 could not be found. Aug 10 17:52:18.373011 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-e736d224-e6b7-47db-9a7e-2bd773cd79bf tempest-MigrationsAdminTest-964085913 tempest-MigrationsAdminTest-964085913-project-admin] Request method failure captured: Aug 10 17:52:18.373011 n-d-852296-2 devstack@n-api.service[129410]: request: DELETE /compute/v2.1/flavors/ecb11648-6e2f-4ee1-97ae-15f83859e423 HTTP/1.1 Aug 10 17:52:18.373011 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 17:52:18.373011 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 17:52:18.373011 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 17:52:18.373011 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 0 Aug 10 17:52:18.373011 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 17:52:18.373011 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 17:52:18.373011 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 17:52:18.373011 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 17:52:18.373011 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8-_34qrKwYhIXal2vjPBD5g82PQVD5R4tnd93fbFZ9M0yciliUNDCwvxCTrKDWpCkYFxf4yVU13v8XzfdSAKmGZfVN2ZmqyaeeCBWjmReFVdg0quFpMaE-UjbbiItZ1X89-_ftumkrChrwUlm9OeC-VxArksbFx2EmsyLnwDfLO4VEQ Aug 10 17:52:18.373011 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 17:52:18.373011 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 17:52:18.373011 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 17:52:18.373011 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 17:52:18.373011 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 17:52:18.373011 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 17:52:18.373011 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: 50abb72754d54a89ae6a586553de4beb Aug 10 17:52:18.373011 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-MigrationsAdminTest-964085913 Aug 10 17:52:18.373011 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member,admin Aug 10 17:52:18.373011 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member,admin Aug 10 17:52:18.373011 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/50abb72754d54a89ae6a586553de4beb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/50abb72754d54a89ae6a586553de4beb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/50abb72754d54a89ae6a586553de4beb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_50abb72754d54a89ae6a586553de4beb", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:52:18.373011 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-MigrationsAdminTest-964085913 Aug 10 17:52:18.373011 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: 50abb72754d54a89ae6a586553de4beb Aug 10 17:52:18.373011 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-MigrationsAdminTest-964085913 Aug 10 17:52:18.373011 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-MigrationsAdminTest-964085913-project-admin Aug 10 17:52:18.373011 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 17:52:18.373011 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 17:52:18.373011 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: 48e3438ea5ed46b79100d48001e63839 Aug 10 17:52:18.373011 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-MigrationsAdminTest-964085913-project-admin Aug 10 17:52:18.373011 n-d-852296-2 devstack@n-api.service[129410]: method: > Aug 10 17:52:18.373011 n-d-852296-2 devstack@n-api.service[129410]: exception: Flavor ecb11648-6e2f-4ee1-97ae-15f83859e423 could not be found. Aug 10 17:52:18.373011 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'id': 'ecb11648-6e2f-4ee1-97ae-15f83859e423'} Aug 10 17:52:18.373011 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:52:18.373011 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:52:18.373011 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Aug 10 17:52:18.373011 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi flavor.destroy() Aug 10 17:52:18.373011 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 10 17:52:18.373011 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 10 17:52:18.373011 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Aug 10 17:52:18.373011 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Aug 10 17:52:18.373011 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Aug 10 17:52:18.373011 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Aug 10 17:52:18.373011 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 10 17:52:18.373011 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 10 17:52:18.373011 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Aug 10 17:52:18.373011 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Aug 10 17:52:18.373011 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor ecb11648-6e2f-4ee1-97ae-15f83859e423 could not be found. Aug 10 17:52:18.373011 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:52:18.373011 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:52:18.373011 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:52:18.373011 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:52:18.373011 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:52:18.373011 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:52:18.373011 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:52:18.373011 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:52:18.373011 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:52:18.373011 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:52:18.373011 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Aug 10 17:52:18.373011 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:52:18.373011 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor ecb11648-6e2f-4ee1-97ae-15f83859e423 could not be found. Aug 10 17:52:18.373011 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:52:18.373011 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:52:18.382122 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:52:18.382122 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:52:18.382122 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:52:18.382122 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:52:18.382122 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:52:18.382122 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:52:18.382122 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor ecb11648-6e2f-4ee1-97ae-15f83859e423 could not be found. Aug 10 17:52:18.382122 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:52:18.382122 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-e736d224-e6b7-47db-9a7e-2bd773cd79bf tempest-MigrationsAdminTest-964085913 tempest-MigrationsAdminTest-964085913-project-admin] Returning 404 to user: Flavor ecb11648-6e2f-4ee1-97ae-15f83859e423 could not be found. {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:52:18.382122 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-e736d224-e6b7-47db-9a7e-2bd773cd79bf tempest-MigrationsAdminTest-964085913 tempest-MigrationsAdminTest-964085913-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/ecb11648-6e2f-4ee1-97ae-15f83859e423" status: 404 len: 109 microversion: 2.1 time: 0.013475 Aug 10 17:52:18.382122 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 391/768] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 10 17:52:18 2022] DELETE /compute/v2.1/flavors/ecb11648-6e2f-4ee1-97ae-15f83859e423 => generated 109 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:52:18.382122 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-bade28c2-aea6-451b-b253-27c4b12b0292 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f"}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:52:18.384137 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-bade28c2-aea6-451b-b253-27c4b12b0292 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] [instance: bee3148a-3834-41bd-99e7-b5da75217256] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:18.394249 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-bade28c2-aea6-451b-b253-27c4b12b0292 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:18.394801 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-bade28c2-aea6-451b-b253-27c4b12b0292 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:18.395303 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-bade28c2-aea6-451b-b253-27c4b12b0292 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:18.396075 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-bade28c2-aea6-451b-b253-27c4b12b0292 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:18.396777 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-bade28c2-aea6-451b-b253-27c4b12b0292 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:18.397277 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-bade28c2-aea6-451b-b253-27c4b12b0292 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:18.488685 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-5ea64949-47b3-4a47-8ba4-0dd0df9b7c22 tempest-ServersOnMultiNodesTest-116104069 tempest-ServersOnMultiNodesTest-116104069-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/83268d7f-5375-4b01-9b5c-519be7daf0a4" status: 200 len: 1620 microversion: 2.1 time: 0.307536 Aug 10 17:52:18.492664 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 378/769] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:18 2022] GET /compute/v2.1/servers/83268d7f-5375-4b01-9b5c-519be7daf0a4 => generated 1620 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:18.523892 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.virt.hardware [None req-bade28c2-aea6-451b-b253-27c4b12b0292 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Flavor limits 0:0:0 {{(pid=129410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 17:52:18.534181 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.virt.hardware [None req-bade28c2-aea6-451b-b253-27c4b12b0292 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Image limits 0:0:0 {{(pid=129410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 17:52:18.534181 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.virt.hardware [None req-bade28c2-aea6-451b-b253-27c4b12b0292 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Flavor pref 0:0:0 {{(pid=129410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 17:52:18.534181 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.virt.hardware [None req-bade28c2-aea6-451b-b253-27c4b12b0292 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Image pref 0:0:0 {{(pid=129410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 17:52:18.534181 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.virt.hardware [None req-bade28c2-aea6-451b-b253-27c4b12b0292 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 17:52:18.546035 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-c6534c36-3e91-4e34-aae6-0ecff8024dc9 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-733846649", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452"}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:52:18.615073 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.network.neutron [None req-c6534c36-3e91-4e34-aae6-0ecff8024dc9 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] validate_networks() for None {{(pid=129409) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 17:52:18.957919 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.virt.hardware [None req-c6534c36-3e91-4e34-aae6-0ecff8024dc9 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Flavor limits 0:0:0 {{(pid=129409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 17:52:18.958568 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.virt.hardware [None req-c6534c36-3e91-4e34-aae6-0ecff8024dc9 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Image limits 0:0:0 {{(pid=129409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 17:52:18.958804 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.virt.hardware [None req-c6534c36-3e91-4e34-aae6-0ecff8024dc9 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Flavor pref 0:0:0 {{(pid=129409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 17:52:18.959216 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.virt.hardware [None req-c6534c36-3e91-4e34-aae6-0ecff8024dc9 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Image pref 0:0:0 {{(pid=129409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 17:52:18.959626 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.virt.hardware [None req-c6534c36-3e91-4e34-aae6-0ecff8024dc9 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 17:52:18.970778 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c6534c36-3e91-4e34-aae6-0ecff8024dc9 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:18.971533 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c6534c36-3e91-4e34-aae6-0ecff8024dc9 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:18.971965 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c6534c36-3e91-4e34-aae6-0ecff8024dc9 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:18.973039 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c6534c36-3e91-4e34-aae6-0ecff8024dc9 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:18.973498 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c6534c36-3e91-4e34-aae6-0ecff8024dc9 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:18.974021 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c6534c36-3e91-4e34-aae6-0ecff8024dc9 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:18.994903 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-c6534c36-3e91-4e34-aae6-0ecff8024dc9 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Getting quotas for project 48bbb92998f54ebeb624bc794d406896. Resources: {'instances', 'ram', 'cores'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:52:18.999983 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-c6534c36-3e91-4e34-aae6-0ecff8024dc9 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Getting quotas for user e109c3dcd0574faaa3d7ec31dd4edd24 and project 48bbb92998f54ebeb624bc794d406896. Resources: {'instances', 'ram', 'cores'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:52:19.013997 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-c6534c36-3e91-4e34-aae6-0ecff8024dc9 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Going to run 1 instances... {{(pid=129409) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 17:52:19.016508 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-c6534c36-3e91-4e34-aae6-0ecff8024dc9 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] [instance: 6fffb7a0-b963-4fdc-8f5d-0fe046c6a7ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a735ff26-463a-4ffe-a981-ab9d9baa494f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 17:52:19.057211 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-bade28c2-aea6-451b-b253-27c4b12b0292 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] [instance: bee3148a-3834-41bd-99e7-b5da75217256] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:19.064173 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-bade28c2-aea6-451b-b253-27c4b12b0292 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:19.064982 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-bade28c2-aea6-451b-b253-27c4b12b0292 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:19.065319 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-bade28c2-aea6-451b-b253-27c4b12b0292 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:19.067691 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-bade28c2-aea6-451b-b253-27c4b12b0292 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:19.067691 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-bade28c2-aea6-451b-b253-27c4b12b0292 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:19.067691 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-bade28c2-aea6-451b-b253-27c4b12b0292 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:19.122502 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-bade28c2-aea6-451b-b253-27c4b12b0292 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] 10.222.0.50 "POST /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256/action" status: 202 len: 1066 microversion: 2.1 time: 0.721863 Aug 10 17:52:19.122502 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 392/770] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 10 17:52:18 2022] POST /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256/action => generated 1066 bytes in 723 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 10 17:52:19.122502 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-aae268d9-7a82-418e-8ba7-256e98b261a7 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1186541846", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "af745ef7-21f0-4149-ba68-33f45f73f2dd"}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:52:19.164497 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.network.neutron [None req-aae268d9-7a82-418e-8ba7-256e98b261a7 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] validate_networks() for None {{(pid=129410) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 17:52:19.219936 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-c6534c36-3e91-4e34-aae6-0ecff8024dc9 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.680686 Aug 10 17:52:19.221237 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 379/771] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 17:52:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 683 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 10 17:52:19.226357 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-33c74bdb-4221-4931-9594-f30d1db205c2 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:19.227928 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-33c74bdb-4221-4931-9594-f30d1db205c2 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] [instance: bee3148a-3834-41bd-99e7-b5da75217256] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:19.240429 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-33c74bdb-4221-4931-9594-f30d1db205c2 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:19.249639 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-33c74bdb-4221-4931-9594-f30d1db205c2 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:19.252697 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-33c74bdb-4221-4931-9594-f30d1db205c2 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:19.256313 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-33c74bdb-4221-4931-9594-f30d1db205c2 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:19.258036 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-33c74bdb-4221-4931-9594-f30d1db205c2 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:19.258036 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-33c74bdb-4221-4931-9594-f30d1db205c2 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:19.492645 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.virt.hardware [None req-aae268d9-7a82-418e-8ba7-256e98b261a7 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Flavor limits 0:0:0 {{(pid=129410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 17:52:19.492939 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.virt.hardware [None req-aae268d9-7a82-418e-8ba7-256e98b261a7 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Image limits 0:0:0 {{(pid=129410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 17:52:19.493410 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.virt.hardware [None req-aae268d9-7a82-418e-8ba7-256e98b261a7 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Flavor pref 0:0:0 {{(pid=129410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 17:52:19.497109 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.virt.hardware [None req-aae268d9-7a82-418e-8ba7-256e98b261a7 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Image pref 0:0:0 {{(pid=129410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 17:52:19.497109 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.virt.hardware [None req-aae268d9-7a82-418e-8ba7-256e98b261a7 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 17:52:19.505078 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-aae268d9-7a82-418e-8ba7-256e98b261a7 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:19.505619 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-aae268d9-7a82-418e-8ba7-256e98b261a7 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:19.506336 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-aae268d9-7a82-418e-8ba7-256e98b261a7 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:19.507522 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-aae268d9-7a82-418e-8ba7-256e98b261a7 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:19.508259 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-aae268d9-7a82-418e-8ba7-256e98b261a7 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:19.509306 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-aae268d9-7a82-418e-8ba7-256e98b261a7 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:19.534918 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.quota [None req-aae268d9-7a82-418e-8ba7-256e98b261a7 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Getting quotas for project 0638146d08704b2983761619745290b3. Resources: {'instances', 'ram', 'cores'} {{(pid=129410) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:52:19.543730 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.quota [None req-aae268d9-7a82-418e-8ba7-256e98b261a7 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Getting quotas for user f76b870a54454956b3926c34f9f27442 and project 0638146d08704b2983761619745290b3. Resources: {'instances', 'ram', 'cores'} {{(pid=129410) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:52:19.557130 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-aae268d9-7a82-418e-8ba7-256e98b261a7 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Going to run 1 instances... {{(pid=129410) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 17:52:19.559861 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-aae268d9-7a82-418e-8ba7-256e98b261a7 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: f747d5da-322c-4afb-bac6-c614b85656f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a735ff26-463a-4ffe-a981-ab9d9baa494f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129410) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 17:52:19.797439 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-aae268d9-7a82-418e-8ba7-256e98b261a7 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.696111 Aug 10 17:52:19.803875 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 393/772] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 17:52:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 698 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 17:52:19.803875 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-61d11938-5699-4ad7-992d-5c2f7b27ffd7 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:19.803875 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-61d11938-5699-4ad7-992d-5c2f7b27ffd7 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] [instance: 6fffb7a0-b963-4fdc-8f5d-0fe046c6a7ed] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:19.867177 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-61d11938-5699-4ad7-992d-5c2f7b27ffd7 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e109c3dcd0574faaa3d7ec31dd4edd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48bbb92998f54ebeb624bc794d406896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:19.899610 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-61d11938-5699-4ad7-992d-5c2f7b27ffd7 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] 10.222.0.50 "GET /compute/v2.1/servers/6fffb7a0-b963-4fdc-8f5d-0fe046c6a7ed" status: 200 len: 1212 microversion: 2.1 time: 0.099966 Aug 10 17:52:19.902295 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 394/773] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:19 2022] GET /compute/v2.1/servers/6fffb7a0-b963-4fdc-8f5d-0fe046c6a7ed => generated 1212 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:19.905814 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-33c74bdb-4221-4931-9594-f30d1db205c2 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2fd6acf18d4218ad143ccee2d0bb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7c2481a908406fa9c4562513fff665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:19.916730 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-33c74bdb-4221-4931-9594-f30d1db205c2 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] 10.222.0.50 "GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256" status: 200 len: 1470 microversion: 2.1 time: 0.694255 Aug 10 17:52:19.918341 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-c873f8ee-ebd5-42a4-bfcd-c9fd6d271239 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:19.920312 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 380/774] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:19 2022] GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256 => generated 1470 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:19.922569 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-c873f8ee-ebd5-42a4-bfcd-c9fd6d271239 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] [instance: 25b28585-a586-423f-8f04-2b2f4d28f16c] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:19.935608 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-c873f8ee-ebd5-42a4-bfcd-c9fd6d271239 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:19.936314 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-c873f8ee-ebd5-42a4-bfcd-c9fd6d271239 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:19.937057 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-c873f8ee-ebd5-42a4-bfcd-c9fd6d271239 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:19.938429 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-c873f8ee-ebd5-42a4-bfcd-c9fd6d271239 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:19.939151 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-c873f8ee-ebd5-42a4-bfcd-c9fd6d271239 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:19.939644 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-c873f8ee-ebd5-42a4-bfcd-c9fd6d271239 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:19.943971 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-7eac5684-f897-4dbc-912a-cd744298a4e7 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:19.944620 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-7eac5684-f897-4dbc-912a-cd744298a4e7 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] [instance: e2777988-0bbf-496c-9c97-b206dbc94a62] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:19.958270 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7eac5684-f897-4dbc-912a-cd744298a4e7 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:19.958933 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7eac5684-f897-4dbc-912a-cd744298a4e7 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:19.959669 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7eac5684-f897-4dbc-912a-cd744298a4e7 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:19.960551 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7eac5684-f897-4dbc-912a-cd744298a4e7 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:19.961161 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7eac5684-f897-4dbc-912a-cd744298a4e7 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:19.961738 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7eac5684-f897-4dbc-912a-cd744298a4e7 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:20.064049 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-7eac5684-f897-4dbc-912a-cd744298a4e7 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:20.074775 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-7eac5684-f897-4dbc-912a-cd744298a4e7 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:20.084292 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-7eac5684-f897-4dbc-912a-cd744298a4e7 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:20.103430 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-7eac5684-f897-4dbc-912a-cd744298a4e7 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] 10.222.0.50 "GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62" status: 200 len: 1445 microversion: 2.75 time: 0.178731 Aug 10 17:52:20.123823 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 381/775] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:52:19 2022] GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62 => generated 1445 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:52:20.140926 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-97c0ada8-562c-4aaa-a618-eb75629aa623 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:20.141560 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-97c0ada8-562c-4aaa-a618-eb75629aa623 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: f747d5da-322c-4afb-bac6-c614b85656f9] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:20.266536 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-c873f8ee-ebd5-42a4-bfcd-c9fd6d271239 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83a3e198e21476eb12fcf417aea62de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df088e5a610436ea21b8a360e2bb527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:20.275915 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-c873f8ee-ebd5-42a4-bfcd-c9fd6d271239 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] 10.222.0.50 "GET /compute/v2.1/servers/25b28585-a586-423f-8f04-2b2f4d28f16c" status: 200 len: 1321 microversion: 2.1 time: 0.366505 Aug 10 17:52:20.276542 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 395/776] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:19 2022] GET /compute/v2.1/servers/25b28585-a586-423f-8f04-2b2f4d28f16c => generated 1321 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:20.280269 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-97c0ada8-562c-4aaa-a618-eb75629aa623 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:20.290547 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-97c0ada8-562c-4aaa-a618-eb75629aa623 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/f747d5da-322c-4afb-bac6-c614b85656f9" status: 200 len: 1217 microversion: 2.1 time: 0.165045 Aug 10 17:52:20.291126 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 382/777] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:20 2022] GET /compute/v2.1/servers/f747d5da-322c-4afb-bac6-c614b85656f9 => generated 1217 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:20.922493 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-45070d71-f5f3-4537-87a1-dfc398900e75 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:20.923814 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-45070d71-f5f3-4537-87a1-dfc398900e75 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] [instance: 6fffb7a0-b963-4fdc-8f5d-0fe046c6a7ed] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:20.949369 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-ab2729dc-b6df-46d2-8aca-beb25e0bfebb tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:20.950256 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-ab2729dc-b6df-46d2-8aca-beb25e0bfebb tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] [instance: bee3148a-3834-41bd-99e7-b5da75217256] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:20.962347 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-ab2729dc-b6df-46d2-8aca-beb25e0bfebb tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:20.964342 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-ab2729dc-b6df-46d2-8aca-beb25e0bfebb tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:20.965800 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-ab2729dc-b6df-46d2-8aca-beb25e0bfebb tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:20.970470 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-ab2729dc-b6df-46d2-8aca-beb25e0bfebb tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:20.971941 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-ab2729dc-b6df-46d2-8aca-beb25e0bfebb tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:20.973491 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-ab2729dc-b6df-46d2-8aca-beb25e0bfebb tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:20.991244 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-45070d71-f5f3-4537-87a1-dfc398900e75 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e109c3dcd0574faaa3d7ec31dd4edd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48bbb92998f54ebeb624bc794d406896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:21.005520 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-45070d71-f5f3-4537-87a1-dfc398900e75 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] 10.222.0.50 "GET /compute/v2.1/servers/6fffb7a0-b963-4fdc-8f5d-0fe046c6a7ed" status: 200 len: 1212 microversion: 2.1 time: 0.087148 Aug 10 17:52:21.006104 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 396/778] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:20 2022] GET /compute/v2.1/servers/6fffb7a0-b963-4fdc-8f5d-0fe046c6a7ed => generated 1212 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:21.131014 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-c03535f6-4977-4237-b620-780274bc85b5 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:21.132311 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-c03535f6-4977-4237-b620-780274bc85b5 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] [instance: e2777988-0bbf-496c-9c97-b206dbc94a62] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:21.138779 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-c03535f6-4977-4237-b620-780274bc85b5 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:21.139454 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-c03535f6-4977-4237-b620-780274bc85b5 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:21.140120 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-c03535f6-4977-4237-b620-780274bc85b5 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:21.141005 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-c03535f6-4977-4237-b620-780274bc85b5 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:21.141641 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-c03535f6-4977-4237-b620-780274bc85b5 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:21.142341 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-c03535f6-4977-4237-b620-780274bc85b5 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:21.260031 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-c03535f6-4977-4237-b620-780274bc85b5 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:21.265983 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-ab2729dc-b6df-46d2-8aca-beb25e0bfebb tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2fd6acf18d4218ad143ccee2d0bb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7c2481a908406fa9c4562513fff665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:21.269759 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-c03535f6-4977-4237-b620-780274bc85b5 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:21.272053 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-c03535f6-4977-4237-b620-780274bc85b5 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:21.277725 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-ab2729dc-b6df-46d2-8aca-beb25e0bfebb tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] 10.222.0.50 "GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256" status: 200 len: 1470 microversion: 2.1 time: 0.333137 Aug 10 17:52:21.278598 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 383/779] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:20 2022] GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256 => generated 1470 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:21.284162 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-c03535f6-4977-4237-b620-780274bc85b5 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] 10.222.0.50 "GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62" status: 200 len: 1445 microversion: 2.75 time: 0.151905 Aug 10 17:52:21.293933 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 397/780] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:52:21 2022] GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62 => generated 1445 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 17:52:21.306314 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-9c6ce301-702a-4ced-a117-f266692ba9b8 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:21.307541 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-9c6ce301-702a-4ced-a117-f266692ba9b8 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] [instance: 25b28585-a586-423f-8f04-2b2f4d28f16c] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:21.321170 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-4bd05b28-3f10-41dd-9b3d-5a759b263927 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:21.323623 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-4bd05b28-3f10-41dd-9b3d-5a759b263927 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: f747d5da-322c-4afb-bac6-c614b85656f9] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:21.323765 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-9c6ce301-702a-4ced-a117-f266692ba9b8 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:21.324402 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-9c6ce301-702a-4ced-a117-f266692ba9b8 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:21.324970 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-9c6ce301-702a-4ced-a117-f266692ba9b8 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:21.325775 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-9c6ce301-702a-4ced-a117-f266692ba9b8 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:21.326380 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-9c6ce301-702a-4ced-a117-f266692ba9b8 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:21.327047 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-9c6ce301-702a-4ced-a117-f266692ba9b8 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:21.405552 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-4bd05b28-3f10-41dd-9b3d-5a759b263927 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:21.413450 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-4bd05b28-3f10-41dd-9b3d-5a759b263927 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/f747d5da-322c-4afb-bac6-c614b85656f9" status: 200 len: 1217 microversion: 2.1 time: 0.102125 Aug 10 17:52:21.414027 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 398/781] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:21 2022] GET /compute/v2.1/servers/f747d5da-322c-4afb-bac6-c614b85656f9 => generated 1217 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:21.498628 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-9c6ce301-702a-4ced-a117-f266692ba9b8 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83a3e198e21476eb12fcf417aea62de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df088e5a610436ea21b8a360e2bb527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:21.507245 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-9c6ce301-702a-4ced-a117-f266692ba9b8 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] 10.222.0.50 "GET /compute/v2.1/servers/25b28585-a586-423f-8f04-2b2f4d28f16c" status: 200 len: 1471 microversion: 2.1 time: 0.211335 Aug 10 17:52:21.507833 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 384/782] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:21 2022] GET /compute/v2.1/servers/25b28585-a586-423f-8f04-2b2f4d28f16c => generated 1471 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:21.662731 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-f6b9a17f-148e-40fd-bf07-6dad8a76c3e6 tempest-ServersAdminNegativeTestJSON-307727315 tempest-ServersAdminNegativeTestJSON-307727315-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:52:21.663557 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-f6b9a17f-148e-40fd-bf07-6dad8a76c3e6 tempest-ServersAdminNegativeTestJSON-307727315 tempest-ServersAdminNegativeTestJSON-307727315-project-admin] [instance: 3cf107ef-cfd5-44fe-9275-24a21da53430] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:21.672387 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-f6b9a17f-148e-40fd-bf07-6dad8a76c3e6 tempest-ServersAdminNegativeTestJSON-307727315 tempest-ServersAdminNegativeTestJSON-307727315-project-admin] HTTP exception thrown: Instance 3cf107ef-cfd5-44fe-9275-24a21da53430 could not be found. Aug 10 17:52:21.675015 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-f6b9a17f-148e-40fd-bf07-6dad8a76c3e6 tempest-ServersAdminNegativeTestJSON-307727315 tempest-ServersAdminNegativeTestJSON-307727315-project-admin] Request method failure captured: Aug 10 17:52:21.675015 n-d-852296-2 devstack@n-api.service[129410]: request: POST /compute/v2.1/servers/3cf107ef-cfd5-44fe-9275-24a21da53430/action HTTP/1.1 Aug 10 17:52:21.675015 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 17:52:21.675015 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 17:52:21.675015 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 17:52:21.675015 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 15 Aug 10 17:52:21.675015 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 17:52:21.675015 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 17:52:21.675015 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 17:52:21.675015 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 17:52:21.675015 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8_Az95pXA_-z9Z4ZguwXal6sDXpsrgA5RYelI-lKWnXmEUkeilBIkLRb4BMsvPPbiIRSmq-BO9p7h0GhyB_Dv2ByKXUprBd3vMLurr9dR-2Mlu-4PGDChoatitlnYLRiePSEEUl4_tuqc5GLYRKirr74955dIGhHHsB-2PUtCkIduJg Aug 10 17:52:21.675015 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 17:52:21.675015 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 17:52:21.675015 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 17:52:21.675015 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 17:52:21.675015 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 17:52:21.675015 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 17:52:21.675015 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: 015da3a257f64754bd373f857e81d05b Aug 10 17:52:21.675015 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-307727315 Aug 10 17:52:21.675015 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member,admin Aug 10 17:52:21.675015 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member,admin Aug 10 17:52:21.675015 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/015da3a257f64754bd373f857e81d05b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/015da3a257f64754bd373f857e81d05b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/015da3a257f64754bd373f857e81d05b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_015da3a257f64754bd373f857e81d05b", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:52:21.675015 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-ServersAdminNegativeTestJSON-307727315 Aug 10 17:52:21.675015 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: 015da3a257f64754bd373f857e81d05b Aug 10 17:52:21.675015 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-307727315 Aug 10 17:52:21.675015 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-ServersAdminNegativeTestJSON-307727315-project-admin Aug 10 17:52:21.675015 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 17:52:21.675015 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 17:52:21.675015 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: ff6104cbca83425094909941de2d6c63 Aug 10 17:52:21.675015 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-ServersAdminNegativeTestJSON-307727315-project-admin Aug 10 17:52:21.675015 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 17:52:21.675015 n-d-852296-2 devstack@n-api.service[129410]: {"migrate": {}} Aug 10 17:52:21.675015 n-d-852296-2 devstack@n-api.service[129410]: method: > Aug 10 17:52:21.675015 n-d-852296-2 devstack@n-api.service[129410]: exception: Instance 3cf107ef-cfd5-44fe-9275-24a21da53430 could not be found. Aug 10 17:52:21.675015 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'id': '3cf107ef-cfd5-44fe-9275-24a21da53430', 'body': {'migrate': {}}} Aug 10 17:52:21.675015 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:52:21.675015 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:52:21.675015 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 17:52:21.675015 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 17:52:21.675015 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 17:52:21.675015 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 17:52:21.675015 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 10 17:52:21.675015 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 10 17:52:21.675015 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3cf107ef-cfd5-44fe-9275-24a21da53430 could not be found. Aug 10 17:52:21.675015 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:52:21.675015 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:52:21.675015 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:52:21.675015 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:52:21.675015 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:52:21.675015 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:52:21.675015 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:52:21.675015 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:52:21.675015 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:52:21.675015 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:52:21.675015 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:52:21.675015 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:52:21.675015 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Aug 10 17:52:21.675015 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Aug 10 17:52:21.675015 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 17:52:21.675015 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:52:21.675015 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3cf107ef-cfd5-44fe-9275-24a21da53430 could not be found. Aug 10 17:52:21.675015 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:52:21.675015 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:52:21.675015 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:52:21.675015 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:52:21.690884 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:52:21.690884 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:52:21.690884 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:52:21.690884 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:52:21.690884 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3cf107ef-cfd5-44fe-9275-24a21da53430 could not be found. Aug 10 17:52:21.690884 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:52:21.690884 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-f6b9a17f-148e-40fd-bf07-6dad8a76c3e6 tempest-ServersAdminNegativeTestJSON-307727315 tempest-ServersAdminNegativeTestJSON-307727315-project-admin] Returning 404 to user: Instance 3cf107ef-cfd5-44fe-9275-24a21da53430 could not be found. {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:52:21.690884 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-f6b9a17f-148e-40fd-bf07-6dad8a76c3e6 tempest-ServersAdminNegativeTestJSON-307727315 tempest-ServersAdminNegativeTestJSON-307727315-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/3cf107ef-cfd5-44fe-9275-24a21da53430/action" status: 404 len: 111 microversion: 2.1 time: 0.151465 Aug 10 17:52:21.690884 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 399/783] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 10 17:52:21 2022] POST /compute/v2.1/servers/3cf107ef-cfd5-44fe-9275-24a21da53430/action => generated 111 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:52:21.804093 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-725ce19b-1cc1-4245-9cbb-221bf5582ec4 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1315199476", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452"}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:52:21.865062 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.network.neutron [None req-725ce19b-1cc1-4245-9cbb-221bf5582ec4 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] validate_networks() for None {{(pid=129409) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 17:52:22.027840 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-aaf50341-0078-4c6b-b87a-e1207905017e tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:22.028738 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-aaf50341-0078-4c6b-b87a-e1207905017e tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] [instance: 6fffb7a0-b963-4fdc-8f5d-0fe046c6a7ed] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:22.040734 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-aaf50341-0078-4c6b-b87a-e1207905017e tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:22.041944 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-aaf50341-0078-4c6b-b87a-e1207905017e tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:22.042457 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-aaf50341-0078-4c6b-b87a-e1207905017e tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:22.043373 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-aaf50341-0078-4c6b-b87a-e1207905017e tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:22.043822 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-aaf50341-0078-4c6b-b87a-e1207905017e tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:22.044268 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-aaf50341-0078-4c6b-b87a-e1207905017e tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:22.141247 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-aaf50341-0078-4c6b-b87a-e1207905017e tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e109c3dcd0574faaa3d7ec31dd4edd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48bbb92998f54ebeb624bc794d406896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:22.151015 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-aaf50341-0078-4c6b-b87a-e1207905017e tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] 10.222.0.50 "GET /compute/v2.1/servers/6fffb7a0-b963-4fdc-8f5d-0fe046c6a7ed" status: 200 len: 1208 microversion: 2.1 time: 0.128474 Aug 10 17:52:22.151932 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 400/784] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:22 2022] GET /compute/v2.1/servers/6fffb7a0-b963-4fdc-8f5d-0fe046c6a7ed => generated 1208 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:52:22.179583 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.virt.hardware [None req-725ce19b-1cc1-4245-9cbb-221bf5582ec4 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Flavor limits 0:0:0 {{(pid=129409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 17:52:22.179583 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.virt.hardware [None req-725ce19b-1cc1-4245-9cbb-221bf5582ec4 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Image limits 0:0:0 {{(pid=129409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 17:52:22.179583 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.virt.hardware [None req-725ce19b-1cc1-4245-9cbb-221bf5582ec4 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Flavor pref 0:0:0 {{(pid=129409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 17:52:22.180233 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.virt.hardware [None req-725ce19b-1cc1-4245-9cbb-221bf5582ec4 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Image pref 0:0:0 {{(pid=129409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 17:52:22.180233 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.virt.hardware [None req-725ce19b-1cc1-4245-9cbb-221bf5582ec4 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 17:52:22.210349 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-725ce19b-1cc1-4245-9cbb-221bf5582ec4 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:22.216627 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-725ce19b-1cc1-4245-9cbb-221bf5582ec4 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:22.217232 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-725ce19b-1cc1-4245-9cbb-221bf5582ec4 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:22.218161 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-725ce19b-1cc1-4245-9cbb-221bf5582ec4 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:22.225213 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-725ce19b-1cc1-4245-9cbb-221bf5582ec4 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:22.225708 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-725ce19b-1cc1-4245-9cbb-221bf5582ec4 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:22.289131 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-725ce19b-1cc1-4245-9cbb-221bf5582ec4 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Getting quotas for project 9df088e5a610436ea21b8a360e2bb527. Resources: {'instances', 'ram', 'cores'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:52:22.299763 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-725ce19b-1cc1-4245-9cbb-221bf5582ec4 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Getting quotas for user e83a3e198e21476eb12fcf417aea62de and project 9df088e5a610436ea21b8a360e2bb527. Resources: {'instances', 'ram', 'cores'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:52:22.304823 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-64792707-e58e-4a8d-8b77-5ca65f16323c tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:22.304823 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-64792707-e58e-4a8d-8b77-5ca65f16323c tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] [instance: bee3148a-3834-41bd-99e7-b5da75217256] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:22.314464 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-64792707-e58e-4a8d-8b77-5ca65f16323c tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:22.316208 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-64792707-e58e-4a8d-8b77-5ca65f16323c tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:22.319825 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-725ce19b-1cc1-4245-9cbb-221bf5582ec4 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Going to run 1 instances... {{(pid=129409) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 17:52:22.320945 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-64792707-e58e-4a8d-8b77-5ca65f16323c tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:22.323786 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-725ce19b-1cc1-4245-9cbb-221bf5582ec4 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] [instance: 3ca0b504-e928-4d31-be09-24a70200eff2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a735ff26-463a-4ffe-a981-ab9d9baa494f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 17:52:22.324722 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-64792707-e58e-4a8d-8b77-5ca65f16323c tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:22.325373 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-64792707-e58e-4a8d-8b77-5ca65f16323c tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:22.326704 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-64792707-e58e-4a8d-8b77-5ca65f16323c tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:22.498277 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-64792707-e58e-4a8d-8b77-5ca65f16323c tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2fd6acf18d4218ad143ccee2d0bb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7c2481a908406fa9c4562513fff665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:22.522005 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-64792707-e58e-4a8d-8b77-5ca65f16323c tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] 10.222.0.50 "GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256" status: 200 len: 1470 microversion: 2.1 time: 0.225617 Aug 10 17:52:22.522812 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 401/785] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:22 2022] GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256 => generated 1470 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:22.527970 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-d3587664-7a19-4cc5-944c-b8cfc555a113 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:22.528935 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-d3587664-7a19-4cc5-944c-b8cfc555a113 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] [instance: e2777988-0bbf-496c-9c97-b206dbc94a62] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:22.537188 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d3587664-7a19-4cc5-944c-b8cfc555a113 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:22.537675 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d3587664-7a19-4cc5-944c-b8cfc555a113 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:22.538118 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d3587664-7a19-4cc5-944c-b8cfc555a113 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:22.538851 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d3587664-7a19-4cc5-944c-b8cfc555a113 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:22.539308 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d3587664-7a19-4cc5-944c-b8cfc555a113 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:22.540047 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d3587664-7a19-4cc5-944c-b8cfc555a113 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:22.565760 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-725ce19b-1cc1-4245-9cbb-221bf5582ec4 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.765926 Aug 10 17:52:22.566685 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 385/786] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 17:52:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 768 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 10 17:52:22.584476 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-306dcc4f-e0d5-4a95-9c0d-53d67c0f3dcf tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:22.586040 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-306dcc4f-e0d5-4a95-9c0d-53d67c0f3dcf tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: f747d5da-322c-4afb-bac6-c614b85656f9] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:22.615147 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-306dcc4f-e0d5-4a95-9c0d-53d67c0f3dcf tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:22.616491 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-306dcc4f-e0d5-4a95-9c0d-53d67c0f3dcf tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:22.618014 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-306dcc4f-e0d5-4a95-9c0d-53d67c0f3dcf tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:22.618933 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-306dcc4f-e0d5-4a95-9c0d-53d67c0f3dcf tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:22.619832 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-306dcc4f-e0d5-4a95-9c0d-53d67c0f3dcf tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:22.621483 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-306dcc4f-e0d5-4a95-9c0d-53d67c0f3dcf tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:22.635849 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-d3587664-7a19-4cc5-944c-b8cfc555a113 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:22.644960 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-d3587664-7a19-4cc5-944c-b8cfc555a113 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:22.653311 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-d3587664-7a19-4cc5-944c-b8cfc555a113 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:22.668687 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-d3587664-7a19-4cc5-944c-b8cfc555a113 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] 10.222.0.50 "GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62" status: 200 len: 1445 microversion: 2.75 time: 0.144413 Aug 10 17:52:22.671973 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 402/787] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:52:22 2022] GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62 => generated 1445 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:52:22.675113 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-e62fd6f2-a9bc-4431-86d3-bfbf81d33390 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:22.675943 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-e62fd6f2-a9bc-4431-86d3-bfbf81d33390 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] [instance: 3ca0b504-e928-4d31-be09-24a70200eff2] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:22.770719 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-306dcc4f-e0d5-4a95-9c0d-53d67c0f3dcf tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:22.781570 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-306dcc4f-e0d5-4a95-9c0d-53d67c0f3dcf tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/f747d5da-322c-4afb-bac6-c614b85656f9" status: 200 len: 1213 microversion: 2.1 time: 0.212272 Aug 10 17:52:22.784973 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-e62fd6f2-a9bc-4431-86d3-bfbf81d33390 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83a3e198e21476eb12fcf417aea62de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df088e5a610436ea21b8a360e2bb527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:22.793616 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-e62fd6f2-a9bc-4431-86d3-bfbf81d33390 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] 10.222.0.50 "GET /compute/v2.1/servers/3ca0b504-e928-4d31-be09-24a70200eff2" status: 200 len: 1222 microversion: 2.1 time: 0.122959 Aug 10 17:52:22.794635 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 386/788] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:22 2022] GET /compute/v2.1/servers/f747d5da-322c-4afb-bac6-c614b85656f9 => generated 1213 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:22.809176 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 403/789] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:22 2022] GET /compute/v2.1/servers/3ca0b504-e928-4d31-be09-24a70200eff2 => generated 1222 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:23.173868 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-754ccdb1-4377-4273-910a-4b6b70539642 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:23.175703 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-754ccdb1-4377-4273-910a-4b6b70539642 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] [instance: 6fffb7a0-b963-4fdc-8f5d-0fe046c6a7ed] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:23.185679 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-754ccdb1-4377-4273-910a-4b6b70539642 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:23.187764 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-754ccdb1-4377-4273-910a-4b6b70539642 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:23.188726 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-754ccdb1-4377-4273-910a-4b6b70539642 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:23.189951 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-754ccdb1-4377-4273-910a-4b6b70539642 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:23.190587 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-754ccdb1-4377-4273-910a-4b6b70539642 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:23.191349 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-754ccdb1-4377-4273-910a-4b6b70539642 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:23.294934 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-754ccdb1-4377-4273-910a-4b6b70539642 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e109c3dcd0574faaa3d7ec31dd4edd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48bbb92998f54ebeb624bc794d406896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:23.305093 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-754ccdb1-4377-4273-910a-4b6b70539642 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] 10.222.0.50 "GET /compute/v2.1/servers/6fffb7a0-b963-4fdc-8f5d-0fe046c6a7ed" status: 200 len: 1264 microversion: 2.1 time: 0.135892 Aug 10 17:52:23.306008 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 387/790] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:23 2022] GET /compute/v2.1/servers/6fffb7a0-b963-4fdc-8f5d-0fe046c6a7ed => generated 1264 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:23.544515 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-f871bf41-1b40-4b9d-9f24-7396f1000ea7 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:23.545148 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-f871bf41-1b40-4b9d-9f24-7396f1000ea7 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] [instance: bee3148a-3834-41bd-99e7-b5da75217256] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:23.549883 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=4,nova_api:INSERT=3 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:52:23.553945 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-f871bf41-1b40-4b9d-9f24-7396f1000ea7 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:23.554427 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-f871bf41-1b40-4b9d-9f24-7396f1000ea7 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:23.554898 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-f871bf41-1b40-4b9d-9f24-7396f1000ea7 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:23.555594 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-f871bf41-1b40-4b9d-9f24-7396f1000ea7 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:23.556042 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-f871bf41-1b40-4b9d-9f24-7396f1000ea7 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:23.556513 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-f871bf41-1b40-4b9d-9f24-7396f1000ea7 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:23.696746 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-abff6b44-94d1-465b-bab2-7ed2e4aa15a8 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:23.700542 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-abff6b44-94d1-465b-bab2-7ed2e4aa15a8 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] [instance: e2777988-0bbf-496c-9c97-b206dbc94a62] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:23.704926 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-abff6b44-94d1-465b-bab2-7ed2e4aa15a8 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:23.705874 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-abff6b44-94d1-465b-bab2-7ed2e4aa15a8 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:23.706310 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-abff6b44-94d1-465b-bab2-7ed2e4aa15a8 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:23.707188 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-abff6b44-94d1-465b-bab2-7ed2e4aa15a8 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:23.707805 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-abff6b44-94d1-465b-bab2-7ed2e4aa15a8 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:23.708411 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-abff6b44-94d1-465b-bab2-7ed2e4aa15a8 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:23.718320 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-f871bf41-1b40-4b9d-9f24-7396f1000ea7 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2fd6acf18d4218ad143ccee2d0bb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7c2481a908406fa9c4562513fff665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:23.730680 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-f871bf41-1b40-4b9d-9f24-7396f1000ea7 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] 10.222.0.50 "GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256" status: 200 len: 1470 microversion: 2.1 time: 0.191470 Aug 10 17:52:23.731438 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 404/791] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:23 2022] GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256 => generated 1470 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:23.793319 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-abff6b44-94d1-465b-bab2-7ed2e4aa15a8 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:23.807714 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-abff6b44-94d1-465b-bab2-7ed2e4aa15a8 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:23.807714 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-abff6b44-94d1-465b-bab2-7ed2e4aa15a8 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:23.813774 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-abff6b44-94d1-465b-bab2-7ed2e4aa15a8 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] 10.222.0.50 "GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62" status: 200 len: 1445 microversion: 2.75 time: 0.120953 Aug 10 17:52:23.814893 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 388/792] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:52:23 2022] GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62 => generated 1445 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:52:23.818407 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-afe5d5aa-85af-4e14-9003-fe31b249d6af tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:23.819022 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-afe5d5aa-85af-4e14-9003-fe31b249d6af tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] [instance: 3ca0b504-e928-4d31-be09-24a70200eff2] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:23.821824 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-6b31648d-07d7-4cdf-9166-01b07a71dc5a tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:23.822612 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-6b31648d-07d7-4cdf-9166-01b07a71dc5a tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: f747d5da-322c-4afb-bac6-c614b85656f9] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:23.829345 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-6b31648d-07d7-4cdf-9166-01b07a71dc5a tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:23.829867 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-6b31648d-07d7-4cdf-9166-01b07a71dc5a tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:23.830358 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-6b31648d-07d7-4cdf-9166-01b07a71dc5a tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:23.831121 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-6b31648d-07d7-4cdf-9166-01b07a71dc5a tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:23.831852 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-6b31648d-07d7-4cdf-9166-01b07a71dc5a tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:23.832303 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-6b31648d-07d7-4cdf-9166-01b07a71dc5a tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:23.874915 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-afe5d5aa-85af-4e14-9003-fe31b249d6af tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83a3e198e21476eb12fcf417aea62de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df088e5a610436ea21b8a360e2bb527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:23.882067 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-afe5d5aa-85af-4e14-9003-fe31b249d6af tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] 10.222.0.50 "GET /compute/v2.1/servers/3ca0b504-e928-4d31-be09-24a70200eff2" status: 200 len: 1222 microversion: 2.1 time: 0.068144 Aug 10 17:52:23.910169 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 405/793] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:23 2022] GET /compute/v2.1/servers/3ca0b504-e928-4d31-be09-24a70200eff2 => generated 1222 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:52:23.951574 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-6b31648d-07d7-4cdf-9166-01b07a71dc5a tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:23.978162 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-6b31648d-07d7-4cdf-9166-01b07a71dc5a tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/f747d5da-322c-4afb-bac6-c614b85656f9" status: 200 len: 1269 microversion: 2.1 time: 0.149946 Aug 10 17:52:23.978162 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 389/794] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:23 2022] GET /compute/v2.1/servers/f747d5da-322c-4afb-bac6-c614b85656f9 => generated 1269 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:24.326959 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-0261cbcc-a8e1-48a7-bca5-509ac4a30e5c tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:24.328098 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-0261cbcc-a8e1-48a7-bca5-509ac4a30e5c tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] [instance: 6fffb7a0-b963-4fdc-8f5d-0fe046c6a7ed] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:24.335620 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-0261cbcc-a8e1-48a7-bca5-509ac4a30e5c tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:24.336394 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-0261cbcc-a8e1-48a7-bca5-509ac4a30e5c tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:24.337519 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-0261cbcc-a8e1-48a7-bca5-509ac4a30e5c tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:24.337830 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-0261cbcc-a8e1-48a7-bca5-509ac4a30e5c tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:24.338442 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-0261cbcc-a8e1-48a7-bca5-509ac4a30e5c tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:24.338940 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-0261cbcc-a8e1-48a7-bca5-509ac4a30e5c tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:24.491803 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-0261cbcc-a8e1-48a7-bca5-509ac4a30e5c tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e109c3dcd0574faaa3d7ec31dd4edd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48bbb92998f54ebeb624bc794d406896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:24.504889 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-0261cbcc-a8e1-48a7-bca5-509ac4a30e5c tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] 10.222.0.50 "GET /compute/v2.1/servers/6fffb7a0-b963-4fdc-8f5d-0fe046c6a7ed" status: 200 len: 1272 microversion: 2.1 time: 0.178716 Aug 10 17:52:24.504889 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 406/795] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:24 2022] GET /compute/v2.1/servers/6fffb7a0-b963-4fdc-8f5d-0fe046c6a7ed => generated 1272 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:24.754367 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-c13a39a9-f0dc-4aeb-bb4a-e4a56d459f76 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:24.755003 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-c13a39a9-f0dc-4aeb-bb4a-e4a56d459f76 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] [instance: bee3148a-3834-41bd-99e7-b5da75217256] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:24.761072 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c13a39a9-f0dc-4aeb-bb4a-e4a56d459f76 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:24.761764 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c13a39a9-f0dc-4aeb-bb4a-e4a56d459f76 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:24.762201 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c13a39a9-f0dc-4aeb-bb4a-e4a56d459f76 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:24.762893 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c13a39a9-f0dc-4aeb-bb4a-e4a56d459f76 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:24.763337 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c13a39a9-f0dc-4aeb-bb4a-e4a56d459f76 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:24.763932 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c13a39a9-f0dc-4aeb-bb4a-e4a56d459f76 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:24.846105 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-70e521d0-af5d-4147-845b-44bcb13ecfd7 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:24.846810 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-70e521d0-af5d-4147-845b-44bcb13ecfd7 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] [instance: e2777988-0bbf-496c-9c97-b206dbc94a62] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:24.854203 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-70e521d0-af5d-4147-845b-44bcb13ecfd7 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:24.854907 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-70e521d0-af5d-4147-845b-44bcb13ecfd7 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:24.855354 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-70e521d0-af5d-4147-845b-44bcb13ecfd7 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:24.856065 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-70e521d0-af5d-4147-845b-44bcb13ecfd7 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:24.856553 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-70e521d0-af5d-4147-845b-44bcb13ecfd7 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:24.856984 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-70e521d0-af5d-4147-845b-44bcb13ecfd7 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:24.939858 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-70e521d0-af5d-4147-845b-44bcb13ecfd7 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:24.995757 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-70e521d0-af5d-4147-845b-44bcb13ecfd7 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:24.997489 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-70e521d0-af5d-4147-845b-44bcb13ecfd7 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:25.002078 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-c13a39a9-f0dc-4aeb-bb4a-e4a56d459f76 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2fd6acf18d4218ad143ccee2d0bb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7c2481a908406fa9c4562513fff665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:25.011988 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-c13a39a9-f0dc-4aeb-bb4a-e4a56d459f76 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] 10.222.0.50 "GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256" status: 200 len: 1470 microversion: 2.1 time: 0.263191 Aug 10 17:52:25.013704 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 390/796] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:24 2022] GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256 => generated 1470 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:25.019737 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-a03038dd-5f4c-4a26-819d-7af6df783028 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:25.022541 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-a03038dd-5f4c-4a26-819d-7af6df783028 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] [instance: 3ca0b504-e928-4d31-be09-24a70200eff2] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:25.029163 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a03038dd-5f4c-4a26-819d-7af6df783028 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:25.029477 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-70e521d0-af5d-4147-845b-44bcb13ecfd7 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] 10.222.0.50 "GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62" status: 200 len: 1445 microversion: 2.75 time: 0.188192 Aug 10 17:52:25.029868 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a03038dd-5f4c-4a26-819d-7af6df783028 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:25.030879 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a03038dd-5f4c-4a26-819d-7af6df783028 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:25.031588 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a03038dd-5f4c-4a26-819d-7af6df783028 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:25.032339 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a03038dd-5f4c-4a26-819d-7af6df783028 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:25.032971 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a03038dd-5f4c-4a26-819d-7af6df783028 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:25.046061 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 407/797] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:52:24 2022] GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62 => generated 1445 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 17:52:25.072713 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-a97129ec-a164-49c4-a9a8-ff1ad9d0925a tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:25.072713 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-a97129ec-a164-49c4-a9a8-ff1ad9d0925a tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: f747d5da-322c-4afb-bac6-c614b85656f9] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:25.076097 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a97129ec-a164-49c4-a9a8-ff1ad9d0925a tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:25.076632 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a97129ec-a164-49c4-a9a8-ff1ad9d0925a tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:25.077170 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a97129ec-a164-49c4-a9a8-ff1ad9d0925a tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:25.077897 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a97129ec-a164-49c4-a9a8-ff1ad9d0925a tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:25.078447 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a97129ec-a164-49c4-a9a8-ff1ad9d0925a tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:25.078879 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a97129ec-a164-49c4-a9a8-ff1ad9d0925a tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:25.136800 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-a03038dd-5f4c-4a26-819d-7af6df783028 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83a3e198e21476eb12fcf417aea62de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df088e5a610436ea21b8a360e2bb527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:25.145858 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-a03038dd-5f4c-4a26-819d-7af6df783028 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] 10.222.0.50 "GET /compute/v2.1/servers/3ca0b504-e928-4d31-be09-24a70200eff2" status: 200 len: 1226 microversion: 2.1 time: 0.131013 Aug 10 17:52:25.146668 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 391/798] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:25 2022] GET /compute/v2.1/servers/3ca0b504-e928-4d31-be09-24a70200eff2 => generated 1226 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:25.155797 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-a97129ec-a164-49c4-a9a8-ff1ad9d0925a tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:25.165400 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-a97129ec-a164-49c4-a9a8-ff1ad9d0925a tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/f747d5da-322c-4afb-bac6-c614b85656f9" status: 200 len: 1277 microversion: 2.1 time: 0.118161 Aug 10 17:52:25.166419 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 408/799] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:25 2022] GET /compute/v2.1/servers/f747d5da-322c-4afb-bac6-c614b85656f9 => generated 1277 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:25.525072 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-33089ae1-07d9-4da2-aa49-f4fcbbd70444 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:25.525689 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-33089ae1-07d9-4da2-aa49-f4fcbbd70444 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] [instance: 6fffb7a0-b963-4fdc-8f5d-0fe046c6a7ed] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:25.533038 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-33089ae1-07d9-4da2-aa49-f4fcbbd70444 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:25.534447 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-33089ae1-07d9-4da2-aa49-f4fcbbd70444 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:25.534447 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-33089ae1-07d9-4da2-aa49-f4fcbbd70444 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:25.534817 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-33089ae1-07d9-4da2-aa49-f4fcbbd70444 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:25.536475 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-33089ae1-07d9-4da2-aa49-f4fcbbd70444 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:25.536909 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-33089ae1-07d9-4da2-aa49-f4fcbbd70444 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:25.906803 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-33089ae1-07d9-4da2-aa49-f4fcbbd70444 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e109c3dcd0574faaa3d7ec31dd4edd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48bbb92998f54ebeb624bc794d406896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:25.925671 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:52:25.929278 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-33089ae1-07d9-4da2-aa49-f4fcbbd70444 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] 10.222.0.50 "GET /compute/v2.1/servers/6fffb7a0-b963-4fdc-8f5d-0fe046c6a7ed" status: 200 len: 1312 microversion: 2.1 time: 0.408210 Aug 10 17:52:25.932289 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 392/800] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:25 2022] GET /compute/v2.1/servers/6fffb7a0-b963-4fdc-8f5d-0fe046c6a7ed => generated 1312 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:52:26.034138 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-19a76a97-19c9-4c81-8c40-b39891140284 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:26.034793 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-19a76a97-19c9-4c81-8c40-b39891140284 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] [instance: bee3148a-3834-41bd-99e7-b5da75217256] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:26.042151 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-19a76a97-19c9-4c81-8c40-b39891140284 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:26.042881 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-19a76a97-19c9-4c81-8c40-b39891140284 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:26.043551 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-19a76a97-19c9-4c81-8c40-b39891140284 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:26.044505 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-19a76a97-19c9-4c81-8c40-b39891140284 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:26.045163 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-19a76a97-19c9-4c81-8c40-b39891140284 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:26.045835 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-19a76a97-19c9-4c81-8c40-b39891140284 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:26.058131 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-f7ba9ed7-f8ed-41cd-9da2-87839ab2375d tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:26.059213 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-f7ba9ed7-f8ed-41cd-9da2-87839ab2375d tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] [instance: e2777988-0bbf-496c-9c97-b206dbc94a62] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:26.066469 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-f7ba9ed7-f8ed-41cd-9da2-87839ab2375d tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:26.067205 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-f7ba9ed7-f8ed-41cd-9da2-87839ab2375d tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:26.067840 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-f7ba9ed7-f8ed-41cd-9da2-87839ab2375d tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:26.068757 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-f7ba9ed7-f8ed-41cd-9da2-87839ab2375d tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:26.069410 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-f7ba9ed7-f8ed-41cd-9da2-87839ab2375d tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:26.070047 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-f7ba9ed7-f8ed-41cd-9da2-87839ab2375d tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:26.202913 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-f7ba9ed7-f8ed-41cd-9da2-87839ab2375d tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:26.202913 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-f7ba9ed7-f8ed-41cd-9da2-87839ab2375d tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:26.202913 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-f7ba9ed7-f8ed-41cd-9da2-87839ab2375d tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:26.202913 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-f7ba9ed7-f8ed-41cd-9da2-87839ab2375d tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] 10.222.0.50 "GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62" status: 200 len: 1445 microversion: 2.75 time: 0.130572 Aug 10 17:52:26.202913 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 393/801] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:52:26 2022] GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62 => generated 1445 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:52:26.208499 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-2c05b299-8689-449f-8b94-96eb57672174 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:26.209117 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-2c05b299-8689-449f-8b94-96eb57672174 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] [instance: 3ca0b504-e928-4d31-be09-24a70200eff2] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:26.216146 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-2c05b299-8689-449f-8b94-96eb57672174 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:26.216708 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-2c05b299-8689-449f-8b94-96eb57672174 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:26.217142 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-2c05b299-8689-449f-8b94-96eb57672174 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:26.218201 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-2c05b299-8689-449f-8b94-96eb57672174 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:26.218864 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-2c05b299-8689-449f-8b94-96eb57672174 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:26.219327 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-2c05b299-8689-449f-8b94-96eb57672174 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:26.238818 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-19a76a97-19c9-4c81-8c40-b39891140284 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2fd6acf18d4218ad143ccee2d0bb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7c2481a908406fa9c4562513fff665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:26.272653 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-19a76a97-19c9-4c81-8c40-b39891140284 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] 10.222.0.50 "GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256" status: 200 len: 1470 microversion: 2.1 time: 0.227997 Aug 10 17:52:26.272653 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 409/802] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:26 2022] GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256 => generated 1470 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:26.272653 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-fc93c8e5-31d0-437b-87f3-29ad05531efe tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:26.272653 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-fc93c8e5-31d0-437b-87f3-29ad05531efe tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: f747d5da-322c-4afb-bac6-c614b85656f9] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:26.272653 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-fc93c8e5-31d0-437b-87f3-29ad05531efe tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:26.272653 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-fc93c8e5-31d0-437b-87f3-29ad05531efe tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:26.272653 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-fc93c8e5-31d0-437b-87f3-29ad05531efe tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:26.272653 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-fc93c8e5-31d0-437b-87f3-29ad05531efe tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:26.272653 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-fc93c8e5-31d0-437b-87f3-29ad05531efe tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:26.272653 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-fc93c8e5-31d0-437b-87f3-29ad05531efe tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:26.285186 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-2c05b299-8689-449f-8b94-96eb57672174 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83a3e198e21476eb12fcf417aea62de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df088e5a610436ea21b8a360e2bb527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:26.293146 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-2c05b299-8689-449f-8b94-96eb57672174 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] 10.222.0.50 "GET /compute/v2.1/servers/3ca0b504-e928-4d31-be09-24a70200eff2" status: 200 len: 1218 microversion: 2.1 time: 0.101547 Aug 10 17:52:26.294038 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 394/803] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:26 2022] GET /compute/v2.1/servers/3ca0b504-e928-4d31-be09-24a70200eff2 => generated 1218 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:26.367354 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-fc93c8e5-31d0-437b-87f3-29ad05531efe tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:26.375954 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-fc93c8e5-31d0-437b-87f3-29ad05531efe tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/f747d5da-322c-4afb-bac6-c614b85656f9" status: 200 len: 1275 microversion: 2.1 time: 0.116969 Aug 10 17:52:26.376829 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 410/804] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:26 2022] GET /compute/v2.1/servers/f747d5da-322c-4afb-bac6-c614b85656f9 => generated 1275 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:26.956620 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-838a67cb-94ed-4b17-8496-2f83bf0f3e9b tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:26.961301 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-838a67cb-94ed-4b17-8496-2f83bf0f3e9b tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] [instance: 6fffb7a0-b963-4fdc-8f5d-0fe046c6a7ed] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:26.977856 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-838a67cb-94ed-4b17-8496-2f83bf0f3e9b tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:26.977856 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-838a67cb-94ed-4b17-8496-2f83bf0f3e9b tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:26.977856 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-838a67cb-94ed-4b17-8496-2f83bf0f3e9b tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:26.977856 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-838a67cb-94ed-4b17-8496-2f83bf0f3e9b tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:26.977856 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-838a67cb-94ed-4b17-8496-2f83bf0f3e9b tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:26.977856 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-838a67cb-94ed-4b17-8496-2f83bf0f3e9b tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:27.132940 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-838a67cb-94ed-4b17-8496-2f83bf0f3e9b tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e109c3dcd0574faaa3d7ec31dd4edd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48bbb92998f54ebeb624bc794d406896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:27.141202 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-838a67cb-94ed-4b17-8496-2f83bf0f3e9b tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] 10.222.0.50 "GET /compute/v2.1/servers/6fffb7a0-b963-4fdc-8f5d-0fe046c6a7ed" status: 200 len: 1312 microversion: 2.1 time: 0.188888 Aug 10 17:52:27.154505 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 395/805] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:26 2022] GET /compute/v2.1/servers/6fffb7a0-b963-4fdc-8f5d-0fe046c6a7ed => generated 1312 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:27.214506 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-f03fc1a6-42bc-4082-b453-c527f8fd3f3a tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:27.215969 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-f03fc1a6-42bc-4082-b453-c527f8fd3f3a tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] [instance: e2777988-0bbf-496c-9c97-b206dbc94a62] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:27.232534 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-f03fc1a6-42bc-4082-b453-c527f8fd3f3a tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:27.232534 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-f03fc1a6-42bc-4082-b453-c527f8fd3f3a tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:27.232534 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-f03fc1a6-42bc-4082-b453-c527f8fd3f3a tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:27.232534 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-f03fc1a6-42bc-4082-b453-c527f8fd3f3a tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:27.232534 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-f03fc1a6-42bc-4082-b453-c527f8fd3f3a tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:27.232534 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-f03fc1a6-42bc-4082-b453-c527f8fd3f3a tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:27.295217 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-39181f6c-feae-4dc3-bfbd-da90cd6b4bc2 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:27.296442 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-39181f6c-feae-4dc3-bfbd-da90cd6b4bc2 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] [instance: bee3148a-3834-41bd-99e7-b5da75217256] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:27.305916 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-39181f6c-feae-4dc3-bfbd-da90cd6b4bc2 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:27.312284 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-39181f6c-feae-4dc3-bfbd-da90cd6b4bc2 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:27.312284 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-39181f6c-feae-4dc3-bfbd-da90cd6b4bc2 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:27.312284 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-39181f6c-feae-4dc3-bfbd-da90cd6b4bc2 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:27.312284 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-39181f6c-feae-4dc3-bfbd-da90cd6b4bc2 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:27.312284 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-39181f6c-feae-4dc3-bfbd-da90cd6b4bc2 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:27.339330 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-f03fc1a6-42bc-4082-b453-c527f8fd3f3a tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:27.356102 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-f03fc1a6-42bc-4082-b453-c527f8fd3f3a tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:27.360495 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-f03fc1a6-42bc-4082-b453-c527f8fd3f3a tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:27.381300 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-f03fc1a6-42bc-4082-b453-c527f8fd3f3a tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] 10.222.0.50 "GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62" status: 200 len: 1445 microversion: 2.75 time: 0.174463 Aug 10 17:52:27.382536 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 411/806] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:52:27 2022] GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62 => generated 1445 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:52:27.407922 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-0f2ef2e6-3a2c-4dae-93ff-c38969af7c0e tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:27.409650 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-0f2ef2e6-3a2c-4dae-93ff-c38969af7c0e tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] [instance: 3ca0b504-e928-4d31-be09-24a70200eff2] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:27.421172 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-0f2ef2e6-3a2c-4dae-93ff-c38969af7c0e tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:27.423480 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-0f2ef2e6-3a2c-4dae-93ff-c38969af7c0e tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:27.423993 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-0f2ef2e6-3a2c-4dae-93ff-c38969af7c0e tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:27.425298 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-0f2ef2e6-3a2c-4dae-93ff-c38969af7c0e tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:27.425920 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-0f2ef2e6-3a2c-4dae-93ff-c38969af7c0e tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:27.427190 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-0f2ef2e6-3a2c-4dae-93ff-c38969af7c0e tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:27.432185 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:52:27.524039 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-0f2ef2e6-3a2c-4dae-93ff-c38969af7c0e tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83a3e198e21476eb12fcf417aea62de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df088e5a610436ea21b8a360e2bb527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:27.533614 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-0f2ef2e6-3a2c-4dae-93ff-c38969af7c0e tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] 10.222.0.50 "GET /compute/v2.1/servers/3ca0b504-e928-4d31-be09-24a70200eff2" status: 200 len: 1274 microversion: 2.1 time: 0.149824 Aug 10 17:52:27.534679 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 412/807] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:27 2022] GET /compute/v2.1/servers/3ca0b504-e928-4d31-be09-24a70200eff2 => generated 1274 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:27.541153 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-e5966990-ea3e-407c-a4d2-762f224f45b2 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:27.541929 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-e5966990-ea3e-407c-a4d2-762f224f45b2 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: f747d5da-322c-4afb-bac6-c614b85656f9] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:27.544730 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-39181f6c-feae-4dc3-bfbd-da90cd6b4bc2 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2fd6acf18d4218ad143ccee2d0bb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7c2481a908406fa9c4562513fff665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:27.551280 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e5966990-ea3e-407c-a4d2-762f224f45b2 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:27.552366 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e5966990-ea3e-407c-a4d2-762f224f45b2 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:27.553051 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e5966990-ea3e-407c-a4d2-762f224f45b2 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:27.553216 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-39181f6c-feae-4dc3-bfbd-da90cd6b4bc2 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] 10.222.0.50 "GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256" status: 200 len: 1470 microversion: 2.1 time: 0.262254 Aug 10 17:52:27.554046 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 396/808] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:27 2022] GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256 => generated 1470 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:27.554306 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e5966990-ea3e-407c-a4d2-762f224f45b2 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:27.554856 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e5966990-ea3e-407c-a4d2-762f224f45b2 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:27.555332 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e5966990-ea3e-407c-a4d2-762f224f45b2 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:27.795503 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-e5966990-ea3e-407c-a4d2-762f224f45b2 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:27.803764 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-e5966990-ea3e-407c-a4d2-762f224f45b2 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/f747d5da-322c-4afb-bac6-c614b85656f9" status: 200 len: 1317 microversion: 2.1 time: 0.267521 Aug 10 17:52:27.804384 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 413/809] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:27 2022] GET /compute/v2.1/servers/f747d5da-322c-4afb-bac6-c614b85656f9 => generated 1317 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:27.994435 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [req-9e706fbb-fe11-45bb-940a-b6e9f61ef84a req-5798238c-28f8-4018-a68f-6ca776052169 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6fffb7a0-b963-4fdc-8f5d-0fe046c6a7ed", "tag": "25ae0a01-bb3b-4af9-abfc-9b9f8dc40384"}]} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:52:28.012839 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-9e706fbb-fe11-45bb-940a-b6e9f61ef84a req-5798238c-28f8-4018-a68f-6ca776052169 service nova] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:28.013347 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-9e706fbb-fe11-45bb-940a-b6e9f61ef84a req-5798238c-28f8-4018-a68f-6ca776052169 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:28.013771 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-9e706fbb-fe11-45bb-940a-b6e9f61ef84a req-5798238c-28f8-4018-a68f-6ca776052169 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:28.039225 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.compute.server_external_events [req-9e706fbb-fe11-45bb-940a-b6e9f61ef84a req-5798238c-28f8-4018-a68f-6ca776052169 service nova] Creating event network-changed:25ae0a01-bb3b-4af9-abfc-9b9f8dc40384 for instance 6fffb7a0-b963-4fdc-8f5d-0fe046c6a7ed on n-h2-852296-2 Aug 10 17:52:28.047220 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [req-9e706fbb-fe11-45bb-940a-b6e9f61ef84a req-5798238c-28f8-4018-a68f-6ca776052169 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056258 Aug 10 17:52:28.048157 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 397/810] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 10 17:52:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:52:28.166616 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-bbf46db4-6fa5-4d46-9821-aff518bac040 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:28.169028 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-bbf46db4-6fa5-4d46-9821-aff518bac040 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] [instance: 6fffb7a0-b963-4fdc-8f5d-0fe046c6a7ed] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:28.196623 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-bbf46db4-6fa5-4d46-9821-aff518bac040 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:28.197340 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-bbf46db4-6fa5-4d46-9821-aff518bac040 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:28.198009 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-bbf46db4-6fa5-4d46-9821-aff518bac040 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:28.198887 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-bbf46db4-6fa5-4d46-9821-aff518bac040 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:28.199502 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-bbf46db4-6fa5-4d46-9821-aff518bac040 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:28.200059 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-bbf46db4-6fa5-4d46-9821-aff518bac040 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:28.399280 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-d270032b-f8c8-4dd9-be9a-e22d44c2b394 tempest-VolumesNegativeTest-1835577791 tempest-VolumesNegativeTest-1835577791-project] Action: 'create', calling method: .version_select at 0x7fb3465e88b0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1754081213", "metadata": {"Type": "work"}}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:52:28.416429 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-d270032b-f8c8-4dd9-be9a-e22d44c2b394 tempest-VolumesNegativeTest-1835577791 tempest-VolumesNegativeTest-1835577791-project] Request method failure captured: Aug 10 17:52:28.416429 n-d-852296-2 devstack@n-api.service[129409]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 10 17:52:28.416429 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 17:52:28.416429 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 17:52:28.416429 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 17:52:28.416429 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 122 Aug 10 17:52:28.416429 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 17:52:28.416429 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 17:52:28.416429 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 17:52:28.416429 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 17:52:28.416429 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8_Bc7wx2SHREHD-g8ZQ7AYhxtd-EiH3UlnxRQS2aIm0-vbvm-Wv2OtXrLWQlw0myIj_HmAA3HxQ_jVUDy57g5wszmmZXsmzsmwBcD5BCe0w4E0qP5mO1AvRRJYTm-BZKx5B_vj69RlVja_tdWxmNZx7O0ZVIltMFEiOBdRTrFmUXSz8 Aug 10 17:52:28.416429 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 17:52:28.416429 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 17:52:28.416429 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 17:52:28.416429 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 17:52:28.416429 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 17:52:28.416429 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 17:52:28.416429 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: 2c5baaa1ea3842e6844b2d1c4e40e801 Aug 10 17:52:28.416429 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-VolumesNegativeTest-1835577791 Aug 10 17:52:28.416429 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 17:52:28.416429 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 17:52:28.416429 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2c5baaa1ea3842e6844b2d1c4e40e801"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/2c5baaa1ea3842e6844b2d1c4e40e801"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2c5baaa1ea3842e6844b2d1c4e40e801"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_2c5baaa1ea3842e6844b2d1c4e40e801", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:52:28.416429 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-VolumesNegativeTest-1835577791 Aug 10 17:52:28.416429 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: 2c5baaa1ea3842e6844b2d1c4e40e801 Aug 10 17:52:28.416429 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-VolumesNegativeTest-1835577791 Aug 10 17:52:28.416429 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-VolumesNegativeTest-1835577791-project Aug 10 17:52:28.416429 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 17:52:28.416429 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 17:52:28.416429 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: 4f0ec6deb19f43c38097f1c674b8652c Aug 10 17:52:28.416429 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-VolumesNegativeTest-1835577791-project Aug 10 17:52:28.416429 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:52:28.416429 n-d-852296-2 devstack@n-api.service[129409]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1754081213", "metadata": {"Type": "work"}}} Aug 10 17:52:28.416429 n-d-852296-2 devstack@n-api.service[129409]: method: Aug 10 17:52:28.416429 n-d-852296-2 devstack@n-api.service[129409]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 10 17:52:28.416429 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1754081213', 'metadata': {'Type': 'work'}}}} Aug 10 17:52:28.416429 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:52:28.416429 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:52:28.416429 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 10 17:52:28.416429 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 10 17:52:28.416429 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 10 17:52:28.416429 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise error Aug 10 17:52:28.416429 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 10 17:52:28.416429 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:52:28.416429 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 10 17:52:28.416429 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 10 17:52:28.416429 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:52:28.416429 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 10 17:52:28.416429 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi '#$%' Aug 10 17:52:28.416429 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:52:28.416429 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:52:28.416429 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:52:28.416429 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:52:28.416429 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:52:28.416429 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:52:28.416429 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:52:28.416429 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:52:28.416429 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 17:52:28.416429 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 17:52:28.416429 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:52:28.416429 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:52:28.416429 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 10 17:52:28.416429 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 10 17:52:28.416429 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 10 17:52:28.416429 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 10 17:52:28.416429 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 10 17:52:28.416429 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 10 17:52:28.422174 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 10 17:52:28.422174 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:52:28.422174 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:52:28.422174 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:52:28.422174 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:52:28.422174 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:52:28.422174 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:52:28.422174 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 10 17:52:28.422174 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 10 17:52:28.422174 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 10 17:52:28.422174 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:52:28.425584 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-d270032b-f8c8-4dd9-be9a-e22d44c2b394 tempest-VolumesNegativeTest-1835577791 tempest-VolumesNegativeTest-1835577791-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:52:28.426732 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-d270032b-f8c8-4dd9-be9a-e22d44c2b394 tempest-VolumesNegativeTest-1835577791 tempest-VolumesNegativeTest-1835577791-project] 10.222.0.50 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.259847 Aug 10 17:52:28.432806 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 398/811] 10.222.0.50 () {60 vars in 1156 bytes} [Wed Aug 10 17:52:28 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 266 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 10 17:52:28.444556 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-395a0734-eb43-4a80-a2fc-c6e2d24a3a05 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:28.446148 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-395a0734-eb43-4a80-a2fc-c6e2d24a3a05 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] [instance: e2777988-0bbf-496c-9c97-b206dbc94a62] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:28.455536 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-395a0734-eb43-4a80-a2fc-c6e2d24a3a05 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:28.456196 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-395a0734-eb43-4a80-a2fc-c6e2d24a3a05 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:28.456765 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-395a0734-eb43-4a80-a2fc-c6e2d24a3a05 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:28.457661 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-395a0734-eb43-4a80-a2fc-c6e2d24a3a05 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:28.459854 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-395a0734-eb43-4a80-a2fc-c6e2d24a3a05 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:28.460645 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-395a0734-eb43-4a80-a2fc-c6e2d24a3a05 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:28.623461 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-bbf46db4-6fa5-4d46-9821-aff518bac040 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e109c3dcd0574faaa3d7ec31dd4edd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48bbb92998f54ebeb624bc794d406896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:28.632367 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-bbf46db4-6fa5-4d46-9821-aff518bac040 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] 10.222.0.50 "GET /compute/v2.1/servers/6fffb7a0-b963-4fdc-8f5d-0fe046c6a7ed" status: 200 len: 1312 microversion: 2.1 time: 0.473598 Aug 10 17:52:28.634158 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 414/812] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:28 2022] GET /compute/v2.1/servers/6fffb7a0-b963-4fdc-8f5d-0fe046c6a7ed => generated 1312 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:28.640319 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-0e35b9dc-dd64-4c3d-8dbc-3bae827d6cb1 tempest-VolumesNegativeTest-1835577791 tempest-VolumesNegativeTest-1835577791-project] Action: 'create', calling method: .version_select at 0x7fb346104c10>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-682349012", "metadata": {"Type": "work"}}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:52:28.646405 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-0e35b9dc-dd64-4c3d-8dbc-3bae827d6cb1 tempest-VolumesNegativeTest-1835577791 tempest-VolumesNegativeTest-1835577791-project] Request method failure captured: Aug 10 17:52:28.646405 n-d-852296-2 devstack@n-api.service[129410]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 10 17:52:28.646405 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 17:52:28.646405 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 17:52:28.646405 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 17:52:28.646405 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 119 Aug 10 17:52:28.646405 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 17:52:28.646405 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 17:52:28.646405 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 17:52:28.646405 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 17:52:28.646405 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8_Bc7wx2SHREHD-g8ZQ7AYhxtd-EiH3UlnxRQS2aIm0-vbvm-Wv2OtXrLWQlw0myIj_HmAA3HxQ_jVUDy57g5wszmmZXsmzsmwBcD5BCe0w4E0qP5mO1AvRRJYTm-BZKx5B_vj69RlVja_tdWxmNZx7O0ZVIltMFEiOBdRTrFmUXSz8 Aug 10 17:52:28.646405 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 17:52:28.646405 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 17:52:28.646405 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 17:52:28.646405 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 17:52:28.646405 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 17:52:28.646405 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 17:52:28.646405 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: 2c5baaa1ea3842e6844b2d1c4e40e801 Aug 10 17:52:28.646405 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-VolumesNegativeTest-1835577791 Aug 10 17:52:28.646405 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 17:52:28.646405 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 17:52:28.646405 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2c5baaa1ea3842e6844b2d1c4e40e801"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/2c5baaa1ea3842e6844b2d1c4e40e801"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2c5baaa1ea3842e6844b2d1c4e40e801"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_2c5baaa1ea3842e6844b2d1c4e40e801", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:52:28.646405 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-VolumesNegativeTest-1835577791 Aug 10 17:52:28.646405 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: 2c5baaa1ea3842e6844b2d1c4e40e801 Aug 10 17:52:28.646405 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-VolumesNegativeTest-1835577791 Aug 10 17:52:28.646405 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-VolumesNegativeTest-1835577791-project Aug 10 17:52:28.646405 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 17:52:28.646405 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 17:52:28.646405 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: 4f0ec6deb19f43c38097f1c674b8652c Aug 10 17:52:28.646405 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-VolumesNegativeTest-1835577791-project Aug 10 17:52:28.646405 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 17:52:28.646405 n-d-852296-2 devstack@n-api.service[129410]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-682349012", "metadata": {"Type": "work"}}} Aug 10 17:52:28.646405 n-d-852296-2 devstack@n-api.service[129410]: method: Aug 10 17:52:28.646405 n-d-852296-2 devstack@n-api.service[129410]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 10 17:52:28.646405 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-682349012', 'metadata': {'Type': 'work'}}}} Aug 10 17:52:28.646405 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:52:28.646405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:52:28.646405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 10 17:52:28.646405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 10 17:52:28.646405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 10 17:52:28.646405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise error Aug 10 17:52:28.646405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 10 17:52:28.646405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:52:28.646405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 10 17:52:28.646405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 10 17:52:28.646405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:52:28.646405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 10 17:52:28.646405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi '0' Aug 10 17:52:28.646405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:52:28.646405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:52:28.646405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:52:28.646405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:52:28.646405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:52:28.646405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:52:28.646405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:52:28.646405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:52:28.646405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 17:52:28.646405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 17:52:28.646405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:52:28.646405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:52:28.646405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 10 17:52:28.646405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 10 17:52:28.646405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 10 17:52:28.646405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 10 17:52:28.646405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 10 17:52:28.646405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 10 17:52:28.654589 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 10 17:52:28.654589 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:52:28.654589 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:52:28.654589 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:52:28.654589 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:52:28.654589 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:52:28.654589 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:52:28.654589 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 10 17:52:28.654589 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 10 17:52:28.654589 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 10 17:52:28.654589 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:52:28.654589 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-0e35b9dc-dd64-4c3d-8dbc-3bae827d6cb1 tempest-VolumesNegativeTest-1835577791 tempest-VolumesNegativeTest-1835577791-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:52:28.654589 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-0e35b9dc-dd64-4c3d-8dbc-3bae827d6cb1 tempest-VolumesNegativeTest-1835577791 tempest-VolumesNegativeTest-1835577791-project] 10.222.0.50 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.013959 Aug 10 17:52:28.654589 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 415/813] 10.222.0.50 () {60 vars in 1156 bytes} [Wed Aug 10 17:52:28 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 10 17:52:28.657186 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-90b5136e-d5f6-4961-b688-845e185a44bb tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:28.657186 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-90b5136e-d5f6-4961-b688-845e185a44bb tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] [instance: 3ca0b504-e928-4d31-be09-24a70200eff2] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:28.667472 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-90b5136e-d5f6-4961-b688-845e185a44bb tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:28.667966 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-90b5136e-d5f6-4961-b688-845e185a44bb tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:28.668450 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-90b5136e-d5f6-4961-b688-845e185a44bb tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:28.669204 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-90b5136e-d5f6-4961-b688-845e185a44bb tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:28.669669 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-90b5136e-d5f6-4961-b688-845e185a44bb tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:28.670124 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-90b5136e-d5f6-4961-b688-845e185a44bb tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:28.770339 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-90b5136e-d5f6-4961-b688-845e185a44bb tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83a3e198e21476eb12fcf417aea62de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df088e5a610436ea21b8a360e2bb527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:28.782521 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-90b5136e-d5f6-4961-b688-845e185a44bb tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] 10.222.0.50 "GET /compute/v2.1/servers/3ca0b504-e928-4d31-be09-24a70200eff2" status: 200 len: 1292 microversion: 2.1 time: 0.131448 Aug 10 17:52:28.784455 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 416/814] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:28 2022] GET /compute/v2.1/servers/3ca0b504-e928-4d31-be09-24a70200eff2 => generated 1292 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:28.817329 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-399412a1-48cc-4670-a72c-39e035770d56 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:28.817965 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-399412a1-48cc-4670-a72c-39e035770d56 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] [instance: bee3148a-3834-41bd-99e7-b5da75217256] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:28.825274 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-399412a1-48cc-4670-a72c-39e035770d56 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:28.825773 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-399412a1-48cc-4670-a72c-39e035770d56 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:28.826211 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-399412a1-48cc-4670-a72c-39e035770d56 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:28.827346 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-399412a1-48cc-4670-a72c-39e035770d56 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:28.828134 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-399412a1-48cc-4670-a72c-39e035770d56 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:28.828736 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-399412a1-48cc-4670-a72c-39e035770d56 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:28.838770 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-395a0734-eb43-4a80-a2fc-c6e2d24a3a05 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:28.853607 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-395a0734-eb43-4a80-a2fc-c6e2d24a3a05 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:28.854908 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-395a0734-eb43-4a80-a2fc-c6e2d24a3a05 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:28.896526 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-395a0734-eb43-4a80-a2fc-c6e2d24a3a05 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] 10.222.0.50 "GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62" status: 200 len: 1445 microversion: 2.75 time: 0.462107 Aug 10 17:52:28.897766 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 399/815] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:52:28 2022] GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62 => generated 1445 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:52:28.902711 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-85c31b36-cbe7-4607-bd4c-43e4a5a2acc5 tempest-VolumesNegativeTest-1835577791 tempest-VolumesNegativeTest-1835577791-project] Action: 'create', calling method: .version_select at 0x7fb346621b80>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1428694445", "metadata": {"Type": "work"}}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:52:28.907830 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-85c31b36-cbe7-4607-bd4c-43e4a5a2acc5 tempest-VolumesNegativeTest-1835577791 tempest-VolumesNegativeTest-1835577791-project] Request method failure captured: Aug 10 17:52:28.907830 n-d-852296-2 devstack@n-api.service[129409]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 10 17:52:28.907830 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 17:52:28.907830 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 17:52:28.907830 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 17:52:28.907830 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 119 Aug 10 17:52:28.907830 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 17:52:28.907830 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 17:52:28.907830 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 17:52:28.907830 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 17:52:28.907830 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8_Bc7wx2SHREHD-g8ZQ7AYhxtd-EiH3UlnxRQS2aIm0-vbvm-Wv2OtXrLWQlw0myIj_HmAA3HxQ_jVUDy57g5wszmmZXsmzsmwBcD5BCe0w4E0qP5mO1AvRRJYTm-BZKx5B_vj69RlVja_tdWxmNZx7O0ZVIltMFEiOBdRTrFmUXSz8 Aug 10 17:52:28.907830 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 17:52:28.907830 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 17:52:28.907830 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 17:52:28.907830 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 17:52:28.907830 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 17:52:28.907830 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 17:52:28.907830 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: 2c5baaa1ea3842e6844b2d1c4e40e801 Aug 10 17:52:28.907830 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-VolumesNegativeTest-1835577791 Aug 10 17:52:28.907830 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 17:52:28.907830 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 17:52:28.907830 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2c5baaa1ea3842e6844b2d1c4e40e801"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/2c5baaa1ea3842e6844b2d1c4e40e801"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2c5baaa1ea3842e6844b2d1c4e40e801"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_2c5baaa1ea3842e6844b2d1c4e40e801", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:52:28.907830 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-VolumesNegativeTest-1835577791 Aug 10 17:52:28.907830 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: 2c5baaa1ea3842e6844b2d1c4e40e801 Aug 10 17:52:28.907830 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-VolumesNegativeTest-1835577791 Aug 10 17:52:28.907830 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-VolumesNegativeTest-1835577791-project Aug 10 17:52:28.907830 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 17:52:28.907830 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 17:52:28.907830 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: 4f0ec6deb19f43c38097f1c674b8652c Aug 10 17:52:28.907830 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-VolumesNegativeTest-1835577791-project Aug 10 17:52:28.907830 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:52:28.907830 n-d-852296-2 devstack@n-api.service[129409]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1428694445", "metadata": {"Type": "work"}}} Aug 10 17:52:28.907830 n-d-852296-2 devstack@n-api.service[129409]: method: Aug 10 17:52:28.907830 n-d-852296-2 devstack@n-api.service[129409]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 10 17:52:28.907830 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1428694445', 'metadata': {'Type': 'work'}}}} Aug 10 17:52:28.907830 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:52:28.907830 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:52:28.907830 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 10 17:52:28.907830 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 10 17:52:28.907830 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 10 17:52:28.907830 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise error Aug 10 17:52:28.907830 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 10 17:52:28.907830 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:52:28.907830 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 10 17:52:28.907830 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 10 17:52:28.907830 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:52:28.907830 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 10 17:52:28.907830 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi '' Aug 10 17:52:28.907830 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:52:28.907830 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:52:28.907830 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:52:28.907830 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:52:28.907830 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:52:28.907830 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:52:28.907830 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:52:28.907830 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:52:28.907830 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 17:52:28.907830 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 17:52:28.907830 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:52:28.907830 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:52:28.907830 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 10 17:52:28.907830 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 10 17:52:28.907830 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 10 17:52:28.907830 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 10 17:52:28.907830 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 10 17:52:28.907830 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 10 17:52:28.913880 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 10 17:52:28.913880 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:52:28.913880 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:52:28.913880 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:52:28.913880 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:52:28.913880 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:52:28.913880 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:52:28.913880 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 10 17:52:28.913880 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 10 17:52:28.913880 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 10 17:52:28.913880 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:52:28.916386 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-85c31b36-cbe7-4607-bd4c-43e4a5a2acc5 tempest-VolumesNegativeTest-1835577791 tempest-VolumesNegativeTest-1835577791-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:52:28.919223 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-85c31b36-cbe7-4607-bd4c-43e4a5a2acc5 tempest-VolumesNegativeTest-1835577791 tempest-VolumesNegativeTest-1835577791-project] 10.222.0.50 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.020302 Aug 10 17:52:28.925368 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 400/816] 10.222.0.50 () {60 vars in 1156 bytes} [Wed Aug 10 17:52:28 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 10 17:52:28.931921 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-ba9b686f-9095-437d-be3f-c1851eb9ddd6 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:28.932842 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-ba9b686f-9095-437d-be3f-c1851eb9ddd6 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: f747d5da-322c-4afb-bac6-c614b85656f9] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:28.940572 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-ba9b686f-9095-437d-be3f-c1851eb9ddd6 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:28.941062 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-ba9b686f-9095-437d-be3f-c1851eb9ddd6 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:28.941495 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-ba9b686f-9095-437d-be3f-c1851eb9ddd6 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:28.942209 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-ba9b686f-9095-437d-be3f-c1851eb9ddd6 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:28.942652 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-ba9b686f-9095-437d-be3f-c1851eb9ddd6 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:28.943075 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-ba9b686f-9095-437d-be3f-c1851eb9ddd6 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:29.101978 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-399412a1-48cc-4670-a72c-39e035770d56 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2fd6acf18d4218ad143ccee2d0bb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7c2481a908406fa9c4562513fff665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:29.113303 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-399412a1-48cc-4670-a72c-39e035770d56 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] 10.222.0.50 "GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256" status: 200 len: 1470 microversion: 2.1 time: 0.326249 Aug 10 17:52:29.114271 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 417/817] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:28 2022] GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256 => generated 1470 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:29.120034 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-fe649222-d438-4cb5-be39-a81f851d96ab tempest-VolumesNegativeTest-1835577791 tempest-VolumesNegativeTest-1835577791-project] Calling method '.version_select at 0x7fb346104820>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:29.182717 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-ba9b686f-9095-437d-be3f-c1851eb9ddd6 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:29.195926 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-ba9b686f-9095-437d-be3f-c1851eb9ddd6 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/f747d5da-322c-4afb-bac6-c614b85656f9" status: 200 len: 1317 microversion: 2.1 time: 0.269253 Aug 10 17:52:29.210968 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 401/818] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:28 2022] GET /compute/v2.1/servers/f747d5da-322c-4afb-bac6-c614b85656f9 => generated 1317 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:29.226642 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-fe649222-d438-4cb5-be39-a81f851d96ab tempest-VolumesNegativeTest-1835577791 tempest-VolumesNegativeTest-1835577791-project] HTTP exception thrown: Volume tempest-invalid-801233989 could not be found. Aug 10 17:52:29.230606 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-fe649222-d438-4cb5-be39-a81f851d96ab tempest-VolumesNegativeTest-1835577791 tempest-VolumesNegativeTest-1835577791-project] Request method failure captured: Aug 10 17:52:29.230606 n-d-852296-2 devstack@n-api.service[129410]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-801233989 HTTP/1.1 Aug 10 17:52:29.230606 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 17:52:29.230606 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 17:52:29.230606 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 17:52:29.230606 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 0 Aug 10 17:52:29.230606 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 17:52:29.230606 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 17:52:29.230606 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 17:52:29.230606 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 17:52:29.230606 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8_Bc7wx2SHREHD-g8ZQ7AYhxtd-EiH3UlnxRQS2aIm0-vbvm-Wv2OtXrLWQlw0myIj_HmAA3HxQ_jVUDy57g5wszmmZXsmzsmwBcD5BCe0w4E0qP5mO1AvRRJYTm-BZKx5B_vj69RlVja_tdWxmNZx7O0ZVIltMFEiOBdRTrFmUXSz8 Aug 10 17:52:29.230606 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 17:52:29.230606 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 17:52:29.230606 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 17:52:29.230606 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 17:52:29.230606 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 17:52:29.230606 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 17:52:29.230606 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: 2c5baaa1ea3842e6844b2d1c4e40e801 Aug 10 17:52:29.230606 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-VolumesNegativeTest-1835577791 Aug 10 17:52:29.230606 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 17:52:29.230606 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 17:52:29.230606 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2c5baaa1ea3842e6844b2d1c4e40e801"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/2c5baaa1ea3842e6844b2d1c4e40e801"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2c5baaa1ea3842e6844b2d1c4e40e801"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_2c5baaa1ea3842e6844b2d1c4e40e801", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:52:29.230606 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-VolumesNegativeTest-1835577791 Aug 10 17:52:29.230606 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: 2c5baaa1ea3842e6844b2d1c4e40e801 Aug 10 17:52:29.230606 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-VolumesNegativeTest-1835577791 Aug 10 17:52:29.230606 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-VolumesNegativeTest-1835577791-project Aug 10 17:52:29.230606 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 17:52:29.230606 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 17:52:29.230606 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: 4f0ec6deb19f43c38097f1c674b8652c Aug 10 17:52:29.230606 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-VolumesNegativeTest-1835577791-project Aug 10 17:52:29.230606 n-d-852296-2 devstack@n-api.service[129410]: method: Aug 10 17:52:29.230606 n-d-852296-2 devstack@n-api.service[129410]: exception: Volume tempest-invalid-801233989 could not be found. Aug 10 17:52:29.230606 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'id': 'tempest-invalid-801233989'} Aug 10 17:52:29.230606 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:52:29.230606 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:52:29.230606 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 17:52:29.230606 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 17:52:29.230606 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 10 17:52:29.230606 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 10 17:52:29.230606 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 10 17:52:29.230606 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 10 17:52:29.230606 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 10 17:52:29.230606 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 10 17:52:29.230606 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 10 17:52:29.230606 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 10 17:52:29.230606 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 17:52:29.230606 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 17:52:29.230606 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 17:52:29.230606 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 17:52:29.230606 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-801233989 could not be found. (HTTP 404) (Request-ID: req-bead0644-e709-4f2a-8c66-80024dec8c6d) Aug 10 17:52:29.230606 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:52:29.230606 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:52:29.230606 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:52:29.230606 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:52:29.230606 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 10 17:52:29.230606 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 10 17:52:29.230606 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 10 17:52:29.230606 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 10 17:52:29.230606 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 10 17:52:29.230606 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 10 17:52:29.230606 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 10 17:52:29.230606 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 10 17:52:29.230606 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 17:52:29.234815 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 17:52:29.234815 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 10 17:52:29.234815 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 10 17:52:29.234815 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 10 17:52:29.234815 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 10 17:52:29.234815 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 10 17:52:29.234815 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 10 17:52:29.234815 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 10 17:52:29.234815 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 10 17:52:29.234815 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 17:52:29.234815 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 17:52:29.234815 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 17:52:29.234815 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 17:52:29.234815 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-801233989 could not be found. Aug 10 17:52:29.234815 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:52:29.234815 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:52:29.234815 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:52:29.234815 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:52:29.234815 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:52:29.234815 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:52:29.234815 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:52:29.234815 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:52:29.234815 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 17:52:29.234815 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 17:52:29.234815 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:52:29.234815 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:52:29.234815 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 10 17:52:29.234815 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:52:29.234815 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-801233989 could not be found. Aug 10 17:52:29.234815 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:52:29.234815 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:52:29.234815 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:52:29.234815 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:52:29.234815 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:52:29.234815 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:52:29.234815 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:52:29.234815 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:52:29.234815 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-801233989 could not be found. Aug 10 17:52:29.234815 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:52:29.234815 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-fe649222-d438-4cb5-be39-a81f851d96ab tempest-VolumesNegativeTest-1835577791 tempest-VolumesNegativeTest-1835577791-project] Returning 404 to user: Volume tempest-invalid-801233989 could not be found. {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:52:29.234815 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-fe649222-d438-4cb5-be39-a81f851d96ab tempest-VolumesNegativeTest-1835577791 tempest-VolumesNegativeTest-1835577791-project] 10.222.0.50 "DELETE /compute/v2.1/os-volumes/tempest-invalid-801233989" status: 404 len: 98 microversion: 2.1 time: 0.118145 Aug 10 17:52:29.243263 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 418/819] 10.222.0.50 () {58 vars in 1215 bytes} [Wed Aug 10 17:52:29 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-801233989 => generated 98 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 10 17:52:29.248165 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-11c8ca62-3cce-4d9b-8e64-d946b30e5b8c tempest-VolumesNegativeTest-1835577791 tempest-VolumesNegativeTest-1835577791-project] 10.222.0.50 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004711 Aug 10 17:52:29.249802 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 402/820] 10.222.0.50 () {58 vars in 1140 bytes} [Wed Aug 10 17:52:29 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 10 17:52:29.268866 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-d2ceb18c-b611-417c-9b9f-e98ff13002b5 tempest-VolumesNegativeTest-1835577791 tempest-VolumesNegativeTest-1835577791-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.010562 Aug 10 17:52:29.268866 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 419/821] 10.222.0.50 () {58 vars in 1137 bytes} [Wed Aug 10 17:52:29 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 12 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Aug 10 17:52:29.283364 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-d5146617-6472-48b3-8ff2-d77fdf9666cd tempest-VolumesNegativeTest-1835577791 tempest-VolumesNegativeTest-1835577791-project] Calling method '.version_select at 0x7fb346621940>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:29.294784 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [req-c196b27a-49d5-459f-89e6-7568cb7f9590 req-e559e7f0-8e6b-45f8-956f-a1c9fbe64c76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f747d5da-322c-4afb-bac6-c614b85656f9", "tag": "fdf7ca0a-1e47-4466-96d3-61b2385956a4"}]} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:52:29.325866 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-c196b27a-49d5-459f-89e6-7568cb7f9590 req-e559e7f0-8e6b-45f8-956f-a1c9fbe64c76 service nova] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:29.330069 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-c196b27a-49d5-459f-89e6-7568cb7f9590 req-e559e7f0-8e6b-45f8-956f-a1c9fbe64c76 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:29.330545 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-c196b27a-49d5-459f-89e6-7568cb7f9590 req-e559e7f0-8e6b-45f8-956f-a1c9fbe64c76 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:29.334299 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-d5146617-6472-48b3-8ff2-d77fdf9666cd tempest-VolumesNegativeTest-1835577791 tempest-VolumesNegativeTest-1835577791-project] HTTP exception thrown: Volume e8bb916c-e8b0-4368-8943-bbe7ae9b2df7 could not be found. Aug 10 17:52:29.340808 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-d5146617-6472-48b3-8ff2-d77fdf9666cd tempest-VolumesNegativeTest-1835577791 tempest-VolumesNegativeTest-1835577791-project] Request method failure captured: Aug 10 17:52:29.340808 n-d-852296-2 devstack@n-api.service[129409]: request: DELETE /compute/v2.1/os-volumes/e8bb916c-e8b0-4368-8943-bbe7ae9b2df7 HTTP/1.1 Aug 10 17:52:29.340808 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 17:52:29.340808 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 17:52:29.340808 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 17:52:29.340808 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 0 Aug 10 17:52:29.340808 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 17:52:29.340808 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 17:52:29.340808 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 17:52:29.340808 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 17:52:29.340808 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8_Bc7wx2SHREHD-g8ZQ7AYhxtd-EiH3UlnxRQS2aIm0-vbvm-Wv2OtXrLWQlw0myIj_HmAA3HxQ_jVUDy57g5wszmmZXsmzsmwBcD5BCe0w4E0qP5mO1AvRRJYTm-BZKx5B_vj69RlVja_tdWxmNZx7O0ZVIltMFEiOBdRTrFmUXSz8 Aug 10 17:52:29.340808 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 17:52:29.340808 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 17:52:29.340808 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 17:52:29.340808 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 17:52:29.340808 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 17:52:29.340808 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 17:52:29.340808 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: 2c5baaa1ea3842e6844b2d1c4e40e801 Aug 10 17:52:29.340808 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-VolumesNegativeTest-1835577791 Aug 10 17:52:29.340808 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 17:52:29.340808 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 17:52:29.340808 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2c5baaa1ea3842e6844b2d1c4e40e801"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/2c5baaa1ea3842e6844b2d1c4e40e801"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2c5baaa1ea3842e6844b2d1c4e40e801"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_2c5baaa1ea3842e6844b2d1c4e40e801", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:52:29.340808 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-VolumesNegativeTest-1835577791 Aug 10 17:52:29.340808 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: 2c5baaa1ea3842e6844b2d1c4e40e801 Aug 10 17:52:29.340808 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-VolumesNegativeTest-1835577791 Aug 10 17:52:29.340808 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-VolumesNegativeTest-1835577791-project Aug 10 17:52:29.340808 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 17:52:29.340808 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 17:52:29.340808 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: 4f0ec6deb19f43c38097f1c674b8652c Aug 10 17:52:29.340808 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-VolumesNegativeTest-1835577791-project Aug 10 17:52:29.340808 n-d-852296-2 devstack@n-api.service[129409]: method: Aug 10 17:52:29.340808 n-d-852296-2 devstack@n-api.service[129409]: exception: Volume e8bb916c-e8b0-4368-8943-bbe7ae9b2df7 could not be found. Aug 10 17:52:29.340808 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'id': 'e8bb916c-e8b0-4368-8943-bbe7ae9b2df7'} Aug 10 17:52:29.340808 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:52:29.340808 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:52:29.340808 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 17:52:29.340808 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 17:52:29.340808 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 10 17:52:29.340808 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 10 17:52:29.340808 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 10 17:52:29.340808 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 10 17:52:29.340808 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 10 17:52:29.340808 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 10 17:52:29.340808 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 10 17:52:29.340808 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 10 17:52:29.340808 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 17:52:29.340808 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 17:52:29.340808 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 17:52:29.340808 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 17:52:29.340808 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e8bb916c-e8b0-4368-8943-bbe7ae9b2df7 could not be found. (HTTP 404) (Request-ID: req-69074841-4ed5-4bbe-bda3-1aedaec5edf1) Aug 10 17:52:29.340808 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:52:29.340808 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:52:29.340808 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:52:29.340808 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:52:29.340808 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 10 17:52:29.340808 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 10 17:52:29.340808 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 10 17:52:29.340808 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 10 17:52:29.340808 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 10 17:52:29.340808 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 10 17:52:29.340808 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 10 17:52:29.340808 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 10 17:52:29.340808 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 17:52:29.346081 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 17:52:29.346081 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 10 17:52:29.346081 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 10 17:52:29.346081 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 10 17:52:29.346081 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 10 17:52:29.346081 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 10 17:52:29.346081 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 10 17:52:29.346081 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 10 17:52:29.346081 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 10 17:52:29.346081 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 17:52:29.346081 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 17:52:29.346081 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 17:52:29.346081 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 17:52:29.346081 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e8bb916c-e8b0-4368-8943-bbe7ae9b2df7 could not be found. Aug 10 17:52:29.346081 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:52:29.346081 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:52:29.346081 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:52:29.346081 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:52:29.346081 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:52:29.346081 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:52:29.346081 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:52:29.346081 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:52:29.346081 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 17:52:29.346081 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 17:52:29.346081 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:52:29.346081 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:52:29.346081 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 10 17:52:29.346081 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:52:29.346081 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e8bb916c-e8b0-4368-8943-bbe7ae9b2df7 could not be found. Aug 10 17:52:29.346081 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:52:29.346081 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:52:29.346081 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:52:29.346081 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:52:29.346081 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:52:29.346081 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:52:29.346081 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:52:29.346081 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:52:29.346081 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e8bb916c-e8b0-4368-8943-bbe7ae9b2df7 could not be found. Aug 10 17:52:29.346081 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:52:29.351260 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-d5146617-6472-48b3-8ff2-d77fdf9666cd tempest-VolumesNegativeTest-1835577791 tempest-VolumesNegativeTest-1835577791-project] Returning 404 to user: Volume e8bb916c-e8b0-4368-8943-bbe7ae9b2df7 could not be found. {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:52:29.352462 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-d5146617-6472-48b3-8ff2-d77fdf9666cd tempest-VolumesNegativeTest-1835577791 tempest-VolumesNegativeTest-1835577791-project] 10.222.0.50 "DELETE /compute/v2.1/os-volumes/e8bb916c-e8b0-4368-8943-bbe7ae9b2df7" status: 404 len: 109 microversion: 2.1 time: 0.075686 Aug 10 17:52:29.353146 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 403/822] 10.222.0.50 () {58 vars in 1248 bytes} [Wed Aug 10 17:52:29 2022] DELETE /compute/v2.1/os-volumes/e8bb916c-e8b0-4368-8943-bbe7ae9b2df7 => generated 109 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:52:29.358721 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.compute.server_external_events [req-c196b27a-49d5-459f-89e6-7568cb7f9590 req-e559e7f0-8e6b-45f8-956f-a1c9fbe64c76 service nova] Creating event network-changed:fdf7ca0a-1e47-4466-96d3-61b2385956a4 for instance f747d5da-322c-4afb-bac6-c614b85656f9 on n-h2-852296-2 Aug 10 17:52:29.374399 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [req-c196b27a-49d5-459f-89e6-7568cb7f9590 req-e559e7f0-8e6b-45f8-956f-a1c9fbe64c76 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082857 Aug 10 17:52:29.375521 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 420/823] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 10 17:52:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:52:29.383890 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-b4e136c3-1792-438c-a953-78aa04874b9d tempest-VolumesNegativeTest-1835577791 tempest-VolumesNegativeTest-1835577791-project] Calling method '.version_select at 0x7fb346321820>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:29.457696 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-b4e136c3-1792-438c-a953-78aa04874b9d tempest-VolumesNegativeTest-1835577791 tempest-VolumesNegativeTest-1835577791-project] HTTP exception thrown: Volume 4acf3386-92ee-4a0e-b152-b834b45e737f could not be found. Aug 10 17:52:29.460784 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-b4e136c3-1792-438c-a953-78aa04874b9d tempest-VolumesNegativeTest-1835577791 tempest-VolumesNegativeTest-1835577791-project] Request method failure captured: Aug 10 17:52:29.460784 n-d-852296-2 devstack@n-api.service[129409]: request: GET /compute/v2.1/os-volumes/4acf3386-92ee-4a0e-b152-b834b45e737f HTTP/1.1 Aug 10 17:52:29.460784 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 17:52:29.460784 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 17:52:29.460784 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 17:52:29.460784 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 0 Aug 10 17:52:29.460784 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 17:52:29.460784 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 17:52:29.460784 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 17:52:29.460784 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 17:52:29.460784 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8_Bc7wx2SHREHD-g8ZQ7AYhxtd-EiH3UlnxRQS2aIm0-vbvm-Wv2OtXrLWQlw0myIj_HmAA3HxQ_jVUDy57g5wszmmZXsmzsmwBcD5BCe0w4E0qP5mO1AvRRJYTm-BZKx5B_vj69RlVja_tdWxmNZx7O0ZVIltMFEiOBdRTrFmUXSz8 Aug 10 17:52:29.460784 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 17:52:29.460784 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 17:52:29.460784 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 17:52:29.460784 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 17:52:29.460784 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 17:52:29.460784 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 17:52:29.460784 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: 2c5baaa1ea3842e6844b2d1c4e40e801 Aug 10 17:52:29.460784 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-VolumesNegativeTest-1835577791 Aug 10 17:52:29.460784 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 17:52:29.460784 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 17:52:29.460784 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2c5baaa1ea3842e6844b2d1c4e40e801"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/2c5baaa1ea3842e6844b2d1c4e40e801"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2c5baaa1ea3842e6844b2d1c4e40e801"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_2c5baaa1ea3842e6844b2d1c4e40e801", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:52:29.460784 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-VolumesNegativeTest-1835577791 Aug 10 17:52:29.460784 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: 2c5baaa1ea3842e6844b2d1c4e40e801 Aug 10 17:52:29.460784 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-VolumesNegativeTest-1835577791 Aug 10 17:52:29.460784 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-VolumesNegativeTest-1835577791-project Aug 10 17:52:29.460784 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 17:52:29.460784 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 17:52:29.460784 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: 4f0ec6deb19f43c38097f1c674b8652c Aug 10 17:52:29.460784 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-VolumesNegativeTest-1835577791-project Aug 10 17:52:29.460784 n-d-852296-2 devstack@n-api.service[129409]: method: Aug 10 17:52:29.460784 n-d-852296-2 devstack@n-api.service[129409]: exception: Volume 4acf3386-92ee-4a0e-b152-b834b45e737f could not be found. Aug 10 17:52:29.460784 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'id': '4acf3386-92ee-4a0e-b152-b834b45e737f'} Aug 10 17:52:29.460784 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:52:29.460784 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:52:29.460784 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 17:52:29.460784 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 17:52:29.460784 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 10 17:52:29.460784 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 10 17:52:29.460784 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 10 17:52:29.460784 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 10 17:52:29.460784 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 17:52:29.460784 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 17:52:29.460784 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 17:52:29.460784 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 17:52:29.460784 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 17:52:29.460784 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 17:52:29.460784 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 17:52:29.460784 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 17:52:29.460784 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4acf3386-92ee-4a0e-b152-b834b45e737f could not be found. (HTTP 404) (Request-ID: req-83b71d3d-71d5-49bc-aecc-9a65cc686e23) Aug 10 17:52:29.460784 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:52:29.460784 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:52:29.460784 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:52:29.460784 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:52:29.460784 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 10 17:52:29.460784 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 10 17:52:29.460784 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 10 17:52:29.460784 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 10 17:52:29.460784 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 10 17:52:29.460784 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 10 17:52:29.460784 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 10 17:52:29.460784 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 10 17:52:29.460784 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 17:52:29.466836 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 17:52:29.466836 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 10 17:52:29.466836 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 10 17:52:29.466836 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 10 17:52:29.466836 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 10 17:52:29.466836 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 17:52:29.466836 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 17:52:29.466836 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 17:52:29.466836 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 17:52:29.466836 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 17:52:29.466836 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 17:52:29.466836 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 17:52:29.466836 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 17:52:29.466836 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4acf3386-92ee-4a0e-b152-b834b45e737f could not be found. Aug 10 17:52:29.466836 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:52:29.466836 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:52:29.466836 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:52:29.466836 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:52:29.466836 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:52:29.466836 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:52:29.466836 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:52:29.466836 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:52:29.466836 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 17:52:29.466836 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 17:52:29.466836 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:52:29.466836 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:52:29.466836 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 10 17:52:29.466836 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:52:29.466836 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4acf3386-92ee-4a0e-b152-b834b45e737f could not be found. Aug 10 17:52:29.466836 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:52:29.466836 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:52:29.466836 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:52:29.466836 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:52:29.466836 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:52:29.466836 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:52:29.466836 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:52:29.466836 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:52:29.466836 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4acf3386-92ee-4a0e-b152-b834b45e737f could not be found. Aug 10 17:52:29.466836 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:52:29.466836 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-b4e136c3-1792-438c-a953-78aa04874b9d tempest-VolumesNegativeTest-1835577791 tempest-VolumesNegativeTest-1835577791-project] Returning 404 to user: Volume 4acf3386-92ee-4a0e-b152-b834b45e737f could not be found. {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:52:29.466836 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-b4e136c3-1792-438c-a953-78aa04874b9d tempest-VolumesNegativeTest-1835577791 tempest-VolumesNegativeTest-1835577791-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/4acf3386-92ee-4a0e-b152-b834b45e737f" status: 404 len: 109 microversion: 2.1 time: 0.103945 Aug 10 17:52:29.466836 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 404/824] 10.222.0.50 () {58 vars in 1245 bytes} [Wed Aug 10 17:52:29 2022] GET /compute/v2.1/os-volumes/4acf3386-92ee-4a0e-b152-b834b45e737f => generated 109 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 17:52:29.651470 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_cell0:SELECT=12 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:52:29.657905 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-6438427c-49f2-4805-a65f-cf7934aa9f2c tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:29.658636 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-6438427c-49f2-4805-a65f-cf7934aa9f2c tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] [instance: 6fffb7a0-b963-4fdc-8f5d-0fe046c6a7ed] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:29.668890 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-6438427c-49f2-4805-a65f-cf7934aa9f2c tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:29.668890 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-6438427c-49f2-4805-a65f-cf7934aa9f2c tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:29.668890 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-6438427c-49f2-4805-a65f-cf7934aa9f2c tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:29.669440 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-6438427c-49f2-4805-a65f-cf7934aa9f2c tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:29.670164 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-6438427c-49f2-4805-a65f-cf7934aa9f2c tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:29.671438 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-6438427c-49f2-4805-a65f-cf7934aa9f2c tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:29.816575 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-52fc3e80-64f0-4dec-b1ad-d15ed23f18a4 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:29.819590 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-52fc3e80-64f0-4dec-b1ad-d15ed23f18a4 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] [instance: 3ca0b504-e928-4d31-be09-24a70200eff2] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:29.831839 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-52fc3e80-64f0-4dec-b1ad-d15ed23f18a4 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:29.834900 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-52fc3e80-64f0-4dec-b1ad-d15ed23f18a4 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:29.835301 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-52fc3e80-64f0-4dec-b1ad-d15ed23f18a4 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:29.835949 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-52fc3e80-64f0-4dec-b1ad-d15ed23f18a4 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:29.836616 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-52fc3e80-64f0-4dec-b1ad-d15ed23f18a4 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:29.837083 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-52fc3e80-64f0-4dec-b1ad-d15ed23f18a4 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:29.854996 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-6438427c-49f2-4805-a65f-cf7934aa9f2c tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e109c3dcd0574faaa3d7ec31dd4edd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48bbb92998f54ebeb624bc794d406896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:29.868096 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-6438427c-49f2-4805-a65f-cf7934aa9f2c tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] 10.222.0.50 "GET /compute/v2.1/servers/6fffb7a0-b963-4fdc-8f5d-0fe046c6a7ed" status: 200 len: 1312 microversion: 2.1 time: 0.217506 Aug 10 17:52:29.884341 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 421/825] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:29 2022] GET /compute/v2.1/servers/6fffb7a0-b963-4fdc-8f5d-0fe046c6a7ed => generated 1312 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:29.927470 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-828ebbfa-c1d7-4fd6-b81b-799f690b1ab0 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:29.928422 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-828ebbfa-c1d7-4fd6-b81b-799f690b1ab0 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] [instance: e2777988-0bbf-496c-9c97-b206dbc94a62] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:29.941692 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-828ebbfa-c1d7-4fd6-b81b-799f690b1ab0 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:29.942181 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-828ebbfa-c1d7-4fd6-b81b-799f690b1ab0 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:29.942801 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-828ebbfa-c1d7-4fd6-b81b-799f690b1ab0 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:29.943793 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-828ebbfa-c1d7-4fd6-b81b-799f690b1ab0 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:29.944716 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-828ebbfa-c1d7-4fd6-b81b-799f690b1ab0 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:29.945321 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-828ebbfa-c1d7-4fd6-b81b-799f690b1ab0 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:29.988298 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-52fc3e80-64f0-4dec-b1ad-d15ed23f18a4 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83a3e198e21476eb12fcf417aea62de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df088e5a610436ea21b8a360e2bb527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:30.007230 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-52fc3e80-64f0-4dec-b1ad-d15ed23f18a4 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] 10.222.0.50 "GET /compute/v2.1/servers/3ca0b504-e928-4d31-be09-24a70200eff2" status: 200 len: 1280 microversion: 2.1 time: 0.195029 Aug 10 17:52:30.011214 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 405/826] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:29 2022] GET /compute/v2.1/servers/3ca0b504-e928-4d31-be09-24a70200eff2 => generated 1280 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:52:30.031093 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-828ebbfa-c1d7-4fd6-b81b-799f690b1ab0 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:30.041024 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-828ebbfa-c1d7-4fd6-b81b-799f690b1ab0 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:30.042808 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-828ebbfa-c1d7-4fd6-b81b-799f690b1ab0 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:30.049191 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-828ebbfa-c1d7-4fd6-b81b-799f690b1ab0 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] 10.222.0.50 "GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62" status: 200 len: 1445 microversion: 2.75 time: 0.125855 Aug 10 17:52:30.058884 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 422/827] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:52:29 2022] GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62 => generated 1445 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:52:30.138656 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-cd9fd414-811f-4905-875e-7026361b0827 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:30.139752 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-cd9fd414-811f-4905-875e-7026361b0827 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] [instance: bee3148a-3834-41bd-99e7-b5da75217256] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:30.183972 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-cd9fd414-811f-4905-875e-7026361b0827 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:30.185288 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-cd9fd414-811f-4905-875e-7026361b0827 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:30.188067 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-cd9fd414-811f-4905-875e-7026361b0827 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:30.189069 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-cd9fd414-811f-4905-875e-7026361b0827 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:30.195366 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-cd9fd414-811f-4905-875e-7026361b0827 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:30.202422 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-cd9fd414-811f-4905-875e-7026361b0827 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:30.218442 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-29b5b532-18de-407e-b37b-f7b70c92fe1f tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:30.219337 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-29b5b532-18de-407e-b37b-f7b70c92fe1f tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: f747d5da-322c-4afb-bac6-c614b85656f9] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:30.228739 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-29b5b532-18de-407e-b37b-f7b70c92fe1f tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:30.241034 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-29b5b532-18de-407e-b37b-f7b70c92fe1f tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:30.241034 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-29b5b532-18de-407e-b37b-f7b70c92fe1f tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:30.241034 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-29b5b532-18de-407e-b37b-f7b70c92fe1f tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:30.241034 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-29b5b532-18de-407e-b37b-f7b70c92fe1f tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:30.241034 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-29b5b532-18de-407e-b37b-f7b70c92fe1f tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:30.457157 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-cd9fd414-811f-4905-875e-7026361b0827 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2fd6acf18d4218ad143ccee2d0bb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7c2481a908406fa9c4562513fff665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:30.466657 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-cd9fd414-811f-4905-875e-7026361b0827 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] 10.222.0.50 "GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256" status: 200 len: 1470 microversion: 2.1 time: 0.335225 Aug 10 17:52:30.468279 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 406/828] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:30 2022] GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256 => generated 1470 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:52:30.496591 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-29b5b532-18de-407e-b37b-f7b70c92fe1f tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:30.506764 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-29b5b532-18de-407e-b37b-f7b70c92fe1f tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/f747d5da-322c-4afb-bac6-c614b85656f9" status: 200 len: 1317 microversion: 2.1 time: 0.293086 Aug 10 17:52:30.507850 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 423/829] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:30 2022] GET /compute/v2.1/servers/f747d5da-322c-4afb-bac6-c614b85656f9 => generated 1317 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:52:30.891484 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-457f0a3e-b96f-4758-8b1d-e0fb48df7994 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:30.892515 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-457f0a3e-b96f-4758-8b1d-e0fb48df7994 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] [instance: 6fffb7a0-b963-4fdc-8f5d-0fe046c6a7ed] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:30.911087 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-457f0a3e-b96f-4758-8b1d-e0fb48df7994 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:30.911591 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-457f0a3e-b96f-4758-8b1d-e0fb48df7994 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:30.913276 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-457f0a3e-b96f-4758-8b1d-e0fb48df7994 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:30.915244 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-457f0a3e-b96f-4758-8b1d-e0fb48df7994 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:30.915883 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-457f0a3e-b96f-4758-8b1d-e0fb48df7994 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:30.916747 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-457f0a3e-b96f-4758-8b1d-e0fb48df7994 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:31.039507 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-3a71a369-9d27-4539-9568-25272605e9fc tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:31.040097 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-3a71a369-9d27-4539-9568-25272605e9fc tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] [instance: 3ca0b504-e928-4d31-be09-24a70200eff2] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:31.050131 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-3a71a369-9d27-4539-9568-25272605e9fc tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:31.050900 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-3a71a369-9d27-4539-9568-25272605e9fc tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:31.051054 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-3a71a369-9d27-4539-9568-25272605e9fc tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:31.051746 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-3a71a369-9d27-4539-9568-25272605e9fc tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:31.052199 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-3a71a369-9d27-4539-9568-25272605e9fc tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:31.052649 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-3a71a369-9d27-4539-9568-25272605e9fc tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:31.228106 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-3a71a369-9d27-4539-9568-25272605e9fc tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83a3e198e21476eb12fcf417aea62de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df088e5a610436ea21b8a360e2bb527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:31.239618 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-3a71a369-9d27-4539-9568-25272605e9fc tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] 10.222.0.50 "GET /compute/v2.1/servers/3ca0b504-e928-4d31-be09-24a70200eff2" status: 200 len: 1322 microversion: 2.1 time: 0.205678 Aug 10 17:52:31.242572 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-457f0a3e-b96f-4758-8b1d-e0fb48df7994 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e109c3dcd0574faaa3d7ec31dd4edd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48bbb92998f54ebeb624bc794d406896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:31.253455 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 424/830] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:31 2022] GET /compute/v2.1/servers/3ca0b504-e928-4d31-be09-24a70200eff2 => generated 1322 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:52:31.258320 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-457f0a3e-b96f-4758-8b1d-e0fb48df7994 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] 10.222.0.50 "GET /compute/v2.1/servers/6fffb7a0-b963-4fdc-8f5d-0fe046c6a7ed" status: 200 len: 1312 microversion: 2.1 time: 0.371317 Aug 10 17:52:31.260171 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-e37f4e25-23e9-4f52-b9f2-692e94acb24e tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:31.260998 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-e37f4e25-23e9-4f52-b9f2-692e94acb24e tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] [instance: e2777988-0bbf-496c-9c97-b206dbc94a62] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:31.269981 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e37f4e25-23e9-4f52-b9f2-692e94acb24e tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:31.270733 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e37f4e25-23e9-4f52-b9f2-692e94acb24e tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:31.271416 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e37f4e25-23e9-4f52-b9f2-692e94acb24e tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:31.271590 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 407/831] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:30 2022] GET /compute/v2.1/servers/6fffb7a0-b963-4fdc-8f5d-0fe046c6a7ed => generated 1312 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:31.272646 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e37f4e25-23e9-4f52-b9f2-692e94acb24e tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:31.273282 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e37f4e25-23e9-4f52-b9f2-692e94acb24e tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:31.274020 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e37f4e25-23e9-4f52-b9f2-692e94acb24e tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:31.346144 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-e37f4e25-23e9-4f52-b9f2-692e94acb24e tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:31.355534 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-e37f4e25-23e9-4f52-b9f2-692e94acb24e tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:31.366412 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-e37f4e25-23e9-4f52-b9f2-692e94acb24e tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:31.366412 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-e37f4e25-23e9-4f52-b9f2-692e94acb24e tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] 10.222.0.50 "GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62" status: 200 len: 1445 microversion: 2.75 time: 0.109145 Aug 10 17:52:31.366412 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 425/832] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:52:31 2022] GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62 => generated 1445 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:52:31.491218 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-7ef1f724-6fe6-4489-8fc8-0f7e871ebbd6 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:31.492464 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-7ef1f724-6fe6-4489-8fc8-0f7e871ebbd6 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] [instance: bee3148a-3834-41bd-99e7-b5da75217256] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:31.501907 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:52:31.503651 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7ef1f724-6fe6-4489-8fc8-0f7e871ebbd6 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:31.507108 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7ef1f724-6fe6-4489-8fc8-0f7e871ebbd6 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:31.507640 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7ef1f724-6fe6-4489-8fc8-0f7e871ebbd6 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:31.508483 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7ef1f724-6fe6-4489-8fc8-0f7e871ebbd6 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:31.509016 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7ef1f724-6fe6-4489-8fc8-0f7e871ebbd6 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:31.509703 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7ef1f724-6fe6-4489-8fc8-0f7e871ebbd6 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:31.528015 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-8eafb738-d8d3-4a02-a751-10eac14a852b tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:31.528695 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-8eafb738-d8d3-4a02-a751-10eac14a852b tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: f747d5da-322c-4afb-bac6-c614b85656f9] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:31.535626 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-8eafb738-d8d3-4a02-a751-10eac14a852b tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:31.537477 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-8eafb738-d8d3-4a02-a751-10eac14a852b tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:31.537974 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-8eafb738-d8d3-4a02-a751-10eac14a852b tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:31.538699 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-8eafb738-d8d3-4a02-a751-10eac14a852b tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:31.539163 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-8eafb738-d8d3-4a02-a751-10eac14a852b tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:31.539582 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-8eafb738-d8d3-4a02-a751-10eac14a852b tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:31.698959 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-7ef1f724-6fe6-4489-8fc8-0f7e871ebbd6 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2fd6acf18d4218ad143ccee2d0bb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7c2481a908406fa9c4562513fff665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:31.712368 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-7ef1f724-6fe6-4489-8fc8-0f7e871ebbd6 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] 10.222.0.50 "GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256" status: 200 len: 1470 microversion: 2.1 time: 0.223881 Aug 10 17:52:31.712368 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 408/833] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:31 2022] GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256 => generated 1470 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:31.712597 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-8eafb738-d8d3-4a02-a751-10eac14a852b tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:31.724698 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [req-07c81bca-ad3e-4535-b172-034272ae1bf2 req-11b409a2-7823-4ec2-999e-ca9d4430347c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ca0b504-e928-4d31-be09-24a70200eff2", "tag": "40ddb24b-0be9-4b22-93f8-5f65c2504414"}]} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:52:31.727707 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-8eafb738-d8d3-4a02-a751-10eac14a852b tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/f747d5da-322c-4afb-bac6-c614b85656f9" status: 200 len: 1317 microversion: 2.1 time: 0.197470 Aug 10 17:52:31.728406 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 426/834] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:31 2022] GET /compute/v2.1/servers/f747d5da-322c-4afb-bac6-c614b85656f9 => generated 1317 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:52:31.739062 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-07c81bca-ad3e-4535-b172-034272ae1bf2 req-11b409a2-7823-4ec2-999e-ca9d4430347c service nova] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:31.739638 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-07c81bca-ad3e-4535-b172-034272ae1bf2 req-11b409a2-7823-4ec2-999e-ca9d4430347c service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:31.740204 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-07c81bca-ad3e-4535-b172-034272ae1bf2 req-11b409a2-7823-4ec2-999e-ca9d4430347c service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:31.752664 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.compute.server_external_events [req-07c81bca-ad3e-4535-b172-034272ae1bf2 req-11b409a2-7823-4ec2-999e-ca9d4430347c service nova] Creating event network-changed:40ddb24b-0be9-4b22-93f8-5f65c2504414 for instance 3ca0b504-e928-4d31-be09-24a70200eff2 on n-h1-852296-2 Aug 10 17:52:31.758082 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [req-07c81bca-ad3e-4535-b172-034272ae1bf2 req-11b409a2-7823-4ec2-999e-ca9d4430347c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047086 Aug 10 17:52:31.759005 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 409/835] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 10 17:52:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:52:32.042545 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-d1a6bc03-c6fe-402a-bef8-bdb64883f630 tempest-LiveMigrationTest-599680963 tempest-LiveMigrationTest-599680963-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1080417683", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "623c412b-148c-4a37-96d8-0a1f84e37887"}], "block_device_mapping_v2": [{"uuid": "5adfa031-f817-4f73-b484-d951b46e2c44", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:52:32.119856 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.network.neutron [None req-d1a6bc03-c6fe-402a-bef8-bdb64883f630 tempest-LiveMigrationTest-599680963 tempest-LiveMigrationTest-599680963-project] validate_networks() for [('623c412b-148c-4a37-96d8-0a1f84e37887', None, None, None, None, None)] {{(pid=129410) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 17:52:32.266560 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-8110ff5e-7850-429b-89f1-c93f3352e954 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:32.267580 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-8110ff5e-7850-429b-89f1-c93f3352e954 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] [instance: 3ca0b504-e928-4d31-be09-24a70200eff2] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:32.270175 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_cell0:SELECT=12 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:52:32.287791 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-8110ff5e-7850-429b-89f1-c93f3352e954 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:32.288628 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-8110ff5e-7850-429b-89f1-c93f3352e954 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:32.289247 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-8110ff5e-7850-429b-89f1-c93f3352e954 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:32.290165 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-8110ff5e-7850-429b-89f1-c93f3352e954 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:32.290623 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-8110ff5e-7850-429b-89f1-c93f3352e954 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:32.291707 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-8110ff5e-7850-429b-89f1-c93f3352e954 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:32.311614 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_cell0:SELECT=22 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:52:32.363640 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [None req-d1a6bc03-c6fe-402a-bef8-bdb64883f630 tempest-LiveMigrationTest-599680963 tempest-LiveMigrationTest-599680963-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-f80aa54e-a484-4db1-97e6-70b5dc0894fe) Aug 10 17:52:32.363640 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:52:32.363640 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:52:32.363640 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:52:32.363640 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:52:32.363640 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:52:32.363640 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:52:32.363640 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:52:32.363640 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:52:32.363640 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:52:32.363640 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 17:52:32.363640 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 17:52:32.363640 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 17:52:32.363640 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 17:52:32.363640 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 17:52:32.363640 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 17:52:32.363640 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 17:52:32.363640 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 17:52:32.363640 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 17:52:32.363640 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 17:52:32.363640 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 17:52:32.363640 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 17:52:32.363640 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 17:52:32.363640 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 17:52:32.363640 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 17:52:32.363640 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 17:52:32.363640 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 17:52:32.363640 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:52:32.363640 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:52:32.363640 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 17:52:32.363640 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 17:52:32.363640 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:52:32.363640 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:52:32.363640 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:52:32.363640 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:52:32.363640 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:52:32.363640 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:52:32.363640 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:52:32.363640 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:52:32.363640 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:52:32.363640 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:52:32.363640 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 17:52:32.363640 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 17:52:32.363640 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 17:52:32.363640 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 17:52:32.363640 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 17:52:32.363640 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 17:52:32.363640 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 17:52:32.363640 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 17:52:32.363640 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 17:52:32.363640 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 17:52:32.363640 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 17:52:32.363640 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 17:52:32.368543 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 17:52:32.368543 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 17:52:32.368543 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 17:52:32.368543 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 17:52:32.368543 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 17:52:32.368543 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 17:52:32.368543 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 17:52:32.368543 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 17:52:32.368543 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 17:52:32.368543 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 17:52:32.368543 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 17:52:32.368543 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 17:52:32.368543 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 17:52:32.368543 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 17:52:32.368543 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-f80aa54e-a484-4db1-97e6-70b5dc0894fe) Aug 10 17:52:32.368543 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:52:32.368543 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-d1a6bc03-c6fe-402a-bef8-bdb64883f630 tempest-LiveMigrationTest-599680963 tempest-LiveMigrationTest-599680963-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:52:32.368543 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 17:52:32.368543 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-d1a6bc03-c6fe-402a-bef8-bdb64883f630 tempest-LiveMigrationTest-599680963 tempest-LiveMigrationTest-599680963-project] Request method failure captured: Aug 10 17:52:32.368543 n-d-852296-2 devstack@n-api.service[129410]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 17:52:32.368543 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 17:52:32.368543 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 17:52:32.368543 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 17:52:32.368543 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 349 Aug 10 17:52:32.368543 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 17:52:32.368543 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 17:52:32.368543 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 17:52:32.368543 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 17:52:32.368543 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8_AO3YZ0wNOhHSEtDBEZBVvtYn7m6Qn_F_DYGySZEUrfUaziWiB7goSICh-3pRLhBRcEAIanjg5W_oTgET_b2RlFYHQdLGmCYcb8a6bIZVqdupYVhdSkNWUTJ-LpZ5JXV49BiMsKoTfQpe-UPgKB-l6zUjTDW3HDMYqVsazAtUHA70M Aug 10 17:52:32.368543 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 17:52:32.368543 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 17:52:32.368543 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 17:52:32.368543 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 17:52:32.368543 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 17:52:32.368543 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 17:52:32.368543 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: c330e5bdaec74dbca34fe733a9d9d2f7 Aug 10 17:52:32.368543 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-LiveMigrationTest-599680963 Aug 10 17:52:32.368543 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 17:52:32.368543 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 17:52:32.368543 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c330e5bdaec74dbca34fe733a9d9d2f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c330e5bdaec74dbca34fe733a9d9d2f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c330e5bdaec74dbca34fe733a9d9d2f7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c330e5bdaec74dbca34fe733a9d9d2f7", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:52:32.368543 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-LiveMigrationTest-599680963 Aug 10 17:52:32.368543 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: c330e5bdaec74dbca34fe733a9d9d2f7 Aug 10 17:52:32.368543 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-LiveMigrationTest-599680963 Aug 10 17:52:32.368543 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-LiveMigrationTest-599680963-project Aug 10 17:52:32.368543 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 17:52:32.368543 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 17:52:32.368543 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: f3bca1f64dd44e6bb6e1427d5e28075f Aug 10 17:52:32.368543 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-LiveMigrationTest-599680963-project Aug 10 17:52:32.368543 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 17:52:32.368543 n-d-852296-2 devstack@n-api.service[129410]: {"server": {"name": "tempest-LiveMigrationTest-server-1080417683", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "623c412b-148c-4a37-96d8-0a1f84e37887"}], "block_device_mapping_v2": [{"uuid": "5adfa031-f817-4f73-b484-d951b46e2c44", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} Aug 10 17:52:32.368543 n-d-852296-2 devstack@n-api.service[129410]: method: > Aug 10 17:52:32.368543 n-d-852296-2 devstack@n-api.service[129410]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:52:32.368543 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 17:52:32.375898 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'body': {'server': {'name': 'tempest-LiveMigrationTest-server-1080417683', 'imageRef': '', 'flavorRef': '452', 'networks': [{'uuid': '623c412b-148c-4a37-96d8-0a1f84e37887'}], 'block_device_mapping_v2': [{'source_type': 'volume', 'destination_type': 'volume', 'boot_index': 0, 'delete_on_termination': True, 'volume_id': '5adfa031-f817-4f73-b484-d951b46e2c44'}]}}} Aug 10 17:52:32.375898 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:52:32.375898 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:52:32.375898 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:52:32.375898 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:52:32.375898 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:52:32.375898 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:52:32.375898 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:52:32.375898 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:52:32.375898 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:52:32.375898 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:52:32.375898 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 17:52:32.375898 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 17:52:32.375898 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 17:52:32.375898 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 17:52:32.375898 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 17:52:32.375898 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 17:52:32.375898 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 17:52:32.375898 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 17:52:32.375898 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 17:52:32.375898 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 17:52:32.375898 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 17:52:32.375898 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 17:52:32.375898 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 17:52:32.375898 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 17:52:32.375898 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 17:52:32.375898 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 17:52:32.375898 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 17:52:32.375898 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:52:32.375898 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:52:32.375898 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 17:52:32.375898 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 17:52:32.375898 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:52:32.375898 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:52:32.375898 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:52:32.375898 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:52:32.375898 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:52:32.375898 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:52:32.375898 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:52:32.375898 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:52:32.375898 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:52:32.375898 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:52:32.375898 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 17:52:32.375898 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 17:52:32.375898 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 17:52:32.375898 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 17:52:32.375898 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 17:52:32.375898 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 17:52:32.375898 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 17:52:32.375898 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 17:52:32.375898 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 17:52:32.375898 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 17:52:32.375898 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 17:52:32.375898 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 17:52:32.381159 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 17:52:32.381159 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 17:52:32.381159 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 17:52:32.381159 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 17:52:32.381159 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 17:52:32.381159 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 17:52:32.381159 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 17:52:32.381159 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 17:52:32.381159 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 17:52:32.381159 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 17:52:32.381159 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 17:52:32.381159 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 17:52:32.381159 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 17:52:32.381159 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 17:52:32.381159 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-f80aa54e-a484-4db1-97e6-70b5dc0894fe) Aug 10 17:52:32.381159 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:52:32.381159 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:52:32.381159 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:52:32.381159 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:52:32.381159 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:52:32.381159 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:52:32.381159 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:52:32.381159 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:52:32.381159 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 10 17:52:32.381159 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 10 17:52:32.381159 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:52:32.381159 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:52:32.381159 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:52:32.381159 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:52:32.381159 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:52:32.381159 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:52:32.381159 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:52:32.381159 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:52:32.381159 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:52:32.381159 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:52:32.381159 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:52:32.381159 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:52:32.381159 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:52:32.381159 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-d1a6bc03-c6fe-402a-bef8-bdb64883f630 tempest-LiveMigrationTest-599680963 tempest-LiveMigrationTest-599680963-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:52:32.381159 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:52:32.381159 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-d1a6bc03-c6fe-402a-bef8-bdb64883f630 tempest-LiveMigrationTest-599680963 tempest-LiveMigrationTest-599680963-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.325172 Aug 10 17:52:32.381159 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 427/836] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 17:52:32 2022] POST /compute/v2.1/servers => generated 214 bytes in 326 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 10 17:52:32.381159 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-0d6bd9ea-3abd-4863-968a-90d921496ae6 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:32.381159 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-0d6bd9ea-3abd-4863-968a-90d921496ae6 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] [instance: 6fffb7a0-b963-4fdc-8f5d-0fe046c6a7ed] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:32.388758 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-0d6bd9ea-3abd-4863-968a-90d921496ae6 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:32.389449 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-0d6bd9ea-3abd-4863-968a-90d921496ae6 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:32.390351 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-0d6bd9ea-3abd-4863-968a-90d921496ae6 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:32.391190 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-0d6bd9ea-3abd-4863-968a-90d921496ae6 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:32.391683 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-0d6bd9ea-3abd-4863-968a-90d921496ae6 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:32.392117 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-0d6bd9ea-3abd-4863-968a-90d921496ae6 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:32.543301 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-0d6bd9ea-3abd-4863-968a-90d921496ae6 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e109c3dcd0574faaa3d7ec31dd4edd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48bbb92998f54ebeb624bc794d406896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:32.553031 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-0d6bd9ea-3abd-4863-968a-90d921496ae6 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] 10.222.0.50 "GET /compute/v2.1/servers/6fffb7a0-b963-4fdc-8f5d-0fe046c6a7ed" status: 200 len: 1312 microversion: 2.1 time: 0.187202 Aug 10 17:52:32.559827 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 428/837] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:32 2022] GET /compute/v2.1/servers/6fffb7a0-b963-4fdc-8f5d-0fe046c6a7ed => generated 1312 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:32.574795 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-8110ff5e-7850-429b-89f1-c93f3352e954 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83a3e198e21476eb12fcf417aea62de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df088e5a610436ea21b8a360e2bb527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:32.575512 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-54afd822-cf14-4f71-b481-1e25bf15cc96 tempest-LiveMigrationTest-599680963 tempest-LiveMigrationTest-599680963-project] Calling method '.version_select at 0x7fb345e6f1f0>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:32.584518 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-8110ff5e-7850-429b-89f1-c93f3352e954 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] 10.222.0.50 "GET /compute/v2.1/servers/3ca0b504-e928-4d31-be09-24a70200eff2" status: 200 len: 1322 microversion: 2.1 time: 0.322753 Aug 10 17:52:32.585423 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 410/838] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:32 2022] GET /compute/v2.1/servers/3ca0b504-e928-4d31-be09-24a70200eff2 => generated 1322 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:32.607595 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-82867b8f-9db9-428f-8eac-9e645c8c2973 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:32.607595 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-82867b8f-9db9-428f-8eac-9e645c8c2973 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] [instance: e2777988-0bbf-496c-9c97-b206dbc94a62] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:32.619488 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-82867b8f-9db9-428f-8eac-9e645c8c2973 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:32.620782 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-82867b8f-9db9-428f-8eac-9e645c8c2973 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:32.621249 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-82867b8f-9db9-428f-8eac-9e645c8c2973 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:32.623601 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-82867b8f-9db9-428f-8eac-9e645c8c2973 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:32.625216 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-82867b8f-9db9-428f-8eac-9e645c8c2973 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:32.625666 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-82867b8f-9db9-428f-8eac-9e645c8c2973 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:32.712029 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-82867b8f-9db9-428f-8eac-9e645c8c2973 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:32.721091 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-54afd822-cf14-4f71-b481-1e25bf15cc96 tempest-LiveMigrationTest-599680963 tempest-LiveMigrationTest-599680963-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2040684976" status: 202 len: 0 microversion: 2.1 time: 0.156219 Aug 10 17:52:32.721994 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 429/839] 10.222.0.50 () {58 vars in 1221 bytes} [Wed Aug 10 17:52:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2040684976 => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 17:52:32.734131 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-82867b8f-9db9-428f-8eac-9e645c8c2973 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:32.734131 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-82867b8f-9db9-428f-8eac-9e645c8c2973 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:32.734131 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-82867b8f-9db9-428f-8eac-9e645c8c2973 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] 10.222.0.50 "GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62" status: 200 len: 1445 microversion: 2.75 time: 0.142860 Aug 10 17:52:32.734131 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 411/840] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:52:32 2022] GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62 => generated 1445 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:52:32.734873 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-8ac60c31-5fc7-40a6-afdd-49d0a1b37e59 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:32.734873 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-8ac60c31-5fc7-40a6-afdd-49d0a1b37e59 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] [instance: bee3148a-3834-41bd-99e7-b5da75217256] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:32.738721 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-8ac60c31-5fc7-40a6-afdd-49d0a1b37e59 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:32.739453 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-8ac60c31-5fc7-40a6-afdd-49d0a1b37e59 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:32.739884 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-8ac60c31-5fc7-40a6-afdd-49d0a1b37e59 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:32.740618 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-8ac60c31-5fc7-40a6-afdd-49d0a1b37e59 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:32.741416 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-8ac60c31-5fc7-40a6-afdd-49d0a1b37e59 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:32.742049 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-8ac60c31-5fc7-40a6-afdd-49d0a1b37e59 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:32.755440 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-aca9f801-fb0c-435f-a081-22b2f9c16656 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:32.757287 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-aca9f801-fb0c-435f-a081-22b2f9c16656 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: f747d5da-322c-4afb-bac6-c614b85656f9] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:32.798854 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-aca9f801-fb0c-435f-a081-22b2f9c16656 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:32.799396 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-aca9f801-fb0c-435f-a081-22b2f9c16656 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:32.799848 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-aca9f801-fb0c-435f-a081-22b2f9c16656 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:32.800612 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-aca9f801-fb0c-435f-a081-22b2f9c16656 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:32.801069 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-aca9f801-fb0c-435f-a081-22b2f9c16656 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:32.801491 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-aca9f801-fb0c-435f-a081-22b2f9c16656 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:32.929650 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-8ac60c31-5fc7-40a6-afdd-49d0a1b37e59 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2fd6acf18d4218ad143ccee2d0bb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7c2481a908406fa9c4562513fff665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:32.943979 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-8ac60c31-5fc7-40a6-afdd-49d0a1b37e59 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] 10.222.0.50 "GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256" status: 200 len: 1470 microversion: 2.1 time: 0.217469 Aug 10 17:52:32.944981 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 430/841] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:32 2022] GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256 => generated 1470 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:33.018915 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-aca9f801-fb0c-435f-a081-22b2f9c16656 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:33.029350 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-aca9f801-fb0c-435f-a081-22b2f9c16656 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/f747d5da-322c-4afb-bac6-c614b85656f9" status: 200 len: 1317 microversion: 2.1 time: 0.279708 Aug 10 17:52:33.029350 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 412/842] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:32 2022] GET /compute/v2.1/servers/f747d5da-322c-4afb-bac6-c614b85656f9 => generated 1317 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:33.478989 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [req-03f59164-884b-4bd6-8879-5c981b4e42fa req-173eb9ff-7ef4-4476-88ea-be2d46719279 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fffb7a0-b963-4fdc-8f5d-0fe046c6a7ed", "name": "network-vif-plugged", "status": "completed", "tag": "25ae0a01-bb3b-4af9-abfc-9b9f8dc40384"}]} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:52:33.500389 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-03f59164-884b-4bd6-8879-5c981b4e42fa req-173eb9ff-7ef4-4476-88ea-be2d46719279 service nova] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:33.501888 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-03f59164-884b-4bd6-8879-5c981b4e42fa req-173eb9ff-7ef4-4476-88ea-be2d46719279 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:33.503437 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-03f59164-884b-4bd6-8879-5c981b4e42fa req-173eb9ff-7ef4-4476-88ea-be2d46719279 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:33.518388 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.compute.server_external_events [req-03f59164-884b-4bd6-8879-5c981b4e42fa req-173eb9ff-7ef4-4476-88ea-be2d46719279 service nova] Creating event network-vif-plugged:25ae0a01-bb3b-4af9-abfc-9b9f8dc40384 for instance 6fffb7a0-b963-4fdc-8f5d-0fe046c6a7ed on n-h2-852296-2 Aug 10 17:52:33.523774 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [req-03f59164-884b-4bd6-8879-5c981b4e42fa req-173eb9ff-7ef4-4476-88ea-be2d46719279 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049863 Aug 10 17:52:33.527988 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 431/843] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 10 17:52:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:52:33.575305 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-617a1b66-9759-4384-ae60-6241e829dd4c tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:33.576114 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-617a1b66-9759-4384-ae60-6241e829dd4c tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] [instance: 6fffb7a0-b963-4fdc-8f5d-0fe046c6a7ed] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:33.591291 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-617a1b66-9759-4384-ae60-6241e829dd4c tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:33.591858 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-617a1b66-9759-4384-ae60-6241e829dd4c tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:33.592380 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-617a1b66-9759-4384-ae60-6241e829dd4c tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:33.594354 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-617a1b66-9759-4384-ae60-6241e829dd4c tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:33.595025 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-617a1b66-9759-4384-ae60-6241e829dd4c tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:33.595638 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-617a1b66-9759-4384-ae60-6241e829dd4c tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:33.608802 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-cab7713f-dd9f-4d16-b322-37bdffd48ab1 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:33.610139 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-cab7713f-dd9f-4d16-b322-37bdffd48ab1 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] [instance: 3ca0b504-e928-4d31-be09-24a70200eff2] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:33.618575 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-cab7713f-dd9f-4d16-b322-37bdffd48ab1 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:33.619345 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-cab7713f-dd9f-4d16-b322-37bdffd48ab1 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:33.627624 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-cab7713f-dd9f-4d16-b322-37bdffd48ab1 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:33.634059 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-cab7713f-dd9f-4d16-b322-37bdffd48ab1 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:33.635287 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-cab7713f-dd9f-4d16-b322-37bdffd48ab1 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:33.638287 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-cab7713f-dd9f-4d16-b322-37bdffd48ab1 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:33.879209 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_cell0:SELECT=22 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:52:33.921207 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-617a1b66-9759-4384-ae60-6241e829dd4c tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e109c3dcd0574faaa3d7ec31dd4edd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48bbb92998f54ebeb624bc794d406896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:33.929202 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-617a1b66-9759-4384-ae60-6241e829dd4c tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] 10.222.0.50 "GET /compute/v2.1/servers/6fffb7a0-b963-4fdc-8f5d-0fe046c6a7ed" status: 200 len: 1312 microversion: 2.1 time: 0.357973 Aug 10 17:52:33.930126 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 413/844] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:33 2022] GET /compute/v2.1/servers/6fffb7a0-b963-4fdc-8f5d-0fe046c6a7ed => generated 1312 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:33.936958 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-a17dbe54-01c6-48f7-8944-bf7f989707e3 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:33.938207 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-a17dbe54-01c6-48f7-8944-bf7f989707e3 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] [instance: e2777988-0bbf-496c-9c97-b206dbc94a62] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:33.950339 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a17dbe54-01c6-48f7-8944-bf7f989707e3 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:33.951335 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a17dbe54-01c6-48f7-8944-bf7f989707e3 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:33.952295 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a17dbe54-01c6-48f7-8944-bf7f989707e3 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:33.959027 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a17dbe54-01c6-48f7-8944-bf7f989707e3 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:33.959027 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a17dbe54-01c6-48f7-8944-bf7f989707e3 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:33.959027 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a17dbe54-01c6-48f7-8944-bf7f989707e3 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:34.057791 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-a17dbe54-01c6-48f7-8944-bf7f989707e3 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:34.068306 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-a17dbe54-01c6-48f7-8944-bf7f989707e3 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:34.070452 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-a17dbe54-01c6-48f7-8944-bf7f989707e3 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:34.079450 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-a17dbe54-01c6-48f7-8944-bf7f989707e3 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] 10.222.0.50 "GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62" status: 200 len: 1445 microversion: 2.75 time: 0.146802 Aug 10 17:52:34.079450 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 414/845] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:52:33 2022] GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62 => generated 1445 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:52:34.083941 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-a658817f-0984-4744-87de-aea774a455b0 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:34.084714 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-a658817f-0984-4744-87de-aea774a455b0 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] [instance: bee3148a-3834-41bd-99e7-b5da75217256] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:34.091784 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a658817f-0984-4744-87de-aea774a455b0 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:34.093094 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a658817f-0984-4744-87de-aea774a455b0 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:34.094199 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a658817f-0984-4744-87de-aea774a455b0 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:34.094852 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a658817f-0984-4744-87de-aea774a455b0 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:34.095363 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a658817f-0984-4744-87de-aea774a455b0 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:34.095799 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a658817f-0984-4744-87de-aea774a455b0 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:34.267240 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-cab7713f-dd9f-4d16-b322-37bdffd48ab1 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83a3e198e21476eb12fcf417aea62de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df088e5a610436ea21b8a360e2bb527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:34.279535 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-cab7713f-dd9f-4d16-b322-37bdffd48ab1 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] 10.222.0.50 "GET /compute/v2.1/servers/3ca0b504-e928-4d31-be09-24a70200eff2" status: 200 len: 1322 microversion: 2.1 time: 0.673370 Aug 10 17:52:34.279535 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 432/846] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:33 2022] GET /compute/v2.1/servers/3ca0b504-e928-4d31-be09-24a70200eff2 => generated 1322 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:34.280315 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-a658817f-0984-4744-87de-aea774a455b0 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2fd6acf18d4218ad143ccee2d0bb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7c2481a908406fa9c4562513fff665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:34.285725 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-ad5ba319-35d1-4983-b4f7-f2766a16b079 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:34.286485 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-ad5ba319-35d1-4983-b4f7-f2766a16b079 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: f747d5da-322c-4afb-bac6-c614b85656f9] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:34.288600 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_cell1:SELECT=100 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:52:34.290951 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-a658817f-0984-4744-87de-aea774a455b0 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] 10.222.0.50 "GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256" status: 200 len: 1470 microversion: 2.1 time: 0.210651 Aug 10 17:52:34.292197 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 415/847] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:34 2022] GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256 => generated 1470 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:34.301142 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-ad5ba319-35d1-4983-b4f7-f2766a16b079 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:34.301648 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-ad5ba319-35d1-4983-b4f7-f2766a16b079 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:34.302078 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-ad5ba319-35d1-4983-b4f7-f2766a16b079 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:34.302797 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-ad5ba319-35d1-4983-b4f7-f2766a16b079 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:34.304649 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-ad5ba319-35d1-4983-b4f7-f2766a16b079 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:34.305210 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-ad5ba319-35d1-4983-b4f7-f2766a16b079 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:34.469163 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-ad5ba319-35d1-4983-b4f7-f2766a16b079 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:34.477357 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-ad5ba319-35d1-4983-b4f7-f2766a16b079 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/f747d5da-322c-4afb-bac6-c614b85656f9" status: 200 len: 1317 microversion: 2.1 time: 0.197867 Aug 10 17:52:34.477919 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 433/848] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:34 2022] GET /compute/v2.1/servers/f747d5da-322c-4afb-bac6-c614b85656f9 => generated 1317 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:34.954730 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-466b1431-449d-4842-8671-dcc03806ad29 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:34.955543 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-466b1431-449d-4842-8671-dcc03806ad29 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] [instance: 6fffb7a0-b963-4fdc-8f5d-0fe046c6a7ed] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:34.963680 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-466b1431-449d-4842-8671-dcc03806ad29 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:34.964439 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-466b1431-449d-4842-8671-dcc03806ad29 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:34.964956 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-466b1431-449d-4842-8671-dcc03806ad29 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:34.965843 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-466b1431-449d-4842-8671-dcc03806ad29 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:34.966591 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-466b1431-449d-4842-8671-dcc03806ad29 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:34.967097 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-466b1431-449d-4842-8671-dcc03806ad29 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:35.109480 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-dc8c8597-b4de-4f69-833f-d10975098138 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:35.109480 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-dc8c8597-b4de-4f69-833f-d10975098138 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] [instance: e2777988-0bbf-496c-9c97-b206dbc94a62] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:35.113954 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-dc8c8597-b4de-4f69-833f-d10975098138 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:35.115235 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-dc8c8597-b4de-4f69-833f-d10975098138 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:35.116466 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-dc8c8597-b4de-4f69-833f-d10975098138 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:35.117668 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-dc8c8597-b4de-4f69-833f-d10975098138 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:35.118395 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-dc8c8597-b4de-4f69-833f-d10975098138 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:35.119067 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-dc8c8597-b4de-4f69-833f-d10975098138 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:35.203669 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-dc8c8597-b4de-4f69-833f-d10975098138 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:35.218857 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-dc8c8597-b4de-4f69-833f-d10975098138 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:35.220677 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-dc8c8597-b4de-4f69-833f-d10975098138 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:35.226675 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-dc8c8597-b4de-4f69-833f-d10975098138 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] 10.222.0.50 "GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62" status: 200 len: 1445 microversion: 2.75 time: 0.127436 Aug 10 17:52:35.227657 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 434/849] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:52:35 2022] GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62 => generated 1445 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 17:52:35.312535 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-a98b7a42-225d-4ffa-86a3-0f5061c2734c tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:35.313451 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-a98b7a42-225d-4ffa-86a3-0f5061c2734c tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] [instance: 3ca0b504-e928-4d31-be09-24a70200eff2] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:35.321233 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a98b7a42-225d-4ffa-86a3-0f5061c2734c tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:35.327133 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a98b7a42-225d-4ffa-86a3-0f5061c2734c tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:35.327133 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a98b7a42-225d-4ffa-86a3-0f5061c2734c tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:35.327133 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a98b7a42-225d-4ffa-86a3-0f5061c2734c tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:35.327133 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a98b7a42-225d-4ffa-86a3-0f5061c2734c tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:35.327133 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a98b7a42-225d-4ffa-86a3-0f5061c2734c tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:35.330404 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_cell1:SELECT=100 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:52:35.492628 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-466b1431-449d-4842-8671-dcc03806ad29 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e109c3dcd0574faaa3d7ec31dd4edd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48bbb92998f54ebeb624bc794d406896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:35.503804 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-466b1431-449d-4842-8671-dcc03806ad29 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] 10.222.0.50 "GET /compute/v2.1/servers/6fffb7a0-b963-4fdc-8f5d-0fe046c6a7ed" status: 200 len: 1312 microversion: 2.1 time: 0.553690 Aug 10 17:52:35.505100 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 416/850] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:34 2022] GET /compute/v2.1/servers/6fffb7a0-b963-4fdc-8f5d-0fe046c6a7ed => generated 1312 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:35.511107 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-cacbc182-88e7-4c50-b465-7335cb7dd13e tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:35.511949 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-cacbc182-88e7-4c50-b465-7335cb7dd13e tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] [instance: bee3148a-3834-41bd-99e7-b5da75217256] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:35.520145 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-cacbc182-88e7-4c50-b465-7335cb7dd13e tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:35.521062 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-cacbc182-88e7-4c50-b465-7335cb7dd13e tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:35.521742 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-cacbc182-88e7-4c50-b465-7335cb7dd13e tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:35.522786 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-cacbc182-88e7-4c50-b465-7335cb7dd13e tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:35.523258 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-a98b7a42-225d-4ffa-86a3-0f5061c2734c tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83a3e198e21476eb12fcf417aea62de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df088e5a610436ea21b8a360e2bb527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:35.523713 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-cacbc182-88e7-4c50-b465-7335cb7dd13e tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:35.524589 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-cacbc182-88e7-4c50-b465-7335cb7dd13e tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:35.539973 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-a98b7a42-225d-4ffa-86a3-0f5061c2734c tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] 10.222.0.50 "GET /compute/v2.1/servers/3ca0b504-e928-4d31-be09-24a70200eff2" status: 200 len: 1322 microversion: 2.1 time: 0.244898 Aug 10 17:52:35.553978 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 435/851] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:35 2022] GET /compute/v2.1/servers/3ca0b504-e928-4d31-be09-24a70200eff2 => generated 1322 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:52:35.561350 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-5825cda3-3413-4a86-b811-a8672b596ff1 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:35.565050 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-5825cda3-3413-4a86-b811-a8672b596ff1 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: f747d5da-322c-4afb-bac6-c614b85656f9] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:35.577160 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-5825cda3-3413-4a86-b811-a8672b596ff1 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:35.577649 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-5825cda3-3413-4a86-b811-a8672b596ff1 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:35.578089 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-5825cda3-3413-4a86-b811-a8672b596ff1 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:35.578807 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-5825cda3-3413-4a86-b811-a8672b596ff1 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:35.579259 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-5825cda3-3413-4a86-b811-a8672b596ff1 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:35.579678 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-5825cda3-3413-4a86-b811-a8672b596ff1 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:35.736216 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-cacbc182-88e7-4c50-b465-7335cb7dd13e tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2fd6acf18d4218ad143ccee2d0bb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7c2481a908406fa9c4562513fff665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:35.744429 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-cacbc182-88e7-4c50-b465-7335cb7dd13e tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] 10.222.0.50 "GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256" status: 200 len: 1470 microversion: 2.1 time: 0.237819 Aug 10 17:52:35.745150 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 417/852] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:35 2022] GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256 => generated 1470 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:35.777971 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-5825cda3-3413-4a86-b811-a8672b596ff1 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:35.787927 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-5825cda3-3413-4a86-b811-a8672b596ff1 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/f747d5da-322c-4afb-bac6-c614b85656f9" status: 200 len: 1317 microversion: 2.1 time: 0.231744 Aug 10 17:52:35.788932 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 436/853] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:35 2022] GET /compute/v2.1/servers/f747d5da-322c-4afb-bac6-c614b85656f9 => generated 1317 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:36.254647 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-ff627096-e303-4191-8bff-59cfca087b0d tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:36.255270 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-ff627096-e303-4191-8bff-59cfca087b0d tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] [instance: e2777988-0bbf-496c-9c97-b206dbc94a62] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:36.263995 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-ff627096-e303-4191-8bff-59cfca087b0d tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:36.265268 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-ff627096-e303-4191-8bff-59cfca087b0d tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:36.265786 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-ff627096-e303-4191-8bff-59cfca087b0d tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:36.266695 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-ff627096-e303-4191-8bff-59cfca087b0d tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:36.267534 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-ff627096-e303-4191-8bff-59cfca087b0d tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:36.268027 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-ff627096-e303-4191-8bff-59cfca087b0d tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:36.367831 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-ff627096-e303-4191-8bff-59cfca087b0d tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:36.380294 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-ff627096-e303-4191-8bff-59cfca087b0d tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:36.382556 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-ff627096-e303-4191-8bff-59cfca087b0d tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:36.390594 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-ff627096-e303-4191-8bff-59cfca087b0d tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] 10.222.0.50 "GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62" status: 200 len: 1445 microversion: 2.75 time: 0.140989 Aug 10 17:52:36.405097 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 418/854] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:52:36 2022] GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62 => generated 1445 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:52:36.531137 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-a941f9bd-0947-4097-b4a8-7f6764cc54ac tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:36.532466 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-a941f9bd-0947-4097-b4a8-7f6764cc54ac tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] [instance: 6fffb7a0-b963-4fdc-8f5d-0fe046c6a7ed] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:36.540462 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a941f9bd-0947-4097-b4a8-7f6764cc54ac tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:36.541232 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a941f9bd-0947-4097-b4a8-7f6764cc54ac tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:36.541905 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a941f9bd-0947-4097-b4a8-7f6764cc54ac tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:36.542812 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a941f9bd-0947-4097-b4a8-7f6764cc54ac tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:36.543485 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a941f9bd-0947-4097-b4a8-7f6764cc54ac tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:36.544111 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a941f9bd-0947-4097-b4a8-7f6764cc54ac tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:36.570129 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-df40e063-032b-4a1e-b07a-8a2c6f74ef02 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:36.570731 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-df40e063-032b-4a1e-b07a-8a2c6f74ef02 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] [instance: 3ca0b504-e928-4d31-be09-24a70200eff2] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:36.580829 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-df40e063-032b-4a1e-b07a-8a2c6f74ef02 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:36.585147 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-df40e063-032b-4a1e-b07a-8a2c6f74ef02 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:36.597000 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-df40e063-032b-4a1e-b07a-8a2c6f74ef02 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:36.597000 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-df40e063-032b-4a1e-b07a-8a2c6f74ef02 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:36.597000 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-df40e063-032b-4a1e-b07a-8a2c6f74ef02 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:36.597000 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-df40e063-032b-4a1e-b07a-8a2c6f74ef02 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:36.720935 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-a941f9bd-0947-4097-b4a8-7f6764cc54ac tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e109c3dcd0574faaa3d7ec31dd4edd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48bbb92998f54ebeb624bc794d406896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:36.744754 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-a941f9bd-0947-4097-b4a8-7f6764cc54ac tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] 10.222.0.50 "GET /compute/v2.1/servers/6fffb7a0-b963-4fdc-8f5d-0fe046c6a7ed" status: 200 len: 1462 microversion: 2.1 time: 0.203354 Aug 10 17:52:36.744754 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 437/855] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:36 2022] GET /compute/v2.1/servers/6fffb7a0-b963-4fdc-8f5d-0fe046c6a7ed => generated 1462 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:36.757072 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-77e8e14d-33ca-48ae-b0d7-ef433be1fc21 tempest-MigrationsAdminTest-964085913 tempest-MigrationsAdminTest-964085913-project-admin] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:36.758005 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-77e8e14d-33ca-48ae-b0d7-ef433be1fc21 tempest-MigrationsAdminTest-964085913 tempest-MigrationsAdminTest-964085913-project-admin] [instance: 6fffb7a0-b963-4fdc-8f5d-0fe046c6a7ed] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:36.766604 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-77e8e14d-33ca-48ae-b0d7-ef433be1fc21 tempest-MigrationsAdminTest-964085913 tempest-MigrationsAdminTest-964085913-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:36.767487 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-77e8e14d-33ca-48ae-b0d7-ef433be1fc21 tempest-MigrationsAdminTest-964085913 tempest-MigrationsAdminTest-964085913-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:36.768275 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-77e8e14d-33ca-48ae-b0d7-ef433be1fc21 tempest-MigrationsAdminTest-964085913 tempest-MigrationsAdminTest-964085913-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:36.769082 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-77e8e14d-33ca-48ae-b0d7-ef433be1fc21 tempest-MigrationsAdminTest-964085913 tempest-MigrationsAdminTest-964085913-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:36.769770 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-77e8e14d-33ca-48ae-b0d7-ef433be1fc21 tempest-MigrationsAdminTest-964085913 tempest-MigrationsAdminTest-964085913-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:36.770503 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-77e8e14d-33ca-48ae-b0d7-ef433be1fc21 tempest-MigrationsAdminTest-964085913 tempest-MigrationsAdminTest-964085913-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:36.852117 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-df40e063-032b-4a1e-b07a-8a2c6f74ef02 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83a3e198e21476eb12fcf417aea62de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df088e5a610436ea21b8a360e2bb527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:36.862618 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-df40e063-032b-4a1e-b07a-8a2c6f74ef02 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] 10.222.0.50 "GET /compute/v2.1/servers/3ca0b504-e928-4d31-be09-24a70200eff2" status: 200 len: 1322 microversion: 2.1 time: 0.296340 Aug 10 17:52:36.863847 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 419/856] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:36 2022] GET /compute/v2.1/servers/3ca0b504-e928-4d31-be09-24a70200eff2 => generated 1322 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:52:36.892134 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-b0c84d13-e7bf-4f1b-8ee9-0fc273407cb2 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:36.892823 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-b0c84d13-e7bf-4f1b-8ee9-0fc273407cb2 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] [instance: bee3148a-3834-41bd-99e7-b5da75217256] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:36.913540 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-b0c84d13-e7bf-4f1b-8ee9-0fc273407cb2 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:36.914391 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-b0c84d13-e7bf-4f1b-8ee9-0fc273407cb2 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:36.914905 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-b0c84d13-e7bf-4f1b-8ee9-0fc273407cb2 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:36.921019 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-b0c84d13-e7bf-4f1b-8ee9-0fc273407cb2 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:36.927291 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-b0c84d13-e7bf-4f1b-8ee9-0fc273407cb2 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:36.927291 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-b0c84d13-e7bf-4f1b-8ee9-0fc273407cb2 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:36.962692 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-77e8e14d-33ca-48ae-b0d7-ef433be1fc21 tempest-MigrationsAdminTest-964085913 tempest-MigrationsAdminTest-964085913-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/6fffb7a0-b963-4fdc-8f5d-0fe046c6a7ed" status: 200 len: 1613 microversion: 2.1 time: 0.211173 Aug 10 17:52:36.975207 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 438/857] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:36 2022] GET /compute/v2.1/servers/6fffb7a0-b963-4fdc-8f5d-0fe046c6a7ed => generated 1613 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:36.979650 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-f32fdbb9-108e-41f6-8b5e-fcb4514905eb tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:36.981016 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-f32fdbb9-108e-41f6-8b5e-fcb4514905eb tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: f747d5da-322c-4afb-bac6-c614b85656f9] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:36.988365 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-f32fdbb9-108e-41f6-8b5e-fcb4514905eb tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:36.989107 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-f32fdbb9-108e-41f6-8b5e-fcb4514905eb tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:36.990509 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-f32fdbb9-108e-41f6-8b5e-fcb4514905eb tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:36.991550 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-f32fdbb9-108e-41f6-8b5e-fcb4514905eb tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:36.992177 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-f32fdbb9-108e-41f6-8b5e-fcb4514905eb tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:36.992799 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-f32fdbb9-108e-41f6-8b5e-fcb4514905eb tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:37.164857 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-f32fdbb9-108e-41f6-8b5e-fcb4514905eb tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:37.174092 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-f32fdbb9-108e-41f6-8b5e-fcb4514905eb tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/f747d5da-322c-4afb-bac6-c614b85656f9" status: 200 len: 1317 microversion: 2.1 time: 0.205942 Aug 10 17:52:37.174681 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 439/858] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:36 2022] GET /compute/v2.1/servers/f747d5da-322c-4afb-bac6-c614b85656f9 => generated 1317 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:37.179606 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-42dd902c-0b79-464f-a0de-d45ac997b45e tempest-MigrationsAdminTest-964085913 tempest-MigrationsAdminTest-964085913-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:52:37.180227 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-42dd902c-0b79-464f-a0de-d45ac997b45e tempest-MigrationsAdminTest-964085913 tempest-MigrationsAdminTest-964085913-project-admin] [instance: 6fffb7a0-b963-4fdc-8f5d-0fe046c6a7ed] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:37.192131 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-42dd902c-0b79-464f-a0de-d45ac997b45e tempest-MigrationsAdminTest-964085913 tempest-MigrationsAdminTest-964085913-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:37.192730 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-42dd902c-0b79-464f-a0de-d45ac997b45e tempest-MigrationsAdminTest-964085913 tempest-MigrationsAdminTest-964085913-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:37.193575 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-42dd902c-0b79-464f-a0de-d45ac997b45e tempest-MigrationsAdminTest-964085913 tempest-MigrationsAdminTest-964085913-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:37.194344 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-42dd902c-0b79-464f-a0de-d45ac997b45e tempest-MigrationsAdminTest-964085913 tempest-MigrationsAdminTest-964085913-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:37.194898 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-42dd902c-0b79-464f-a0de-d45ac997b45e tempest-MigrationsAdminTest-964085913 tempest-MigrationsAdminTest-964085913-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:37.195385 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-42dd902c-0b79-464f-a0de-d45ac997b45e tempest-MigrationsAdminTest-964085913 tempest-MigrationsAdminTest-964085913-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:37.202034 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-b0c84d13-e7bf-4f1b-8ee9-0fc273407cb2 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2fd6acf18d4218ad143ccee2d0bb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7c2481a908406fa9c4562513fff665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:37.219303 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-b0c84d13-e7bf-4f1b-8ee9-0fc273407cb2 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] 10.222.0.50 "GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256" status: 200 len: 1470 microversion: 2.1 time: 0.354094 Aug 10 17:52:37.221189 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 420/859] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:36 2022] GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256 => generated 1470 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:37.324126 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [None req-42dd902c-0b79-464f-a0de-d45ac997b45e tempest-MigrationsAdminTest-964085913 tempest-MigrationsAdminTest-964085913-project-admin] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-fe403412-5402-4083-a79b-a586c24f9a18) Aug 10 17:52:37.324126 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:52:37.324126 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:52:37.324126 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:52:37.324126 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:52:37.324126 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:52:37.324126 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Aug 10 17:52:37.324126 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Aug 10 17:52:37.324126 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 368, in inner Aug 10 17:52:37.324126 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi if self.network_api.instance_has_extended_resource_request( Aug 10 17:52:37.324126 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1035, in instance_has_extended_resource_request Aug 10 17:52:37.324126 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi if not self.has_extended_resource_request_extension(admin_context): Aug 10 17:52:37.324126 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 17:52:37.324126 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 17:52:37.324126 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 17:52:37.324126 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 17:52:37.324126 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 17:52:37.324126 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 17:52:37.324126 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:52:37.324126 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:52:37.324126 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 17:52:37.324126 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 17:52:37.324126 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:52:37.324126 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:52:37.324126 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:52:37.324126 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:52:37.324126 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:52:37.324126 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:52:37.324126 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:52:37.324126 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:52:37.324126 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:52:37.324126 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:52:37.324126 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 17:52:37.324126 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 17:52:37.324126 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 17:52:37.324126 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 17:52:37.324126 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 17:52:37.324126 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 17:52:37.324126 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 17:52:37.324126 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 17:52:37.324126 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 17:52:37.324126 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 17:52:37.324126 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 17:52:37.324126 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 17:52:37.324126 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 17:52:37.324126 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 17:52:37.324126 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 17:52:37.324126 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 17:52:37.324126 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 17:52:37.324126 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 17:52:37.338619 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 17:52:37.338619 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 17:52:37.338619 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 17:52:37.338619 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 17:52:37.338619 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 17:52:37.338619 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 17:52:37.338619 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 17:52:37.338619 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 17:52:37.338619 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-fe403412-5402-4083-a79b-a586c24f9a18) Aug 10 17:52:37.338619 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:52:37.338619 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-42dd902c-0b79-464f-a0de-d45ac997b45e tempest-MigrationsAdminTest-964085913 tempest-MigrationsAdminTest-964085913-project-admin] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:52:37.338619 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 17:52:37.338619 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-42dd902c-0b79-464f-a0de-d45ac997b45e tempest-MigrationsAdminTest-964085913 tempest-MigrationsAdminTest-964085913-project-admin] Request method failure captured: Aug 10 17:52:37.338619 n-d-852296-2 devstack@n-api.service[129410]: request: POST /compute/v2.1/servers/6fffb7a0-b963-4fdc-8f5d-0fe046c6a7ed/action HTTP/1.1 Aug 10 17:52:37.338619 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 17:52:37.338619 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 17:52:37.338619 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 17:52:37.338619 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 15 Aug 10 17:52:37.338619 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 17:52:37.338619 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 17:52:37.338619 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 17:52:37.338619 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 17:52:37.338619 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8-_34qrKwYhIXal2vjPBD5g82PQVD5R4tnd93fbFZ9M0yciliUNDCwvxCTrKDWpCkYFxf4yVU13v8XzfdSAKmGZfVN2ZmqyaeeCBWjmReFVdg0quFpMaE-UjbbiItZ1X89-_ftumkrChrwUlm9OeC-VxArksbFx2EmsyLnwDfLO4VEQ Aug 10 17:52:37.338619 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 17:52:37.338619 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 17:52:37.338619 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 17:52:37.338619 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 17:52:37.338619 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 17:52:37.338619 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 17:52:37.338619 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: 50abb72754d54a89ae6a586553de4beb Aug 10 17:52:37.338619 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-MigrationsAdminTest-964085913 Aug 10 17:52:37.338619 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member,admin Aug 10 17:52:37.338619 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member,admin Aug 10 17:52:37.338619 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/50abb72754d54a89ae6a586553de4beb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/50abb72754d54a89ae6a586553de4beb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/50abb72754d54a89ae6a586553de4beb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_50abb72754d54a89ae6a586553de4beb", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:52:37.338619 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-MigrationsAdminTest-964085913 Aug 10 17:52:37.338619 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: 50abb72754d54a89ae6a586553de4beb Aug 10 17:52:37.338619 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-MigrationsAdminTest-964085913 Aug 10 17:52:37.338619 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-MigrationsAdminTest-964085913-project-admin Aug 10 17:52:37.338619 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 17:52:37.338619 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 17:52:37.338619 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: 48e3438ea5ed46b79100d48001e63839 Aug 10 17:52:37.338619 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-MigrationsAdminTest-964085913-project-admin Aug 10 17:52:37.338619 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 17:52:37.338619 n-d-852296-2 devstack@n-api.service[129410]: {"migrate": {}} Aug 10 17:52:37.338619 n-d-852296-2 devstack@n-api.service[129410]: method: > Aug 10 17:52:37.338619 n-d-852296-2 devstack@n-api.service[129410]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:52:37.338619 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 17:52:37.338619 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'id': '6fffb7a0-b963-4fdc-8f5d-0fe046c6a7ed', 'body': {'migrate': {}}} Aug 10 17:52:37.338619 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:52:37.338619 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:52:37.338619 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:52:37.338619 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:52:37.338619 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:52:37.338619 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:52:37.338619 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Aug 10 17:52:37.338619 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Aug 10 17:52:37.338619 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 368, in inner Aug 10 17:52:37.338619 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi if self.network_api.instance_has_extended_resource_request( Aug 10 17:52:37.338619 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1035, in instance_has_extended_resource_request Aug 10 17:52:37.342870 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi if not self.has_extended_resource_request_extension(admin_context): Aug 10 17:52:37.342870 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 17:52:37.342870 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 17:52:37.342870 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 17:52:37.342870 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 17:52:37.342870 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 17:52:37.342870 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 17:52:37.342870 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:52:37.342870 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:52:37.342870 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 17:52:37.342870 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 17:52:37.342870 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:52:37.342870 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:52:37.342870 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:52:37.342870 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:52:37.342870 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:52:37.342870 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:52:37.342870 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:52:37.342870 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:52:37.342870 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:52:37.342870 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:52:37.342870 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 17:52:37.342870 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 17:52:37.342870 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 17:52:37.342870 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 17:52:37.342870 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 17:52:37.342870 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 17:52:37.342870 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 17:52:37.342870 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 17:52:37.342870 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 17:52:37.342870 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 17:52:37.342870 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 17:52:37.342870 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 17:52:37.342870 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 17:52:37.342870 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 17:52:37.342870 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 17:52:37.342870 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 17:52:37.342870 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 17:52:37.342870 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 17:52:37.342870 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 17:52:37.342870 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 17:52:37.342870 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 17:52:37.342870 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 17:52:37.342870 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 17:52:37.342870 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 17:52:37.342870 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 17:52:37.342870 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 17:52:37.342870 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-fe403412-5402-4083-a79b-a586c24f9a18) Aug 10 17:52:37.342870 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:52:37.342870 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:52:37.342870 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:52:37.342870 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:52:37.342870 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:52:37.350731 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:52:37.350731 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:52:37.350731 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:52:37.350731 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 10 17:52:37.350731 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 10 17:52:37.350731 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:52:37.350731 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:52:37.350731 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:52:37.350731 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:52:37.350731 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:52:37.350731 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:52:37.350731 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:52:37.350731 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:52:37.350731 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:52:37.350731 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:52:37.350731 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:52:37.350731 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:52:37.350731 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:52:37.350731 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-42dd902c-0b79-464f-a0de-d45ac997b45e tempest-MigrationsAdminTest-964085913 tempest-MigrationsAdminTest-964085913-project-admin] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:52:37.350731 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:52:37.350731 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-42dd902c-0b79-464f-a0de-d45ac997b45e tempest-MigrationsAdminTest-964085913 tempest-MigrationsAdminTest-964085913-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/6fffb7a0-b963-4fdc-8f5d-0fe046c6a7ed/action" status: 500 len: 214 microversion: 2.1 time: 0.156780 Aug 10 17:52:37.350731 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 440/860] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 10 17:52:37 2022] POST /compute/v2.1/servers/6fffb7a0-b963-4fdc-8f5d-0fe046c6a7ed/action => generated 214 bytes in 158 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 10 17:52:37.355033 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-809859dc-65c3-468f-88bd-7a539f79966a tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:37.356852 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-809859dc-65c3-468f-88bd-7a539f79966a tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] [instance: 6fffb7a0-b963-4fdc-8f5d-0fe046c6a7ed] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:37.365145 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-809859dc-65c3-468f-88bd-7a539f79966a tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:37.365801 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-809859dc-65c3-468f-88bd-7a539f79966a tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:37.367182 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-809859dc-65c3-468f-88bd-7a539f79966a tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:37.383105 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-809859dc-65c3-468f-88bd-7a539f79966a tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:37.387494 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-809859dc-65c3-468f-88bd-7a539f79966a tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:37.388027 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-809859dc-65c3-468f-88bd-7a539f79966a tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:37.416695 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-73de2cd3-aebb-490b-9f7c-690ddbb7f4f1 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:37.423218 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-73de2cd3-aebb-490b-9f7c-690ddbb7f4f1 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] [instance: e2777988-0bbf-496c-9c97-b206dbc94a62] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:37.431064 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-73de2cd3-aebb-490b-9f7c-690ddbb7f4f1 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:37.435890 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-73de2cd3-aebb-490b-9f7c-690ddbb7f4f1 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:37.436692 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-73de2cd3-aebb-490b-9f7c-690ddbb7f4f1 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:37.439727 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-73de2cd3-aebb-490b-9f7c-690ddbb7f4f1 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:37.442445 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-73de2cd3-aebb-490b-9f7c-690ddbb7f4f1 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:37.446348 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-73de2cd3-aebb-490b-9f7c-690ddbb7f4f1 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:37.487610 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-809859dc-65c3-468f-88bd-7a539f79966a tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] [instance: 6fffb7a0-b963-4fdc-8f5d-0fe046c6a7ed] Going to try to terminate instance {{(pid=129409) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 17:52:37.567456 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-73de2cd3-aebb-490b-9f7c-690ddbb7f4f1 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:37.577776 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-73de2cd3-aebb-490b-9f7c-690ddbb7f4f1 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:37.580040 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-73de2cd3-aebb-490b-9f7c-690ddbb7f4f1 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:37.586046 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-73de2cd3-aebb-490b-9f7c-690ddbb7f4f1 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] 10.222.0.50 "GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62" status: 200 len: 1445 microversion: 2.75 time: 0.173789 Aug 10 17:52:37.586746 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 441/861] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:52:37 2022] GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62 => generated 1445 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:52:37.892493 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-4592e4d0-4333-47cc-ba12-86d1526b1241 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:37.893098 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-4592e4d0-4333-47cc-ba12-86d1526b1241 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] [instance: 3ca0b504-e928-4d31-be09-24a70200eff2] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:37.905443 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-4592e4d0-4333-47cc-ba12-86d1526b1241 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:37.906194 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-4592e4d0-4333-47cc-ba12-86d1526b1241 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:37.907570 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-4592e4d0-4333-47cc-ba12-86d1526b1241 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:37.908337 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-4592e4d0-4333-47cc-ba12-86d1526b1241 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:37.908967 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-809859dc-65c3-468f-88bd-7a539f79966a tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] 10.222.0.50 "DELETE /compute/v2.1/servers/6fffb7a0-b963-4fdc-8f5d-0fe046c6a7ed" status: 204 len: 0 microversion: 2.1 time: 0.564812 Aug 10 17:52:37.909854 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 421/862] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 10 17:52:37 2022] DELETE /compute/v2.1/servers/6fffb7a0-b963-4fdc-8f5d-0fe046c6a7ed => generated 0 bytes in 570 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 17:52:37.914283 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-4592e4d0-4333-47cc-ba12-86d1526b1241 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:37.914744 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-4592e4d0-4333-47cc-ba12-86d1526b1241 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:37.921929 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [req-a266eab0-37f7-4d06-9f7b-30c57e8bb96d req-dbe2f9e9-34a3-4e75-b845-d867786f2c97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f747d5da-322c-4afb-bac6-c614b85656f9", "name": "network-vif-plugged", "status": "completed", "tag": "fdf7ca0a-1e47-4466-96d3-61b2385956a4"}]} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:52:37.936361 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-a266eab0-37f7-4d06-9f7b-30c57e8bb96d req-dbe2f9e9-34a3-4e75-b845-d867786f2c97 service nova] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:37.937021 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-a266eab0-37f7-4d06-9f7b-30c57e8bb96d req-dbe2f9e9-34a3-4e75-b845-d867786f2c97 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:37.938140 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-a266eab0-37f7-4d06-9f7b-30c57e8bb96d req-dbe2f9e9-34a3-4e75-b845-d867786f2c97 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:37.966566 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.compute.server_external_events [req-a266eab0-37f7-4d06-9f7b-30c57e8bb96d req-dbe2f9e9-34a3-4e75-b845-d867786f2c97 service nova] Creating event network-vif-plugged:fdf7ca0a-1e47-4466-96d3-61b2385956a4 for instance f747d5da-322c-4afb-bac6-c614b85656f9 on n-h2-852296-2 Aug 10 17:52:37.972954 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [req-a266eab0-37f7-4d06-9f7b-30c57e8bb96d req-dbe2f9e9-34a3-4e75-b845-d867786f2c97 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058020 Aug 10 17:52:37.974686 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 422/863] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 10 17:52:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:52:38.000946 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-7c67590c-7f57-4632-8001-ff34037522f4 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:38.003067 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-7c67590c-7f57-4632-8001-ff34037522f4 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] [instance: 6fffb7a0-b963-4fdc-8f5d-0fe046c6a7ed] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:38.024965 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7c67590c-7f57-4632-8001-ff34037522f4 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:38.025472 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7c67590c-7f57-4632-8001-ff34037522f4 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:38.030826 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7c67590c-7f57-4632-8001-ff34037522f4 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:38.031585 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7c67590c-7f57-4632-8001-ff34037522f4 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:38.032140 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7c67590c-7f57-4632-8001-ff34037522f4 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:38.032502 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7c67590c-7f57-4632-8001-ff34037522f4 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:38.160052 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-4592e4d0-4333-47cc-ba12-86d1526b1241 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83a3e198e21476eb12fcf417aea62de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df088e5a610436ea21b8a360e2bb527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:38.173699 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-4592e4d0-4333-47cc-ba12-86d1526b1241 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] 10.222.0.50 "GET /compute/v2.1/servers/3ca0b504-e928-4d31-be09-24a70200eff2" status: 200 len: 1322 microversion: 2.1 time: 0.287340 Aug 10 17:52:38.174292 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 442/864] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:37 2022] GET /compute/v2.1/servers/3ca0b504-e928-4d31-be09-24a70200eff2 => generated 1322 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:38.204478 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-7fe9b896-c556-49a6-ab45-70fdb29faa18 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:38.205510 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-7fe9b896-c556-49a6-ab45-70fdb29faa18 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: f747d5da-322c-4afb-bac6-c614b85656f9] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:38.217674 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-7fe9b896-c556-49a6-ab45-70fdb29faa18 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:38.219002 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-7fe9b896-c556-49a6-ab45-70fdb29faa18 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:38.222014 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-7fe9b896-c556-49a6-ab45-70fdb29faa18 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:38.225004 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-7fe9b896-c556-49a6-ab45-70fdb29faa18 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:38.227346 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-7fe9b896-c556-49a6-ab45-70fdb29faa18 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:38.228028 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-7fe9b896-c556-49a6-ab45-70fdb29faa18 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:38.246741 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-7c67590c-7f57-4632-8001-ff34037522f4 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e109c3dcd0574faaa3d7ec31dd4edd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48bbb92998f54ebeb624bc794d406896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:38.256591 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-7c67590c-7f57-4632-8001-ff34037522f4 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] 10.222.0.50 "GET /compute/v2.1/servers/6fffb7a0-b963-4fdc-8f5d-0fe046c6a7ed" status: 200 len: 1468 microversion: 2.1 time: 0.279747 Aug 10 17:52:38.270934 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 423/865] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:37 2022] GET /compute/v2.1/servers/6fffb7a0-b963-4fdc-8f5d-0fe046c6a7ed => generated 1468 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:38.275639 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-6e8a8926-bb37-4012-a69b-df82f31e8ce9 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:38.276290 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-6e8a8926-bb37-4012-a69b-df82f31e8ce9 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] [instance: bee3148a-3834-41bd-99e7-b5da75217256] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:38.283197 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-6e8a8926-bb37-4012-a69b-df82f31e8ce9 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:38.283699 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-6e8a8926-bb37-4012-a69b-df82f31e8ce9 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:38.284135 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-6e8a8926-bb37-4012-a69b-df82f31e8ce9 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:38.284878 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-6e8a8926-bb37-4012-a69b-df82f31e8ce9 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:38.285597 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-6e8a8926-bb37-4012-a69b-df82f31e8ce9 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:38.286032 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-6e8a8926-bb37-4012-a69b-df82f31e8ce9 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:38.497253 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-6e8a8926-bb37-4012-a69b-df82f31e8ce9 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2fd6acf18d4218ad143ccee2d0bb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7c2481a908406fa9c4562513fff665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:38.507829 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-6e8a8926-bb37-4012-a69b-df82f31e8ce9 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] 10.222.0.50 "GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256" status: 200 len: 1470 microversion: 2.1 time: 0.235946 Aug 10 17:52:38.510800 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 424/866] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:38 2022] GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256 => generated 1470 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:38.612311 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-540d3399-eced-411b-acfc-039cf5993127 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:38.613178 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-540d3399-eced-411b-acfc-039cf5993127 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] [instance: e2777988-0bbf-496c-9c97-b206dbc94a62] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:38.620792 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-540d3399-eced-411b-acfc-039cf5993127 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:38.621293 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-540d3399-eced-411b-acfc-039cf5993127 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:38.621742 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-540d3399-eced-411b-acfc-039cf5993127 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:38.622458 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-540d3399-eced-411b-acfc-039cf5993127 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:38.626346 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-540d3399-eced-411b-acfc-039cf5993127 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:38.627118 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-540d3399-eced-411b-acfc-039cf5993127 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:38.704716 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-540d3399-eced-411b-acfc-039cf5993127 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:38.713412 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-540d3399-eced-411b-acfc-039cf5993127 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:38.715202 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-540d3399-eced-411b-acfc-039cf5993127 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:38.721494 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-540d3399-eced-411b-acfc-039cf5993127 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] 10.222.0.50 "GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62" status: 200 len: 1445 microversion: 2.75 time: 0.113908 Aug 10 17:52:38.722393 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 425/867] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:52:38 2022] GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62 => generated 1445 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 17:52:38.737659 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-7fe9b896-c556-49a6-ab45-70fdb29faa18 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:38.747314 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-7fe9b896-c556-49a6-ab45-70fdb29faa18 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/f747d5da-322c-4afb-bac6-c614b85656f9" status: 200 len: 1317 microversion: 2.1 time: 0.556485 Aug 10 17:52:38.748181 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 443/868] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:38 2022] GET /compute/v2.1/servers/f747d5da-322c-4afb-bac6-c614b85656f9 => generated 1317 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:52:39.201541 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-bb04dec5-261d-442f-b23b-193072e270ed tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:39.206629 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-bb04dec5-261d-442f-b23b-193072e270ed tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] [instance: 3ca0b504-e928-4d31-be09-24a70200eff2] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:39.212682 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-bb04dec5-261d-442f-b23b-193072e270ed tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:39.214303 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-bb04dec5-261d-442f-b23b-193072e270ed tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:39.216033 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-bb04dec5-261d-442f-b23b-193072e270ed tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:39.221599 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-bb04dec5-261d-442f-b23b-193072e270ed tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:39.222250 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-bb04dec5-261d-442f-b23b-193072e270ed tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:39.222819 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-bb04dec5-261d-442f-b23b-193072e270ed tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:39.279376 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-01ceb706-7c35-436c-8a82-1b7e10c36ebc tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:39.279861 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-01ceb706-7c35-436c-8a82-1b7e10c36ebc tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] [instance: 6fffb7a0-b963-4fdc-8f5d-0fe046c6a7ed] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:39.287304 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-01ceb706-7c35-436c-8a82-1b7e10c36ebc tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:39.288042 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-01ceb706-7c35-436c-8a82-1b7e10c36ebc tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:39.288595 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-01ceb706-7c35-436c-8a82-1b7e10c36ebc tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:39.289513 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-01ceb706-7c35-436c-8a82-1b7e10c36ebc tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:39.290090 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-01ceb706-7c35-436c-8a82-1b7e10c36ebc tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:39.290633 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-01ceb706-7c35-436c-8a82-1b7e10c36ebc tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:39.488867 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-01ceb706-7c35-436c-8a82-1b7e10c36ebc tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e109c3dcd0574faaa3d7ec31dd4edd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48bbb92998f54ebeb624bc794d406896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:39.508593 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-01ceb706-7c35-436c-8a82-1b7e10c36ebc tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] 10.222.0.50 "GET /compute/v2.1/servers/6fffb7a0-b963-4fdc-8f5d-0fe046c6a7ed" status: 200 len: 1468 microversion: 2.1 time: 0.233528 Aug 10 17:52:39.514535 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 444/869] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:39 2022] GET /compute/v2.1/servers/6fffb7a0-b963-4fdc-8f5d-0fe046c6a7ed => generated 1468 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:39.531727 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-bb68439b-aba3-4a5d-989c-a06da1f86918 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:39.533157 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-bb68439b-aba3-4a5d-989c-a06da1f86918 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] [instance: bee3148a-3834-41bd-99e7-b5da75217256] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:39.562139 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-bb68439b-aba3-4a5d-989c-a06da1f86918 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:39.569129 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-bb68439b-aba3-4a5d-989c-a06da1f86918 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:39.570801 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-bb68439b-aba3-4a5d-989c-a06da1f86918 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:39.573367 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-bb68439b-aba3-4a5d-989c-a06da1f86918 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:39.580677 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-bb68439b-aba3-4a5d-989c-a06da1f86918 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:39.581991 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-bb68439b-aba3-4a5d-989c-a06da1f86918 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:39.650151 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-bb04dec5-261d-442f-b23b-193072e270ed tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83a3e198e21476eb12fcf417aea62de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df088e5a610436ea21b8a360e2bb527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:39.665088 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-bb04dec5-261d-442f-b23b-193072e270ed tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] 10.222.0.50 "GET /compute/v2.1/servers/3ca0b504-e928-4d31-be09-24a70200eff2" status: 200 len: 1322 microversion: 2.1 time: 0.470587 Aug 10 17:52:39.667535 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 426/870] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:39 2022] GET /compute/v2.1/servers/3ca0b504-e928-4d31-be09-24a70200eff2 => generated 1322 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:39.747309 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-c57e4a15-bbcd-4f3e-b9ad-046ce7959fcd tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:39.760958 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-c57e4a15-bbcd-4f3e-b9ad-046ce7959fcd tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] [instance: e2777988-0bbf-496c-9c97-b206dbc94a62] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:39.760958 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c57e4a15-bbcd-4f3e-b9ad-046ce7959fcd tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:39.760958 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c57e4a15-bbcd-4f3e-b9ad-046ce7959fcd tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:39.760958 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c57e4a15-bbcd-4f3e-b9ad-046ce7959fcd tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:39.761658 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c57e4a15-bbcd-4f3e-b9ad-046ce7959fcd tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:39.761932 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c57e4a15-bbcd-4f3e-b9ad-046ce7959fcd tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:39.762551 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c57e4a15-bbcd-4f3e-b9ad-046ce7959fcd tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:39.830390 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-bb68439b-aba3-4a5d-989c-a06da1f86918 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2fd6acf18d4218ad143ccee2d0bb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7c2481a908406fa9c4562513fff665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:39.840053 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-bb68439b-aba3-4a5d-989c-a06da1f86918 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] 10.222.0.50 "GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256" status: 200 len: 1488 microversion: 2.1 time: 0.313161 Aug 10 17:52:39.857763 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 445/871] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:39 2022] GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256 => generated 1488 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:52:39.868458 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-8db8cdd3-8b4b-4b5b-a614-f3b6ac60e4ca tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:39.869372 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-8db8cdd3-8b4b-4b5b-a614-f3b6ac60e4ca tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: f747d5da-322c-4afb-bac6-c614b85656f9] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:39.876103 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-8db8cdd3-8b4b-4b5b-a614-f3b6ac60e4ca tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:39.887189 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-8db8cdd3-8b4b-4b5b-a614-f3b6ac60e4ca tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:39.887189 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-8db8cdd3-8b4b-4b5b-a614-f3b6ac60e4ca tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:39.887189 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-8db8cdd3-8b4b-4b5b-a614-f3b6ac60e4ca tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:39.887189 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-8db8cdd3-8b4b-4b5b-a614-f3b6ac60e4ca tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:39.887189 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-8db8cdd3-8b4b-4b5b-a614-f3b6ac60e4ca tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:39.916709 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-c57e4a15-bbcd-4f3e-b9ad-046ce7959fcd tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:39.944934 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-c57e4a15-bbcd-4f3e-b9ad-046ce7959fcd tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:39.947437 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-c57e4a15-bbcd-4f3e-b9ad-046ce7959fcd tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:39.956396 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-c57e4a15-bbcd-4f3e-b9ad-046ce7959fcd tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] 10.222.0.50 "GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62" status: 200 len: 1445 microversion: 2.75 time: 0.213039 Aug 10 17:52:39.962412 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 427/872] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:52:39 2022] GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62 => generated 1445 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:52:40.140578 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-8db8cdd3-8b4b-4b5b-a614-f3b6ac60e4ca tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:40.152447 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-8db8cdd3-8b4b-4b5b-a614-f3b6ac60e4ca tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/f747d5da-322c-4afb-bac6-c614b85656f9" status: 200 len: 1317 microversion: 2.1 time: 0.291273 Aug 10 17:52:40.159516 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 446/873] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:39 2022] GET /compute/v2.1/servers/f747d5da-322c-4afb-bac6-c614b85656f9 => generated 1317 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:40.522676 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [req-c11aee8e-b389-4c6a-b1e0-0bc7629a16a9 req-243ba934-11ed-48ce-9154-4ef77840b026 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ca0b504-e928-4d31-be09-24a70200eff2", "name": "network-vif-plugged", "status": "completed", "tag": "40ddb24b-0be9-4b22-93f8-5f65c2504414"}]} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:52:40.533752 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-acf88fa2-fa70-46da-8e02-984f2860c68e tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:40.534664 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-acf88fa2-fa70-46da-8e02-984f2860c68e tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] [instance: 6fffb7a0-b963-4fdc-8f5d-0fe046c6a7ed] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:40.548648 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-acf88fa2-fa70-46da-8e02-984f2860c68e tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:40.548864 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-c11aee8e-b389-4c6a-b1e0-0bc7629a16a9 req-243ba934-11ed-48ce-9154-4ef77840b026 service nova] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:40.549339 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-c11aee8e-b389-4c6a-b1e0-0bc7629a16a9 req-243ba934-11ed-48ce-9154-4ef77840b026 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:40.549661 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-acf88fa2-fa70-46da-8e02-984f2860c68e tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:40.554392 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-c11aee8e-b389-4c6a-b1e0-0bc7629a16a9 req-243ba934-11ed-48ce-9154-4ef77840b026 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:40.554530 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-acf88fa2-fa70-46da-8e02-984f2860c68e tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:40.554530 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-acf88fa2-fa70-46da-8e02-984f2860c68e tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:40.554530 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-acf88fa2-fa70-46da-8e02-984f2860c68e tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:40.554530 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-acf88fa2-fa70-46da-8e02-984f2860c68e tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:40.580085 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.compute.server_external_events [req-c11aee8e-b389-4c6a-b1e0-0bc7629a16a9 req-243ba934-11ed-48ce-9154-4ef77840b026 service nova] Creating event network-vif-plugged:40ddb24b-0be9-4b22-93f8-5f65c2504414 for instance 3ca0b504-e928-4d31-be09-24a70200eff2 on n-h1-852296-2 Aug 10 17:52:40.592487 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [req-c11aee8e-b389-4c6a-b1e0-0bc7629a16a9 req-243ba934-11ed-48ce-9154-4ef77840b026 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073715 Aug 10 17:52:40.593722 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 428/874] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 10 17:52:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:52:40.694446 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-a08ffda4-2ec7-4446-a573-30d1e4c5baa9 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:40.695322 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-a08ffda4-2ec7-4446-a573-30d1e4c5baa9 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] [instance: 3ca0b504-e928-4d31-be09-24a70200eff2] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:40.712214 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a08ffda4-2ec7-4446-a573-30d1e4c5baa9 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:40.713184 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a08ffda4-2ec7-4446-a573-30d1e4c5baa9 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:40.713974 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a08ffda4-2ec7-4446-a573-30d1e4c5baa9 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:40.715511 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a08ffda4-2ec7-4446-a573-30d1e4c5baa9 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:40.716170 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a08ffda4-2ec7-4446-a573-30d1e4c5baa9 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:40.717514 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a08ffda4-2ec7-4446-a573-30d1e4c5baa9 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:40.784051 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-acf88fa2-fa70-46da-8e02-984f2860c68e tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e109c3dcd0574faaa3d7ec31dd4edd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48bbb92998f54ebeb624bc794d406896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:40.793613 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-acf88fa2-fa70-46da-8e02-984f2860c68e tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] 10.222.0.50 "GET /compute/v2.1/servers/6fffb7a0-b963-4fdc-8f5d-0fe046c6a7ed" status: 200 len: 1468 microversion: 2.1 time: 0.265113 Aug 10 17:52:40.794310 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 447/875] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:40 2022] GET /compute/v2.1/servers/6fffb7a0-b963-4fdc-8f5d-0fe046c6a7ed => generated 1468 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:52:40.863953 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-9dfb7fb4-378c-47f3-b4a7-d7ae88396f17 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:40.864687 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-9dfb7fb4-378c-47f3-b4a7-d7ae88396f17 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] [instance: bee3148a-3834-41bd-99e7-b5da75217256] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:40.871931 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-9dfb7fb4-378c-47f3-b4a7-d7ae88396f17 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:40.872553 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-9dfb7fb4-378c-47f3-b4a7-d7ae88396f17 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:40.873656 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-9dfb7fb4-378c-47f3-b4a7-d7ae88396f17 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:40.874410 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-9dfb7fb4-378c-47f3-b4a7-d7ae88396f17 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:40.874874 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-9dfb7fb4-378c-47f3-b4a7-d7ae88396f17 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:40.875305 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-9dfb7fb4-378c-47f3-b4a7-d7ae88396f17 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:41.031876 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-9dfb7fb4-378c-47f3-b4a7-d7ae88396f17 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2fd6acf18d4218ad143ccee2d0bb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7c2481a908406fa9c4562513fff665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:41.040275 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-9dfb7fb4-378c-47f3-b4a7-d7ae88396f17 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] 10.222.0.50 "GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256" status: 200 len: 1476 microversion: 2.1 time: 0.180293 Aug 10 17:52:41.040868 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 448/876] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:40 2022] GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256 => generated 1476 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:52:41.045840 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-af29c81e-d3ee-4fb4-8694-acf477e2f28f tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:41.046433 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-af29c81e-d3ee-4fb4-8694-acf477e2f28f tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] [instance: e2777988-0bbf-496c-9c97-b206dbc94a62] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:41.052236 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:52:41.056282 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-af29c81e-d3ee-4fb4-8694-acf477e2f28f tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:41.056652 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-af29c81e-d3ee-4fb4-8694-acf477e2f28f tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:41.057090 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-af29c81e-d3ee-4fb4-8694-acf477e2f28f tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:41.057806 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-af29c81e-d3ee-4fb4-8694-acf477e2f28f tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:41.058265 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-af29c81e-d3ee-4fb4-8694-acf477e2f28f tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:41.061842 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-af29c81e-d3ee-4fb4-8694-acf477e2f28f tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:41.128761 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-af29c81e-d3ee-4fb4-8694-acf477e2f28f tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:41.136924 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-af29c81e-d3ee-4fb4-8694-acf477e2f28f tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:41.138435 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-af29c81e-d3ee-4fb4-8694-acf477e2f28f tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:41.143872 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-af29c81e-d3ee-4fb4-8694-acf477e2f28f tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] 10.222.0.50 "GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62" status: 200 len: 1451 microversion: 2.75 time: 0.101869 Aug 10 17:52:41.144473 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 449/877] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:52:41 2022] GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62 => generated 1451 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:52:41.175747 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-1d941ee8-6f45-4d9a-a099-516cedc2ac2d tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:41.176514 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-1d941ee8-6f45-4d9a-a099-516cedc2ac2d tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: f747d5da-322c-4afb-bac6-c614b85656f9] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:41.184991 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-1d941ee8-6f45-4d9a-a099-516cedc2ac2d tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:41.187123 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-1d941ee8-6f45-4d9a-a099-516cedc2ac2d tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:41.187123 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-1d941ee8-6f45-4d9a-a099-516cedc2ac2d tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:41.187745 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-1d941ee8-6f45-4d9a-a099-516cedc2ac2d tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:41.188370 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-1d941ee8-6f45-4d9a-a099-516cedc2ac2d tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:41.188800 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-1d941ee8-6f45-4d9a-a099-516cedc2ac2d tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:41.356282 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-1d941ee8-6f45-4d9a-a099-516cedc2ac2d tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:41.369678 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-1d941ee8-6f45-4d9a-a099-516cedc2ac2d tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/f747d5da-322c-4afb-bac6-c614b85656f9" status: 200 len: 1317 microversion: 2.1 time: 0.197451 Aug 10 17:52:41.370607 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 450/878] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:41 2022] GET /compute/v2.1/servers/f747d5da-322c-4afb-bac6-c614b85656f9 => generated 1317 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:41.376410 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [req-dffe92ed-9df4-49e7-baf9-b1e64164e373 req-debdeefc-0da8-4bba-af89-8190b5d3938b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fffb7a0-b963-4fdc-8f5d-0fe046c6a7ed", "name": "network-vif-deleted", "tag": "25ae0a01-bb3b-4af9-abfc-9b9f8dc40384"}]} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:52:41.400566 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-dffe92ed-9df4-49e7-baf9-b1e64164e373 req-debdeefc-0da8-4bba-af89-8190b5d3938b service nova] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:41.400566 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-dffe92ed-9df4-49e7-baf9-b1e64164e373 req-debdeefc-0da8-4bba-af89-8190b5d3938b service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:41.400566 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-dffe92ed-9df4-49e7-baf9-b1e64164e373 req-debdeefc-0da8-4bba-af89-8190b5d3938b service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:41.409799 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.compute.server_external_events [req-dffe92ed-9df4-49e7-baf9-b1e64164e373 req-debdeefc-0da8-4bba-af89-8190b5d3938b service nova] Creating event network-vif-deleted:25ae0a01-bb3b-4af9-abfc-9b9f8dc40384 for instance 6fffb7a0-b963-4fdc-8f5d-0fe046c6a7ed on n-h2-852296-2 Aug 10 17:52:41.415583 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [req-dffe92ed-9df4-49e7-baf9-b1e64164e373 req-debdeefc-0da8-4bba-af89-8190b5d3938b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043370 Aug 10 17:52:41.417027 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 451/879] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 10 17:52:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:52:41.438271 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-a08ffda4-2ec7-4446-a573-30d1e4c5baa9 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83a3e198e21476eb12fcf417aea62de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df088e5a610436ea21b8a360e2bb527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:41.449269 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-a08ffda4-2ec7-4446-a573-30d1e4c5baa9 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] 10.222.0.50 "GET /compute/v2.1/servers/3ca0b504-e928-4d31-be09-24a70200eff2" status: 200 len: 1322 microversion: 2.1 time: 0.760222 Aug 10 17:52:41.452598 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 429/880] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:40 2022] GET /compute/v2.1/servers/3ca0b504-e928-4d31-be09-24a70200eff2 => generated 1322 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:41.816053 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-f60efd3c-b0a1-4a88-b1a3-e9c9fcb09115 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:41.816783 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-f60efd3c-b0a1-4a88-b1a3-e9c9fcb09115 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] [instance: 6fffb7a0-b963-4fdc-8f5d-0fe046c6a7ed] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:41.823140 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-f60efd3c-b0a1-4a88-b1a3-e9c9fcb09115 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:41.823762 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-f60efd3c-b0a1-4a88-b1a3-e9c9fcb09115 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:41.824324 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-f60efd3c-b0a1-4a88-b1a3-e9c9fcb09115 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:41.825277 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-f60efd3c-b0a1-4a88-b1a3-e9c9fcb09115 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:41.826669 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-f60efd3c-b0a1-4a88-b1a3-e9c9fcb09115 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:41.827309 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-f60efd3c-b0a1-4a88-b1a3-e9c9fcb09115 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:41.901681 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-f60efd3c-b0a1-4a88-b1a3-e9c9fcb09115 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e109c3dcd0574faaa3d7ec31dd4edd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48bbb92998f54ebeb624bc794d406896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:41.905116 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_cell1:SELECT=100 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:52:41.912942 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-f60efd3c-b0a1-4a88-b1a3-e9c9fcb09115 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] 10.222.0.50 "GET /compute/v2.1/servers/6fffb7a0-b963-4fdc-8f5d-0fe046c6a7ed" status: 200 len: 1426 microversion: 2.1 time: 0.101652 Aug 10 17:52:41.913539 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 452/881] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:41 2022] GET /compute/v2.1/servers/6fffb7a0-b963-4fdc-8f5d-0fe046c6a7ed => generated 1426 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:42.065560 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-49384a1b-46d6-4b65-9361-bd22a104e003 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:42.066192 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-49384a1b-46d6-4b65-9361-bd22a104e003 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] [instance: bee3148a-3834-41bd-99e7-b5da75217256] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:42.086030 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-49384a1b-46d6-4b65-9361-bd22a104e003 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:42.086030 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-49384a1b-46d6-4b65-9361-bd22a104e003 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:42.086030 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-49384a1b-46d6-4b65-9361-bd22a104e003 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:42.086030 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-49384a1b-46d6-4b65-9361-bd22a104e003 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:42.086030 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-49384a1b-46d6-4b65-9361-bd22a104e003 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:42.086030 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-49384a1b-46d6-4b65-9361-bd22a104e003 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:42.171951 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-06418b59-899e-4dd5-94da-ce1671426899 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:42.172796 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-06418b59-899e-4dd5-94da-ce1671426899 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] [instance: e2777988-0bbf-496c-9c97-b206dbc94a62] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:42.179339 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-06418b59-899e-4dd5-94da-ce1671426899 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:42.179978 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-06418b59-899e-4dd5-94da-ce1671426899 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:42.180546 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-06418b59-899e-4dd5-94da-ce1671426899 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:42.181366 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-06418b59-899e-4dd5-94da-ce1671426899 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:42.182113 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-06418b59-899e-4dd5-94da-ce1671426899 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:42.182636 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-06418b59-899e-4dd5-94da-ce1671426899 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:42.259671 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-06418b59-899e-4dd5-94da-ce1671426899 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:42.269839 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-06418b59-899e-4dd5-94da-ce1671426899 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:42.271775 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-06418b59-899e-4dd5-94da-ce1671426899 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:42.282410 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-06418b59-899e-4dd5-94da-ce1671426899 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] 10.222.0.50 "GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62" status: 200 len: 1451 microversion: 2.75 time: 0.111008 Aug 10 17:52:42.282410 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 453/882] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:52:42 2022] GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62 => generated 1451 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 17:52:42.316197 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-49384a1b-46d6-4b65-9361-bd22a104e003 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2fd6acf18d4218ad143ccee2d0bb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7c2481a908406fa9c4562513fff665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:42.325663 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-49384a1b-46d6-4b65-9361-bd22a104e003 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] 10.222.0.50 "GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256" status: 200 len: 1476 microversion: 2.1 time: 0.266464 Aug 10 17:52:42.326468 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 430/883] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:42 2022] GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256 => generated 1476 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:42.392235 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-d68fe5b7-c465-4dee-9d3e-b84a397340eb tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:42.393006 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-d68fe5b7-c465-4dee-9d3e-b84a397340eb tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: f747d5da-322c-4afb-bac6-c614b85656f9] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:42.399632 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d68fe5b7-c465-4dee-9d3e-b84a397340eb tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:42.400225 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d68fe5b7-c465-4dee-9d3e-b84a397340eb tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:42.400794 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d68fe5b7-c465-4dee-9d3e-b84a397340eb tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:42.401558 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d68fe5b7-c465-4dee-9d3e-b84a397340eb tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:42.402101 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d68fe5b7-c465-4dee-9d3e-b84a397340eb tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:42.402591 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d68fe5b7-c465-4dee-9d3e-b84a397340eb tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:42.471275 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-990e8d83-204e-4c5b-b2af-c57cedc56fed tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:42.472458 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-990e8d83-204e-4c5b-b2af-c57cedc56fed tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] [instance: 3ca0b504-e928-4d31-be09-24a70200eff2] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:42.478792 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-990e8d83-204e-4c5b-b2af-c57cedc56fed tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:42.479279 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-990e8d83-204e-4c5b-b2af-c57cedc56fed tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:42.479709 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-990e8d83-204e-4c5b-b2af-c57cedc56fed tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:42.480658 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-990e8d83-204e-4c5b-b2af-c57cedc56fed tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:42.481115 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-990e8d83-204e-4c5b-b2af-c57cedc56fed tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:42.481538 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-990e8d83-204e-4c5b-b2af-c57cedc56fed tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:42.567967 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-d68fe5b7-c465-4dee-9d3e-b84a397340eb tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:42.582733 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-d68fe5b7-c465-4dee-9d3e-b84a397340eb tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/f747d5da-322c-4afb-bac6-c614b85656f9" status: 200 len: 1317 microversion: 2.1 time: 0.189411 Aug 10 17:52:42.582733 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 454/884] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:42 2022] GET /compute/v2.1/servers/f747d5da-322c-4afb-bac6-c614b85656f9 => generated 1317 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:42.640162 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [req-e69ca18e-c026-4aec-acd8-dbefdeda2a60 req-d41229f8-b23e-4056-b6c2-ea67e445bb77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bee3148a-3834-41bd-99e7-b5da75217256", "name": "network-vif-unplugged", "status": "completed", "tag": "2f16a409-b711-4b31-9eb5-9884dbbe9489"}]} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:52:42.640162 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-e69ca18e-c026-4aec-acd8-dbefdeda2a60 req-d41229f8-b23e-4056-b6c2-ea67e445bb77 service nova] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:42.640162 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-e69ca18e-c026-4aec-acd8-dbefdeda2a60 req-d41229f8-b23e-4056-b6c2-ea67e445bb77 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:42.640162 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-e69ca18e-c026-4aec-acd8-dbefdeda2a60 req-d41229f8-b23e-4056-b6c2-ea67e445bb77 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:42.646451 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.compute.server_external_events [req-e69ca18e-c026-4aec-acd8-dbefdeda2a60 req-d41229f8-b23e-4056-b6c2-ea67e445bb77 service nova] Creating event network-vif-unplugged:2f16a409-b711-4b31-9eb5-9884dbbe9489 for instance bee3148a-3834-41bd-99e7-b5da75217256 on n-h2-852296-2 Aug 10 17:52:42.651520 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [req-e69ca18e-c026-4aec-acd8-dbefdeda2a60 req-d41229f8-b23e-4056-b6c2-ea67e445bb77 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039104 Aug 10 17:52:42.652320 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 455/885] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 10 17:52:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:52:42.731919 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-990e8d83-204e-4c5b-b2af-c57cedc56fed tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83a3e198e21476eb12fcf417aea62de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df088e5a610436ea21b8a360e2bb527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:42.731919 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-990e8d83-204e-4c5b-b2af-c57cedc56fed tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] 10.222.0.50 "GET /compute/v2.1/servers/3ca0b504-e928-4d31-be09-24a70200eff2" status: 200 len: 1322 microversion: 2.1 time: 0.264233 Aug 10 17:52:42.731919 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 431/886] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:42 2022] GET /compute/v2.1/servers/3ca0b504-e928-4d31-be09-24a70200eff2 => generated 1322 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:42.938991 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-e3f63030-aab3-4aee-8456-c4dc1ade0071 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:42.939695 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-e3f63030-aab3-4aee-8456-c4dc1ade0071 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] [instance: 6fffb7a0-b963-4fdc-8f5d-0fe046c6a7ed] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:42.968977 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e3f63030-aab3-4aee-8456-c4dc1ade0071 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:42.973944 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e3f63030-aab3-4aee-8456-c4dc1ade0071 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:42.973944 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e3f63030-aab3-4aee-8456-c4dc1ade0071 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:42.973944 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e3f63030-aab3-4aee-8456-c4dc1ade0071 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:42.976291 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e3f63030-aab3-4aee-8456-c4dc1ade0071 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:42.977460 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e3f63030-aab3-4aee-8456-c4dc1ade0071 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:43.027637 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e3f63030-aab3-4aee-8456-c4dc1ade0071 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:43.027946 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e3f63030-aab3-4aee-8456-c4dc1ade0071 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:43.028471 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e3f63030-aab3-4aee-8456-c4dc1ade0071 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:43.029192 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.objects.instance [None req-e3f63030-aab3-4aee-8456-c4dc1ade0071 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lazy-loading 'fault' on Instance uuid 6fffb7a0-b963-4fdc-8f5d-0fe046c6a7ed {{(pid=129410) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:52:43.087460 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-e3f63030-aab3-4aee-8456-c4dc1ade0071 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e109c3dcd0574faaa3d7ec31dd4edd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48bbb92998f54ebeb624bc794d406896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:43.095764 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-e3f63030-aab3-4aee-8456-c4dc1ade0071 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] 10.222.0.50 "GET /compute/v2.1/servers/6fffb7a0-b963-4fdc-8f5d-0fe046c6a7ed" status: 200 len: 1302 microversion: 2.1 time: 0.162342 Aug 10 17:52:43.100322 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 456/887] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:42 2022] GET /compute/v2.1/servers/6fffb7a0-b963-4fdc-8f5d-0fe046c6a7ed => generated 1302 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:43.305709 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-749ac471-b408-4f10-a61a-77d9c926bf9a tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:43.307112 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-749ac471-b408-4f10-a61a-77d9c926bf9a tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] [instance: e2777988-0bbf-496c-9c97-b206dbc94a62] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:43.315035 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-749ac471-b408-4f10-a61a-77d9c926bf9a tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:43.316829 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-749ac471-b408-4f10-a61a-77d9c926bf9a tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:43.317433 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-749ac471-b408-4f10-a61a-77d9c926bf9a tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:43.318313 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-749ac471-b408-4f10-a61a-77d9c926bf9a tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:43.318926 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-749ac471-b408-4f10-a61a-77d9c926bf9a tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:43.319524 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-749ac471-b408-4f10-a61a-77d9c926bf9a tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:43.325551 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:52:43.347962 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-28fc17f8-ff3c-41f0-8eb4-0ee1bc43a718 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:43.348599 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-28fc17f8-ff3c-41f0-8eb4-0ee1bc43a718 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] [instance: bee3148a-3834-41bd-99e7-b5da75217256] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:43.355433 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-28fc17f8-ff3c-41f0-8eb4-0ee1bc43a718 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:43.355925 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-28fc17f8-ff3c-41f0-8eb4-0ee1bc43a718 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:43.356397 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-28fc17f8-ff3c-41f0-8eb4-0ee1bc43a718 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:43.357102 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-28fc17f8-ff3c-41f0-8eb4-0ee1bc43a718 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:43.357684 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-28fc17f8-ff3c-41f0-8eb4-0ee1bc43a718 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:43.358428 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-28fc17f8-ff3c-41f0-8eb4-0ee1bc43a718 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:43.425712 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-749ac471-b408-4f10-a61a-77d9c926bf9a tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:43.446192 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-749ac471-b408-4f10-a61a-77d9c926bf9a tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:43.447601 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-749ac471-b408-4f10-a61a-77d9c926bf9a tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:43.468408 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-749ac471-b408-4f10-a61a-77d9c926bf9a tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] 10.222.0.50 "GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62" status: 200 len: 1451 microversion: 2.75 time: 0.168099 Aug 10 17:52:43.484275 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 432/888] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:52:43 2022] GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62 => generated 1451 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:52:43.559770 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-28fc17f8-ff3c-41f0-8eb4-0ee1bc43a718 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2fd6acf18d4218ad143ccee2d0bb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7c2481a908406fa9c4562513fff665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:43.569697 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-28fc17f8-ff3c-41f0-8eb4-0ee1bc43a718 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] 10.222.0.50 "GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256" status: 200 len: 1476 microversion: 2.1 time: 0.225498 Aug 10 17:52:43.570722 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 457/889] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:43 2022] GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256 => generated 1476 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:43.603009 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-ee692c39-f70e-4883-a716-ed34d495cfb4 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:43.603879 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-ee692c39-f70e-4883-a716-ed34d495cfb4 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: f747d5da-322c-4afb-bac6-c614b85656f9] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:43.610549 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-ee692c39-f70e-4883-a716-ed34d495cfb4 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:43.611037 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-ee692c39-f70e-4883-a716-ed34d495cfb4 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:43.611679 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-ee692c39-f70e-4883-a716-ed34d495cfb4 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:43.612573 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-ee692c39-f70e-4883-a716-ed34d495cfb4 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:43.613180 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-ee692c39-f70e-4883-a716-ed34d495cfb4 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:43.613745 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-ee692c39-f70e-4883-a716-ed34d495cfb4 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:43.752103 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-2352525b-c667-4ad0-bdca-f3be85b6197c tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:43.753618 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-2352525b-c667-4ad0-bdca-f3be85b6197c tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] [instance: 3ca0b504-e928-4d31-be09-24a70200eff2] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:43.762955 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2352525b-c667-4ad0-bdca-f3be85b6197c tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:43.764890 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2352525b-c667-4ad0-bdca-f3be85b6197c tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:43.766653 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2352525b-c667-4ad0-bdca-f3be85b6197c tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:43.776787 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2352525b-c667-4ad0-bdca-f3be85b6197c tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:43.777385 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2352525b-c667-4ad0-bdca-f3be85b6197c tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:43.778101 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2352525b-c667-4ad0-bdca-f3be85b6197c tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:43.830023 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-ee692c39-f70e-4883-a716-ed34d495cfb4 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:43.838301 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-ee692c39-f70e-4883-a716-ed34d495cfb4 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/f747d5da-322c-4afb-bac6-c614b85656f9" status: 200 len: 1467 microversion: 2.1 time: 0.239262 Aug 10 17:52:43.838873 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 433/890] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:43 2022] GET /compute/v2.1/servers/f747d5da-322c-4afb-bac6-c614b85656f9 => generated 1467 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:43.864923 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-c6bb82ec-fcb2-4e59-b9fa-48e026783a46 tempest-ServersOnMultiNodesTest-116104069 tempest-ServersOnMultiNodesTest-116104069-project-admin] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:43.865681 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-c6bb82ec-fcb2-4e59-b9fa-48e026783a46 tempest-ServersOnMultiNodesTest-116104069 tempest-ServersOnMultiNodesTest-116104069-project-admin] [instance: f747d5da-322c-4afb-bac6-c614b85656f9] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:43.881576 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c6bb82ec-fcb2-4e59-b9fa-48e026783a46 tempest-ServersOnMultiNodesTest-116104069 tempest-ServersOnMultiNodesTest-116104069-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:43.902401 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c6bb82ec-fcb2-4e59-b9fa-48e026783a46 tempest-ServersOnMultiNodesTest-116104069 tempest-ServersOnMultiNodesTest-116104069-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:43.902401 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c6bb82ec-fcb2-4e59-b9fa-48e026783a46 tempest-ServersOnMultiNodesTest-116104069 tempest-ServersOnMultiNodesTest-116104069-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:43.902401 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c6bb82ec-fcb2-4e59-b9fa-48e026783a46 tempest-ServersOnMultiNodesTest-116104069 tempest-ServersOnMultiNodesTest-116104069-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:43.902401 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c6bb82ec-fcb2-4e59-b9fa-48e026783a46 tempest-ServersOnMultiNodesTest-116104069 tempest-ServersOnMultiNodesTest-116104069-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:43.902401 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c6bb82ec-fcb2-4e59-b9fa-48e026783a46 tempest-ServersOnMultiNodesTest-116104069 tempest-ServersOnMultiNodesTest-116104069-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:43.997788 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-2352525b-c667-4ad0-bdca-f3be85b6197c tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83a3e198e21476eb12fcf417aea62de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df088e5a610436ea21b8a360e2bb527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:44.006279 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-2352525b-c667-4ad0-bdca-f3be85b6197c tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] 10.222.0.50 "GET /compute/v2.1/servers/3ca0b504-e928-4d31-be09-24a70200eff2" status: 200 len: 1322 microversion: 2.1 time: 0.258656 Aug 10 17:52:44.006857 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 458/891] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:43 2022] GET /compute/v2.1/servers/3ca0b504-e928-4d31-be09-24a70200eff2 => generated 1322 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:44.057129 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-c6bb82ec-fcb2-4e59-b9fa-48e026783a46 tempest-ServersOnMultiNodesTest-116104069 tempest-ServersOnMultiNodesTest-116104069-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/f747d5da-322c-4afb-bac6-c614b85656f9" status: 200 len: 1618 microversion: 2.1 time: 0.201687 Aug 10 17:52:44.057869 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 434/892] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:43 2022] GET /compute/v2.1/servers/f747d5da-322c-4afb-bac6-c614b85656f9 => generated 1618 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:52:44.118132 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-052c06fb-f6c9-4d50-854a-0b2a4c310bec tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:44.118999 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-052c06fb-f6c9-4d50-854a-0b2a4c310bec tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] [instance: 6fffb7a0-b963-4fdc-8f5d-0fe046c6a7ed] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:44.128035 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-052c06fb-f6c9-4d50-854a-0b2a4c310bec tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:44.129022 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-052c06fb-f6c9-4d50-854a-0b2a4c310bec tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:44.129503 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-052c06fb-f6c9-4d50-854a-0b2a4c310bec tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:44.130213 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-052c06fb-f6c9-4d50-854a-0b2a4c310bec tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:44.130879 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-052c06fb-f6c9-4d50-854a-0b2a4c310bec tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:44.131311 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-052c06fb-f6c9-4d50-854a-0b2a4c310bec tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:44.168571 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-052c06fb-f6c9-4d50-854a-0b2a4c310bec tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:44.169065 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-052c06fb-f6c9-4d50-854a-0b2a4c310bec tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:44.169498 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-052c06fb-f6c9-4d50-854a-0b2a4c310bec tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:44.170597 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.objects.instance [None req-052c06fb-f6c9-4d50-854a-0b2a4c310bec tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lazy-loading 'fault' on Instance uuid 6fffb7a0-b963-4fdc-8f5d-0fe046c6a7ed {{(pid=129410) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:52:44.205586 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-eb59fd2c-645c-4026-9bad-19f3000575cc tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-271824893", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["af745ef7-21f0-4149-ba68-33f45f73f2dd"]}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:52:44.237352 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-052c06fb-f6c9-4d50-854a-0b2a4c310bec tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e109c3dcd0574faaa3d7ec31dd4edd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48bbb92998f54ebeb624bc794d406896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:44.253725 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-052c06fb-f6c9-4d50-854a-0b2a4c310bec tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] 10.222.0.50 "GET /compute/v2.1/servers/6fffb7a0-b963-4fdc-8f5d-0fe046c6a7ed" status: 200 len: 1302 microversion: 2.1 time: 0.139147 Aug 10 17:52:44.256342 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 459/893] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:44 2022] GET /compute/v2.1/servers/6fffb7a0-b963-4fdc-8f5d-0fe046c6a7ed => generated 1302 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:44.291827 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.network.neutron [None req-eb59fd2c-645c-4026-9bad-19f3000575cc tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] validate_networks() for None {{(pid=129409) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 17:52:44.495637 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-cbcaffe3-49cd-452e-8b98-186dd16aceb3 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:44.496561 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-cbcaffe3-49cd-452e-8b98-186dd16aceb3 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] [instance: e2777988-0bbf-496c-9c97-b206dbc94a62] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:44.504149 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-cbcaffe3-49cd-452e-8b98-186dd16aceb3 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:44.504676 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-cbcaffe3-49cd-452e-8b98-186dd16aceb3 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:44.505134 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-cbcaffe3-49cd-452e-8b98-186dd16aceb3 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:44.505829 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-cbcaffe3-49cd-452e-8b98-186dd16aceb3 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:44.506331 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-cbcaffe3-49cd-452e-8b98-186dd16aceb3 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:44.506762 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-cbcaffe3-49cd-452e-8b98-186dd16aceb3 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:44.579341 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-cbcaffe3-49cd-452e-8b98-186dd16aceb3 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:44.597616 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-cbcaffe3-49cd-452e-8b98-186dd16aceb3 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:44.599452 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-cbcaffe3-49cd-452e-8b98-186dd16aceb3 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:44.617406 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.virt.hardware [None req-eb59fd2c-645c-4026-9bad-19f3000575cc tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Flavor limits 0:0:0 {{(pid=129409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 17:52:44.617935 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.virt.hardware [None req-eb59fd2c-645c-4026-9bad-19f3000575cc tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Image limits 0:0:0 {{(pid=129409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 17:52:44.618525 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.virt.hardware [None req-eb59fd2c-645c-4026-9bad-19f3000575cc tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Flavor pref 0:0:0 {{(pid=129409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 17:52:44.619781 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.virt.hardware [None req-eb59fd2c-645c-4026-9bad-19f3000575cc tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Image pref 0:0:0 {{(pid=129409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 17:52:44.620224 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.virt.hardware [None req-eb59fd2c-645c-4026-9bad-19f3000575cc tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 17:52:44.625073 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-cbcaffe3-49cd-452e-8b98-186dd16aceb3 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] 10.222.0.50 "GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62" status: 200 len: 1451 microversion: 2.75 time: 0.130660 Aug 10 17:52:44.633193 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-eb59fd2c-645c-4026-9bad-19f3000575cc tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:44.633902 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-eb59fd2c-645c-4026-9bad-19f3000575cc tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:44.634669 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-eb59fd2c-645c-4026-9bad-19f3000575cc tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:44.635691 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-eb59fd2c-645c-4026-9bad-19f3000575cc tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:44.637156 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 460/894] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:52:44 2022] GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62 => generated 1451 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 17:52:44.637320 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-eb59fd2c-645c-4026-9bad-19f3000575cc tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:44.637913 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-eb59fd2c-645c-4026-9bad-19f3000575cc tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:44.659568 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-e0c1fb46-a48c-476c-bc3b-dfd7c3294d65 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:44.663159 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-e0c1fb46-a48c-476c-bc3b-dfd7c3294d65 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] [instance: bee3148a-3834-41bd-99e7-b5da75217256] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:44.672319 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-eb59fd2c-645c-4026-9bad-19f3000575cc tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Getting quotas for project 0638146d08704b2983761619745290b3. Resources: {'instances', 'ram', 'cores'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:52:44.673104 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e0c1fb46-a48c-476c-bc3b-dfd7c3294d65 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:44.674283 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e0c1fb46-a48c-476c-bc3b-dfd7c3294d65 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:44.674987 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e0c1fb46-a48c-476c-bc3b-dfd7c3294d65 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:44.677099 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e0c1fb46-a48c-476c-bc3b-dfd7c3294d65 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:44.679101 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e0c1fb46-a48c-476c-bc3b-dfd7c3294d65 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:44.680780 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e0c1fb46-a48c-476c-bc3b-dfd7c3294d65 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:44.682384 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-eb59fd2c-645c-4026-9bad-19f3000575cc tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Getting quotas for user f76b870a54454956b3926c34f9f27442 and project 0638146d08704b2983761619745290b3. Resources: {'instances', 'ram', 'cores'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:52:44.735913 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-eb59fd2c-645c-4026-9bad-19f3000575cc tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Going to run 1 instances... {{(pid=129409) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 17:52:44.743744 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-eb59fd2c-645c-4026-9bad-19f3000575cc tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: 873f60d0-8ef0-4ff5-800d-945ca4237a28] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a735ff26-463a-4ffe-a981-ab9d9baa494f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 17:52:45.001180 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-e0c1fb46-a48c-476c-bc3b-dfd7c3294d65 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2fd6acf18d4218ad143ccee2d0bb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7c2481a908406fa9c4562513fff665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:45.010528 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-e0c1fb46-a48c-476c-bc3b-dfd7c3294d65 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] 10.222.0.50 "GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256" status: 200 len: 1476 microversion: 2.1 time: 0.372102 Aug 10 17:52:45.011491 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 461/895] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:44 2022] GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256 => generated 1476 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:45.027609 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-7566a714-1895-437b-ba40-1b7e896c3ae3 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:45.032540 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-7566a714-1895-437b-ba40-1b7e896c3ae3 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] [instance: 3ca0b504-e928-4d31-be09-24a70200eff2] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:45.035902 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-7566a714-1895-437b-ba40-1b7e896c3ae3 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:45.036421 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-7566a714-1895-437b-ba40-1b7e896c3ae3 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:45.037098 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-7566a714-1895-437b-ba40-1b7e896c3ae3 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:45.037829 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-7566a714-1895-437b-ba40-1b7e896c3ae3 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:45.038283 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-7566a714-1895-437b-ba40-1b7e896c3ae3 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:45.038707 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-7566a714-1895-437b-ba40-1b7e896c3ae3 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:45.086964 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-eb59fd2c-645c-4026-9bad-19f3000575cc tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.888973 Aug 10 17:52:45.088458 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 435/896] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 17:52:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 891 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 10 17:52:45.099708 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-627ef00b-6731-462b-ad62-a5f87e8e2d84 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:45.100365 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-627ef00b-6731-462b-ad62-a5f87e8e2d84 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: 873f60d0-8ef0-4ff5-800d-945ca4237a28] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:45.207786 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-627ef00b-6731-462b-ad62-a5f87e8e2d84 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:45.226898 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-7566a714-1895-437b-ba40-1b7e896c3ae3 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83a3e198e21476eb12fcf417aea62de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df088e5a610436ea21b8a360e2bb527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:45.227514 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-627ef00b-6731-462b-ad62-a5f87e8e2d84 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/873f60d0-8ef0-4ff5-800d-945ca4237a28" status: 200 len: 1216 microversion: 2.1 time: 0.131417 Aug 10 17:52:45.228526 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 436/897] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:45 2022] GET /compute/v2.1/servers/873f60d0-8ef0-4ff5-800d-945ca4237a28 => generated 1216 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:52:45.235034 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-7566a714-1895-437b-ba40-1b7e896c3ae3 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] 10.222.0.50 "GET /compute/v2.1/servers/3ca0b504-e928-4d31-be09-24a70200eff2" status: 200 len: 1322 microversion: 2.1 time: 0.211822 Aug 10 17:52:45.235623 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 462/898] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:45 2022] GET /compute/v2.1/servers/3ca0b504-e928-4d31-be09-24a70200eff2 => generated 1322 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:52:45.281455 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-7f65f761-d46f-44f1-8b5c-947aa6f2eb99 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:45.282249 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-7f65f761-d46f-44f1-8b5c-947aa6f2eb99 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] [instance: 6fffb7a0-b963-4fdc-8f5d-0fe046c6a7ed] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:45.299981 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7f65f761-d46f-44f1-8b5c-947aa6f2eb99 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:45.300510 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7f65f761-d46f-44f1-8b5c-947aa6f2eb99 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:45.300962 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7f65f761-d46f-44f1-8b5c-947aa6f2eb99 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:45.302270 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7f65f761-d46f-44f1-8b5c-947aa6f2eb99 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:45.302270 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7f65f761-d46f-44f1-8b5c-947aa6f2eb99 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:45.302714 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7f65f761-d46f-44f1-8b5c-947aa6f2eb99 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:45.319733 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-7f65f761-d46f-44f1-8b5c-947aa6f2eb99 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] HTTP exception thrown: Instance 6fffb7a0-b963-4fdc-8f5d-0fe046c6a7ed could not be found. Aug 10 17:52:45.332867 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-7f65f761-d46f-44f1-8b5c-947aa6f2eb99 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Request method failure captured: Aug 10 17:52:45.332867 n-d-852296-2 devstack@n-api.service[129409]: request: GET /compute/v2.1/servers/6fffb7a0-b963-4fdc-8f5d-0fe046c6a7ed HTTP/1.1 Aug 10 17:52:45.332867 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 17:52:45.332867 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 17:52:45.332867 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 17:52:45.332867 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 0 Aug 10 17:52:45.332867 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 17:52:45.332867 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 17:52:45.332867 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 17:52:45.332867 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 17:52:45.332867 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8-_0hr6nliTkkjEq4POLxTS39b7AKRzs5IHoadOFYk-Avq_EhHZhiXBqUGkDcgCWPqhSAgOsv1fUEScaBilJPZ4n8-MqEuqv4LzNqxeh_dhY8n5FOoRyMW4xdBlwKatTDuceji8cWTk46ZLZhXUEi0tZyObBcD9QSkhHyY2UTCtQ3Ok Aug 10 17:52:45.332867 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 17:52:45.332867 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 17:52:45.332867 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 17:52:45.332867 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 17:52:45.332867 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 17:52:45.332867 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 17:52:45.332867 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: 48bbb92998f54ebeb624bc794d406896 Aug 10 17:52:45.332867 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-MigrationsAdminTest-561431726 Aug 10 17:52:45.332867 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 17:52:45.332867 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 17:52:45.332867 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/48bbb92998f54ebeb624bc794d406896"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/48bbb92998f54ebeb624bc794d406896"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/48bbb92998f54ebeb624bc794d406896"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_48bbb92998f54ebeb624bc794d406896", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:52:45.332867 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-MigrationsAdminTest-561431726 Aug 10 17:52:45.332867 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: 48bbb92998f54ebeb624bc794d406896 Aug 10 17:52:45.332867 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-MigrationsAdminTest-561431726 Aug 10 17:52:45.332867 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-MigrationsAdminTest-561431726-project Aug 10 17:52:45.332867 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 17:52:45.332867 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 17:52:45.332867 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: e109c3dcd0574faaa3d7ec31dd4edd24 Aug 10 17:52:45.332867 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-MigrationsAdminTest-561431726-project Aug 10 17:52:45.332867 n-d-852296-2 devstack@n-api.service[129409]: method: > Aug 10 17:52:45.332867 n-d-852296-2 devstack@n-api.service[129409]: exception: Instance 6fffb7a0-b963-4fdc-8f5d-0fe046c6a7ed could not be found. Aug 10 17:52:45.332867 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'id': '6fffb7a0-b963-4fdc-8f5d-0fe046c6a7ed'} Aug 10 17:52:45.332867 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:52:45.332867 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:52:45.332867 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 17:52:45.332867 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 17:52:45.332867 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 17:52:45.332867 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 17:52:45.332867 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 17:52:45.332867 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 17:52:45.332867 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 17:52:45.332867 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 17:52:45.332867 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6fffb7a0-b963-4fdc-8f5d-0fe046c6a7ed could not be found. Aug 10 17:52:45.332867 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:52:45.332867 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:52:45.332867 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:52:45.332867 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:52:45.332867 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:52:45.332867 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:52:45.332867 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:52:45.332867 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:52:45.332867 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:52:45.332867 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:52:45.332867 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 17:52:45.332867 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 17:52:45.332867 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 17:52:45.332867 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 17:52:45.332867 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 17:52:45.332867 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:52:45.332867 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6fffb7a0-b963-4fdc-8f5d-0fe046c6a7ed could not be found. Aug 10 17:52:45.332867 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:52:45.332867 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:52:45.332867 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:52:45.340389 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:52:45.340389 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:52:45.340389 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:52:45.340389 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:52:45.340389 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:52:45.340389 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6fffb7a0-b963-4fdc-8f5d-0fe046c6a7ed could not be found. Aug 10 17:52:45.340389 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:52:45.340389 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-7f65f761-d46f-44f1-8b5c-947aa6f2eb99 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Returning 404 to user: Instance 6fffb7a0-b963-4fdc-8f5d-0fe046c6a7ed could not be found. {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:52:45.340389 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-7f65f761-d46f-44f1-8b5c-947aa6f2eb99 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] 10.222.0.50 "GET /compute/v2.1/servers/6fffb7a0-b963-4fdc-8f5d-0fe046c6a7ed" status: 404 len: 111 microversion: 2.1 time: 0.059616 Aug 10 17:52:45.340389 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 437/899] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:45 2022] GET /compute/v2.1/servers/6fffb7a0-b963-4fdc-8f5d-0fe046c6a7ed => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:52:45.345480 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-21309486-d173-4c35-b086-137805eb7c7a tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:45.345977 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-21309486-d173-4c35-b086-137805eb7c7a tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] [instance: 43ff4d86-8c12-48ce-bcf5-c607c9bcaa05] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:45.360055 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-21309486-d173-4c35-b086-137805eb7c7a tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:45.360644 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-21309486-d173-4c35-b086-137805eb7c7a tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:45.361079 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-21309486-d173-4c35-b086-137805eb7c7a tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:45.361794 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-21309486-d173-4c35-b086-137805eb7c7a tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:45.362246 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-21309486-d173-4c35-b086-137805eb7c7a tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:45.362662 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-21309486-d173-4c35-b086-137805eb7c7a tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:45.409464 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-21309486-d173-4c35-b086-137805eb7c7a tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] [instance: 43ff4d86-8c12-48ce-bcf5-c607c9bcaa05] Going to try to terminate instance {{(pid=129410) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 17:52:45.655570 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-071b2cb5-b273-479b-acce-28946390d7d7 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:45.656529 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-071b2cb5-b273-479b-acce-28946390d7d7 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] [instance: e2777988-0bbf-496c-9c97-b206dbc94a62] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:45.663281 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-071b2cb5-b273-479b-acce-28946390d7d7 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:45.665921 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-071b2cb5-b273-479b-acce-28946390d7d7 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:45.665921 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-071b2cb5-b273-479b-acce-28946390d7d7 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:45.665921 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-071b2cb5-b273-479b-acce-28946390d7d7 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:45.666550 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-071b2cb5-b273-479b-acce-28946390d7d7 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:45.667005 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-071b2cb5-b273-479b-acce-28946390d7d7 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:45.743097 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-071b2cb5-b273-479b-acce-28946390d7d7 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:45.756391 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-071b2cb5-b273-479b-acce-28946390d7d7 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:45.757954 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-071b2cb5-b273-479b-acce-28946390d7d7 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:45.763337 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-071b2cb5-b273-479b-acce-28946390d7d7 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] 10.222.0.50 "GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62" status: 200 len: 1451 microversion: 2.75 time: 0.112358 Aug 10 17:52:45.764227 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 438/900] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:52:45 2022] GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62 => generated 1451 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:52:45.955793 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-21309486-d173-4c35-b086-137805eb7c7a tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] 10.222.0.50 "DELETE /compute/v2.1/servers/43ff4d86-8c12-48ce-bcf5-c607c9bcaa05" status: 204 len: 0 microversion: 2.1 time: 0.616267 Aug 10 17:52:45.956996 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 463/901] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 10 17:52:45 2022] DELETE /compute/v2.1/servers/43ff4d86-8c12-48ce-bcf5-c607c9bcaa05 => generated 0 bytes in 618 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 17:52:45.964880 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-fefee67c-239a-4a7c-952a-8b85818e764f tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:45.965795 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-fefee67c-239a-4a7c-952a-8b85818e764f tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] [instance: 43ff4d86-8c12-48ce-bcf5-c607c9bcaa05] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:45.975157 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-fefee67c-239a-4a7c-952a-8b85818e764f tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:45.977841 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-fefee67c-239a-4a7c-952a-8b85818e764f tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:45.978310 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-fefee67c-239a-4a7c-952a-8b85818e764f tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:45.980604 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-fefee67c-239a-4a7c-952a-8b85818e764f tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:45.985175 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-fefee67c-239a-4a7c-952a-8b85818e764f tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:45.985620 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-fefee67c-239a-4a7c-952a-8b85818e764f tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:46.038090 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-deee39bf-eee9-47ea-9403-be4f2f0e2f04 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:46.043567 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-deee39bf-eee9-47ea-9403-be4f2f0e2f04 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] [instance: bee3148a-3834-41bd-99e7-b5da75217256] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:46.050908 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-deee39bf-eee9-47ea-9403-be4f2f0e2f04 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:46.051636 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-deee39bf-eee9-47ea-9403-be4f2f0e2f04 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:46.057263 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-deee39bf-eee9-47ea-9403-be4f2f0e2f04 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:46.057263 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-deee39bf-eee9-47ea-9403-be4f2f0e2f04 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:46.057263 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-deee39bf-eee9-47ea-9403-be4f2f0e2f04 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:46.057263 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-deee39bf-eee9-47ea-9403-be4f2f0e2f04 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:46.210763 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-fefee67c-239a-4a7c-952a-8b85818e764f tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e109c3dcd0574faaa3d7ec31dd4edd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48bbb92998f54ebeb624bc794d406896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:46.221910 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-fefee67c-239a-4a7c-952a-8b85818e764f tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] 10.222.0.50 "GET /compute/v2.1/servers/43ff4d86-8c12-48ce-bcf5-c607c9bcaa05" status: 200 len: 1535 microversion: 2.1 time: 0.259407 Aug 10 17:52:46.223077 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 439/902] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:45 2022] GET /compute/v2.1/servers/43ff4d86-8c12-48ce-bcf5-c607c9bcaa05 => generated 1535 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:46.224168 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-deee39bf-eee9-47ea-9403-be4f2f0e2f04 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2fd6acf18d4218ad143ccee2d0bb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7c2481a908406fa9c4562513fff665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:46.228528 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [req-080ba1a0-61ce-4152-b602-6beb10d733c7 req-2419857c-bd75-4d45-b70b-869338eb4213 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bee3148a-3834-41bd-99e7-b5da75217256", "name": "network-vif-plugged", "status": "completed", "tag": "2f16a409-b711-4b31-9eb5-9884dbbe9489"}]} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:52:46.235177 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:52:46.239929 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-deee39bf-eee9-47ea-9403-be4f2f0e2f04 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] 10.222.0.50 "GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256" status: 200 len: 1476 microversion: 2.1 time: 0.203809 Aug 10 17:52:46.239929 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 464/903] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:46 2022] GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256 => generated 1476 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:46.240726 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-080ba1a0-61ce-4152-b602-6beb10d733c7 req-2419857c-bd75-4d45-b70b-869338eb4213 service nova] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:46.240726 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-080ba1a0-61ce-4152-b602-6beb10d733c7 req-2419857c-bd75-4d45-b70b-869338eb4213 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:46.240726 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-080ba1a0-61ce-4152-b602-6beb10d733c7 req-2419857c-bd75-4d45-b70b-869338eb4213 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:46.252045 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-4340de67-dc86-4002-b210-3cb1dde64ce5 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:46.253146 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-4340de67-dc86-4002-b210-3cb1dde64ce5 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: 873f60d0-8ef0-4ff5-800d-945ca4237a28] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:46.254985 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.compute.server_external_events [req-080ba1a0-61ce-4152-b602-6beb10d733c7 req-2419857c-bd75-4d45-b70b-869338eb4213 service nova] Creating event network-vif-plugged:2f16a409-b711-4b31-9eb5-9884dbbe9489 for instance bee3148a-3834-41bd-99e7-b5da75217256 on n-h2-852296-2 Aug 10 17:52:46.261399 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [req-080ba1a0-61ce-4152-b602-6beb10d733c7 req-2419857c-bd75-4d45-b70b-869338eb4213 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036855 Aug 10 17:52:46.262402 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 440/904] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 10 17:52:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:52:46.269168 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-258eb4ee-6a80-44bb-913d-4679e13af854 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:46.270067 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-258eb4ee-6a80-44bb-913d-4679e13af854 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] [instance: 3ca0b504-e928-4d31-be09-24a70200eff2] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:46.290210 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-258eb4ee-6a80-44bb-913d-4679e13af854 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:46.290210 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-258eb4ee-6a80-44bb-913d-4679e13af854 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:46.290210 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-258eb4ee-6a80-44bb-913d-4679e13af854 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:46.290210 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-258eb4ee-6a80-44bb-913d-4679e13af854 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:46.290210 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-258eb4ee-6a80-44bb-913d-4679e13af854 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:46.290210 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-258eb4ee-6a80-44bb-913d-4679e13af854 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:46.328239 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-4340de67-dc86-4002-b210-3cb1dde64ce5 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:46.335266 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-4340de67-dc86-4002-b210-3cb1dde64ce5 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/873f60d0-8ef0-4ff5-800d-945ca4237a28" status: 200 len: 1216 microversion: 2.1 time: 0.089547 Aug 10 17:52:46.335943 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 465/905] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:46 2022] GET /compute/v2.1/servers/873f60d0-8ef0-4ff5-800d-945ca4237a28 => generated 1216 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:46.458351 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-258eb4ee-6a80-44bb-913d-4679e13af854 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83a3e198e21476eb12fcf417aea62de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df088e5a610436ea21b8a360e2bb527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:46.468054 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-258eb4ee-6a80-44bb-913d-4679e13af854 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] 10.222.0.50 "GET /compute/v2.1/servers/3ca0b504-e928-4d31-be09-24a70200eff2" status: 200 len: 1322 microversion: 2.1 time: 0.203588 Aug 10 17:52:46.468848 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 441/906] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:46 2022] GET /compute/v2.1/servers/3ca0b504-e928-4d31-be09-24a70200eff2 => generated 1322 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:46.789869 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-9c3950e9-f588-455a-ae15-35deae660e2d tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:46.790494 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-9c3950e9-f588-455a-ae15-35deae660e2d tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] [instance: e2777988-0bbf-496c-9c97-b206dbc94a62] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:46.796570 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-9c3950e9-f588-455a-ae15-35deae660e2d tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:46.797050 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-9c3950e9-f588-455a-ae15-35deae660e2d tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:46.797479 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-9c3950e9-f588-455a-ae15-35deae660e2d tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:46.798156 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-9c3950e9-f588-455a-ae15-35deae660e2d tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:46.798603 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-9c3950e9-f588-455a-ae15-35deae660e2d tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:46.799024 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-9c3950e9-f588-455a-ae15-35deae660e2d tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:46.863102 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-9c3950e9-f588-455a-ae15-35deae660e2d tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:46.871117 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-9c3950e9-f588-455a-ae15-35deae660e2d tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:46.873342 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-9c3950e9-f588-455a-ae15-35deae660e2d tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:46.878297 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-9c3950e9-f588-455a-ae15-35deae660e2d tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] 10.222.0.50 "GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62" status: 200 len: 1451 microversion: 2.75 time: 0.092304 Aug 10 17:52:46.879026 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 466/907] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:52:46 2022] GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62 => generated 1451 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:52:47.243729 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-f49dbdd9-ac82-4905-be91-13d46aeb6b41 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:47.244356 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-f49dbdd9-ac82-4905-be91-13d46aeb6b41 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] [instance: 43ff4d86-8c12-48ce-bcf5-c607c9bcaa05] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:47.251962 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-f49dbdd9-ac82-4905-be91-13d46aeb6b41 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:47.252479 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-f49dbdd9-ac82-4905-be91-13d46aeb6b41 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:47.252927 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-f49dbdd9-ac82-4905-be91-13d46aeb6b41 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:47.253630 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-f49dbdd9-ac82-4905-be91-13d46aeb6b41 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:47.254130 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-f49dbdd9-ac82-4905-be91-13d46aeb6b41 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:47.254626 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-f49dbdd9-ac82-4905-be91-13d46aeb6b41 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:47.260728 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-b4a58a69-79c9-4256-9ace-3ae9d027c42c tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:47.262237 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-b4a58a69-79c9-4256-9ace-3ae9d027c42c tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] [instance: bee3148a-3834-41bd-99e7-b5da75217256] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:47.270224 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b4a58a69-79c9-4256-9ace-3ae9d027c42c tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:47.270720 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b4a58a69-79c9-4256-9ace-3ae9d027c42c tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:47.271160 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b4a58a69-79c9-4256-9ace-3ae9d027c42c tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:47.271902 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b4a58a69-79c9-4256-9ace-3ae9d027c42c tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:47.272845 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b4a58a69-79c9-4256-9ace-3ae9d027c42c tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:47.273279 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b4a58a69-79c9-4256-9ace-3ae9d027c42c tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:47.431956 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-b4a58a69-79c9-4256-9ace-3ae9d027c42c tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2fd6acf18d4218ad143ccee2d0bb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7c2481a908406fa9c4562513fff665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:47.441159 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-f49dbdd9-ac82-4905-be91-13d46aeb6b41 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e109c3dcd0574faaa3d7ec31dd4edd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48bbb92998f54ebeb624bc794d406896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:47.445369 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-b4a58a69-79c9-4256-9ace-3ae9d027c42c tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] 10.222.0.50 "GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256" status: 200 len: 1476 microversion: 2.1 time: 0.185328 Aug 10 17:52:47.445369 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 467/908] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:47 2022] GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256 => generated 1476 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:52:47.451491 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-f49dbdd9-ac82-4905-be91-13d46aeb6b41 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] 10.222.0.50 "GET /compute/v2.1/servers/43ff4d86-8c12-48ce-bcf5-c607c9bcaa05" status: 200 len: 1535 microversion: 2.1 time: 0.211757 Aug 10 17:52:47.460480 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 442/909] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:47 2022] GET /compute/v2.1/servers/43ff4d86-8c12-48ce-bcf5-c607c9bcaa05 => generated 1535 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:47.460580 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-81cdb8ca-f8e4-45c4-8e64-50084bf0d9ee tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:47.461768 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-81cdb8ca-f8e4-45c4-8e64-50084bf0d9ee tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: 873f60d0-8ef0-4ff5-800d-945ca4237a28] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:47.468595 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-81cdb8ca-f8e4-45c4-8e64-50084bf0d9ee tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:47.469084 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-81cdb8ca-f8e4-45c4-8e64-50084bf0d9ee tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:47.469655 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-81cdb8ca-f8e4-45c4-8e64-50084bf0d9ee tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:47.470388 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-81cdb8ca-f8e4-45c4-8e64-50084bf0d9ee tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:47.470962 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-81cdb8ca-f8e4-45c4-8e64-50084bf0d9ee tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:47.471397 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-81cdb8ca-f8e4-45c4-8e64-50084bf0d9ee tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:47.491003 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-5b13b4a0-1456-4154-9969-cd33dc18122b tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:47.491951 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-5b13b4a0-1456-4154-9969-cd33dc18122b tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] [instance: 3ca0b504-e928-4d31-be09-24a70200eff2] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:47.499166 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-5b13b4a0-1456-4154-9969-cd33dc18122b tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:47.502811 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-5b13b4a0-1456-4154-9969-cd33dc18122b tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:47.502811 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-5b13b4a0-1456-4154-9969-cd33dc18122b tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:47.502811 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-5b13b4a0-1456-4154-9969-cd33dc18122b tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:47.502811 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-5b13b4a0-1456-4154-9969-cd33dc18122b tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:47.502811 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-5b13b4a0-1456-4154-9969-cd33dc18122b tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:47.540076 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-81cdb8ca-f8e4-45c4-8e64-50084bf0d9ee tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:47.542722 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:52:47.549083 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-81cdb8ca-f8e4-45c4-8e64-50084bf0d9ee tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/873f60d0-8ef0-4ff5-800d-945ca4237a28" status: 200 len: 1220 microversion: 2.1 time: 0.105001 Aug 10 17:52:47.549792 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 468/910] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:47 2022] GET /compute/v2.1/servers/873f60d0-8ef0-4ff5-800d-945ca4237a28 => generated 1220 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:47.645130 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-5b13b4a0-1456-4154-9969-cd33dc18122b tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83a3e198e21476eb12fcf417aea62de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df088e5a610436ea21b8a360e2bb527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:47.660282 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-5b13b4a0-1456-4154-9969-cd33dc18122b tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] 10.222.0.50 "GET /compute/v2.1/servers/3ca0b504-e928-4d31-be09-24a70200eff2" status: 200 len: 1471 microversion: 2.1 time: 0.174619 Aug 10 17:52:47.660943 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 443/911] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:47 2022] GET /compute/v2.1/servers/3ca0b504-e928-4d31-be09-24a70200eff2 => generated 1471 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:52:47.683090 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-064add76-c2ad-43e9-96ad-a97b394b759f tempest-ServersAdminNegativeTestJSON-307727315 tempest-ServersAdminNegativeTestJSON-307727315-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:52:47.683633 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-064add76-c2ad-43e9-96ad-a97b394b759f tempest-ServersAdminNegativeTestJSON-307727315 tempest-ServersAdminNegativeTestJSON-307727315-project-admin] [instance: 3ca0b504-e928-4d31-be09-24a70200eff2] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:47.690933 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-064add76-c2ad-43e9-96ad-a97b394b759f tempest-ServersAdminNegativeTestJSON-307727315 tempest-ServersAdminNegativeTestJSON-307727315-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:47.691428 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-064add76-c2ad-43e9-96ad-a97b394b759f tempest-ServersAdminNegativeTestJSON-307727315 tempest-ServersAdminNegativeTestJSON-307727315-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:47.691888 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-064add76-c2ad-43e9-96ad-a97b394b759f tempest-ServersAdminNegativeTestJSON-307727315 tempest-ServersAdminNegativeTestJSON-307727315-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:47.692641 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-064add76-c2ad-43e9-96ad-a97b394b759f tempest-ServersAdminNegativeTestJSON-307727315 tempest-ServersAdminNegativeTestJSON-307727315-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:47.693131 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-064add76-c2ad-43e9-96ad-a97b394b759f tempest-ServersAdminNegativeTestJSON-307727315 tempest-ServersAdminNegativeTestJSON-307727315-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:47.693585 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-064add76-c2ad-43e9-96ad-a97b394b759f tempest-ServersAdminNegativeTestJSON-307727315 tempest-ServersAdminNegativeTestJSON-307727315-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:47.728691 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.objects.instance [None req-064add76-c2ad-43e9-96ad-a97b394b759f tempest-ServersAdminNegativeTestJSON-307727315 tempest-ServersAdminNegativeTestJSON-307727315-project-admin] Lazy-loading 'flavor' on Instance uuid 3ca0b504-e928-4d31-be09-24a70200eff2 {{(pid=129410) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:52:47.916290 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-03d3c38d-8244-46ad-943f-ab166204c576 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:47.916290 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-03d3c38d-8244-46ad-943f-ab166204c576 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] [instance: e2777988-0bbf-496c-9c97-b206dbc94a62] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:47.923675 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-03d3c38d-8244-46ad-943f-ab166204c576 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:47.924183 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-03d3c38d-8244-46ad-943f-ab166204c576 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:47.924655 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-03d3c38d-8244-46ad-943f-ab166204c576 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:47.925378 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-03d3c38d-8244-46ad-943f-ab166204c576 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:47.925840 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-03d3c38d-8244-46ad-943f-ab166204c576 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:47.926269 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-03d3c38d-8244-46ad-943f-ab166204c576 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:48.007404 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-03d3c38d-8244-46ad-943f-ab166204c576 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:48.016578 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-03d3c38d-8244-46ad-943f-ab166204c576 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:48.030961 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-03d3c38d-8244-46ad-943f-ab166204c576 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:48.030961 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-03d3c38d-8244-46ad-943f-ab166204c576 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] 10.222.0.50 "GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62" status: 200 len: 1451 microversion: 2.75 time: 0.125446 Aug 10 17:52:48.030961 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 444/912] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:52:47 2022] GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62 => generated 1451 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:52:48.467347 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-f2bdfa49-a0a4-4b22-ae53-8eef47a67dc5 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:48.469176 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-f2bdfa49-a0a4-4b22-ae53-8eef47a67dc5 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] [instance: bee3148a-3834-41bd-99e7-b5da75217256] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:48.476743 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-f2bdfa49-a0a4-4b22-ae53-8eef47a67dc5 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:48.477353 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-f2bdfa49-a0a4-4b22-ae53-8eef47a67dc5 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:48.477930 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-f2bdfa49-a0a4-4b22-ae53-8eef47a67dc5 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:48.486293 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-f2bdfa49-a0a4-4b22-ae53-8eef47a67dc5 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:48.486860 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-064add76-c2ad-43e9-96ad-a97b394b759f tempest-ServersAdminNegativeTestJSON-307727315 tempest-ServersAdminNegativeTestJSON-307727315-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/3ca0b504-e928-4d31-be09-24a70200eff2/action" status: 202 len: 0 microversion: 2.1 time: 0.808694 Aug 10 17:52:48.500471 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-f2bdfa49-a0a4-4b22-ae53-8eef47a67dc5 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:48.500640 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 469/913] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 10 17:52:47 2022] POST /compute/v2.1/servers/3ca0b504-e928-4d31-be09-24a70200eff2/action => generated 0 bytes in 811 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 17:52:48.500740 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-f2bdfa49-a0a4-4b22-ae53-8eef47a67dc5 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:48.500916 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-e1fc6168-d2c2-45fb-805f-3e2319ba6488 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:48.500916 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-e1fc6168-d2c2-45fb-805f-3e2319ba6488 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] [instance: 43ff4d86-8c12-48ce-bcf5-c607c9bcaa05] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:48.518270 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e1fc6168-d2c2-45fb-805f-3e2319ba6488 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:48.518824 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e1fc6168-d2c2-45fb-805f-3e2319ba6488 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:48.519320 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e1fc6168-d2c2-45fb-805f-3e2319ba6488 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:48.520228 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e1fc6168-d2c2-45fb-805f-3e2319ba6488 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:48.520908 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e1fc6168-d2c2-45fb-805f-3e2319ba6488 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:48.521480 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e1fc6168-d2c2-45fb-805f-3e2319ba6488 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:48.614297 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-e1fc6168-d2c2-45fb-805f-3e2319ba6488 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e109c3dcd0574faaa3d7ec31dd4edd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48bbb92998f54ebeb624bc794d406896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:48.624945 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-e1fc6168-d2c2-45fb-805f-3e2319ba6488 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] 10.222.0.50 "GET /compute/v2.1/servers/43ff4d86-8c12-48ce-bcf5-c607c9bcaa05" status: 200 len: 1493 microversion: 2.1 time: 0.135623 Aug 10 17:52:48.639319 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 470/914] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:48 2022] GET /compute/v2.1/servers/43ff4d86-8c12-48ce-bcf5-c607c9bcaa05 => generated 1493 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:48.641614 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-a7648ca9-c91d-4ca6-9e7d-8356d4f615ac tempest-ServersAdminNegativeTestJSON-307727315 tempest-ServersAdminNegativeTestJSON-307727315-project-admin] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:48.642043 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-a7648ca9-c91d-4ca6-9e7d-8356d4f615ac tempest-ServersAdminNegativeTestJSON-307727315 tempest-ServersAdminNegativeTestJSON-307727315-project-admin] [instance: 3ca0b504-e928-4d31-be09-24a70200eff2] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:48.653325 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a7648ca9-c91d-4ca6-9e7d-8356d4f615ac tempest-ServersAdminNegativeTestJSON-307727315 tempest-ServersAdminNegativeTestJSON-307727315-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:48.655147 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a7648ca9-c91d-4ca6-9e7d-8356d4f615ac tempest-ServersAdminNegativeTestJSON-307727315 tempest-ServersAdminNegativeTestJSON-307727315-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:48.656479 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a7648ca9-c91d-4ca6-9e7d-8356d4f615ac tempest-ServersAdminNegativeTestJSON-307727315 tempest-ServersAdminNegativeTestJSON-307727315-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:48.657523 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a7648ca9-c91d-4ca6-9e7d-8356d4f615ac tempest-ServersAdminNegativeTestJSON-307727315 tempest-ServersAdminNegativeTestJSON-307727315-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:48.658935 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a7648ca9-c91d-4ca6-9e7d-8356d4f615ac tempest-ServersAdminNegativeTestJSON-307727315 tempest-ServersAdminNegativeTestJSON-307727315-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:48.659654 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a7648ca9-c91d-4ca6-9e7d-8356d4f615ac tempest-ServersAdminNegativeTestJSON-307727315 tempest-ServersAdminNegativeTestJSON-307727315-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:48.978033 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-f2bdfa49-a0a4-4b22-ae53-8eef47a67dc5 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2fd6acf18d4218ad143ccee2d0bb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7c2481a908406fa9c4562513fff665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:48.986507 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-f2bdfa49-a0a4-4b22-ae53-8eef47a67dc5 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] 10.222.0.50 "GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256" status: 200 len: 1476 microversion: 2.1 time: 0.524643 Aug 10 17:52:48.987147 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 445/915] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:48 2022] GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256 => generated 1476 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:52:48.992105 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-81e37482-bad1-43a3-b417-038aa7e49f46 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:48.992774 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-81e37482-bad1-43a3-b417-038aa7e49f46 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: 873f60d0-8ef0-4ff5-800d-945ca4237a28] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:48.999805 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-81e37482-bad1-43a3-b417-038aa7e49f46 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:49.000447 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-81e37482-bad1-43a3-b417-038aa7e49f46 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:49.000960 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-81e37482-bad1-43a3-b417-038aa7e49f46 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:49.001741 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-81e37482-bad1-43a3-b417-038aa7e49f46 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:49.002266 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-81e37482-bad1-43a3-b417-038aa7e49f46 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:49.002811 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-81e37482-bad1-43a3-b417-038aa7e49f46 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:49.068541 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-81e37482-bad1-43a3-b417-038aa7e49f46 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:49.076860 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-81e37482-bad1-43a3-b417-038aa7e49f46 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/873f60d0-8ef0-4ff5-800d-945ca4237a28" status: 200 len: 1268 microversion: 2.1 time: 0.088690 Aug 10 17:52:49.077635 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 446/916] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:48 2022] GET /compute/v2.1/servers/873f60d0-8ef0-4ff5-800d-945ca4237a28 => generated 1268 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:49.083421 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [req-1a72c3a9-9ac8-4272-b79e-f39fe0b2b540 req-dab4cd83-d576-4416-8f96-0c74fdd3cb0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43ff4d86-8c12-48ce-bcf5-c607c9bcaa05", "name": "network-vif-deleted", "tag": "50148ea5-cdd9-47b3-8521-2b838cc4745f"}]} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:52:49.095812 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-1a72c3a9-9ac8-4272-b79e-f39fe0b2b540 req-dab4cd83-d576-4416-8f96-0c74fdd3cb0b service nova] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:49.096431 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-1a72c3a9-9ac8-4272-b79e-f39fe0b2b540 req-dab4cd83-d576-4416-8f96-0c74fdd3cb0b service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:49.097084 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-1a72c3a9-9ac8-4272-b79e-f39fe0b2b540 req-dab4cd83-d576-4416-8f96-0c74fdd3cb0b service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:49.110373 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.compute.server_external_events [req-1a72c3a9-9ac8-4272-b79e-f39fe0b2b540 req-dab4cd83-d576-4416-8f96-0c74fdd3cb0b service nova] Creating event network-vif-deleted:50148ea5-cdd9-47b3-8521-2b838cc4745f for instance 43ff4d86-8c12-48ce-bcf5-c607c9bcaa05 on n-h2-852296-2 Aug 10 17:52:49.115408 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [req-1a72c3a9-9ac8-4272-b79e-f39fe0b2b540 req-dab4cd83-d576-4416-8f96-0c74fdd3cb0b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036449 Aug 10 17:52:49.116085 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 447/917] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 10 17:52:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:52:49.122361 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-50cc2636-598b-439c-ab54-28ba94a093e3 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:49.124305 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-50cc2636-598b-439c-ab54-28ba94a093e3 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] [instance: e2777988-0bbf-496c-9c97-b206dbc94a62] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:49.131281 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-50cc2636-598b-439c-ab54-28ba94a093e3 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:49.131768 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-50cc2636-598b-439c-ab54-28ba94a093e3 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:49.132205 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-50cc2636-598b-439c-ab54-28ba94a093e3 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:49.132924 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-50cc2636-598b-439c-ab54-28ba94a093e3 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:49.133416 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-50cc2636-598b-439c-ab54-28ba94a093e3 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:49.133841 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-50cc2636-598b-439c-ab54-28ba94a093e3 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:49.204796 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-a7648ca9-c91d-4ca6-9e7d-8356d4f615ac tempest-ServersAdminNegativeTestJSON-307727315 tempest-ServersAdminNegativeTestJSON-307727315-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/3ca0b504-e928-4d31-be09-24a70200eff2" status: 200 len: 1630 microversion: 2.1 time: 0.568297 Aug 10 17:52:49.204796 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 471/918] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:48 2022] GET /compute/v2.1/servers/3ca0b504-e928-4d31-be09-24a70200eff2 => generated 1630 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:49.223159 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-50cc2636-598b-439c-ab54-28ba94a093e3 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:49.234081 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-50cc2636-598b-439c-ab54-28ba94a093e3 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:49.235616 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-50cc2636-598b-439c-ab54-28ba94a093e3 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:49.241519 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-50cc2636-598b-439c-ab54-28ba94a093e3 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] 10.222.0.50 "GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62" status: 200 len: 1436 microversion: 2.75 time: 0.124027 Aug 10 17:52:49.244380 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 448/919] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:52:49 2022] GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62 => generated 1436 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:52:49.477448 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-e661f7f4-9ac0-4649-81e4-9de5558ca7e6 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f"}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:52:49.480291 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-e661f7f4-9ac0-4649-81e4-9de5558ca7e6 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] [instance: e2777988-0bbf-496c-9c97-b206dbc94a62] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:49.486921 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e661f7f4-9ac0-4649-81e4-9de5558ca7e6 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:49.487494 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e661f7f4-9ac0-4649-81e4-9de5558ca7e6 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:49.487878 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e661f7f4-9ac0-4649-81e4-9de5558ca7e6 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:49.488620 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e661f7f4-9ac0-4649-81e4-9de5558ca7e6 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:49.489077 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e661f7f4-9ac0-4649-81e4-9de5558ca7e6 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:49.489502 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e661f7f4-9ac0-4649-81e4-9de5558ca7e6 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:49.574498 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.virt.hardware [None req-e661f7f4-9ac0-4649-81e4-9de5558ca7e6 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Flavor limits 0:0:0 {{(pid=129410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 17:52:49.574498 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.virt.hardware [None req-e661f7f4-9ac0-4649-81e4-9de5558ca7e6 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Image limits 0:0:0 {{(pid=129410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 17:52:49.574498 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.virt.hardware [None req-e661f7f4-9ac0-4649-81e4-9de5558ca7e6 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Flavor pref 0:0:0 {{(pid=129410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 17:52:49.576160 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.virt.hardware [None req-e661f7f4-9ac0-4649-81e4-9de5558ca7e6 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Image pref 0:0:0 {{(pid=129410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 17:52:49.576831 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.virt.hardware [None req-e661f7f4-9ac0-4649-81e4-9de5558ca7e6 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 17:52:49.646399 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-55db3e3c-638d-4aa5-81dc-9e79717f1894 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:49.647227 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-55db3e3c-638d-4aa5-81dc-9e79717f1894 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] [instance: 43ff4d86-8c12-48ce-bcf5-c607c9bcaa05] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:49.662965 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-55db3e3c-638d-4aa5-81dc-9e79717f1894 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:49.663510 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-55db3e3c-638d-4aa5-81dc-9e79717f1894 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:49.663985 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-55db3e3c-638d-4aa5-81dc-9e79717f1894 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:49.664778 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-55db3e3c-638d-4aa5-81dc-9e79717f1894 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:49.665273 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-55db3e3c-638d-4aa5-81dc-9e79717f1894 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:49.665708 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-55db3e3c-638d-4aa5-81dc-9e79717f1894 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:49.740487 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-55db3e3c-638d-4aa5-81dc-9e79717f1894 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e109c3dcd0574faaa3d7ec31dd4edd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48bbb92998f54ebeb624bc794d406896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:49.749551 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-55db3e3c-638d-4aa5-81dc-9e79717f1894 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] 10.222.0.50 "GET /compute/v2.1/servers/43ff4d86-8c12-48ce-bcf5-c607c9bcaa05" status: 200 len: 1364 microversion: 2.1 time: 0.106951 Aug 10 17:52:49.750462 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 449/920] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:49 2022] GET /compute/v2.1/servers/43ff4d86-8c12-48ce-bcf5-c607c9bcaa05 => generated 1364 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:52:50.009153 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-8a347e4e-62b0-44a6-a166-647d9fc77483 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:50.009778 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-8a347e4e-62b0-44a6-a166-647d9fc77483 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] [instance: bee3148a-3834-41bd-99e7-b5da75217256] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:50.017034 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-8a347e4e-62b0-44a6-a166-647d9fc77483 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:50.017524 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-8a347e4e-62b0-44a6-a166-647d9fc77483 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:50.017970 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-8a347e4e-62b0-44a6-a166-647d9fc77483 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:50.018669 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-8a347e4e-62b0-44a6-a166-647d9fc77483 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:50.019140 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-8a347e4e-62b0-44a6-a166-647d9fc77483 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:50.019567 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-8a347e4e-62b0-44a6-a166-647d9fc77483 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:50.152559 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-8a347e4e-62b0-44a6-a166-647d9fc77483 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2fd6acf18d4218ad143ccee2d0bb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7c2481a908406fa9c4562513fff665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:50.161522 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-8a347e4e-62b0-44a6-a166-647d9fc77483 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] 10.222.0.50 "GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256" status: 200 len: 1462 microversion: 2.1 time: 0.156230 Aug 10 17:52:50.162044 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 450/921] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:50 2022] GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256 => generated 1462 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:52:50.166623 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-1644220c-b94d-4c3c-99f3-50e3b6fa8a76 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:50.167208 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-1644220c-b94d-4c3c-99f3-50e3b6fa8a76 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: 873f60d0-8ef0-4ff5-800d-945ca4237a28] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:50.173362 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-1644220c-b94d-4c3c-99f3-50e3b6fa8a76 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:50.173935 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-1644220c-b94d-4c3c-99f3-50e3b6fa8a76 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:50.174403 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-1644220c-b94d-4c3c-99f3-50e3b6fa8a76 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:50.175121 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-1644220c-b94d-4c3c-99f3-50e3b6fa8a76 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:50.175582 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-1644220c-b94d-4c3c-99f3-50e3b6fa8a76 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:50.176036 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-1644220c-b94d-4c3c-99f3-50e3b6fa8a76 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:50.197666 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-e661f7f4-9ac0-4649-81e4-9de5558ca7e6 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] [instance: e2777988-0bbf-496c-9c97-b206dbc94a62] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:50.204840 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e661f7f4-9ac0-4649-81e4-9de5558ca7e6 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:50.205333 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e661f7f4-9ac0-4649-81e4-9de5558ca7e6 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:50.205776 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e661f7f4-9ac0-4649-81e4-9de5558ca7e6 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:50.206672 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e661f7f4-9ac0-4649-81e4-9de5558ca7e6 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:50.207129 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e661f7f4-9ac0-4649-81e4-9de5558ca7e6 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:50.207578 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e661f7f4-9ac0-4649-81e4-9de5558ca7e6 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:50.243427 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-1644220c-b94d-4c3c-99f3-50e3b6fa8a76 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:50.251662 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-1644220c-b94d-4c3c-99f3-50e3b6fa8a76 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/873f60d0-8ef0-4ff5-800d-945ca4237a28" status: 200 len: 1268 microversion: 2.1 time: 0.088605 Aug 10 17:52:50.252239 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 451/922] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:50 2022] GET /compute/v2.1/servers/873f60d0-8ef0-4ff5-800d-945ca4237a28 => generated 1268 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:50.265196 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-43c4b2f1-b886-419a-b60c-e226335ecb64 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:50.265196 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-43c4b2f1-b886-419a-b60c-e226335ecb64 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] [instance: bee3148a-3834-41bd-99e7-b5da75217256] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:50.265196 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-43c4b2f1-b886-419a-b60c-e226335ecb64 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:50.265196 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-43c4b2f1-b886-419a-b60c-e226335ecb64 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:50.265196 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-43c4b2f1-b886-419a-b60c-e226335ecb64 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:50.265196 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-43c4b2f1-b886-419a-b60c-e226335ecb64 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:50.270815 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-43c4b2f1-b886-419a-b60c-e226335ecb64 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:50.270815 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-43c4b2f1-b886-419a-b60c-e226335ecb64 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:50.281880 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_cell1:SELECT=100 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:52:50.410666 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.objects.instance [None req-e661f7f4-9ac0-4649-81e4-9de5558ca7e6 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lazy-loading 'services' on Instance uuid e2777988-0bbf-496c-9c97-b206dbc94a62 {{(pid=129410) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:52:50.503566 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-e661f7f4-9ac0-4649-81e4-9de5558ca7e6 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62/action" status: 202 len: 1938 microversion: 2.75 time: 1.236975 Aug 10 17:52:50.515782 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 472/923] 10.222.0.50 () {62 vars in 1319 bytes} [Wed Aug 10 17:52:49 2022] POST /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62/action => generated 1938 bytes in 1239 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Aug 10 17:52:50.515782 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-cc54fbe9-4c16-4f65-9027-03582e514401 tempest-ServersAdminNegativeTestJSON-307727315 tempest-ServersAdminNegativeTestJSON-307727315-project-admin] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:50.515782 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-cc54fbe9-4c16-4f65-9027-03582e514401 tempest-ServersAdminNegativeTestJSON-307727315 tempest-ServersAdminNegativeTestJSON-307727315-project-admin] [instance: 3ca0b504-e928-4d31-be09-24a70200eff2] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:50.518681 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-cc54fbe9-4c16-4f65-9027-03582e514401 tempest-ServersAdminNegativeTestJSON-307727315 tempest-ServersAdminNegativeTestJSON-307727315-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:50.519240 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-cc54fbe9-4c16-4f65-9027-03582e514401 tempest-ServersAdminNegativeTestJSON-307727315 tempest-ServersAdminNegativeTestJSON-307727315-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:50.519787 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-cc54fbe9-4c16-4f65-9027-03582e514401 tempest-ServersAdminNegativeTestJSON-307727315 tempest-ServersAdminNegativeTestJSON-307727315-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:50.521446 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-cc54fbe9-4c16-4f65-9027-03582e514401 tempest-ServersAdminNegativeTestJSON-307727315 tempest-ServersAdminNegativeTestJSON-307727315-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:50.522140 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-cc54fbe9-4c16-4f65-9027-03582e514401 tempest-ServersAdminNegativeTestJSON-307727315 tempest-ServersAdminNegativeTestJSON-307727315-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:50.522796 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-cc54fbe9-4c16-4f65-9027-03582e514401 tempest-ServersAdminNegativeTestJSON-307727315 tempest-ServersAdminNegativeTestJSON-307727315-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:50.585151 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-43c4b2f1-b886-419a-b60c-e226335ecb64 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2fd6acf18d4218ad143ccee2d0bb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7c2481a908406fa9c4562513fff665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:50.596658 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-43c4b2f1-b886-419a-b60c-e226335ecb64 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] 10.222.0.50 "GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256" status: 200 len: 1462 microversion: 2.1 time: 0.343233 Aug 10 17:52:50.597439 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 452/924] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:50 2022] GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256 => generated 1462 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:50.603590 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-81e19a2c-f2d7-4fdc-a7a6-09411ed24d92 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:50.605263 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-81e19a2c-f2d7-4fdc-a7a6-09411ed24d92 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] [instance: e2777988-0bbf-496c-9c97-b206dbc94a62] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:50.613235 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-81e19a2c-f2d7-4fdc-a7a6-09411ed24d92 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:50.613947 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-81e19a2c-f2d7-4fdc-a7a6-09411ed24d92 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:50.615884 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-81e19a2c-f2d7-4fdc-a7a6-09411ed24d92 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:50.615884 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-81e19a2c-f2d7-4fdc-a7a6-09411ed24d92 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:50.615884 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-81e19a2c-f2d7-4fdc-a7a6-09411ed24d92 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:50.616387 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-81e19a2c-f2d7-4fdc-a7a6-09411ed24d92 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:50.742338 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-cc54fbe9-4c16-4f65-9027-03582e514401 tempest-ServersAdminNegativeTestJSON-307727315 tempest-ServersAdminNegativeTestJSON-307727315-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/3ca0b504-e928-4d31-be09-24a70200eff2" status: 200 len: 1613 microversion: 2.1 time: 0.236291 Aug 10 17:52:50.742920 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 473/925] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:50 2022] GET /compute/v2.1/servers/3ca0b504-e928-4d31-be09-24a70200eff2 => generated 1613 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:50.748516 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-9f24fe71-3d73-4f76-a016-2c6b8beb5928 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f"}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:52:50.751190 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-9f24fe71-3d73-4f76-a016-2c6b8beb5928 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] [instance: bee3148a-3834-41bd-99e7-b5da75217256] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:50.757100 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-9f24fe71-3d73-4f76-a016-2c6b8beb5928 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:50.757579 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-9f24fe71-3d73-4f76-a016-2c6b8beb5928 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:50.758171 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-9f24fe71-3d73-4f76-a016-2c6b8beb5928 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:50.759125 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-9f24fe71-3d73-4f76-a016-2c6b8beb5928 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:50.759585 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-9f24fe71-3d73-4f76-a016-2c6b8beb5928 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:50.760307 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-9f24fe71-3d73-4f76-a016-2c6b8beb5928 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:50.762199 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.objects.instance [None req-81e19a2c-f2d7-4fdc-a7a6-09411ed24d92 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lazy-loading 'services' on Instance uuid e2777988-0bbf-496c-9c97-b206dbc94a62 {{(pid=129409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:52:50.825152 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-81e19a2c-f2d7-4fdc-a7a6-09411ed24d92 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62" status: 200 len: 1925 microversion: 2.75 time: 0.225756 Aug 10 17:52:50.827049 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 453/926] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:52:50 2022] GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62 => generated 1925 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:52:50.833800 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-dd992649-3496-473a-aac3-49085b72b59a tempest-ServersAdminNegativeTestJSON-307727315 tempest-ServersAdminNegativeTestJSON-307727315-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:52:50.834719 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-dd992649-3496-473a-aac3-49085b72b59a tempest-ServersAdminNegativeTestJSON-307727315 tempest-ServersAdminNegativeTestJSON-307727315-project-admin] [instance: 3ca0b504-e928-4d31-be09-24a70200eff2] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:50.843914 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-dd992649-3496-473a-aac3-49085b72b59a tempest-ServersAdminNegativeTestJSON-307727315 tempest-ServersAdminNegativeTestJSON-307727315-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:50.844490 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-dd992649-3496-473a-aac3-49085b72b59a tempest-ServersAdminNegativeTestJSON-307727315 tempest-ServersAdminNegativeTestJSON-307727315-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:50.845147 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-dd992649-3496-473a-aac3-49085b72b59a tempest-ServersAdminNegativeTestJSON-307727315 tempest-ServersAdminNegativeTestJSON-307727315-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:50.846050 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-dd992649-3496-473a-aac3-49085b72b59a tempest-ServersAdminNegativeTestJSON-307727315 tempest-ServersAdminNegativeTestJSON-307727315-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:50.847224 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-dd992649-3496-473a-aac3-49085b72b59a tempest-ServersAdminNegativeTestJSON-307727315 tempest-ServersAdminNegativeTestJSON-307727315-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:50.847725 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-dd992649-3496-473a-aac3-49085b72b59a tempest-ServersAdminNegativeTestJSON-307727315 tempest-ServersAdminNegativeTestJSON-307727315-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:50.864162 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.virt.hardware [None req-9f24fe71-3d73-4f76-a016-2c6b8beb5928 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Flavor limits 0:0:0 {{(pid=129410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 17:52:50.864990 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.virt.hardware [None req-9f24fe71-3d73-4f76-a016-2c6b8beb5928 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Image limits 0:0:0 {{(pid=129410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 17:52:50.865582 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.virt.hardware [None req-9f24fe71-3d73-4f76-a016-2c6b8beb5928 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Flavor pref 0:0:0 {{(pid=129410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 17:52:50.866057 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.virt.hardware [None req-9f24fe71-3d73-4f76-a016-2c6b8beb5928 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Image pref 0:0:0 {{(pid=129410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 17:52:50.866466 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.virt.hardware [None req-9f24fe71-3d73-4f76-a016-2c6b8beb5928 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 17:52:50.910439 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [None req-dd992649-3496-473a-aac3-49085b72b59a tempest-ServersAdminNegativeTestJSON-307727315 tempest-ServersAdminNegativeTestJSON-307727315-project-admin] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-57efec27-93c3-44cf-bd74-c6b6655d0f58) Aug 10 17:52:50.910439 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:52:50.910439 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:52:50.910439 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:52:50.910439 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:52:50.910439 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:52:50.910439 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Aug 10 17:52:50.910439 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Aug 10 17:52:50.910439 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 368, in inner Aug 10 17:52:50.910439 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi if self.network_api.instance_has_extended_resource_request( Aug 10 17:52:50.910439 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1035, in instance_has_extended_resource_request Aug 10 17:52:50.910439 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi if not self.has_extended_resource_request_extension(admin_context): Aug 10 17:52:50.910439 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 17:52:50.910439 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 17:52:50.910439 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 17:52:50.910439 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 17:52:50.910439 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 17:52:50.910439 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 17:52:50.910439 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:52:50.910439 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:52:50.910439 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 17:52:50.910439 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 17:52:50.910439 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:52:50.910439 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:52:50.910439 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:52:50.910439 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:52:50.910439 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:52:50.910439 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:52:50.910439 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:52:50.910439 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:52:50.910439 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:52:50.910439 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:52:50.910439 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 17:52:50.910439 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 17:52:50.910439 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 17:52:50.910439 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 17:52:50.910439 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 17:52:50.910439 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 17:52:50.910439 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 17:52:50.910439 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 17:52:50.910439 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 17:52:50.910439 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 17:52:50.910439 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 17:52:50.910439 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 17:52:50.910439 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 17:52:50.910439 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 17:52:50.910439 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 17:52:50.910439 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 17:52:50.910439 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 17:52:50.910439 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 17:52:50.914321 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 17:52:50.914321 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 17:52:50.914321 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 17:52:50.914321 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 17:52:50.914321 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 17:52:50.914321 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 17:52:50.914321 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 17:52:50.914321 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 17:52:50.914321 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-57efec27-93c3-44cf-bd74-c6b6655d0f58) Aug 10 17:52:50.914321 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:52:50.914321 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-dd992649-3496-473a-aac3-49085b72b59a tempest-ServersAdminNegativeTestJSON-307727315 tempest-ServersAdminNegativeTestJSON-307727315-project-admin] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:52:50.914321 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:52:50.914321 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-dd992649-3496-473a-aac3-49085b72b59a tempest-ServersAdminNegativeTestJSON-307727315 tempest-ServersAdminNegativeTestJSON-307727315-project-admin] Request method failure captured: Aug 10 17:52:50.914321 n-d-852296-2 devstack@n-api.service[129409]: request: POST /compute/v2.1/servers/3ca0b504-e928-4d31-be09-24a70200eff2/action HTTP/1.1 Aug 10 17:52:50.914321 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 17:52:50.914321 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 17:52:50.914321 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 17:52:50.914321 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 15 Aug 10 17:52:50.914321 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 17:52:50.914321 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 17:52:50.914321 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 17:52:50.914321 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 17:52:50.914321 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8_Az95pXA_-z9Z4ZguwXal6sDXpsrgA5RYelI-lKWnXmEUkeilBIkLRb4BMsvPPbiIRSmq-BO9p7h0GhyB_Dv2ByKXUprBd3vMLurr9dR-2Mlu-4PGDChoatitlnYLRiePSEEUl4_tuqc5GLYRKirr74955dIGhHHsB-2PUtCkIduJg Aug 10 17:52:50.914321 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 17:52:50.914321 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 17:52:50.914321 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 17:52:50.914321 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 17:52:50.914321 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 17:52:50.914321 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 17:52:50.914321 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: 015da3a257f64754bd373f857e81d05b Aug 10 17:52:50.914321 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-307727315 Aug 10 17:52:50.914321 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member,admin Aug 10 17:52:50.914321 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member,admin Aug 10 17:52:50.914321 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/015da3a257f64754bd373f857e81d05b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/015da3a257f64754bd373f857e81d05b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/015da3a257f64754bd373f857e81d05b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_015da3a257f64754bd373f857e81d05b", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:52:50.914321 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-ServersAdminNegativeTestJSON-307727315 Aug 10 17:52:50.914321 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: 015da3a257f64754bd373f857e81d05b Aug 10 17:52:50.914321 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-307727315 Aug 10 17:52:50.914321 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-ServersAdminNegativeTestJSON-307727315-project-admin Aug 10 17:52:50.914321 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 17:52:50.914321 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 17:52:50.914321 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: ff6104cbca83425094909941de2d6c63 Aug 10 17:52:50.914321 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-ServersAdminNegativeTestJSON-307727315-project-admin Aug 10 17:52:50.914321 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:52:50.914321 n-d-852296-2 devstack@n-api.service[129409]: {"migrate": {}} Aug 10 17:52:50.914321 n-d-852296-2 devstack@n-api.service[129409]: method: > Aug 10 17:52:50.914321 n-d-852296-2 devstack@n-api.service[129409]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:52:50.914321 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:52:50.914321 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'id': '3ca0b504-e928-4d31-be09-24a70200eff2', 'body': {'migrate': {}}} Aug 10 17:52:50.914321 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:52:50.914321 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:52:50.914321 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:52:50.914321 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:52:50.914321 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:52:50.914321 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:52:50.914321 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Aug 10 17:52:50.914321 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Aug 10 17:52:50.914321 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 368, in inner Aug 10 17:52:50.914321 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi if self.network_api.instance_has_extended_resource_request( Aug 10 17:52:50.918801 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1035, in instance_has_extended_resource_request Aug 10 17:52:50.918801 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi if not self.has_extended_resource_request_extension(admin_context): Aug 10 17:52:50.918801 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 17:52:50.918801 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 17:52:50.918801 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 17:52:50.918801 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 17:52:50.918801 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 17:52:50.918801 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 17:52:50.918801 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:52:50.918801 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:52:50.918801 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 17:52:50.918801 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 17:52:50.918801 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:52:50.918801 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:52:50.918801 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:52:50.918801 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:52:50.918801 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:52:50.918801 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:52:50.918801 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:52:50.918801 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:52:50.918801 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:52:50.918801 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:52:50.918801 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 17:52:50.918801 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 17:52:50.918801 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 17:52:50.918801 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 17:52:50.918801 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 17:52:50.918801 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 17:52:50.918801 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 17:52:50.918801 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 17:52:50.918801 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 17:52:50.918801 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 17:52:50.918801 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 17:52:50.918801 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 17:52:50.918801 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 17:52:50.918801 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 17:52:50.918801 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 17:52:50.918801 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 17:52:50.918801 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 17:52:50.918801 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 17:52:50.918801 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 17:52:50.918801 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 17:52:50.918801 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 17:52:50.918801 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 17:52:50.918801 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 17:52:50.918801 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 17:52:50.918801 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 17:52:50.918801 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 17:52:50.918801 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-57efec27-93c3-44cf-bd74-c6b6655d0f58) Aug 10 17:52:50.918801 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:52:50.918801 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:52:50.918801 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:52:50.918801 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:52:50.923527 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:52:50.923527 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:52:50.923527 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:52:50.923527 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:52:50.923527 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 10 17:52:50.923527 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 10 17:52:50.923527 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:52:50.923527 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:52:50.923527 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:52:50.923527 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:52:50.923527 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:52:50.923527 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:52:50.923527 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:52:50.923527 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:52:50.923527 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:52:50.923527 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:52:50.923527 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:52:50.923527 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:52:50.923527 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:52:50.923527 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-dd992649-3496-473a-aac3-49085b72b59a tempest-ServersAdminNegativeTestJSON-307727315 tempest-ServersAdminNegativeTestJSON-307727315-project-admin] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:52:50.923527 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:52:50.923527 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-dd992649-3496-473a-aac3-49085b72b59a tempest-ServersAdminNegativeTestJSON-307727315 tempest-ServersAdminNegativeTestJSON-307727315-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/3ca0b504-e928-4d31-be09-24a70200eff2/action" status: 500 len: 214 microversion: 2.1 time: 0.087132 Aug 10 17:52:50.923527 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 454/927] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 10 17:52:50 2022] POST /compute/v2.1/servers/3ca0b504-e928-4d31-be09-24a70200eff2/action => generated 214 bytes in 88 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 10 17:52:50.931201 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-e8a24216-3371-425a-9943-672236bee0e6 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:50.931757 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-e8a24216-3371-425a-9943-672236bee0e6 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] [instance: 43ff4d86-8c12-48ce-bcf5-c607c9bcaa05] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:50.938764 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e8a24216-3371-425a-9943-672236bee0e6 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:50.939351 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e8a24216-3371-425a-9943-672236bee0e6 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:50.939882 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e8a24216-3371-425a-9943-672236bee0e6 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:50.940750 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e8a24216-3371-425a-9943-672236bee0e6 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:50.941403 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e8a24216-3371-425a-9943-672236bee0e6 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:50.942016 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e8a24216-3371-425a-9943-672236bee0e6 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:51.004662 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e8a24216-3371-425a-9943-672236bee0e6 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:51.005330 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e8a24216-3371-425a-9943-672236bee0e6 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:51.005603 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e8a24216-3371-425a-9943-672236bee0e6 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:51.006050 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.objects.instance [None req-e8a24216-3371-425a-9943-672236bee0e6 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lazy-loading 'fault' on Instance uuid 43ff4d86-8c12-48ce-bcf5-c607c9bcaa05 {{(pid=129409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:52:51.063436 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-e8a24216-3371-425a-9943-672236bee0e6 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e109c3dcd0574faaa3d7ec31dd4edd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48bbb92998f54ebeb624bc794d406896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:51.071072 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-e8a24216-3371-425a-9943-672236bee0e6 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] 10.222.0.50 "GET /compute/v2.1/servers/43ff4d86-8c12-48ce-bcf5-c607c9bcaa05" status: 200 len: 1369 microversion: 2.1 time: 0.147431 Aug 10 17:52:51.071631 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 455/928] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:50 2022] GET /compute/v2.1/servers/43ff4d86-8c12-48ce-bcf5-c607c9bcaa05 => generated 1369 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:51.087593 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-eb7b1c9a-3ad8-40ac-b858-aba8d737766d tempest-ServersAdminNegativeTestJSON-307727315 tempest-ServersAdminNegativeTestJSON-307727315-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:52:51.091253 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-eb7b1c9a-3ad8-40ac-b858-aba8d737766d tempest-ServersAdminNegativeTestJSON-307727315 tempest-ServersAdminNegativeTestJSON-307727315-project-admin] Request method failure captured: Aug 10 17:52:51.091253 n-d-852296-2 devstack@n-api.service[129409]: request: POST /compute/v2.1/servers/25b28585-a586-423f-8f04-2b2f4d28f16c/action HTTP/1.1 Aug 10 17:52:51.091253 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 17:52:51.091253 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 17:52:51.091253 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 17:52:51.091253 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 39 Aug 10 17:52:51.091253 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 17:52:51.091253 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 17:52:51.091253 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 17:52:51.091253 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 17:52:51.091253 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8_Az95pXA_-z9Z4ZguwXal6sDXpsrgA5RYelI-lKWnXmEUkeilBIkLRb4BMsvPPbiIRSmq-BO9p7h0GhyB_Dv2ByKXUprBd3vMLurr9dR-2Mlu-4PGDChoatitlnYLRiePSEEUl4_tuqc5GLYRKirr74955dIGhHHsB-2PUtCkIduJg Aug 10 17:52:51.091253 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 17:52:51.091253 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 17:52:51.091253 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 17:52:51.091253 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 17:52:51.091253 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 17:52:51.091253 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 17:52:51.091253 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: 015da3a257f64754bd373f857e81d05b Aug 10 17:52:51.091253 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-307727315 Aug 10 17:52:51.091253 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member,admin Aug 10 17:52:51.091253 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member,admin Aug 10 17:52:51.091253 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/015da3a257f64754bd373f857e81d05b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/015da3a257f64754bd373f857e81d05b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/015da3a257f64754bd373f857e81d05b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_015da3a257f64754bd373f857e81d05b", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:52:51.091253 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-ServersAdminNegativeTestJSON-307727315 Aug 10 17:52:51.091253 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: 015da3a257f64754bd373f857e81d05b Aug 10 17:52:51.091253 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-307727315 Aug 10 17:52:51.091253 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-ServersAdminNegativeTestJSON-307727315-project-admin Aug 10 17:52:51.091253 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 17:52:51.091253 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 17:52:51.091253 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: ff6104cbca83425094909941de2d6c63 Aug 10 17:52:51.091253 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-ServersAdminNegativeTestJSON-307727315-project-admin Aug 10 17:52:51.091253 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:52:51.091253 n-d-852296-2 devstack@n-api.service[129409]: {"os-resetState": {"state": "invalid"}} Aug 10 17:52:51.091253 n-d-852296-2 devstack@n-api.service[129409]: method: > Aug 10 17:52:51.091253 n-d-852296-2 devstack@n-api.service[129409]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Aug 10 17:52:51.091253 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'id': '25b28585-a586-423f-8f04-2b2f4d28f16c', 'body': {'os-resetState': {'state': 'invalid'}}} Aug 10 17:52:51.091253 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:52:51.091253 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:52:51.091253 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 10 17:52:51.091253 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 10 17:52:51.091253 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 10 17:52:51.091253 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise error Aug 10 17:52:51.091253 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Aug 10 17:52:51.091253 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:52:51.091253 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Aug 10 17:52:51.091253 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Aug 10 17:52:51.091253 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:52:51.091253 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Aug 10 17:52:51.091253 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi 'invalid' Aug 10 17:52:51.091253 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:52:51.091253 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:52:51.091253 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:52:51.091253 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:52:51.091253 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:52:51.091253 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:52:51.091253 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:52:51.091253 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:52:51.091253 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:52:51.091253 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:52:51.091253 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 10 17:52:51.091253 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 10 17:52:51.091253 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 10 17:52:51.091253 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 10 17:52:51.091253 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 10 17:52:51.091253 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 10 17:52:51.096265 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Aug 10 17:52:51.096265 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:52:51.096265 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:52:51.096265 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:52:51.096265 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:52:51.096265 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:52:51.096265 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:52:51.096265 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 10 17:52:51.096265 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 10 17:52:51.096265 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Aug 10 17:52:51.096265 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:52:51.096265 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-eb7b1c9a-3ad8-40ac-b858-aba8d737766d tempest-ServersAdminNegativeTestJSON-307727315 tempest-ServersAdminNegativeTestJSON-307727315-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:52:51.096265 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-eb7b1c9a-3ad8-40ac-b858-aba8d737766d tempest-ServersAdminNegativeTestJSON-307727315 tempest-ServersAdminNegativeTestJSON-307727315-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/25b28585-a586-423f-8f04-2b2f4d28f16c/action" status: 400 len: 144 microversion: 2.1 time: 0.009807 Aug 10 17:52:51.096265 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 456/929] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 10 17:52:51 2022] POST /compute/v2.1/servers/25b28585-a586-423f-8f04-2b2f4d28f16c/action => generated 144 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 10 17:52:51.102255 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-2da2679f-7629-4f66-822d-19cd6f392181 tempest-ServersAdminNegativeTestJSON-307727315 tempest-ServersAdminNegativeTestJSON-307727315-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:52:51.105865 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-2da2679f-7629-4f66-822d-19cd6f392181 tempest-ServersAdminNegativeTestJSON-307727315 tempest-ServersAdminNegativeTestJSON-307727315-project-admin] Request method failure captured: Aug 10 17:52:51.105865 n-d-852296-2 devstack@n-api.service[129409]: request: POST /compute/v2.1/servers/25b28585-a586-423f-8f04-2b2f4d28f16c/action HTTP/1.1 Aug 10 17:52:51.105865 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 17:52:51.105865 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 17:52:51.105865 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 17:52:51.105865 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 31 Aug 10 17:52:51.105865 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 17:52:51.105865 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 17:52:51.105865 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 17:52:51.105865 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 17:52:51.105865 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8_Az95pXA_-z9Z4ZguwXal6sDXpsrgA5RYelI-lKWnXmEUkeilBIkLRb4BMsvPPbiIRSmq-BO9p7h0GhyB_Dv2ByKXUprBd3vMLurr9dR-2Mlu-4PGDChoatitlnYLRiePSEEUl4_tuqc5GLYRKirr74955dIGhHHsB-2PUtCkIduJg Aug 10 17:52:51.105865 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 17:52:51.105865 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 17:52:51.105865 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 17:52:51.105865 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 17:52:51.105865 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 17:52:51.105865 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 17:52:51.105865 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: 015da3a257f64754bd373f857e81d05b Aug 10 17:52:51.105865 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-307727315 Aug 10 17:52:51.105865 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member,admin Aug 10 17:52:51.105865 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member,admin Aug 10 17:52:51.105865 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/015da3a257f64754bd373f857e81d05b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/015da3a257f64754bd373f857e81d05b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/015da3a257f64754bd373f857e81d05b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_015da3a257f64754bd373f857e81d05b", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:52:51.105865 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-ServersAdminNegativeTestJSON-307727315 Aug 10 17:52:51.105865 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: 015da3a257f64754bd373f857e81d05b Aug 10 17:52:51.105865 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-307727315 Aug 10 17:52:51.105865 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-ServersAdminNegativeTestJSON-307727315-project-admin Aug 10 17:52:51.105865 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 17:52:51.105865 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 17:52:51.105865 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: ff6104cbca83425094909941de2d6c63 Aug 10 17:52:51.105865 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-ServersAdminNegativeTestJSON-307727315-project-admin Aug 10 17:52:51.105865 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:52:51.105865 n-d-852296-2 devstack@n-api.service[129409]: {"os-resetState": {"state": 1}} Aug 10 17:52:51.105865 n-d-852296-2 devstack@n-api.service[129409]: method: > Aug 10 17:52:51.105865 n-d-852296-2 devstack@n-api.service[129409]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Aug 10 17:52:51.105865 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'id': '25b28585-a586-423f-8f04-2b2f4d28f16c', 'body': {'os-resetState': {'state': 1}}} Aug 10 17:52:51.105865 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:52:51.105865 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:52:51.105865 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 10 17:52:51.105865 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 10 17:52:51.105865 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 10 17:52:51.105865 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise error Aug 10 17:52:51.105865 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Aug 10 17:52:51.105865 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:52:51.105865 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Aug 10 17:52:51.105865 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Aug 10 17:52:51.105865 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:52:51.105865 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Aug 10 17:52:51.105865 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi 1 Aug 10 17:52:51.105865 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:52:51.105865 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:52:51.105865 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:52:51.105865 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:52:51.105865 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:52:51.105865 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:52:51.105865 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:52:51.105865 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:52:51.105865 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:52:51.105865 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:52:51.105865 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 10 17:52:51.105865 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 10 17:52:51.105865 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 10 17:52:51.105865 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 10 17:52:51.105865 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 10 17:52:51.105865 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 10 17:52:51.105865 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Aug 10 17:52:51.105865 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:52:51.111250 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:52:51.111250 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:52:51.111250 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:52:51.111250 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:52:51.111250 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:52:51.111250 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 10 17:52:51.111250 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 10 17:52:51.111250 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Aug 10 17:52:51.111250 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:52:51.111250 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-2da2679f-7629-4f66-822d-19cd6f392181 tempest-ServersAdminNegativeTestJSON-307727315 tempest-ServersAdminNegativeTestJSON-307727315-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:52:51.111250 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-2da2679f-7629-4f66-822d-19cd6f392181 tempest-ServersAdminNegativeTestJSON-307727315 tempest-ServersAdminNegativeTestJSON-307727315-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/25b28585-a586-423f-8f04-2b2f4d28f16c/action" status: 400 len: 120 microversion: 2.1 time: 0.008916 Aug 10 17:52:51.112088 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 457/930] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 10 17:52:51 2022] POST /compute/v2.1/servers/25b28585-a586-423f-8f04-2b2f4d28f16c/action => generated 120 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 10 17:52:51.118494 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-48e9da0e-db30-4790-a8a0-621808115dcc tempest-ServersAdminNegativeTestJSON-307727315 tempest-ServersAdminNegativeTestJSON-307727315-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:52:51.120838 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-48e9da0e-db30-4790-a8a0-621808115dcc tempest-ServersAdminNegativeTestJSON-307727315 tempest-ServersAdminNegativeTestJSON-307727315-project-admin] Failed to fetch instance by id 999 {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2928}} Aug 10 17:52:51.121346 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-48e9da0e-db30-4790-a8a0-621808115dcc tempest-ServersAdminNegativeTestJSON-307727315 tempest-ServersAdminNegativeTestJSON-307727315-project-admin] HTTP exception thrown: Instance 999 could not be found. Aug 10 17:52:51.131316 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-48e9da0e-db30-4790-a8a0-621808115dcc tempest-ServersAdminNegativeTestJSON-307727315 tempest-ServersAdminNegativeTestJSON-307727315-project-admin] Request method failure captured: Aug 10 17:52:51.131316 n-d-852296-2 devstack@n-api.service[129409]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Aug 10 17:52:51.131316 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 17:52:51.131316 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 17:52:51.131316 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 17:52:51.131316 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 37 Aug 10 17:52:51.131316 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 17:52:51.131316 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 17:52:51.131316 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 17:52:51.131316 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 17:52:51.131316 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8_Az95pXA_-z9Z4ZguwXal6sDXpsrgA5RYelI-lKWnXmEUkeilBIkLRb4BMsvPPbiIRSmq-BO9p7h0GhyB_Dv2ByKXUprBd3vMLurr9dR-2Mlu-4PGDChoatitlnYLRiePSEEUl4_tuqc5GLYRKirr74955dIGhHHsB-2PUtCkIduJg Aug 10 17:52:51.131316 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 17:52:51.131316 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 17:52:51.131316 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 17:52:51.131316 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 17:52:51.131316 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 17:52:51.131316 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 17:52:51.131316 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: 015da3a257f64754bd373f857e81d05b Aug 10 17:52:51.131316 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-307727315 Aug 10 17:52:51.131316 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member,admin Aug 10 17:52:51.131316 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member,admin Aug 10 17:52:51.131316 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/015da3a257f64754bd373f857e81d05b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/015da3a257f64754bd373f857e81d05b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/015da3a257f64754bd373f857e81d05b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_015da3a257f64754bd373f857e81d05b", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:52:51.131316 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-ServersAdminNegativeTestJSON-307727315 Aug 10 17:52:51.131316 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: 015da3a257f64754bd373f857e81d05b Aug 10 17:52:51.131316 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-307727315 Aug 10 17:52:51.131316 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-ServersAdminNegativeTestJSON-307727315-project-admin Aug 10 17:52:51.131316 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 17:52:51.131316 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 17:52:51.131316 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: ff6104cbca83425094909941de2d6c63 Aug 10 17:52:51.131316 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-ServersAdminNegativeTestJSON-307727315-project-admin Aug 10 17:52:51.131316 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:52:51.131316 n-d-852296-2 devstack@n-api.service[129409]: {"os-resetState": {"state": "error"}} Aug 10 17:52:51.131316 n-d-852296-2 devstack@n-api.service[129409]: method: > Aug 10 17:52:51.131316 n-d-852296-2 devstack@n-api.service[129409]: exception: Instance 999 could not be found. Aug 10 17:52:51.131316 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Aug 10 17:52:51.131316 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:52:51.131316 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:52:51.131316 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 17:52:51.131316 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 17:52:51.131316 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2929, in get Aug 10 17:52:51.131316 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 10 17:52:51.131316 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Aug 10 17:52:51.131316 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:52:51.131316 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:52:51.131316 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:52:51.131316 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:52:51.131316 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:52:51.131316 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:52:51.131316 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:52:51.131316 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:52:51.131316 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:52:51.131316 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:52:51.131316 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:52:51.131316 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:52:51.131316 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Aug 10 17:52:51.131316 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 10 17:52:51.131316 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 17:52:51.131316 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:52:51.131316 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Aug 10 17:52:51.131316 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:52:51.131316 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:52:51.131316 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:52:51.131316 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:52:51.131316 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:52:51.131316 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:52:51.131316 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:52:51.135703 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:52:51.135703 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Aug 10 17:52:51.135703 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:52:51.135703 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-48e9da0e-db30-4790-a8a0-621808115dcc tempest-ServersAdminNegativeTestJSON-307727315 tempest-ServersAdminNegativeTestJSON-307727315-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:52:51.135703 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-48e9da0e-db30-4790-a8a0-621808115dcc tempest-ServersAdminNegativeTestJSON-307727315 tempest-ServersAdminNegativeTestJSON-307727315-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.019154 Aug 10 17:52:51.135703 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 458/931] 10.222.0.50 () {60 vars in 1179 bytes} [Wed Aug 10 17:52:51 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 10 17:52:51.143248 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-f4ae80a4-13a8-45e9-b109-d4ed5d9c4090 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:51.143778 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-f4ae80a4-13a8-45e9-b109-d4ed5d9c4090 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] [instance: 3ca0b504-e928-4d31-be09-24a70200eff2] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:51.151647 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-f4ae80a4-13a8-45e9-b109-d4ed5d9c4090 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:51.152137 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-f4ae80a4-13a8-45e9-b109-d4ed5d9c4090 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:51.152608 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-f4ae80a4-13a8-45e9-b109-d4ed5d9c4090 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:51.153310 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-f4ae80a4-13a8-45e9-b109-d4ed5d9c4090 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:51.153931 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-f4ae80a4-13a8-45e9-b109-d4ed5d9c4090 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:51.154267 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-f4ae80a4-13a8-45e9-b109-d4ed5d9c4090 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:51.191239 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-f4ae80a4-13a8-45e9-b109-d4ed5d9c4090 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] [instance: 3ca0b504-e928-4d31-be09-24a70200eff2] Going to try to terminate instance {{(pid=129409) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 17:52:51.395813 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-9f24fe71-3d73-4f76-a016-2c6b8beb5928 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] [instance: bee3148a-3834-41bd-99e7-b5da75217256] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:51.409517 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-9f24fe71-3d73-4f76-a016-2c6b8beb5928 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:51.410281 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-9f24fe71-3d73-4f76-a016-2c6b8beb5928 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:51.410725 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-9f24fe71-3d73-4f76-a016-2c6b8beb5928 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:51.411439 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-9f24fe71-3d73-4f76-a016-2c6b8beb5928 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:51.411899 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-9f24fe71-3d73-4f76-a016-2c6b8beb5928 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:51.412351 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-9f24fe71-3d73-4f76-a016-2c6b8beb5928 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:51.487777 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-9f24fe71-3d73-4f76-a016-2c6b8beb5928 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] 10.222.0.50 "POST /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256/action" status: 202 len: 1066 microversion: 2.1 time: 0.743748 Aug 10 17:52:51.488466 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 474/932] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 10 17:52:50 2022] POST /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256/action => generated 1066 bytes in 745 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 10 17:52:51.494610 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-53ebe3f5-cb7f-4fc6-911e-271fdb7e7f3b tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:51.495441 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-53ebe3f5-cb7f-4fc6-911e-271fdb7e7f3b tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: 873f60d0-8ef0-4ff5-800d-945ca4237a28] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:51.509698 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-53ebe3f5-cb7f-4fc6-911e-271fdb7e7f3b tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:51.510769 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-53ebe3f5-cb7f-4fc6-911e-271fdb7e7f3b tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:51.511236 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-53ebe3f5-cb7f-4fc6-911e-271fdb7e7f3b tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:51.511986 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-53ebe3f5-cb7f-4fc6-911e-271fdb7e7f3b tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:51.512613 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-53ebe3f5-cb7f-4fc6-911e-271fdb7e7f3b tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:51.513431 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-53ebe3f5-cb7f-4fc6-911e-271fdb7e7f3b tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:51.579361 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-53ebe3f5-cb7f-4fc6-911e-271fdb7e7f3b tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:51.587173 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-53ebe3f5-cb7f-4fc6-911e-271fdb7e7f3b tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/873f60d0-8ef0-4ff5-800d-945ca4237a28" status: 200 len: 1286 microversion: 2.1 time: 0.097521 Aug 10 17:52:51.587754 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 475/933] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:51 2022] GET /compute/v2.1/servers/873f60d0-8ef0-4ff5-800d-945ca4237a28 => generated 1286 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:51.593479 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-330c0393-ea80-4fb0-be2f-1aa6833f196a tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:51.594076 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-330c0393-ea80-4fb0-be2f-1aa6833f196a tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] [instance: bee3148a-3834-41bd-99e7-b5da75217256] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:51.599945 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-330c0393-ea80-4fb0-be2f-1aa6833f196a tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:51.600482 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-330c0393-ea80-4fb0-be2f-1aa6833f196a tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:51.600918 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-330c0393-ea80-4fb0-be2f-1aa6833f196a tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:51.601601 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-330c0393-ea80-4fb0-be2f-1aa6833f196a tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:51.602091 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-330c0393-ea80-4fb0-be2f-1aa6833f196a tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:51.602538 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-330c0393-ea80-4fb0-be2f-1aa6833f196a tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:51.770170 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-330c0393-ea80-4fb0-be2f-1aa6833f196a tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2fd6acf18d4218ad143ccee2d0bb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7c2481a908406fa9c4562513fff665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:51.777649 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-330c0393-ea80-4fb0-be2f-1aa6833f196a tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] 10.222.0.50 "GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256" status: 200 len: 1471 microversion: 2.1 time: 0.188244 Aug 10 17:52:51.778221 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 476/934] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:51 2022] GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256 => generated 1471 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:51.819004 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-f4ae80a4-13a8-45e9-b109-d4ed5d9c4090 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] 10.222.0.50 "DELETE /compute/v2.1/servers/3ca0b504-e928-4d31-be09-24a70200eff2" status: 204 len: 0 microversion: 2.1 time: 0.679328 Aug 10 17:52:51.819846 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 459/935] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 10 17:52:51 2022] DELETE /compute/v2.1/servers/3ca0b504-e928-4d31-be09-24a70200eff2 => generated 0 bytes in 682 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 10 17:52:51.834266 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-eefb2012-b4ea-4745-8f10-65857b2a0f2c tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:51.834929 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-eefb2012-b4ea-4745-8f10-65857b2a0f2c tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] [instance: 3ca0b504-e928-4d31-be09-24a70200eff2] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:51.841541 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-eefb2012-b4ea-4745-8f10-65857b2a0f2c tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:51.842783 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-eefb2012-b4ea-4745-8f10-65857b2a0f2c tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:51.843233 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-eefb2012-b4ea-4745-8f10-65857b2a0f2c tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:51.843938 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-eefb2012-b4ea-4745-8f10-65857b2a0f2c tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:51.844429 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-eefb2012-b4ea-4745-8f10-65857b2a0f2c tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:51.844858 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-eefb2012-b4ea-4745-8f10-65857b2a0f2c tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:51.855446 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-36a4760b-177c-4e5b-bb89-1c7cb9328f8f tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:51.856220 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-36a4760b-177c-4e5b-bb89-1c7cb9328f8f tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] [instance: e2777988-0bbf-496c-9c97-b206dbc94a62] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:51.864831 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-36a4760b-177c-4e5b-bb89-1c7cb9328f8f tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:51.870743 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-36a4760b-177c-4e5b-bb89-1c7cb9328f8f tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:51.870743 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-36a4760b-177c-4e5b-bb89-1c7cb9328f8f tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:51.870743 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-36a4760b-177c-4e5b-bb89-1c7cb9328f8f tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:51.870743 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-36a4760b-177c-4e5b-bb89-1c7cb9328f8f tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:51.870743 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-36a4760b-177c-4e5b-bb89-1c7cb9328f8f tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:52.004169 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.objects.instance [None req-36a4760b-177c-4e5b-bb89-1c7cb9328f8f tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lazy-loading 'services' on Instance uuid e2777988-0bbf-496c-9c97-b206dbc94a62 {{(pid=129409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:52:52.041528 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-36a4760b-177c-4e5b-bb89-1c7cb9328f8f tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62" status: 200 len: 1925 microversion: 2.75 time: 0.191924 Aug 10 17:52:52.048205 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 460/936] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:52:51 2022] GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62 => generated 1925 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:52:52.053671 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-eefb2012-b4ea-4745-8f10-65857b2a0f2c tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83a3e198e21476eb12fcf417aea62de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df088e5a610436ea21b8a360e2bb527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:52.062622 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-eefb2012-b4ea-4745-8f10-65857b2a0f2c tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] 10.222.0.50 "GET /compute/v2.1/servers/3ca0b504-e928-4d31-be09-24a70200eff2" status: 200 len: 1468 microversion: 2.1 time: 0.232508 Aug 10 17:52:52.063771 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 477/937] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:51 2022] GET /compute/v2.1/servers/3ca0b504-e928-4d31-be09-24a70200eff2 => generated 1468 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:52.099893 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-38064dc1-c617-4621-845b-6b696f97d3f1 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:52.099893 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-38064dc1-c617-4621-845b-6b696f97d3f1 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] [instance: 43ff4d86-8c12-48ce-bcf5-c607c9bcaa05] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:52.104054 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-38064dc1-c617-4621-845b-6b696f97d3f1 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:52.104853 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-38064dc1-c617-4621-845b-6b696f97d3f1 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:52.105276 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-38064dc1-c617-4621-845b-6b696f97d3f1 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:52.106328 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-38064dc1-c617-4621-845b-6b696f97d3f1 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:52.106428 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-38064dc1-c617-4621-845b-6b696f97d3f1 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:52.107247 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-38064dc1-c617-4621-845b-6b696f97d3f1 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:52.143329 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-38064dc1-c617-4621-845b-6b696f97d3f1 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] HTTP exception thrown: Instance 43ff4d86-8c12-48ce-bcf5-c607c9bcaa05 could not be found. Aug 10 17:52:52.145021 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-38064dc1-c617-4621-845b-6b696f97d3f1 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Request method failure captured: Aug 10 17:52:52.145021 n-d-852296-2 devstack@n-api.service[129409]: request: GET /compute/v2.1/servers/43ff4d86-8c12-48ce-bcf5-c607c9bcaa05 HTTP/1.1 Aug 10 17:52:52.145021 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 17:52:52.145021 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 17:52:52.145021 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 17:52:52.145021 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 0 Aug 10 17:52:52.145021 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 17:52:52.145021 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 17:52:52.145021 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 17:52:52.145021 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 17:52:52.145021 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8-_0hr6nliTkkjEq4POLxTS39b7AKRzs5IHoadOFYk-Avq_EhHZhiXBqUGkDcgCWPqhSAgOsv1fUEScaBilJPZ4n8-MqEuqv4LzNqxeh_dhY8n5FOoRyMW4xdBlwKatTDuceji8cWTk46ZLZhXUEi0tZyObBcD9QSkhHyY2UTCtQ3Ok Aug 10 17:52:52.145021 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 17:52:52.145021 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 17:52:52.145021 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 17:52:52.145021 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 17:52:52.145021 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 17:52:52.145021 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 17:52:52.145021 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: 48bbb92998f54ebeb624bc794d406896 Aug 10 17:52:52.145021 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-MigrationsAdminTest-561431726 Aug 10 17:52:52.145021 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 17:52:52.145021 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 17:52:52.145021 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/48bbb92998f54ebeb624bc794d406896"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/48bbb92998f54ebeb624bc794d406896"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/48bbb92998f54ebeb624bc794d406896"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_48bbb92998f54ebeb624bc794d406896", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:52:52.145021 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-MigrationsAdminTest-561431726 Aug 10 17:52:52.145021 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: 48bbb92998f54ebeb624bc794d406896 Aug 10 17:52:52.145021 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-MigrationsAdminTest-561431726 Aug 10 17:52:52.145021 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-MigrationsAdminTest-561431726-project Aug 10 17:52:52.145021 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 17:52:52.145021 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 17:52:52.145021 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: e109c3dcd0574faaa3d7ec31dd4edd24 Aug 10 17:52:52.145021 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-MigrationsAdminTest-561431726-project Aug 10 17:52:52.145021 n-d-852296-2 devstack@n-api.service[129409]: method: > Aug 10 17:52:52.145021 n-d-852296-2 devstack@n-api.service[129409]: exception: Instance 43ff4d86-8c12-48ce-bcf5-c607c9bcaa05 could not be found. Aug 10 17:52:52.145021 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'id': '43ff4d86-8c12-48ce-bcf5-c607c9bcaa05'} Aug 10 17:52:52.145021 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:52:52.145021 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:52:52.145021 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 17:52:52.145021 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 17:52:52.145021 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 17:52:52.145021 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 17:52:52.145021 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 17:52:52.145021 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 17:52:52.145021 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 17:52:52.145021 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 17:52:52.145021 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43ff4d86-8c12-48ce-bcf5-c607c9bcaa05 could not be found. Aug 10 17:52:52.145021 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:52:52.145021 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:52:52.145021 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:52:52.145021 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:52:52.145021 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:52:52.145021 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:52:52.145021 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:52:52.145021 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:52:52.145021 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:52:52.145021 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:52:52.145021 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 17:52:52.145021 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 17:52:52.145021 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 17:52:52.145021 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 17:52:52.145021 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 17:52:52.145021 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:52:52.145021 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43ff4d86-8c12-48ce-bcf5-c607c9bcaa05 could not be found. Aug 10 17:52:52.145021 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:52:52.145021 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:52:52.145021 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:52:52.152579 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:52:52.152579 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:52:52.152579 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:52:52.152579 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:52:52.152579 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:52:52.152579 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43ff4d86-8c12-48ce-bcf5-c607c9bcaa05 could not be found. Aug 10 17:52:52.152579 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:52:52.152579 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-38064dc1-c617-4621-845b-6b696f97d3f1 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Returning 404 to user: Instance 43ff4d86-8c12-48ce-bcf5-c607c9bcaa05 could not be found. {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:52:52.153381 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-38064dc1-c617-4621-845b-6b696f97d3f1 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] 10.222.0.50 "GET /compute/v2.1/servers/43ff4d86-8c12-48ce-bcf5-c607c9bcaa05" status: 404 len: 111 microversion: 2.1 time: 0.062076 Aug 10 17:52:52.156341 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 461/938] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:52 2022] GET /compute/v2.1/servers/43ff4d86-8c12-48ce-bcf5-c607c9bcaa05 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:52:52.162945 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-bc11d7f8-0560-494a-9502-92207ffe4de2 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:52.167337 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-bc11d7f8-0560-494a-9502-92207ffe4de2 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] [instance: 37934416-f4a8-4fee-8f7f-53c9df0f6c72] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:52.174799 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-bc11d7f8-0560-494a-9502-92207ffe4de2 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:52.175351 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-bc11d7f8-0560-494a-9502-92207ffe4de2 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:52.175957 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-bc11d7f8-0560-494a-9502-92207ffe4de2 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:52.176719 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-bc11d7f8-0560-494a-9502-92207ffe4de2 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:52.177171 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-bc11d7f8-0560-494a-9502-92207ffe4de2 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:52.179125 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-bc11d7f8-0560-494a-9502-92207ffe4de2 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:52.233794 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-bc11d7f8-0560-494a-9502-92207ffe4de2 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] [instance: 37934416-f4a8-4fee-8f7f-53c9df0f6c72] Going to try to terminate instance {{(pid=129410) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 17:52:52.609456 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-b07306b3-c340-490c-aac6-211dc696d24a tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:52.610079 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-b07306b3-c340-490c-aac6-211dc696d24a tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: 873f60d0-8ef0-4ff5-800d-945ca4237a28] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:52.620335 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-b07306b3-c340-490c-aac6-211dc696d24a tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:52.636956 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-b07306b3-c340-490c-aac6-211dc696d24a tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:52.636956 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-b07306b3-c340-490c-aac6-211dc696d24a tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:52.636956 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-b07306b3-c340-490c-aac6-211dc696d24a tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:52.636956 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-b07306b3-c340-490c-aac6-211dc696d24a tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:52.636956 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-b07306b3-c340-490c-aac6-211dc696d24a tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:52.813562 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-bc11d7f8-0560-494a-9502-92207ffe4de2 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] 10.222.0.50 "DELETE /compute/v2.1/servers/37934416-f4a8-4fee-8f7f-53c9df0f6c72" status: 204 len: 0 microversion: 2.1 time: 0.654546 Aug 10 17:52:52.814712 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 478/939] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 10 17:52:52 2022] DELETE /compute/v2.1/servers/37934416-f4a8-4fee-8f7f-53c9df0f6c72 => generated 0 bytes in 657 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 17:52:52.819933 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-14003a73-1e5a-4fcc-bc1f-54309ade4b42 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:52.820857 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-14003a73-1e5a-4fcc-bc1f-54309ade4b42 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] [instance: bee3148a-3834-41bd-99e7-b5da75217256] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:52.827542 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-14003a73-1e5a-4fcc-bc1f-54309ade4b42 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:52.831573 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-14003a73-1e5a-4fcc-bc1f-54309ade4b42 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:52.831573 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-14003a73-1e5a-4fcc-bc1f-54309ade4b42 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:52.831573 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-14003a73-1e5a-4fcc-bc1f-54309ade4b42 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:52.831573 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-14003a73-1e5a-4fcc-bc1f-54309ade4b42 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:52.831573 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-14003a73-1e5a-4fcc-bc1f-54309ade4b42 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:52.940161 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-b07306b3-c340-490c-aac6-211dc696d24a tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:52.948273 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-b07306b3-c340-490c-aac6-211dc696d24a tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/873f60d0-8ef0-4ff5-800d-945ca4237a28" status: 200 len: 1316 microversion: 2.1 time: 0.344100 Aug 10 17:52:52.948947 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 462/940] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:52 2022] GET /compute/v2.1/servers/873f60d0-8ef0-4ff5-800d-945ca4237a28 => generated 1316 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:52:52.955468 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-03b58103-ff48-442b-a5a3-442644b53c17 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:52.956055 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-03b58103-ff48-442b-a5a3-442644b53c17 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] [instance: 37934416-f4a8-4fee-8f7f-53c9df0f6c72] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:52.962597 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-03b58103-ff48-442b-a5a3-442644b53c17 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:52.963688 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-03b58103-ff48-442b-a5a3-442644b53c17 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:52.964337 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-03b58103-ff48-442b-a5a3-442644b53c17 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:52.965224 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-03b58103-ff48-442b-a5a3-442644b53c17 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:52.967196 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-03b58103-ff48-442b-a5a3-442644b53c17 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:52.967196 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-03b58103-ff48-442b-a5a3-442644b53c17 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:53.014965 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-14003a73-1e5a-4fcc-bc1f-54309ade4b42 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2fd6acf18d4218ad143ccee2d0bb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7c2481a908406fa9c4562513fff665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:53.024292 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-14003a73-1e5a-4fcc-bc1f-54309ade4b42 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] 10.222.0.50 "GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256" status: 200 len: 1471 microversion: 2.1 time: 0.208149 Aug 10 17:52:53.024897 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 479/941] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:52 2022] GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256 => generated 1471 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:53.074657 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-70d99408-9f11-48f9-b37c-45b9d7cb3912 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:53.078343 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-70d99408-9f11-48f9-b37c-45b9d7cb3912 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] [instance: e2777988-0bbf-496c-9c97-b206dbc94a62] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:53.085803 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-70d99408-9f11-48f9-b37c-45b9d7cb3912 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:53.086292 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-70d99408-9f11-48f9-b37c-45b9d7cb3912 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:53.087021 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-70d99408-9f11-48f9-b37c-45b9d7cb3912 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:53.087716 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-70d99408-9f11-48f9-b37c-45b9d7cb3912 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:53.088380 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-70d99408-9f11-48f9-b37c-45b9d7cb3912 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:53.089001 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-70d99408-9f11-48f9-b37c-45b9d7cb3912 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:53.166972 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.objects.instance [None req-70d99408-9f11-48f9-b37c-45b9d7cb3912 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lazy-loading 'services' on Instance uuid e2777988-0bbf-496c-9c97-b206dbc94a62 {{(pid=129410) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:52:53.184401 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:52:53.187375 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-70d99408-9f11-48f9-b37c-45b9d7cb3912 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62" status: 200 len: 1925 microversion: 2.75 time: 0.117768 Aug 10 17:52:53.187967 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 480/942] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:52:53 2022] GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62 => generated 1925 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 17:52:53.192523 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-9da1c6be-c1f8-4e6f-a618-cb84cd890a88 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:53.193120 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-9da1c6be-c1f8-4e6f-a618-cb84cd890a88 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] [instance: 3ca0b504-e928-4d31-be09-24a70200eff2] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:53.205303 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-03b58103-ff48-442b-a5a3-442644b53c17 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e109c3dcd0574faaa3d7ec31dd4edd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48bbb92998f54ebeb624bc794d406896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:53.208146 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-9da1c6be-c1f8-4e6f-a618-cb84cd890a88 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:53.208804 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-9da1c6be-c1f8-4e6f-a618-cb84cd890a88 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:53.209399 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-9da1c6be-c1f8-4e6f-a618-cb84cd890a88 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:53.210352 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-9da1c6be-c1f8-4e6f-a618-cb84cd890a88 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:53.211002 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-9da1c6be-c1f8-4e6f-a618-cb84cd890a88 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:53.211608 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-9da1c6be-c1f8-4e6f-a618-cb84cd890a88 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:53.220957 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-03b58103-ff48-442b-a5a3-442644b53c17 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] 10.222.0.50 "GET /compute/v2.1/servers/37934416-f4a8-4fee-8f7f-53c9df0f6c72" status: 200 len: 1469 microversion: 2.1 time: 0.268463 Aug 10 17:52:53.222198 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 463/943] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:52 2022] GET /compute/v2.1/servers/37934416-f4a8-4fee-8f7f-53c9df0f6c72 => generated 1469 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:53.386790 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-9da1c6be-c1f8-4e6f-a618-cb84cd890a88 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83a3e198e21476eb12fcf417aea62de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df088e5a610436ea21b8a360e2bb527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:53.395332 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-9da1c6be-c1f8-4e6f-a618-cb84cd890a88 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] 10.222.0.50 "GET /compute/v2.1/servers/3ca0b504-e928-4d31-be09-24a70200eff2" status: 200 len: 1468 microversion: 2.1 time: 0.206360 Aug 10 17:52:53.395913 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 481/944] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:53 2022] GET /compute/v2.1/servers/3ca0b504-e928-4d31-be09-24a70200eff2 => generated 1468 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:53.416019 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-a3ae1b89-0094-4f48-8318-afafdb6f5ec8 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-694862320", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452"}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:52:53.468708 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.network.neutron [None req-a3ae1b89-0094-4f48-8318-afafdb6f5ec8 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] validate_networks() for None {{(pid=129409) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 17:52:53.585772 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [req-1ce936aa-e706-4d98-a454-124259914ce9 req-61358de5-4eaf-4e3c-97ff-d55dfc2d94e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "873f60d0-8ef0-4ff5-800d-945ca4237a28", "tag": "ceae5e90-0655-4ae7-a475-8af854b4bda6"}]} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:52:53.592475 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:52:53.597277 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-1ce936aa-e706-4d98-a454-124259914ce9 req-61358de5-4eaf-4e3c-97ff-d55dfc2d94e6 service nova] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:53.597755 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-1ce936aa-e706-4d98-a454-124259914ce9 req-61358de5-4eaf-4e3c-97ff-d55dfc2d94e6 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:53.598226 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-1ce936aa-e706-4d98-a454-124259914ce9 req-61358de5-4eaf-4e3c-97ff-d55dfc2d94e6 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:53.611975 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.compute.server_external_events [req-1ce936aa-e706-4d98-a454-124259914ce9 req-61358de5-4eaf-4e3c-97ff-d55dfc2d94e6 service nova] Creating event network-changed:ceae5e90-0655-4ae7-a475-8af854b4bda6 for instance 873f60d0-8ef0-4ff5-800d-945ca4237a28 on n-h2-852296-2 Aug 10 17:52:53.617001 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [req-1ce936aa-e706-4d98-a454-124259914ce9 req-61358de5-4eaf-4e3c-97ff-d55dfc2d94e6 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036934 Aug 10 17:52:53.617890 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 482/945] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 10 17:52:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:52:53.725199 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.virt.hardware [None req-a3ae1b89-0094-4f48-8318-afafdb6f5ec8 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Flavor limits 0:0:0 {{(pid=129409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 17:52:53.725617 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.virt.hardware [None req-a3ae1b89-0094-4f48-8318-afafdb6f5ec8 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Image limits 0:0:0 {{(pid=129409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 17:52:53.726115 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.virt.hardware [None req-a3ae1b89-0094-4f48-8318-afafdb6f5ec8 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Flavor pref 0:0:0 {{(pid=129409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 17:52:53.726520 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.virt.hardware [None req-a3ae1b89-0094-4f48-8318-afafdb6f5ec8 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Image pref 0:0:0 {{(pid=129409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 17:52:53.726957 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.virt.hardware [None req-a3ae1b89-0094-4f48-8318-afafdb6f5ec8 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 17:52:53.737119 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a3ae1b89-0094-4f48-8318-afafdb6f5ec8 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:53.737598 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a3ae1b89-0094-4f48-8318-afafdb6f5ec8 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:53.739808 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a3ae1b89-0094-4f48-8318-afafdb6f5ec8 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:53.739808 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a3ae1b89-0094-4f48-8318-afafdb6f5ec8 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:53.739808 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a3ae1b89-0094-4f48-8318-afafdb6f5ec8 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:53.739808 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a3ae1b89-0094-4f48-8318-afafdb6f5ec8 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:53.757858 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-a3ae1b89-0094-4f48-8318-afafdb6f5ec8 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Getting quotas for project 8e1c7c8eeb1b4065b25fe28eba30d0eb. Resources: {'instances', 'ram', 'cores'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:52:53.771030 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-a3ae1b89-0094-4f48-8318-afafdb6f5ec8 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Getting quotas for user 5f082ed04bc143679029c204e8a97160 and project 8e1c7c8eeb1b4065b25fe28eba30d0eb. Resources: {'instances', 'ram', 'cores'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:52:53.776466 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-a3ae1b89-0094-4f48-8318-afafdb6f5ec8 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Going to run 1 instances... {{(pid=129409) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 17:52:53.778923 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-a3ae1b89-0094-4f48-8318-afafdb6f5ec8 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] [instance: 2c8728f2-55fb-4306-acc5-227ba55ec278] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a735ff26-463a-4ffe-a981-ab9d9baa494f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 17:52:53.978265 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-a3ae1b89-0094-4f48-8318-afafdb6f5ec8 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.754709 Aug 10 17:52:53.979653 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 464/946] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 17:52:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 757 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 17:52:53.990896 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-32013b42-d5fe-46a2-b561-2437e35e8bca tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:53.991439 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-b8737223-2af6-432d-8a17-d6ba1cb719e5 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:53.991884 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-b8737223-2af6-432d-8a17-d6ba1cb719e5 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] [instance: 2c8728f2-55fb-4306-acc5-227ba55ec278] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:53.995138 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-32013b42-d5fe-46a2-b561-2437e35e8bca tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: 873f60d0-8ef0-4ff5-800d-945ca4237a28] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:54.010865 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-32013b42-d5fe-46a2-b561-2437e35e8bca tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:54.011763 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-32013b42-d5fe-46a2-b561-2437e35e8bca tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:54.012458 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-32013b42-d5fe-46a2-b561-2437e35e8bca tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:54.014310 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-32013b42-d5fe-46a2-b561-2437e35e8bca tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:54.015124 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-32013b42-d5fe-46a2-b561-2437e35e8bca tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:54.015772 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-32013b42-d5fe-46a2-b561-2437e35e8bca tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:54.071593 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-b8737223-2af6-432d-8a17-d6ba1cb719e5 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f082ed04bc143679029c204e8a97160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c7c8eeb1b4065b25fe28eba30d0eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:54.085907 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-b8737223-2af6-432d-8a17-d6ba1cb719e5 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] 10.222.0.50 "GET /compute/v2.1/servers/2c8728f2-55fb-4306-acc5-227ba55ec278" status: 200 len: 1218 microversion: 2.1 time: 0.099055 Aug 10 17:52:54.086840 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 465/947] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:53 2022] GET /compute/v2.1/servers/2c8728f2-55fb-4306-acc5-227ba55ec278 => generated 1218 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:52:54.094229 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-7c2c6da3-1ff5-47f0-9488-d7c1ad6949e9 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:54.094876 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-7c2c6da3-1ff5-47f0-9488-d7c1ad6949e9 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] [instance: bee3148a-3834-41bd-99e7-b5da75217256] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:54.101758 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7c2c6da3-1ff5-47f0-9488-d7c1ad6949e9 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:54.102495 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7c2c6da3-1ff5-47f0-9488-d7c1ad6949e9 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:54.103989 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7c2c6da3-1ff5-47f0-9488-d7c1ad6949e9 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:54.105424 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7c2c6da3-1ff5-47f0-9488-d7c1ad6949e9 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:54.106169 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7c2c6da3-1ff5-47f0-9488-d7c1ad6949e9 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:54.107119 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7c2c6da3-1ff5-47f0-9488-d7c1ad6949e9 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:54.187481 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-32013b42-d5fe-46a2-b561-2437e35e8bca tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:54.194984 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-32013b42-d5fe-46a2-b561-2437e35e8bca tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/873f60d0-8ef0-4ff5-800d-945ca4237a28" status: 200 len: 1316 microversion: 2.1 time: 0.223162 Aug 10 17:52:54.208582 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 483/948] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:53 2022] GET /compute/v2.1/servers/873f60d0-8ef0-4ff5-800d-945ca4237a28 => generated 1316 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:52:54.215592 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-284207d2-6bd7-484b-8e5a-817adcd9f19c tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:54.216747 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-284207d2-6bd7-484b-8e5a-817adcd9f19c tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] [instance: e2777988-0bbf-496c-9c97-b206dbc94a62] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:54.224417 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-284207d2-6bd7-484b-8e5a-817adcd9f19c tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:54.224960 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-284207d2-6bd7-484b-8e5a-817adcd9f19c tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:54.225429 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-284207d2-6bd7-484b-8e5a-817adcd9f19c tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:54.226142 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-284207d2-6bd7-484b-8e5a-817adcd9f19c tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:54.226598 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-284207d2-6bd7-484b-8e5a-817adcd9f19c tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:54.227029 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-284207d2-6bd7-484b-8e5a-817adcd9f19c tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:54.261301 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-7c2c6da3-1ff5-47f0-9488-d7c1ad6949e9 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2fd6acf18d4218ad143ccee2d0bb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7c2481a908406fa9c4562513fff665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:54.269614 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-7c2c6da3-1ff5-47f0-9488-d7c1ad6949e9 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] 10.222.0.50 "GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256" status: 200 len: 1471 microversion: 2.1 time: 0.181648 Aug 10 17:52:54.283481 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 466/949] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:54 2022] GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256 => generated 1471 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:54.285366 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-53b05f1f-b119-41d6-844b-346491b63f56 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:54.285996 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-53b05f1f-b119-41d6-844b-346491b63f56 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] [instance: 37934416-f4a8-4fee-8f7f-53c9df0f6c72] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:54.292619 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-53b05f1f-b119-41d6-844b-346491b63f56 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:54.293153 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-53b05f1f-b119-41d6-844b-346491b63f56 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:54.293639 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-53b05f1f-b119-41d6-844b-346491b63f56 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:54.294462 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-53b05f1f-b119-41d6-844b-346491b63f56 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:54.295216 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-53b05f1f-b119-41d6-844b-346491b63f56 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:54.295721 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-53b05f1f-b119-41d6-844b-346491b63f56 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:54.312797 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.objects.instance [None req-284207d2-6bd7-484b-8e5a-817adcd9f19c tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lazy-loading 'services' on Instance uuid e2777988-0bbf-496c-9c97-b206dbc94a62 {{(pid=129410) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:52:54.331691 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-284207d2-6bd7-484b-8e5a-817adcd9f19c tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62" status: 200 len: 1925 microversion: 2.75 time: 0.119947 Aug 10 17:52:54.332301 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 484/950] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:52:54 2022] GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62 => generated 1925 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 17:52:54.418916 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-e7da26cd-b60f-4626-ac3b-a44e0665930b tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:54.419602 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-e7da26cd-b60f-4626-ac3b-a44e0665930b tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] [instance: 3ca0b504-e928-4d31-be09-24a70200eff2] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:54.425844 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e7da26cd-b60f-4626-ac3b-a44e0665930b tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:54.426332 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e7da26cd-b60f-4626-ac3b-a44e0665930b tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:54.426799 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e7da26cd-b60f-4626-ac3b-a44e0665930b tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:54.427507 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e7da26cd-b60f-4626-ac3b-a44e0665930b tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:54.427960 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e7da26cd-b60f-4626-ac3b-a44e0665930b tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:54.428419 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e7da26cd-b60f-4626-ac3b-a44e0665930b tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:54.455748 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-53b05f1f-b119-41d6-844b-346491b63f56 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e109c3dcd0574faaa3d7ec31dd4edd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48bbb92998f54ebeb624bc794d406896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:54.463246 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-53b05f1f-b119-41d6-844b-346491b63f56 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] 10.222.0.50 "GET /compute/v2.1/servers/37934416-f4a8-4fee-8f7f-53c9df0f6c72" status: 200 len: 1469 microversion: 2.1 time: 0.184645 Aug 10 17:52:54.467356 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 467/951] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:54 2022] GET /compute/v2.1/servers/37934416-f4a8-4fee-8f7f-53c9df0f6c72 => generated 1469 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:54.592856 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-e7da26cd-b60f-4626-ac3b-a44e0665930b tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83a3e198e21476eb12fcf417aea62de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df088e5a610436ea21b8a360e2bb527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:54.600375 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-e7da26cd-b60f-4626-ac3b-a44e0665930b tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] 10.222.0.50 "GET /compute/v2.1/servers/3ca0b504-e928-4d31-be09-24a70200eff2" status: 200 len: 1468 microversion: 2.1 time: 0.185490 Aug 10 17:52:54.613816 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 485/952] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:54 2022] GET /compute/v2.1/servers/3ca0b504-e928-4d31-be09-24a70200eff2 => generated 1468 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:55.108353 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-0d9f0e6e-054b-44b4-97fd-0c9bd712e329 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:55.109192 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-0d9f0e6e-054b-44b4-97fd-0c9bd712e329 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] [instance: 2c8728f2-55fb-4306-acc5-227ba55ec278] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:55.209268 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-0d9f0e6e-054b-44b4-97fd-0c9bd712e329 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f082ed04bc143679029c204e8a97160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c7c8eeb1b4065b25fe28eba30d0eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:55.218921 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-81aad909-9fde-4df7-a4df-61221eb46120 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:55.220713 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-81aad909-9fde-4df7-a4df-61221eb46120 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: 873f60d0-8ef0-4ff5-800d-945ca4237a28] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:55.242099 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-81aad909-9fde-4df7-a4df-61221eb46120 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:55.242099 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-81aad909-9fde-4df7-a4df-61221eb46120 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:55.243083 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-0d9f0e6e-054b-44b4-97fd-0c9bd712e329 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] 10.222.0.50 "GET /compute/v2.1/servers/2c8728f2-55fb-4306-acc5-227ba55ec278" status: 200 len: 1218 microversion: 2.1 time: 0.139634 Aug 10 17:52:55.244399 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-81aad909-9fde-4df7-a4df-61221eb46120 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:55.245895 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 468/953] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:55 2022] GET /compute/v2.1/servers/2c8728f2-55fb-4306-acc5-227ba55ec278 => generated 1218 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:52:55.246489 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-81aad909-9fde-4df7-a4df-61221eb46120 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:55.247241 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-81aad909-9fde-4df7-a4df-61221eb46120 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:55.248308 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-81aad909-9fde-4df7-a4df-61221eb46120 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:55.292039 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-f96cedcf-5085-42f5-8b4f-eb981d5b8636 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:55.292857 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-f96cedcf-5085-42f5-8b4f-eb981d5b8636 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] [instance: bee3148a-3834-41bd-99e7-b5da75217256] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:55.302504 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-f96cedcf-5085-42f5-8b4f-eb981d5b8636 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:55.303005 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-f96cedcf-5085-42f5-8b4f-eb981d5b8636 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:55.303438 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-f96cedcf-5085-42f5-8b4f-eb981d5b8636 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:55.304148 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-f96cedcf-5085-42f5-8b4f-eb981d5b8636 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:55.304997 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-f96cedcf-5085-42f5-8b4f-eb981d5b8636 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:55.305624 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-f96cedcf-5085-42f5-8b4f-eb981d5b8636 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:55.462737 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-f96cedcf-5085-42f5-8b4f-eb981d5b8636 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2fd6acf18d4218ad143ccee2d0bb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7c2481a908406fa9c4562513fff665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:55.472184 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-f96cedcf-5085-42f5-8b4f-eb981d5b8636 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] 10.222.0.50 "GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256" status: 200 len: 1471 microversion: 2.1 time: 0.184648 Aug 10 17:52:55.473095 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 469/954] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:55 2022] GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256 => generated 1471 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:55.478104 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-fff22160-c322-460f-b28a-4201edc814d4 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:55.480120 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-fff22160-c322-460f-b28a-4201edc814d4 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] [instance: e2777988-0bbf-496c-9c97-b206dbc94a62] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:55.489665 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-fff22160-c322-460f-b28a-4201edc814d4 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:55.490129 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-fff22160-c322-460f-b28a-4201edc814d4 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:55.490567 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-fff22160-c322-460f-b28a-4201edc814d4 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:55.491264 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-fff22160-c322-460f-b28a-4201edc814d4 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:55.491791 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-fff22160-c322-460f-b28a-4201edc814d4 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:55.492129 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-fff22160-c322-460f-b28a-4201edc814d4 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:55.663276 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.objects.instance [None req-fff22160-c322-460f-b28a-4201edc814d4 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lazy-loading 'services' on Instance uuid e2777988-0bbf-496c-9c97-b206dbc94a62 {{(pid=129409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:52:55.694917 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-fff22160-c322-460f-b28a-4201edc814d4 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62" status: 200 len: 1925 microversion: 2.75 time: 0.220698 Aug 10 17:52:55.709155 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 470/955] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:52:55 2022] GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62 => generated 1925 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:52:55.714170 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-5ed2e266-7a1d-4177-8fdb-5579477af862 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:55.725167 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-5ed2e266-7a1d-4177-8fdb-5579477af862 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] [instance: 37934416-f4a8-4fee-8f7f-53c9df0f6c72] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:55.751644 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-5ed2e266-7a1d-4177-8fdb-5579477af862 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:55.751644 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-5ed2e266-7a1d-4177-8fdb-5579477af862 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:55.751644 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-5ed2e266-7a1d-4177-8fdb-5579477af862 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:55.751644 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-5ed2e266-7a1d-4177-8fdb-5579477af862 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:55.751644 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-5ed2e266-7a1d-4177-8fdb-5579477af862 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:55.751644 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-5ed2e266-7a1d-4177-8fdb-5579477af862 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:55.924668 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-81aad909-9fde-4df7-a4df-61221eb46120 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:55.932951 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-81aad909-9fde-4df7-a4df-61221eb46120 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/873f60d0-8ef0-4ff5-800d-945ca4237a28" status: 200 len: 1316 microversion: 2.1 time: 0.721920 Aug 10 17:52:55.933761 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 486/956] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:55 2022] GET /compute/v2.1/servers/873f60d0-8ef0-4ff5-800d-945ca4237a28 => generated 1316 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:52:55.939320 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-a3928e93-f977-4858-941a-199729bbcc36 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:55.943024 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-5ed2e266-7a1d-4177-8fdb-5579477af862 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e109c3dcd0574faaa3d7ec31dd4edd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48bbb92998f54ebeb624bc794d406896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:55.947303 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-a3928e93-f977-4858-941a-199729bbcc36 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] [instance: 3ca0b504-e928-4d31-be09-24a70200eff2] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:55.952365 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-5ed2e266-7a1d-4177-8fdb-5579477af862 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] 10.222.0.50 "GET /compute/v2.1/servers/37934416-f4a8-4fee-8f7f-53c9df0f6c72" status: 200 len: 1469 microversion: 2.1 time: 0.241937 Aug 10 17:52:55.955949 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 471/957] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:55 2022] GET /compute/v2.1/servers/37934416-f4a8-4fee-8f7f-53c9df0f6c72 => generated 1469 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:55.959762 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a3928e93-f977-4858-941a-199729bbcc36 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:55.960369 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a3928e93-f977-4858-941a-199729bbcc36 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:55.960802 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a3928e93-f977-4858-941a-199729bbcc36 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:55.961756 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a3928e93-f977-4858-941a-199729bbcc36 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:55.962207 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a3928e93-f977-4858-941a-199729bbcc36 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:55.962626 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a3928e93-f977-4858-941a-199729bbcc36 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:55.967741 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [req-80f6a797-fff3-421a-b548-383dbd09b63e req-14af4df5-552a-42b7-b8c8-6e4e120650da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ca0b504-e928-4d31-be09-24a70200eff2", "name": "network-vif-deleted", "tag": "40ddb24b-0be9-4b22-93f8-5f65c2504414"}]} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:52:55.977979 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-80f6a797-fff3-421a-b548-383dbd09b63e req-14af4df5-552a-42b7-b8c8-6e4e120650da service nova] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:55.978922 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-80f6a797-fff3-421a-b548-383dbd09b63e req-14af4df5-552a-42b7-b8c8-6e4e120650da service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:55.979600 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-80f6a797-fff3-421a-b548-383dbd09b63e req-14af4df5-552a-42b7-b8c8-6e4e120650da service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:55.993375 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.compute.server_external_events [req-80f6a797-fff3-421a-b548-383dbd09b63e req-14af4df5-552a-42b7-b8c8-6e4e120650da service nova] Creating event network-vif-deleted:40ddb24b-0be9-4b22-93f8-5f65c2504414 for instance 3ca0b504-e928-4d31-be09-24a70200eff2 on n-h1-852296-2 Aug 10 17:52:55.999851 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [req-80f6a797-fff3-421a-b548-383dbd09b63e req-14af4df5-552a-42b7-b8c8-6e4e120650da service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041872 Aug 10 17:52:56.001136 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 472/958] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 10 17:52:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:52:56.152615 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-a3928e93-f977-4858-941a-199729bbcc36 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83a3e198e21476eb12fcf417aea62de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df088e5a610436ea21b8a360e2bb527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:56.174426 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-a3928e93-f977-4858-941a-199729bbcc36 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] 10.222.0.50 "GET /compute/v2.1/servers/3ca0b504-e928-4d31-be09-24a70200eff2" status: 200 len: 1298 microversion: 2.1 time: 0.239432 Aug 10 17:52:56.189247 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 487/959] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:55 2022] GET /compute/v2.1/servers/3ca0b504-e928-4d31-be09-24a70200eff2 => generated 1298 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:56.233791 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [req-f134212b-7849-435d-bcfb-6a968b108482 req-47ede1a7-8c3c-43b6-841b-78c6ca2368d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37934416-f4a8-4fee-8f7f-53c9df0f6c72", "name": "network-vif-deleted", "tag": "3cbaf3c0-cf29-4559-9947-0b6b1c26bf4b"}]} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:52:56.244596 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-f134212b-7849-435d-bcfb-6a968b108482 req-47ede1a7-8c3c-43b6-841b-78c6ca2368d5 service nova] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:56.245317 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-f134212b-7849-435d-bcfb-6a968b108482 req-47ede1a7-8c3c-43b6-841b-78c6ca2368d5 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:56.245904 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-f134212b-7849-435d-bcfb-6a968b108482 req-47ede1a7-8c3c-43b6-841b-78c6ca2368d5 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:56.264578 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-4e783587-8e6f-4b8c-91d2-7e9e14576644 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:56.265778 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-4e783587-8e6f-4b8c-91d2-7e9e14576644 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] [instance: 2c8728f2-55fb-4306-acc5-227ba55ec278] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:56.272275 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.compute.server_external_events [req-f134212b-7849-435d-bcfb-6a968b108482 req-47ede1a7-8c3c-43b6-841b-78c6ca2368d5 service nova] Creating event network-vif-deleted:3cbaf3c0-cf29-4559-9947-0b6b1c26bf4b for instance 37934416-f4a8-4fee-8f7f-53c9df0f6c72 on n-h1-852296-2 Aug 10 17:52:56.275790 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-4e783587-8e6f-4b8c-91d2-7e9e14576644 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:56.276492 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-4e783587-8e6f-4b8c-91d2-7e9e14576644 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:56.280209 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-4e783587-8e6f-4b8c-91d2-7e9e14576644 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:56.281600 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-4e783587-8e6f-4b8c-91d2-7e9e14576644 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:56.282457 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-4e783587-8e6f-4b8c-91d2-7e9e14576644 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:56.283051 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-4e783587-8e6f-4b8c-91d2-7e9e14576644 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:56.288280 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [req-f134212b-7849-435d-bcfb-6a968b108482 req-47ede1a7-8c3c-43b6-841b-78c6ca2368d5 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059374 Aug 10 17:52:56.298022 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 473/960] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 10 17:52:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:52:56.336294 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_cell0:SELECT=2 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:52:56.495023 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-0a7572aa-4c2a-4f3a-8052-b6748fbda3f2 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:56.495734 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-0a7572aa-4c2a-4f3a-8052-b6748fbda3f2 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] [instance: bee3148a-3834-41bd-99e7-b5da75217256] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:56.502822 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-0a7572aa-4c2a-4f3a-8052-b6748fbda3f2 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:56.503315 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-0a7572aa-4c2a-4f3a-8052-b6748fbda3f2 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:56.503949 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-0a7572aa-4c2a-4f3a-8052-b6748fbda3f2 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:56.504724 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-0a7572aa-4c2a-4f3a-8052-b6748fbda3f2 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:56.505190 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-0a7572aa-4c2a-4f3a-8052-b6748fbda3f2 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:56.505621 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-0a7572aa-4c2a-4f3a-8052-b6748fbda3f2 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:56.508775 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:52:56.593441 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-4e783587-8e6f-4b8c-91d2-7e9e14576644 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f082ed04bc143679029c204e8a97160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c7c8eeb1b4065b25fe28eba30d0eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:56.602150 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-4e783587-8e6f-4b8c-91d2-7e9e14576644 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] 10.222.0.50 "GET /compute/v2.1/servers/2c8728f2-55fb-4306-acc5-227ba55ec278" status: 200 len: 1222 microversion: 2.1 time: 0.342013 Aug 10 17:52:56.603523 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 488/961] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:56 2022] GET /compute/v2.1/servers/2c8728f2-55fb-4306-acc5-227ba55ec278 => generated 1222 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:56.651795 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-0a7572aa-4c2a-4f3a-8052-b6748fbda3f2 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2fd6acf18d4218ad143ccee2d0bb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7c2481a908406fa9c4562513fff665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:56.660329 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-0a7572aa-4c2a-4f3a-8052-b6748fbda3f2 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] 10.222.0.50 "GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256" status: 200 len: 1471 microversion: 2.1 time: 0.169599 Aug 10 17:52:56.660992 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 474/962] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:56 2022] GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256 => generated 1471 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:52:56.735466 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-d2c36893-f835-48d7-a345-fd058df806b8 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:56.736078 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-d2c36893-f835-48d7-a345-fd058df806b8 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] [instance: e2777988-0bbf-496c-9c97-b206dbc94a62] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:56.742200 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d2c36893-f835-48d7-a345-fd058df806b8 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:56.742691 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d2c36893-f835-48d7-a345-fd058df806b8 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:56.743133 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d2c36893-f835-48d7-a345-fd058df806b8 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:56.743835 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d2c36893-f835-48d7-a345-fd058df806b8 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:56.744314 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d2c36893-f835-48d7-a345-fd058df806b8 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:56.744749 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d2c36893-f835-48d7-a345-fd058df806b8 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:56.819662 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.objects.instance [None req-d2c36893-f835-48d7-a345-fd058df806b8 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lazy-loading 'services' on Instance uuid e2777988-0bbf-496c-9c97-b206dbc94a62 {{(pid=129410) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:52:56.839139 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-d2c36893-f835-48d7-a345-fd058df806b8 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62" status: 200 len: 1925 microversion: 2.75 time: 0.115512 Aug 10 17:52:56.852978 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 489/963] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:52:56 2022] GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62 => generated 1925 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:52:56.957009 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-dde711d0-3000-4cea-86ae-ae9feaa75d6f tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:56.957881 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-dde711d0-3000-4cea-86ae-ae9feaa75d6f tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: 873f60d0-8ef0-4ff5-800d-945ca4237a28] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:56.960993 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:52:56.964705 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-dde711d0-3000-4cea-86ae-ae9feaa75d6f tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:56.973298 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-dde711d0-3000-4cea-86ae-ae9feaa75d6f tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:56.973298 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-dde711d0-3000-4cea-86ae-ae9feaa75d6f tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:56.973298 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-dde711d0-3000-4cea-86ae-ae9feaa75d6f tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:56.973298 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-dde711d0-3000-4cea-86ae-ae9feaa75d6f tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:56.973298 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-dde711d0-3000-4cea-86ae-ae9feaa75d6f tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:56.979559 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-a291e98a-48e6-4181-b12e-43c496e79bf7 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:56.980524 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-a291e98a-48e6-4181-b12e-43c496e79bf7 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] [instance: 37934416-f4a8-4fee-8f7f-53c9df0f6c72] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:56.988154 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a291e98a-48e6-4181-b12e-43c496e79bf7 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:56.988976 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a291e98a-48e6-4181-b12e-43c496e79bf7 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:56.989681 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a291e98a-48e6-4181-b12e-43c496e79bf7 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:56.990686 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a291e98a-48e6-4181-b12e-43c496e79bf7 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:56.991453 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a291e98a-48e6-4181-b12e-43c496e79bf7 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:56.992136 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a291e98a-48e6-4181-b12e-43c496e79bf7 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:57.074546 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-a291e98a-48e6-4181-b12e-43c496e79bf7 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e109c3dcd0574faaa3d7ec31dd4edd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48bbb92998f54ebeb624bc794d406896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:57.083833 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-a291e98a-48e6-4181-b12e-43c496e79bf7 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] 10.222.0.50 "GET /compute/v2.1/servers/37934416-f4a8-4fee-8f7f-53c9df0f6c72" status: 200 len: 1298 microversion: 2.1 time: 0.109226 Aug 10 17:52:57.085001 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 490/964] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:56 2022] GET /compute/v2.1/servers/37934416-f4a8-4fee-8f7f-53c9df0f6c72 => generated 1298 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:52:57.126437 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-dde711d0-3000-4cea-86ae-ae9feaa75d6f tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:57.134136 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-dde711d0-3000-4cea-86ae-ae9feaa75d6f tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/873f60d0-8ef0-4ff5-800d-945ca4237a28" status: 200 len: 1316 microversion: 2.1 time: 0.181142 Aug 10 17:52:57.134723 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 475/965] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:56 2022] GET /compute/v2.1/servers/873f60d0-8ef0-4ff5-800d-945ca4237a28 => generated 1316 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:57.196919 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-1ed87c15-72f7-4625-9803-231898b16521 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:57.197892 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-1ed87c15-72f7-4625-9803-231898b16521 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] [instance: 3ca0b504-e928-4d31-be09-24a70200eff2] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:57.205405 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-1ed87c15-72f7-4625-9803-231898b16521 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:57.206118 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-1ed87c15-72f7-4625-9803-231898b16521 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:57.218938 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-1ed87c15-72f7-4625-9803-231898b16521 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:57.218938 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-1ed87c15-72f7-4625-9803-231898b16521 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:57.218938 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-1ed87c15-72f7-4625-9803-231898b16521 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:57.218938 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-1ed87c15-72f7-4625-9803-231898b16521 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:57.249931 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-1ed87c15-72f7-4625-9803-231898b16521 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:57.250418 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-1ed87c15-72f7-4625-9803-231898b16521 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:57.251071 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-1ed87c15-72f7-4625-9803-231898b16521 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:57.251572 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.objects.instance [None req-1ed87c15-72f7-4625-9803-231898b16521 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lazy-loading 'fault' on Instance uuid 3ca0b504-e928-4d31-be09-24a70200eff2 {{(pid=129410) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:52:57.297329 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-1ed87c15-72f7-4625-9803-231898b16521 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83a3e198e21476eb12fcf417aea62de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df088e5a610436ea21b8a360e2bb527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:57.305315 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-1ed87c15-72f7-4625-9803-231898b16521 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] 10.222.0.50 "GET /compute/v2.1/servers/3ca0b504-e928-4d31-be09-24a70200eff2" status: 200 len: 1312 microversion: 2.1 time: 0.112510 Aug 10 17:52:57.310618 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 491/966] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:57 2022] GET /compute/v2.1/servers/3ca0b504-e928-4d31-be09-24a70200eff2 => generated 1312 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:57.624923 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-9da50a68-c1bd-4173-bf60-f03def352b23 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:57.625556 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-9da50a68-c1bd-4173-bf60-f03def352b23 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] [instance: 2c8728f2-55fb-4306-acc5-227ba55ec278] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:57.632061 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-9da50a68-c1bd-4173-bf60-f03def352b23 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:57.632592 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-9da50a68-c1bd-4173-bf60-f03def352b23 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:57.633040 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-9da50a68-c1bd-4173-bf60-f03def352b23 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:57.633772 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-9da50a68-c1bd-4173-bf60-f03def352b23 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:57.634235 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-9da50a68-c1bd-4173-bf60-f03def352b23 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:57.634668 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-9da50a68-c1bd-4173-bf60-f03def352b23 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:57.681986 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-003e8b82-dbe6-4eec-8a5c-3ac42deb1940 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:57.682693 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-003e8b82-dbe6-4eec-8a5c-3ac42deb1940 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] [instance: bee3148a-3834-41bd-99e7-b5da75217256] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:57.690186 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-003e8b82-dbe6-4eec-8a5c-3ac42deb1940 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:57.690752 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-003e8b82-dbe6-4eec-8a5c-3ac42deb1940 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:57.691279 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-003e8b82-dbe6-4eec-8a5c-3ac42deb1940 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:57.692052 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-003e8b82-dbe6-4eec-8a5c-3ac42deb1940 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:57.692604 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-003e8b82-dbe6-4eec-8a5c-3ac42deb1940 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:57.693098 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-003e8b82-dbe6-4eec-8a5c-3ac42deb1940 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:57.716922 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-9da50a68-c1bd-4173-bf60-f03def352b23 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f082ed04bc143679029c204e8a97160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c7c8eeb1b4065b25fe28eba30d0eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:57.725259 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-9da50a68-c1bd-4173-bf60-f03def352b23 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] 10.222.0.50 "GET /compute/v2.1/servers/2c8728f2-55fb-4306-acc5-227ba55ec278" status: 200 len: 1214 microversion: 2.1 time: 0.105187 Aug 10 17:52:57.725804 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 476/967] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:57 2022] GET /compute/v2.1/servers/2c8728f2-55fb-4306-acc5-227ba55ec278 => generated 1214 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:57.862789 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-003e8b82-dbe6-4eec-8a5c-3ac42deb1940 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2fd6acf18d4218ad143ccee2d0bb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7c2481a908406fa9c4562513fff665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:57.867495 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-de6f5e71-d24c-4577-85ab-a42228174e95 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:57.868116 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-de6f5e71-d24c-4577-85ab-a42228174e95 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] [instance: e2777988-0bbf-496c-9c97-b206dbc94a62] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:57.873317 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-003e8b82-dbe6-4eec-8a5c-3ac42deb1940 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] 10.222.0.50 "GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256" status: 200 len: 1471 microversion: 2.1 time: 0.195729 Aug 10 17:52:57.874809 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 492/968] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:57 2022] GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256 => generated 1471 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:52:57.875195 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-de6f5e71-d24c-4577-85ab-a42228174e95 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:57.876346 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-de6f5e71-d24c-4577-85ab-a42228174e95 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:57.877026 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-de6f5e71-d24c-4577-85ab-a42228174e95 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:57.878108 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-de6f5e71-d24c-4577-85ab-a42228174e95 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:57.878776 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-de6f5e71-d24c-4577-85ab-a42228174e95 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:57.879403 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-de6f5e71-d24c-4577-85ab-a42228174e95 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:57.989784 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-1ed61950-1eb6-4dee-ae32-811753338220 tempest-ServersTestBootFromVolume-1380572823 tempest-ServersTestBootFromVolume-1380572823-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-454588076", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "ce34d998-a74d-42d1-9d25-4ac593f12547"}], "security_groups": [{"name": "tempest-securitygroup--2026322170"}], "key_name": "tempest-keypair-80691101", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "baff9737-a3fd-429d-8d08-2a0d9062a959", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:52:58.025886 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.objects.instance [None req-de6f5e71-d24c-4577-85ab-a42228174e95 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lazy-loading 'services' on Instance uuid e2777988-0bbf-496c-9c97-b206dbc94a62 {{(pid=129409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:52:58.049347 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-de6f5e71-d24c-4577-85ab-a42228174e95 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62" status: 200 len: 1925 microversion: 2.75 time: 0.186090 Aug 10 17:52:58.049961 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 477/969] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:52:57 2022] GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62 => generated 1925 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 17:52:58.105937 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-df1187c8-cb2b-4853-9574-9e8870ca96e1 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:58.107373 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-df1187c8-cb2b-4853-9574-9e8870ca96e1 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] [instance: 37934416-f4a8-4fee-8f7f-53c9df0f6c72] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:58.114987 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-df1187c8-cb2b-4853-9574-9e8870ca96e1 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:58.115765 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-df1187c8-cb2b-4853-9574-9e8870ca96e1 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:58.116419 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-df1187c8-cb2b-4853-9574-9e8870ca96e1 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:58.117134 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-df1187c8-cb2b-4853-9574-9e8870ca96e1 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:58.117756 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-df1187c8-cb2b-4853-9574-9e8870ca96e1 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:58.118399 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-df1187c8-cb2b-4853-9574-9e8870ca96e1 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:58.147138 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.network.neutron [None req-1ed61950-1eb6-4dee-ae32-811753338220 tempest-ServersTestBootFromVolume-1380572823 tempest-ServersTestBootFromVolume-1380572823-project] validate_networks() for [('ce34d998-a74d-42d1-9d25-4ac593f12547', None, None, None, None, None)] {{(pid=129410) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 17:52:58.153949 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-df1187c8-cb2b-4853-9574-9e8870ca96e1 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:58.154585 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-df1187c8-cb2b-4853-9574-9e8870ca96e1 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:58.155506 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-df1187c8-cb2b-4853-9574-9e8870ca96e1 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:58.156209 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.objects.instance [None req-df1187c8-cb2b-4853-9574-9e8870ca96e1 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lazy-loading 'fault' on Instance uuid 37934416-f4a8-4fee-8f7f-53c9df0f6c72 {{(pid=129409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:52:58.232090 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-df1187c8-cb2b-4853-9574-9e8870ca96e1 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e109c3dcd0574faaa3d7ec31dd4edd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48bbb92998f54ebeb624bc794d406896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:58.242788 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-df1187c8-cb2b-4853-9574-9e8870ca96e1 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] 10.222.0.50 "GET /compute/v2.1/servers/37934416-f4a8-4fee-8f7f-53c9df0f6c72" status: 200 len: 1303 microversion: 2.1 time: 0.140693 Aug 10 17:52:58.245794 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 478/970] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:58 2022] GET /compute/v2.1/servers/37934416-f4a8-4fee-8f7f-53c9df0f6c72 => generated 1303 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:52:58.264930 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-8ec9c159-b225-41f9-b479-e1968f0f2e90 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:58.266706 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-8ec9c159-b225-41f9-b479-e1968f0f2e90 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: 873f60d0-8ef0-4ff5-800d-945ca4237a28] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:58.282736 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-8ec9c159-b225-41f9-b479-e1968f0f2e90 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:58.283269 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-8ec9c159-b225-41f9-b479-e1968f0f2e90 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:58.284615 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-8ec9c159-b225-41f9-b479-e1968f0f2e90 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:58.285789 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-8ec9c159-b225-41f9-b479-e1968f0f2e90 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:58.286274 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-8ec9c159-b225-41f9-b479-e1968f0f2e90 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:58.286961 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-8ec9c159-b225-41f9-b479-e1968f0f2e90 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:58.490982 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-8ec9c159-b225-41f9-b479-e1968f0f2e90 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:58.491252 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [None req-1ed61950-1eb6-4dee-ae32-811753338220 tempest-ServersTestBootFromVolume-1380572823 tempest-ServersTestBootFromVolume-1380572823-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-fc7730b3-ae8d-49d3-8da6-3f707dc3ab92) Aug 10 17:52:58.491252 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:52:58.491252 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:52:58.491252 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:52:58.491252 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:52:58.491252 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:52:58.491252 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:52:58.491252 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:52:58.491252 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:52:58.491252 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:52:58.491252 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 17:52:58.491252 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 17:52:58.491252 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 17:52:58.491252 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 17:52:58.491252 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 17:52:58.491252 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 17:52:58.491252 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 17:52:58.491252 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 17:52:58.491252 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 17:52:58.491252 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 17:52:58.491252 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 17:52:58.491252 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 17:52:58.491252 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 17:52:58.491252 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 17:52:58.491252 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 17:52:58.491252 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 17:52:58.491252 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 17:52:58.491252 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:52:58.491252 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:52:58.491252 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 17:52:58.491252 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 17:52:58.491252 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:52:58.491252 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:52:58.491252 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:52:58.491252 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:52:58.491252 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:52:58.491252 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:52:58.491252 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:52:58.491252 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:52:58.491252 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:52:58.491252 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:52:58.491252 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 17:52:58.491252 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 17:52:58.491252 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 17:52:58.491252 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 17:52:58.491252 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 17:52:58.491252 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 17:52:58.491252 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 17:52:58.491252 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 17:52:58.491252 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 17:52:58.491252 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 17:52:58.491252 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 17:52:58.495719 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 17:52:58.495719 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 17:52:58.495719 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 17:52:58.495719 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 17:52:58.495719 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 17:52:58.495719 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 17:52:58.495719 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 17:52:58.495719 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 17:52:58.495719 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 17:52:58.495719 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 17:52:58.495719 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 17:52:58.495719 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 17:52:58.495719 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 17:52:58.495719 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 17:52:58.495719 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 17:52:58.495719 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-fc7730b3-ae8d-49d3-8da6-3f707dc3ab92) Aug 10 17:52:58.495719 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:52:58.495719 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-1ed61950-1eb6-4dee-ae32-811753338220 tempest-ServersTestBootFromVolume-1380572823 tempest-ServersTestBootFromVolume-1380572823-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:52:58.495719 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 17:52:58.495719 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-1ed61950-1eb6-4dee-ae32-811753338220 tempest-ServersTestBootFromVolume-1380572823 tempest-ServersTestBootFromVolume-1380572823-project] Request method failure captured: Aug 10 17:52:58.495719 n-d-852296-2 devstack@n-api.service[129410]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 17:52:58.495719 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 17:52:58.495719 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 17:52:58.495719 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 17:52:58.495719 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 786 Aug 10 17:52:58.495719 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 17:52:58.495719 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 17:52:58.495719 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 17:52:58.495719 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 17:52:58.495719 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8_BKTeiBkYtoBmjDLWOSrfbJs4yIW23gI35IQ8GmKtK6EKTEx0HpQLzHuo8KNyj56tNmu4Ag1kErY8bBKWDcZLk8fmkxRMOHsfdi0ncrLBiw8S9mPurUCM2K3gWZ4lazXYWZDxcvf2AatojhR1FOztRV3sfUOYR0zrUddPeqrBOlEm4 Aug 10 17:52:58.495719 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 17:52:58.495719 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 17:52:58.495719 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 17:52:58.495719 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 17:52:58.495719 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 17:52:58.495719 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 17:52:58.495719 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: 065cbd9235f3459ab207302019d19a60 Aug 10 17:52:58.495719 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-ServersTestBootFromVolume-1380572823 Aug 10 17:52:58.495719 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 17:52:58.495719 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 17:52:58.495719 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/065cbd9235f3459ab207302019d19a60"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/065cbd9235f3459ab207302019d19a60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/065cbd9235f3459ab207302019d19a60"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_065cbd9235f3459ab207302019d19a60", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:52:58.495719 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-ServersTestBootFromVolume-1380572823 Aug 10 17:52:58.495719 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: 065cbd9235f3459ab207302019d19a60 Aug 10 17:52:58.495719 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-ServersTestBootFromVolume-1380572823 Aug 10 17:52:58.495719 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-ServersTestBootFromVolume-1380572823-project Aug 10 17:52:58.495719 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 17:52:58.495719 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 17:52:58.495719 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: 7876521dc1b54398ac3fae72846211c6 Aug 10 17:52:58.495719 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-ServersTestBootFromVolume-1380572823-project Aug 10 17:52:58.495719 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 17:52:58.495719 n-d-852296-2 devstack@n-api.service[129410]: {"server": {"name": "tempest-ServersTestBootFromVolume-server-454588076", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "T1+IflrDJyy9X6C", "networks": [{"uuid": "ce34d998-a74d-42d1-9d25-4ac593f12547"}], "security_groups": [{"name": "tempest-securitygroup--2026322170"}], "key_name": "tempest-keypair-80691101", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "baff9737-a3fd-429d-8d08-2a0d9062a959", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "AUTO"}} Aug 10 17:52:58.501383 n-d-852296-2 devstack@n-api.service[129410]: method: > Aug 10 17:52:58.501383 n-d-852296-2 devstack@n-api.service[129410]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:52:58.501383 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 17:52:58.501383 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'body': {'server': {'name': 'tempest-ServersTestBootFromVolume-server-454588076', 'imageRef': '', 'flavorRef': '452', 'metadata': {'hello': 'world'}, 'adminPass': 'T1+IflrDJyy9X6C', 'networks': [{'uuid': 'ce34d998-a74d-42d1-9d25-4ac593f12547'}], 'security_groups': [{'name': 'tempest-securitygroup--2026322170'}], 'key_name': 'tempest-keypair-80691101', 'user_data': 'IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=', 'block_device_mapping_v2': [{'source_type': 'volume', 'destination_type': 'volume', 'boot_index': 0, 'delete_on_termination': True, 'volume_id': 'baff9737-a3fd-429d-8d08-2a0d9062a959'}]}}} Aug 10 17:52:58.501383 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:52:58.501383 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:52:58.501383 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:52:58.501383 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:52:58.501383 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:52:58.501383 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:52:58.501383 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:52:58.501383 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:52:58.501383 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:52:58.501383 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:52:58.501383 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 17:52:58.501383 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 17:52:58.501383 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 17:52:58.501383 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 17:52:58.501383 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 17:52:58.501383 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 17:52:58.501383 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 17:52:58.501383 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 17:52:58.501383 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 17:52:58.501383 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 17:52:58.501383 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 17:52:58.501383 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 17:52:58.501383 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 17:52:58.501383 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 17:52:58.501383 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 17:52:58.501383 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 17:52:58.501383 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 17:52:58.501383 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:52:58.501383 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:52:58.501383 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 17:52:58.501383 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 17:52:58.501383 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:52:58.501383 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:52:58.501383 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:52:58.501383 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:52:58.501383 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:52:58.501383 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:52:58.501383 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:52:58.501383 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:52:58.501383 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:52:58.501383 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:52:58.501383 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 17:52:58.501383 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 17:52:58.501383 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 17:52:58.501383 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 17:52:58.501383 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 17:52:58.501383 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 17:52:58.505542 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 17:52:58.505542 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 17:52:58.505542 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 17:52:58.505542 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 17:52:58.505542 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 17:52:58.505542 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 17:52:58.505542 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 17:52:58.505542 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 17:52:58.505542 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 17:52:58.505542 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 17:52:58.505542 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 17:52:58.505542 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 17:52:58.505542 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 17:52:58.505542 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 17:52:58.505542 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 17:52:58.505542 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 17:52:58.505542 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 17:52:58.505542 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 17:52:58.505542 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 17:52:58.505542 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 17:52:58.505542 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-fc7730b3-ae8d-49d3-8da6-3f707dc3ab92) Aug 10 17:52:58.505542 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:52:58.505542 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:52:58.505542 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:52:58.505542 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:52:58.505542 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:52:58.505542 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:52:58.505542 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:52:58.505542 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:52:58.505542 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 10 17:52:58.505542 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 10 17:52:58.505542 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:52:58.505542 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:52:58.505542 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:52:58.505542 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:52:58.505542 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:52:58.505542 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:52:58.505542 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:52:58.505542 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:52:58.505542 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:52:58.505542 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:52:58.505542 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:52:58.505542 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:52:58.505542 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:52:58.505542 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-1ed61950-1eb6-4dee-ae32-811753338220 tempest-ServersTestBootFromVolume-1380572823 tempest-ServersTestBootFromVolume-1380572823-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:52:58.505542 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:52:58.505542 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-1ed61950-1eb6-4dee-ae32-811753338220 tempest-ServersTestBootFromVolume-1380572823 tempest-ServersTestBootFromVolume-1380572823-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.482419 Aug 10 17:52:58.505542 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 493/971] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 17:52:57 2022] POST /compute/v2.1/servers => generated 214 bytes in 484 msecs (HTTP/1.1 500) 9 headers in 391 bytes (2 switches on core 0) Aug 10 17:52:58.509646 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-8ec9c159-b225-41f9-b479-e1968f0f2e90 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/873f60d0-8ef0-4ff5-800d-945ca4237a28" status: 200 len: 1316 microversion: 2.1 time: 0.222054 Aug 10 17:52:58.509646 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 479/972] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:58 2022] GET /compute/v2.1/servers/873f60d0-8ef0-4ff5-800d-945ca4237a28 => generated 1316 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:58.509882 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-90224522-e974-4f5d-ac62-09e820dbdcfa tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:58.509882 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-90224522-e974-4f5d-ac62-09e820dbdcfa tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] [instance: 3ca0b504-e928-4d31-be09-24a70200eff2] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:58.510063 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-44a8d7a5-dac0-4c22-b4d8-80b86bbde1e8 tempest-ServersTestBootFromVolume-1380572823 tempest-ServersTestBootFromVolume-1380572823-project] Calling method '.version_select at 0x7fb346059f70>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:58.510167 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-90224522-e974-4f5d-ac62-09e820dbdcfa tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:58.510167 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-90224522-e974-4f5d-ac62-09e820dbdcfa tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:58.510167 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-90224522-e974-4f5d-ac62-09e820dbdcfa tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:58.510167 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-90224522-e974-4f5d-ac62-09e820dbdcfa tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:58.510167 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-90224522-e974-4f5d-ac62-09e820dbdcfa tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:58.510167 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-90224522-e974-4f5d-ac62-09e820dbdcfa tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:58.510167 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-90224522-e974-4f5d-ac62-09e820dbdcfa tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] HTTP exception thrown: Instance 3ca0b504-e928-4d31-be09-24a70200eff2 could not be found. Aug 10 17:52:58.510167 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-90224522-e974-4f5d-ac62-09e820dbdcfa tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Request method failure captured: Aug 10 17:52:58.510167 n-d-852296-2 devstack@n-api.service[129410]: request: GET /compute/v2.1/servers/3ca0b504-e928-4d31-be09-24a70200eff2 HTTP/1.1 Aug 10 17:52:58.510167 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 17:52:58.510167 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 17:52:58.510167 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 17:52:58.510167 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 0 Aug 10 17:52:58.510167 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 17:52:58.510167 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 17:52:58.510167 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 17:52:58.510167 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 17:52:58.510167 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8_Ax5FoTzfQ9mXfAgBDm0Eq_KUKl79ObzeWWghowFTicYlEw2PN4VFAH5oo2rZYIAzobuZ642g072vGbg9xWKdJYfvA39uBz-K_2MauHArZmoeWgH06ksMYTO5qtjmfnPIsT3z9bK61c1f2ecM3zukbnVnlwF0ZmhjuJ5FbSISCyCeY Aug 10 17:52:58.510167 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 17:52:58.510167 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 17:52:58.510167 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 17:52:58.510167 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 17:52:58.510167 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 17:52:58.510167 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 17:52:58.510167 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: 9df088e5a610436ea21b8a360e2bb527 Aug 10 17:52:58.510167 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2097420203 Aug 10 17:52:58.510167 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 17:52:58.510167 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 17:52:58.510167 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9df088e5a610436ea21b8a360e2bb527"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9df088e5a610436ea21b8a360e2bb527"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9df088e5a610436ea21b8a360e2bb527"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9df088e5a610436ea21b8a360e2bb527", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:52:58.510167 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2097420203 Aug 10 17:52:58.510167 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: 9df088e5a610436ea21b8a360e2bb527 Aug 10 17:52:58.510167 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2097420203 Aug 10 17:52:58.510167 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-ServersAdminNegativeTestJSON-2097420203-project Aug 10 17:52:58.510167 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 17:52:58.510167 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 17:52:58.510167 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: e83a3e198e21476eb12fcf417aea62de Aug 10 17:52:58.510167 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2097420203-project Aug 10 17:52:58.514398 n-d-852296-2 devstack@n-api.service[129410]: method: > Aug 10 17:52:58.514398 n-d-852296-2 devstack@n-api.service[129410]: exception: Instance 3ca0b504-e928-4d31-be09-24a70200eff2 could not be found. Aug 10 17:52:58.514398 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'id': '3ca0b504-e928-4d31-be09-24a70200eff2'} Aug 10 17:52:58.514398 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:52:58.514398 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:52:58.514398 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 17:52:58.514398 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 17:52:58.514398 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 17:52:58.514398 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 17:52:58.514398 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 17:52:58.514398 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 17:52:58.514398 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 17:52:58.514398 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 17:52:58.514398 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ca0b504-e928-4d31-be09-24a70200eff2 could not be found. Aug 10 17:52:58.514398 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:52:58.514398 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:52:58.514398 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:52:58.514398 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:52:58.514398 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:52:58.514398 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:52:58.514398 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:52:58.514398 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:52:58.514398 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:52:58.514398 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:52:58.514398 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 17:52:58.514398 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 17:52:58.514398 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 17:52:58.514398 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 17:52:58.514398 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 17:52:58.514398 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:52:58.514398 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ca0b504-e928-4d31-be09-24a70200eff2 could not be found. Aug 10 17:52:58.514398 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:52:58.514398 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:52:58.514398 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:52:58.514398 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:52:58.514398 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:52:58.514398 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:52:58.514398 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:52:58.514398 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:52:58.514398 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ca0b504-e928-4d31-be09-24a70200eff2 could not be found. Aug 10 17:52:58.514398 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:52:58.514398 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-90224522-e974-4f5d-ac62-09e820dbdcfa tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Returning 404 to user: Instance 3ca0b504-e928-4d31-be09-24a70200eff2 could not be found. {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:52:58.514398 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-90224522-e974-4f5d-ac62-09e820dbdcfa tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] 10.222.0.50 "GET /compute/v2.1/servers/3ca0b504-e928-4d31-be09-24a70200eff2" status: 404 len: 111 microversion: 2.1 time: 0.042624 Aug 10 17:52:58.514398 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 494/973] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:58 2022] GET /compute/v2.1/servers/3ca0b504-e928-4d31-be09-24a70200eff2 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:52:58.521066 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-103e0b09-7a08-4813-97e6-751f0aac6e3a tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:58.521664 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-103e0b09-7a08-4813-97e6-751f0aac6e3a tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] [instance: 25b28585-a586-423f-8f04-2b2f4d28f16c] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:58.528618 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-103e0b09-7a08-4813-97e6-751f0aac6e3a tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:58.535238 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-103e0b09-7a08-4813-97e6-751f0aac6e3a tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:58.535238 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-103e0b09-7a08-4813-97e6-751f0aac6e3a tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:58.535238 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-103e0b09-7a08-4813-97e6-751f0aac6e3a tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:58.535238 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-103e0b09-7a08-4813-97e6-751f0aac6e3a tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:58.535238 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-103e0b09-7a08-4813-97e6-751f0aac6e3a tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:58.559250 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-103e0b09-7a08-4813-97e6-751f0aac6e3a tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] [instance: 25b28585-a586-423f-8f04-2b2f4d28f16c] Going to try to terminate instance {{(pid=129410) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 17:52:58.682026 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-44a8d7a5-dac0-4c22-b4d8-80b86bbde1e8 tempest-ServersTestBootFromVolume-1380572823 tempest-ServersTestBootFromVolume-1380572823-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-80691101" status: 202 len: 0 microversion: 2.1 time: 0.208822 Aug 10 17:52:58.682945 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 480/974] 10.222.0.50 () {58 vars in 1215 bytes} [Wed Aug 10 17:52:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-80691101 => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 17:52:58.749884 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-b51137db-3c1b-42f3-8de7-df636b70052a tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:58.750651 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-b51137db-3c1b-42f3-8de7-df636b70052a tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] [instance: 2c8728f2-55fb-4306-acc5-227ba55ec278] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:58.756604 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-b51137db-3c1b-42f3-8de7-df636b70052a tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:58.757092 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-b51137db-3c1b-42f3-8de7-df636b70052a tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:58.757531 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-b51137db-3c1b-42f3-8de7-df636b70052a tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:58.758246 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-b51137db-3c1b-42f3-8de7-df636b70052a tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:58.758692 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-b51137db-3c1b-42f3-8de7-df636b70052a tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:58.759125 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-b51137db-3c1b-42f3-8de7-df636b70052a tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:58.835223 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-b51137db-3c1b-42f3-8de7-df636b70052a tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f082ed04bc143679029c204e8a97160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c7c8eeb1b4065b25fe28eba30d0eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:58.843503 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-b51137db-3c1b-42f3-8de7-df636b70052a tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] 10.222.0.50 "GET /compute/v2.1/servers/2c8728f2-55fb-4306-acc5-227ba55ec278" status: 200 len: 1270 microversion: 2.1 time: 0.098221 Aug 10 17:52:58.844069 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 481/975] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:58 2022] GET /compute/v2.1/servers/2c8728f2-55fb-4306-acc5-227ba55ec278 => generated 1270 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:52:58.895034 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-916bfa62-9fd0-45c4-ba01-3d7cf34521ce tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:58.895444 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-916bfa62-9fd0-45c4-ba01-3d7cf34521ce tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] [instance: bee3148a-3834-41bd-99e7-b5da75217256] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:58.902581 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-916bfa62-9fd0-45c4-ba01-3d7cf34521ce tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:58.903074 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-916bfa62-9fd0-45c4-ba01-3d7cf34521ce tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:58.904078 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-916bfa62-9fd0-45c4-ba01-3d7cf34521ce tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:58.904904 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-916bfa62-9fd0-45c4-ba01-3d7cf34521ce tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:58.905358 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-916bfa62-9fd0-45c4-ba01-3d7cf34521ce tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:58.905782 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-916bfa62-9fd0-45c4-ba01-3d7cf34521ce tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:58.994474 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-103e0b09-7a08-4813-97e6-751f0aac6e3a tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] 10.222.0.50 "DELETE /compute/v2.1/servers/25b28585-a586-423f-8f04-2b2f4d28f16c" status: 204 len: 0 microversion: 2.1 time: 0.475986 Aug 10 17:52:58.996145 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 495/976] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 10 17:52:58 2022] DELETE /compute/v2.1/servers/25b28585-a586-423f-8f04-2b2f4d28f16c => generated 0 bytes in 479 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 10 17:52:59.007383 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-f8eb7d38-f9c7-4bef-bacd-90caf247fa4c tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:59.008359 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-f8eb7d38-f9c7-4bef-bacd-90caf247fa4c tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] [instance: 25b28585-a586-423f-8f04-2b2f4d28f16c] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:59.016503 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-f8eb7d38-f9c7-4bef-bacd-90caf247fa4c tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:59.017005 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-f8eb7d38-f9c7-4bef-bacd-90caf247fa4c tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:59.017450 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-f8eb7d38-f9c7-4bef-bacd-90caf247fa4c tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:59.018177 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-f8eb7d38-f9c7-4bef-bacd-90caf247fa4c tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:59.018635 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-f8eb7d38-f9c7-4bef-bacd-90caf247fa4c tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:59.019114 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-f8eb7d38-f9c7-4bef-bacd-90caf247fa4c tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:59.083247 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-916bfa62-9fd0-45c4-ba01-3d7cf34521ce tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2fd6acf18d4218ad143ccee2d0bb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7c2481a908406fa9c4562513fff665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:59.091469 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-916bfa62-9fd0-45c4-ba01-3d7cf34521ce tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] 10.222.0.50 "GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256" status: 200 len: 1471 microversion: 2.1 time: 0.199922 Aug 10 17:52:59.092384 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 482/977] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:58 2022] GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256 => generated 1471 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:52:59.102051 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-f4ea012d-337c-46b5-93af-89e823eaa873 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:59.102932 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-f4ea012d-337c-46b5-93af-89e823eaa873 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] [instance: e2777988-0bbf-496c-9c97-b206dbc94a62] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:59.127822 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-f4ea012d-337c-46b5-93af-89e823eaa873 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:59.128797 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-f4ea012d-337c-46b5-93af-89e823eaa873 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:59.129496 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-f4ea012d-337c-46b5-93af-89e823eaa873 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:59.130346 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-f4ea012d-337c-46b5-93af-89e823eaa873 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:59.130869 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-f4ea012d-337c-46b5-93af-89e823eaa873 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:59.131376 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-f4ea012d-337c-46b5-93af-89e823eaa873 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:59.225018 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.objects.instance [None req-f4ea012d-337c-46b5-93af-89e823eaa873 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lazy-loading 'services' on Instance uuid e2777988-0bbf-496c-9c97-b206dbc94a62 {{(pid=129409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:52:59.253503 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-f4ea012d-337c-46b5-93af-89e823eaa873 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62" status: 200 len: 1925 microversion: 2.75 time: 0.159806 Aug 10 17:52:59.254124 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 483/978] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:52:59 2022] GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62 => generated 1925 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:52:59.278905 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-aa8aa969-5e2d-4f4b-a0a1-e7289719dfb1 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:59.285313 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-aa8aa969-5e2d-4f4b-a0a1-e7289719dfb1 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] [instance: 37934416-f4a8-4fee-8f7f-53c9df0f6c72] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:59.294346 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-aa8aa969-5e2d-4f4b-a0a1-e7289719dfb1 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:59.295135 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-aa8aa969-5e2d-4f4b-a0a1-e7289719dfb1 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:59.295738 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-aa8aa969-5e2d-4f4b-a0a1-e7289719dfb1 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:59.296835 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-aa8aa969-5e2d-4f4b-a0a1-e7289719dfb1 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:59.297454 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-aa8aa969-5e2d-4f4b-a0a1-e7289719dfb1 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:59.298040 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-aa8aa969-5e2d-4f4b-a0a1-e7289719dfb1 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:59.314042 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-aa8aa969-5e2d-4f4b-a0a1-e7289719dfb1 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] HTTP exception thrown: Instance 37934416-f4a8-4fee-8f7f-53c9df0f6c72 could not be found. Aug 10 17:52:59.315825 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-aa8aa969-5e2d-4f4b-a0a1-e7289719dfb1 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Request method failure captured: Aug 10 17:52:59.315825 n-d-852296-2 devstack@n-api.service[129409]: request: GET /compute/v2.1/servers/37934416-f4a8-4fee-8f7f-53c9df0f6c72 HTTP/1.1 Aug 10 17:52:59.315825 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 17:52:59.315825 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 17:52:59.315825 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 17:52:59.315825 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 0 Aug 10 17:52:59.315825 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 17:52:59.315825 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 17:52:59.315825 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 17:52:59.315825 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 17:52:59.315825 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8-_0hr6nliTkkjEq4POLxTS39b7AKRzs5IHoadOFYk-Avq_EhHZhiXBqUGkDcgCWPqhSAgOsv1fUEScaBilJPZ4n8-MqEuqv4LzNqxeh_dhY8n5FOoRyMW4xdBlwKatTDuceji8cWTk46ZLZhXUEi0tZyObBcD9QSkhHyY2UTCtQ3Ok Aug 10 17:52:59.315825 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 17:52:59.315825 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 17:52:59.315825 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 17:52:59.315825 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 17:52:59.315825 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 17:52:59.315825 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 17:52:59.315825 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: 48bbb92998f54ebeb624bc794d406896 Aug 10 17:52:59.315825 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-MigrationsAdminTest-561431726 Aug 10 17:52:59.315825 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 17:52:59.315825 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 17:52:59.315825 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/48bbb92998f54ebeb624bc794d406896"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/48bbb92998f54ebeb624bc794d406896"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/48bbb92998f54ebeb624bc794d406896"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_48bbb92998f54ebeb624bc794d406896", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:52:59.315825 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-MigrationsAdminTest-561431726 Aug 10 17:52:59.315825 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: 48bbb92998f54ebeb624bc794d406896 Aug 10 17:52:59.315825 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-MigrationsAdminTest-561431726 Aug 10 17:52:59.315825 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-MigrationsAdminTest-561431726-project Aug 10 17:52:59.315825 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 17:52:59.315825 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 17:52:59.315825 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: e109c3dcd0574faaa3d7ec31dd4edd24 Aug 10 17:52:59.315825 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-MigrationsAdminTest-561431726-project Aug 10 17:52:59.315825 n-d-852296-2 devstack@n-api.service[129409]: method: > Aug 10 17:52:59.315825 n-d-852296-2 devstack@n-api.service[129409]: exception: Instance 37934416-f4a8-4fee-8f7f-53c9df0f6c72 could not be found. Aug 10 17:52:59.315825 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'id': '37934416-f4a8-4fee-8f7f-53c9df0f6c72'} Aug 10 17:52:59.315825 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:52:59.315825 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:52:59.315825 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 17:52:59.315825 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 17:52:59.315825 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 17:52:59.315825 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 17:52:59.315825 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 17:52:59.315825 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 17:52:59.315825 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 17:52:59.315825 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 17:52:59.315825 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37934416-f4a8-4fee-8f7f-53c9df0f6c72 could not be found. Aug 10 17:52:59.315825 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:52:59.315825 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:52:59.315825 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:52:59.315825 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:52:59.315825 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:52:59.315825 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:52:59.315825 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:52:59.315825 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:52:59.315825 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:52:59.315825 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:52:59.315825 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 17:52:59.315825 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 17:52:59.315825 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 17:52:59.315825 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 17:52:59.315825 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 17:52:59.315825 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:52:59.315825 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37934416-f4a8-4fee-8f7f-53c9df0f6c72 could not be found. Aug 10 17:52:59.315825 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:52:59.315825 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:52:59.315825 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:52:59.320049 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:52:59.320049 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:52:59.320049 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:52:59.320049 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:52:59.320049 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:52:59.320049 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37934416-f4a8-4fee-8f7f-53c9df0f6c72 could not be found. Aug 10 17:52:59.320049 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:52:59.320049 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-aa8aa969-5e2d-4f4b-a0a1-e7289719dfb1 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Returning 404 to user: Instance 37934416-f4a8-4fee-8f7f-53c9df0f6c72 could not be found. {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:52:59.320049 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-aa8aa969-5e2d-4f4b-a0a1-e7289719dfb1 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] 10.222.0.50 "GET /compute/v2.1/servers/37934416-f4a8-4fee-8f7f-53c9df0f6c72" status: 404 len: 111 microversion: 2.1 time: 0.048370 Aug 10 17:52:59.321062 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 484/979] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:59 2022] GET /compute/v2.1/servers/37934416-f4a8-4fee-8f7f-53c9df0f6c72 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:52:59.326796 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-258249c6-ac20-45ac-a3c9-0e44bb48090e tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:59.327300 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-258249c6-ac20-45ac-a3c9-0e44bb48090e tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] [instance: af35a390-86bf-4618-bce0-db7423a065bb] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:59.333836 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-258249c6-ac20-45ac-a3c9-0e44bb48090e tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:59.334335 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-258249c6-ac20-45ac-a3c9-0e44bb48090e tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:59.334779 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-258249c6-ac20-45ac-a3c9-0e44bb48090e tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:59.335523 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-258249c6-ac20-45ac-a3c9-0e44bb48090e tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:59.335987 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-258249c6-ac20-45ac-a3c9-0e44bb48090e tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:59.336450 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-258249c6-ac20-45ac-a3c9-0e44bb48090e tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:59.348025 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-f8eb7d38-f9c7-4bef-bacd-90caf247fa4c tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83a3e198e21476eb12fcf417aea62de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df088e5a610436ea21b8a360e2bb527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:59.360492 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-f8eb7d38-f9c7-4bef-bacd-90caf247fa4c tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] 10.222.0.50 "GET /compute/v2.1/servers/25b28585-a586-423f-8f04-2b2f4d28f16c" status: 200 len: 1477 microversion: 2.1 time: 0.357533 Aug 10 17:52:59.363138 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 496/980] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:58 2022] GET /compute/v2.1/servers/25b28585-a586-423f-8f04-2b2f4d28f16c => generated 1477 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:52:59.377322 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-258249c6-ac20-45ac-a3c9-0e44bb48090e tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] [instance: af35a390-86bf-4618-bce0-db7423a065bb] Going to try to terminate instance {{(pid=129409) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 17:52:59.493868 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-b0509978-5e61-424e-8298-a44e203db33d tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:59.494517 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-b0509978-5e61-424e-8298-a44e203db33d tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: 873f60d0-8ef0-4ff5-800d-945ca4237a28] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:59.501563 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b0509978-5e61-424e-8298-a44e203db33d tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:59.501987 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b0509978-5e61-424e-8298-a44e203db33d tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:59.502498 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b0509978-5e61-424e-8298-a44e203db33d tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:59.504210 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b0509978-5e61-424e-8298-a44e203db33d tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:59.504860 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b0509978-5e61-424e-8298-a44e203db33d tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:59.505293 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b0509978-5e61-424e-8298-a44e203db33d tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:59.706373 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-b0509978-5e61-424e-8298-a44e203db33d tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:52:59.722669 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-b0509978-5e61-424e-8298-a44e203db33d tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/873f60d0-8ef0-4ff5-800d-945ca4237a28" status: 200 len: 1316 microversion: 2.1 time: 0.233176 Aug 10 17:52:59.727855 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 497/981] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:59 2022] GET /compute/v2.1/servers/873f60d0-8ef0-4ff5-800d-945ca4237a28 => generated 1316 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:52:59.838700 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-258249c6-ac20-45ac-a3c9-0e44bb48090e tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] 10.222.0.50 "DELETE /compute/v2.1/servers/af35a390-86bf-4618-bce0-db7423a065bb" status: 204 len: 0 microversion: 2.1 time: 0.516298 Aug 10 17:52:59.839576 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 485/982] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 10 17:52:59 2022] DELETE /compute/v2.1/servers/af35a390-86bf-4618-bce0-db7423a065bb => generated 0 bytes in 518 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 17:52:59.848205 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-9b405ce9-e5a4-4c91-a243-31c7e3ef918d tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:59.848841 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-9b405ce9-e5a4-4c91-a243-31c7e3ef918d tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] [instance: af35a390-86bf-4618-bce0-db7423a065bb] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:59.855587 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-9b405ce9-e5a4-4c91-a243-31c7e3ef918d tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:59.856089 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-9b405ce9-e5a4-4c91-a243-31c7e3ef918d tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:59.857057 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-9b405ce9-e5a4-4c91-a243-31c7e3ef918d tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:59.858858 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-9b405ce9-e5a4-4c91-a243-31c7e3ef918d tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:59.859438 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-9b405ce9-e5a4-4c91-a243-31c7e3ef918d tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:59.859735 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-9b405ce9-e5a4-4c91-a243-31c7e3ef918d tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:59.868895 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-e6fb79c3-f875-4004-a0f8-25180a24dbd5 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:52:59.869907 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-e6fb79c3-f875-4004-a0f8-25180a24dbd5 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] [instance: 2c8728f2-55fb-4306-acc5-227ba55ec278] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:52:59.877111 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e6fb79c3-f875-4004-a0f8-25180a24dbd5 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:59.878054 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e6fb79c3-f875-4004-a0f8-25180a24dbd5 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:59.879956 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e6fb79c3-f875-4004-a0f8-25180a24dbd5 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:52:59.879956 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e6fb79c3-f875-4004-a0f8-25180a24dbd5 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:52:59.879956 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e6fb79c3-f875-4004-a0f8-25180a24dbd5 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:52:59.880981 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e6fb79c3-f875-4004-a0f8-25180a24dbd5 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:00.024236 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-9b405ce9-e5a4-4c91-a243-31c7e3ef918d tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e109c3dcd0574faaa3d7ec31dd4edd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48bbb92998f54ebeb624bc794d406896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:00.032412 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-9b405ce9-e5a4-4c91-a243-31c7e3ef918d tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] 10.222.0.50 "GET /compute/v2.1/servers/af35a390-86bf-4618-bce0-db7423a065bb" status: 200 len: 1469 microversion: 2.1 time: 0.188330 Aug 10 17:53:00.033007 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 498/983] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:59 2022] GET /compute/v2.1/servers/af35a390-86bf-4618-bce0-db7423a065bb => generated 1469 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:53:00.113698 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-edaefe68-c447-4afb-8771-e9a1bc135bda tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:00.114408 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-edaefe68-c447-4afb-8771-e9a1bc135bda tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] [instance: bee3148a-3834-41bd-99e7-b5da75217256] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:00.120761 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-edaefe68-c447-4afb-8771-e9a1bc135bda tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:00.121331 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-edaefe68-c447-4afb-8771-e9a1bc135bda tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:00.121915 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-edaefe68-c447-4afb-8771-e9a1bc135bda tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:00.122620 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-edaefe68-c447-4afb-8771-e9a1bc135bda tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:00.123071 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-edaefe68-c447-4afb-8771-e9a1bc135bda tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:00.123520 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-edaefe68-c447-4afb-8771-e9a1bc135bda tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:00.270529 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-edaefe68-c447-4afb-8771-e9a1bc135bda tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2fd6acf18d4218ad143ccee2d0bb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7c2481a908406fa9c4562513fff665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:00.274738 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:53:00.279579 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-edaefe68-c447-4afb-8771-e9a1bc135bda tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] 10.222.0.50 "GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256" status: 200 len: 1471 microversion: 2.1 time: 0.169849 Aug 10 17:53:00.280378 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 499/984] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:00 2022] GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256 => generated 1471 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:53:00.285231 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-bc6e0158-ed39-4761-b39b-2ed767988c76 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:00.286515 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-bc6e0158-ed39-4761-b39b-2ed767988c76 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] [instance: e2777988-0bbf-496c-9c97-b206dbc94a62] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:00.293080 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-bc6e0158-ed39-4761-b39b-2ed767988c76 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:00.293330 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-e6fb79c3-f875-4004-a0f8-25180a24dbd5 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f082ed04bc143679029c204e8a97160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c7c8eeb1b4065b25fe28eba30d0eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:00.294625 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-bc6e0158-ed39-4761-b39b-2ed767988c76 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:00.295224 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-bc6e0158-ed39-4761-b39b-2ed767988c76 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:00.296043 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-bc6e0158-ed39-4761-b39b-2ed767988c76 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:00.296547 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-bc6e0158-ed39-4761-b39b-2ed767988c76 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:00.296952 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-bc6e0158-ed39-4761-b39b-2ed767988c76 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:00.304162 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-e6fb79c3-f875-4004-a0f8-25180a24dbd5 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] 10.222.0.50 "GET /compute/v2.1/servers/2c8728f2-55fb-4306-acc5-227ba55ec278" status: 200 len: 1276 microversion: 2.1 time: 0.439589 Aug 10 17:53:00.309648 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 486/985] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:52:59 2022] GET /compute/v2.1/servers/2c8728f2-55fb-4306-acc5-227ba55ec278 => generated 1276 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:53:00.369794 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.objects.instance [None req-bc6e0158-ed39-4761-b39b-2ed767988c76 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lazy-loading 'services' on Instance uuid e2777988-0bbf-496c-9c97-b206dbc94a62 {{(pid=129410) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:53:00.383128 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-7b6955ec-1025-4fa8-be02-c3df7759c52e tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:00.383736 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-7b6955ec-1025-4fa8-be02-c3df7759c52e tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] [instance: 25b28585-a586-423f-8f04-2b2f4d28f16c] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:00.391812 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7b6955ec-1025-4fa8-be02-c3df7759c52e tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:00.392015 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-bc6e0158-ed39-4761-b39b-2ed767988c76 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62" status: 200 len: 1925 microversion: 2.75 time: 0.110283 Aug 10 17:53:00.393109 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 500/986] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:53:00 2022] GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62 => generated 1925 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:53:00.396893 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7b6955ec-1025-4fa8-be02-c3df7759c52e tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:00.400892 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7b6955ec-1025-4fa8-be02-c3df7759c52e tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:00.401788 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7b6955ec-1025-4fa8-be02-c3df7759c52e tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:00.402264 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7b6955ec-1025-4fa8-be02-c3df7759c52e tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:00.402698 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7b6955ec-1025-4fa8-be02-c3df7759c52e tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:00.633293 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [req-9e604612-7c67-441a-8398-fece12663a83 req-cfa8fe1c-6dd8-4524-b810-1afc57f1dc11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "873f60d0-8ef0-4ff5-800d-945ca4237a28", "name": "network-vif-plugged", "status": "completed", "tag": "ceae5e90-0655-4ae7-a475-8af854b4bda6"}]} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:53:00.644151 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-9e604612-7c67-441a-8398-fece12663a83 req-cfa8fe1c-6dd8-4524-b810-1afc57f1dc11 service nova] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:00.644897 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-9e604612-7c67-441a-8398-fece12663a83 req-cfa8fe1c-6dd8-4524-b810-1afc57f1dc11 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:00.645636 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-9e604612-7c67-441a-8398-fece12663a83 req-cfa8fe1c-6dd8-4524-b810-1afc57f1dc11 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:00.656747 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.compute.server_external_events [req-9e604612-7c67-441a-8398-fece12663a83 req-cfa8fe1c-6dd8-4524-b810-1afc57f1dc11 service nova] Creating event network-vif-plugged:ceae5e90-0655-4ae7-a475-8af854b4bda6 for instance 873f60d0-8ef0-4ff5-800d-945ca4237a28 on n-h2-852296-2 Aug 10 17:53:00.661856 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [req-9e604612-7c67-441a-8398-fece12663a83 req-cfa8fe1c-6dd8-4524-b810-1afc57f1dc11 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032755 Aug 10 17:53:00.662450 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 501/987] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 10 17:53:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:53:00.748713 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-1e3e9d55-0696-4dd2-89b9-dea5a0e972a5 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:00.749529 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-1e3e9d55-0696-4dd2-89b9-dea5a0e972a5 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: 873f60d0-8ef0-4ff5-800d-945ca4237a28] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:00.755907 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-1e3e9d55-0696-4dd2-89b9-dea5a0e972a5 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:00.756422 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-1e3e9d55-0696-4dd2-89b9-dea5a0e972a5 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:00.756860 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-1e3e9d55-0696-4dd2-89b9-dea5a0e972a5 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:00.757664 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-1e3e9d55-0696-4dd2-89b9-dea5a0e972a5 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:00.758180 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-1e3e9d55-0696-4dd2-89b9-dea5a0e972a5 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:00.758610 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-1e3e9d55-0696-4dd2-89b9-dea5a0e972a5 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:00.778537 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-7b6955ec-1025-4fa8-be02-c3df7759c52e tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83a3e198e21476eb12fcf417aea62de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df088e5a610436ea21b8a360e2bb527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:00.787032 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-7b6955ec-1025-4fa8-be02-c3df7759c52e tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] 10.222.0.50 "GET /compute/v2.1/servers/25b28585-a586-423f-8f04-2b2f4d28f16c" status: 200 len: 1477 microversion: 2.1 time: 0.407777 Aug 10 17:53:00.787645 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 487/988] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:00 2022] GET /compute/v2.1/servers/25b28585-a586-423f-8f04-2b2f4d28f16c => generated 1477 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:53:00.982472 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-1e3e9d55-0696-4dd2-89b9-dea5a0e972a5 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:00.990399 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-1e3e9d55-0696-4dd2-89b9-dea5a0e972a5 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/873f60d0-8ef0-4ff5-800d-945ca4237a28" status: 200 len: 1316 microversion: 2.1 time: 0.246396 Aug 10 17:53:00.991140 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 502/989] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:00 2022] GET /compute/v2.1/servers/873f60d0-8ef0-4ff5-800d-945ca4237a28 => generated 1316 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:53:01.054715 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-59cb1faa-5f25-4a95-993a-0b140cb0b048 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:01.055309 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-59cb1faa-5f25-4a95-993a-0b140cb0b048 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] [instance: af35a390-86bf-4618-bce0-db7423a065bb] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:01.063063 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-59cb1faa-5f25-4a95-993a-0b140cb0b048 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:01.063542 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-59cb1faa-5f25-4a95-993a-0b140cb0b048 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:01.063973 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-59cb1faa-5f25-4a95-993a-0b140cb0b048 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:01.064718 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-59cb1faa-5f25-4a95-993a-0b140cb0b048 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:01.065167 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-59cb1faa-5f25-4a95-993a-0b140cb0b048 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:01.065583 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-59cb1faa-5f25-4a95-993a-0b140cb0b048 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:01.301034 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-74b6b0fa-179c-462c-b4a2-051952e519f7 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:01.302070 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-74b6b0fa-179c-462c-b4a2-051952e519f7 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] [instance: bee3148a-3834-41bd-99e7-b5da75217256] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:01.310275 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-74b6b0fa-179c-462c-b4a2-051952e519f7 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:01.311297 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-74b6b0fa-179c-462c-b4a2-051952e519f7 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:01.311954 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-74b6b0fa-179c-462c-b4a2-051952e519f7 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:01.312999 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-74b6b0fa-179c-462c-b4a2-051952e519f7 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:01.313781 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-74b6b0fa-179c-462c-b4a2-051952e519f7 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:01.314279 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-74b6b0fa-179c-462c-b4a2-051952e519f7 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:01.406254 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-59cb1faa-5f25-4a95-993a-0b140cb0b048 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e109c3dcd0574faaa3d7ec31dd4edd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48bbb92998f54ebeb624bc794d406896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:01.422085 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-59cb1faa-5f25-4a95-993a-0b140cb0b048 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] 10.222.0.50 "GET /compute/v2.1/servers/af35a390-86bf-4618-bce0-db7423a065bb" status: 200 len: 1469 microversion: 2.1 time: 0.371545 Aug 10 17:53:01.423407 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 488/990] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:01 2022] GET /compute/v2.1/servers/af35a390-86bf-4618-bce0-db7423a065bb => generated 1469 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:53:01.428276 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-19a08bfc-3360-460d-b62d-f08352cc4e5c tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:01.431734 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-19a08bfc-3360-460d-b62d-f08352cc4e5c tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] [instance: 2c8728f2-55fb-4306-acc5-227ba55ec278] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:01.435757 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-19a08bfc-3360-460d-b62d-f08352cc4e5c tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:01.436538 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-19a08bfc-3360-460d-b62d-f08352cc4e5c tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:01.437185 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-19a08bfc-3360-460d-b62d-f08352cc4e5c tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:01.442365 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-19a08bfc-3360-460d-b62d-f08352cc4e5c tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:01.443964 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-19a08bfc-3360-460d-b62d-f08352cc4e5c tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:01.445253 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-19a08bfc-3360-460d-b62d-f08352cc4e5c tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:01.584331 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-74b6b0fa-179c-462c-b4a2-051952e519f7 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2fd6acf18d4218ad143ccee2d0bb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7c2481a908406fa9c4562513fff665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:01.596988 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-74b6b0fa-179c-462c-b4a2-051952e519f7 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] 10.222.0.50 "GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256" status: 200 len: 1471 microversion: 2.1 time: 0.299731 Aug 10 17:53:01.610235 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 503/991] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:01 2022] GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256 => generated 1471 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:53:01.610235 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-55725ad9-70c0-4eb2-b4ca-39f7c3600e7e tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:01.610235 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-55725ad9-70c0-4eb2-b4ca-39f7c3600e7e tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] [instance: e2777988-0bbf-496c-9c97-b206dbc94a62] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:01.610235 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-55725ad9-70c0-4eb2-b4ca-39f7c3600e7e tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:01.610235 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-55725ad9-70c0-4eb2-b4ca-39f7c3600e7e tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:01.618323 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-55725ad9-70c0-4eb2-b4ca-39f7c3600e7e tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:01.618323 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-55725ad9-70c0-4eb2-b4ca-39f7c3600e7e tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:01.618323 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-55725ad9-70c0-4eb2-b4ca-39f7c3600e7e tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:01.618638 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-55725ad9-70c0-4eb2-b4ca-39f7c3600e7e tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:01.715838 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.objects.instance [None req-55725ad9-70c0-4eb2-b4ca-39f7c3600e7e tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lazy-loading 'services' on Instance uuid e2777988-0bbf-496c-9c97-b206dbc94a62 {{(pid=129410) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:53:01.746116 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-55725ad9-70c0-4eb2-b4ca-39f7c3600e7e tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62" status: 200 len: 1925 microversion: 2.75 time: 0.147235 Aug 10 17:53:01.747239 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 504/992] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:53:01 2022] GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62 => generated 1925 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:53:01.787712 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-19a08bfc-3360-460d-b62d-f08352cc4e5c tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f082ed04bc143679029c204e8a97160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c7c8eeb1b4065b25fe28eba30d0eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:01.797409 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-19a08bfc-3360-460d-b62d-f08352cc4e5c tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] 10.222.0.50 "GET /compute/v2.1/servers/2c8728f2-55fb-4306-acc5-227ba55ec278" status: 200 len: 1318 microversion: 2.1 time: 0.372654 Aug 10 17:53:01.809799 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 489/993] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:01 2022] GET /compute/v2.1/servers/2c8728f2-55fb-4306-acc5-227ba55ec278 => generated 1318 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:53:01.811898 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-a991b360-acf2-46e2-8fee-28ac36184438 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:01.812951 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-a991b360-acf2-46e2-8fee-28ac36184438 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] [instance: 25b28585-a586-423f-8f04-2b2f4d28f16c] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:01.819180 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a991b360-acf2-46e2-8fee-28ac36184438 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:01.819662 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a991b360-acf2-46e2-8fee-28ac36184438 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:01.820118 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a991b360-acf2-46e2-8fee-28ac36184438 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:01.820877 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a991b360-acf2-46e2-8fee-28ac36184438 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:01.821321 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a991b360-acf2-46e2-8fee-28ac36184438 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:01.822012 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a991b360-acf2-46e2-8fee-28ac36184438 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:02.015198 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-5921ccf1-08fd-454d-9afb-13db4d95cf1b tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:02.016199 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-5921ccf1-08fd-454d-9afb-13db4d95cf1b tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: 873f60d0-8ef0-4ff5-800d-945ca4237a28] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:02.025824 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-5921ccf1-08fd-454d-9afb-13db4d95cf1b tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:02.026571 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-5921ccf1-08fd-454d-9afb-13db4d95cf1b tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:02.027202 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-5921ccf1-08fd-454d-9afb-13db4d95cf1b tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:02.028165 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-5921ccf1-08fd-454d-9afb-13db4d95cf1b tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:02.028829 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-5921ccf1-08fd-454d-9afb-13db4d95cf1b tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:02.029488 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-5921ccf1-08fd-454d-9afb-13db4d95cf1b tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:02.052004 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-a991b360-acf2-46e2-8fee-28ac36184438 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83a3e198e21476eb12fcf417aea62de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df088e5a610436ea21b8a360e2bb527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:02.062203 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-a991b360-acf2-46e2-8fee-28ac36184438 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] 10.222.0.50 "GET /compute/v2.1/servers/25b28585-a586-423f-8f04-2b2f4d28f16c" status: 200 len: 1477 microversion: 2.1 time: 0.257622 Aug 10 17:53:02.063089 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 505/994] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:01 2022] GET /compute/v2.1/servers/25b28585-a586-423f-8f04-2b2f4d28f16c => generated 1477 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:53:02.288615 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [req-d9f60683-3c4b-4831-a806-4bb458610d84 req-4667dcdf-32ee-43d5-a79c-db1f27171fd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25b28585-a586-423f-8f04-2b2f4d28f16c", "name": "network-vif-deleted", "tag": "9b21b54b-64c6-42f3-892e-f4d109dd851a"}]} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:53:02.302931 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-d9f60683-3c4b-4831-a806-4bb458610d84 req-4667dcdf-32ee-43d5-a79c-db1f27171fd5 service nova] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:02.308336 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-d9f60683-3c4b-4831-a806-4bb458610d84 req-4667dcdf-32ee-43d5-a79c-db1f27171fd5 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:02.308336 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-d9f60683-3c4b-4831-a806-4bb458610d84 req-4667dcdf-32ee-43d5-a79c-db1f27171fd5 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:02.318987 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.compute.server_external_events [req-d9f60683-3c4b-4831-a806-4bb458610d84 req-4667dcdf-32ee-43d5-a79c-db1f27171fd5 service nova] Creating event network-vif-deleted:9b21b54b-64c6-42f3-892e-f4d109dd851a for instance 25b28585-a586-423f-8f04-2b2f4d28f16c on n-h1-852296-2 Aug 10 17:53:02.324659 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [req-d9f60683-3c4b-4831-a806-4bb458610d84 req-4667dcdf-32ee-43d5-a79c-db1f27171fd5 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043897 Aug 10 17:53:02.325703 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 506/995] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 10 17:53:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:53:02.444920 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-02b11dea-3e38-4b28-b51a-ecfe97d8b095 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:02.446086 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-02b11dea-3e38-4b28-b51a-ecfe97d8b095 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] [instance: af35a390-86bf-4618-bce0-db7423a065bb] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:02.454395 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-02b11dea-3e38-4b28-b51a-ecfe97d8b095 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:02.454914 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-02b11dea-3e38-4b28-b51a-ecfe97d8b095 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:02.455564 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-02b11dea-3e38-4b28-b51a-ecfe97d8b095 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:02.456627 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-02b11dea-3e38-4b28-b51a-ecfe97d8b095 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:02.457535 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-02b11dea-3e38-4b28-b51a-ecfe97d8b095 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:02.457961 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-02b11dea-3e38-4b28-b51a-ecfe97d8b095 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:02.525882 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-5921ccf1-08fd-454d-9afb-13db4d95cf1b tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:02.540598 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-5921ccf1-08fd-454d-9afb-13db4d95cf1b tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/873f60d0-8ef0-4ff5-800d-945ca4237a28" status: 200 len: 1316 microversion: 2.1 time: 0.532606 Aug 10 17:53:02.541989 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 490/996] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:02 2022] GET /compute/v2.1/servers/873f60d0-8ef0-4ff5-800d-945ca4237a28 => generated 1316 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:53:02.618317 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-70aa56f4-6a04-423f-a519-ee7e659d7085 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:02.619224 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-70aa56f4-6a04-423f-a519-ee7e659d7085 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] [instance: bee3148a-3834-41bd-99e7-b5da75217256] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:02.634944 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-02b11dea-3e38-4b28-b51a-ecfe97d8b095 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e109c3dcd0574faaa3d7ec31dd4edd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48bbb92998f54ebeb624bc794d406896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:02.635919 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-70aa56f4-6a04-423f-a519-ee7e659d7085 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:02.636524 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-70aa56f4-6a04-423f-a519-ee7e659d7085 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:02.637035 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-70aa56f4-6a04-423f-a519-ee7e659d7085 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:02.638569 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-70aa56f4-6a04-423f-a519-ee7e659d7085 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:02.639105 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-70aa56f4-6a04-423f-a519-ee7e659d7085 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:02.639596 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-70aa56f4-6a04-423f-a519-ee7e659d7085 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:02.647443 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-02b11dea-3e38-4b28-b51a-ecfe97d8b095 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] 10.222.0.50 "GET /compute/v2.1/servers/af35a390-86bf-4618-bce0-db7423a065bb" status: 200 len: 1469 microversion: 2.1 time: 0.207974 Aug 10 17:53:02.648765 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 507/997] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:02 2022] GET /compute/v2.1/servers/af35a390-86bf-4618-bce0-db7423a065bb => generated 1469 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:53:02.660154 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:53:02.773099 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-e31b06c8-2198-4b98-82a5-be68a812fca2 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:02.774698 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-e31b06c8-2198-4b98-82a5-be68a812fca2 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] [instance: e2777988-0bbf-496c-9c97-b206dbc94a62] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:02.784062 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e31b06c8-2198-4b98-82a5-be68a812fca2 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:02.784682 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e31b06c8-2198-4b98-82a5-be68a812fca2 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:02.785383 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e31b06c8-2198-4b98-82a5-be68a812fca2 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:02.786119 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e31b06c8-2198-4b98-82a5-be68a812fca2 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:02.786578 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e31b06c8-2198-4b98-82a5-be68a812fca2 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:02.787050 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e31b06c8-2198-4b98-82a5-be68a812fca2 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:02.866115 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.objects.instance [None req-e31b06c8-2198-4b98-82a5-be68a812fca2 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lazy-loading 'services' on Instance uuid e2777988-0bbf-496c-9c97-b206dbc94a62 {{(pid=129410) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:53:02.884442 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-e31b06c8-2198-4b98-82a5-be68a812fca2 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62" status: 200 len: 1925 microversion: 2.75 time: 0.115960 Aug 10 17:53:02.885040 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 508/998] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:53:02 2022] GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62 => generated 1925 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 17:53:02.900728 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-b2073758-f2f8-4dfe-9871-7c45c9c57541 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:02.900728 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-b2073758-f2f8-4dfe-9871-7c45c9c57541 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] [instance: 2c8728f2-55fb-4306-acc5-227ba55ec278] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:02.900728 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b2073758-f2f8-4dfe-9871-7c45c9c57541 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:02.900728 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b2073758-f2f8-4dfe-9871-7c45c9c57541 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:02.900728 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b2073758-f2f8-4dfe-9871-7c45c9c57541 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:02.901274 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b2073758-f2f8-4dfe-9871-7c45c9c57541 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:02.901603 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b2073758-f2f8-4dfe-9871-7c45c9c57541 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:02.902218 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b2073758-f2f8-4dfe-9871-7c45c9c57541 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:03.068052 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-b2073758-f2f8-4dfe-9871-7c45c9c57541 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f082ed04bc143679029c204e8a97160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c7c8eeb1b4065b25fe28eba30d0eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:03.076544 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-b2073758-f2f8-4dfe-9871-7c45c9c57541 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] 10.222.0.50 "GET /compute/v2.1/servers/2c8728f2-55fb-4306-acc5-227ba55ec278" status: 200 len: 1318 microversion: 2.1 time: 0.190350 Aug 10 17:53:03.077135 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 509/999] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:02 2022] GET /compute/v2.1/servers/2c8728f2-55fb-4306-acc5-227ba55ec278 => generated 1318 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:53:03.089833 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-2abfbe40-26a5-4149-a8ba-f23b1d285554 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:03.090767 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-2abfbe40-26a5-4149-a8ba-f23b1d285554 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] [instance: 25b28585-a586-423f-8f04-2b2f4d28f16c] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:03.097609 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2abfbe40-26a5-4149-a8ba-f23b1d285554 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:03.098110 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2abfbe40-26a5-4149-a8ba-f23b1d285554 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:03.098552 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2abfbe40-26a5-4149-a8ba-f23b1d285554 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:03.099261 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2abfbe40-26a5-4149-a8ba-f23b1d285554 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:03.099720 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2abfbe40-26a5-4149-a8ba-f23b1d285554 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:03.100196 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2abfbe40-26a5-4149-a8ba-f23b1d285554 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:03.136504 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2abfbe40-26a5-4149-a8ba-f23b1d285554 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:03.137056 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2abfbe40-26a5-4149-a8ba-f23b1d285554 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:03.138045 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2abfbe40-26a5-4149-a8ba-f23b1d285554 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:03.138706 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.objects.instance [None req-2abfbe40-26a5-4149-a8ba-f23b1d285554 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lazy-loading 'fault' on Instance uuid 25b28585-a586-423f-8f04-2b2f4d28f16c {{(pid=129410) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:53:03.181708 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-2abfbe40-26a5-4149-a8ba-f23b1d285554 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83a3e198e21476eb12fcf417aea62de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df088e5a610436ea21b8a360e2bb527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:03.189363 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-2abfbe40-26a5-4149-a8ba-f23b1d285554 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] 10.222.0.50 "GET /compute/v2.1/servers/25b28585-a586-423f-8f04-2b2f4d28f16c" status: 200 len: 1311 microversion: 2.1 time: 0.103297 Aug 10 17:53:03.189608 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 510/1000] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:03 2022] GET /compute/v2.1/servers/25b28585-a586-423f-8f04-2b2f4d28f16c => generated 1311 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:53:03.271049 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-70aa56f4-6a04-423f-a519-ee7e659d7085 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2fd6acf18d4218ad143ccee2d0bb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7c2481a908406fa9c4562513fff665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:03.279233 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-70aa56f4-6a04-423f-a519-ee7e659d7085 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] 10.222.0.50 "GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256" status: 200 len: 1471 microversion: 2.1 time: 0.664996 Aug 10 17:53:03.279849 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 491/1001] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:02 2022] GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256 => generated 1471 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:53:03.476510 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [req-13477726-6d38-4be4-a97c-4e782f80e95c req-894c29f9-6e8f-47d5-80bc-7a96dd37e104 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af35a390-86bf-4618-bce0-db7423a065bb", "name": "network-vif-deleted", "tag": "fd08385d-d8e2-4f4b-ac59-f79dbc7a4c5d"}]} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:53:03.509445 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-13477726-6d38-4be4-a97c-4e782f80e95c req-894c29f9-6e8f-47d5-80bc-7a96dd37e104 service nova] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:03.509920 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-13477726-6d38-4be4-a97c-4e782f80e95c req-894c29f9-6e8f-47d5-80bc-7a96dd37e104 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:03.510351 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-13477726-6d38-4be4-a97c-4e782f80e95c req-894c29f9-6e8f-47d5-80bc-7a96dd37e104 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:03.532069 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.compute.server_external_events [req-13477726-6d38-4be4-a97c-4e782f80e95c req-894c29f9-6e8f-47d5-80bc-7a96dd37e104 service nova] Creating event network-vif-deleted:fd08385d-d8e2-4f4b-ac59-f79dbc7a4c5d for instance af35a390-86bf-4618-bce0-db7423a065bb on n-h2-852296-2 Aug 10 17:53:03.538141 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [req-13477726-6d38-4be4-a97c-4e782f80e95c req-894c29f9-6e8f-47d5-80bc-7a96dd37e104 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067344 Aug 10 17:53:03.539558 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 511/1002] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 10 17:53:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:53:03.563704 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-ef3354d8-03a6-473e-b248-841833431575 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:03.564841 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-ef3354d8-03a6-473e-b248-841833431575 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: 873f60d0-8ef0-4ff5-800d-945ca4237a28] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:03.581460 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-ef3354d8-03a6-473e-b248-841833431575 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:03.581962 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-ef3354d8-03a6-473e-b248-841833431575 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:03.582399 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-ef3354d8-03a6-473e-b248-841833431575 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:03.583301 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-ef3354d8-03a6-473e-b248-841833431575 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:03.583754 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-ef3354d8-03a6-473e-b248-841833431575 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:03.585019 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-ef3354d8-03a6-473e-b248-841833431575 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:03.679334 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-c43bc6af-1ce6-4cc4-976d-f7736c4548a7 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:03.705579 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-c43bc6af-1ce6-4cc4-976d-f7736c4548a7 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] [instance: af35a390-86bf-4618-bce0-db7423a065bb] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:03.723803 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-c43bc6af-1ce6-4cc4-976d-f7736c4548a7 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:03.723803 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-c43bc6af-1ce6-4cc4-976d-f7736c4548a7 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:03.723803 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-c43bc6af-1ce6-4cc4-976d-f7736c4548a7 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:03.723803 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-c43bc6af-1ce6-4cc4-976d-f7736c4548a7 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:03.723803 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-c43bc6af-1ce6-4cc4-976d-f7736c4548a7 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:03.723803 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-c43bc6af-1ce6-4cc4-976d-f7736c4548a7 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:03.752087 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_cell0:SELECT=4 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:53:03.853822 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-c43bc6af-1ce6-4cc4-976d-f7736c4548a7 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e109c3dcd0574faaa3d7ec31dd4edd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48bbb92998f54ebeb624bc794d406896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:03.864700 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-c43bc6af-1ce6-4cc4-976d-f7736c4548a7 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] 10.222.0.50 "GET /compute/v2.1/servers/af35a390-86bf-4618-bce0-db7423a065bb" status: 200 len: 1298 microversion: 2.1 time: 0.196201 Aug 10 17:53:03.865811 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 512/1003] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:03 2022] GET /compute/v2.1/servers/af35a390-86bf-4618-bce0-db7423a065bb => generated 1298 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:53:03.897502 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-ef3354d8-03a6-473e-b248-841833431575 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:03.910960 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-ef3354d8-03a6-473e-b248-841833431575 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/873f60d0-8ef0-4ff5-800d-945ca4237a28" status: 200 len: 1316 microversion: 2.1 time: 0.351339 Aug 10 17:53:03.916160 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-fbe0a58d-b647-47c3-9bfc-62db02f40cec tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:03.917004 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-fbe0a58d-b647-47c3-9bfc-62db02f40cec tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] [instance: e2777988-0bbf-496c-9c97-b206dbc94a62] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:03.925418 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 492/1004] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:03 2022] GET /compute/v2.1/servers/873f60d0-8ef0-4ff5-800d-945ca4237a28 => generated 1316 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:53:03.932136 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-fbe0a58d-b647-47c3-9bfc-62db02f40cec tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:03.932668 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-fbe0a58d-b647-47c3-9bfc-62db02f40cec tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:03.937321 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-fbe0a58d-b647-47c3-9bfc-62db02f40cec tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:03.937321 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-fbe0a58d-b647-47c3-9bfc-62db02f40cec tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:03.937321 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-fbe0a58d-b647-47c3-9bfc-62db02f40cec tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:03.937321 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-fbe0a58d-b647-47c3-9bfc-62db02f40cec tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:04.101925 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-4a7abb1c-49db-44a3-8707-48e25f06ac61 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:04.102998 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-4a7abb1c-49db-44a3-8707-48e25f06ac61 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] [instance: 2c8728f2-55fb-4306-acc5-227ba55ec278] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:04.111137 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.objects.instance [None req-fbe0a58d-b647-47c3-9bfc-62db02f40cec tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lazy-loading 'services' on Instance uuid e2777988-0bbf-496c-9c97-b206dbc94a62 {{(pid=129410) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:53:04.117805 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-4a7abb1c-49db-44a3-8707-48e25f06ac61 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:04.119257 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-4a7abb1c-49db-44a3-8707-48e25f06ac61 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:04.120583 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-4a7abb1c-49db-44a3-8707-48e25f06ac61 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:04.121760 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-4a7abb1c-49db-44a3-8707-48e25f06ac61 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:04.122484 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-4a7abb1c-49db-44a3-8707-48e25f06ac61 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:04.123694 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-4a7abb1c-49db-44a3-8707-48e25f06ac61 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:04.152316 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-fbe0a58d-b647-47c3-9bfc-62db02f40cec tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62" status: 200 len: 1925 microversion: 2.75 time: 0.240191 Aug 10 17:53:04.154189 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 513/1005] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:53:03 2022] GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62 => generated 1925 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 17:53:04.210827 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-5edfbfed-a335-4526-9a29-57f18da1b7e4 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:04.211472 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-5edfbfed-a335-4526-9a29-57f18da1b7e4 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] [instance: 25b28585-a586-423f-8f04-2b2f4d28f16c] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:04.220351 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-5edfbfed-a335-4526-9a29-57f18da1b7e4 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:04.230360 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-5edfbfed-a335-4526-9a29-57f18da1b7e4 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:04.238336 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-5edfbfed-a335-4526-9a29-57f18da1b7e4 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:04.240733 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-5edfbfed-a335-4526-9a29-57f18da1b7e4 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:04.242352 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-5edfbfed-a335-4526-9a29-57f18da1b7e4 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:04.245671 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-5edfbfed-a335-4526-9a29-57f18da1b7e4 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:04.272350 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-5edfbfed-a335-4526-9a29-57f18da1b7e4 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] HTTP exception thrown: Instance 25b28585-a586-423f-8f04-2b2f4d28f16c could not be found. Aug 10 17:53:04.274006 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-5edfbfed-a335-4526-9a29-57f18da1b7e4 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Request method failure captured: Aug 10 17:53:04.274006 n-d-852296-2 devstack@n-api.service[129410]: request: GET /compute/v2.1/servers/25b28585-a586-423f-8f04-2b2f4d28f16c HTTP/1.1 Aug 10 17:53:04.274006 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 17:53:04.274006 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 17:53:04.274006 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 17:53:04.274006 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 0 Aug 10 17:53:04.274006 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 17:53:04.274006 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 17:53:04.274006 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 17:53:04.274006 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 17:53:04.274006 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8_Ax5FoTzfQ9mXfAgBDm0Eq_KUKl79ObzeWWghowFTicYlEw2PN4VFAH5oo2rZYIAzobuZ642g072vGbg9xWKdJYfvA39uBz-K_2MauHArZmoeWgH06ksMYTO5qtjmfnPIsT3z9bK61c1f2ecM3zukbnVnlwF0ZmhjuJ5FbSISCyCeY Aug 10 17:53:04.274006 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 17:53:04.274006 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 17:53:04.274006 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 17:53:04.274006 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 17:53:04.274006 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 17:53:04.274006 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 17:53:04.274006 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: 9df088e5a610436ea21b8a360e2bb527 Aug 10 17:53:04.274006 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2097420203 Aug 10 17:53:04.274006 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 17:53:04.274006 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 17:53:04.274006 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9df088e5a610436ea21b8a360e2bb527"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9df088e5a610436ea21b8a360e2bb527"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9df088e5a610436ea21b8a360e2bb527"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9df088e5a610436ea21b8a360e2bb527", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:53:04.274006 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2097420203 Aug 10 17:53:04.274006 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: 9df088e5a610436ea21b8a360e2bb527 Aug 10 17:53:04.274006 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2097420203 Aug 10 17:53:04.274006 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-ServersAdminNegativeTestJSON-2097420203-project Aug 10 17:53:04.274006 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 17:53:04.274006 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 17:53:04.274006 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: e83a3e198e21476eb12fcf417aea62de Aug 10 17:53:04.274006 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2097420203-project Aug 10 17:53:04.274006 n-d-852296-2 devstack@n-api.service[129410]: method: > Aug 10 17:53:04.274006 n-d-852296-2 devstack@n-api.service[129410]: exception: Instance 25b28585-a586-423f-8f04-2b2f4d28f16c could not be found. Aug 10 17:53:04.274006 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'id': '25b28585-a586-423f-8f04-2b2f4d28f16c'} Aug 10 17:53:04.274006 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:53:04.274006 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:53:04.274006 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 17:53:04.274006 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 17:53:04.274006 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 17:53:04.274006 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 17:53:04.274006 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 17:53:04.274006 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 17:53:04.274006 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 17:53:04.274006 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 17:53:04.274006 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25b28585-a586-423f-8f04-2b2f4d28f16c could not be found. Aug 10 17:53:04.274006 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:53:04.274006 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:53:04.274006 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:53:04.274006 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:53:04.274006 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:53:04.274006 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:53:04.274006 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:53:04.274006 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:53:04.274006 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:53:04.274006 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:53:04.274006 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 17:53:04.274006 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 17:53:04.274006 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 17:53:04.274006 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 17:53:04.274006 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 17:53:04.274006 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:53:04.274006 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25b28585-a586-423f-8f04-2b2f4d28f16c could not be found. Aug 10 17:53:04.274006 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:53:04.274006 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:53:04.278941 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:53:04.278941 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:53:04.278941 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:53:04.278941 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:53:04.278941 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:53:04.278941 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:53:04.278941 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25b28585-a586-423f-8f04-2b2f4d28f16c could not be found. Aug 10 17:53:04.278941 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:53:04.278941 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-5edfbfed-a335-4526-9a29-57f18da1b7e4 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] Returning 404 to user: Instance 25b28585-a586-423f-8f04-2b2f4d28f16c could not be found. {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:53:04.278941 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-5edfbfed-a335-4526-9a29-57f18da1b7e4 tempest-ServersAdminNegativeTestJSON-2097420203 tempest-ServersAdminNegativeTestJSON-2097420203-project] 10.222.0.50 "GET /compute/v2.1/servers/25b28585-a586-423f-8f04-2b2f4d28f16c" status: 404 len: 111 microversion: 2.1 time: 0.068445 Aug 10 17:53:04.281961 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 514/1006] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:04 2022] GET /compute/v2.1/servers/25b28585-a586-423f-8f04-2b2f4d28f16c => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 17:53:04.304913 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-00538c40-9d99-44fd-914a-99560191c2a8 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:04.305559 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-00538c40-9d99-44fd-914a-99560191c2a8 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] [instance: bee3148a-3834-41bd-99e7-b5da75217256] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:04.341324 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-00538c40-9d99-44fd-914a-99560191c2a8 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:04.347022 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-00538c40-9d99-44fd-914a-99560191c2a8 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:04.347022 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-00538c40-9d99-44fd-914a-99560191c2a8 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:04.347022 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-00538c40-9d99-44fd-914a-99560191c2a8 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:04.347022 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-00538c40-9d99-44fd-914a-99560191c2a8 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:04.347022 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-00538c40-9d99-44fd-914a-99560191c2a8 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:04.443387 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-4a7abb1c-49db-44a3-8707-48e25f06ac61 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f082ed04bc143679029c204e8a97160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c7c8eeb1b4065b25fe28eba30d0eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:04.467034 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-4a7abb1c-49db-44a3-8707-48e25f06ac61 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] 10.222.0.50 "GET /compute/v2.1/servers/2c8728f2-55fb-4306-acc5-227ba55ec278" status: 200 len: 1318 microversion: 2.1 time: 0.372172 Aug 10 17:53:04.469416 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 493/1007] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:04 2022] GET /compute/v2.1/servers/2c8728f2-55fb-4306-acc5-227ba55ec278 => generated 1318 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:53:04.646756 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-00538c40-9d99-44fd-914a-99560191c2a8 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2fd6acf18d4218ad143ccee2d0bb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7c2481a908406fa9c4562513fff665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:04.656586 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-00538c40-9d99-44fd-914a-99560191c2a8 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] 10.222.0.50 "GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256" status: 200 len: 1471 microversion: 2.1 time: 0.359842 Aug 10 17:53:04.672261 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 515/1008] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:04 2022] GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256 => generated 1471 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:53:04.891725 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-cfca8409-2c1e-475a-aad0-c076a64e2afe tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:04.893847 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-cfca8409-2c1e-475a-aad0-c076a64e2afe tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] [instance: af35a390-86bf-4618-bce0-db7423a065bb] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:04.901753 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-cfca8409-2c1e-475a-aad0-c076a64e2afe tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:04.902581 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-cfca8409-2c1e-475a-aad0-c076a64e2afe tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:04.903544 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-cfca8409-2c1e-475a-aad0-c076a64e2afe tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:04.904918 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-cfca8409-2c1e-475a-aad0-c076a64e2afe tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:04.905546 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-cfca8409-2c1e-475a-aad0-c076a64e2afe tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:04.906217 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-cfca8409-2c1e-475a-aad0-c076a64e2afe tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:04.933666 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-5442471d-8ca1-4e6a-9f60-8e618d469c06 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:04.935470 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-5442471d-8ca1-4e6a-9f60-8e618d469c06 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: 873f60d0-8ef0-4ff5-800d-945ca4237a28] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:04.946369 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:53:04.961981 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-5442471d-8ca1-4e6a-9f60-8e618d469c06 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:04.962489 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-5442471d-8ca1-4e6a-9f60-8e618d469c06 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:04.962935 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-5442471d-8ca1-4e6a-9f60-8e618d469c06 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:04.963678 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-5442471d-8ca1-4e6a-9f60-8e618d469c06 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:04.964140 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-5442471d-8ca1-4e6a-9f60-8e618d469c06 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:04.964592 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-5442471d-8ca1-4e6a-9f60-8e618d469c06 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:05.025326 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-cfca8409-2c1e-475a-aad0-c076a64e2afe tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:05.025326 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-cfca8409-2c1e-475a-aad0-c076a64e2afe tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:05.025326 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-cfca8409-2c1e-475a-aad0-c076a64e2afe tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:05.025326 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.objects.instance [None req-cfca8409-2c1e-475a-aad0-c076a64e2afe tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lazy-loading 'fault' on Instance uuid af35a390-86bf-4618-bce0-db7423a065bb {{(pid=129409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:53:05.078616 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-cfca8409-2c1e-475a-aad0-c076a64e2afe tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e109c3dcd0574faaa3d7ec31dd4edd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48bbb92998f54ebeb624bc794d406896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:05.092764 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-cfca8409-2c1e-475a-aad0-c076a64e2afe tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] 10.222.0.50 "GET /compute/v2.1/servers/af35a390-86bf-4618-bce0-db7423a065bb" status: 200 len: 1303 microversion: 2.1 time: 0.208041 Aug 10 17:53:05.093863 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 494/1009] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:04 2022] GET /compute/v2.1/servers/af35a390-86bf-4618-bce0-db7423a065bb => generated 1303 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:53:05.186895 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-471c5aae-7f4c-41c6-bd3c-49746b69c4db tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:05.189075 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-471c5aae-7f4c-41c6-bd3c-49746b69c4db tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] [instance: e2777988-0bbf-496c-9c97-b206dbc94a62] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:05.205122 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-471c5aae-7f4c-41c6-bd3c-49746b69c4db tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:05.208962 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-471c5aae-7f4c-41c6-bd3c-49746b69c4db tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:05.212069 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-471c5aae-7f4c-41c6-bd3c-49746b69c4db tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:05.217828 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-471c5aae-7f4c-41c6-bd3c-49746b69c4db tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:05.218951 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-471c5aae-7f4c-41c6-bd3c-49746b69c4db tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:05.220844 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-471c5aae-7f4c-41c6-bd3c-49746b69c4db tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:05.290509 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_cell0:SELECT=18 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:53:05.307096 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-5442471d-8ca1-4e6a-9f60-8e618d469c06 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:05.326555 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-5442471d-8ca1-4e6a-9f60-8e618d469c06 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/873f60d0-8ef0-4ff5-800d-945ca4237a28" status: 200 len: 1465 microversion: 2.1 time: 0.387051 Aug 10 17:53:05.326841 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 516/1010] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:04 2022] GET /compute/v2.1/servers/873f60d0-8ef0-4ff5-800d-945ca4237a28 => generated 1465 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:53:05.350913 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-af328618-767a-481e-af2a-fdb3172bd3e9 tempest-ServersOnMultiNodesTest-116104069 tempest-ServersOnMultiNodesTest-116104069-project-admin] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:05.355193 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-af328618-767a-481e-af2a-fdb3172bd3e9 tempest-ServersOnMultiNodesTest-116104069 tempest-ServersOnMultiNodesTest-116104069-project-admin] [instance: 873f60d0-8ef0-4ff5-800d-945ca4237a28] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:05.368601 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-af328618-767a-481e-af2a-fdb3172bd3e9 tempest-ServersOnMultiNodesTest-116104069 tempest-ServersOnMultiNodesTest-116104069-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:05.369353 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-af328618-767a-481e-af2a-fdb3172bd3e9 tempest-ServersOnMultiNodesTest-116104069 tempest-ServersOnMultiNodesTest-116104069-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:05.369947 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-af328618-767a-481e-af2a-fdb3172bd3e9 tempest-ServersOnMultiNodesTest-116104069 tempest-ServersOnMultiNodesTest-116104069-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:05.370853 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-af328618-767a-481e-af2a-fdb3172bd3e9 tempest-ServersOnMultiNodesTest-116104069 tempest-ServersOnMultiNodesTest-116104069-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:05.372072 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-af328618-767a-481e-af2a-fdb3172bd3e9 tempest-ServersOnMultiNodesTest-116104069 tempest-ServersOnMultiNodesTest-116104069-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:05.373066 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-af328618-767a-481e-af2a-fdb3172bd3e9 tempest-ServersOnMultiNodesTest-116104069 tempest-ServersOnMultiNodesTest-116104069-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:05.442125 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.objects.instance [None req-471c5aae-7f4c-41c6-bd3c-49746b69c4db tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lazy-loading 'services' on Instance uuid e2777988-0bbf-496c-9c97-b206dbc94a62 {{(pid=129409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:53:05.515263 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-471c5aae-7f4c-41c6-bd3c-49746b69c4db tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62" status: 200 len: 1925 microversion: 2.75 time: 0.298202 Aug 10 17:53:05.515263 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 495/1011] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:53:05 2022] GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62 => generated 1925 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:53:05.515263 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-2772e83c-3a63-4cd8-a697-4ebb94799503 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:05.515263 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-2772e83c-3a63-4cd8-a697-4ebb94799503 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] [instance: 2c8728f2-55fb-4306-acc5-227ba55ec278] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:05.520212 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-2772e83c-3a63-4cd8-a697-4ebb94799503 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:05.521979 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-2772e83c-3a63-4cd8-a697-4ebb94799503 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:05.522474 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-2772e83c-3a63-4cd8-a697-4ebb94799503 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:05.526383 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-2772e83c-3a63-4cd8-a697-4ebb94799503 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:05.526861 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-2772e83c-3a63-4cd8-a697-4ebb94799503 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:05.527293 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-2772e83c-3a63-4cd8-a697-4ebb94799503 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:05.604984 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-af328618-767a-481e-af2a-fdb3172bd3e9 tempest-ServersOnMultiNodesTest-116104069 tempest-ServersOnMultiNodesTest-116104069-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/873f60d0-8ef0-4ff5-800d-945ca4237a28" status: 200 len: 1616 microversion: 2.1 time: 0.261109 Aug 10 17:53:05.606578 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 517/1012] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:05 2022] GET /compute/v2.1/servers/873f60d0-8ef0-4ff5-800d-945ca4237a28 => generated 1616 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:53:05.612314 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [req-20a783b5-cc8e-4327-9a3f-1fcd80ecdcd6 req-d6df040b-8342-4afe-b102-a8927cf87a77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c8728f2-55fb-4306-acc5-227ba55ec278", "tag": "e250e1f9-19b1-4cb6-be9d-02413ac740e5"}]} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:53:05.633039 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:53:05.642316 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-20a783b5-cc8e-4327-9a3f-1fcd80ecdcd6 req-d6df040b-8342-4afe-b102-a8927cf87a77 service nova] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:05.644416 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-20a783b5-cc8e-4327-9a3f-1fcd80ecdcd6 req-d6df040b-8342-4afe-b102-a8927cf87a77 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:05.646678 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-20a783b5-cc8e-4327-9a3f-1fcd80ecdcd6 req-d6df040b-8342-4afe-b102-a8927cf87a77 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:05.675722 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.compute.server_external_events [req-20a783b5-cc8e-4327-9a3f-1fcd80ecdcd6 req-d6df040b-8342-4afe-b102-a8927cf87a77 service nova] Creating event network-changed:e250e1f9-19b1-4cb6-be9d-02413ac740e5 for instance 2c8728f2-55fb-4306-acc5-227ba55ec278 on n-h2-852296-2 Aug 10 17:53:05.681498 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [req-20a783b5-cc8e-4327-9a3f-1fcd80ecdcd6 req-d6df040b-8342-4afe-b102-a8927cf87a77 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073337 Aug 10 17:53:05.682119 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 518/1013] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 10 17:53:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:53:05.689329 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-c5d1d9a6-3282-461a-a330-db1f2d945f9c tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:05.689681 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-c5d1d9a6-3282-461a-a330-db1f2d945f9c tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] [instance: bee3148a-3834-41bd-99e7-b5da75217256] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:05.698274 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-c5d1d9a6-3282-461a-a330-db1f2d945f9c tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:05.698822 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-c5d1d9a6-3282-461a-a330-db1f2d945f9c tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:05.699454 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-c5d1d9a6-3282-461a-a330-db1f2d945f9c tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:05.700239 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-c5d1d9a6-3282-461a-a330-db1f2d945f9c tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:05.700855 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-c5d1d9a6-3282-461a-a330-db1f2d945f9c tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:05.701351 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-c5d1d9a6-3282-461a-a330-db1f2d945f9c tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:05.871312 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-2772e83c-3a63-4cd8-a697-4ebb94799503 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f082ed04bc143679029c204e8a97160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c7c8eeb1b4065b25fe28eba30d0eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:05.898238 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-2772e83c-3a63-4cd8-a697-4ebb94799503 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] 10.222.0.50 "GET /compute/v2.1/servers/2c8728f2-55fb-4306-acc5-227ba55ec278" status: 200 len: 1318 microversion: 2.1 time: 0.409790 Aug 10 17:53:05.900403 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 496/1014] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:05 2022] GET /compute/v2.1/servers/2c8728f2-55fb-4306-acc5-227ba55ec278 => generated 1318 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:53:05.905597 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-cba19464-6235-4305-8d24-6e35ac028014 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1168980672", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "af745ef7-21f0-4149-ba68-33f45f73f2dd"}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:53:05.965026 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-c5d1d9a6-3282-461a-a330-db1f2d945f9c tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2fd6acf18d4218ad143ccee2d0bb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7c2481a908406fa9c4562513fff665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:05.970114 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.network.neutron [None req-cba19464-6235-4305-8d24-6e35ac028014 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] validate_networks() for None {{(pid=129409) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 17:53:05.975159 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-c5d1d9a6-3282-461a-a330-db1f2d945f9c tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] 10.222.0.50 "GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256" status: 200 len: 1471 microversion: 2.1 time: 0.291839 Aug 10 17:53:05.979129 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 519/1015] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:05 2022] GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256 => generated 1471 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:53:06.119698 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-7d2521ea-679d-4ad8-8d5b-f668530286d5 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:06.120692 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-7d2521ea-679d-4ad8-8d5b-f668530286d5 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] [instance: af35a390-86bf-4618-bce0-db7423a065bb] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:06.138577 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-7d2521ea-679d-4ad8-8d5b-f668530286d5 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:06.140591 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-7d2521ea-679d-4ad8-8d5b-f668530286d5 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:06.141403 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-7d2521ea-679d-4ad8-8d5b-f668530286d5 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:06.142364 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-7d2521ea-679d-4ad8-8d5b-f668530286d5 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:06.143732 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-7d2521ea-679d-4ad8-8d5b-f668530286d5 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:06.144441 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-7d2521ea-679d-4ad8-8d5b-f668530286d5 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:06.167027 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-7d2521ea-679d-4ad8-8d5b-f668530286d5 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] HTTP exception thrown: Instance af35a390-86bf-4618-bce0-db7423a065bb could not be found. Aug 10 17:53:06.168338 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-7d2521ea-679d-4ad8-8d5b-f668530286d5 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Request method failure captured: Aug 10 17:53:06.168338 n-d-852296-2 devstack@n-api.service[129410]: request: GET /compute/v2.1/servers/af35a390-86bf-4618-bce0-db7423a065bb HTTP/1.1 Aug 10 17:53:06.168338 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 17:53:06.168338 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 17:53:06.168338 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 17:53:06.168338 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 0 Aug 10 17:53:06.168338 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 17:53:06.168338 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 17:53:06.168338 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 17:53:06.168338 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 17:53:06.168338 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8-_0hr6nliTkkjEq4POLxTS39b7AKRzs5IHoadOFYk-Avq_EhHZhiXBqUGkDcgCWPqhSAgOsv1fUEScaBilJPZ4n8-MqEuqv4LzNqxeh_dhY8n5FOoRyMW4xdBlwKatTDuceji8cWTk46ZLZhXUEi0tZyObBcD9QSkhHyY2UTCtQ3Ok Aug 10 17:53:06.168338 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 17:53:06.168338 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 17:53:06.168338 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 17:53:06.168338 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 17:53:06.168338 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 17:53:06.168338 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 17:53:06.168338 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: 48bbb92998f54ebeb624bc794d406896 Aug 10 17:53:06.168338 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-MigrationsAdminTest-561431726 Aug 10 17:53:06.168338 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 17:53:06.168338 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 17:53:06.168338 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/48bbb92998f54ebeb624bc794d406896"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/48bbb92998f54ebeb624bc794d406896"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/48bbb92998f54ebeb624bc794d406896"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_48bbb92998f54ebeb624bc794d406896", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:53:06.168338 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-MigrationsAdminTest-561431726 Aug 10 17:53:06.168338 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: 48bbb92998f54ebeb624bc794d406896 Aug 10 17:53:06.168338 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-MigrationsAdminTest-561431726 Aug 10 17:53:06.168338 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-MigrationsAdminTest-561431726-project Aug 10 17:53:06.168338 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 17:53:06.168338 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 17:53:06.168338 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: e109c3dcd0574faaa3d7ec31dd4edd24 Aug 10 17:53:06.168338 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-MigrationsAdminTest-561431726-project Aug 10 17:53:06.168338 n-d-852296-2 devstack@n-api.service[129410]: method: > Aug 10 17:53:06.168338 n-d-852296-2 devstack@n-api.service[129410]: exception: Instance af35a390-86bf-4618-bce0-db7423a065bb could not be found. Aug 10 17:53:06.168338 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'id': 'af35a390-86bf-4618-bce0-db7423a065bb'} Aug 10 17:53:06.168338 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:53:06.168338 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:53:06.168338 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 17:53:06.168338 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 17:53:06.168338 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 17:53:06.168338 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 17:53:06.168338 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 17:53:06.168338 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 17:53:06.168338 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 17:53:06.168338 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 17:53:06.168338 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af35a390-86bf-4618-bce0-db7423a065bb could not be found. Aug 10 17:53:06.168338 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:53:06.168338 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:53:06.168338 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:53:06.168338 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:53:06.168338 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:53:06.168338 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:53:06.168338 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:53:06.168338 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:53:06.168338 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:53:06.168338 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:53:06.168338 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 17:53:06.168338 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 17:53:06.168338 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 17:53:06.168338 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 17:53:06.168338 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 17:53:06.168338 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:53:06.168338 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af35a390-86bf-4618-bce0-db7423a065bb could not be found. Aug 10 17:53:06.168338 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:53:06.168338 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:53:06.168338 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:53:06.173131 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:53:06.173131 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:53:06.173131 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:53:06.173131 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:53:06.173131 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:53:06.173131 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af35a390-86bf-4618-bce0-db7423a065bb could not be found. Aug 10 17:53:06.173131 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:53:06.175386 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-7d2521ea-679d-4ad8-8d5b-f668530286d5 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] Returning 404 to user: Instance af35a390-86bf-4618-bce0-db7423a065bb could not be found. {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:53:06.176941 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-7d2521ea-679d-4ad8-8d5b-f668530286d5 tempest-MigrationsAdminTest-561431726 tempest-MigrationsAdminTest-561431726-project] 10.222.0.50 "GET /compute/v2.1/servers/af35a390-86bf-4618-bce0-db7423a065bb" status: 404 len: 111 microversion: 2.1 time: 0.062869 Aug 10 17:53:06.181101 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 520/1016] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:06 2022] GET /compute/v2.1/servers/af35a390-86bf-4618-bce0-db7423a065bb => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 17:53:06.261059 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.virt.hardware [None req-cba19464-6235-4305-8d24-6e35ac028014 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Flavor limits 0:0:0 {{(pid=129409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 17:53:06.263196 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.virt.hardware [None req-cba19464-6235-4305-8d24-6e35ac028014 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Image limits 0:0:0 {{(pid=129409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 17:53:06.263678 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.virt.hardware [None req-cba19464-6235-4305-8d24-6e35ac028014 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Flavor pref 0:0:0 {{(pid=129409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 17:53:06.264087 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.virt.hardware [None req-cba19464-6235-4305-8d24-6e35ac028014 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Image pref 0:0:0 {{(pid=129409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 17:53:06.264527 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.virt.hardware [None req-cba19464-6235-4305-8d24-6e35ac028014 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 17:53:06.273996 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-cba19464-6235-4305-8d24-6e35ac028014 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:06.275030 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-cba19464-6235-4305-8d24-6e35ac028014 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:06.276317 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-cba19464-6235-4305-8d24-6e35ac028014 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:06.276946 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-cba19464-6235-4305-8d24-6e35ac028014 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:06.277646 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-cba19464-6235-4305-8d24-6e35ac028014 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:06.278011 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-cba19464-6235-4305-8d24-6e35ac028014 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:06.295911 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-cba19464-6235-4305-8d24-6e35ac028014 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Getting quotas for project 0638146d08704b2983761619745290b3. Resources: {'instances', 'ram', 'cores'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:53:06.300685 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-cba19464-6235-4305-8d24-6e35ac028014 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Getting quotas for user f76b870a54454956b3926c34f9f27442 and project 0638146d08704b2983761619745290b3. Resources: {'instances', 'ram', 'cores'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:53:06.313952 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-cba19464-6235-4305-8d24-6e35ac028014 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Going to run 1 instances... {{(pid=129409) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 17:53:06.316226 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-cba19464-6235-4305-8d24-6e35ac028014 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: d4920fe1-a755-43f8-aa8f-b38c20f8c98a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a735ff26-463a-4ffe-a981-ab9d9baa494f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 17:53:06.497916 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-cba19464-6235-4305-8d24-6e35ac028014 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.596053 Aug 10 17:53:06.498560 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 497/1017] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 17:53:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 597 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 17:53:06.509582 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-16360751-eb36-4f39-9859-502a2becc448 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:06.510197 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-16360751-eb36-4f39-9859-502a2becc448 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: d4920fe1-a755-43f8-aa8f-b38c20f8c98a] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:06.513036 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-4289f766-a870-4ae7-8e92-ee5e8955f5ab tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:06.514370 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-4289f766-a870-4ae7-8e92-ee5e8955f5ab tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] [instance: e2777988-0bbf-496c-9c97-b206dbc94a62] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:06.520928 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-4289f766-a870-4ae7-8e92-ee5e8955f5ab tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:06.521418 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-4289f766-a870-4ae7-8e92-ee5e8955f5ab tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:06.521855 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-4289f766-a870-4ae7-8e92-ee5e8955f5ab tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:06.522556 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-4289f766-a870-4ae7-8e92-ee5e8955f5ab tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:06.523509 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-4289f766-a870-4ae7-8e92-ee5e8955f5ab tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:06.523941 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-4289f766-a870-4ae7-8e92-ee5e8955f5ab tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:06.599196 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-16360751-eb36-4f39-9859-502a2becc448 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:06.608907 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-16360751-eb36-4f39-9859-502a2becc448 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/d4920fe1-a755-43f8-aa8f-b38c20f8c98a" status: 200 len: 1217 microversion: 2.1 time: 0.103359 Aug 10 17:53:06.609846 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 521/1018] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:06 2022] GET /compute/v2.1/servers/d4920fe1-a755-43f8-aa8f-b38c20f8c98a => generated 1217 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:53:06.711280 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.objects.instance [None req-4289f766-a870-4ae7-8e92-ee5e8955f5ab tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lazy-loading 'services' on Instance uuid e2777988-0bbf-496c-9c97-b206dbc94a62 {{(pid=129409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:53:06.732006 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-4289f766-a870-4ae7-8e92-ee5e8955f5ab tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62" status: 200 len: 1925 microversion: 2.75 time: 0.223201 Aug 10 17:53:06.751897 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 498/1019] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:53:06 2022] GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62 => generated 1925 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 17:53:06.927515 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-03a9270f-688a-49fc-952c-cec4d314d46a tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:06.929202 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-03a9270f-688a-49fc-952c-cec4d314d46a tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] [instance: 2c8728f2-55fb-4306-acc5-227ba55ec278] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:06.942386 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-03a9270f-688a-49fc-952c-cec4d314d46a tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:06.944480 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-03a9270f-688a-49fc-952c-cec4d314d46a tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:06.945887 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-03a9270f-688a-49fc-952c-cec4d314d46a tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:06.947061 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-03a9270f-688a-49fc-952c-cec4d314d46a tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:06.947856 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-03a9270f-688a-49fc-952c-cec4d314d46a tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:06.948590 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-03a9270f-688a-49fc-952c-cec4d314d46a tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:07.001096 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-b1f7b15c-7f15-4b0c-9ad1-74fafaf58fa3 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:07.001714 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-b1f7b15c-7f15-4b0c-9ad1-74fafaf58fa3 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] [instance: bee3148a-3834-41bd-99e7-b5da75217256] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:07.009413 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-b1f7b15c-7f15-4b0c-9ad1-74fafaf58fa3 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:07.010183 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-b1f7b15c-7f15-4b0c-9ad1-74fafaf58fa3 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:07.010624 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-b1f7b15c-7f15-4b0c-9ad1-74fafaf58fa3 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:07.011581 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-b1f7b15c-7f15-4b0c-9ad1-74fafaf58fa3 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:07.012842 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-b1f7b15c-7f15-4b0c-9ad1-74fafaf58fa3 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:07.013428 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-b1f7b15c-7f15-4b0c-9ad1-74fafaf58fa3 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:07.216157 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-03a9270f-688a-49fc-952c-cec4d314d46a tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f082ed04bc143679029c204e8a97160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c7c8eeb1b4065b25fe28eba30d0eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:07.227640 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-03a9270f-688a-49fc-952c-cec4d314d46a tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] 10.222.0.50 "GET /compute/v2.1/servers/2c8728f2-55fb-4306-acc5-227ba55ec278" status: 200 len: 1318 microversion: 2.1 time: 0.307805 Aug 10 17:53:07.231854 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 522/1020] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:06 2022] GET /compute/v2.1/servers/2c8728f2-55fb-4306-acc5-227ba55ec278 => generated 1318 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:53:07.604715 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-b1f7b15c-7f15-4b0c-9ad1-74fafaf58fa3 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2fd6acf18d4218ad143ccee2d0bb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7c2481a908406fa9c4562513fff665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:07.613110 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-b1f7b15c-7f15-4b0c-9ad1-74fafaf58fa3 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] 10.222.0.50 "GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256" status: 200 len: 1471 microversion: 2.1 time: 0.617631 Aug 10 17:53:07.613699 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 499/1021] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:06 2022] GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256 => generated 1471 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:53:07.629958 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-6d97d1f5-7232-44d0-a86b-abb00edf0a59 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:07.630959 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-6d97d1f5-7232-44d0-a86b-abb00edf0a59 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: d4920fe1-a755-43f8-aa8f-b38c20f8c98a] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:07.727787 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-6d97d1f5-7232-44d0-a86b-abb00edf0a59 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:07.734906 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-6d97d1f5-7232-44d0-a86b-abb00edf0a59 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/d4920fe1-a755-43f8-aa8f-b38c20f8c98a" status: 200 len: 1217 microversion: 2.1 time: 0.109292 Aug 10 17:53:07.737434 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 523/1022] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:07 2022] GET /compute/v2.1/servers/d4920fe1-a755-43f8-aa8f-b38c20f8c98a => generated 1217 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:53:07.758194 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-0b545e44-e084-4bca-b081-a8c1ce7486cb tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:07.759789 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-0b545e44-e084-4bca-b081-a8c1ce7486cb tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] [instance: e2777988-0bbf-496c-9c97-b206dbc94a62] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:07.770024 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-0b545e44-e084-4bca-b081-a8c1ce7486cb tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:07.771098 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-0b545e44-e084-4bca-b081-a8c1ce7486cb tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:07.771693 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-0b545e44-e084-4bca-b081-a8c1ce7486cb tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:07.772622 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-0b545e44-e084-4bca-b081-a8c1ce7486cb tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:07.773229 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-0b545e44-e084-4bca-b081-a8c1ce7486cb tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:07.773803 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-0b545e44-e084-4bca-b081-a8c1ce7486cb tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:07.936712 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.objects.instance [None req-0b545e44-e084-4bca-b081-a8c1ce7486cb tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lazy-loading 'services' on Instance uuid e2777988-0bbf-496c-9c97-b206dbc94a62 {{(pid=129409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:53:07.960744 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-0b545e44-e084-4bca-b081-a8c1ce7486cb tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62" status: 200 len: 1925 microversion: 2.75 time: 0.207042 Aug 10 17:53:07.968436 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 500/1023] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:53:07 2022] GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62 => generated 1925 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:53:08.248557 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-ae8df62a-62d8-4059-ba3f-592e92da1abf tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:08.249185 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-ae8df62a-62d8-4059-ba3f-592e92da1abf tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] [instance: 2c8728f2-55fb-4306-acc5-227ba55ec278] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:08.254895 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-ae8df62a-62d8-4059-ba3f-592e92da1abf tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:08.255372 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-ae8df62a-62d8-4059-ba3f-592e92da1abf tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:08.255803 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-ae8df62a-62d8-4059-ba3f-592e92da1abf tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:08.256505 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-ae8df62a-62d8-4059-ba3f-592e92da1abf tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:08.256955 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-ae8df62a-62d8-4059-ba3f-592e92da1abf tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:08.257372 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-ae8df62a-62d8-4059-ba3f-592e92da1abf tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:08.398594 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-ae8df62a-62d8-4059-ba3f-592e92da1abf tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f082ed04bc143679029c204e8a97160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c7c8eeb1b4065b25fe28eba30d0eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:08.408805 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-ae8df62a-62d8-4059-ba3f-592e92da1abf tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] 10.222.0.50 "GET /compute/v2.1/servers/2c8728f2-55fb-4306-acc5-227ba55ec278" status: 200 len: 1318 microversion: 2.1 time: 0.163941 Aug 10 17:53:08.409716 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 524/1024] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:08 2022] GET /compute/v2.1/servers/2c8728f2-55fb-4306-acc5-227ba55ec278 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:53:08.634937 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-3c251fca-1589-4e2f-8223-d8e9b4cd056f tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:08.635559 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-3c251fca-1589-4e2f-8223-d8e9b4cd056f tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] [instance: bee3148a-3834-41bd-99e7-b5da75217256] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:08.642143 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-3c251fca-1589-4e2f-8223-d8e9b4cd056f tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:08.642626 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-3c251fca-1589-4e2f-8223-d8e9b4cd056f tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:08.643063 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-3c251fca-1589-4e2f-8223-d8e9b4cd056f tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:08.643751 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-3c251fca-1589-4e2f-8223-d8e9b4cd056f tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:08.644207 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-3c251fca-1589-4e2f-8223-d8e9b4cd056f tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:08.644658 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-3c251fca-1589-4e2f-8223-d8e9b4cd056f tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:08.756872 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-44348103-1eb0-427b-ba6b-889e6873ca40 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:08.757635 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-44348103-1eb0-427b-ba6b-889e6873ca40 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: d4920fe1-a755-43f8-aa8f-b38c20f8c98a] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:08.781825 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-44348103-1eb0-427b-ba6b-889e6873ca40 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:08.782320 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-44348103-1eb0-427b-ba6b-889e6873ca40 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:08.782758 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-44348103-1eb0-427b-ba6b-889e6873ca40 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:08.783469 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-44348103-1eb0-427b-ba6b-889e6873ca40 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:08.783932 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-44348103-1eb0-427b-ba6b-889e6873ca40 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:08.786302 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-44348103-1eb0-427b-ba6b-889e6873ca40 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:08.822897 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-3c251fca-1589-4e2f-8223-d8e9b4cd056f tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2fd6acf18d4218ad143ccee2d0bb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7c2481a908406fa9c4562513fff665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:08.831798 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-3c251fca-1589-4e2f-8223-d8e9b4cd056f tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] 10.222.0.50 "GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256" status: 200 len: 1471 microversion: 2.1 time: 0.200714 Aug 10 17:53:08.846091 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 501/1025] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:08 2022] GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256 => generated 1471 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:53:08.884520 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-44348103-1eb0-427b-ba6b-889e6873ca40 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:08.894101 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-44348103-1eb0-427b-ba6b-889e6873ca40 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/d4920fe1-a755-43f8-aa8f-b38c20f8c98a" status: 200 len: 1213 microversion: 2.1 time: 0.140402 Aug 10 17:53:08.895473 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 525/1026] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:08 2022] GET /compute/v2.1/servers/d4920fe1-a755-43f8-aa8f-b38c20f8c98a => generated 1213 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:53:08.986905 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-023e429c-003a-42b5-a980-871719687505 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:08.987520 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-023e429c-003a-42b5-a980-871719687505 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] [instance: e2777988-0bbf-496c-9c97-b206dbc94a62] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:08.993563 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-023e429c-003a-42b5-a980-871719687505 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:08.994037 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-023e429c-003a-42b5-a980-871719687505 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:08.994476 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-023e429c-003a-42b5-a980-871719687505 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:08.995173 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-023e429c-003a-42b5-a980-871719687505 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:08.995741 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-023e429c-003a-42b5-a980-871719687505 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:08.996175 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-023e429c-003a-42b5-a980-871719687505 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:09.080328 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.objects.instance [None req-023e429c-003a-42b5-a980-871719687505 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lazy-loading 'services' on Instance uuid e2777988-0bbf-496c-9c97-b206dbc94a62 {{(pid=129409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:53:09.118320 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-023e429c-003a-42b5-a980-871719687505 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62" status: 200 len: 1925 microversion: 2.75 time: 0.135154 Aug 10 17:53:09.120006 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 502/1027] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:53:08 2022] GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62 => generated 1925 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:53:09.429977 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-6e583146-4e58-4094-b7ad-b86dc6cc5b65 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:09.430614 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-6e583146-4e58-4094-b7ad-b86dc6cc5b65 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] [instance: 2c8728f2-55fb-4306-acc5-227ba55ec278] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:09.437138 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-6e583146-4e58-4094-b7ad-b86dc6cc5b65 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:09.437623 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-6e583146-4e58-4094-b7ad-b86dc6cc5b65 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:09.438069 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-6e583146-4e58-4094-b7ad-b86dc6cc5b65 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:09.438762 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-6e583146-4e58-4094-b7ad-b86dc6cc5b65 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:09.439218 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-6e583146-4e58-4094-b7ad-b86dc6cc5b65 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:09.439647 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-6e583146-4e58-4094-b7ad-b86dc6cc5b65 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:09.581266 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-6e583146-4e58-4094-b7ad-b86dc6cc5b65 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f082ed04bc143679029c204e8a97160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c7c8eeb1b4065b25fe28eba30d0eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:09.590823 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-6e583146-4e58-4094-b7ad-b86dc6cc5b65 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] 10.222.0.50 "GET /compute/v2.1/servers/2c8728f2-55fb-4306-acc5-227ba55ec278" status: 200 len: 1318 microversion: 2.1 time: 0.162518 Aug 10 17:53:09.590823 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 526/1028] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:09 2022] GET /compute/v2.1/servers/2c8728f2-55fb-4306-acc5-227ba55ec278 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:53:09.853548 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-9ebd3851-d83a-45cd-8a88-5934c88cb93c tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:09.858170 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-9ebd3851-d83a-45cd-8a88-5934c88cb93c tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] [instance: bee3148a-3834-41bd-99e7-b5da75217256] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:09.861022 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-9ebd3851-d83a-45cd-8a88-5934c88cb93c tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:09.861509 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-9ebd3851-d83a-45cd-8a88-5934c88cb93c tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:09.861944 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-9ebd3851-d83a-45cd-8a88-5934c88cb93c tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:09.862636 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-9ebd3851-d83a-45cd-8a88-5934c88cb93c tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:09.863090 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-9ebd3851-d83a-45cd-8a88-5934c88cb93c tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:09.863574 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-9ebd3851-d83a-45cd-8a88-5934c88cb93c tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:09.920015 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-c1207dcc-5bbd-4b1c-9986-3a91f35d8598 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:09.920913 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-c1207dcc-5bbd-4b1c-9986-3a91f35d8598 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: d4920fe1-a755-43f8-aa8f-b38c20f8c98a] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:09.927053 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-c1207dcc-5bbd-4b1c-9986-3a91f35d8598 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:09.928087 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-c1207dcc-5bbd-4b1c-9986-3a91f35d8598 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:09.928087 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-c1207dcc-5bbd-4b1c-9986-3a91f35d8598 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:09.928783 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-c1207dcc-5bbd-4b1c-9986-3a91f35d8598 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:09.929239 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-c1207dcc-5bbd-4b1c-9986-3a91f35d8598 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:09.929664 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-c1207dcc-5bbd-4b1c-9986-3a91f35d8598 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:10.020942 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-9ebd3851-d83a-45cd-8a88-5934c88cb93c tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2fd6acf18d4218ad143ccee2d0bb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7c2481a908406fa9c4562513fff665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:10.028980 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-9ebd3851-d83a-45cd-8a88-5934c88cb93c tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] 10.222.0.50 "GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256" status: 200 len: 1471 microversion: 2.1 time: 0.179269 Aug 10 17:53:10.029846 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 503/1029] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:09 2022] GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256 => generated 1471 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:53:10.041945 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-c1207dcc-5bbd-4b1c-9986-3a91f35d8598 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:10.050645 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-c1207dcc-5bbd-4b1c-9986-3a91f35d8598 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/d4920fe1-a755-43f8-aa8f-b38c20f8c98a" status: 200 len: 1277 microversion: 2.1 time: 0.135067 Aug 10 17:53:10.064339 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 527/1030] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:09 2022] GET /compute/v2.1/servers/d4920fe1-a755-43f8-aa8f-b38c20f8c98a => generated 1277 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:53:10.149629 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-cb367e55-ae55-441c-9ce1-793f65eb0f75 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:10.149629 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-cb367e55-ae55-441c-9ce1-793f65eb0f75 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] [instance: e2777988-0bbf-496c-9c97-b206dbc94a62] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:10.154744 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-cb367e55-ae55-441c-9ce1-793f65eb0f75 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:10.155478 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-cb367e55-ae55-441c-9ce1-793f65eb0f75 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:10.156085 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-cb367e55-ae55-441c-9ce1-793f65eb0f75 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:10.156860 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-cb367e55-ae55-441c-9ce1-793f65eb0f75 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:10.157321 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-cb367e55-ae55-441c-9ce1-793f65eb0f75 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:10.157747 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-cb367e55-ae55-441c-9ce1-793f65eb0f75 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:10.240544 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.objects.instance [None req-cb367e55-ae55-441c-9ce1-793f65eb0f75 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lazy-loading 'services' on Instance uuid e2777988-0bbf-496c-9c97-b206dbc94a62 {{(pid=129409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:53:10.266244 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-cb367e55-ae55-441c-9ce1-793f65eb0f75 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62" status: 200 len: 1925 microversion: 2.75 time: 0.123819 Aug 10 17:53:10.269011 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 504/1031] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:53:10 2022] GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62 => generated 1925 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:53:10.611062 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-33f3b37f-db53-4db5-86eb-78500e26a28e tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:10.612729 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-33f3b37f-db53-4db5-86eb-78500e26a28e tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] [instance: 2c8728f2-55fb-4306-acc5-227ba55ec278] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:10.620481 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-33f3b37f-db53-4db5-86eb-78500e26a28e tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:10.621057 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-33f3b37f-db53-4db5-86eb-78500e26a28e tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:10.621583 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-33f3b37f-db53-4db5-86eb-78500e26a28e tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:10.622436 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-33f3b37f-db53-4db5-86eb-78500e26a28e tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:10.622984 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-33f3b37f-db53-4db5-86eb-78500e26a28e tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:10.623646 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-33f3b37f-db53-4db5-86eb-78500e26a28e tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:10.726240 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [req-c52950ff-e084-4f82-9ace-4f21969c44a5 req-0a74c7a9-4ac5-4c06-b55f-803d2bddb5ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c8728f2-55fb-4306-acc5-227ba55ec278", "name": "network-vif-plugged", "status": "completed", "tag": "e250e1f9-19b1-4cb6-be9d-02413ac740e5"}]} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:53:10.739349 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:53:10.748536 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-c52950ff-e084-4f82-9ace-4f21969c44a5 req-0a74c7a9-4ac5-4c06-b55f-803d2bddb5ef service nova] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:10.749237 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-c52950ff-e084-4f82-9ace-4f21969c44a5 req-0a74c7a9-4ac5-4c06-b55f-803d2bddb5ef service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:10.749953 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-c52950ff-e084-4f82-9ace-4f21969c44a5 req-0a74c7a9-4ac5-4c06-b55f-803d2bddb5ef service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:10.753131 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_cell1:SELECT=100 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:53:10.770471 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.compute.server_external_events [req-c52950ff-e084-4f82-9ace-4f21969c44a5 req-0a74c7a9-4ac5-4c06-b55f-803d2bddb5ef service nova] Creating event network-vif-plugged:e250e1f9-19b1-4cb6-be9d-02413ac740e5 for instance 2c8728f2-55fb-4306-acc5-227ba55ec278 on n-h2-852296-2 Aug 10 17:53:10.775890 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [req-c52950ff-e084-4f82-9ace-4f21969c44a5 req-0a74c7a9-4ac5-4c06-b55f-803d2bddb5ef service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053797 Aug 10 17:53:10.776802 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 505/1032] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 10 17:53:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:53:10.893207 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-33f3b37f-db53-4db5-86eb-78500e26a28e tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f082ed04bc143679029c204e8a97160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c7c8eeb1b4065b25fe28eba30d0eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:10.902084 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-33f3b37f-db53-4db5-86eb-78500e26a28e tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] 10.222.0.50 "GET /compute/v2.1/servers/2c8728f2-55fb-4306-acc5-227ba55ec278" status: 200 len: 1318 microversion: 2.1 time: 0.296311 Aug 10 17:53:10.903093 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 528/1033] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:10 2022] GET /compute/v2.1/servers/2c8728f2-55fb-4306-acc5-227ba55ec278 => generated 1318 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:53:11.055573 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-44469381-9b1a-4033-bffb-2f92e7b9af8d tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:11.059146 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-44469381-9b1a-4033-bffb-2f92e7b9af8d tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] [instance: bee3148a-3834-41bd-99e7-b5da75217256] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:11.077615 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-9c0a39fa-b292-4c3c-9532-c8a059109080 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:11.078615 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-9c0a39fa-b292-4c3c-9532-c8a059109080 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: d4920fe1-a755-43f8-aa8f-b38c20f8c98a] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:11.085122 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-44469381-9b1a-4033-bffb-2f92e7b9af8d tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:11.086180 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-44469381-9b1a-4033-bffb-2f92e7b9af8d tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:11.086869 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-44469381-9b1a-4033-bffb-2f92e7b9af8d tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:11.094084 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-44469381-9b1a-4033-bffb-2f92e7b9af8d tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:11.094084 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-44469381-9b1a-4033-bffb-2f92e7b9af8d tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:11.094084 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-44469381-9b1a-4033-bffb-2f92e7b9af8d tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:11.094777 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-9c0a39fa-b292-4c3c-9532-c8a059109080 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:11.096936 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-9c0a39fa-b292-4c3c-9532-c8a059109080 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:11.097896 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-9c0a39fa-b292-4c3c-9532-c8a059109080 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:11.099527 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-9c0a39fa-b292-4c3c-9532-c8a059109080 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:11.103054 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-9c0a39fa-b292-4c3c-9532-c8a059109080 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:11.103752 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-9c0a39fa-b292-4c3c-9532-c8a059109080 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:11.317396 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-44469381-9b1a-4033-bffb-2f92e7b9af8d tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2fd6acf18d4218ad143ccee2d0bb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7c2481a908406fa9c4562513fff665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:11.325152 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-44469381-9b1a-4033-bffb-2f92e7b9af8d tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] 10.222.0.50 "GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256" status: 200 len: 1471 microversion: 2.1 time: 0.275844 Aug 10 17:53:11.345127 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 506/1034] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:11 2022] GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256 => generated 1471 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:53:11.350816 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-a6837467-769c-450a-b210-bc93f2bb79d7 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:11.351744 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-a6837467-769c-450a-b210-bc93f2bb79d7 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] [instance: e2777988-0bbf-496c-9c97-b206dbc94a62] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:11.360726 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a6837467-769c-450a-b210-bc93f2bb79d7 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:11.361438 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a6837467-769c-450a-b210-bc93f2bb79d7 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:11.362105 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a6837467-769c-450a-b210-bc93f2bb79d7 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:11.363026 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a6837467-769c-450a-b210-bc93f2bb79d7 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:11.363686 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a6837467-769c-450a-b210-bc93f2bb79d7 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:11.364597 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a6837467-769c-450a-b210-bc93f2bb79d7 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:11.449803 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.objects.instance [None req-a6837467-769c-450a-b210-bc93f2bb79d7 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lazy-loading 'services' on Instance uuid e2777988-0bbf-496c-9c97-b206dbc94a62 {{(pid=129409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:53:11.472583 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-a6837467-769c-450a-b210-bc93f2bb79d7 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62" status: 200 len: 1925 microversion: 2.75 time: 0.126048 Aug 10 17:53:11.473169 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 507/1035] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:53:11 2022] GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62 => generated 1925 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:53:11.676765 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-9c0a39fa-b292-4c3c-9532-c8a059109080 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:11.687880 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-9c0a39fa-b292-4c3c-9532-c8a059109080 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/d4920fe1-a755-43f8-aa8f-b38c20f8c98a" status: 200 len: 1317 microversion: 2.1 time: 0.617108 Aug 10 17:53:11.689406 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 529/1036] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:11 2022] GET /compute/v2.1/servers/d4920fe1-a755-43f8-aa8f-b38c20f8c98a => generated 1317 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:53:11.923801 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-64dc2145-a1d3-46c1-adc8-7196e699f7dd tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:11.924675 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-64dc2145-a1d3-46c1-adc8-7196e699f7dd tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] [instance: 2c8728f2-55fb-4306-acc5-227ba55ec278] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:11.930873 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-64dc2145-a1d3-46c1-adc8-7196e699f7dd tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:11.931650 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-64dc2145-a1d3-46c1-adc8-7196e699f7dd tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:11.932355 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-64dc2145-a1d3-46c1-adc8-7196e699f7dd tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:11.933174 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-64dc2145-a1d3-46c1-adc8-7196e699f7dd tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:11.933773 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-64dc2145-a1d3-46c1-adc8-7196e699f7dd tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:11.934478 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-64dc2145-a1d3-46c1-adc8-7196e699f7dd tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:12.134300 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-64dc2145-a1d3-46c1-adc8-7196e699f7dd tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f082ed04bc143679029c204e8a97160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c7c8eeb1b4065b25fe28eba30d0eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:12.144925 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-64dc2145-a1d3-46c1-adc8-7196e699f7dd tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] 10.222.0.50 "GET /compute/v2.1/servers/2c8728f2-55fb-4306-acc5-227ba55ec278" status: 200 len: 1318 microversion: 2.1 time: 0.225267 Aug 10 17:53:12.146591 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 508/1037] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:11 2022] GET /compute/v2.1/servers/2c8728f2-55fb-4306-acc5-227ba55ec278 => generated 1318 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:53:12.315541 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [req-f226261f-27bb-4a0c-bbaf-d7b13236cfd1 req-27d9844d-e136-4482-bd96-645237ff633c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4920fe1-a755-43f8-aa8f-b38c20f8c98a", "tag": "32763ad4-0ca1-47d1-838d-b554a0f3bd13"}]} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:53:12.329834 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-f226261f-27bb-4a0c-bbaf-d7b13236cfd1 req-27d9844d-e136-4482-bd96-645237ff633c service nova] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:12.330577 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-f226261f-27bb-4a0c-bbaf-d7b13236cfd1 req-27d9844d-e136-4482-bd96-645237ff633c service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:12.331003 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-f226261f-27bb-4a0c-bbaf-d7b13236cfd1 req-27d9844d-e136-4482-bd96-645237ff633c service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:12.344214 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.compute.server_external_events [req-f226261f-27bb-4a0c-bbaf-d7b13236cfd1 req-27d9844d-e136-4482-bd96-645237ff633c service nova] Creating event network-changed:32763ad4-0ca1-47d1-838d-b554a0f3bd13 for instance d4920fe1-a755-43f8-aa8f-b38c20f8c98a on n-h1-852296-2 Aug 10 17:53:12.349464 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [req-f226261f-27bb-4a0c-bbaf-d7b13236cfd1 req-27d9844d-e136-4482-bd96-645237ff633c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038581 Aug 10 17:53:12.350369 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 530/1038] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 10 17:53:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:53:12.356725 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-95fbe299-7cab-46f6-8ee8-372132d616a4 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:12.357495 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-95fbe299-7cab-46f6-8ee8-372132d616a4 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] [instance: bee3148a-3834-41bd-99e7-b5da75217256] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:12.365734 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-95fbe299-7cab-46f6-8ee8-372132d616a4 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:12.366391 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-95fbe299-7cab-46f6-8ee8-372132d616a4 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:12.366885 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-95fbe299-7cab-46f6-8ee8-372132d616a4 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:12.367822 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-95fbe299-7cab-46f6-8ee8-372132d616a4 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:12.368589 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-95fbe299-7cab-46f6-8ee8-372132d616a4 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:12.369484 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-95fbe299-7cab-46f6-8ee8-372132d616a4 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:12.500827 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-25503e4e-4f74-49ee-b211-4c546c363237 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:12.501526 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-25503e4e-4f74-49ee-b211-4c546c363237 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] [instance: e2777988-0bbf-496c-9c97-b206dbc94a62] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:12.508161 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-25503e4e-4f74-49ee-b211-4c546c363237 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:12.508674 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-25503e4e-4f74-49ee-b211-4c546c363237 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:12.509113 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-25503e4e-4f74-49ee-b211-4c546c363237 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:12.509817 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-25503e4e-4f74-49ee-b211-4c546c363237 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:12.510278 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-25503e4e-4f74-49ee-b211-4c546c363237 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:12.510705 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-25503e4e-4f74-49ee-b211-4c546c363237 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:12.544360 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-95fbe299-7cab-46f6-8ee8-372132d616a4 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2fd6acf18d4218ad143ccee2d0bb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7c2481a908406fa9c4562513fff665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:12.554218 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-95fbe299-7cab-46f6-8ee8-372132d616a4 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] 10.222.0.50 "GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256" status: 200 len: 1471 microversion: 2.1 time: 0.202009 Aug 10 17:53:12.555492 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 509/1039] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:12 2022] GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256 => generated 1471 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:53:12.663249 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_cell1:SELECT=100 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:53:12.671954 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.objects.instance [None req-25503e4e-4f74-49ee-b211-4c546c363237 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lazy-loading 'services' on Instance uuid e2777988-0bbf-496c-9c97-b206dbc94a62 {{(pid=129410) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:53:12.691949 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-25503e4e-4f74-49ee-b211-4c546c363237 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62" status: 200 len: 1925 microversion: 2.75 time: 0.196317 Aug 10 17:53:12.693680 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 531/1040] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:53:12 2022] GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62 => generated 1925 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 17:53:12.719448 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-71ccc3dc-d306-4acd-b6d7-7f24c4848a05 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:12.720058 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-71ccc3dc-d306-4acd-b6d7-7f24c4848a05 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: d4920fe1-a755-43f8-aa8f-b38c20f8c98a] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:12.731129 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-71ccc3dc-d306-4acd-b6d7-7f24c4848a05 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:12.731594 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-71ccc3dc-d306-4acd-b6d7-7f24c4848a05 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:12.732033 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-71ccc3dc-d306-4acd-b6d7-7f24c4848a05 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:12.732777 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-71ccc3dc-d306-4acd-b6d7-7f24c4848a05 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:12.733240 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-71ccc3dc-d306-4acd-b6d7-7f24c4848a05 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:12.733667 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-71ccc3dc-d306-4acd-b6d7-7f24c4848a05 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:12.881523 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-71ccc3dc-d306-4acd-b6d7-7f24c4848a05 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:12.889940 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-71ccc3dc-d306-4acd-b6d7-7f24c4848a05 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/d4920fe1-a755-43f8-aa8f-b38c20f8c98a" status: 200 len: 1317 microversion: 2.1 time: 0.178335 Aug 10 17:53:12.915785 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 510/1041] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:12 2022] GET /compute/v2.1/servers/d4920fe1-a755-43f8-aa8f-b38c20f8c98a => generated 1317 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:53:13.171454 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-c1a43811-847e-4f5a-8f42-76204020377e tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:13.172200 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-c1a43811-847e-4f5a-8f42-76204020377e tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] [instance: 2c8728f2-55fb-4306-acc5-227ba55ec278] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:13.178863 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c1a43811-847e-4f5a-8f42-76204020377e tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:13.180395 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c1a43811-847e-4f5a-8f42-76204020377e tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:13.180395 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c1a43811-847e-4f5a-8f42-76204020377e tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:13.180792 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c1a43811-847e-4f5a-8f42-76204020377e tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:13.181202 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c1a43811-847e-4f5a-8f42-76204020377e tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:13.181632 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c1a43811-847e-4f5a-8f42-76204020377e tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:13.324550 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-c1a43811-847e-4f5a-8f42-76204020377e tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f082ed04bc143679029c204e8a97160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c7c8eeb1b4065b25fe28eba30d0eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:13.332770 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-c1a43811-847e-4f5a-8f42-76204020377e tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] 10.222.0.50 "GET /compute/v2.1/servers/2c8728f2-55fb-4306-acc5-227ba55ec278" status: 200 len: 1468 microversion: 2.1 time: 0.167170 Aug 10 17:53:13.333348 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 511/1042] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:13 2022] GET /compute/v2.1/servers/2c8728f2-55fb-4306-acc5-227ba55ec278 => generated 1468 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:53:13.476742 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-5308df35-5df5-46a4-a697-d6535a08f36f tempest-ServicesAdminNegativeTestJSON-1320006350 tempest-ServicesAdminNegativeTestJSON-1320006350-project-admin] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:13.480260 n-d-852296-2 devstack@n-api.service[129410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:53:13.480260 n-d-852296-2 devstack@n-api.service[129410]: warnings.warn(msg) Aug 10 17:53:13.482061 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-5308df35-5df5-46a4-a697-d6535a08f36f tempest-ServicesAdminNegativeTestJSON-1320006350 tempest-ServicesAdminNegativeTestJSON-1320006350-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:13.482723 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-5308df35-5df5-46a4-a697-d6535a08f36f tempest-ServicesAdminNegativeTestJSON-1320006350 tempest-ServicesAdminNegativeTestJSON-1320006350-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:13.483455 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-5308df35-5df5-46a4-a697-d6535a08f36f tempest-ServicesAdminNegativeTestJSON-1320006350 tempest-ServicesAdminNegativeTestJSON-1320006350-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:13.484439 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-5308df35-5df5-46a4-a697-d6535a08f36f tempest-ServicesAdminNegativeTestJSON-1320006350 tempest-ServicesAdminNegativeTestJSON-1320006350-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:13.485059 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-5308df35-5df5-46a4-a697-d6535a08f36f tempest-ServicesAdminNegativeTestJSON-1320006350 tempest-ServicesAdminNegativeTestJSON-1320006350-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:13.485652 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-5308df35-5df5-46a4-a697-d6535a08f36f tempest-ServicesAdminNegativeTestJSON-1320006350 tempest-ServicesAdminNegativeTestJSON-1320006350-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:13.513847 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-5308df35-5df5-46a4-a697-d6535a08f36f tempest-ServicesAdminNegativeTestJSON-1320006350 tempest-ServicesAdminNegativeTestJSON-1320006350-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.366348 Aug 10 17:53:13.514726 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 532/1043] 10.222.0.50 () {58 vars in 1137 bytes} [Wed Aug 10 17:53:13 2022] GET /compute/v2.1/os-services => generated 944 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:53:13.528617 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-0e15bb3d-677c-42c9-8fb1-c56633549bc5 tempest-ServicesAdminNegativeTestJSON-1320006350 tempest-ServicesAdminNegativeTestJSON-1320006350-project-admin] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:13.531973 n-d-852296-2 devstack@n-api.service[129410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:53:13.531973 n-d-852296-2 devstack@n-api.service[129410]: warnings.warn(msg) Aug 10 17:53:13.533509 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-0e15bb3d-677c-42c9-8fb1-c56633549bc5 tempest-ServicesAdminNegativeTestJSON-1320006350 tempest-ServicesAdminNegativeTestJSON-1320006350-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:13.534012 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-0e15bb3d-677c-42c9-8fb1-c56633549bc5 tempest-ServicesAdminNegativeTestJSON-1320006350 tempest-ServicesAdminNegativeTestJSON-1320006350-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:13.534562 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-0e15bb3d-677c-42c9-8fb1-c56633549bc5 tempest-ServicesAdminNegativeTestJSON-1320006350 tempest-ServicesAdminNegativeTestJSON-1320006350-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:13.536001 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-0e15bb3d-677c-42c9-8fb1-c56633549bc5 tempest-ServicesAdminNegativeTestJSON-1320006350 tempest-ServicesAdminNegativeTestJSON-1320006350-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:13.536497 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-0e15bb3d-677c-42c9-8fb1-c56633549bc5 tempest-ServicesAdminNegativeTestJSON-1320006350 tempest-ServicesAdminNegativeTestJSON-1320006350-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:13.536931 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-0e15bb3d-677c-42c9-8fb1-c56633549bc5 tempest-ServicesAdminNegativeTestJSON-1320006350 tempest-ServicesAdminNegativeTestJSON-1320006350-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:13.565966 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-0e15bb3d-677c-42c9-8fb1-c56633549bc5 tempest-ServicesAdminNegativeTestJSON-1320006350 tempest-ServicesAdminNegativeTestJSON-1320006350-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.042478 Aug 10 17:53:13.567589 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 533/1044] 10.222.0.50 () {58 vars in 1170 bytes} [Wed Aug 10 17:53:13 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 944 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:53:13.578031 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-6ce48d57-4c24-4ade-92ac-ac8bd3d3fec7 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:13.579511 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-6ce48d57-4c24-4ade-92ac-ac8bd3d3fec7 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] [instance: bee3148a-3834-41bd-99e7-b5da75217256] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:13.586316 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-6ce48d57-4c24-4ade-92ac-ac8bd3d3fec7 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:13.586961 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-6ce48d57-4c24-4ade-92ac-ac8bd3d3fec7 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:13.587617 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-6ce48d57-4c24-4ade-92ac-ac8bd3d3fec7 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:13.588489 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-6ce48d57-4c24-4ade-92ac-ac8bd3d3fec7 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:13.589144 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-6ce48d57-4c24-4ade-92ac-ac8bd3d3fec7 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:13.590286 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-6ce48d57-4c24-4ade-92ac-ac8bd3d3fec7 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:13.743180 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-33c94695-e173-4182-a6fb-939e68fa99f2 tempest-LiveMigrationNegativeTest-2143065160 tempest-LiveMigrationNegativeTest-2143065160-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-1438745285", "block_migration": true, "disk_over_commit": false}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:53:13.747541 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-33c94695-e173-4182-a6fb-939e68fa99f2 tempest-LiveMigrationNegativeTest-2143065160 tempest-LiveMigrationNegativeTest-2143065160-project-admin] [instance: 2c8728f2-55fb-4306-acc5-227ba55ec278] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:13.756634 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-33c94695-e173-4182-a6fb-939e68fa99f2 tempest-LiveMigrationNegativeTest-2143065160 tempest-LiveMigrationNegativeTest-2143065160-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:13.757487 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-33c94695-e173-4182-a6fb-939e68fa99f2 tempest-LiveMigrationNegativeTest-2143065160 tempest-LiveMigrationNegativeTest-2143065160-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:13.758368 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-33c94695-e173-4182-a6fb-939e68fa99f2 tempest-LiveMigrationNegativeTest-2143065160 tempest-LiveMigrationNegativeTest-2143065160-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:13.759708 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-33c94695-e173-4182-a6fb-939e68fa99f2 tempest-LiveMigrationNegativeTest-2143065160 tempest-LiveMigrationNegativeTest-2143065160-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:13.762370 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-33c94695-e173-4182-a6fb-939e68fa99f2 tempest-LiveMigrationNegativeTest-2143065160 tempest-LiveMigrationNegativeTest-2143065160-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:13.763080 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-33c94695-e173-4182-a6fb-939e68fa99f2 tempest-LiveMigrationNegativeTest-2143065160 tempest-LiveMigrationNegativeTest-2143065160-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:13.852850 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-6ce48d57-4c24-4ade-92ac-ac8bd3d3fec7 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2fd6acf18d4218ad143ccee2d0bb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7c2481a908406fa9c4562513fff665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:13.867357 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-6ce48d57-4c24-4ade-92ac-ac8bd3d3fec7 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] 10.222.0.50 "GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256" status: 200 len: 1471 microversion: 2.1 time: 0.294253 Aug 10 17:53:13.867586 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [None req-33c94695-e173-4182-a6fb-939e68fa99f2 tempest-LiveMigrationNegativeTest-2143065160 tempest-LiveMigrationNegativeTest-2143065160-project-admin] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-10e9ff7b-4179-4845-8eb6-15239059340d) Aug 10 17:53:13.867586 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:53:13.867586 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:53:13.867586 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:53:13.867586 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:53:13.867586 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:53:13.867586 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:53:13.867586 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:53:13.867586 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:53:13.867586 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:53:13.867586 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 10 17:53:13.867586 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Aug 10 17:53:13.867586 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Aug 10 17:53:13.867586 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 368, in inner Aug 10 17:53:13.867586 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi if self.network_api.instance_has_extended_resource_request( Aug 10 17:53:13.867586 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1035, in instance_has_extended_resource_request Aug 10 17:53:13.867586 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi if not self.has_extended_resource_request_extension(admin_context): Aug 10 17:53:13.867586 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 17:53:13.867586 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 17:53:13.867586 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 17:53:13.867586 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 17:53:13.867586 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 17:53:13.867586 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 17:53:13.867586 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:53:13.867586 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:53:13.867586 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 17:53:13.867586 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 17:53:13.867586 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:53:13.867586 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:53:13.867586 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:53:13.867586 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:53:13.867586 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:53:13.867586 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:53:13.867586 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:53:13.867586 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:53:13.867586 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:53:13.867586 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:53:13.867586 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 17:53:13.867586 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 17:53:13.867586 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 17:53:13.867586 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 17:53:13.867586 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 17:53:13.867586 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 17:53:13.867586 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 17:53:13.867586 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 17:53:13.867586 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 17:53:13.867586 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 17:53:13.867586 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 17:53:13.867586 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 17:53:13.867586 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 17:53:13.867586 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 17:53:13.871981 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 17:53:13.871981 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 17:53:13.871981 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 17:53:13.871981 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 17:53:13.871981 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 17:53:13.871981 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 17:53:13.871981 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 17:53:13.871981 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 17:53:13.871981 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 17:53:13.871981 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 17:53:13.871981 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 17:53:13.871981 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 17:53:13.871981 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-10e9ff7b-4179-4845-8eb6-15239059340d) Aug 10 17:53:13.871981 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:53:13.871981 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-33c94695-e173-4182-a6fb-939e68fa99f2 tempest-LiveMigrationNegativeTest-2143065160 tempest-LiveMigrationNegativeTest-2143065160-project-admin] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:53:13.871981 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:53:13.871981 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-33c94695-e173-4182-a6fb-939e68fa99f2 tempest-LiveMigrationNegativeTest-2143065160 tempest-LiveMigrationNegativeTest-2143065160-project-admin] Request method failure captured: Aug 10 17:53:13.871981 n-d-852296-2 devstack@n-api.service[129409]: request: POST /compute/v2.1/servers/2c8728f2-55fb-4306-acc5-227ba55ec278/action HTTP/1.1 Aug 10 17:53:13.871981 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 17:53:13.871981 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 17:53:13.871981 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 17:53:13.871981 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 107 Aug 10 17:53:13.871981 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 17:53:13.871981 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 17:53:13.871981 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 17:53:13.871981 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 17:53:13.871981 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8_B0Q8-09Hwlfuybk-MNSgqBUgaqU0bCElMZ60k8mp7AMIIUVvno9spRXefYJvXE0__upoYexOwkTwUq3WFp7v3SM7fRjc8eSU4HcSFIz4TNBIAhmgXYhxVjC_QC3umF3Y9XcdMfbJvgifhs3GPSbXwkVwUr7MPv4adm1Cp85mTgGjw Aug 10 17:53:13.871981 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 17:53:13.871981 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 17:53:13.871981 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 17:53:13.871981 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 17:53:13.871981 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 17:53:13.871981 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 17:53:13.871981 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: f42088ae2e2c42b3bedf8280efde9912 Aug 10 17:53:13.871981 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-LiveMigrationNegativeTest-2143065160 Aug 10 17:53:13.871981 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member,admin Aug 10 17:53:13.871981 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member,admin Aug 10 17:53:13.871981 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f42088ae2e2c42b3bedf8280efde9912"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f42088ae2e2c42b3bedf8280efde9912"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f42088ae2e2c42b3bedf8280efde9912"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f42088ae2e2c42b3bedf8280efde9912", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:53:13.871981 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-LiveMigrationNegativeTest-2143065160 Aug 10 17:53:13.871981 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: f42088ae2e2c42b3bedf8280efde9912 Aug 10 17:53:13.871981 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-2143065160 Aug 10 17:53:13.871981 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-LiveMigrationNegativeTest-2143065160-project-admin Aug 10 17:53:13.871981 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 17:53:13.871981 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 17:53:13.871981 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: 9448e6b6b3874ee3bfe34180943f4809 Aug 10 17:53:13.871981 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-LiveMigrationNegativeTest-2143065160-project-admin Aug 10 17:53:13.871981 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:53:13.871981 n-d-852296-2 devstack@n-api.service[129409]: {"os-migrateLive": {"host": "tempest-host-1438745285", "block_migration": true, "disk_over_commit": false}} Aug 10 17:53:13.871981 n-d-852296-2 devstack@n-api.service[129409]: method: > Aug 10 17:53:13.871981 n-d-852296-2 devstack@n-api.service[129409]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:53:13.871981 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:53:13.871981 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'id': '2c8728f2-55fb-4306-acc5-227ba55ec278', 'body': {'os-migrateLive': {'host': 'tempest-host-1438745285', 'block_migration': True, 'disk_over_commit': False}}} Aug 10 17:53:13.871981 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:53:13.871981 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:53:13.871981 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:53:13.871981 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:53:13.881006 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:53:13.881006 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:53:13.881006 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:53:13.881006 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:53:13.881006 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:53:13.881006 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:53:13.881006 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 10 17:53:13.881006 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Aug 10 17:53:13.881006 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Aug 10 17:53:13.881006 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 368, in inner Aug 10 17:53:13.881006 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi if self.network_api.instance_has_extended_resource_request( Aug 10 17:53:13.881006 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1035, in instance_has_extended_resource_request Aug 10 17:53:13.881006 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi if not self.has_extended_resource_request_extension(admin_context): Aug 10 17:53:13.881006 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 17:53:13.881006 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 17:53:13.881006 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 17:53:13.881006 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 17:53:13.881006 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 17:53:13.881006 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 17:53:13.881006 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:53:13.881006 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:53:13.881006 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 17:53:13.881006 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 17:53:13.881006 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:53:13.881006 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:53:13.881006 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:53:13.881006 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:53:13.881006 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:53:13.881006 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:53:13.881006 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:53:13.881006 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:53:13.881006 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:53:13.881006 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:53:13.881006 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 17:53:13.881006 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 17:53:13.881006 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 17:53:13.881006 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 17:53:13.881006 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 17:53:13.881006 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 17:53:13.881006 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 17:53:13.881006 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 17:53:13.881006 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 17:53:13.881006 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 17:53:13.881006 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 17:53:13.881006 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 17:53:13.881006 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 17:53:13.881006 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 17:53:13.881006 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 17:53:13.881006 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 17:53:13.881006 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 17:53:13.881006 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 17:53:13.881006 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 17:53:13.881006 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 17:53:13.881006 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 17:53:13.885503 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 17:53:13.885503 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 17:53:13.885503 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 17:53:13.885503 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 17:53:13.885503 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 17:53:13.885503 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-10e9ff7b-4179-4845-8eb6-15239059340d) Aug 10 17:53:13.885503 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:53:13.885503 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:53:13.885503 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:53:13.885503 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:53:13.885503 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:53:13.885503 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:53:13.885503 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:53:13.885503 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:53:13.885503 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 10 17:53:13.885503 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 10 17:53:13.885503 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:53:13.885503 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:53:13.885503 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:53:13.885503 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:53:13.885503 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:53:13.885503 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:53:13.885503 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:53:13.885503 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:53:13.885503 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:53:13.885503 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:53:13.885503 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:53:13.885503 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:53:13.885503 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:53:13.885503 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-33c94695-e173-4182-a6fb-939e68fa99f2 tempest-LiveMigrationNegativeTest-2143065160 tempest-LiveMigrationNegativeTest-2143065160-project-admin] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:53:13.885503 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:53:13.891014 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 534/1045] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:13 2022] GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256 => generated 1471 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:53:13.891115 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-33c94695-e173-4182-a6fb-939e68fa99f2 tempest-LiveMigrationNegativeTest-2143065160 tempest-LiveMigrationNegativeTest-2143065160-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/2c8728f2-55fb-4306-acc5-227ba55ec278/action" status: 500 len: 214 microversion: 2.1 time: 0.522787 Aug 10 17:53:13.891115 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 512/1046] 10.222.0.50 () {60 vars in 1279 bytes} [Wed Aug 10 17:53:13 2022] POST /compute/v2.1/servers/2c8728f2-55fb-4306-acc5-227ba55ec278/action => generated 214 bytes in 524 msecs (HTTP/1.1 500) 9 headers in 391 bytes (2 switches on core 0) Aug 10 17:53:13.891293 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-0a00fccb-6047-4c24-a2a9-8f3d22c16821 tempest-ServicesAdminNegativeTestJSON-1320006350 tempest-ServicesAdminNegativeTestJSON-1320006350-project-admin] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:13.891384 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-7fd678c3-0901-4057-b1ec-fd6b06560bfb tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:13.891384 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-7fd678c3-0901-4057-b1ec-fd6b06560bfb tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] [instance: e2777988-0bbf-496c-9c97-b206dbc94a62] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:13.891559 n-d-852296-2 devstack@n-api.service[129410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:53:13.891559 n-d-852296-2 devstack@n-api.service[129410]: warnings.warn(msg) Aug 10 17:53:13.891559 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-0a00fccb-6047-4c24-a2a9-8f3d22c16821 tempest-ServicesAdminNegativeTestJSON-1320006350 tempest-ServicesAdminNegativeTestJSON-1320006350-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:13.891799 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7fd678c3-0901-4057-b1ec-fd6b06560bfb tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:13.891799 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7fd678c3-0901-4057-b1ec-fd6b06560bfb tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:13.891799 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7fd678c3-0901-4057-b1ec-fd6b06560bfb tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:13.892038 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-0a00fccb-6047-4c24-a2a9-8f3d22c16821 tempest-ServicesAdminNegativeTestJSON-1320006350 tempest-ServicesAdminNegativeTestJSON-1320006350-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:13.892038 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-0a00fccb-6047-4c24-a2a9-8f3d22c16821 tempest-ServicesAdminNegativeTestJSON-1320006350 tempest-ServicesAdminNegativeTestJSON-1320006350-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:13.892038 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-0a00fccb-6047-4c24-a2a9-8f3d22c16821 tempest-ServicesAdminNegativeTestJSON-1320006350 tempest-ServicesAdminNegativeTestJSON-1320006350-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:13.892038 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-0a00fccb-6047-4c24-a2a9-8f3d22c16821 tempest-ServicesAdminNegativeTestJSON-1320006350 tempest-ServicesAdminNegativeTestJSON-1320006350-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:13.892038 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-0a00fccb-6047-4c24-a2a9-8f3d22c16821 tempest-ServicesAdminNegativeTestJSON-1320006350 tempest-ServicesAdminNegativeTestJSON-1320006350-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:13.917480 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7fd678c3-0901-4057-b1ec-fd6b06560bfb tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:13.917480 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7fd678c3-0901-4057-b1ec-fd6b06560bfb tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:13.917480 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7fd678c3-0901-4057-b1ec-fd6b06560bfb tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:13.969182 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-0a00fccb-6047-4c24-a2a9-8f3d22c16821 tempest-ServicesAdminNegativeTestJSON-1320006350 tempest-ServicesAdminNegativeTestJSON-1320006350-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.095657 Aug 10 17:53:13.970377 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 535/1047] 10.222.0.50 () {58 vars in 1137 bytes} [Wed Aug 10 17:53:13 2022] GET /compute/v2.1/os-services => generated 944 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:53:13.976596 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-d11e337b-934e-4bc9-ac5c-27845f2f59bb tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:13.986158 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-d11e337b-934e-4bc9-ac5c-27845f2f59bb tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: d4920fe1-a755-43f8-aa8f-b38c20f8c98a] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:13.986158 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d11e337b-934e-4bc9-ac5c-27845f2f59bb tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:13.986158 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d11e337b-934e-4bc9-ac5c-27845f2f59bb tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:13.986158 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d11e337b-934e-4bc9-ac5c-27845f2f59bb tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:13.987694 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d11e337b-934e-4bc9-ac5c-27845f2f59bb tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:13.988377 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d11e337b-934e-4bc9-ac5c-27845f2f59bb tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:13.989297 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d11e337b-934e-4bc9-ac5c-27845f2f59bb tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:14.047770 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.objects.instance [None req-7fd678c3-0901-4057-b1ec-fd6b06560bfb tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lazy-loading 'services' on Instance uuid e2777988-0bbf-496c-9c97-b206dbc94a62 {{(pid=129409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:53:14.080438 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-7fd678c3-0901-4057-b1ec-fd6b06560bfb tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62" status: 200 len: 1925 microversion: 2.75 time: 0.205656 Aug 10 17:53:14.096098 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 513/1048] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:53:13 2022] GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62 => generated 1925 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:53:14.108262 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-7c071848-9ff5-4fcd-86b2-12f06d2c3844 tempest-ServicesAdminNegativeTestJSON-1320006350 tempest-ServicesAdminNegativeTestJSON-1320006350-project-admin] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:14.108262 n-d-852296-2 devstack@n-api.service[129409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:53:14.108262 n-d-852296-2 devstack@n-api.service[129409]: warnings.warn(msg) Aug 10 17:53:14.108262 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7c071848-9ff5-4fcd-86b2-12f06d2c3844 tempest-ServicesAdminNegativeTestJSON-1320006350 tempest-ServicesAdminNegativeTestJSON-1320006350-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:14.108262 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7c071848-9ff5-4fcd-86b2-12f06d2c3844 tempest-ServicesAdminNegativeTestJSON-1320006350 tempest-ServicesAdminNegativeTestJSON-1320006350-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:14.108262 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7c071848-9ff5-4fcd-86b2-12f06d2c3844 tempest-ServicesAdminNegativeTestJSON-1320006350 tempest-ServicesAdminNegativeTestJSON-1320006350-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:14.108262 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7c071848-9ff5-4fcd-86b2-12f06d2c3844 tempest-ServicesAdminNegativeTestJSON-1320006350 tempest-ServicesAdminNegativeTestJSON-1320006350-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:14.108895 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7c071848-9ff5-4fcd-86b2-12f06d2c3844 tempest-ServicesAdminNegativeTestJSON-1320006350 tempest-ServicesAdminNegativeTestJSON-1320006350-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:14.108895 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7c071848-9ff5-4fcd-86b2-12f06d2c3844 tempest-ServicesAdminNegativeTestJSON-1320006350 tempest-ServicesAdminNegativeTestJSON-1320006350-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:14.132763 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-7c071848-9ff5-4fcd-86b2-12f06d2c3844 tempest-ServicesAdminNegativeTestJSON-1320006350 tempest-ServicesAdminNegativeTestJSON-1320006350-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services?host=n-d-852296-2&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.034998 Aug 10 17:53:14.133368 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 514/1049] 10.222.0.50 () {58 vars in 1194 bytes} [Wed Aug 10 17:53:14 2022] GET /compute/v2.1/os-services?host=n-d-852296-2&binary=xxx => generated 16 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 17:53:14.138298 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-fb68599e-479a-4c30-9461-500503935e84 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-799340899", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452"}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:53:14.153673 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-d11e337b-934e-4bc9-ac5c-27845f2f59bb tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:14.161514 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-d11e337b-934e-4bc9-ac5c-27845f2f59bb tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/d4920fe1-a755-43f8-aa8f-b38c20f8c98a" status: 200 len: 1317 microversion: 2.1 time: 0.189847 Aug 10 17:53:14.162089 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 536/1050] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:13 2022] GET /compute/v2.1/servers/d4920fe1-a755-43f8-aa8f-b38c20f8c98a => generated 1317 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:53:14.166305 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-33f80ac2-a5cd-4cd5-b6e9-313a960adff8 tempest-ServicesAdminNegativeTestJSON-1320006350 tempest-ServicesAdminNegativeTestJSON-1320006350-project-admin] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:14.169853 n-d-852296-2 devstack@n-api.service[129410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:53:14.169853 n-d-852296-2 devstack@n-api.service[129410]: warnings.warn(msg) Aug 10 17:53:14.170970 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-33f80ac2-a5cd-4cd5-b6e9-313a960adff8 tempest-ServicesAdminNegativeTestJSON-1320006350 tempest-ServicesAdminNegativeTestJSON-1320006350-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:14.171450 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-33f80ac2-a5cd-4cd5-b6e9-313a960adff8 tempest-ServicesAdminNegativeTestJSON-1320006350 tempest-ServicesAdminNegativeTestJSON-1320006350-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:14.171882 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-33f80ac2-a5cd-4cd5-b6e9-313a960adff8 tempest-ServicesAdminNegativeTestJSON-1320006350 tempest-ServicesAdminNegativeTestJSON-1320006350-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:14.172962 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-33f80ac2-a5cd-4cd5-b6e9-313a960adff8 tempest-ServicesAdminNegativeTestJSON-1320006350 tempest-ServicesAdminNegativeTestJSON-1320006350-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:14.173749 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-33f80ac2-a5cd-4cd5-b6e9-313a960adff8 tempest-ServicesAdminNegativeTestJSON-1320006350 tempest-ServicesAdminNegativeTestJSON-1320006350-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:14.174356 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-33f80ac2-a5cd-4cd5-b6e9-313a960adff8 tempest-ServicesAdminNegativeTestJSON-1320006350 tempest-ServicesAdminNegativeTestJSON-1320006350-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:14.192189 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.network.neutron [None req-fb68599e-479a-4c30-9461-500503935e84 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] validate_networks() for None {{(pid=129409) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 17:53:14.200370 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-33f80ac2-a5cd-4cd5-b6e9-313a960adff8 tempest-ServicesAdminNegativeTestJSON-1320006350 tempest-ServicesAdminNegativeTestJSON-1320006350-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.037244 Aug 10 17:53:14.201313 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 537/1051] 10.222.0.50 () {58 vars in 1137 bytes} [Wed Aug 10 17:53:14 2022] GET /compute/v2.1/os-services => generated 944 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:53:14.212633 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-fed13614-fbba-4bea-919d-2da1c58f889d tempest-ServicesAdminNegativeTestJSON-1320006350 tempest-ServicesAdminNegativeTestJSON-1320006350-project-admin] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:14.232658 n-d-852296-2 devstack@n-api.service[129410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:53:14.232658 n-d-852296-2 devstack@n-api.service[129410]: warnings.warn(msg) Aug 10 17:53:14.232658 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-fed13614-fbba-4bea-919d-2da1c58f889d tempest-ServicesAdminNegativeTestJSON-1320006350 tempest-ServicesAdminNegativeTestJSON-1320006350-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:14.232658 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-fed13614-fbba-4bea-919d-2da1c58f889d tempest-ServicesAdminNegativeTestJSON-1320006350 tempest-ServicesAdminNegativeTestJSON-1320006350-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:14.233280 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-fed13614-fbba-4bea-919d-2da1c58f889d tempest-ServicesAdminNegativeTestJSON-1320006350 tempest-ServicesAdminNegativeTestJSON-1320006350-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:14.234044 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-fed13614-fbba-4bea-919d-2da1c58f889d tempest-ServicesAdminNegativeTestJSON-1320006350 tempest-ServicesAdminNegativeTestJSON-1320006350-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:14.234506 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-fed13614-fbba-4bea-919d-2da1c58f889d tempest-ServicesAdminNegativeTestJSON-1320006350 tempest-ServicesAdminNegativeTestJSON-1320006350-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:14.235059 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-fed13614-fbba-4bea-919d-2da1c58f889d tempest-ServicesAdminNegativeTestJSON-1320006350 tempest-ServicesAdminNegativeTestJSON-1320006350-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:14.263657 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-fed13614-fbba-4bea-919d-2da1c58f889d tempest-ServicesAdminNegativeTestJSON-1320006350 tempest-ServicesAdminNegativeTestJSON-1320006350-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.053832 Aug 10 17:53:14.271458 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 538/1052] 10.222.0.50 () {58 vars in 1198 bytes} [Wed Aug 10 17:53:14 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 10 17:53:14.516643 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.virt.hardware [None req-fb68599e-479a-4c30-9461-500503935e84 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Flavor limits 0:0:0 {{(pid=129409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 17:53:14.517065 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.virt.hardware [None req-fb68599e-479a-4c30-9461-500503935e84 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Image limits 0:0:0 {{(pid=129409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 17:53:14.517433 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.virt.hardware [None req-fb68599e-479a-4c30-9461-500503935e84 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Flavor pref 0:0:0 {{(pid=129409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 17:53:14.518132 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.virt.hardware [None req-fb68599e-479a-4c30-9461-500503935e84 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Image pref 0:0:0 {{(pid=129409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 17:53:14.518552 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.virt.hardware [None req-fb68599e-479a-4c30-9461-500503935e84 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 17:53:14.528720 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-fb68599e-479a-4c30-9461-500503935e84 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:14.529221 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-fb68599e-479a-4c30-9461-500503935e84 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:14.529868 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-fb68599e-479a-4c30-9461-500503935e84 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:14.530795 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-fb68599e-479a-4c30-9461-500503935e84 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:14.531244 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-fb68599e-479a-4c30-9461-500503935e84 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:14.531674 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-fb68599e-479a-4c30-9461-500503935e84 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:14.551207 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-fb68599e-479a-4c30-9461-500503935e84 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Getting quotas for project 8e1c7c8eeb1b4065b25fe28eba30d0eb. Resources: {'instances', 'ram', 'cores'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:53:14.556166 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-fb68599e-479a-4c30-9461-500503935e84 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Getting quotas for user 5f082ed04bc143679029c204e8a97160 and project 8e1c7c8eeb1b4065b25fe28eba30d0eb. Resources: {'instances', 'ram', 'cores'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:53:14.569400 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-fb68599e-479a-4c30-9461-500503935e84 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Going to run 1 instances... {{(pid=129409) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 17:53:14.571693 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-fb68599e-479a-4c30-9461-500503935e84 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] [instance: 4390cd8e-2484-4205-9678-fb7332d1c78d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a735ff26-463a-4ffe-a981-ab9d9baa494f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 17:53:14.603965 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-347756a1-ce0b-40a3-8d4b-7c5255139e8f tempest-ServicesAdminNegativeTestJSON-841962417 tempest-ServicesAdminNegativeTestJSON-841962417-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:14.607572 n-d-852296-2 devstack@n-api.service[129410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:53:14.607572 n-d-852296-2 devstack@n-api.service[129410]: warnings.warn(msg) Aug 10 17:53:14.608137 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-347756a1-ce0b-40a3-8d4b-7c5255139e8f tempest-ServicesAdminNegativeTestJSON-841962417 tempest-ServicesAdminNegativeTestJSON-841962417-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '0cb86f61adcf4cddb8b473045e5ec436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee34a806dabb4594880b9975eb2c17ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:14.610764 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-347756a1-ce0b-40a3-8d4b-7c5255139e8f tempest-ServicesAdminNegativeTestJSON-841962417 tempest-ServicesAdminNegativeTestJSON-841962417-project] Request method failure captured: Aug 10 17:53:14.610764 n-d-852296-2 devstack@n-api.service[129410]: request: GET /compute/v2.1/os-services HTTP/1.1 Aug 10 17:53:14.610764 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 17:53:14.610764 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 17:53:14.610764 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 17:53:14.610764 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 0 Aug 10 17:53:14.610764 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 17:53:14.610764 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 17:53:14.610764 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 17:53:14.610764 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 17:53:14.610764 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8_CHRMOZLtzFnKx665Q_22LUdEGPDNGPqOw7tU9LdloZ-yiUpTKmZ25kuKEcGKrtD11lu7Yqx8KETQjpqWNPdVWOsWtw0YiSAk5MamTsb0rLkwDjGHHR1W0ocAzgYCaqg5cMr0jJuh7b7wsWrC7ZpvK20HKhTAGAEsGihhpw_ff_fpk Aug 10 17:53:14.610764 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 17:53:14.610764 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 17:53:14.610764 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 17:53:14.610764 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 17:53:14.610764 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 17:53:14.610764 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 17:53:14.610764 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: ee34a806dabb4594880b9975eb2c17ff Aug 10 17:53:14.610764 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-841962417 Aug 10 17:53:14.610764 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 17:53:14.610764 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 17:53:14.610764 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ee34a806dabb4594880b9975eb2c17ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/ee34a806dabb4594880b9975eb2c17ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ee34a806dabb4594880b9975eb2c17ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_ee34a806dabb4594880b9975eb2c17ff", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:53:14.610764 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-841962417 Aug 10 17:53:14.610764 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: ee34a806dabb4594880b9975eb2c17ff Aug 10 17:53:14.610764 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-841962417 Aug 10 17:53:14.610764 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-ServicesAdminNegativeTestJSON-841962417-project Aug 10 17:53:14.610764 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 17:53:14.610764 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 17:53:14.610764 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: 0cb86f61adcf4cddb8b473045e5ec436 Aug 10 17:53:14.610764 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-841962417-project Aug 10 17:53:14.610764 n-d-852296-2 devstack@n-api.service[129410]: method: > Aug 10 17:53:14.610764 n-d-852296-2 devstack@n-api.service[129410]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 10 17:53:14.610764 n-d-852296-2 devstack@n-api.service[129410]: action_args: {} Aug 10 17:53:14.610764 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:53:14.610764 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:53:14.610764 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:53:14.610764 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:53:14.610764 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:53:14.610764 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:53:14.610764 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 10 17:53:14.610764 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:53:14.610764 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 10 17:53:14.610764 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:53:14.610764 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:53:14.610764 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:53:14.610764 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 387, in index Aug 10 17:53:14.610764 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Aug 10 17:53:14.610764 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 10 17:53:14.610764 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 10 17:53:14.610764 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 10 17:53:14.610764 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 10 17:53:14.610764 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 10 17:53:14.610764 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 10 17:53:14.610764 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 10 17:53:14.610764 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise self.value Aug 10 17:53:14.610764 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 10 17:53:14.610764 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 10 17:53:14.610764 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 10 17:53:14.610764 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 10 17:53:14.610764 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 10 17:53:14.610764 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 10 17:53:14.610764 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 10 17:53:14.610764 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:53:14.615600 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:53:14.615600 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:53:14.615600 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:53:14.615600 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:53:14.615600 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:53:14.615600 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 10 17:53:14.615600 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 10 17:53:14.615600 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 10 17:53:14.615600 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:53:14.617086 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-347756a1-ce0b-40a3-8d4b-7c5255139e8f tempest-ServicesAdminNegativeTestJSON-841962417 tempest-ServicesAdminNegativeTestJSON-841962417-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:53:14.617928 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-347756a1-ce0b-40a3-8d4b-7c5255139e8f tempest-ServicesAdminNegativeTestJSON-841962417 tempest-ServicesAdminNegativeTestJSON-841962417-project] 10.222.0.50 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.345438 Aug 10 17:53:14.622417 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 539/1053] 10.222.0.50 () {58 vars in 1137 bytes} [Wed Aug 10 17:53:14 2022] GET /compute/v2.1/os-services => generated 112 bytes in 350 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:53:14.960634 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-fb68599e-479a-4c30-9461-500503935e84 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.826168 Aug 10 17:53:14.961282 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 515/1054] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 17:53:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 827 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 17:53:14.972434 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-b00326b9-1fe3-4f31-a6f5-02fb74e199a2 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:14.973039 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-b00326b9-1fe3-4f31-a6f5-02fb74e199a2 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] [instance: bee3148a-3834-41bd-99e7-b5da75217256] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:14.986362 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-b00326b9-1fe3-4f31-a6f5-02fb74e199a2 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:14.986744 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-b00326b9-1fe3-4f31-a6f5-02fb74e199a2 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:14.987190 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-b00326b9-1fe3-4f31-a6f5-02fb74e199a2 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:14.987907 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-b00326b9-1fe3-4f31-a6f5-02fb74e199a2 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:14.988398 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-b00326b9-1fe3-4f31-a6f5-02fb74e199a2 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:14.988831 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-b00326b9-1fe3-4f31-a6f5-02fb74e199a2 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:15.181853 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-b00326b9-1fe3-4f31-a6f5-02fb74e199a2 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2fd6acf18d4218ad143ccee2d0bb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7c2481a908406fa9c4562513fff665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:15.192354 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-b00326b9-1fe3-4f31-a6f5-02fb74e199a2 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] 10.222.0.50 "GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256" status: 200 len: 1471 microversion: 2.1 time: 0.223731 Aug 10 17:53:15.195599 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 516/1055] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:14 2022] GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256 => generated 1471 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:53:15.203414 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-56b32d47-7979-4288-a43a-7c50f328f09c tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:15.204182 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-56b32d47-7979-4288-a43a-7c50f328f09c tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] [instance: 4390cd8e-2484-4205-9678-fb7332d1c78d] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:15.219030 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-2cb1fb07-29b7-4110-97fb-fe44947df171 tempest-QuotasAdminTestJSON-1220511093 tempest-QuotasAdminTestJSON-1220511093-project-admin] Calling method '.version_select at 0x7fb345c14d30>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:15.303766 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-56b32d47-7979-4288-a43a-7c50f328f09c tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f082ed04bc143679029c204e8a97160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c7c8eeb1b4065b25fe28eba30d0eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:15.316408 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-56b32d47-7979-4288-a43a-7c50f328f09c tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] 10.222.0.50 "GET /compute/v2.1/servers/4390cd8e-2484-4205-9678-fb7332d1c78d" status: 200 len: 1218 microversion: 2.1 time: 0.117942 Aug 10 17:53:15.318218 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 517/1056] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:15 2022] GET /compute/v2.1/servers/4390cd8e-2484-4205-9678-fb7332d1c78d => generated 1218 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:53:15.329019 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-bb34814c-850c-4122-9f68-c040e1bc43e9 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:15.330142 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-bb34814c-850c-4122-9f68-c040e1bc43e9 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] [instance: e2777988-0bbf-496c-9c97-b206dbc94a62] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:15.338293 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-bb34814c-850c-4122-9f68-c040e1bc43e9 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:15.338802 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-bb34814c-850c-4122-9f68-c040e1bc43e9 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:15.339245 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-bb34814c-850c-4122-9f68-c040e1bc43e9 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:15.340702 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-bb34814c-850c-4122-9f68-c040e1bc43e9 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:15.341508 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-bb34814c-850c-4122-9f68-c040e1bc43e9 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:15.342136 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-bb34814c-850c-4122-9f68-c040e1bc43e9 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:15.427445 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.objects.instance [None req-bb34814c-850c-4122-9f68-c040e1bc43e9 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lazy-loading 'services' on Instance uuid e2777988-0bbf-496c-9c97-b206dbc94a62 {{(pid=129409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:53:15.469809 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-bb34814c-850c-4122-9f68-c040e1bc43e9 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62" status: 200 len: 1925 microversion: 2.75 time: 0.149091 Aug 10 17:53:15.470791 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 518/1057] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:53:15 2022] GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62 => generated 1925 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:53:15.475833 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-5d019ed2-022b-4835-84b1-a781ab2486e6 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:15.476415 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-5d019ed2-022b-4835-84b1-a781ab2486e6 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: d4920fe1-a755-43f8-aa8f-b38c20f8c98a] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:15.492687 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-5d019ed2-022b-4835-84b1-a781ab2486e6 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:15.493294 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-5d019ed2-022b-4835-84b1-a781ab2486e6 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:15.493740 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-5d019ed2-022b-4835-84b1-a781ab2486e6 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:15.494642 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-5d019ed2-022b-4835-84b1-a781ab2486e6 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:15.495347 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-5d019ed2-022b-4835-84b1-a781ab2486e6 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:15.496130 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-5d019ed2-022b-4835-84b1-a781ab2486e6 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:15.643113 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-2cb1fb07-29b7-4110-97fb-fe44947df171 tempest-QuotasAdminTestJSON-1220511093 tempest-QuotasAdminTestJSON-1220511093-project-admin] 10.222.0.50 "GET /compute/v2.1/os-quota-sets/82b282fd8da5460196c767f0bb6053b4" status: 200 len: 371 microversion: 2.1 time: 1.019578 Aug 10 17:53:15.643706 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 540/1058] 10.222.0.50 () {58 vars in 1242 bytes} [Wed Aug 10 17:53:14 2022] GET /compute/v2.1/os-quota-sets/82b282fd8da5460196c767f0bb6053b4 => generated 371 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:53:15.662610 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-596e1cc0-ac53-47b3-884f-585c82458618 tempest-QuotasAdminTestJSON-1220511093 tempest-QuotasAdminTestJSON-1220511093-project-admin] Action: 'update', calling method: .version_select at 0x7fb345e07b80>, body: {"quota_set": {"ram": "5120"}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:53:15.832026 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-5d019ed2-022b-4835-84b1-a781ab2486e6 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:15.843616 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-5d019ed2-022b-4835-84b1-a781ab2486e6 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/d4920fe1-a755-43f8-aa8f-b38c20f8c98a" status: 200 len: 1317 microversion: 2.1 time: 0.367876 Aug 10 17:53:15.843616 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 519/1059] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:15 2022] GET /compute/v2.1/servers/d4920fe1-a755-43f8-aa8f-b38c20f8c98a => generated 1317 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:53:15.933693 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-596e1cc0-ac53-47b3-884f-585c82458618 tempest-QuotasAdminTestJSON-1220511093 tempest-QuotasAdminTestJSON-1220511093-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:15.934392 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-596e1cc0-ac53-47b3-884f-585c82458618 tempest-QuotasAdminTestJSON-1220511093 tempest-QuotasAdminTestJSON-1220511093-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:15.934940 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-596e1cc0-ac53-47b3-884f-585c82458618 tempest-QuotasAdminTestJSON-1220511093 tempest-QuotasAdminTestJSON-1220511093-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:15.936084 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-596e1cc0-ac53-47b3-884f-585c82458618 tempest-QuotasAdminTestJSON-1220511093 tempest-QuotasAdminTestJSON-1220511093-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:15.937503 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-596e1cc0-ac53-47b3-884f-585c82458618 tempest-QuotasAdminTestJSON-1220511093 tempest-QuotasAdminTestJSON-1220511093-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:15.938029 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-596e1cc0-ac53-47b3-884f-585c82458618 tempest-QuotasAdminTestJSON-1220511093 tempest-QuotasAdminTestJSON-1220511093-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:16.145971 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-596e1cc0-ac53-47b3-884f-585c82458618 tempest-QuotasAdminTestJSON-1220511093 tempest-QuotasAdminTestJSON-1220511093-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-quota-sets/82b282fd8da5460196c767f0bb6053b4" status: 200 len: 328 microversion: 2.1 time: 0.487565 Aug 10 17:53:16.146925 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 541/1060] 10.222.0.50 () {60 vars in 1262 bytes} [Wed Aug 10 17:53:15 2022] PUT /compute/v2.1/os-quota-sets/82b282fd8da5460196c767f0bb6053b4 => generated 328 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:53:16.157785 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-eeb51d99-261d-4bba-a4da-9cdf04a324e4 tempest-QuotasAdminTestJSON-1220511093 tempest-QuotasAdminTestJSON-1220511093-project-admin] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:16.215604 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-9db99796-36a8-4c16-aa6e-1b35b917b41a tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:16.216259 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-9db99796-36a8-4c16-aa6e-1b35b917b41a tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] [instance: bee3148a-3834-41bd-99e7-b5da75217256] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:16.222539 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-9db99796-36a8-4c16-aa6e-1b35b917b41a tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:16.223695 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-9db99796-36a8-4c16-aa6e-1b35b917b41a tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:16.224161 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-9db99796-36a8-4c16-aa6e-1b35b917b41a tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:16.224948 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-9db99796-36a8-4c16-aa6e-1b35b917b41a tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:16.225413 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-9db99796-36a8-4c16-aa6e-1b35b917b41a tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:16.225843 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-9db99796-36a8-4c16-aa6e-1b35b917b41a tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:16.283884 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-eeb51d99-261d-4bba-a4da-9cdf04a324e4 tempest-QuotasAdminTestJSON-1220511093 tempest-QuotasAdminTestJSON-1220511093-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-quota-sets/82b282fd8da5460196c767f0bb6053b4" status: 202 len: 0 microversion: 2.1 time: 0.129655 Aug 10 17:53:16.285164 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 520/1061] 10.222.0.50 () {58 vars in 1245 bytes} [Wed Aug 10 17:53:16 2022] DELETE /compute/v2.1/os-quota-sets/82b282fd8da5460196c767f0bb6053b4 => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 17:53:16.294115 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-a85e2f1c-20dd-4fe0-803e-99e27891ad68 tempest-QuotasAdminTestJSON-1220511093 tempest-QuotasAdminTestJSON-1220511093-project-admin] Calling method '.version_select at 0x7fb346178f70>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:16.520815 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-9db99796-36a8-4c16-aa6e-1b35b917b41a tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2fd6acf18d4218ad143ccee2d0bb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7c2481a908406fa9c4562513fff665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:16.528876 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-9db99796-36a8-4c16-aa6e-1b35b917b41a tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] 10.222.0.50 "GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256" status: 200 len: 1471 microversion: 2.1 time: 0.317813 Aug 10 17:53:16.529699 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 542/1062] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:16 2022] GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256 => generated 1471 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:53:16.548970 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-3eb2bd3d-15a6-41c9-9c18-26c2ee7392c3 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:16.550096 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-3eb2bd3d-15a6-41c9-9c18-26c2ee7392c3 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] [instance: 4390cd8e-2484-4205-9678-fb7332d1c78d] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:16.557700 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-3eb2bd3d-15a6-41c9-9c18-26c2ee7392c3 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:16.559074 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-3eb2bd3d-15a6-41c9-9c18-26c2ee7392c3 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:16.575626 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-3eb2bd3d-15a6-41c9-9c18-26c2ee7392c3 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:16.575626 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-3eb2bd3d-15a6-41c9-9c18-26c2ee7392c3 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:16.575626 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-3eb2bd3d-15a6-41c9-9c18-26c2ee7392c3 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:16.575626 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-3eb2bd3d-15a6-41c9-9c18-26c2ee7392c3 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:16.600984 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-a85e2f1c-20dd-4fe0-803e-99e27891ad68 tempest-QuotasAdminTestJSON-1220511093 tempest-QuotasAdminTestJSON-1220511093-project-admin] 10.222.0.50 "GET /compute/v2.1/os-quota-sets/82b282fd8da5460196c767f0bb6053b4" status: 200 len: 371 microversion: 2.1 time: 0.307814 Aug 10 17:53:16.603491 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 521/1063] 10.222.0.50 () {58 vars in 1242 bytes} [Wed Aug 10 17:53:16 2022] GET /compute/v2.1/os-quota-sets/82b282fd8da5460196c767f0bb6053b4 => generated 371 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:53:16.608196 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-cb346d0d-b553-460f-baa3-4218a832cf47 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:16.608831 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-cb346d0d-b553-460f-baa3-4218a832cf47 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] [instance: e2777988-0bbf-496c-9c97-b206dbc94a62] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:16.621701 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-cb346d0d-b553-460f-baa3-4218a832cf47 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:16.622207 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-cb346d0d-b553-460f-baa3-4218a832cf47 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:16.622643 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-cb346d0d-b553-460f-baa3-4218a832cf47 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:16.623503 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-cb346d0d-b553-460f-baa3-4218a832cf47 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:16.623960 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-cb346d0d-b553-460f-baa3-4218a832cf47 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:16.624494 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-cb346d0d-b553-460f-baa3-4218a832cf47 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:16.664565 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-3eb2bd3d-15a6-41c9-9c18-26c2ee7392c3 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f082ed04bc143679029c204e8a97160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c7c8eeb1b4065b25fe28eba30d0eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:16.675180 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-3eb2bd3d-15a6-41c9-9c18-26c2ee7392c3 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] 10.222.0.50 "GET /compute/v2.1/servers/4390cd8e-2484-4205-9678-fb7332d1c78d" status: 200 len: 1222 microversion: 2.1 time: 0.130052 Aug 10 17:53:16.676332 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 543/1064] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:16 2022] GET /compute/v2.1/servers/4390cd8e-2484-4205-9678-fb7332d1c78d => generated 1222 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:53:16.706112 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.objects.instance [None req-cb346d0d-b553-460f-baa3-4218a832cf47 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lazy-loading 'services' on Instance uuid e2777988-0bbf-496c-9c97-b206dbc94a62 {{(pid=129409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:53:16.734934 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-cb346d0d-b553-460f-baa3-4218a832cf47 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62" status: 200 len: 1925 microversion: 2.75 time: 0.129729 Aug 10 17:53:16.735767 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 522/1065] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:53:16 2022] GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62 => generated 1925 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:53:16.864874 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-1c62bd82-604e-462a-8be4-6af8c40b4aa2 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:16.866139 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-1c62bd82-604e-462a-8be4-6af8c40b4aa2 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: d4920fe1-a755-43f8-aa8f-b38c20f8c98a] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:16.873918 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-1c62bd82-604e-462a-8be4-6af8c40b4aa2 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:16.874641 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-1c62bd82-604e-462a-8be4-6af8c40b4aa2 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:16.875316 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-1c62bd82-604e-462a-8be4-6af8c40b4aa2 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:16.876437 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-1c62bd82-604e-462a-8be4-6af8c40b4aa2 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:16.876896 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-1c62bd82-604e-462a-8be4-6af8c40b4aa2 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:16.877360 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-1c62bd82-604e-462a-8be4-6af8c40b4aa2 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:17.397106 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-3bab8d90-8b7e-4f76-af5e-0305d46d7f3c tempest-QuotasAdminTestJSON-1220511093 tempest-QuotasAdminTestJSON-1220511093-project-admin] Calling method '.version_select at 0x7fb3465983a0>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:17.412505 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-1c62bd82-604e-462a-8be4-6af8c40b4aa2 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:17.436695 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-1c62bd82-604e-462a-8be4-6af8c40b4aa2 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/d4920fe1-a755-43f8-aa8f-b38c20f8c98a" status: 200 len: 1317 microversion: 2.1 time: 0.566077 Aug 10 17:53:17.456345 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 544/1066] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:16 2022] GET /compute/v2.1/servers/d4920fe1-a755-43f8-aa8f-b38c20f8c98a => generated 1317 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:53:17.553705 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-b37a5cfe-faf4-4d07-8b03-0f02610b2e7d tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:17.554319 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-b37a5cfe-faf4-4d07-8b03-0f02610b2e7d tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] [instance: bee3148a-3834-41bd-99e7-b5da75217256] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:17.561261 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b37a5cfe-faf4-4d07-8b03-0f02610b2e7d tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:17.561740 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b37a5cfe-faf4-4d07-8b03-0f02610b2e7d tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:17.562350 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b37a5cfe-faf4-4d07-8b03-0f02610b2e7d tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:17.563149 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b37a5cfe-faf4-4d07-8b03-0f02610b2e7d tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:17.563600 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b37a5cfe-faf4-4d07-8b03-0f02610b2e7d tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:17.564047 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b37a5cfe-faf4-4d07-8b03-0f02610b2e7d tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:17.779761 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-b37a5cfe-faf4-4d07-8b03-0f02610b2e7d tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2fd6acf18d4218ad143ccee2d0bb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7c2481a908406fa9c4562513fff665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:17.789239 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-b37a5cfe-faf4-4d07-8b03-0f02610b2e7d tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] 10.222.0.50 "GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256" status: 200 len: 1471 microversion: 2.1 time: 0.242865 Aug 10 17:53:17.802912 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 545/1067] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:17 2022] GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256 => generated 1471 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:53:17.810457 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-22bdac07-efd7-47e7-9b1d-7686524d0022 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:17.811591 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-22bdac07-efd7-47e7-9b1d-7686524d0022 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] [instance: 4390cd8e-2484-4205-9678-fb7332d1c78d] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:17.820359 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-22bdac07-efd7-47e7-9b1d-7686524d0022 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:17.821060 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-22bdac07-efd7-47e7-9b1d-7686524d0022 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:17.825422 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-22bdac07-efd7-47e7-9b1d-7686524d0022 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:17.825422 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-22bdac07-efd7-47e7-9b1d-7686524d0022 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:17.825422 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-22bdac07-efd7-47e7-9b1d-7686524d0022 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:17.825422 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-22bdac07-efd7-47e7-9b1d-7686524d0022 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:17.913965 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-22bdac07-efd7-47e7-9b1d-7686524d0022 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f082ed04bc143679029c204e8a97160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c7c8eeb1b4065b25fe28eba30d0eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:17.922770 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-22bdac07-efd7-47e7-9b1d-7686524d0022 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] 10.222.0.50 "GET /compute/v2.1/servers/4390cd8e-2484-4205-9678-fb7332d1c78d" status: 200 len: 1270 microversion: 2.1 time: 0.118507 Aug 10 17:53:17.924075 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 546/1068] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:17 2022] GET /compute/v2.1/servers/4390cd8e-2484-4205-9678-fb7332d1c78d => generated 1270 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:53:17.929941 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-cdda7f2f-811d-45b7-956b-cd44131e92a1 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:17.931457 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-cdda7f2f-811d-45b7-956b-cd44131e92a1 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] [instance: e2777988-0bbf-496c-9c97-b206dbc94a62] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:17.939909 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-cdda7f2f-811d-45b7-956b-cd44131e92a1 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:17.940736 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-cdda7f2f-811d-45b7-956b-cd44131e92a1 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:17.941390 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-cdda7f2f-811d-45b7-956b-cd44131e92a1 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:17.942332 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-cdda7f2f-811d-45b7-956b-cd44131e92a1 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:17.942994 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-cdda7f2f-811d-45b7-956b-cd44131e92a1 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:17.943624 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-cdda7f2f-811d-45b7-956b-cd44131e92a1 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:18.003432 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-3bab8d90-8b7e-4f76-af5e-0305d46d7f3c tempest-QuotasAdminTestJSON-1220511093 tempest-QuotasAdminTestJSON-1220511093-project-admin] 10.222.0.50 "GET /compute/v2.1/os-quota-sets/88d7445c0d374d3dbc1d93df283f823e/defaults" status: 200 len: 371 microversion: 2.1 time: 0.611059 Aug 10 17:53:18.013719 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 523/1069] 10.222.0.50 () {58 vars in 1269 bytes} [Wed Aug 10 17:53:17 2022] GET /compute/v2.1/os-quota-sets/88d7445c0d374d3dbc1d93df283f823e/defaults => generated 371 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:53:18.071910 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.objects.instance [None req-cdda7f2f-811d-45b7-956b-cd44131e92a1 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lazy-loading 'services' on Instance uuid e2777988-0bbf-496c-9c97-b206dbc94a62 {{(pid=129410) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:53:18.113753 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-cdda7f2f-811d-45b7-956b-cd44131e92a1 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62" status: 200 len: 1925 microversion: 2.75 time: 0.188062 Aug 10 17:53:18.114716 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 547/1070] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:53:17 2022] GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62 => generated 1925 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:53:18.468522 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-d3439b3a-95e2-454e-b735-4ca9ea642ad8 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:18.471650 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-d3439b3a-95e2-454e-b735-4ca9ea642ad8 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: d4920fe1-a755-43f8-aa8f-b38c20f8c98a] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:18.488639 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-d3439b3a-95e2-454e-b735-4ca9ea642ad8 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:18.489744 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-d3439b3a-95e2-454e-b735-4ca9ea642ad8 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:18.492739 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-d3439b3a-95e2-454e-b735-4ca9ea642ad8 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:18.495246 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-d3439b3a-95e2-454e-b735-4ca9ea642ad8 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:18.500421 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-d3439b3a-95e2-454e-b735-4ca9ea642ad8 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:18.501640 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-d3439b3a-95e2-454e-b735-4ca9ea642ad8 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:18.727520 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-5e601e1b-8b85-49b1-aca9-05a50f4db96f tempest-QuotasAdminTestJSON-1220511093 tempest-QuotasAdminTestJSON-1220511093-project-admin] Action: 'update', calling method: .version_select at 0x7fb345bcf4c0>, body: {"quota_set": {"ram": "5120"}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:53:18.758709 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-d3439b3a-95e2-454e-b735-4ca9ea642ad8 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:18.768651 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-d3439b3a-95e2-454e-b735-4ca9ea642ad8 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/d4920fe1-a755-43f8-aa8f-b38c20f8c98a" status: 200 len: 1317 microversion: 2.1 time: 0.309392 Aug 10 17:53:18.771764 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 524/1071] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:18 2022] GET /compute/v2.1/servers/d4920fe1-a755-43f8-aa8f-b38c20f8c98a => generated 1317 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:53:18.811311 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-87b457cd-15d9-44a5-96eb-4a18ae572820 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:18.812158 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-87b457cd-15d9-44a5-96eb-4a18ae572820 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] [instance: bee3148a-3834-41bd-99e7-b5da75217256] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:18.822762 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-87b457cd-15d9-44a5-96eb-4a18ae572820 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:18.823584 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-87b457cd-15d9-44a5-96eb-4a18ae572820 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:18.826136 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-87b457cd-15d9-44a5-96eb-4a18ae572820 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:18.827453 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-87b457cd-15d9-44a5-96eb-4a18ae572820 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:18.828717 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-87b457cd-15d9-44a5-96eb-4a18ae572820 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:18.829507 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-87b457cd-15d9-44a5-96eb-4a18ae572820 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:19.035784 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-87b457cd-15d9-44a5-96eb-4a18ae572820 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2fd6acf18d4218ad143ccee2d0bb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7c2481a908406fa9c4562513fff665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:19.044927 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-87b457cd-15d9-44a5-96eb-4a18ae572820 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] 10.222.0.50 "GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256" status: 200 len: 1471 microversion: 2.1 time: 0.237891 Aug 10 17:53:19.045914 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 525/1072] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:18 2022] GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256 => generated 1471 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:53:19.050955 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-8f19596a-06fc-46e9-a9bb-6bfe6845e29d tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:19.051980 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-8f19596a-06fc-46e9-a9bb-6bfe6845e29d tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] [instance: 4390cd8e-2484-4205-9678-fb7332d1c78d] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:19.058855 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-8f19596a-06fc-46e9-a9bb-6bfe6845e29d tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:19.059564 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-8f19596a-06fc-46e9-a9bb-6bfe6845e29d tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:19.060109 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-8f19596a-06fc-46e9-a9bb-6bfe6845e29d tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:19.060968 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-8f19596a-06fc-46e9-a9bb-6bfe6845e29d tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:19.061534 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-8f19596a-06fc-46e9-a9bb-6bfe6845e29d tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:19.062055 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-8f19596a-06fc-46e9-a9bb-6bfe6845e29d tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:19.165476 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-8f19596a-06fc-46e9-a9bb-6bfe6845e29d tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f082ed04bc143679029c204e8a97160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c7c8eeb1b4065b25fe28eba30d0eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:19.168535 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_cell1:SELECT=100 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:53:19.176507 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-8f19596a-06fc-46e9-a9bb-6bfe6845e29d tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] 10.222.0.50 "GET /compute/v2.1/servers/4390cd8e-2484-4205-9678-fb7332d1c78d" status: 200 len: 1276 microversion: 2.1 time: 0.129248 Aug 10 17:53:19.182920 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 526/1073] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:19 2022] GET /compute/v2.1/servers/4390cd8e-2484-4205-9678-fb7332d1c78d => generated 1276 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:53:19.202020 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-441086ad-b155-43df-8b84-794208b2b613 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:19.205988 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-441086ad-b155-43df-8b84-794208b2b613 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] [instance: e2777988-0bbf-496c-9c97-b206dbc94a62] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:19.209295 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-441086ad-b155-43df-8b84-794208b2b613 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:19.209852 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-441086ad-b155-43df-8b84-794208b2b613 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:19.210366 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-441086ad-b155-43df-8b84-794208b2b613 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:19.211150 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-441086ad-b155-43df-8b84-794208b2b613 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:19.211690 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-441086ad-b155-43df-8b84-794208b2b613 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:19.212169 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-441086ad-b155-43df-8b84-794208b2b613 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:19.318832 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.objects.instance [None req-441086ad-b155-43df-8b84-794208b2b613 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lazy-loading 'services' on Instance uuid e2777988-0bbf-496c-9c97-b206dbc94a62 {{(pid=129409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:53:19.343703 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-441086ad-b155-43df-8b84-794208b2b613 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62" status: 200 len: 1925 microversion: 2.75 time: 0.159178 Aug 10 17:53:19.344478 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 527/1074] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:53:19 2022] GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62 => generated 1925 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:53:19.412983 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-5e601e1b-8b85-49b1-aca9-05a50f4db96f tempest-QuotasAdminTestJSON-1220511093 tempest-QuotasAdminTestJSON-1220511093-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:19.413783 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-5e601e1b-8b85-49b1-aca9-05a50f4db96f tempest-QuotasAdminTestJSON-1220511093 tempest-QuotasAdminTestJSON-1220511093-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:19.414416 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-5e601e1b-8b85-49b1-aca9-05a50f4db96f tempest-QuotasAdminTestJSON-1220511093 tempest-QuotasAdminTestJSON-1220511093-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:19.415708 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-5e601e1b-8b85-49b1-aca9-05a50f4db96f tempest-QuotasAdminTestJSON-1220511093 tempest-QuotasAdminTestJSON-1220511093-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:19.416578 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-5e601e1b-8b85-49b1-aca9-05a50f4db96f tempest-QuotasAdminTestJSON-1220511093 tempest-QuotasAdminTestJSON-1220511093-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:19.417172 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-5e601e1b-8b85-49b1-aca9-05a50f4db96f tempest-QuotasAdminTestJSON-1220511093 tempest-QuotasAdminTestJSON-1220511093-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:19.567142 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:53:19.585860 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-5e601e1b-8b85-49b1-aca9-05a50f4db96f tempest-QuotasAdminTestJSON-1220511093 tempest-QuotasAdminTestJSON-1220511093-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-quota-sets/96df8c92fa6a4bffbeb07a71c2e6ea39" status: 200 len: 328 microversion: 2.1 time: 0.861944 Aug 10 17:53:19.594571 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 548/1075] 10.222.0.50 () {60 vars in 1262 bytes} [Wed Aug 10 17:53:18 2022] PUT /compute/v2.1/os-quota-sets/96df8c92fa6a4bffbeb07a71c2e6ea39 => generated 328 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:53:19.599511 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-a3ebc107-6ef8-4125-856e-f608ec84bf9b tempest-QuotasAdminTestJSON-1220511093 tempest-QuotasAdminTestJSON-1220511093-project-admin] Calling method '.version_select at 0x7fb346178b80>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:19.794270 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-35a50543-8d68-4bea-9314-25785d445ac3 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:19.795506 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-35a50543-8d68-4bea-9314-25785d445ac3 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: d4920fe1-a755-43f8-aa8f-b38c20f8c98a] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:19.804682 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-35a50543-8d68-4bea-9314-25785d445ac3 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:19.805626 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-35a50543-8d68-4bea-9314-25785d445ac3 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:19.807970 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-35a50543-8d68-4bea-9314-25785d445ac3 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:19.810771 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-35a50543-8d68-4bea-9314-25785d445ac3 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:19.815628 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-35a50543-8d68-4bea-9314-25785d445ac3 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:19.816355 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-35a50543-8d68-4bea-9314-25785d445ac3 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:20.009193 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a3ebc107-6ef8-4125-856e-f608ec84bf9b tempest-QuotasAdminTestJSON-1220511093 tempest-QuotasAdminTestJSON-1220511093-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:20.010023 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a3ebc107-6ef8-4125-856e-f608ec84bf9b tempest-QuotasAdminTestJSON-1220511093 tempest-QuotasAdminTestJSON-1220511093-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:20.010778 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a3ebc107-6ef8-4125-856e-f608ec84bf9b tempest-QuotasAdminTestJSON-1220511093 tempest-QuotasAdminTestJSON-1220511093-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:20.011942 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a3ebc107-6ef8-4125-856e-f608ec84bf9b tempest-QuotasAdminTestJSON-1220511093 tempest-QuotasAdminTestJSON-1220511093-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:20.012629 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a3ebc107-6ef8-4125-856e-f608ec84bf9b tempest-QuotasAdminTestJSON-1220511093 tempest-QuotasAdminTestJSON-1220511093-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:20.013227 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a3ebc107-6ef8-4125-856e-f608ec84bf9b tempest-QuotasAdminTestJSON-1220511093 tempest-QuotasAdminTestJSON-1220511093-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:20.033861 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-a3ebc107-6ef8-4125-856e-f608ec84bf9b tempest-QuotasAdminTestJSON-1220511093 tempest-QuotasAdminTestJSON-1220511093-project-admin] 10.222.0.50 "GET /compute/v2.1/os-quota-sets/96df8c92fa6a4bffbeb07a71c2e6ea39/detail" status: 200 len: 916 microversion: 2.1 time: 0.438990 Aug 10 17:53:20.035238 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 528/1076] 10.222.0.50 () {58 vars in 1263 bytes} [Wed Aug 10 17:53:19 2022] GET /compute/v2.1/os-quota-sets/96df8c92fa6a4bffbeb07a71c2e6ea39/detail => generated 916 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:53:20.070763 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-a9c0d954-e8d7-4d31-b24a-97e86e27c874 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:20.071567 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-a9c0d954-e8d7-4d31-b24a-97e86e27c874 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] [instance: bee3148a-3834-41bd-99e7-b5da75217256] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:20.078991 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a9c0d954-e8d7-4d31-b24a-97e86e27c874 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:20.079923 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a9c0d954-e8d7-4d31-b24a-97e86e27c874 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:20.080804 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a9c0d954-e8d7-4d31-b24a-97e86e27c874 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:20.084208 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a9c0d954-e8d7-4d31-b24a-97e86e27c874 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:20.084980 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a9c0d954-e8d7-4d31-b24a-97e86e27c874 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:20.085581 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a9c0d954-e8d7-4d31-b24a-97e86e27c874 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:20.304339 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-35a50543-8d68-4bea-9314-25785d445ac3 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:20.315928 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-35a50543-8d68-4bea-9314-25785d445ac3 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/d4920fe1-a755-43f8-aa8f-b38c20f8c98a" status: 200 len: 1317 microversion: 2.1 time: 0.525717 Aug 10 17:53:20.330534 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-a9c0d954-e8d7-4d31-b24a-97e86e27c874 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2fd6acf18d4218ad143ccee2d0bb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7c2481a908406fa9c4562513fff665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:20.335365 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 549/1077] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:19 2022] GET /compute/v2.1/servers/d4920fe1-a755-43f8-aa8f-b38c20f8c98a => generated 1317 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:53:20.339814 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-a9c0d954-e8d7-4d31-b24a-97e86e27c874 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] 10.222.0.50 "GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256" status: 200 len: 1471 microversion: 2.1 time: 0.273133 Aug 10 17:53:20.340662 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 529/1078] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:20 2022] GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256 => generated 1471 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:53:20.343994 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-75935bba-0c0e-44b0-8ccb-521e7df7db79 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:20.350152 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-75935bba-0c0e-44b0-8ccb-521e7df7db79 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] [instance: 4390cd8e-2484-4205-9678-fb7332d1c78d] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:20.351331 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [req-e0861261-8b56-4865-ac59-a1d9c3ed4b1c req-fd073fb7-e0eb-4d56-8fc6-66152ec9841c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4920fe1-a755-43f8-aa8f-b38c20f8c98a", "name": "network-vif-plugged", "status": "completed", "tag": "32763ad4-0ca1-47d1-838d-b554a0f3bd13"}]} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:53:20.365809 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-e0861261-8b56-4865-ac59-a1d9c3ed4b1c req-fd073fb7-e0eb-4d56-8fc6-66152ec9841c service nova] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:20.367200 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-e0861261-8b56-4865-ac59-a1d9c3ed4b1c req-fd073fb7-e0eb-4d56-8fc6-66152ec9841c service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:20.367798 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-e0861261-8b56-4865-ac59-a1d9c3ed4b1c req-fd073fb7-e0eb-4d56-8fc6-66152ec9841c service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:20.383356 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-75935bba-0c0e-44b0-8ccb-521e7df7db79 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:20.390756 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-75935bba-0c0e-44b0-8ccb-521e7df7db79 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:20.391263 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-75935bba-0c0e-44b0-8ccb-521e7df7db79 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:20.394768 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-75935bba-0c0e-44b0-8ccb-521e7df7db79 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:20.395318 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-75935bba-0c0e-44b0-8ccb-521e7df7db79 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:20.395773 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-75935bba-0c0e-44b0-8ccb-521e7df7db79 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:20.400753 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.compute.server_external_events [req-e0861261-8b56-4865-ac59-a1d9c3ed4b1c req-fd073fb7-e0eb-4d56-8fc6-66152ec9841c service nova] Creating event network-vif-plugged:32763ad4-0ca1-47d1-838d-b554a0f3bd13 for instance d4920fe1-a755-43f8-aa8f-b38c20f8c98a on n-h1-852296-2 Aug 10 17:53:20.421253 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [req-e0861261-8b56-4865-ac59-a1d9c3ed4b1c req-fd073fb7-e0eb-4d56-8fc6-66152ec9841c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079011 Aug 10 17:53:20.424357 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 530/1079] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 10 17:53:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:53:20.441783 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-4aec18fe-079d-469c-be16-f0b6dcd7ee09 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:20.443252 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-4aec18fe-079d-469c-be16-f0b6dcd7ee09 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] [instance: e2777988-0bbf-496c-9c97-b206dbc94a62] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:20.473436 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-4aec18fe-079d-469c-be16-f0b6dcd7ee09 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:20.473935 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-4aec18fe-079d-469c-be16-f0b6dcd7ee09 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:20.474372 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-4aec18fe-079d-469c-be16-f0b6dcd7ee09 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:20.475086 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-4aec18fe-079d-469c-be16-f0b6dcd7ee09 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:20.481462 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-4aec18fe-079d-469c-be16-f0b6dcd7ee09 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:20.490615 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-4aec18fe-079d-469c-be16-f0b6dcd7ee09 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:20.755725 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.objects.instance [None req-4aec18fe-079d-469c-be16-f0b6dcd7ee09 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lazy-loading 'services' on Instance uuid e2777988-0bbf-496c-9c97-b206dbc94a62 {{(pid=129409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:53:20.783622 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-4aec18fe-079d-469c-be16-f0b6dcd7ee09 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62" status: 200 len: 1925 microversion: 2.75 time: 0.357349 Aug 10 17:53:20.785094 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 531/1080] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:53:20 2022] GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62 => generated 1925 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:53:20.875905 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-2a2e6c59-061f-4df4-85a8-b4c4e03685c6 tempest-QuotasAdminTestJSON-1220511093 tempest-QuotasAdminTestJSON-1220511093-project-admin] Action: 'update', calling method: .version_select at 0x7fb346416160>, body: {"quota_set": {"ram": "2048"}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:53:21.090737 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-75935bba-0c0e-44b0-8ccb-521e7df7db79 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f082ed04bc143679029c204e8a97160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c7c8eeb1b4065b25fe28eba30d0eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:21.108360 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-75935bba-0c0e-44b0-8ccb-521e7df7db79 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] 10.222.0.50 "GET /compute/v2.1/servers/4390cd8e-2484-4205-9678-fb7332d1c78d" status: 200 len: 1318 microversion: 2.1 time: 0.767737 Aug 10 17:53:21.109382 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 550/1081] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:20 2022] GET /compute/v2.1/servers/4390cd8e-2484-4205-9678-fb7332d1c78d => generated 1318 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:53:21.345206 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-3d94e166-81ef-463a-92fa-0fee4bcfb2ff tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:21.346052 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-3d94e166-81ef-463a-92fa-0fee4bcfb2ff tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: d4920fe1-a755-43f8-aa8f-b38c20f8c98a] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:21.352462 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-3d94e166-81ef-463a-92fa-0fee4bcfb2ff tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:21.353188 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-3d94e166-81ef-463a-92fa-0fee4bcfb2ff tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:21.353822 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-3d94e166-81ef-463a-92fa-0fee4bcfb2ff tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:21.354714 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-3d94e166-81ef-463a-92fa-0fee4bcfb2ff tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:21.355988 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-3d94e166-81ef-463a-92fa-0fee4bcfb2ff tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:21.356870 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-3d94e166-81ef-463a-92fa-0fee4bcfb2ff tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:21.475588 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-2a2e6c59-061f-4df4-85a8-b4c4e03685c6 tempest-QuotasAdminTestJSON-1220511093 tempest-QuotasAdminTestJSON-1220511093-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:21.479325 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-2a2e6c59-061f-4df4-85a8-b4c4e03685c6 tempest-QuotasAdminTestJSON-1220511093 tempest-QuotasAdminTestJSON-1220511093-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:21.479883 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-2a2e6c59-061f-4df4-85a8-b4c4e03685c6 tempest-QuotasAdminTestJSON-1220511093 tempest-QuotasAdminTestJSON-1220511093-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:21.480762 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-2a2e6c59-061f-4df4-85a8-b4c4e03685c6 tempest-QuotasAdminTestJSON-1220511093 tempest-QuotasAdminTestJSON-1220511093-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:21.483274 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-2a2e6c59-061f-4df4-85a8-b4c4e03685c6 tempest-QuotasAdminTestJSON-1220511093 tempest-QuotasAdminTestJSON-1220511093-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:21.487472 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-2a2e6c59-061f-4df4-85a8-b4c4e03685c6 tempest-QuotasAdminTestJSON-1220511093 tempest-QuotasAdminTestJSON-1220511093-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:21.561810 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-2a2e6c59-061f-4df4-85a8-b4c4e03685c6 tempest-QuotasAdminTestJSON-1220511093 tempest-QuotasAdminTestJSON-1220511093-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:21.563740 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-2a2e6c59-061f-4df4-85a8-b4c4e03685c6 tempest-QuotasAdminTestJSON-1220511093 tempest-QuotasAdminTestJSON-1220511093-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:21.563740 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-2a2e6c59-061f-4df4-85a8-b4c4e03685c6 tempest-QuotasAdminTestJSON-1220511093 tempest-QuotasAdminTestJSON-1220511093-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:21.563740 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-2a2e6c59-061f-4df4-85a8-b4c4e03685c6 tempest-QuotasAdminTestJSON-1220511093 tempest-QuotasAdminTestJSON-1220511093-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:21.564427 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-2a2e6c59-061f-4df4-85a8-b4c4e03685c6 tempest-QuotasAdminTestJSON-1220511093 tempest-QuotasAdminTestJSON-1220511093-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:21.565023 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-2a2e6c59-061f-4df4-85a8-b4c4e03685c6 tempest-QuotasAdminTestJSON-1220511093 tempest-QuotasAdminTestJSON-1220511093-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:21.590027 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:DELETE=2 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:53:21.823272 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-2a2e6c59-061f-4df4-85a8-b4c4e03685c6 tempest-QuotasAdminTestJSON-1220511093 tempest-QuotasAdminTestJSON-1220511093-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-quota-sets/96df8c92fa6a4bffbeb07a71c2e6ea39?user_id=eb382407f5b5407399f2227cffeb613f" status: 200 len: 328 microversion: 2.1 time: 0.953181 Aug 10 17:53:21.826817 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 532/1082] 10.222.0.50 () {60 vars in 1343 bytes} [Wed Aug 10 17:53:20 2022] PUT /compute/v2.1/os-quota-sets/96df8c92fa6a4bffbeb07a71c2e6ea39?user_id=eb382407f5b5407399f2227cffeb613f => generated 328 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:53:21.832117 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-e1fc1148-03e2-4b88-a0cb-20a7bfdaeeab tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:21.839251 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-e1fc1148-03e2-4b88-a0cb-20a7bfdaeeab tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] [instance: bee3148a-3834-41bd-99e7-b5da75217256] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:21.847604 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e1fc1148-03e2-4b88-a0cb-20a7bfdaeeab tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:21.848470 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e1fc1148-03e2-4b88-a0cb-20a7bfdaeeab tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:21.849302 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e1fc1148-03e2-4b88-a0cb-20a7bfdaeeab tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:21.850190 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e1fc1148-03e2-4b88-a0cb-20a7bfdaeeab tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:21.850801 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e1fc1148-03e2-4b88-a0cb-20a7bfdaeeab tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:21.851378 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e1fc1148-03e2-4b88-a0cb-20a7bfdaeeab tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:21.945856 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-3d94e166-81ef-463a-92fa-0fee4bcfb2ff tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:21.955634 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-3d94e166-81ef-463a-92fa-0fee4bcfb2ff tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/d4920fe1-a755-43f8-aa8f-b38c20f8c98a" status: 200 len: 1317 microversion: 2.1 time: 0.617121 Aug 10 17:53:21.957116 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 551/1083] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:21 2022] GET /compute/v2.1/servers/d4920fe1-a755-43f8-aa8f-b38c20f8c98a => generated 1317 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:53:21.962621 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-eb6704e1-9c6b-4a9b-8bab-87a735bd845f tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:21.963629 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-eb6704e1-9c6b-4a9b-8bab-87a735bd845f tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] [instance: e2777988-0bbf-496c-9c97-b206dbc94a62] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:21.972599 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-eb6704e1-9c6b-4a9b-8bab-87a735bd845f tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:21.973311 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-eb6704e1-9c6b-4a9b-8bab-87a735bd845f tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:21.973760 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-eb6704e1-9c6b-4a9b-8bab-87a735bd845f tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:21.974465 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-eb6704e1-9c6b-4a9b-8bab-87a735bd845f tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:21.974913 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-eb6704e1-9c6b-4a9b-8bab-87a735bd845f tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:21.975618 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-eb6704e1-9c6b-4a9b-8bab-87a735bd845f tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:22.094355 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-e1fc1148-03e2-4b88-a0cb-20a7bfdaeeab tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2fd6acf18d4218ad143ccee2d0bb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7c2481a908406fa9c4562513fff665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:22.097042 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.objects.instance [None req-eb6704e1-9c6b-4a9b-8bab-87a735bd845f tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lazy-loading 'services' on Instance uuid e2777988-0bbf-496c-9c97-b206dbc94a62 {{(pid=129410) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:53:22.110659 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-e1fc1148-03e2-4b88-a0cb-20a7bfdaeeab tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] 10.222.0.50 "GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256" status: 200 len: 1471 microversion: 2.1 time: 0.279616 Aug 10 17:53:22.111239 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 533/1084] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:21 2022] GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256 => generated 1471 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:53:22.122482 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-41b6fbc7-2c7d-4c10-a751-47fcf65d6be0 tempest-QuotasAdminTestJSON-1220511093 tempest-QuotasAdminTestJSON-1220511093-project-admin] Calling method '.version_select at 0x7fb3460b0940>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:22.148076 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-eb6704e1-9c6b-4a9b-8bab-87a735bd845f tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62" status: 200 len: 1925 microversion: 2.75 time: 0.189493 Aug 10 17:53:22.155130 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 552/1085] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:53:21 2022] GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62 => generated 1925 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:53:22.157138 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-6ee2d272-878d-4be8-b18d-e8e5993e947d tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:22.157951 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-6ee2d272-878d-4be8-b18d-e8e5993e947d tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] [instance: 4390cd8e-2484-4205-9678-fb7332d1c78d] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:22.186503 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-6ee2d272-878d-4be8-b18d-e8e5993e947d tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:22.188031 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-6ee2d272-878d-4be8-b18d-e8e5993e947d tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:22.191599 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-6ee2d272-878d-4be8-b18d-e8e5993e947d tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:22.191599 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-6ee2d272-878d-4be8-b18d-e8e5993e947d tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:22.191599 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-6ee2d272-878d-4be8-b18d-e8e5993e947d tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:22.191599 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-6ee2d272-878d-4be8-b18d-e8e5993e947d tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:22.505854 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-41b6fbc7-2c7d-4c10-a751-47fcf65d6be0 tempest-QuotasAdminTestJSON-1220511093 tempest-QuotasAdminTestJSON-1220511093-project-admin] 10.222.0.50 "GET /compute/v2.1/os-quota-sets/96df8c92fa6a4bffbeb07a71c2e6ea39?user_id=eb382407f5b5407399f2227cffeb613f" status: 200 len: 370 microversion: 2.1 time: 0.393352 Aug 10 17:53:22.506587 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 534/1086] 10.222.0.50 () {58 vars in 1323 bytes} [Wed Aug 10 17:53:22 2022] GET /compute/v2.1/os-quota-sets/96df8c92fa6a4bffbeb07a71c2e6ea39?user_id=eb382407f5b5407399f2227cffeb613f => generated 370 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:53:22.583485 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-9ec3c2c1-cc00-4978-a10d-5802c0394a40 tempest-TenantUsagesNegativeTestJSON-2085621756 tempest-TenantUsagesNegativeTestJSON-2085621756-project-admin] 10.222.0.50 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-08-09T17%3A53%3A22.427698&end=2022-08-11T17%3A53%3A22.427698" status: 404 len: 112 microversion: - time: 0.075169 Aug 10 17:53:22.588774 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 535/1087] 10.222.0.50 () {58 vars in 1316 bytes} [Wed Aug 10 17:53:22 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-08-09T17%3A53%3A22.427698&end=2022-08-11T17%3A53%3A22.427698 => generated 112 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 10 17:53:22.596450 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-fabccba3-d2d0-46de-a8ac-a4de01127f98 tempest-TenantUsagesNegativeTestJSON-2085621756 tempest-TenantUsagesNegativeTestJSON-2085621756-project-admin] Calling method '.version_select at 0x7fb346015310>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:22.606559 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-fabccba3-d2d0-46de-a8ac-a4de01127f98 tempest-TenantUsagesNegativeTestJSON-2085621756 tempest-TenantUsagesNegativeTestJSON-2085621756-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Aug 10 17:53:22.608592 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-fabccba3-d2d0-46de-a8ac-a4de01127f98 tempest-TenantUsagesNegativeTestJSON-2085621756 tempest-TenantUsagesNegativeTestJSON-2085621756-project-admin] Request method failure captured: Aug 10 17:53:22.608592 n-d-852296-2 devstack@n-api.service[129409]: request: GET /compute/v2.1/os-simple-tenant-usage/f8bc1600ff0e448b8727fe6209fb8637?start=2022-08-11T17%3A53%3A22.427698&end=2022-08-09T17%3A53%3A22.427698 HTTP/1.1 Aug 10 17:53:22.608592 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 17:53:22.608592 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 17:53:22.608592 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 17:53:22.608592 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 0 Aug 10 17:53:22.608592 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 17:53:22.608592 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 17:53:22.608592 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 17:53:22.608592 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 17:53:22.608592 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8_CSY-TWa6KzFj6VfmyU0bcvZ8cGNRoV0xVaaOpMG2JbZQZr3A_D9J61oqRm2MF5oeDM1TeqS5LfMISNajGJm1aY6syjl2AEBrz6RhmDk1gu-fRTGOsiFXAEKgwoDuRek_gQKGUTmQjvqKBbw0s3y4kKe5dOynmKMuHGhUL5JGgF1xE Aug 10 17:53:22.608592 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 17:53:22.608592 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 17:53:22.608592 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 17:53:22.608592 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 17:53:22.608592 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 17:53:22.608592 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 17:53:22.608592 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: 9333e7b748324a47a8d2f201ce72c278 Aug 10 17:53:22.608592 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-2085621756 Aug 10 17:53:22.608592 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member,admin Aug 10 17:53:22.608592 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member,admin Aug 10 17:53:22.608592 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9333e7b748324a47a8d2f201ce72c278"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9333e7b748324a47a8d2f201ce72c278"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9333e7b748324a47a8d2f201ce72c278"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9333e7b748324a47a8d2f201ce72c278", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:53:22.608592 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-2085621756 Aug 10 17:53:22.608592 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: 9333e7b748324a47a8d2f201ce72c278 Aug 10 17:53:22.608592 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-2085621756 Aug 10 17:53:22.608592 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-TenantUsagesNegativeTestJSON-2085621756-project-admin Aug 10 17:53:22.608592 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 17:53:22.608592 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 17:53:22.608592 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: 18245d38860c4095b70e28db677aaa91 Aug 10 17:53:22.608592 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-2085621756-project-admin Aug 10 17:53:22.608592 n-d-852296-2 devstack@n-api.service[129409]: method: Aug 10 17:53:22.608592 n-d-852296-2 devstack@n-api.service[129409]: exception: Invalid start time. The start time cannot occur after the end time. Aug 10 17:53:22.608592 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'id': 'f8bc1600ff0e448b8727fe6209fb8637'} Aug 10 17:53:22.608592 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:53:22.608592 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:53:22.608592 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:53:22.608592 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:53:22.608592 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:53:22.608592 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:53:22.608592 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 17:53:22.608592 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 17:53:22.608592 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 10 17:53:22.608592 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:53:22.608592 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:53:22.608592 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:53:22.608592 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Aug 10 17:53:22.608592 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._show(req, id) Aug 10 17:53:22.608592 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Aug 10 17:53:22.608592 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Aug 10 17:53:22.608592 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Aug 10 17:53:22.608592 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 10 17:53:22.608592 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Aug 10 17:53:22.608592 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:53:22.608592 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:53:22.608592 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:53:22.608592 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:53:22.608592 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:53:22.608592 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:53:22.608592 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:53:22.608592 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:53:22.608592 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Aug 10 17:53:22.608592 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:53:22.616849 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-6ee2d272-878d-4be8-b18d-e8e5993e947d tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f082ed04bc143679029c204e8a97160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c7c8eeb1b4065b25fe28eba30d0eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:22.619471 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-fabccba3-d2d0-46de-a8ac-a4de01127f98 tempest-TenantUsagesNegativeTestJSON-2085621756 tempest-TenantUsagesNegativeTestJSON-2085621756-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:53:22.621998 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-fabccba3-d2d0-46de-a8ac-a4de01127f98 tempest-TenantUsagesNegativeTestJSON-2085621756 tempest-TenantUsagesNegativeTestJSON-2085621756-project-admin] 10.222.0.50 "GET /compute/v2.1/os-simple-tenant-usage/f8bc1600ff0e448b8727fe6209fb8637?start=2022-08-11T17%3A53%3A22.427698&end=2022-08-09T17%3A53%3A22.427698" status: 400 len: 111 microversion: 2.1 time: 0.031559 Aug 10 17:53:22.624784 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 536/1088] 10.222.0.50 () {58 vars in 1412 bytes} [Wed Aug 10 17:53:22 2022] GET /compute/v2.1/os-simple-tenant-usage/f8bc1600ff0e448b8727fe6209fb8637?start=2022-08-11T17%3A53%3A22.427698&end=2022-08-09T17%3A53%3A22.427698 => generated 111 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 10 17:53:22.630440 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-6ee2d272-878d-4be8-b18d-e8e5993e947d tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] 10.222.0.50 "GET /compute/v2.1/servers/4390cd8e-2484-4205-9678-fb7332d1c78d" status: 200 len: 1318 microversion: 2.1 time: 0.478240 Aug 10 17:53:22.631444 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 553/1089] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:22 2022] GET /compute/v2.1/servers/4390cd8e-2484-4205-9678-fb7332d1c78d => generated 1318 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:53:22.946802 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [req-8585226a-6418-46bd-9df3-3585a1b668a7 req-d9501bb6-d0cf-4e2d-ad01-1db53668b56d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4390cd8e-2484-4205-9678-fb7332d1c78d", "tag": "5248f076-be99-4a79-a578-5fcdf9112aab"}]} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:53:22.957657 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-8585226a-6418-46bd-9df3-3585a1b668a7 req-d9501bb6-d0cf-4e2d-ad01-1db53668b56d service nova] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:22.958489 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-8585226a-6418-46bd-9df3-3585a1b668a7 req-d9501bb6-d0cf-4e2d-ad01-1db53668b56d service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:22.959126 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-8585226a-6418-46bd-9df3-3585a1b668a7 req-d9501bb6-d0cf-4e2d-ad01-1db53668b56d service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:22.963482 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_cell1:SELECT=100 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:53:22.971546 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.compute.server_external_events [req-8585226a-6418-46bd-9df3-3585a1b668a7 req-d9501bb6-d0cf-4e2d-ad01-1db53668b56d service nova] Creating event network-changed:5248f076-be99-4a79-a578-5fcdf9112aab for instance 4390cd8e-2484-4205-9678-fb7332d1c78d on n-h1-852296-2 Aug 10 17:53:22.977126 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [req-8585226a-6418-46bd-9df3-3585a1b668a7 req-d9501bb6-d0cf-4e2d-ad01-1db53668b56d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033922 Aug 10 17:53:22.978136 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 554/1090] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 10 17:53:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:53:22.985992 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-4ef203d0-ed83-402e-9895-359be880c354 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:22.987501 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-4ef203d0-ed83-402e-9895-359be880c354 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: d4920fe1-a755-43f8-aa8f-b38c20f8c98a] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:22.994249 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-4ef203d0-ed83-402e-9895-359be880c354 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:22.995076 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-4ef203d0-ed83-402e-9895-359be880c354 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:22.996515 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-4ef203d0-ed83-402e-9895-359be880c354 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:22.997580 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-4ef203d0-ed83-402e-9895-359be880c354 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:22.998209 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-4ef203d0-ed83-402e-9895-359be880c354 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:22.998794 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-4ef203d0-ed83-402e-9895-359be880c354 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:23.182819 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-4ef203d0-ed83-402e-9895-359be880c354 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:23.192797 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-4ef203d0-ed83-402e-9895-359be880c354 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/d4920fe1-a755-43f8-aa8f-b38c20f8c98a" status: 200 len: 1317 microversion: 2.1 time: 0.213188 Aug 10 17:53:23.193455 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 555/1091] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:22 2022] GET /compute/v2.1/servers/d4920fe1-a755-43f8-aa8f-b38c20f8c98a => generated 1317 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:53:23.201848 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-09b13f6a-dc24-4622-beb5-d075db68c5bd tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:23.206557 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-09b13f6a-dc24-4622-beb5-d075db68c5bd tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] [instance: bee3148a-3834-41bd-99e7-b5da75217256] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:23.211359 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-09b13f6a-dc24-4622-beb5-d075db68c5bd tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:23.211959 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-09b13f6a-dc24-4622-beb5-d075db68c5bd tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:23.212527 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-09b13f6a-dc24-4622-beb5-d075db68c5bd tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:23.213334 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-09b13f6a-dc24-4622-beb5-d075db68c5bd tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:23.215165 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-09b13f6a-dc24-4622-beb5-d075db68c5bd tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:23.215795 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-09b13f6a-dc24-4622-beb5-d075db68c5bd tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:23.278110 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-03f4f51b-298f-4866-a06e-d6fe17173302 tempest-TenantUsagesNegativeTestJSON-2084036315 tempest-TenantUsagesNegativeTestJSON-2084036315-project] Calling method '.version_select at 0x7fb3465a1d30>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:23.282402 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-03f4f51b-298f-4866-a06e-d6fe17173302 tempest-TenantUsagesNegativeTestJSON-2084036315 tempest-TenantUsagesNegativeTestJSON-2084036315-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': 'fac2195668784e1192db1a5604bd3070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc1600ff0e448b8727fe6209fb8637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:23.288001 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-03f4f51b-298f-4866-a06e-d6fe17173302 tempest-TenantUsagesNegativeTestJSON-2084036315 tempest-TenantUsagesNegativeTestJSON-2084036315-project] Request method failure captured: Aug 10 17:53:23.288001 n-d-852296-2 devstack@n-api.service[129409]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-09T17%3A53%3A22.427698&end=2022-08-11T17%3A53%3A22.427698&detailed=1 HTTP/1.1 Aug 10 17:53:23.288001 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 17:53:23.288001 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 17:53:23.288001 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 17:53:23.288001 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 0 Aug 10 17:53:23.288001 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 17:53:23.288001 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 17:53:23.288001 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 17:53:23.288001 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 17:53:23.288001 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8_CQ6dcoTXOY6Gt6qfn5VozkTiLdmuF6bnLtRtExKVDQ2gTo1bcatcSkON0op5H3FPaztwUDiPd_pXFWINNQkwf8gwHZreUNf8qHH38uAcK4JbXOEnci4J9boS-2NgZWXF-h6-VRzbWBXS2K6IKAg5vMNVDFkI2EIPJOj6tKutwSrh8 Aug 10 17:53:23.288001 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 17:53:23.288001 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 17:53:23.288001 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 17:53:23.288001 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 17:53:23.288001 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 17:53:23.288001 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 17:53:23.288001 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: f8bc1600ff0e448b8727fe6209fb8637 Aug 10 17:53:23.288001 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-2084036315 Aug 10 17:53:23.288001 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 17:53:23.288001 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 17:53:23.288001 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f8bc1600ff0e448b8727fe6209fb8637"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f8bc1600ff0e448b8727fe6209fb8637"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f8bc1600ff0e448b8727fe6209fb8637"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f8bc1600ff0e448b8727fe6209fb8637", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:53:23.288001 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-2084036315 Aug 10 17:53:23.288001 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: f8bc1600ff0e448b8727fe6209fb8637 Aug 10 17:53:23.288001 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-2084036315 Aug 10 17:53:23.288001 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-TenantUsagesNegativeTestJSON-2084036315-project Aug 10 17:53:23.288001 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 17:53:23.288001 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 17:53:23.288001 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: fac2195668784e1192db1a5604bd3070 Aug 10 17:53:23.288001 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-2084036315-project Aug 10 17:53:23.288001 n-d-852296-2 devstack@n-api.service[129409]: method: Aug 10 17:53:23.288001 n-d-852296-2 devstack@n-api.service[129409]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Aug 10 17:53:23.288001 n-d-852296-2 devstack@n-api.service[129409]: action_args: {} Aug 10 17:53:23.288001 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:53:23.288001 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:53:23.288001 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:53:23.288001 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:53:23.288001 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:53:23.288001 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:53:23.288001 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 17:53:23.288001 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 17:53:23.288001 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 10 17:53:23.288001 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:53:23.288001 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:53:23.288001 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:53:23.288001 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Aug 10 17:53:23.288001 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._index(req) Aug 10 17:53:23.288001 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Aug 10 17:53:23.288001 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Aug 10 17:53:23.288001 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 10 17:53:23.288001 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 10 17:53:23.288001 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 10 17:53:23.288001 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 10 17:53:23.288001 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 10 17:53:23.288001 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 10 17:53:23.288001 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 10 17:53:23.288001 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise self.value Aug 10 17:53:23.288001 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 10 17:53:23.288001 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 10 17:53:23.288001 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 10 17:53:23.288001 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 10 17:53:23.288001 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 10 17:53:23.294830 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 10 17:53:23.294830 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Aug 10 17:53:23.294830 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:53:23.294830 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:53:23.294830 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:53:23.294830 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:53:23.294830 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:53:23.294830 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:53:23.294830 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 10 17:53:23.294830 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 10 17:53:23.294830 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Aug 10 17:53:23.294830 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:53:23.294830 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-03f4f51b-298f-4866-a06e-d6fe17173302 tempest-TenantUsagesNegativeTestJSON-2084036315 tempest-TenantUsagesNegativeTestJSON-2084036315-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:53:23.294830 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-03f4f51b-298f-4866-a06e-d6fe17173302 tempest-TenantUsagesNegativeTestJSON-2084036315 tempest-TenantUsagesNegativeTestJSON-2084036315-project] 10.222.0.50 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-09T17%3A53%3A22.427698&end=2022-08-11T17%3A53%3A22.427698&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.660481 Aug 10 17:53:23.294830 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 537/1092] 10.222.0.50 () {58 vars in 1335 bytes} [Wed Aug 10 17:53:22 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-09T17%3A53%3A22.427698&end=2022-08-11T17%3A53%3A22.427698&detailed=1 => generated 123 bytes in 662 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:53:23.305368 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-862399d6-a87e-4eb0-a7c6-86baf7a6be17 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:23.309655 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-862399d6-a87e-4eb0-a7c6-86baf7a6be17 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] [instance: e2777988-0bbf-496c-9c97-b206dbc94a62] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:23.324753 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-862399d6-a87e-4eb0-a7c6-86baf7a6be17 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:23.326427 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-862399d6-a87e-4eb0-a7c6-86baf7a6be17 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:23.327215 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-862399d6-a87e-4eb0-a7c6-86baf7a6be17 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:23.328886 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-862399d6-a87e-4eb0-a7c6-86baf7a6be17 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:23.330377 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-862399d6-a87e-4eb0-a7c6-86baf7a6be17 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:23.332479 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-862399d6-a87e-4eb0-a7c6-86baf7a6be17 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:23.531597 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.objects.instance [None req-862399d6-a87e-4eb0-a7c6-86baf7a6be17 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lazy-loading 'services' on Instance uuid e2777988-0bbf-496c-9c97-b206dbc94a62 {{(pid=129409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:53:23.550522 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-862399d6-a87e-4eb0-a7c6-86baf7a6be17 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62" status: 200 len: 1925 microversion: 2.75 time: 0.248945 Aug 10 17:53:23.551630 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 538/1093] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:53:23 2022] GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62 => generated 1925 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:53:23.565492 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-09b13f6a-dc24-4622-beb5-d075db68c5bd tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2fd6acf18d4218ad143ccee2d0bb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7c2481a908406fa9c4562513fff665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:23.573660 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-09b13f6a-dc24-4622-beb5-d075db68c5bd tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] 10.222.0.50 "GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256" status: 200 len: 1471 microversion: 2.1 time: 0.379046 Aug 10 17:53:23.574912 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 556/1094] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:23 2022] GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256 => generated 1471 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:53:23.663080 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-7242c8ff-8c5e-470d-af79-ba28f690ca4a tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:23.663697 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-7242c8ff-8c5e-470d-af79-ba28f690ca4a tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] [instance: 4390cd8e-2484-4205-9678-fb7332d1c78d] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:23.670504 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7242c8ff-8c5e-470d-af79-ba28f690ca4a tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:23.671027 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7242c8ff-8c5e-470d-af79-ba28f690ca4a tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:23.671464 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7242c8ff-8c5e-470d-af79-ba28f690ca4a tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:23.672168 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7242c8ff-8c5e-470d-af79-ba28f690ca4a tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:23.672918 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7242c8ff-8c5e-470d-af79-ba28f690ca4a tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:23.673353 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7242c8ff-8c5e-470d-af79-ba28f690ca4a tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:23.831579 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-f279cb90-c2a4-45ea-be35-6fe1c93b57ae tempest-QuotasAdminTestJSON-1220511093 tempest-QuotasAdminTestJSON-1220511093-project-admin] Calling method '.version_select at 0x7fb345c3c550>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:23.856919 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-7242c8ff-8c5e-470d-af79-ba28f690ca4a tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f082ed04bc143679029c204e8a97160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c7c8eeb1b4065b25fe28eba30d0eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:23.867618 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-7242c8ff-8c5e-470d-af79-ba28f690ca4a tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] 10.222.0.50 "GET /compute/v2.1/servers/4390cd8e-2484-4205-9678-fb7332d1c78d" status: 200 len: 1318 microversion: 2.1 time: 0.208995 Aug 10 17:53:23.868769 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 539/1095] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:23 2022] GET /compute/v2.1/servers/4390cd8e-2484-4205-9678-fb7332d1c78d => generated 1318 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:53:24.215403 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-62c78c4f-2b5c-4364-921e-465574a97315 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:24.216467 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-62c78c4f-2b5c-4364-921e-465574a97315 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: d4920fe1-a755-43f8-aa8f-b38c20f8c98a] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:24.224170 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-62c78c4f-2b5c-4364-921e-465574a97315 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:24.224787 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-62c78c4f-2b5c-4364-921e-465574a97315 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:24.225938 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-62c78c4f-2b5c-4364-921e-465574a97315 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:24.226949 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-62c78c4f-2b5c-4364-921e-465574a97315 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:24.227608 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-62c78c4f-2b5c-4364-921e-465574a97315 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:24.228509 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-62c78c4f-2b5c-4364-921e-465574a97315 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:24.428474 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-62c78c4f-2b5c-4364-921e-465574a97315 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:24.438297 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-62c78c4f-2b5c-4364-921e-465574a97315 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/d4920fe1-a755-43f8-aa8f-b38c20f8c98a" status: 200 len: 1466 microversion: 2.1 time: 0.227589 Aug 10 17:53:24.440374 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 540/1096] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:24 2022] GET /compute/v2.1/servers/d4920fe1-a755-43f8-aa8f-b38c20f8c98a => generated 1466 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:53:24.458573 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-439b1bb8-d393-47b3-92be-d12dc1a428ec tempest-ServersOnMultiNodesTest-116104069 tempest-ServersOnMultiNodesTest-116104069-project-admin] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:24.459327 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-439b1bb8-d393-47b3-92be-d12dc1a428ec tempest-ServersOnMultiNodesTest-116104069 tempest-ServersOnMultiNodesTest-116104069-project-admin] [instance: d4920fe1-a755-43f8-aa8f-b38c20f8c98a] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:24.466000 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-439b1bb8-d393-47b3-92be-d12dc1a428ec tempest-ServersOnMultiNodesTest-116104069 tempest-ServersOnMultiNodesTest-116104069-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:24.466805 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-439b1bb8-d393-47b3-92be-d12dc1a428ec tempest-ServersOnMultiNodesTest-116104069 tempest-ServersOnMultiNodesTest-116104069-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:24.467336 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-439b1bb8-d393-47b3-92be-d12dc1a428ec tempest-ServersOnMultiNodesTest-116104069 tempest-ServersOnMultiNodesTest-116104069-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:24.468484 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-439b1bb8-d393-47b3-92be-d12dc1a428ec tempest-ServersOnMultiNodesTest-116104069 tempest-ServersOnMultiNodesTest-116104069-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:24.469285 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-439b1bb8-d393-47b3-92be-d12dc1a428ec tempest-ServersOnMultiNodesTest-116104069 tempest-ServersOnMultiNodesTest-116104069-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:24.470135 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-439b1bb8-d393-47b3-92be-d12dc1a428ec tempest-ServersOnMultiNodesTest-116104069 tempest-ServersOnMultiNodesTest-116104069-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:24.822187 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-f279cb90-c2a4-45ea-be35-6fe1c93b57ae tempest-QuotasAdminTestJSON-1220511093 tempest-QuotasAdminTestJSON-1220511093-project-admin] 10.222.0.50 "GET /compute/v2.1/os-quota-sets/88d7445c0d374d3dbc1d93df283f823e/defaults" status: 200 len: 371 microversion: 2.1 time: 0.995067 Aug 10 17:53:24.822788 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 557/1097] 10.222.0.50 () {58 vars in 1269 bytes} [Wed Aug 10 17:53:23 2022] GET /compute/v2.1/os-quota-sets/88d7445c0d374d3dbc1d93df283f823e/defaults => generated 371 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:53:24.829186 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-74029964-1b7d-49a0-9c17-fda6ba2f2041 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:24.830659 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-74029964-1b7d-49a0-9c17-fda6ba2f2041 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] [instance: e2777988-0bbf-496c-9c97-b206dbc94a62] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:24.838122 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-74029964-1b7d-49a0-9c17-fda6ba2f2041 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:24.838611 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-74029964-1b7d-49a0-9c17-fda6ba2f2041 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:24.839619 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-74029964-1b7d-49a0-9c17-fda6ba2f2041 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:24.841191 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-74029964-1b7d-49a0-9c17-fda6ba2f2041 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:24.841847 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-74029964-1b7d-49a0-9c17-fda6ba2f2041 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:24.843257 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-74029964-1b7d-49a0-9c17-fda6ba2f2041 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:24.847419 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-439b1bb8-d393-47b3-92be-d12dc1a428ec tempest-ServersOnMultiNodesTest-116104069 tempest-ServersOnMultiNodesTest-116104069-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/d4920fe1-a755-43f8-aa8f-b38c20f8c98a" status: 200 len: 1617 microversion: 2.1 time: 0.392611 Aug 10 17:53:24.864277 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 541/1098] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:24 2022] GET /compute/v2.1/servers/d4920fe1-a755-43f8-aa8f-b38c20f8c98a => generated 1617 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:53:24.864277 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-b635827e-43d8-48b0-b382-5cc109a04bc4 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:24.864277 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-b635827e-43d8-48b0-b382-5cc109a04bc4 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] [instance: bee3148a-3834-41bd-99e7-b5da75217256] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:24.875294 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-b635827e-43d8-48b0-b382-5cc109a04bc4 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:24.876600 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-b635827e-43d8-48b0-b382-5cc109a04bc4 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:24.878463 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-b635827e-43d8-48b0-b382-5cc109a04bc4 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:24.879298 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-b635827e-43d8-48b0-b382-5cc109a04bc4 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:24.879867 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-b635827e-43d8-48b0-b382-5cc109a04bc4 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:24.880511 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-b635827e-43d8-48b0-b382-5cc109a04bc4 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:24.953902 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.objects.instance [None req-74029964-1b7d-49a0-9c17-fda6ba2f2041 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lazy-loading 'services' on Instance uuid e2777988-0bbf-496c-9c97-b206dbc94a62 {{(pid=129410) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:53:24.995231 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-74029964-1b7d-49a0-9c17-fda6ba2f2041 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62" status: 200 len: 1931 microversion: 2.75 time: 0.171152 Aug 10 17:53:25.008494 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 558/1099] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:53:24 2022] GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62 => generated 1931 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:53:25.008494 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-f47191b4-12b8-4045-8290-e4b8790de526 tempest-QuotasAdminTestJSON-1220511093 tempest-QuotasAdminTestJSON-1220511093-project-admin] Action: 'update', calling method: .version_select at 0x7fb345bd3af0>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:53:25.202819 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-b635827e-43d8-48b0-b382-5cc109a04bc4 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2fd6acf18d4218ad143ccee2d0bb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7c2481a908406fa9c4562513fff665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:25.232945 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-b635827e-43d8-48b0-b382-5cc109a04bc4 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] 10.222.0.50 "GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256" status: 200 len: 1471 microversion: 2.1 time: 0.373129 Aug 10 17:53:25.235789 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 542/1100] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:24 2022] GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256 => generated 1471 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:53:25.240743 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-324e2775-9b7f-4491-bf5f-a075c0a3b427 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:25.250146 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-324e2775-9b7f-4491-bf5f-a075c0a3b427 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: d4920fe1-a755-43f8-aa8f-b38c20f8c98a] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:25.256421 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-324e2775-9b7f-4491-bf5f-a075c0a3b427 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:25.257112 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-324e2775-9b7f-4491-bf5f-a075c0a3b427 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:25.257702 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-324e2775-9b7f-4491-bf5f-a075c0a3b427 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:25.258572 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-324e2775-9b7f-4491-bf5f-a075c0a3b427 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:25.259207 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-324e2775-9b7f-4491-bf5f-a075c0a3b427 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:25.268875 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-324e2775-9b7f-4491-bf5f-a075c0a3b427 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:25.331930 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-324e2775-9b7f-4491-bf5f-a075c0a3b427 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: d4920fe1-a755-43f8-aa8f-b38c20f8c98a] Going to try to terminate instance {{(pid=129409) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 17:53:25.484835 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-f47191b4-12b8-4045-8290-e4b8790de526 tempest-QuotasAdminTestJSON-1220511093 tempest-QuotasAdminTestJSON-1220511093-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:25.485606 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-f47191b4-12b8-4045-8290-e4b8790de526 tempest-QuotasAdminTestJSON-1220511093 tempest-QuotasAdminTestJSON-1220511093-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:25.486048 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-f47191b4-12b8-4045-8290-e4b8790de526 tempest-QuotasAdminTestJSON-1220511093 tempest-QuotasAdminTestJSON-1220511093-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:25.486781 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-f47191b4-12b8-4045-8290-e4b8790de526 tempest-QuotasAdminTestJSON-1220511093 tempest-QuotasAdminTestJSON-1220511093-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:25.487237 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-f47191b4-12b8-4045-8290-e4b8790de526 tempest-QuotasAdminTestJSON-1220511093 tempest-QuotasAdminTestJSON-1220511093-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:25.487661 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-f47191b4-12b8-4045-8290-e4b8790de526 tempest-QuotasAdminTestJSON-1220511093 tempest-QuotasAdminTestJSON-1220511093-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:26.052179 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-324e2775-9b7f-4491-bf5f-a075c0a3b427 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "DELETE /compute/v2.1/servers/d4920fe1-a755-43f8-aa8f-b38c20f8c98a" status: 204 len: 0 microversion: 2.1 time: 0.814892 Aug 10 17:53:26.052959 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 543/1101] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 10 17:53:25 2022] DELETE /compute/v2.1/servers/d4920fe1-a755-43f8-aa8f-b38c20f8c98a => generated 0 bytes in 816 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 17:53:26.061680 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-e283fe53-1644-4504-87a9-5bf637404a03 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:26.062375 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-e283fe53-1644-4504-87a9-5bf637404a03 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] [instance: 4390cd8e-2484-4205-9678-fb7332d1c78d] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:26.070418 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e283fe53-1644-4504-87a9-5bf637404a03 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:26.070418 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e283fe53-1644-4504-87a9-5bf637404a03 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:26.070418 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e283fe53-1644-4504-87a9-5bf637404a03 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:26.070418 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e283fe53-1644-4504-87a9-5bf637404a03 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:26.070850 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e283fe53-1644-4504-87a9-5bf637404a03 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:26.071459 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e283fe53-1644-4504-87a9-5bf637404a03 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:26.235503 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-e283fe53-1644-4504-87a9-5bf637404a03 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f082ed04bc143679029c204e8a97160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c7c8eeb1b4065b25fe28eba30d0eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:26.243248 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-e283fe53-1644-4504-87a9-5bf637404a03 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] 10.222.0.50 "GET /compute/v2.1/servers/4390cd8e-2484-4205-9678-fb7332d1c78d" status: 200 len: 1318 microversion: 2.1 time: 0.189171 Aug 10 17:53:26.243850 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 544/1102] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:26 2022] GET /compute/v2.1/servers/4390cd8e-2484-4205-9678-fb7332d1c78d => generated 1318 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:53:26.249061 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-eb306bae-4ca7-4ba5-abca-f7ca7630a856 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:26.249662 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-eb306bae-4ca7-4ba5-abca-f7ca7630a856 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] [instance: e2777988-0bbf-496c-9c97-b206dbc94a62] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:26.255484 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-eb306bae-4ca7-4ba5-abca-f7ca7630a856 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:26.255972 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-eb306bae-4ca7-4ba5-abca-f7ca7630a856 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:26.256519 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-eb306bae-4ca7-4ba5-abca-f7ca7630a856 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:26.257208 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-eb306bae-4ca7-4ba5-abca-f7ca7630a856 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:26.257844 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-eb306bae-4ca7-4ba5-abca-f7ca7630a856 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:26.258272 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-eb306bae-4ca7-4ba5-abca-f7ca7630a856 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:26.335515 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.objects.instance [None req-eb306bae-4ca7-4ba5-abca-f7ca7630a856 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lazy-loading 'services' on Instance uuid e2777988-0bbf-496c-9c97-b206dbc94a62 {{(pid=129409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:53:26.339514 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:53:26.358781 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-eb306bae-4ca7-4ba5-abca-f7ca7630a856 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62" status: 200 len: 1931 microversion: 2.75 time: 0.113827 Aug 10 17:53:26.364202 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 545/1103] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:53:26 2022] GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62 => generated 1931 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:53:26.364367 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-162cf1c2-7051-4887-92fb-fb27002b50a2 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:26.378151 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-162cf1c2-7051-4887-92fb-fb27002b50a2 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: d4920fe1-a755-43f8-aa8f-b38c20f8c98a] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:26.378151 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-162cf1c2-7051-4887-92fb-fb27002b50a2 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:26.378151 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-162cf1c2-7051-4887-92fb-fb27002b50a2 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:26.378151 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-162cf1c2-7051-4887-92fb-fb27002b50a2 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:26.378151 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-162cf1c2-7051-4887-92fb-fb27002b50a2 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:26.378151 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-162cf1c2-7051-4887-92fb-fb27002b50a2 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:26.378151 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-162cf1c2-7051-4887-92fb-fb27002b50a2 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:26.515079 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-162cf1c2-7051-4887-92fb-fb27002b50a2 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:26.522576 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-162cf1c2-7051-4887-92fb-fb27002b50a2 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/d4920fe1-a755-43f8-aa8f-b38c20f8c98a" status: 200 len: 1472 microversion: 2.1 time: 0.161717 Aug 10 17:53:26.523392 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 546/1104] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:26 2022] GET /compute/v2.1/servers/d4920fe1-a755-43f8-aa8f-b38c20f8c98a => generated 1472 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:53:26.528033 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-2bada2b7-a4bd-4f00-b0e6-7c66977bcf12 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:26.528698 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-2bada2b7-a4bd-4f00-b0e6-7c66977bcf12 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] [instance: bee3148a-3834-41bd-99e7-b5da75217256] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:26.535207 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-2bada2b7-a4bd-4f00-b0e6-7c66977bcf12 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:26.535704 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-2bada2b7-a4bd-4f00-b0e6-7c66977bcf12 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:26.536125 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-2bada2b7-a4bd-4f00-b0e6-7c66977bcf12 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:26.536853 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-2bada2b7-a4bd-4f00-b0e6-7c66977bcf12 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:26.537305 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-2bada2b7-a4bd-4f00-b0e6-7c66977bcf12 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:26.537725 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-2bada2b7-a4bd-4f00-b0e6-7c66977bcf12 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:26.682256 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-2bada2b7-a4bd-4f00-b0e6-7c66977bcf12 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2fd6acf18d4218ad143ccee2d0bb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7c2481a908406fa9c4562513fff665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:26.691471 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-2bada2b7-a4bd-4f00-b0e6-7c66977bcf12 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] 10.222.0.50 "GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256" status: 200 len: 1477 microversion: 2.1 time: 0.167055 Aug 10 17:53:26.692064 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 547/1105] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:26 2022] GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256 => generated 1477 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:53:27.269685 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-e6f13950-8d7c-46aa-bf00-ce8be23de3a9 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:27.270356 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-e6f13950-8d7c-46aa-bf00-ce8be23de3a9 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] [instance: 4390cd8e-2484-4205-9678-fb7332d1c78d] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:27.279290 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e6f13950-8d7c-46aa-bf00-ce8be23de3a9 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:27.280007 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e6f13950-8d7c-46aa-bf00-ce8be23de3a9 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:27.280474 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e6f13950-8d7c-46aa-bf00-ce8be23de3a9 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:27.281412 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e6f13950-8d7c-46aa-bf00-ce8be23de3a9 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:27.281930 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e6f13950-8d7c-46aa-bf00-ce8be23de3a9 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:27.282608 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e6f13950-8d7c-46aa-bf00-ce8be23de3a9 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:27.521122 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-e6f13950-8d7c-46aa-bf00-ce8be23de3a9 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f082ed04bc143679029c204e8a97160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c7c8eeb1b4065b25fe28eba30d0eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:27.529044 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-e6f13950-8d7c-46aa-bf00-ce8be23de3a9 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] 10.222.0.50 "GET /compute/v2.1/servers/4390cd8e-2484-4205-9678-fb7332d1c78d" status: 200 len: 1318 microversion: 2.1 time: 0.268251 Aug 10 17:53:27.532175 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 548/1106] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:27 2022] GET /compute/v2.1/servers/4390cd8e-2484-4205-9678-fb7332d1c78d => generated 1318 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:53:27.543400 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-1fb9e00b-0a9f-4d74-b5d0-eba8fc84c61f tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:27.545161 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-1fb9e00b-0a9f-4d74-b5d0-eba8fc84c61f tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] [instance: e2777988-0bbf-496c-9c97-b206dbc94a62] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:27.559919 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-1fb9e00b-0a9f-4d74-b5d0-eba8fc84c61f tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:27.563507 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-1fb9e00b-0a9f-4d74-b5d0-eba8fc84c61f tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:27.563507 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-1fb9e00b-0a9f-4d74-b5d0-eba8fc84c61f tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:27.563507 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-1fb9e00b-0a9f-4d74-b5d0-eba8fc84c61f tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:27.563507 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-1fb9e00b-0a9f-4d74-b5d0-eba8fc84c61f tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:27.563507 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-1fb9e00b-0a9f-4d74-b5d0-eba8fc84c61f tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:27.651959 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.objects.instance [None req-1fb9e00b-0a9f-4d74-b5d0-eba8fc84c61f tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lazy-loading 'services' on Instance uuid e2777988-0bbf-496c-9c97-b206dbc94a62 {{(pid=129409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:53:27.678410 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-1fb9e00b-0a9f-4d74-b5d0-eba8fc84c61f tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62" status: 200 len: 1931 microversion: 2.75 time: 0.144865 Aug 10 17:53:27.688450 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 549/1107] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:53:27 2022] GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62 => generated 1931 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:53:27.688629 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-f47191b4-12b8-4045-8290-e4b8790de526 tempest-QuotasAdminTestJSON-1220511093 tempest-QuotasAdminTestJSON-1220511093-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-quota-sets/88d7445c0d374d3dbc1d93df283f823e" status: 200 len: 329 microversion: 2.1 time: 2.680219 Aug 10 17:53:27.688629 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 559/1108] 10.222.0.50 () {60 vars in 1263 bytes} [Wed Aug 10 17:53:25 2022] PUT /compute/v2.1/os-quota-sets/88d7445c0d374d3dbc1d93df283f823e => generated 329 bytes in 2682 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:53:27.689142 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-22fb442f-f165-45eb-8faa-81f7a1094fd6 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:27.689142 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-22fb442f-f165-45eb-8faa-81f7a1094fd6 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: d4920fe1-a755-43f8-aa8f-b38c20f8c98a] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:27.693348 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-22fb442f-f165-45eb-8faa-81f7a1094fd6 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:27.693830 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-22fb442f-f165-45eb-8faa-81f7a1094fd6 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:27.694261 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-22fb442f-f165-45eb-8faa-81f7a1094fd6 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:27.695066 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-22fb442f-f165-45eb-8faa-81f7a1094fd6 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:27.695395 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-22fb442f-f165-45eb-8faa-81f7a1094fd6 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:27.695950 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-22fb442f-f165-45eb-8faa-81f7a1094fd6 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:27.700787 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-88b4a2d4-44d8-40e1-8f44-a7b3af726e77 tempest-QuotasAdminTestJSON-1220511093 tempest-QuotasAdminTestJSON-1220511093-project-admin] Action: 'update', calling method: .version_select at 0x7fb345beb820>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:53:27.916705 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-22fb442f-f165-45eb-8faa-81f7a1094fd6 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:27.921422 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-22fb442f-f165-45eb-8faa-81f7a1094fd6 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/d4920fe1-a755-43f8-aa8f-b38c20f8c98a" status: 200 len: 1472 microversion: 2.1 time: 0.241019 Aug 10 17:53:27.924287 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 550/1109] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:27 2022] GET /compute/v2.1/servers/d4920fe1-a755-43f8-aa8f-b38c20f8c98a => generated 1472 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:53:27.934424 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-5f4fdd53-d634-4baa-b62e-b6cef61f4266 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:27.935081 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-5f4fdd53-d634-4baa-b62e-b6cef61f4266 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] [instance: bee3148a-3834-41bd-99e7-b5da75217256] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:27.942576 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-5f4fdd53-d634-4baa-b62e-b6cef61f4266 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:27.943078 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-5f4fdd53-d634-4baa-b62e-b6cef61f4266 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:27.943516 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-5f4fdd53-d634-4baa-b62e-b6cef61f4266 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:27.944223 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-5f4fdd53-d634-4baa-b62e-b6cef61f4266 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:27.944730 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-5f4fdd53-d634-4baa-b62e-b6cef61f4266 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:27.945230 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-5f4fdd53-d634-4baa-b62e-b6cef61f4266 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:27.968016 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-88b4a2d4-44d8-40e1-8f44-a7b3af726e77 tempest-QuotasAdminTestJSON-1220511093 tempest-QuotasAdminTestJSON-1220511093-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:27.969001 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-88b4a2d4-44d8-40e1-8f44-a7b3af726e77 tempest-QuotasAdminTestJSON-1220511093 tempest-QuotasAdminTestJSON-1220511093-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:27.969629 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-88b4a2d4-44d8-40e1-8f44-a7b3af726e77 tempest-QuotasAdminTestJSON-1220511093 tempest-QuotasAdminTestJSON-1220511093-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:27.970668 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-88b4a2d4-44d8-40e1-8f44-a7b3af726e77 tempest-QuotasAdminTestJSON-1220511093 tempest-QuotasAdminTestJSON-1220511093-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:27.971336 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-88b4a2d4-44d8-40e1-8f44-a7b3af726e77 tempest-QuotasAdminTestJSON-1220511093 tempest-QuotasAdminTestJSON-1220511093-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:27.971973 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-88b4a2d4-44d8-40e1-8f44-a7b3af726e77 tempest-QuotasAdminTestJSON-1220511093 tempest-QuotasAdminTestJSON-1220511093-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:28.129837 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-5f4fdd53-d634-4baa-b62e-b6cef61f4266 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2fd6acf18d4218ad143ccee2d0bb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7c2481a908406fa9c4562513fff665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:28.139761 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-5f4fdd53-d634-4baa-b62e-b6cef61f4266 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] 10.222.0.50 "GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256" status: 200 len: 1477 microversion: 2.1 time: 0.214419 Aug 10 17:53:28.140728 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 551/1110] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:27 2022] GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256 => generated 1477 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:53:28.554542 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-d3dfbf44-f4d7-480d-ba35-ae1d74fb59ad tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:28.556128 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-d3dfbf44-f4d7-480d-ba35-ae1d74fb59ad tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] [instance: 4390cd8e-2484-4205-9678-fb7332d1c78d] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:28.563419 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-d3dfbf44-f4d7-480d-ba35-ae1d74fb59ad tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:28.564155 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-d3dfbf44-f4d7-480d-ba35-ae1d74fb59ad tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:28.564626 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-d3dfbf44-f4d7-480d-ba35-ae1d74fb59ad tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:28.565445 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-d3dfbf44-f4d7-480d-ba35-ae1d74fb59ad tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:28.565998 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-d3dfbf44-f4d7-480d-ba35-ae1d74fb59ad tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:28.566469 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-d3dfbf44-f4d7-480d-ba35-ae1d74fb59ad tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:28.706070 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-d3dfbf44-f4d7-480d-ba35-ae1d74fb59ad tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f082ed04bc143679029c204e8a97160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c7c8eeb1b4065b25fe28eba30d0eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:28.715271 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-d3dfbf44-f4d7-480d-ba35-ae1d74fb59ad tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] 10.222.0.50 "GET /compute/v2.1/servers/4390cd8e-2484-4205-9678-fb7332d1c78d" status: 200 len: 1318 microversion: 2.1 time: 0.164593 Aug 10 17:53:28.726375 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 552/1111] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:28 2022] GET /compute/v2.1/servers/4390cd8e-2484-4205-9678-fb7332d1c78d => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:53:28.726375 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-bceae8fc-4487-4ec8-b8d1-e510553e457a tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:28.726375 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-bceae8fc-4487-4ec8-b8d1-e510553e457a tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] [instance: e2777988-0bbf-496c-9c97-b206dbc94a62] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:28.729839 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-bceae8fc-4487-4ec8-b8d1-e510553e457a tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:28.730439 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-bceae8fc-4487-4ec8-b8d1-e510553e457a tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:28.730900 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-bceae8fc-4487-4ec8-b8d1-e510553e457a tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:28.731766 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-bceae8fc-4487-4ec8-b8d1-e510553e457a tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:28.732227 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-bceae8fc-4487-4ec8-b8d1-e510553e457a tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:28.732677 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-bceae8fc-4487-4ec8-b8d1-e510553e457a tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:28.832969 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.objects.instance [None req-bceae8fc-4487-4ec8-b8d1-e510553e457a tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lazy-loading 'services' on Instance uuid e2777988-0bbf-496c-9c97-b206dbc94a62 {{(pid=129409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:53:28.856449 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-bceae8fc-4487-4ec8-b8d1-e510553e457a tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62" status: 200 len: 1931 microversion: 2.75 time: 0.139086 Aug 10 17:53:28.857719 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 553/1112] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:53:28 2022] GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62 => generated 1931 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:53:28.945631 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-f205e03c-848b-49d8-a757-aa0778154680 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:28.946724 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-f205e03c-848b-49d8-a757-aa0778154680 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: d4920fe1-a755-43f8-aa8f-b38c20f8c98a] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:28.958722 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-f205e03c-848b-49d8-a757-aa0778154680 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:28.965578 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-f205e03c-848b-49d8-a757-aa0778154680 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:28.965578 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-f205e03c-848b-49d8-a757-aa0778154680 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:28.965578 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-f205e03c-848b-49d8-a757-aa0778154680 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:28.965578 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-f205e03c-848b-49d8-a757-aa0778154680 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:28.965578 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-f205e03c-848b-49d8-a757-aa0778154680 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:29.122226 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-f205e03c-848b-49d8-a757-aa0778154680 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:29.128230 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-f205e03c-848b-49d8-a757-aa0778154680 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/d4920fe1-a755-43f8-aa8f-b38c20f8c98a" status: 200 len: 1472 microversion: 2.1 time: 0.190490 Aug 10 17:53:29.129865 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 554/1113] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:28 2022] GET /compute/v2.1/servers/d4920fe1-a755-43f8-aa8f-b38c20f8c98a => generated 1472 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:53:29.151113 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [req-cddf4825-9d0d-4926-9831-4615c87be43a req-10ac7e0c-eb07-4d72-a289-9ca45f8841ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bee3148a-3834-41bd-99e7-b5da75217256", "name": "network-vif-unplugged", "status": "completed", "tag": "2f16a409-b711-4b31-9eb5-9884dbbe9489"}]} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:53:29.164038 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-cddf4825-9d0d-4926-9831-4615c87be43a req-10ac7e0c-eb07-4d72-a289-9ca45f8841ce service nova] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:29.164754 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-cddf4825-9d0d-4926-9831-4615c87be43a req-10ac7e0c-eb07-4d72-a289-9ca45f8841ce service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:29.165356 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-cddf4825-9d0d-4926-9831-4615c87be43a req-10ac7e0c-eb07-4d72-a289-9ca45f8841ce service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:29.178376 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.compute.server_external_events [req-cddf4825-9d0d-4926-9831-4615c87be43a req-10ac7e0c-eb07-4d72-a289-9ca45f8841ce service nova] Creating event network-vif-unplugged:2f16a409-b711-4b31-9eb5-9884dbbe9489 for instance bee3148a-3834-41bd-99e7-b5da75217256 on n-h2-852296-2 Aug 10 17:53:29.185728 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [req-cddf4825-9d0d-4926-9831-4615c87be43a req-10ac7e0c-eb07-4d72-a289-9ca45f8841ce service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039798 Aug 10 17:53:29.186938 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 555/1114] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 10 17:53:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:53:29.193631 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-21ecfe29-3855-4bae-9009-7914506bd611 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:29.194470 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-21ecfe29-3855-4bae-9009-7914506bd611 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] [instance: bee3148a-3834-41bd-99e7-b5da75217256] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:29.201712 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-21ecfe29-3855-4bae-9009-7914506bd611 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:29.203036 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-21ecfe29-3855-4bae-9009-7914506bd611 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:29.203651 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-21ecfe29-3855-4bae-9009-7914506bd611 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:29.204481 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-21ecfe29-3855-4bae-9009-7914506bd611 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:29.205010 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-21ecfe29-3855-4bae-9009-7914506bd611 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:29.205583 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-21ecfe29-3855-4bae-9009-7914506bd611 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:29.366569 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-21ecfe29-3855-4bae-9009-7914506bd611 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2fd6acf18d4218ad143ccee2d0bb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7c2481a908406fa9c4562513fff665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:29.381175 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-21ecfe29-3855-4bae-9009-7914506bd611 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] 10.222.0.50 "GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256" status: 200 len: 1477 microversion: 2.1 time: 0.192775 Aug 10 17:53:29.392706 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 556/1115] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:29 2022] GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256 => generated 1477 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:53:29.392706 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-2b25ba4c-4ff7-4f70-bab8-7a93e9b95da9 tempest-ServersTestMultiNic-747354117 tempest-ServersTestMultiNic-747354117-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-623827626", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "9230cf21-2408-4b28-8cd5-8f8d9d4426f0"}, {"uuid": "26c020e4-40fd-4b26-bf2f-54e3208f68df"}, {"uuid": "9230cf21-2408-4b28-8cd5-8f8d9d4426f0"}]}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:53:29.465899 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.network.neutron [None req-2b25ba4c-4ff7-4f70-bab8-7a93e9b95da9 tempest-ServersTestMultiNic-747354117 tempest-ServersTestMultiNic-747354117-project] validate_networks() for [('9230cf21-2408-4b28-8cd5-8f8d9d4426f0', None, None, None, None, None), ('26c020e4-40fd-4b26-bf2f-54e3208f68df', None, None, None, None, None), ('9230cf21-2408-4b28-8cd5-8f8d9d4426f0', None, None, None, None, None)] {{(pid=129409) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 17:53:29.641452 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_cell0:SELECT=71 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:53:29.700823 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [None req-2b25ba4c-4ff7-4f70-bab8-7a93e9b95da9 tempest-ServersTestMultiNic-747354117 tempest-ServersTestMultiNic-747354117-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-3cb5968d-711c-45ce-9f5a-932d3d26431b) Aug 10 17:53:29.700823 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:53:29.700823 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:53:29.700823 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:53:29.700823 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:53:29.700823 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:53:29.700823 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:53:29.700823 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:53:29.700823 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:53:29.700823 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:53:29.700823 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 17:53:29.700823 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 17:53:29.700823 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 17:53:29.700823 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 17:53:29.700823 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 17:53:29.700823 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 17:53:29.700823 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 17:53:29.700823 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 17:53:29.700823 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 17:53:29.700823 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 17:53:29.700823 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 17:53:29.700823 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 17:53:29.700823 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 17:53:29.700823 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 17:53:29.700823 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 17:53:29.700823 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 17:53:29.700823 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 17:53:29.700823 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:53:29.700823 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:53:29.700823 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 17:53:29.700823 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 17:53:29.700823 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:53:29.700823 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:53:29.700823 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:53:29.700823 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:53:29.700823 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:53:29.700823 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:53:29.700823 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:53:29.700823 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:53:29.700823 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:53:29.700823 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:53:29.700823 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 17:53:29.700823 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 17:53:29.700823 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 17:53:29.700823 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 17:53:29.700823 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 17:53:29.700823 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 17:53:29.700823 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 17:53:29.700823 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 17:53:29.700823 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 17:53:29.700823 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 17:53:29.700823 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 17:53:29.700823 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 17:53:29.705603 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 17:53:29.705603 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 17:53:29.705603 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 17:53:29.705603 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 17:53:29.705603 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 17:53:29.705603 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 17:53:29.705603 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 17:53:29.705603 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 17:53:29.705603 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 17:53:29.705603 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 17:53:29.705603 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 17:53:29.705603 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 17:53:29.705603 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 17:53:29.705603 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 17:53:29.705603 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-3cb5968d-711c-45ce-9f5a-932d3d26431b) Aug 10 17:53:29.705603 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:53:29.705603 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-2b25ba4c-4ff7-4f70-bab8-7a93e9b95da9 tempest-ServersTestMultiNic-747354117 tempest-ServersTestMultiNic-747354117-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:53:29.705603 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:53:29.705603 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-2b25ba4c-4ff7-4f70-bab8-7a93e9b95da9 tempest-ServersTestMultiNic-747354117 tempest-ServersTestMultiNic-747354117-project] Request method failure captured: Aug 10 17:53:29.705603 n-d-852296-2 devstack@n-api.service[129409]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 17:53:29.705603 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 17:53:29.705603 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 17:53:29.705603 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 17:53:29.705603 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 304 Aug 10 17:53:29.705603 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 17:53:29.705603 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 17:53:29.705603 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 17:53:29.705603 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 17:53:29.705603 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8_CTR0vyiG9snnq4cJ5OL7ozNljeQoMtfR8BCOsdMjIgTqz7F6-Rr--KRU17Vf7baGkxc9GVtRlYaEK9Phg_dGiJuswYF2QwJJXZqDL24raheeZNcRWFxSpBGWGxvrFqQ9z0wlis5GQVc6EMZ8FTYXvDrc4UgwJUrwlleBYVk9PrqNU Aug 10 17:53:29.705603 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 17:53:29.705603 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 17:53:29.705603 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 17:53:29.705603 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 17:53:29.705603 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 17:53:29.705603 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 17:53:29.705603 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: 6ba1cff7fb4948b188ee5035d62ca33d Aug 10 17:53:29.705603 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-ServersTestMultiNic-747354117 Aug 10 17:53:29.705603 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 17:53:29.705603 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 17:53:29.705603 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6ba1cff7fb4948b188ee5035d62ca33d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6ba1cff7fb4948b188ee5035d62ca33d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6ba1cff7fb4948b188ee5035d62ca33d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6ba1cff7fb4948b188ee5035d62ca33d", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:53:29.705603 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-ServersTestMultiNic-747354117 Aug 10 17:53:29.705603 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: 6ba1cff7fb4948b188ee5035d62ca33d Aug 10 17:53:29.705603 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-ServersTestMultiNic-747354117 Aug 10 17:53:29.705603 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-ServersTestMultiNic-747354117-project Aug 10 17:53:29.705603 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 17:53:29.705603 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 17:53:29.705603 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: 00a7707e6faf464aa686a4e4472c8848 Aug 10 17:53:29.705603 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-ServersTestMultiNic-747354117-project Aug 10 17:53:29.705603 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:53:29.705603 n-d-852296-2 devstack@n-api.service[129409]: {"server": {"name": "tempest-ServersTestMultiNic-server-623827626", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "9230cf21-2408-4b28-8cd5-8f8d9d4426f0"}, {"uuid": "26c020e4-40fd-4b26-bf2f-54e3208f68df"}, {"uuid": "9230cf21-2408-4b28-8cd5-8f8d9d4426f0"}]}} Aug 10 17:53:29.705603 n-d-852296-2 devstack@n-api.service[129409]: method: > Aug 10 17:53:29.705603 n-d-852296-2 devstack@n-api.service[129409]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:53:29.705603 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:53:29.705603 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'body': {'server': {'name': 'tempest-ServersTestMultiNic-server-623827626', 'imageRef': 'a735ff26-463a-4ffe-a981-ab9d9baa494f', 'flavorRef': '452', 'networks': [{'uuid': '9230cf21-2408-4b28-8cd5-8f8d9d4426f0'}, {'uuid': '26c020e4-40fd-4b26-bf2f-54e3208f68df'}, {'uuid': '9230cf21-2408-4b28-8cd5-8f8d9d4426f0'}]}}} Aug 10 17:53:29.711625 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:53:29.711625 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:53:29.711625 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:53:29.711625 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:53:29.711625 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:53:29.711625 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:53:29.711625 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:53:29.711625 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:53:29.711625 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:53:29.711625 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:53:29.711625 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 17:53:29.711625 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 17:53:29.711625 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 17:53:29.711625 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 17:53:29.711625 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 17:53:29.711625 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 17:53:29.711625 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 17:53:29.711625 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 17:53:29.711625 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 17:53:29.711625 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 17:53:29.711625 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 17:53:29.711625 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 17:53:29.711625 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 17:53:29.711625 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 17:53:29.711625 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 17:53:29.711625 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 17:53:29.711625 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 17:53:29.711625 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:53:29.711625 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:53:29.711625 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 17:53:29.711625 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 17:53:29.711625 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:53:29.711625 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:53:29.711625 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:53:29.711625 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:53:29.711625 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:53:29.711625 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:53:29.711625 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:53:29.711625 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:53:29.711625 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:53:29.711625 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:53:29.711625 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 17:53:29.711625 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 17:53:29.711625 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 17:53:29.711625 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 17:53:29.711625 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 17:53:29.711625 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 17:53:29.711625 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 17:53:29.711625 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 17:53:29.711625 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 17:53:29.711625 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 17:53:29.711625 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 17:53:29.711625 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 17:53:29.711625 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 17:53:29.711625 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 17:53:29.711625 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 17:53:29.721806 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 17:53:29.721806 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 17:53:29.721806 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 17:53:29.721806 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 17:53:29.721806 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 17:53:29.721806 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 17:53:29.721806 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 17:53:29.721806 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 17:53:29.721806 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 17:53:29.721806 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 17:53:29.721806 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 17:53:29.721806 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-3cb5968d-711c-45ce-9f5a-932d3d26431b) Aug 10 17:53:29.721806 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:53:29.721806 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:53:29.721806 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:53:29.721806 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:53:29.721806 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:53:29.721806 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:53:29.721806 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:53:29.721806 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:53:29.721806 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 10 17:53:29.721806 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 10 17:53:29.721806 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:53:29.721806 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:53:29.721806 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:53:29.721806 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:53:29.721806 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:53:29.721806 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:53:29.721806 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:53:29.721806 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:53:29.721806 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:53:29.721806 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:53:29.721806 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:53:29.721806 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:53:29.721806 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:53:29.721806 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-2b25ba4c-4ff7-4f70-bab8-7a93e9b95da9 tempest-ServersTestMultiNic-747354117 tempest-ServersTestMultiNic-747354117-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:53:29.721806 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:53:29.721806 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-2b25ba4c-4ff7-4f70-bab8-7a93e9b95da9 tempest-ServersTestMultiNic-747354117 tempest-ServersTestMultiNic-747354117-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.323230 Aug 10 17:53:29.721806 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 557/1116] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 17:53:29 2022] POST /compute/v2.1/servers => generated 214 bytes in 328 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 10 17:53:29.738108 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-7fb24133-667e-4cdf-9e9e-5bfcd0790466 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:29.738755 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-7fb24133-667e-4cdf-9e9e-5bfcd0790466 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] [instance: 4390cd8e-2484-4205-9678-fb7332d1c78d] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:29.748816 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7fb24133-667e-4cdf-9e9e-5bfcd0790466 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:29.749317 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7fb24133-667e-4cdf-9e9e-5bfcd0790466 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:29.749761 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7fb24133-667e-4cdf-9e9e-5bfcd0790466 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:29.750474 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7fb24133-667e-4cdf-9e9e-5bfcd0790466 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:29.751467 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7fb24133-667e-4cdf-9e9e-5bfcd0790466 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:29.751467 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7fb24133-667e-4cdf-9e9e-5bfcd0790466 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:29.923271 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=21,nova_api:UPDATE=6 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:53:30.003236 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-7fb24133-667e-4cdf-9e9e-5bfcd0790466 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f082ed04bc143679029c204e8a97160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c7c8eeb1b4065b25fe28eba30d0eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:30.017406 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-7fb24133-667e-4cdf-9e9e-5bfcd0790466 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] 10.222.0.50 "GET /compute/v2.1/servers/4390cd8e-2484-4205-9678-fb7332d1c78d" status: 200 len: 1318 microversion: 2.1 time: 0.283662 Aug 10 17:53:30.031523 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 558/1117] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:29 2022] GET /compute/v2.1/servers/4390cd8e-2484-4205-9678-fb7332d1c78d => generated 1318 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:53:30.052499 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-7277e38e-f4d6-4e8b-bbf3-5b1a72a053d4 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:30.052499 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-7277e38e-f4d6-4e8b-bbf3-5b1a72a053d4 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] [instance: e2777988-0bbf-496c-9c97-b206dbc94a62] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:30.059641 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7277e38e-f4d6-4e8b-bbf3-5b1a72a053d4 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:30.060264 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7277e38e-f4d6-4e8b-bbf3-5b1a72a053d4 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:30.060651 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7277e38e-f4d6-4e8b-bbf3-5b1a72a053d4 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:30.061368 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7277e38e-f4d6-4e8b-bbf3-5b1a72a053d4 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:30.062001 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7277e38e-f4d6-4e8b-bbf3-5b1a72a053d4 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:30.062444 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7277e38e-f4d6-4e8b-bbf3-5b1a72a053d4 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:30.190267 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.objects.instance [None req-7277e38e-f4d6-4e8b-bbf3-5b1a72a053d4 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lazy-loading 'services' on Instance uuid e2777988-0bbf-496c-9c97-b206dbc94a62 {{(pid=129409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:53:30.222125 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-7277e38e-f4d6-4e8b-bbf3-5b1a72a053d4 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62" status: 200 len: 1931 microversion: 2.75 time: 0.197353 Aug 10 17:53:30.222125 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 559/1118] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:53:30 2022] GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62 => generated 1931 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:53:30.229308 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-fe25a77b-8382-4914-bae7-ca5917370673 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:30.230452 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-fe25a77b-8382-4914-bae7-ca5917370673 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: d4920fe1-a755-43f8-aa8f-b38c20f8c98a] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:30.262658 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-fe25a77b-8382-4914-bae7-ca5917370673 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:30.263156 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-fe25a77b-8382-4914-bae7-ca5917370673 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:30.263585 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-fe25a77b-8382-4914-bae7-ca5917370673 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:30.266080 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-fe25a77b-8382-4914-bae7-ca5917370673 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:30.266209 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-fe25a77b-8382-4914-bae7-ca5917370673 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:30.266571 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-fe25a77b-8382-4914-bae7-ca5917370673 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:30.554543 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-fe25a77b-8382-4914-bae7-ca5917370673 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:30.565997 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-fe25a77b-8382-4914-bae7-ca5917370673 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/d4920fe1-a755-43f8-aa8f-b38c20f8c98a" status: 200 len: 1472 microversion: 2.1 time: 0.342321 Aug 10 17:53:30.588708 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 560/1119] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:30 2022] GET /compute/v2.1/servers/d4920fe1-a755-43f8-aa8f-b38c20f8c98a => generated 1472 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:53:30.588708 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-67239aed-a440-4058-8010-442f9b17b4fc tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:30.588708 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-67239aed-a440-4058-8010-442f9b17b4fc tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] [instance: bee3148a-3834-41bd-99e7-b5da75217256] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:30.597425 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-67239aed-a440-4058-8010-442f9b17b4fc tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:30.598235 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-67239aed-a440-4058-8010-442f9b17b4fc tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:30.599843 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-67239aed-a440-4058-8010-442f9b17b4fc tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:30.600846 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-67239aed-a440-4058-8010-442f9b17b4fc tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:30.601531 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-67239aed-a440-4058-8010-442f9b17b4fc tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:30.602153 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-67239aed-a440-4058-8010-442f9b17b4fc tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:30.827636 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-67239aed-a440-4058-8010-442f9b17b4fc tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2fd6acf18d4218ad143ccee2d0bb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7c2481a908406fa9c4562513fff665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:30.838333 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-67239aed-a440-4058-8010-442f9b17b4fc tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] 10.222.0.50 "GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256" status: 200 len: 1477 microversion: 2.1 time: 0.257424 Aug 10 17:53:30.839598 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 561/1120] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:30 2022] GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256 => generated 1477 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:53:31.038971 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-c09cb9a7-fb6e-4967-ae53-1703af7d5a3e tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:31.041385 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-c09cb9a7-fb6e-4967-ae53-1703af7d5a3e tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] [instance: 4390cd8e-2484-4205-9678-fb7332d1c78d] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:31.053372 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c09cb9a7-fb6e-4967-ae53-1703af7d5a3e tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:31.053894 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c09cb9a7-fb6e-4967-ae53-1703af7d5a3e tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:31.054339 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c09cb9a7-fb6e-4967-ae53-1703af7d5a3e tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:31.055063 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c09cb9a7-fb6e-4967-ae53-1703af7d5a3e tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:31.055528 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c09cb9a7-fb6e-4967-ae53-1703af7d5a3e tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:31.055971 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c09cb9a7-fb6e-4967-ae53-1703af7d5a3e tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:31.324381 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-c09cb9a7-fb6e-4967-ae53-1703af7d5a3e tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f082ed04bc143679029c204e8a97160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c7c8eeb1b4065b25fe28eba30d0eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:31.332900 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-c09cb9a7-fb6e-4967-ae53-1703af7d5a3e tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] 10.222.0.50 "GET /compute/v2.1/servers/4390cd8e-2484-4205-9678-fb7332d1c78d" status: 200 len: 1318 microversion: 2.1 time: 0.297692 Aug 10 17:53:31.333848 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 562/1121] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:31 2022] GET /compute/v2.1/servers/4390cd8e-2484-4205-9678-fb7332d1c78d => generated 1318 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:53:31.353507 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-fdf85390-3f59-4f7c-830e-3f86a28ba618 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:31.354953 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-fdf85390-3f59-4f7c-830e-3f86a28ba618 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] [instance: e2777988-0bbf-496c-9c97-b206dbc94a62] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:31.361701 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-fdf85390-3f59-4f7c-830e-3f86a28ba618 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:31.362547 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-fdf85390-3f59-4f7c-830e-3f86a28ba618 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:31.363372 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-fdf85390-3f59-4f7c-830e-3f86a28ba618 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:31.364319 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-fdf85390-3f59-4f7c-830e-3f86a28ba618 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:31.364972 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-fdf85390-3f59-4f7c-830e-3f86a28ba618 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:31.365583 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-fdf85390-3f59-4f7c-830e-3f86a28ba618 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:31.463446 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.objects.instance [None req-fdf85390-3f59-4f7c-830e-3f86a28ba618 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lazy-loading 'services' on Instance uuid e2777988-0bbf-496c-9c97-b206dbc94a62 {{(pid=129409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:53:31.495287 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-fdf85390-3f59-4f7c-830e-3f86a28ba618 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62" status: 200 len: 1931 microversion: 2.75 time: 0.147819 Aug 10 17:53:31.496170 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 563/1122] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:53:31 2022] GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62 => generated 1931 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:53:31.598488 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-81cdce15-826c-4062-874f-075ab0811ab9 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:31.599509 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-81cdce15-826c-4062-874f-075ab0811ab9 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: d4920fe1-a755-43f8-aa8f-b38c20f8c98a] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:31.602918 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_cell0:SELECT=13 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:53:31.606731 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-81cdce15-826c-4062-874f-075ab0811ab9 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:31.607226 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-81cdce15-826c-4062-874f-075ab0811ab9 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:31.611300 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-81cdce15-826c-4062-874f-075ab0811ab9 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:31.611300 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-81cdce15-826c-4062-874f-075ab0811ab9 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:31.611300 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-81cdce15-826c-4062-874f-075ab0811ab9 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:31.611300 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-81cdce15-826c-4062-874f-075ab0811ab9 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:31.833331 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-81cdce15-826c-4062-874f-075ab0811ab9 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:31.841721 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-81cdce15-826c-4062-874f-075ab0811ab9 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/d4920fe1-a755-43f8-aa8f-b38c20f8c98a" status: 200 len: 1472 microversion: 2.1 time: 0.247272 Aug 10 17:53:31.842487 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 564/1123] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:31 2022] GET /compute/v2.1/servers/d4920fe1-a755-43f8-aa8f-b38c20f8c98a => generated 1472 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:53:31.861948 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-a896faf8-c3e3-4eec-a4b0-8b5f4cd7b756 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:31.862560 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-a896faf8-c3e3-4eec-a4b0-8b5f4cd7b756 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] [instance: bee3148a-3834-41bd-99e7-b5da75217256] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:31.868713 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a896faf8-c3e3-4eec-a4b0-8b5f4cd7b756 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:31.869202 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a896faf8-c3e3-4eec-a4b0-8b5f4cd7b756 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:31.869647 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a896faf8-c3e3-4eec-a4b0-8b5f4cd7b756 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:31.871076 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a896faf8-c3e3-4eec-a4b0-8b5f4cd7b756 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:31.871702 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a896faf8-c3e3-4eec-a4b0-8b5f4cd7b756 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:31.872145 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a896faf8-c3e3-4eec-a4b0-8b5f4cd7b756 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:31.960120 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-88b4a2d4-44d8-40e1-8f44-a7b3af726e77 tempest-QuotasAdminTestJSON-1220511093 tempest-QuotasAdminTestJSON-1220511093-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-quota-sets/88d7445c0d374d3dbc1d93df283f823e" status: 200 len: 329 microversion: 2.1 time: 4.268669 Aug 10 17:53:31.969426 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 560/1124] 10.222.0.50 () {60 vars in 1263 bytes} [Wed Aug 10 17:53:27 2022] PUT /compute/v2.1/os-quota-sets/88d7445c0d374d3dbc1d93df283f823e => generated 329 bytes in 4278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:53:32.071701 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-a896faf8-c3e3-4eec-a4b0-8b5f4cd7b756 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2fd6acf18d4218ad143ccee2d0bb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7c2481a908406fa9c4562513fff665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:32.080305 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-a896faf8-c3e3-4eec-a4b0-8b5f4cd7b756 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] 10.222.0.50 "GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256" status: 200 len: 1477 microversion: 2.1 time: 0.222390 Aug 10 17:53:32.081280 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 565/1125] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:31 2022] GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256 => generated 1477 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:53:32.355191 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-981846e5-edd4-4140-8ad9-70cbbc2bbfe1 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:32.356287 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-981846e5-edd4-4140-8ad9-70cbbc2bbfe1 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] [instance: 4390cd8e-2484-4205-9678-fb7332d1c78d] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:32.364101 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-981846e5-edd4-4140-8ad9-70cbbc2bbfe1 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:32.364603 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-981846e5-edd4-4140-8ad9-70cbbc2bbfe1 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:32.365034 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-981846e5-edd4-4140-8ad9-70cbbc2bbfe1 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:32.366378 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-981846e5-edd4-4140-8ad9-70cbbc2bbfe1 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:32.366755 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-981846e5-edd4-4140-8ad9-70cbbc2bbfe1 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:32.367182 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-981846e5-edd4-4140-8ad9-70cbbc2bbfe1 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:32.525888 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-dcee43ee-f701-4d53-bd6e-510b591be4db tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:32.526756 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-dcee43ee-f701-4d53-bd6e-510b591be4db tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] [instance: e2777988-0bbf-496c-9c97-b206dbc94a62] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:32.535576 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_cell0:SELECT=34 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:53:32.540663 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-dcee43ee-f701-4d53-bd6e-510b591be4db tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:32.542107 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-dcee43ee-f701-4d53-bd6e-510b591be4db tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:32.542606 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-dcee43ee-f701-4d53-bd6e-510b591be4db tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:32.545661 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-dcee43ee-f701-4d53-bd6e-510b591be4db tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:32.546162 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-dcee43ee-f701-4d53-bd6e-510b591be4db tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:32.546633 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-dcee43ee-f701-4d53-bd6e-510b591be4db tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:32.718740 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.objects.instance [None req-dcee43ee-f701-4d53-bd6e-510b591be4db tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lazy-loading 'services' on Instance uuid e2777988-0bbf-496c-9c97-b206dbc94a62 {{(pid=129409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:53:32.744456 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-dcee43ee-f701-4d53-bd6e-510b591be4db tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62" status: 200 len: 1931 microversion: 2.75 time: 0.223117 Aug 10 17:53:32.746500 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 566/1126] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:53:32 2022] GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62 => generated 1931 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:53:32.868423 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-ffe88bd3-21e5-47ec-a224-58ea4ba9ee58 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:32.869728 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-ffe88bd3-21e5-47ec-a224-58ea4ba9ee58 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: d4920fe1-a755-43f8-aa8f-b38c20f8c98a] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:32.884939 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:53:32.897445 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-ffe88bd3-21e5-47ec-a224-58ea4ba9ee58 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:32.900722 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-ffe88bd3-21e5-47ec-a224-58ea4ba9ee58 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:32.904576 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-ffe88bd3-21e5-47ec-a224-58ea4ba9ee58 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:32.908805 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-ffe88bd3-21e5-47ec-a224-58ea4ba9ee58 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:32.911161 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-ffe88bd3-21e5-47ec-a224-58ea4ba9ee58 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:32.911687 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-ffe88bd3-21e5-47ec-a224-58ea4ba9ee58 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:32.956544 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-981846e5-edd4-4140-8ad9-70cbbc2bbfe1 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f082ed04bc143679029c204e8a97160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c7c8eeb1b4065b25fe28eba30d0eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:32.989676 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-981846e5-edd4-4140-8ad9-70cbbc2bbfe1 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] 10.222.0.50 "GET /compute/v2.1/servers/4390cd8e-2484-4205-9678-fb7332d1c78d" status: 200 len: 1318 microversion: 2.1 time: 0.624161 Aug 10 17:53:32.999821 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 561/1127] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:32 2022] GET /compute/v2.1/servers/4390cd8e-2484-4205-9678-fb7332d1c78d => generated 1318 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:53:33.101656 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-40aadf43-e098-4f6b-8b1c-f5e944ba1c07 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:33.102373 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-40aadf43-e098-4f6b-8b1c-f5e944ba1c07 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] [instance: bee3148a-3834-41bd-99e7-b5da75217256] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:33.116333 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-40aadf43-e098-4f6b-8b1c-f5e944ba1c07 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:33.116906 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-40aadf43-e098-4f6b-8b1c-f5e944ba1c07 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:33.117356 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-40aadf43-e098-4f6b-8b1c-f5e944ba1c07 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:33.118085 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-40aadf43-e098-4f6b-8b1c-f5e944ba1c07 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:33.118540 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-40aadf43-e098-4f6b-8b1c-f5e944ba1c07 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:33.118962 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-40aadf43-e098-4f6b-8b1c-f5e944ba1c07 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:33.320544 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-ffe88bd3-21e5-47ec-a224-58ea4ba9ee58 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:33.328181 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-ffe88bd3-21e5-47ec-a224-58ea4ba9ee58 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/d4920fe1-a755-43f8-aa8f-b38c20f8c98a" status: 200 len: 1472 microversion: 2.1 time: 0.465271 Aug 10 17:53:33.339609 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 567/1128] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:32 2022] GET /compute/v2.1/servers/d4920fe1-a755-43f8-aa8f-b38c20f8c98a => generated 1472 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:53:33.451229 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [req-ae9e7e53-714b-47eb-b989-b12f4fee0f04 req-5a1a6283-af2e-4f43-a431-d58238dcf312 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4390cd8e-2484-4205-9678-fb7332d1c78d", "name": "network-vif-plugged", "status": "completed", "tag": "5248f076-be99-4a79-a578-5fcdf9112aab"}]} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:53:33.462109 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_cell1:SELECT=100 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:53:33.468271 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-ae9e7e53-714b-47eb-b989-b12f4fee0f04 req-5a1a6283-af2e-4f43-a431-d58238dcf312 service nova] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:33.468855 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-ae9e7e53-714b-47eb-b989-b12f4fee0f04 req-5a1a6283-af2e-4f43-a431-d58238dcf312 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:33.469560 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-ae9e7e53-714b-47eb-b989-b12f4fee0f04 req-5a1a6283-af2e-4f43-a431-d58238dcf312 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:33.485692 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.compute.server_external_events [req-ae9e7e53-714b-47eb-b989-b12f4fee0f04 req-5a1a6283-af2e-4f43-a431-d58238dcf312 service nova] Creating event network-vif-plugged:5248f076-be99-4a79-a578-5fcdf9112aab for instance 4390cd8e-2484-4205-9678-fb7332d1c78d on n-h1-852296-2 Aug 10 17:53:33.491107 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [req-ae9e7e53-714b-47eb-b989-b12f4fee0f04 req-5a1a6283-af2e-4f43-a431-d58238dcf312 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048908 Aug 10 17:53:33.492710 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 568/1129] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 10 17:53:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:53:33.581315 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-40aadf43-e098-4f6b-8b1c-f5e944ba1c07 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2fd6acf18d4218ad143ccee2d0bb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7c2481a908406fa9c4562513fff665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:33.596660 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-40aadf43-e098-4f6b-8b1c-f5e944ba1c07 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] 10.222.0.50 "GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256" status: 200 len: 1477 microversion: 2.1 time: 0.494244 Aug 10 17:53:33.599317 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 562/1130] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:33 2022] GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256 => generated 1477 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:53:33.777353 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-2fc04a31-57b5-4396-8afc-4e4d7e5fefa5 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:33.785912 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-2fc04a31-57b5-4396-8afc-4e4d7e5fefa5 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] [instance: e2777988-0bbf-496c-9c97-b206dbc94a62] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:33.813166 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-2fc04a31-57b5-4396-8afc-4e4d7e5fefa5 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:33.816797 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-2fc04a31-57b5-4396-8afc-4e4d7e5fefa5 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:33.821877 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-2fc04a31-57b5-4396-8afc-4e4d7e5fefa5 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:33.823911 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-2fc04a31-57b5-4396-8afc-4e4d7e5fefa5 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:33.828038 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-2fc04a31-57b5-4396-8afc-4e4d7e5fefa5 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:33.829112 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-2fc04a31-57b5-4396-8afc-4e4d7e5fefa5 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:33.842009 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [req-c2c2c80f-8dd5-4770-b1a5-95d15cee87b9 req-87d504d7-96bc-4055-9023-92d2f490c6cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4920fe1-a755-43f8-aa8f-b38c20f8c98a", "name": "network-vif-deleted", "tag": "32763ad4-0ca1-47d1-838d-b554a0f3bd13"}]} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:53:33.862903 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-c2c2c80f-8dd5-4770-b1a5-95d15cee87b9 req-87d504d7-96bc-4055-9023-92d2f490c6cc service nova] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:33.863386 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-c2c2c80f-8dd5-4770-b1a5-95d15cee87b9 req-87d504d7-96bc-4055-9023-92d2f490c6cc service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:33.863815 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-c2c2c80f-8dd5-4770-b1a5-95d15cee87b9 req-87d504d7-96bc-4055-9023-92d2f490c6cc service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:33.886582 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.compute.server_external_events [req-c2c2c80f-8dd5-4770-b1a5-95d15cee87b9 req-87d504d7-96bc-4055-9023-92d2f490c6cc service nova] Creating event network-vif-deleted:32763ad4-0ca1-47d1-838d-b554a0f3bd13 for instance d4920fe1-a755-43f8-aa8f-b38c20f8c98a on n-h1-852296-2 Aug 10 17:53:33.892691 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [req-c2c2c80f-8dd5-4770-b1a5-95d15cee87b9 req-87d504d7-96bc-4055-9023-92d2f490c6cc service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055143 Aug 10 17:53:33.900370 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 563/1131] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 10 17:53:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:53:34.005267 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.objects.instance [None req-2fc04a31-57b5-4396-8afc-4e4d7e5fefa5 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] Lazy-loading 'services' on Instance uuid e2777988-0bbf-496c-9c97-b206dbc94a62 {{(pid=129409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:53:34.006255 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-a1e3b22a-b4a7-4cf0-8307-576b189cf57f tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:34.007703 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-a1e3b22a-b4a7-4cf0-8307-576b189cf57f tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] [instance: 4390cd8e-2484-4205-9678-fb7332d1c78d] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:34.014725 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a1e3b22a-b4a7-4cf0-8307-576b189cf57f tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:34.015213 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a1e3b22a-b4a7-4cf0-8307-576b189cf57f tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:34.015667 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a1e3b22a-b4a7-4cf0-8307-576b189cf57f tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:34.016757 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a1e3b22a-b4a7-4cf0-8307-576b189cf57f tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:34.017164 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a1e3b22a-b4a7-4cf0-8307-576b189cf57f tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:34.017823 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a1e3b22a-b4a7-4cf0-8307-576b189cf57f tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:34.063546 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-2fc04a31-57b5-4396-8afc-4e4d7e5fefa5 tempest-ServersAdmin275Test-1205004515 tempest-ServersAdmin275Test-1205004515-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62" status: 200 len: 1916 microversion: 2.75 time: 0.295459 Aug 10 17:53:34.065498 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 569/1132] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:53:33 2022] GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62 => generated 1916 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:53:34.152891 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-fc7c88a0-85aa-47c9-afd4-a1d05380e3fe tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:34.152891 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-fc7c88a0-85aa-47c9-afd4-a1d05380e3fe tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] [instance: e2777988-0bbf-496c-9c97-b206dbc94a62] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:34.152891 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-fc7c88a0-85aa-47c9-afd4-a1d05380e3fe tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:34.152891 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-fc7c88a0-85aa-47c9-afd4-a1d05380e3fe tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:34.152891 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-fc7c88a0-85aa-47c9-afd4-a1d05380e3fe tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:34.152891 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-fc7c88a0-85aa-47c9-afd4-a1d05380e3fe tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:34.152891 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-fc7c88a0-85aa-47c9-afd4-a1d05380e3fe tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:34.152891 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-fc7c88a0-85aa-47c9-afd4-a1d05380e3fe tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:34.175658 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-fc7c88a0-85aa-47c9-afd4-a1d05380e3fe tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] [instance: e2777988-0bbf-496c-9c97-b206dbc94a62] Going to try to terminate instance {{(pid=129409) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 17:53:34.244586 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-a1e3b22a-b4a7-4cf0-8307-576b189cf57f tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f082ed04bc143679029c204e8a97160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c7c8eeb1b4065b25fe28eba30d0eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:34.257557 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-a1e3b22a-b4a7-4cf0-8307-576b189cf57f tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] 10.222.0.50 "GET /compute/v2.1/servers/4390cd8e-2484-4205-9678-fb7332d1c78d" status: 200 len: 1318 microversion: 2.1 time: 0.256189 Aug 10 17:53:34.258709 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 564/1133] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:33 2022] GET /compute/v2.1/servers/4390cd8e-2484-4205-9678-fb7332d1c78d => generated 1318 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:53:34.352727 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-18c9ef16-8919-41d8-a94c-7a0dd3178485 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:34.353743 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-18c9ef16-8919-41d8-a94c-7a0dd3178485 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: d4920fe1-a755-43f8-aa8f-b38c20f8c98a] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:34.365508 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-18c9ef16-8919-41d8-a94c-7a0dd3178485 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:34.366971 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-18c9ef16-8919-41d8-a94c-7a0dd3178485 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:34.367681 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-18c9ef16-8919-41d8-a94c-7a0dd3178485 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:34.369010 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-18c9ef16-8919-41d8-a94c-7a0dd3178485 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:34.369778 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-18c9ef16-8919-41d8-a94c-7a0dd3178485 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:34.371606 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-18c9ef16-8919-41d8-a94c-7a0dd3178485 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:34.498121 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-18c9ef16-8919-41d8-a94c-7a0dd3178485 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:34.498121 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-18c9ef16-8919-41d8-a94c-7a0dd3178485 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/d4920fe1-a755-43f8-aa8f-b38c20f8c98a" status: 200 len: 1430 microversion: 2.1 time: 0.150253 Aug 10 17:53:34.502242 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 565/1134] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:34 2022] GET /compute/v2.1/servers/d4920fe1-a755-43f8-aa8f-b38c20f8c98a => generated 1430 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:53:34.623013 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-7aab6c74-3a06-481d-8b72-4f9d1613e91b tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:34.623614 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-7aab6c74-3a06-481d-8b72-4f9d1613e91b tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] [instance: bee3148a-3834-41bd-99e7-b5da75217256] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:34.642455 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-7aab6c74-3a06-481d-8b72-4f9d1613e91b tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:34.642455 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-7aab6c74-3a06-481d-8b72-4f9d1613e91b tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:34.642455 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-7aab6c74-3a06-481d-8b72-4f9d1613e91b tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:34.642455 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-7aab6c74-3a06-481d-8b72-4f9d1613e91b tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:34.642455 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-7aab6c74-3a06-481d-8b72-4f9d1613e91b tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:34.642455 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-7aab6c74-3a06-481d-8b72-4f9d1613e91b tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:34.767274 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-7aab6c74-3a06-481d-8b72-4f9d1613e91b tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2fd6acf18d4218ad143ccee2d0bb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7c2481a908406fa9c4562513fff665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:34.807751 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-7aab6c74-3a06-481d-8b72-4f9d1613e91b tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] 10.222.0.50 "GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256" status: 200 len: 1477 microversion: 2.1 time: 0.178173 Aug 10 17:53:34.809245 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 566/1135] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:34 2022] GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256 => generated 1477 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:53:35.005355 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-fc7c88a0-85aa-47c9-afd4-a1d05380e3fe tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] 10.222.0.50 "DELETE /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62" status: 204 len: 0 microversion: 2.75 time: 0.890540 Aug 10 17:53:35.006188 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 570/1136] 10.222.0.50 () {60 vars in 1280 bytes} [Wed Aug 10 17:53:34 2022] DELETE /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62 => generated 0 bytes in 892 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 10 17:53:35.015284 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-88c3d249-2078-4d1d-a2a4-82664628e87d tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:35.016815 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-88c3d249-2078-4d1d-a2a4-82664628e87d tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] [instance: e2777988-0bbf-496c-9c97-b206dbc94a62] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:35.023663 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-88c3d249-2078-4d1d-a2a4-82664628e87d tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:35.024310 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-88c3d249-2078-4d1d-a2a4-82664628e87d tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:35.025010 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-88c3d249-2078-4d1d-a2a4-82664628e87d tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:35.026037 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-88c3d249-2078-4d1d-a2a4-82664628e87d tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:35.027522 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-88c3d249-2078-4d1d-a2a4-82664628e87d tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:35.028177 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-88c3d249-2078-4d1d-a2a4-82664628e87d tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:35.102219 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-88c3d249-2078-4d1d-a2a4-82664628e87d tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:35.110793 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-88c3d249-2078-4d1d-a2a4-82664628e87d tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:35.112331 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-88c3d249-2078-4d1d-a2a4-82664628e87d tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:35.119492 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-88c3d249-2078-4d1d-a2a4-82664628e87d tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] 10.222.0.50 "GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62" status: 200 len: 1442 microversion: 2.75 time: 0.109056 Aug 10 17:53:35.120970 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 567/1137] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:53:35 2022] GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62 => generated 1442 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 17:53:35.282424 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-80bb8859-48ae-4b5d-97c0-5b38bd173514 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:35.283466 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-80bb8859-48ae-4b5d-97c0-5b38bd173514 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] [instance: 4390cd8e-2484-4205-9678-fb7332d1c78d] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:35.298694 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-80bb8859-48ae-4b5d-97c0-5b38bd173514 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:35.300861 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-80bb8859-48ae-4b5d-97c0-5b38bd173514 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:35.301526 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-80bb8859-48ae-4b5d-97c0-5b38bd173514 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:35.302415 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-80bb8859-48ae-4b5d-97c0-5b38bd173514 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:35.305643 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-80bb8859-48ae-4b5d-97c0-5b38bd173514 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:35.306271 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-80bb8859-48ae-4b5d-97c0-5b38bd173514 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:35.509394 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [req-0e2c5cda-c428-4cea-824f-7f25fbe091f1 req-86f8ff74-29cf-47fd-824e-584cdaed471a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bee3148a-3834-41bd-99e7-b5da75217256", "name": "network-vif-plugged", "status": "completed", "tag": "2f16a409-b711-4b31-9eb5-9884dbbe9489"}]} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:53:35.521785 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-0e2c5cda-c428-4cea-824f-7f25fbe091f1 req-86f8ff74-29cf-47fd-824e-584cdaed471a service nova] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:35.522557 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-0e2c5cda-c428-4cea-824f-7f25fbe091f1 req-86f8ff74-29cf-47fd-824e-584cdaed471a service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:35.523157 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-0e2c5cda-c428-4cea-824f-7f25fbe091f1 req-86f8ff74-29cf-47fd-824e-584cdaed471a service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:35.543378 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.compute.server_external_events [req-0e2c5cda-c428-4cea-824f-7f25fbe091f1 req-86f8ff74-29cf-47fd-824e-584cdaed471a service nova] Creating event network-vif-plugged:2f16a409-b711-4b31-9eb5-9884dbbe9489 for instance bee3148a-3834-41bd-99e7-b5da75217256 on n-h2-852296-2 Aug 10 17:53:35.550028 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [req-0e2c5cda-c428-4cea-824f-7f25fbe091f1 req-86f8ff74-29cf-47fd-824e-584cdaed471a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044997 Aug 10 17:53:35.551361 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 568/1138] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 10 17:53:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:53:35.557005 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-ab8aed91-f8d4-439d-abc0-669c7fe943de tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:35.558787 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-ab8aed91-f8d4-439d-abc0-669c7fe943de tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: d4920fe1-a755-43f8-aa8f-b38c20f8c98a] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:35.566877 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-ab8aed91-f8d4-439d-abc0-669c7fe943de tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:35.567615 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-ab8aed91-f8d4-439d-abc0-669c7fe943de tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:35.567868 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-ab8aed91-f8d4-439d-abc0-669c7fe943de tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:35.568811 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-ab8aed91-f8d4-439d-abc0-669c7fe943de tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:35.569463 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-ab8aed91-f8d4-439d-abc0-669c7fe943de tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:35.570211 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-ab8aed91-f8d4-439d-abc0-669c7fe943de tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:35.617931 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-ab8aed91-f8d4-439d-abc0-669c7fe943de tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:35.618356 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-ab8aed91-f8d4-439d-abc0-669c7fe943de tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:35.618832 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-ab8aed91-f8d4-439d-abc0-669c7fe943de tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:35.619264 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.objects.instance [None req-ab8aed91-f8d4-439d-abc0-669c7fe943de tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lazy-loading 'fault' on Instance uuid d4920fe1-a755-43f8-aa8f-b38c20f8c98a {{(pid=129410) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:53:35.688494 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-ab8aed91-f8d4-439d-abc0-669c7fe943de tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:35.702446 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-ab8aed91-f8d4-439d-abc0-669c7fe943de tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/d4920fe1-a755-43f8-aa8f-b38c20f8c98a" status: 200 len: 1307 microversion: 2.1 time: 0.149699 Aug 10 17:53:35.703809 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 569/1139] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:35 2022] GET /compute/v2.1/servers/d4920fe1-a755-43f8-aa8f-b38c20f8c98a => generated 1307 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:53:35.831703 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-b52882c0-abc0-4413-b9b3-25eedfd32dc4 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:35.832698 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-b52882c0-abc0-4413-b9b3-25eedfd32dc4 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] [instance: bee3148a-3834-41bd-99e7-b5da75217256] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:35.842082 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b52882c0-abc0-4413-b9b3-25eedfd32dc4 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:35.843675 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b52882c0-abc0-4413-b9b3-25eedfd32dc4 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:35.845925 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b52882c0-abc0-4413-b9b3-25eedfd32dc4 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:35.846934 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b52882c0-abc0-4413-b9b3-25eedfd32dc4 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:35.847458 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b52882c0-abc0-4413-b9b3-25eedfd32dc4 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:35.848674 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b52882c0-abc0-4413-b9b3-25eedfd32dc4 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:35.893302 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-80bb8859-48ae-4b5d-97c0-5b38bd173514 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f082ed04bc143679029c204e8a97160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c7c8eeb1b4065b25fe28eba30d0eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:35.912079 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-80bb8859-48ae-4b5d-97c0-5b38bd173514 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] 10.222.0.50 "GET /compute/v2.1/servers/4390cd8e-2484-4205-9678-fb7332d1c78d" status: 200 len: 1318 microversion: 2.1 time: 0.635006 Aug 10 17:53:35.912725 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 571/1140] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:35 2022] GET /compute/v2.1/servers/4390cd8e-2484-4205-9678-fb7332d1c78d => generated 1318 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:53:36.034194 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-b52882c0-abc0-4413-b9b3-25eedfd32dc4 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2fd6acf18d4218ad143ccee2d0bb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7c2481a908406fa9c4562513fff665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:36.043059 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-b52882c0-abc0-4413-b9b3-25eedfd32dc4 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] 10.222.0.50 "GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256" status: 200 len: 1477 microversion: 2.1 time: 0.216800 Aug 10 17:53:36.043729 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 570/1141] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:35 2022] GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256 => generated 1477 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:53:36.145095 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-f0cb146d-8f37-49b0-b25a-548a88d18ec4 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:36.145634 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-f0cb146d-8f37-49b0-b25a-548a88d18ec4 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] [instance: e2777988-0bbf-496c-9c97-b206dbc94a62] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:36.157847 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-f0cb146d-8f37-49b0-b25a-548a88d18ec4 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:36.158437 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-f0cb146d-8f37-49b0-b25a-548a88d18ec4 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:36.158955 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-f0cb146d-8f37-49b0-b25a-548a88d18ec4 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:36.160087 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-f0cb146d-8f37-49b0-b25a-548a88d18ec4 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:36.160673 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-f0cb146d-8f37-49b0-b25a-548a88d18ec4 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:36.161102 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-f0cb146d-8f37-49b0-b25a-548a88d18ec4 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:36.285187 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-f0cb146d-8f37-49b0-b25a-548a88d18ec4 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:36.298898 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-f0cb146d-8f37-49b0-b25a-548a88d18ec4 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:36.300568 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-f0cb146d-8f37-49b0-b25a-548a88d18ec4 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:36.306599 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-f0cb146d-8f37-49b0-b25a-548a88d18ec4 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] 10.222.0.50 "GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62" status: 200 len: 1442 microversion: 2.75 time: 0.165427 Aug 10 17:53:36.321130 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 572/1142] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:53:36 2022] GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62 => generated 1442 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:53:36.732041 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-45b8fe3b-2321-4b0b-93d4-e2d53834c35c tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:36.733083 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-45b8fe3b-2321-4b0b-93d4-e2d53834c35c tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: d4920fe1-a755-43f8-aa8f-b38c20f8c98a] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:36.741799 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-45b8fe3b-2321-4b0b-93d4-e2d53834c35c tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:36.742268 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-45b8fe3b-2321-4b0b-93d4-e2d53834c35c tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:36.748083 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-45b8fe3b-2321-4b0b-93d4-e2d53834c35c tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:36.748971 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-45b8fe3b-2321-4b0b-93d4-e2d53834c35c tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:36.749988 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-45b8fe3b-2321-4b0b-93d4-e2d53834c35c tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:36.750445 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-45b8fe3b-2321-4b0b-93d4-e2d53834c35c tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:36.770934 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-45b8fe3b-2321-4b0b-93d4-e2d53834c35c tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] HTTP exception thrown: Instance d4920fe1-a755-43f8-aa8f-b38c20f8c98a could not be found. Aug 10 17:53:36.773395 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-45b8fe3b-2321-4b0b-93d4-e2d53834c35c tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Request method failure captured: Aug 10 17:53:36.773395 n-d-852296-2 devstack@n-api.service[129410]: request: GET /compute/v2.1/servers/d4920fe1-a755-43f8-aa8f-b38c20f8c98a HTTP/1.1 Aug 10 17:53:36.773395 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 17:53:36.773395 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 17:53:36.773395 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 17:53:36.773395 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 0 Aug 10 17:53:36.773395 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 17:53:36.773395 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 17:53:36.773395 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 17:53:36.773395 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 17:53:36.773395 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8-_vb7x9x9F8-sP6h5pKdcrrsXpPJ2RlEbuCXnu2ZTWdSKtHarFJLe7Hjf1WLDt_yPDFFQT5gzj11kqkxwhqMHpazNhmqyhgrlC3SoXOue_P66sN7aOFIkgqmKczGGaSXM3e-yfy_FvawvLBNZry68s7Q1kz50eCpVoZBo2bvZ2yTNc Aug 10 17:53:36.773395 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 17:53:36.773395 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 17:53:36.773395 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 17:53:36.773395 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 17:53:36.773395 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 17:53:36.773395 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 17:53:36.773395 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: 0638146d08704b2983761619745290b3 Aug 10 17:53:36.773395 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-ServersOnMultiNodesTest-946016060 Aug 10 17:53:36.773395 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 17:53:36.773395 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 17:53:36.773395 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0638146d08704b2983761619745290b3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/0638146d08704b2983761619745290b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0638146d08704b2983761619745290b3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_0638146d08704b2983761619745290b3", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:53:36.773395 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-ServersOnMultiNodesTest-946016060 Aug 10 17:53:36.773395 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: 0638146d08704b2983761619745290b3 Aug 10 17:53:36.773395 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-946016060 Aug 10 17:53:36.773395 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-ServersOnMultiNodesTest-946016060-project Aug 10 17:53:36.773395 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 17:53:36.773395 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 17:53:36.773395 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: f76b870a54454956b3926c34f9f27442 Aug 10 17:53:36.773395 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-ServersOnMultiNodesTest-946016060-project Aug 10 17:53:36.773395 n-d-852296-2 devstack@n-api.service[129410]: method: > Aug 10 17:53:36.773395 n-d-852296-2 devstack@n-api.service[129410]: exception: Instance d4920fe1-a755-43f8-aa8f-b38c20f8c98a could not be found. Aug 10 17:53:36.773395 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'id': 'd4920fe1-a755-43f8-aa8f-b38c20f8c98a'} Aug 10 17:53:36.773395 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:53:36.773395 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:53:36.773395 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 17:53:36.773395 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 17:53:36.773395 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 17:53:36.773395 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 17:53:36.773395 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 17:53:36.773395 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 17:53:36.773395 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 17:53:36.773395 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 17:53:36.773395 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4920fe1-a755-43f8-aa8f-b38c20f8c98a could not be found. Aug 10 17:53:36.773395 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:53:36.773395 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:53:36.773395 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:53:36.773395 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:53:36.773395 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:53:36.773395 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:53:36.773395 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:53:36.773395 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:53:36.773395 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:53:36.773395 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:53:36.773395 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 17:53:36.773395 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 17:53:36.773395 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 17:53:36.773395 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 17:53:36.773395 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 17:53:36.773395 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:53:36.773395 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4920fe1-a755-43f8-aa8f-b38c20f8c98a could not be found. Aug 10 17:53:36.773395 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:53:36.773395 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:53:36.773395 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:53:36.779367 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:53:36.779367 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:53:36.779367 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:53:36.779367 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:53:36.779367 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:53:36.779367 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4920fe1-a755-43f8-aa8f-b38c20f8c98a could not be found. Aug 10 17:53:36.779367 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:53:36.779367 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-45b8fe3b-2321-4b0b-93d4-e2d53834c35c tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Returning 404 to user: Instance d4920fe1-a755-43f8-aa8f-b38c20f8c98a could not be found. {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:53:36.779367 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-45b8fe3b-2321-4b0b-93d4-e2d53834c35c tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/d4920fe1-a755-43f8-aa8f-b38c20f8c98a" status: 404 len: 111 microversion: 2.1 time: 0.048479 Aug 10 17:53:36.779367 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 571/1143] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:36 2022] GET /compute/v2.1/servers/d4920fe1-a755-43f8-aa8f-b38c20f8c98a => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:53:36.783481 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-c878594e-75f4-408c-90b9-6b5ac0de31e1 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:36.783971 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-c878594e-75f4-408c-90b9-6b5ac0de31e1 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: 873f60d0-8ef0-4ff5-800d-945ca4237a28] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:36.790324 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c878594e-75f4-408c-90b9-6b5ac0de31e1 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:36.791111 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c878594e-75f4-408c-90b9-6b5ac0de31e1 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:36.791803 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c878594e-75f4-408c-90b9-6b5ac0de31e1 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:36.792853 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c878594e-75f4-408c-90b9-6b5ac0de31e1 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:36.793524 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c878594e-75f4-408c-90b9-6b5ac0de31e1 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:36.794318 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c878594e-75f4-408c-90b9-6b5ac0de31e1 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:36.850567 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-c878594e-75f4-408c-90b9-6b5ac0de31e1 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: 873f60d0-8ef0-4ff5-800d-945ca4237a28] Going to try to terminate instance {{(pid=129409) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 17:53:36.942801 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-d8ac971b-a165-42f5-856c-ae0521acd0f9 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:36.947192 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-d8ac971b-a165-42f5-856c-ae0521acd0f9 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] [instance: 4390cd8e-2484-4205-9678-fb7332d1c78d] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:36.968157 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d8ac971b-a165-42f5-856c-ae0521acd0f9 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:36.968157 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d8ac971b-a165-42f5-856c-ae0521acd0f9 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:36.968157 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d8ac971b-a165-42f5-856c-ae0521acd0f9 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:36.972682 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d8ac971b-a165-42f5-856c-ae0521acd0f9 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:36.973228 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d8ac971b-a165-42f5-856c-ae0521acd0f9 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:36.973678 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d8ac971b-a165-42f5-856c-ae0521acd0f9 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:37.190453 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-d8ac971b-a165-42f5-856c-ae0521acd0f9 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f082ed04bc143679029c204e8a97160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c7c8eeb1b4065b25fe28eba30d0eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:37.200334 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-d8ac971b-a165-42f5-856c-ae0521acd0f9 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] 10.222.0.50 "GET /compute/v2.1/servers/4390cd8e-2484-4205-9678-fb7332d1c78d" status: 200 len: 1468 microversion: 2.1 time: 0.267058 Aug 10 17:53:37.221183 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 572/1144] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:36 2022] GET /compute/v2.1/servers/4390cd8e-2484-4205-9678-fb7332d1c78d => generated 1468 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:53:37.226526 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-801e2add-0ef9-4edb-85ac-69ad170848f1 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:37.227138 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-801e2add-0ef9-4edb-85ac-69ad170848f1 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] [instance: bee3148a-3834-41bd-99e7-b5da75217256] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:37.235623 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-801e2add-0ef9-4edb-85ac-69ad170848f1 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:37.237128 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-801e2add-0ef9-4edb-85ac-69ad170848f1 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:37.237871 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-801e2add-0ef9-4edb-85ac-69ad170848f1 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:37.238791 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-801e2add-0ef9-4edb-85ac-69ad170848f1 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:37.241943 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-801e2add-0ef9-4edb-85ac-69ad170848f1 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:37.243236 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-801e2add-0ef9-4edb-85ac-69ad170848f1 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:37.402829 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-801e2add-0ef9-4edb-85ac-69ad170848f1 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2fd6acf18d4218ad143ccee2d0bb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7c2481a908406fa9c4562513fff665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:37.412539 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-801e2add-0ef9-4edb-85ac-69ad170848f1 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] 10.222.0.50 "GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256" status: 200 len: 1477 microversion: 2.1 time: 0.190166 Aug 10 17:53:37.426019 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 573/1145] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:37 2022] GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256 => generated 1477 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:53:37.431310 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-9149efa1-cdaa-4002-b3b6-408781cef445 tempest-LiveMigrationNegativeTest-2143065160 tempest-LiveMigrationNegativeTest-2143065160-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:53:37.432539 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-9149efa1-cdaa-4002-b3b6-408781cef445 tempest-LiveMigrationNegativeTest-2143065160 tempest-LiveMigrationNegativeTest-2143065160-project-admin] [instance: 4390cd8e-2484-4205-9678-fb7332d1c78d] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:37.452385 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-9149efa1-cdaa-4002-b3b6-408781cef445 tempest-LiveMigrationNegativeTest-2143065160 tempest-LiveMigrationNegativeTest-2143065160-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:37.452385 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-9149efa1-cdaa-4002-b3b6-408781cef445 tempest-LiveMigrationNegativeTest-2143065160 tempest-LiveMigrationNegativeTest-2143065160-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:37.452385 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-9149efa1-cdaa-4002-b3b6-408781cef445 tempest-LiveMigrationNegativeTest-2143065160 tempest-LiveMigrationNegativeTest-2143065160-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:37.453027 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-9149efa1-cdaa-4002-b3b6-408781cef445 tempest-LiveMigrationNegativeTest-2143065160 tempest-LiveMigrationNegativeTest-2143065160-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:37.453656 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-9149efa1-cdaa-4002-b3b6-408781cef445 tempest-LiveMigrationNegativeTest-2143065160 tempest-LiveMigrationNegativeTest-2143065160-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:37.454584 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-9149efa1-cdaa-4002-b3b6-408781cef445 tempest-LiveMigrationNegativeTest-2143065160 tempest-LiveMigrationNegativeTest-2143065160-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:37.489289 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.objects.instance [None req-9149efa1-cdaa-4002-b3b6-408781cef445 tempest-LiveMigrationNegativeTest-2143065160 tempest-LiveMigrationNegativeTest-2143065160-project-admin] Lazy-loading 'flavor' on Instance uuid 4390cd8e-2484-4205-9678-fb7332d1c78d {{(pid=129410) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:53:37.515336 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_cell1:SELECT=100 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:53:37.585871 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-c878594e-75f4-408c-90b9-6b5ac0de31e1 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "DELETE /compute/v2.1/servers/873f60d0-8ef0-4ff5-800d-945ca4237a28" status: 204 len: 0 microversion: 2.1 time: 0.805818 Aug 10 17:53:37.591186 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 573/1146] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 10 17:53:36 2022] DELETE /compute/v2.1/servers/873f60d0-8ef0-4ff5-800d-945ca4237a28 => generated 0 bytes in 810 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 17:53:37.610382 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-bfe496ae-5aa9-40a7-bf2f-784e71727cf5 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:37.613421 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-bfe496ae-5aa9-40a7-bf2f-784e71727cf5 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] [instance: e2777988-0bbf-496c-9c97-b206dbc94a62] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:37.639975 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-bfe496ae-5aa9-40a7-bf2f-784e71727cf5 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:37.640947 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-bfe496ae-5aa9-40a7-bf2f-784e71727cf5 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:37.641608 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-bfe496ae-5aa9-40a7-bf2f-784e71727cf5 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:37.646421 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-bfe496ae-5aa9-40a7-bf2f-784e71727cf5 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:37.646421 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-bfe496ae-5aa9-40a7-bf2f-784e71727cf5 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:37.646421 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-bfe496ae-5aa9-40a7-bf2f-784e71727cf5 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:37.751015 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-bfe496ae-5aa9-40a7-bf2f-784e71727cf5 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:37.760047 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-bfe496ae-5aa9-40a7-bf2f-784e71727cf5 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:37.769693 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-bfe496ae-5aa9-40a7-bf2f-784e71727cf5 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:37.778837 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-bfe496ae-5aa9-40a7-bf2f-784e71727cf5 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] 10.222.0.50 "GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62" status: 200 len: 1442 microversion: 2.75 time: 0.184722 Aug 10 17:53:37.797143 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 574/1147] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:53:37 2022] GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62 => generated 1442 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:53:37.802390 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-61cd98ab-a0c4-4d7a-8471-da92370d2556 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:37.803267 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-61cd98ab-a0c4-4d7a-8471-da92370d2556 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: 873f60d0-8ef0-4ff5-800d-945ca4237a28] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:37.812487 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-61cd98ab-a0c4-4d7a-8471-da92370d2556 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:37.813253 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-61cd98ab-a0c4-4d7a-8471-da92370d2556 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:37.813938 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-61cd98ab-a0c4-4d7a-8471-da92370d2556 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:37.814825 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-61cd98ab-a0c4-4d7a-8471-da92370d2556 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:37.815448 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-61cd98ab-a0c4-4d7a-8471-da92370d2556 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:37.816041 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-61cd98ab-a0c4-4d7a-8471-da92370d2556 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:37.999677 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_cell0:SELECT=18 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:53:38.035701 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-9149efa1-cdaa-4002-b3b6-408781cef445 tempest-LiveMigrationNegativeTest-2143065160 tempest-LiveMigrationNegativeTest-2143065160-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/4390cd8e-2484-4205-9678-fb7332d1c78d/action" status: 202 len: 0 microversion: 2.1 time: 0.606562 Aug 10 17:53:38.044791 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 574/1148] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 10 17:53:37 2022] POST /compute/v2.1/servers/4390cd8e-2484-4205-9678-fb7332d1c78d/action => generated 0 bytes in 613 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 17:53:38.050824 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-75a2fc6f-69ff-47cb-be5c-32c7b9a18460 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:38.051583 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-75a2fc6f-69ff-47cb-be5c-32c7b9a18460 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] [instance: 4390cd8e-2484-4205-9678-fb7332d1c78d] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:38.059406 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-75a2fc6f-69ff-47cb-be5c-32c7b9a18460 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:38.059898 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-75a2fc6f-69ff-47cb-be5c-32c7b9a18460 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:38.060367 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-75a2fc6f-69ff-47cb-be5c-32c7b9a18460 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:38.061077 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-75a2fc6f-69ff-47cb-be5c-32c7b9a18460 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:38.061533 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-75a2fc6f-69ff-47cb-be5c-32c7b9a18460 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:38.061966 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-75a2fc6f-69ff-47cb-be5c-32c7b9a18460 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:38.239936 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-61cd98ab-a0c4-4d7a-8471-da92370d2556 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:38.256126 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-61cd98ab-a0c4-4d7a-8471-da92370d2556 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/873f60d0-8ef0-4ff5-800d-945ca4237a28" status: 200 len: 1471 microversion: 2.1 time: 0.456341 Aug 10 17:53:38.271932 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 575/1149] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:37 2022] GET /compute/v2.1/servers/873f60d0-8ef0-4ff5-800d-945ca4237a28 => generated 1471 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:53:38.365900 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-75a2fc6f-69ff-47cb-be5c-32c7b9a18460 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f082ed04bc143679029c204e8a97160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c7c8eeb1b4065b25fe28eba30d0eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:38.375728 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-75a2fc6f-69ff-47cb-be5c-32c7b9a18460 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] 10.222.0.50 "GET /compute/v2.1/servers/4390cd8e-2484-4205-9678-fb7332d1c78d" status: 200 len: 1476 microversion: 2.1 time: 0.329041 Aug 10 17:53:38.384653 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 575/1150] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:38 2022] GET /compute/v2.1/servers/4390cd8e-2484-4205-9678-fb7332d1c78d => generated 1476 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:53:38.433743 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-e187556b-2b35-4254-aa67-73997f83661b tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:38.440812 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-e187556b-2b35-4254-aa67-73997f83661b tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] [instance: bee3148a-3834-41bd-99e7-b5da75217256] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:38.443899 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e187556b-2b35-4254-aa67-73997f83661b tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:38.444654 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e187556b-2b35-4254-aa67-73997f83661b tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:38.445083 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e187556b-2b35-4254-aa67-73997f83661b tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:38.446193 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e187556b-2b35-4254-aa67-73997f83661b tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:38.446868 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e187556b-2b35-4254-aa67-73997f83661b tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:38.447446 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e187556b-2b35-4254-aa67-73997f83661b tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:38.453309 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:53:38.665283 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-e187556b-2b35-4254-aa67-73997f83661b tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2fd6acf18d4218ad143ccee2d0bb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7c2481a908406fa9c4562513fff665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:38.674953 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-e187556b-2b35-4254-aa67-73997f83661b tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] 10.222.0.50 "GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256" status: 200 len: 1462 microversion: 2.1 time: 0.245638 Aug 10 17:53:38.675539 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 576/1151] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:38 2022] GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256 => generated 1462 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:53:38.710214 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-bc0b5469-7237-4cda-9693-1007572a482d tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:53:38.712904 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-bc0b5469-7237-4cda-9693-1007572a482d tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] [instance: bee3148a-3834-41bd-99e7-b5da75217256] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:38.720290 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-bc0b5469-7237-4cda-9693-1007572a482d tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:38.720901 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-bc0b5469-7237-4cda-9693-1007572a482d tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:38.721437 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-bc0b5469-7237-4cda-9693-1007572a482d tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:38.722255 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-bc0b5469-7237-4cda-9693-1007572a482d tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:38.722826 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-bc0b5469-7237-4cda-9693-1007572a482d tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:38.723397 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-bc0b5469-7237-4cda-9693-1007572a482d tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:38.803582 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-14fecc18-cc2f-49e4-a991-f5e6acd33ab7 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:38.804338 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-14fecc18-cc2f-49e4-a991-f5e6acd33ab7 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] [instance: e2777988-0bbf-496c-9c97-b206dbc94a62] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:38.818669 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-14fecc18-cc2f-49e4-a991-f5e6acd33ab7 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:38.819314 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-14fecc18-cc2f-49e4-a991-f5e6acd33ab7 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:38.819953 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-14fecc18-cc2f-49e4-a991-f5e6acd33ab7 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:38.823087 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-14fecc18-cc2f-49e4-a991-f5e6acd33ab7 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:38.824445 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-14fecc18-cc2f-49e4-a991-f5e6acd33ab7 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:38.825217 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-14fecc18-cc2f-49e4-a991-f5e6acd33ab7 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:38.951563 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-14fecc18-cc2f-49e4-a991-f5e6acd33ab7 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:38.952114 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-14fecc18-cc2f-49e4-a991-f5e6acd33ab7 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:38.952510 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-14fecc18-cc2f-49e4-a991-f5e6acd33ab7 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:38.952970 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.objects.instance [None req-14fecc18-cc2f-49e4-a991-f5e6acd33ab7 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lazy-loading 'fault' on Instance uuid e2777988-0bbf-496c-9c97-b206dbc94a62 {{(pid=129409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:53:39.236859 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-bc0b5469-7237-4cda-9693-1007572a482d tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256/action" status: 202 len: 0 microversion: 2.1 time: 0.531999 Aug 10 17:53:39.238429 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 576/1152] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 10 17:53:38 2022] POST /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256/action => generated 0 bytes in 534 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 17:53:39.248662 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-3fc36e51-7b44-4f75-99f7-8e8b56403b06 tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:39.254638 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-3fc36e51-7b44-4f75-99f7-8e8b56403b06 tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] [instance: bee3148a-3834-41bd-99e7-b5da75217256] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:39.262198 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-14fecc18-cc2f-49e4-a991-f5e6acd33ab7 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:39.277647 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-14fecc18-cc2f-49e4-a991-f5e6acd33ab7 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:39.282371 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-14fecc18-cc2f-49e4-a991-f5e6acd33ab7 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72fc939efd547ceb97257ee1c528d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9baf8d84414bc18598097e20d1966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:39.287013 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-3fc36e51-7b44-4f75-99f7-8e8b56403b06 tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:39.288810 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-3fc36e51-7b44-4f75-99f7-8e8b56403b06 tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:39.293775 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-3fc36e51-7b44-4f75-99f7-8e8b56403b06 tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:39.294526 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-3fc36e51-7b44-4f75-99f7-8e8b56403b06 tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:39.296344 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-3fc36e51-7b44-4f75-99f7-8e8b56403b06 tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:39.299846 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-3fc36e51-7b44-4f75-99f7-8e8b56403b06 tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:39.306079 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-14fecc18-cc2f-49e4-a991-f5e6acd33ab7 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] 10.222.0.50 "GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62" status: 200 len: 1447 microversion: 2.75 time: 0.506757 Aug 10 17:53:39.319262 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 577/1153] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:53:38 2022] GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62 => generated 1447 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 17:53:39.340079 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-800fbe11-038d-4da3-8be0-25e06d787dc2 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:39.345435 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-800fbe11-038d-4da3-8be0-25e06d787dc2 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: 873f60d0-8ef0-4ff5-800d-945ca4237a28] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:39.356237 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-800fbe11-038d-4da3-8be0-25e06d787dc2 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:39.358283 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-800fbe11-038d-4da3-8be0-25e06d787dc2 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:39.359772 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-800fbe11-038d-4da3-8be0-25e06d787dc2 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:39.362601 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-800fbe11-038d-4da3-8be0-25e06d787dc2 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:39.364968 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-800fbe11-038d-4da3-8be0-25e06d787dc2 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:39.365685 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-800fbe11-038d-4da3-8be0-25e06d787dc2 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:39.421365 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-3fc36e51-7b44-4f75-99f7-8e8b56403b06 tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:39.423285 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-3fc36e51-7b44-4f75-99f7-8e8b56403b06 tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:39.423949 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-3fc36e51-7b44-4f75-99f7-8e8b56403b06 tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:39.424682 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.objects.instance [None req-3fc36e51-7b44-4f75-99f7-8e8b56403b06 tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Lazy-loading 'fault' on Instance uuid bee3148a-3834-41bd-99e7-b5da75217256 {{(pid=129410) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:53:39.712266 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-800fbe11-038d-4da3-8be0-25e06d787dc2 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:39.726420 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-800fbe11-038d-4da3-8be0-25e06d787dc2 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/873f60d0-8ef0-4ff5-800d-945ca4237a28" status: 200 len: 1471 microversion: 2.1 time: 0.401547 Aug 10 17:53:39.731913 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 578/1154] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:39 2022] GET /compute/v2.1/servers/873f60d0-8ef0-4ff5-800d-945ca4237a28 => generated 1471 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:53:39.742217 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-15768744-4882-458f-97fc-089dfd037289 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:39.747442 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-15768744-4882-458f-97fc-089dfd037289 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] [instance: 4390cd8e-2484-4205-9678-fb7332d1c78d] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:39.758501 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-15768744-4882-458f-97fc-089dfd037289 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:39.761225 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-15768744-4882-458f-97fc-089dfd037289 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:39.763799 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-15768744-4882-458f-97fc-089dfd037289 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:39.765857 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-15768744-4882-458f-97fc-089dfd037289 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:39.766529 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-15768744-4882-458f-97fc-089dfd037289 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:39.769073 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-15768744-4882-458f-97fc-089dfd037289 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:39.935885 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-3fc36e51-7b44-4f75-99f7-8e8b56403b06 tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256" status: 200 len: 1596 microversion: 2.1 time: 0.693815 Aug 10 17:53:39.936660 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 577/1155] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:39 2022] GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256 => generated 1596 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:53:39.963049 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-e647ad30-209c-4f2e-869a-e5a91a111cdb tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:53:39.983353 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-e647ad30-209c-4f2e-869a-e5a91a111cdb tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] [instance: bee3148a-3834-41bd-99e7-b5da75217256] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:40.001202 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e647ad30-209c-4f2e-869a-e5a91a111cdb tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:40.002204 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e647ad30-209c-4f2e-869a-e5a91a111cdb tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:40.002892 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e647ad30-209c-4f2e-869a-e5a91a111cdb tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:40.003845 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e647ad30-209c-4f2e-869a-e5a91a111cdb tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:40.005658 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e647ad30-209c-4f2e-869a-e5a91a111cdb tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:40.006467 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e647ad30-209c-4f2e-869a-e5a91a111cdb tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:40.130736 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-15768744-4882-458f-97fc-089dfd037289 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f082ed04bc143679029c204e8a97160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c7c8eeb1b4065b25fe28eba30d0eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:40.142908 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-15768744-4882-458f-97fc-089dfd037289 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] 10.222.0.50 "GET /compute/v2.1/servers/4390cd8e-2484-4205-9678-fb7332d1c78d" status: 200 len: 1459 microversion: 2.1 time: 0.408052 Aug 10 17:53:40.156682 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 579/1156] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:39 2022] GET /compute/v2.1/servers/4390cd8e-2484-4205-9678-fb7332d1c78d => generated 1459 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:53:40.164996 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-a78c81a9-bf7a-4861-8b65-b449ef97c8a0 tempest-LiveMigrationNegativeTest-2143065160 tempest-LiveMigrationNegativeTest-2143065160-project-admin] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:40.165865 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-a78c81a9-bf7a-4861-8b65-b449ef97c8a0 tempest-LiveMigrationNegativeTest-2143065160 tempest-LiveMigrationNegativeTest-2143065160-project-admin] [instance: 4390cd8e-2484-4205-9678-fb7332d1c78d] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:40.177783 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a78c81a9-bf7a-4861-8b65-b449ef97c8a0 tempest-LiveMigrationNegativeTest-2143065160 tempest-LiveMigrationNegativeTest-2143065160-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:40.178625 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a78c81a9-bf7a-4861-8b65-b449ef97c8a0 tempest-LiveMigrationNegativeTest-2143065160 tempest-LiveMigrationNegativeTest-2143065160-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:40.183329 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a78c81a9-bf7a-4861-8b65-b449ef97c8a0 tempest-LiveMigrationNegativeTest-2143065160 tempest-LiveMigrationNegativeTest-2143065160-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:40.184348 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a78c81a9-bf7a-4861-8b65-b449ef97c8a0 tempest-LiveMigrationNegativeTest-2143065160 tempest-LiveMigrationNegativeTest-2143065160-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:40.191381 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a78c81a9-bf7a-4861-8b65-b449ef97c8a0 tempest-LiveMigrationNegativeTest-2143065160 tempest-LiveMigrationNegativeTest-2143065160-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:40.196545 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a78c81a9-bf7a-4861-8b65-b449ef97c8a0 tempest-LiveMigrationNegativeTest-2143065160 tempest-LiveMigrationNegativeTest-2143065160-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:40.542399 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-e647ad30-209c-4f2e-869a-e5a91a111cdb tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256/action" status: 202 len: 0 microversion: 2.1 time: 0.586376 Aug 10 17:53:40.544777 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 578/1157] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 10 17:53:39 2022] POST /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256/action => generated 0 bytes in 588 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 17:53:40.549155 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-61c221da-cb89-4d21-a798-f38d4be2b5b1 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:40.552524 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-61c221da-cb89-4d21-a798-f38d4be2b5b1 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] [instance: e2777988-0bbf-496c-9c97-b206dbc94a62] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:40.566327 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-61c221da-cb89-4d21-a798-f38d4be2b5b1 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:40.566729 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-61c221da-cb89-4d21-a798-f38d4be2b5b1 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:40.568948 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-61c221da-cb89-4d21-a798-f38d4be2b5b1 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:40.571006 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-61c221da-cb89-4d21-a798-f38d4be2b5b1 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:40.575636 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-61c221da-cb89-4d21-a798-f38d4be2b5b1 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:40.576363 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-61c221da-cb89-4d21-a798-f38d4be2b5b1 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:40.611482 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-61c221da-cb89-4d21-a798-f38d4be2b5b1 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] HTTP exception thrown: Instance e2777988-0bbf-496c-9c97-b206dbc94a62 could not be found. Aug 10 17:53:40.615887 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-61c221da-cb89-4d21-a798-f38d4be2b5b1 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Request method failure captured: Aug 10 17:53:40.615887 n-d-852296-2 devstack@n-api.service[129410]: request: GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62 HTTP/1.1 Aug 10 17:53:40.615887 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 17:53:40.615887 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 17:53:40.615887 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 17:53:40.615887 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 0 Aug 10 17:53:40.615887 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 17:53:40.615887 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 17:53:40.615887 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 17:53:40.615887 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 17:53:40.615887 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8_AxuO7KJucXUvifDuJP6gWlWnow7t2MZS-7izQ59q82GwZxhiuL0l4L_fXZh_7umqA70-tOj3XbPrVkil3e4rx4I-8Sl_--qYnlL9MhpTSDdfc8r9S-PilgOghPU42ibRuQhQRsSod8ZlUtylSeRMV6DSyQ7C5kXzJGmAQWZ4NgDKY Aug 10 17:53:40.615887 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 17:53:40.615887 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 17:53:40.615887 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 17:53:40.615887 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 17:53:40.615887 n-d-852296-2 devstack@n-api.service[129410]: X-Openstack-Nova-Api-Version: 2.75 Aug 10 17:53:40.615887 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 17:53:40.615887 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 17:53:40.615887 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: 6d9baf8d84414bc18598097e20d1966d Aug 10 17:53:40.615887 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-ServersAdmin275Test-1159807561 Aug 10 17:53:40.615887 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 17:53:40.615887 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 17:53:40.615887 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6d9baf8d84414bc18598097e20d1966d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6d9baf8d84414bc18598097e20d1966d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6d9baf8d84414bc18598097e20d1966d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6d9baf8d84414bc18598097e20d1966d", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:53:40.615887 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-ServersAdmin275Test-1159807561 Aug 10 17:53:40.615887 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: 6d9baf8d84414bc18598097e20d1966d Aug 10 17:53:40.615887 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-ServersAdmin275Test-1159807561 Aug 10 17:53:40.615887 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-ServersAdmin275Test-1159807561-project Aug 10 17:53:40.615887 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 17:53:40.615887 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 17:53:40.615887 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: b72fc939efd547ceb97257ee1c528d13 Aug 10 17:53:40.615887 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-ServersAdmin275Test-1159807561-project Aug 10 17:53:40.615887 n-d-852296-2 devstack@n-api.service[129410]: method: > Aug 10 17:53:40.615887 n-d-852296-2 devstack@n-api.service[129410]: exception: Instance e2777988-0bbf-496c-9c97-b206dbc94a62 could not be found. Aug 10 17:53:40.615887 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'id': 'e2777988-0bbf-496c-9c97-b206dbc94a62'} Aug 10 17:53:40.615887 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:53:40.615887 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:53:40.615887 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 17:53:40.615887 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 17:53:40.615887 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 17:53:40.615887 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 17:53:40.615887 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 17:53:40.615887 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 17:53:40.615887 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 17:53:40.615887 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 17:53:40.615887 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2777988-0bbf-496c-9c97-b206dbc94a62 could not be found. Aug 10 17:53:40.615887 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:53:40.615887 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:53:40.615887 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:53:40.615887 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:53:40.615887 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:53:40.615887 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:53:40.615887 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:53:40.615887 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:53:40.615887 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:53:40.615887 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:53:40.615887 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 17:53:40.615887 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 17:53:40.615887 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 17:53:40.615887 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 17:53:40.615887 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 17:53:40.615887 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:53:40.615887 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2777988-0bbf-496c-9c97-b206dbc94a62 could not be found. Aug 10 17:53:40.615887 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:53:40.615887 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:53:40.615887 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:53:40.625772 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:53:40.625772 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:53:40.625772 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:53:40.625772 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:53:40.625772 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:53:40.625772 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2777988-0bbf-496c-9c97-b206dbc94a62 could not be found. Aug 10 17:53:40.625772 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:53:40.625772 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-61c221da-cb89-4d21-a798-f38d4be2b5b1 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] Returning 404 to user: Instance e2777988-0bbf-496c-9c97-b206dbc94a62 could not be found. {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:53:40.625772 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-61c221da-cb89-4d21-a798-f38d4be2b5b1 tempest-ServersAdmin275Test-1159807561 tempest-ServersAdmin275Test-1159807561-project] 10.222.0.50 "GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62" status: 404 len: 111 microversion: 2.75 time: 0.074629 Aug 10 17:53:40.625772 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 579/1158] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:53:40 2022] GET /compute/v2.1/servers/e2777988-0bbf-496c-9c97-b206dbc94a62 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 10 17:53:40.626869 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-01e58fde-b076-43fb-9fde-83e57f995e6e tempest-ServersTestMultiNic-747354117 tempest-ServersTestMultiNic-747354117-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1892607157", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "c3d5b397-16c1-4cbc-9f79-6c1defe6dba3"}, {"uuid": "a5ec6cbb-7fe4-40f3-b017-28792331a69c"}]}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:53:40.732698 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.network.neutron [None req-01e58fde-b076-43fb-9fde-83e57f995e6e tempest-ServersTestMultiNic-747354117 tempest-ServersTestMultiNic-747354117-project] validate_networks() for [('c3d5b397-16c1-4cbc-9f79-6c1defe6dba3', None, None, None, None, None), ('a5ec6cbb-7fe4-40f3-b017-28792331a69c', None, None, None, None, None)] {{(pid=129410) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 17:53:40.837072 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-a78c81a9-bf7a-4861-8b65-b449ef97c8a0 tempest-LiveMigrationNegativeTest-2143065160 tempest-LiveMigrationNegativeTest-2143065160-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/4390cd8e-2484-4205-9678-fb7332d1c78d" status: 200 len: 1610 microversion: 2.1 time: 0.675834 Aug 10 17:53:40.856293 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 580/1159] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:40 2022] GET /compute/v2.1/servers/4390cd8e-2484-4205-9678-fb7332d1c78d => generated 1610 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:53:40.866645 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-541e81c6-4ce8-4da8-a862-bce27d5ca070 tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:40.870041 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-541e81c6-4ce8-4da8-a862-bce27d5ca070 tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] [instance: bee3148a-3834-41bd-99e7-b5da75217256] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:40.878841 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-541e81c6-4ce8-4da8-a862-bce27d5ca070 tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:40.879341 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-541e81c6-4ce8-4da8-a862-bce27d5ca070 tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:40.879784 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-541e81c6-4ce8-4da8-a862-bce27d5ca070 tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:40.880541 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-541e81c6-4ce8-4da8-a862-bce27d5ca070 tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:40.881190 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-541e81c6-4ce8-4da8-a862-bce27d5ca070 tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:40.881619 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-541e81c6-4ce8-4da8-a862-bce27d5ca070 tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:41.210912 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-541e81c6-4ce8-4da8-a862-bce27d5ca070 tempest-ServersAdminTestJSON-1611368581 tempest-ServersAdminTestJSON-1611368581-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256" status: 200 len: 1613 microversion: 2.1 time: 0.364589 Aug 10 17:53:41.220897 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 581/1160] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:40 2022] GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256 => generated 1613 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:53:41.227385 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-f21f03ab-c0be-4a2a-aa4f-c4ced7a71e51 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:41.228796 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-f21f03ab-c0be-4a2a-aa4f-c4ced7a71e51 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: 873f60d0-8ef0-4ff5-800d-945ca4237a28] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:41.251967 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-f21f03ab-c0be-4a2a-aa4f-c4ced7a71e51 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:41.254156 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-f21f03ab-c0be-4a2a-aa4f-c4ced7a71e51 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:41.254761 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-f21f03ab-c0be-4a2a-aa4f-c4ced7a71e51 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:41.258624 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-f21f03ab-c0be-4a2a-aa4f-c4ced7a71e51 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:41.259314 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-f21f03ab-c0be-4a2a-aa4f-c4ced7a71e51 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:41.260365 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-f21f03ab-c0be-4a2a-aa4f-c4ced7a71e51 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:41.357040 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [None req-01e58fde-b076-43fb-9fde-83e57f995e6e tempest-ServersTestMultiNic-747354117 tempest-ServersTestMultiNic-747354117-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-a144578a-6272-4091-8703-3437088db046) Aug 10 17:53:41.357040 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:53:41.357040 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:53:41.357040 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:53:41.357040 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:53:41.357040 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:53:41.357040 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:53:41.357040 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:53:41.357040 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:53:41.357040 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:53:41.357040 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 17:53:41.357040 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 17:53:41.357040 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 17:53:41.357040 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 17:53:41.357040 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 17:53:41.357040 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 17:53:41.357040 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 17:53:41.357040 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 17:53:41.357040 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 17:53:41.357040 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 17:53:41.357040 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 17:53:41.357040 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 17:53:41.357040 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 17:53:41.357040 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 17:53:41.357040 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 17:53:41.357040 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 17:53:41.357040 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 17:53:41.357040 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:53:41.357040 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:53:41.357040 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 17:53:41.357040 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 17:53:41.357040 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:53:41.357040 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:53:41.357040 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:53:41.357040 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:53:41.357040 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:53:41.357040 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:53:41.357040 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:53:41.357040 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:53:41.357040 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:53:41.357040 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:53:41.357040 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 17:53:41.357040 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 17:53:41.357040 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 17:53:41.357040 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 17:53:41.357040 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 17:53:41.357040 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 17:53:41.357040 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 17:53:41.357040 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 17:53:41.357040 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 17:53:41.357040 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 17:53:41.357040 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 17:53:41.357040 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 17:53:41.361094 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 17:53:41.361094 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 17:53:41.361094 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 17:53:41.361094 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 17:53:41.361094 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 17:53:41.361094 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 17:53:41.361094 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 17:53:41.361094 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 17:53:41.361094 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 17:53:41.361094 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 17:53:41.361094 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 17:53:41.361094 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 17:53:41.361094 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 17:53:41.361094 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 17:53:41.361094 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-a144578a-6272-4091-8703-3437088db046) Aug 10 17:53:41.361094 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:53:41.361094 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-01e58fde-b076-43fb-9fde-83e57f995e6e tempest-ServersTestMultiNic-747354117 tempest-ServersTestMultiNic-747354117-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:53:41.361094 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 17:53:41.361094 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-01e58fde-b076-43fb-9fde-83e57f995e6e tempest-ServersTestMultiNic-747354117 tempest-ServersTestMultiNic-747354117-project] Request method failure captured: Aug 10 17:53:41.361094 n-d-852296-2 devstack@n-api.service[129410]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 17:53:41.361094 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 17:53:41.361094 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 17:53:41.361094 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 17:53:41.361094 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 255 Aug 10 17:53:41.361094 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 17:53:41.361094 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 17:53:41.361094 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 17:53:41.361094 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 17:53:41.361094 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8_CTR0vyiG9snnq4cJ5OL7ozNljeQoMtfR8BCOsdMjIgTqz7F6-Rr--KRU17Vf7baGkxc9GVtRlYaEK9Phg_dGiJuswYF2QwJJXZqDL24raheeZNcRWFxSpBGWGxvrFqQ9z0wlis5GQVc6EMZ8FTYXvDrc4UgwJUrwlleBYVk9PrqNU Aug 10 17:53:41.361094 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 17:53:41.361094 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 17:53:41.361094 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 17:53:41.361094 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 17:53:41.361094 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 17:53:41.361094 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 17:53:41.361094 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: 6ba1cff7fb4948b188ee5035d62ca33d Aug 10 17:53:41.361094 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-ServersTestMultiNic-747354117 Aug 10 17:53:41.361094 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 17:53:41.361094 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 17:53:41.361094 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6ba1cff7fb4948b188ee5035d62ca33d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6ba1cff7fb4948b188ee5035d62ca33d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6ba1cff7fb4948b188ee5035d62ca33d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6ba1cff7fb4948b188ee5035d62ca33d", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:53:41.361094 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-ServersTestMultiNic-747354117 Aug 10 17:53:41.361094 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: 6ba1cff7fb4948b188ee5035d62ca33d Aug 10 17:53:41.361094 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-ServersTestMultiNic-747354117 Aug 10 17:53:41.361094 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-ServersTestMultiNic-747354117-project Aug 10 17:53:41.361094 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 17:53:41.361094 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 17:53:41.361094 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: 00a7707e6faf464aa686a4e4472c8848 Aug 10 17:53:41.361094 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-ServersTestMultiNic-747354117-project Aug 10 17:53:41.361094 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 17:53:41.361094 n-d-852296-2 devstack@n-api.service[129410]: {"server": {"name": "tempest-ServersTestMultiNic-server-1892607157", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "c3d5b397-16c1-4cbc-9f79-6c1defe6dba3"}, {"uuid": "a5ec6cbb-7fe4-40f3-b017-28792331a69c"}]}} Aug 10 17:53:41.361094 n-d-852296-2 devstack@n-api.service[129410]: method: > Aug 10 17:53:41.361094 n-d-852296-2 devstack@n-api.service[129410]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:53:41.361094 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 17:53:41.361094 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'body': {'server': {'name': 'tempest-ServersTestMultiNic-server-1892607157', 'imageRef': 'a735ff26-463a-4ffe-a981-ab9d9baa494f', 'flavorRef': '452', 'networks': [{'uuid': 'c3d5b397-16c1-4cbc-9f79-6c1defe6dba3'}, {'uuid': 'a5ec6cbb-7fe4-40f3-b017-28792331a69c'}]}}} Aug 10 17:53:41.361094 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:53:41.365428 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:53:41.365428 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:53:41.365428 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:53:41.365428 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:53:41.365428 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:53:41.365428 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:53:41.365428 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:53:41.365428 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:53:41.365428 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:53:41.365428 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 17:53:41.365428 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 17:53:41.365428 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 17:53:41.365428 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 17:53:41.365428 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 17:53:41.365428 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 17:53:41.365428 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 17:53:41.365428 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 17:53:41.365428 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 17:53:41.365428 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 17:53:41.365428 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 17:53:41.365428 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 17:53:41.365428 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 17:53:41.365428 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 17:53:41.365428 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 17:53:41.365428 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 17:53:41.365428 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 17:53:41.365428 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:53:41.365428 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:53:41.365428 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 17:53:41.365428 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 17:53:41.365428 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:53:41.365428 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:53:41.365428 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:53:41.365428 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:53:41.365428 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:53:41.365428 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:53:41.365428 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:53:41.365428 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:53:41.365428 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:53:41.365428 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:53:41.365428 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 17:53:41.365428 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 17:53:41.365428 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 17:53:41.365428 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 17:53:41.365428 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 17:53:41.365428 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 17:53:41.365428 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 17:53:41.365428 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 17:53:41.365428 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 17:53:41.365428 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 17:53:41.365428 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 17:53:41.365428 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 17:53:41.365428 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 17:53:41.365428 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 17:53:41.365428 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 17:53:41.365428 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 17:53:41.370155 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 17:53:41.370155 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 17:53:41.370155 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 17:53:41.370155 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 17:53:41.370155 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 17:53:41.370155 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 17:53:41.370155 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 17:53:41.370155 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 17:53:41.370155 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 17:53:41.370155 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 17:53:41.370155 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-a144578a-6272-4091-8703-3437088db046) Aug 10 17:53:41.370155 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:53:41.370155 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:53:41.370155 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:53:41.370155 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:53:41.370155 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:53:41.370155 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:53:41.370155 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:53:41.370155 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:53:41.370155 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 10 17:53:41.370155 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 10 17:53:41.370155 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:53:41.370155 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:53:41.370155 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:53:41.370155 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:53:41.370155 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:53:41.370155 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:53:41.370155 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:53:41.370155 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:53:41.370155 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:53:41.370155 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:53:41.370155 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:53:41.370155 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:53:41.370155 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:53:41.370155 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-01e58fde-b076-43fb-9fde-83e57f995e6e tempest-ServersTestMultiNic-747354117 tempest-ServersTestMultiNic-747354117-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:53:41.370155 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:53:41.370155 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-01e58fde-b076-43fb-9fde-83e57f995e6e tempest-ServersTestMultiNic-747354117 tempest-ServersTestMultiNic-747354117-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.739878 Aug 10 17:53:41.370155 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 580/1161] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 17:53:40 2022] POST /compute/v2.1/servers => generated 214 bytes in 743 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 10 17:53:41.373579 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [req-319f68ab-7de6-4e30-ab94-b5b3c42843c9 req-99c613ad-702d-424c-a973-2c69586880a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "873f60d0-8ef0-4ff5-800d-945ca4237a28", "name": "network-vif-deleted", "tag": "ceae5e90-0655-4ae7-a475-8af854b4bda6"}]} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:53:41.394012 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-319f68ab-7de6-4e30-ab94-b5b3c42843c9 req-99c613ad-702d-424c-a973-2c69586880a0 service nova] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:41.394504 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-319f68ab-7de6-4e30-ab94-b5b3c42843c9 req-99c613ad-702d-424c-a973-2c69586880a0 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:41.394936 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-319f68ab-7de6-4e30-ab94-b5b3c42843c9 req-99c613ad-702d-424c-a973-2c69586880a0 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:41.409039 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-f21f03ab-c0be-4a2a-aa4f-c4ced7a71e51 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:41.422084 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-f21f03ab-c0be-4a2a-aa4f-c4ced7a71e51 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/873f60d0-8ef0-4ff5-800d-945ca4237a28" status: 200 len: 1301 microversion: 2.1 time: 0.199639 Aug 10 17:53:41.432944 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.compute.server_external_events [req-319f68ab-7de6-4e30-ab94-b5b3c42843c9 req-99c613ad-702d-424c-a973-2c69586880a0 service nova] Creating event network-vif-deleted:ceae5e90-0655-4ae7-a475-8af854b4bda6 for instance 873f60d0-8ef0-4ff5-800d-945ca4237a28 on n-h2-852296-2 Aug 10 17:53:41.445580 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 582/1162] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:41 2022] GET /compute/v2.1/servers/873f60d0-8ef0-4ff5-800d-945ca4237a28 => generated 1301 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:53:41.445580 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-2d3509cf-48ff-478f-a04d-c77d3908b431 tempest-LiveMigrationNegativeTest-2143065160 tempest-LiveMigrationNegativeTest-2143065160-project-admin] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:41.445580 n-d-852296-2 devstack@n-api.service[129409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:53:41.445580 n-d-852296-2 devstack@n-api.service[129409]: warnings.warn(msg) Aug 10 17:53:41.445580 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-2d3509cf-48ff-478f-a04d-c77d3908b431 tempest-LiveMigrationNegativeTest-2143065160 tempest-LiveMigrationNegativeTest-2143065160-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:41.446095 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-2d3509cf-48ff-478f-a04d-c77d3908b431 tempest-LiveMigrationNegativeTest-2143065160 tempest-LiveMigrationNegativeTest-2143065160-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:41.446095 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-2d3509cf-48ff-478f-a04d-c77d3908b431 tempest-LiveMigrationNegativeTest-2143065160 tempest-LiveMigrationNegativeTest-2143065160-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:41.446840 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-2d3509cf-48ff-478f-a04d-c77d3908b431 tempest-LiveMigrationNegativeTest-2143065160 tempest-LiveMigrationNegativeTest-2143065160-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:41.447510 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-2d3509cf-48ff-478f-a04d-c77d3908b431 tempest-LiveMigrationNegativeTest-2143065160 tempest-LiveMigrationNegativeTest-2143065160-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:41.448400 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [req-319f68ab-7de6-4e30-ab94-b5b3c42843c9 req-99c613ad-702d-424c-a973-2c69586880a0 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083606 Aug 10 17:53:41.449999 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-2d3509cf-48ff-478f-a04d-c77d3908b431 tempest-LiveMigrationNegativeTest-2143065160 tempest-LiveMigrationNegativeTest-2143065160-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:41.454650 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 581/1163] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 10 17:53:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:53:41.467900 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-2f2bc9e9-1936-4f3b-9346-a1f1621bf677 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:41.472534 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-2f2bc9e9-1936-4f3b-9346-a1f1621bf677 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] [instance: 12eda82b-051e-446c-b78b-6c9c9f6f78d0] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:41.485484 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2f2bc9e9-1936-4f3b-9346-a1f1621bf677 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:41.486212 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2f2bc9e9-1936-4f3b-9346-a1f1621bf677 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:41.488213 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2f2bc9e9-1936-4f3b-9346-a1f1621bf677 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:41.489397 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2f2bc9e9-1936-4f3b-9346-a1f1621bf677 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:41.490411 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2f2bc9e9-1936-4f3b-9346-a1f1621bf677 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:41.491107 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2f2bc9e9-1936-4f3b-9346-a1f1621bf677 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:41.513865 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-2d3509cf-48ff-478f-a04d-c77d3908b431 tempest-LiveMigrationNegativeTest-2143065160 tempest-LiveMigrationNegativeTest-2143065160-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.079406 Aug 10 17:53:41.519474 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 583/1164] 10.222.0.50 () {58 vars in 1176 bytes} [Wed Aug 10 17:53:41 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:53:41.533387 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-2f2bc9e9-1936-4f3b-9346-a1f1621bf677 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] [instance: 12eda82b-051e-446c-b78b-6c9c9f6f78d0] Going to try to terminate instance {{(pid=129410) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 17:53:41.539084 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-c6b8d250-73dd-4cf2-8b30-69daaaf7511f tempest-LiveMigrationNegativeTest-2143065160 tempest-LiveMigrationNegativeTest-2143065160-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-852296-2", "block_migration": true, "disk_over_commit": false}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:53:41.542485 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-c6b8d250-73dd-4cf2-8b30-69daaaf7511f tempest-LiveMigrationNegativeTest-2143065160 tempest-LiveMigrationNegativeTest-2143065160-project-admin] [instance: 4390cd8e-2484-4205-9678-fb7332d1c78d] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:41.551938 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c6b8d250-73dd-4cf2-8b30-69daaaf7511f tempest-LiveMigrationNegativeTest-2143065160 tempest-LiveMigrationNegativeTest-2143065160-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:41.552522 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c6b8d250-73dd-4cf2-8b30-69daaaf7511f tempest-LiveMigrationNegativeTest-2143065160 tempest-LiveMigrationNegativeTest-2143065160-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:41.552962 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c6b8d250-73dd-4cf2-8b30-69daaaf7511f tempest-LiveMigrationNegativeTest-2143065160 tempest-LiveMigrationNegativeTest-2143065160-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:41.553739 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c6b8d250-73dd-4cf2-8b30-69daaaf7511f tempest-LiveMigrationNegativeTest-2143065160 tempest-LiveMigrationNegativeTest-2143065160-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:41.554262 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c6b8d250-73dd-4cf2-8b30-69daaaf7511f tempest-LiveMigrationNegativeTest-2143065160 tempest-LiveMigrationNegativeTest-2143065160-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:41.554676 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c6b8d250-73dd-4cf2-8b30-69daaaf7511f tempest-LiveMigrationNegativeTest-2143065160 tempest-LiveMigrationNegativeTest-2143065160-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:41.911502 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [None req-c6b8d250-73dd-4cf2-8b30-69daaaf7511f tempest-LiveMigrationNegativeTest-2143065160 tempest-LiveMigrationNegativeTest-2143065160-project-admin] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-93b95304-7f48-4dcd-bcdb-ce0741041894) Aug 10 17:53:41.911502 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:53:41.911502 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:53:41.911502 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:53:41.911502 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:53:41.911502 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:53:41.911502 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:53:41.911502 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:53:41.911502 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:53:41.911502 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:53:41.911502 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 10 17:53:41.911502 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Aug 10 17:53:41.911502 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Aug 10 17:53:41.911502 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 368, in inner Aug 10 17:53:41.911502 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi if self.network_api.instance_has_extended_resource_request( Aug 10 17:53:41.911502 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1035, in instance_has_extended_resource_request Aug 10 17:53:41.911502 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi if not self.has_extended_resource_request_extension(admin_context): Aug 10 17:53:41.911502 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 17:53:41.911502 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 17:53:41.911502 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 17:53:41.911502 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 17:53:41.911502 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 17:53:41.911502 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 17:53:41.911502 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:53:41.911502 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:53:41.911502 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 17:53:41.911502 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 17:53:41.911502 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:53:41.911502 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:53:41.911502 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:53:41.911502 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:53:41.911502 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:53:41.911502 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:53:41.911502 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:53:41.911502 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:53:41.911502 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:53:41.911502 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:53:41.911502 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 17:53:41.911502 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 17:53:41.911502 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 17:53:41.911502 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 17:53:41.911502 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 17:53:41.911502 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 17:53:41.911502 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 17:53:41.911502 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 17:53:41.911502 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 17:53:41.911502 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 17:53:41.911502 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 17:53:41.911502 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 17:53:41.911502 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 17:53:41.911502 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 17:53:41.920570 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 17:53:41.920570 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 17:53:41.920570 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 17:53:41.920570 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 17:53:41.920570 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 17:53:41.920570 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 17:53:41.920570 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 17:53:41.920570 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 17:53:41.920570 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 17:53:41.920570 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 17:53:41.920570 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 17:53:41.920570 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 17:53:41.920570 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-93b95304-7f48-4dcd-bcdb-ce0741041894) Aug 10 17:53:41.920570 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:53:41.920570 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-c6b8d250-73dd-4cf2-8b30-69daaaf7511f tempest-LiveMigrationNegativeTest-2143065160 tempest-LiveMigrationNegativeTest-2143065160-project-admin] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:53:41.920570 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:53:41.920570 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-c6b8d250-73dd-4cf2-8b30-69daaaf7511f tempest-LiveMigrationNegativeTest-2143065160 tempest-LiveMigrationNegativeTest-2143065160-project-admin] Request method failure captured: Aug 10 17:53:41.920570 n-d-852296-2 devstack@n-api.service[129409]: request: POST /compute/v2.1/servers/4390cd8e-2484-4205-9678-fb7332d1c78d/action HTTP/1.1 Aug 10 17:53:41.920570 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 17:53:41.920570 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 17:53:41.920570 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 17:53:41.920570 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 97 Aug 10 17:53:41.920570 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 17:53:41.920570 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 17:53:41.920570 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 17:53:41.920570 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 17:53:41.920570 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8_B0Q8-09Hwlfuybk-MNSgqBUgaqU0bCElMZ60k8mp7AMIIUVvno9spRXefYJvXE0__upoYexOwkTwUq3WFp7v3SM7fRjc8eSU4HcSFIz4TNBIAhmgXYhxVjC_QC3umF3Y9XcdMfbJvgifhs3GPSbXwkVwUr7MPv4adm1Cp85mTgGjw Aug 10 17:53:41.920570 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 17:53:41.920570 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 17:53:41.920570 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 17:53:41.920570 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 17:53:41.920570 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 17:53:41.920570 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 17:53:41.920570 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: f42088ae2e2c42b3bedf8280efde9912 Aug 10 17:53:41.920570 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-LiveMigrationNegativeTest-2143065160 Aug 10 17:53:41.920570 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member,admin Aug 10 17:53:41.920570 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member,admin Aug 10 17:53:41.920570 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f42088ae2e2c42b3bedf8280efde9912"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f42088ae2e2c42b3bedf8280efde9912"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f42088ae2e2c42b3bedf8280efde9912"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f42088ae2e2c42b3bedf8280efde9912", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:53:41.920570 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-LiveMigrationNegativeTest-2143065160 Aug 10 17:53:41.920570 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: f42088ae2e2c42b3bedf8280efde9912 Aug 10 17:53:41.920570 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-2143065160 Aug 10 17:53:41.920570 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-LiveMigrationNegativeTest-2143065160-project-admin Aug 10 17:53:41.920570 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 17:53:41.920570 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 17:53:41.920570 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: 9448e6b6b3874ee3bfe34180943f4809 Aug 10 17:53:41.920570 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-LiveMigrationNegativeTest-2143065160-project-admin Aug 10 17:53:41.920570 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:53:41.920570 n-d-852296-2 devstack@n-api.service[129409]: {"os-migrateLive": {"host": "n-h2-852296-2", "block_migration": true, "disk_over_commit": false}} Aug 10 17:53:41.920570 n-d-852296-2 devstack@n-api.service[129409]: method: > Aug 10 17:53:41.920570 n-d-852296-2 devstack@n-api.service[129409]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:53:41.920570 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:53:41.920570 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'id': '4390cd8e-2484-4205-9678-fb7332d1c78d', 'body': {'os-migrateLive': {'host': 'n-h2-852296-2', 'block_migration': True, 'disk_over_commit': False}}} Aug 10 17:53:41.920570 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:53:41.920570 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:53:41.920570 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:53:41.920570 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:53:41.924204 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:53:41.924204 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:53:41.924204 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:53:41.924204 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:53:41.924204 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:53:41.924204 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:53:41.924204 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 10 17:53:41.924204 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Aug 10 17:53:41.924204 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Aug 10 17:53:41.924204 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 368, in inner Aug 10 17:53:41.924204 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi if self.network_api.instance_has_extended_resource_request( Aug 10 17:53:41.924204 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1035, in instance_has_extended_resource_request Aug 10 17:53:41.924204 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi if not self.has_extended_resource_request_extension(admin_context): Aug 10 17:53:41.924204 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 17:53:41.924204 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 17:53:41.924204 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 17:53:41.924204 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 17:53:41.924204 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 17:53:41.924204 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 17:53:41.924204 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:53:41.924204 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:53:41.924204 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 17:53:41.924204 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 17:53:41.924204 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:53:41.924204 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:53:41.924204 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:53:41.924204 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:53:41.924204 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:53:41.924204 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:53:41.924204 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:53:41.924204 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:53:41.924204 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:53:41.924204 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:53:41.924204 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 17:53:41.924204 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 17:53:41.924204 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 17:53:41.924204 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 17:53:41.924204 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 17:53:41.924204 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 17:53:41.924204 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 17:53:41.924204 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 17:53:41.924204 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 17:53:41.924204 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 17:53:41.924204 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 17:53:41.924204 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 17:53:41.924204 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 17:53:41.924204 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 17:53:41.924204 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 17:53:41.924204 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 17:53:41.924204 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 17:53:41.924204 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 17:53:41.924204 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 17:53:41.924204 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 17:53:41.924204 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 17:53:41.931458 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 17:53:41.931458 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 17:53:41.931458 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 17:53:41.931458 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 17:53:41.931458 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 17:53:41.931458 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-93b95304-7f48-4dcd-bcdb-ce0741041894) Aug 10 17:53:41.931458 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:53:41.931458 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:53:41.931458 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:53:41.931458 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:53:41.931458 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:53:41.931458 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:53:41.931458 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:53:41.931458 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:53:41.931458 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 10 17:53:41.931458 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 10 17:53:41.931458 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:53:41.931458 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:53:41.931458 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:53:41.931458 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:53:41.931458 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:53:41.931458 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:53:41.931458 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:53:41.931458 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:53:41.931458 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:53:41.931458 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:53:41.931458 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:53:41.931458 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:53:41.931458 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:53:41.931458 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-c6b8d250-73dd-4cf2-8b30-69daaaf7511f tempest-LiveMigrationNegativeTest-2143065160 tempest-LiveMigrationNegativeTest-2143065160-project-admin] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:53:41.931458 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:53:41.931458 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-c6b8d250-73dd-4cf2-8b30-69daaaf7511f tempest-LiveMigrationNegativeTest-2143065160 tempest-LiveMigrationNegativeTest-2143065160-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/4390cd8e-2484-4205-9678-fb7332d1c78d/action" status: 500 len: 214 microversion: 2.1 time: 0.382357 Aug 10 17:53:41.931458 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 584/1165] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 10 17:53:41 2022] POST /compute/v2.1/servers/4390cd8e-2484-4205-9678-fb7332d1c78d/action => generated 214 bytes in 384 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 10 17:53:41.937853 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-2efd4231-74a0-41f7-9b47-636637ffc674 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:41.938358 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-2efd4231-74a0-41f7-9b47-636637ffc674 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] [instance: 4390cd8e-2484-4205-9678-fb7332d1c78d] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:41.944740 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-2efd4231-74a0-41f7-9b47-636637ffc674 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:41.945235 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-2efd4231-74a0-41f7-9b47-636637ffc674 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:41.945678 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-2efd4231-74a0-41f7-9b47-636637ffc674 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:41.946390 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-2efd4231-74a0-41f7-9b47-636637ffc674 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:41.946852 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-2efd4231-74a0-41f7-9b47-636637ffc674 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:41.947281 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-2efd4231-74a0-41f7-9b47-636637ffc674 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:41.955286 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_cell0:SELECT=19 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:53:41.997128 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-2efd4231-74a0-41f7-9b47-636637ffc674 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] [instance: 4390cd8e-2484-4205-9678-fb7332d1c78d] Going to try to terminate instance {{(pid=129409) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 17:53:42.098470 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-2f2bc9e9-1936-4f3b-9346-a1f1621bf677 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] 10.222.0.50 "DELETE /compute/v2.1/servers/12eda82b-051e-446c-b78b-6c9c9f6f78d0" status: 204 len: 0 microversion: 2.1 time: 0.637285 Aug 10 17:53:42.100275 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 582/1166] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 10 17:53:41 2022] DELETE /compute/v2.1/servers/12eda82b-051e-446c-b78b-6c9c9f6f78d0 => generated 0 bytes in 645 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 17:53:42.110746 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-841573a1-f9f2-4ed8-9663-262099fd420a tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:42.111889 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-841573a1-f9f2-4ed8-9663-262099fd420a tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] [instance: 12eda82b-051e-446c-b78b-6c9c9f6f78d0] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:42.128530 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-841573a1-f9f2-4ed8-9663-262099fd420a tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:42.130904 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-841573a1-f9f2-4ed8-9663-262099fd420a tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:42.132336 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-841573a1-f9f2-4ed8-9663-262099fd420a tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:42.133919 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-841573a1-f9f2-4ed8-9663-262099fd420a tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:42.135525 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-841573a1-f9f2-4ed8-9663-262099fd420a tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:42.136679 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-841573a1-f9f2-4ed8-9663-262099fd420a tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:42.451350 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-2efd4231-74a0-41f7-9b47-636637ffc674 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] 10.222.0.50 "DELETE /compute/v2.1/servers/4390cd8e-2484-4205-9678-fb7332d1c78d" status: 204 len: 0 microversion: 2.1 time: 0.516606 Aug 10 17:53:42.452312 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 585/1167] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 10 17:53:41 2022] DELETE /compute/v2.1/servers/4390cd8e-2484-4205-9678-fb7332d1c78d => generated 0 bytes in 519 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 17:53:42.458249 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-aabbd562-16a2-4f97-a83f-2c3451efdcaa tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:42.459447 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-aabbd562-16a2-4f97-a83f-2c3451efdcaa tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: 873f60d0-8ef0-4ff5-800d-945ca4237a28] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:42.470214 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-aabbd562-16a2-4f97-a83f-2c3451efdcaa tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:42.470706 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-aabbd562-16a2-4f97-a83f-2c3451efdcaa tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:42.471146 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-aabbd562-16a2-4f97-a83f-2c3451efdcaa tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:42.471854 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-aabbd562-16a2-4f97-a83f-2c3451efdcaa tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:42.472330 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-aabbd562-16a2-4f97-a83f-2c3451efdcaa tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:42.472762 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-aabbd562-16a2-4f97-a83f-2c3451efdcaa tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:42.483471 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-841573a1-f9f2-4ed8-9663-262099fd420a tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2fd6acf18d4218ad143ccee2d0bb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7c2481a908406fa9c4562513fff665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:42.497482 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-841573a1-f9f2-4ed8-9663-262099fd420a tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] 10.222.0.50 "GET /compute/v2.1/servers/12eda82b-051e-446c-b78b-6c9c9f6f78d0" status: 200 len: 1468 microversion: 2.1 time: 0.391197 Aug 10 17:53:42.497482 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 583/1168] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:42 2022] GET /compute/v2.1/servers/12eda82b-051e-446c-b78b-6c9c9f6f78d0 => generated 1468 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:53:42.501972 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-d43fbb3f-f5f8-495e-b9a7-5a83a12d8bc8 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:42.502678 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-d43fbb3f-f5f8-495e-b9a7-5a83a12d8bc8 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] [instance: 4390cd8e-2484-4205-9678-fb7332d1c78d] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:42.527482 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d43fbb3f-f5f8-495e-b9a7-5a83a12d8bc8 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:42.528408 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d43fbb3f-f5f8-495e-b9a7-5a83a12d8bc8 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:42.529098 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d43fbb3f-f5f8-495e-b9a7-5a83a12d8bc8 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:42.530082 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d43fbb3f-f5f8-495e-b9a7-5a83a12d8bc8 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:42.530773 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d43fbb3f-f5f8-495e-b9a7-5a83a12d8bc8 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:42.531577 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d43fbb3f-f5f8-495e-b9a7-5a83a12d8bc8 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:42.552914 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-aabbd562-16a2-4f97-a83f-2c3451efdcaa tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:42.554003 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-aabbd562-16a2-4f97-a83f-2c3451efdcaa tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:42.554455 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-aabbd562-16a2-4f97-a83f-2c3451efdcaa tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:42.555732 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.objects.instance [None req-aabbd562-16a2-4f97-a83f-2c3451efdcaa tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lazy-loading 'fault' on Instance uuid 873f60d0-8ef0-4ff5-800d-945ca4237a28 {{(pid=129409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:53:42.637449 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-aabbd562-16a2-4f97-a83f-2c3451efdcaa tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:42.645274 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-aabbd562-16a2-4f97-a83f-2c3451efdcaa tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/873f60d0-8ef0-4ff5-800d-945ca4237a28" status: 200 len: 1306 microversion: 2.1 time: 0.191477 Aug 10 17:53:42.647140 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 586/1169] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:42 2022] GET /compute/v2.1/servers/873f60d0-8ef0-4ff5-800d-945ca4237a28 => generated 1306 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:53:42.827803 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-d43fbb3f-f5f8-495e-b9a7-5a83a12d8bc8 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f082ed04bc143679029c204e8a97160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c7c8eeb1b4065b25fe28eba30d0eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:42.839439 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-d43fbb3f-f5f8-495e-b9a7-5a83a12d8bc8 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] 10.222.0.50 "GET /compute/v2.1/servers/4390cd8e-2484-4205-9678-fb7332d1c78d" status: 200 len: 1465 microversion: 2.1 time: 0.340273 Aug 10 17:53:42.842435 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 584/1170] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:42 2022] GET /compute/v2.1/servers/4390cd8e-2484-4205-9678-fb7332d1c78d => generated 1465 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:53:43.530525 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-def52476-55b9-4d1b-bfe9-0a9bcd57d710 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:43.531753 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-def52476-55b9-4d1b-bfe9-0a9bcd57d710 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] [instance: 12eda82b-051e-446c-b78b-6c9c9f6f78d0] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:43.541148 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-def52476-55b9-4d1b-bfe9-0a9bcd57d710 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:43.543454 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-def52476-55b9-4d1b-bfe9-0a9bcd57d710 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:43.543907 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-def52476-55b9-4d1b-bfe9-0a9bcd57d710 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:43.544661 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-def52476-55b9-4d1b-bfe9-0a9bcd57d710 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:43.545119 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-def52476-55b9-4d1b-bfe9-0a9bcd57d710 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:43.545544 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-def52476-55b9-4d1b-bfe9-0a9bcd57d710 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:43.666396 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-b9594339-638e-4b53-b07b-79ae8155d292 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:43.667214 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-b9594339-638e-4b53-b07b-79ae8155d292 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: 873f60d0-8ef0-4ff5-800d-945ca4237a28] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:43.674558 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b9594339-638e-4b53-b07b-79ae8155d292 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:43.675057 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b9594339-638e-4b53-b07b-79ae8155d292 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:43.675493 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b9594339-638e-4b53-b07b-79ae8155d292 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:43.676410 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b9594339-638e-4b53-b07b-79ae8155d292 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:43.676869 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b9594339-638e-4b53-b07b-79ae8155d292 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:43.677295 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b9594339-638e-4b53-b07b-79ae8155d292 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:43.700933 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-b9594339-638e-4b53-b07b-79ae8155d292 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] HTTP exception thrown: Instance 873f60d0-8ef0-4ff5-800d-945ca4237a28 could not be found. Aug 10 17:53:43.702597 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-b9594339-638e-4b53-b07b-79ae8155d292 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Request method failure captured: Aug 10 17:53:43.702597 n-d-852296-2 devstack@n-api.service[129410]: request: GET /compute/v2.1/servers/873f60d0-8ef0-4ff5-800d-945ca4237a28 HTTP/1.1 Aug 10 17:53:43.702597 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 17:53:43.702597 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 17:53:43.702597 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 17:53:43.702597 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 0 Aug 10 17:53:43.702597 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 17:53:43.702597 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 17:53:43.702597 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 17:53:43.702597 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 17:53:43.702597 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8-_vb7x9x9F8-sP6h5pKdcrrsXpPJ2RlEbuCXnu2ZTWdSKtHarFJLe7Hjf1WLDt_yPDFFQT5gzj11kqkxwhqMHpazNhmqyhgrlC3SoXOue_P66sN7aOFIkgqmKczGGaSXM3e-yfy_FvawvLBNZry68s7Q1kz50eCpVoZBo2bvZ2yTNc Aug 10 17:53:43.702597 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 17:53:43.702597 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 17:53:43.702597 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 17:53:43.702597 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 17:53:43.702597 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 17:53:43.702597 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 17:53:43.702597 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: 0638146d08704b2983761619745290b3 Aug 10 17:53:43.702597 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-ServersOnMultiNodesTest-946016060 Aug 10 17:53:43.702597 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 17:53:43.702597 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 17:53:43.702597 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0638146d08704b2983761619745290b3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/0638146d08704b2983761619745290b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0638146d08704b2983761619745290b3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_0638146d08704b2983761619745290b3", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:53:43.702597 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-ServersOnMultiNodesTest-946016060 Aug 10 17:53:43.702597 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: 0638146d08704b2983761619745290b3 Aug 10 17:53:43.702597 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-946016060 Aug 10 17:53:43.702597 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-ServersOnMultiNodesTest-946016060-project Aug 10 17:53:43.702597 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 17:53:43.702597 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 17:53:43.702597 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: f76b870a54454956b3926c34f9f27442 Aug 10 17:53:43.702597 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-ServersOnMultiNodesTest-946016060-project Aug 10 17:53:43.702597 n-d-852296-2 devstack@n-api.service[129410]: method: > Aug 10 17:53:43.702597 n-d-852296-2 devstack@n-api.service[129410]: exception: Instance 873f60d0-8ef0-4ff5-800d-945ca4237a28 could not be found. Aug 10 17:53:43.702597 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'id': '873f60d0-8ef0-4ff5-800d-945ca4237a28'} Aug 10 17:53:43.702597 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:53:43.702597 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:53:43.702597 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 17:53:43.702597 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 17:53:43.702597 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 17:53:43.702597 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 17:53:43.702597 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 17:53:43.702597 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 17:53:43.702597 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 17:53:43.702597 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 17:53:43.702597 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 873f60d0-8ef0-4ff5-800d-945ca4237a28 could not be found. Aug 10 17:53:43.702597 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:53:43.702597 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:53:43.702597 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:53:43.702597 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:53:43.702597 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:53:43.702597 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:53:43.702597 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:53:43.702597 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:53:43.702597 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:53:43.702597 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:53:43.702597 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 17:53:43.702597 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 17:53:43.702597 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 17:53:43.702597 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 17:53:43.702597 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 17:53:43.702597 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:53:43.702597 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 873f60d0-8ef0-4ff5-800d-945ca4237a28 could not be found. Aug 10 17:53:43.702597 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:53:43.702597 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:53:43.702597 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:53:43.719668 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:53:43.719668 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:53:43.719668 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:53:43.719668 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:53:43.719668 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:53:43.719668 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 873f60d0-8ef0-4ff5-800d-945ca4237a28 could not be found. Aug 10 17:53:43.719668 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:53:43.719668 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-b9594339-638e-4b53-b07b-79ae8155d292 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Returning 404 to user: Instance 873f60d0-8ef0-4ff5-800d-945ca4237a28 could not be found. {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:53:43.719668 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-b9594339-638e-4b53-b07b-79ae8155d292 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/873f60d0-8ef0-4ff5-800d-945ca4237a28" status: 404 len: 111 microversion: 2.1 time: 0.045858 Aug 10 17:53:43.719668 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 585/1171] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:43 2022] GET /compute/v2.1/servers/873f60d0-8ef0-4ff5-800d-945ca4237a28 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:53:43.741351 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-99fd9d0f-8633-4db6-9d6b-74c85d3db8f5 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:43.745280 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-99fd9d0f-8633-4db6-9d6b-74c85d3db8f5 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: f747d5da-322c-4afb-bac6-c614b85656f9] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:43.755668 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-99fd9d0f-8633-4db6-9d6b-74c85d3db8f5 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:43.756162 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-99fd9d0f-8633-4db6-9d6b-74c85d3db8f5 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:43.756635 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-99fd9d0f-8633-4db6-9d6b-74c85d3db8f5 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:43.757354 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-99fd9d0f-8633-4db6-9d6b-74c85d3db8f5 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:43.757814 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-99fd9d0f-8633-4db6-9d6b-74c85d3db8f5 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:43.758239 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-99fd9d0f-8633-4db6-9d6b-74c85d3db8f5 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:43.831917 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-99fd9d0f-8633-4db6-9d6b-74c85d3db8f5 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: f747d5da-322c-4afb-bac6-c614b85656f9] Going to try to terminate instance {{(pid=129410) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 17:53:43.973604 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-def52476-55b9-4d1b-bfe9-0a9bcd57d710 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2fd6acf18d4218ad143ccee2d0bb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7c2481a908406fa9c4562513fff665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:43.985457 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-def52476-55b9-4d1b-bfe9-0a9bcd57d710 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] 10.222.0.50 "GET /compute/v2.1/servers/12eda82b-051e-446c-b78b-6c9c9f6f78d0" status: 200 len: 1468 microversion: 2.1 time: 0.472079 Aug 10 17:53:43.990622 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 587/1172] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:43 2022] GET /compute/v2.1/servers/12eda82b-051e-446c-b78b-6c9c9f6f78d0 => generated 1468 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:53:44.009667 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-7fdbf544-e02e-4013-b855-56cd74860654 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:44.014204 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-7fdbf544-e02e-4013-b855-56cd74860654 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] [instance: 4390cd8e-2484-4205-9678-fb7332d1c78d] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:44.030738 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7fdbf544-e02e-4013-b855-56cd74860654 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:44.045595 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7fdbf544-e02e-4013-b855-56cd74860654 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:44.046234 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7fdbf544-e02e-4013-b855-56cd74860654 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:44.047061 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7fdbf544-e02e-4013-b855-56cd74860654 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:44.048918 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7fdbf544-e02e-4013-b855-56cd74860654 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:44.049541 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7fdbf544-e02e-4013-b855-56cd74860654 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:44.092235 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_cell1:UPDATE=8,nova_cell1:SELECT=88,nova_cell1:INSERT=4 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:53:44.247159 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=9,nova_api:INSERT=7 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:53:44.373008 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-99fd9d0f-8633-4db6-9d6b-74c85d3db8f5 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "DELETE /compute/v2.1/servers/f747d5da-322c-4afb-bac6-c614b85656f9" status: 204 len: 0 microversion: 2.1 time: 0.650383 Aug 10 17:53:44.374321 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 586/1173] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 10 17:53:43 2022] DELETE /compute/v2.1/servers/f747d5da-322c-4afb-bac6-c614b85656f9 => generated 0 bytes in 653 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 17:53:44.386682 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-585aec62-e1cb-45ab-8561-e05d8ae786da tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:44.387641 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-585aec62-e1cb-45ab-8561-e05d8ae786da tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: f747d5da-322c-4afb-bac6-c614b85656f9] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:44.404688 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-585aec62-e1cb-45ab-8561-e05d8ae786da tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:44.406872 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-585aec62-e1cb-45ab-8561-e05d8ae786da tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:44.407744 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-585aec62-e1cb-45ab-8561-e05d8ae786da tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:44.409076 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-585aec62-e1cb-45ab-8561-e05d8ae786da tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:44.411464 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-585aec62-e1cb-45ab-8561-e05d8ae786da tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:44.412327 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-585aec62-e1cb-45ab-8561-e05d8ae786da tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:44.728378 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-7fdbf544-e02e-4013-b855-56cd74860654 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f082ed04bc143679029c204e8a97160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c7c8eeb1b4065b25fe28eba30d0eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:44.751522 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-7fdbf544-e02e-4013-b855-56cd74860654 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] 10.222.0.50 "GET /compute/v2.1/servers/4390cd8e-2484-4205-9678-fb7332d1c78d" status: 200 len: 1465 microversion: 2.1 time: 0.751209 Aug 10 17:53:44.751522 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 588/1174] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:43 2022] GET /compute/v2.1/servers/4390cd8e-2484-4205-9678-fb7332d1c78d => generated 1465 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:53:44.812823 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-585aec62-e1cb-45ab-8561-e05d8ae786da tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:44.823739 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-585aec62-e1cb-45ab-8561-e05d8ae786da tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/f747d5da-322c-4afb-bac6-c614b85656f9" status: 200 len: 1473 microversion: 2.1 time: 0.442405 Aug 10 17:53:44.825052 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 587/1175] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:44 2022] GET /compute/v2.1/servers/f747d5da-322c-4afb-bac6-c614b85656f9 => generated 1473 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:53:45.015589 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-885cbfdd-a0e2-4a1b-80a4-114389bdd0a2 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:45.017385 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-885cbfdd-a0e2-4a1b-80a4-114389bdd0a2 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] [instance: 12eda82b-051e-446c-b78b-6c9c9f6f78d0] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:45.047284 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-885cbfdd-a0e2-4a1b-80a4-114389bdd0a2 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:45.048227 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-885cbfdd-a0e2-4a1b-80a4-114389bdd0a2 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:45.048952 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-885cbfdd-a0e2-4a1b-80a4-114389bdd0a2 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:45.049913 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-885cbfdd-a0e2-4a1b-80a4-114389bdd0a2 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:45.054019 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-885cbfdd-a0e2-4a1b-80a4-114389bdd0a2 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:45.054914 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-885cbfdd-a0e2-4a1b-80a4-114389bdd0a2 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:45.210588 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-885cbfdd-a0e2-4a1b-80a4-114389bdd0a2 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2fd6acf18d4218ad143ccee2d0bb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7c2481a908406fa9c4562513fff665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:45.224824 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-885cbfdd-a0e2-4a1b-80a4-114389bdd0a2 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] 10.222.0.50 "GET /compute/v2.1/servers/12eda82b-051e-446c-b78b-6c9c9f6f78d0" status: 200 len: 1426 microversion: 2.1 time: 0.214341 Aug 10 17:53:45.225631 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 589/1176] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:45 2022] GET /compute/v2.1/servers/12eda82b-051e-446c-b78b-6c9c9f6f78d0 => generated 1426 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:53:45.485760 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [req-ec10cd10-2903-4443-8946-034037325d23 req-1205276c-9d8c-4472-9ba7-f7dee82db69f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12eda82b-051e-446c-b78b-6c9c9f6f78d0", "name": "network-vif-deleted", "tag": "178a85c3-8f3f-4fb1-89ab-d84c805185db"}]} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:53:45.521092 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-ec10cd10-2903-4443-8946-034037325d23 req-1205276c-9d8c-4472-9ba7-f7dee82db69f service nova] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:45.521574 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-ec10cd10-2903-4443-8946-034037325d23 req-1205276c-9d8c-4472-9ba7-f7dee82db69f service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:45.522001 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-ec10cd10-2903-4443-8946-034037325d23 req-1205276c-9d8c-4472-9ba7-f7dee82db69f service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:45.551679 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.compute.server_external_events [req-ec10cd10-2903-4443-8946-034037325d23 req-1205276c-9d8c-4472-9ba7-f7dee82db69f service nova] Creating event network-vif-deleted:178a85c3-8f3f-4fb1-89ab-d84c805185db for instance 12eda82b-051e-446c-b78b-6c9c9f6f78d0 on n-h2-852296-2 Aug 10 17:53:45.570027 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [req-ec10cd10-2903-4443-8946-034037325d23 req-1205276c-9d8c-4472-9ba7-f7dee82db69f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089726 Aug 10 17:53:45.583498 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 588/1177] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 10 17:53:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:53:45.771123 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-edc7680e-e529-4c12-afcf-d8bb70513ec0 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:45.772686 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-edc7680e-e529-4c12-afcf-d8bb70513ec0 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] [instance: 4390cd8e-2484-4205-9678-fb7332d1c78d] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:45.787311 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-edc7680e-e529-4c12-afcf-d8bb70513ec0 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:45.789642 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-edc7680e-e529-4c12-afcf-d8bb70513ec0 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:45.791144 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-edc7680e-e529-4c12-afcf-d8bb70513ec0 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:45.792187 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-edc7680e-e529-4c12-afcf-d8bb70513ec0 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:45.792884 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-edc7680e-e529-4c12-afcf-d8bb70513ec0 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:45.794821 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-edc7680e-e529-4c12-afcf-d8bb70513ec0 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:45.846642 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-cb5aa88f-5179-4a11-8cf6-f0c7517feb2e tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:45.847341 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-cb5aa88f-5179-4a11-8cf6-f0c7517feb2e tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: f747d5da-322c-4afb-bac6-c614b85656f9] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:45.857267 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-cb5aa88f-5179-4a11-8cf6-f0c7517feb2e tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:45.863218 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-cb5aa88f-5179-4a11-8cf6-f0c7517feb2e tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:45.864402 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-cb5aa88f-5179-4a11-8cf6-f0c7517feb2e tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:45.870606 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-cb5aa88f-5179-4a11-8cf6-f0c7517feb2e tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:45.873026 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-cb5aa88f-5179-4a11-8cf6-f0c7517feb2e tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:45.873720 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-cb5aa88f-5179-4a11-8cf6-f0c7517feb2e tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:46.081570 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-edc7680e-e529-4c12-afcf-d8bb70513ec0 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f082ed04bc143679029c204e8a97160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c7c8eeb1b4065b25fe28eba30d0eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:46.113420 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-edc7680e-e529-4c12-afcf-d8bb70513ec0 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] 10.222.0.50 "GET /compute/v2.1/servers/4390cd8e-2484-4205-9678-fb7332d1c78d" status: 200 len: 1423 microversion: 2.1 time: 0.347311 Aug 10 17:53:46.114295 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 590/1178] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:45 2022] GET /compute/v2.1/servers/4390cd8e-2484-4205-9678-fb7332d1c78d => generated 1423 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:53:46.248716 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-78efba94-3734-4cb9-9e03-0d0c5a31a1a7 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:46.249648 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-78efba94-3734-4cb9-9e03-0d0c5a31a1a7 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] [instance: 12eda82b-051e-446c-b78b-6c9c9f6f78d0] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:46.262362 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-78efba94-3734-4cb9-9e03-0d0c5a31a1a7 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:46.265214 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-78efba94-3734-4cb9-9e03-0d0c5a31a1a7 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:46.266073 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-78efba94-3734-4cb9-9e03-0d0c5a31a1a7 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:46.268281 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-78efba94-3734-4cb9-9e03-0d0c5a31a1a7 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:46.270627 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-78efba94-3734-4cb9-9e03-0d0c5a31a1a7 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:46.272522 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-78efba94-3734-4cb9-9e03-0d0c5a31a1a7 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:46.280346 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-cb5aa88f-5179-4a11-8cf6-f0c7517feb2e tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:46.288959 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-cb5aa88f-5179-4a11-8cf6-f0c7517feb2e tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/f747d5da-322c-4afb-bac6-c614b85656f9" status: 200 len: 1473 microversion: 2.1 time: 0.447844 Aug 10 17:53:46.301165 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 589/1179] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:45 2022] GET /compute/v2.1/servers/f747d5da-322c-4afb-bac6-c614b85656f9 => generated 1473 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:53:46.340518 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:53:46.370769 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-78efba94-3734-4cb9-9e03-0d0c5a31a1a7 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:46.371761 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-78efba94-3734-4cb9-9e03-0d0c5a31a1a7 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:46.372489 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-78efba94-3734-4cb9-9e03-0d0c5a31a1a7 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:46.373113 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.objects.instance [None req-78efba94-3734-4cb9-9e03-0d0c5a31a1a7 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lazy-loading 'fault' on Instance uuid 12eda82b-051e-446c-b78b-6c9c9f6f78d0 {{(pid=129409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:53:46.462701 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-78efba94-3734-4cb9-9e03-0d0c5a31a1a7 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2fd6acf18d4218ad143ccee2d0bb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7c2481a908406fa9c4562513fff665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:46.499919 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-78efba94-3734-4cb9-9e03-0d0c5a31a1a7 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] 10.222.0.50 "GET /compute/v2.1/servers/12eda82b-051e-446c-b78b-6c9c9f6f78d0" status: 200 len: 1303 microversion: 2.1 time: 0.256645 Aug 10 17:53:46.504268 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 591/1180] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:46 2022] GET /compute/v2.1/servers/12eda82b-051e-446c-b78b-6c9c9f6f78d0 => generated 1303 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:53:47.133944 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-385b6934-d212-4f4e-84e2-a1af7ab9f024 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:47.137193 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-385b6934-d212-4f4e-84e2-a1af7ab9f024 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] [instance: 4390cd8e-2484-4205-9678-fb7332d1c78d] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:47.152770 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-385b6934-d212-4f4e-84e2-a1af7ab9f024 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:47.153234 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-385b6934-d212-4f4e-84e2-a1af7ab9f024 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:47.153678 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-385b6934-d212-4f4e-84e2-a1af7ab9f024 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:47.156801 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-385b6934-d212-4f4e-84e2-a1af7ab9f024 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:47.157634 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-385b6934-d212-4f4e-84e2-a1af7ab9f024 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:47.158230 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-385b6934-d212-4f4e-84e2-a1af7ab9f024 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:47.239648 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-385b6934-d212-4f4e-84e2-a1af7ab9f024 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:47.242037 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-385b6934-d212-4f4e-84e2-a1af7ab9f024 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:47.242530 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-385b6934-d212-4f4e-84e2-a1af7ab9f024 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:47.243001 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.objects.instance [None req-385b6934-d212-4f4e-84e2-a1af7ab9f024 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lazy-loading 'fault' on Instance uuid 4390cd8e-2484-4205-9678-fb7332d1c78d {{(pid=129410) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:53:47.320776 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-a9b607a0-87f4-4b64-8df3-7e4e74a38edd tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:47.322650 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-a9b607a0-87f4-4b64-8df3-7e4e74a38edd tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: f747d5da-322c-4afb-bac6-c614b85656f9] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:47.329345 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a9b607a0-87f4-4b64-8df3-7e4e74a38edd tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:47.334482 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a9b607a0-87f4-4b64-8df3-7e4e74a38edd tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:47.335211 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a9b607a0-87f4-4b64-8df3-7e4e74a38edd tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:47.336109 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a9b607a0-87f4-4b64-8df3-7e4e74a38edd tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:47.338220 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a9b607a0-87f4-4b64-8df3-7e4e74a38edd tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:47.338918 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a9b607a0-87f4-4b64-8df3-7e4e74a38edd tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:47.459598 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-385b6934-d212-4f4e-84e2-a1af7ab9f024 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f082ed04bc143679029c204e8a97160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c7c8eeb1b4065b25fe28eba30d0eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:47.482491 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-385b6934-d212-4f4e-84e2-a1af7ab9f024 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] 10.222.0.50 "GET /compute/v2.1/servers/4390cd8e-2484-4205-9678-fb7332d1c78d" status: 200 len: 1308 microversion: 2.1 time: 0.352719 Aug 10 17:53:47.483302 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 590/1181] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:47 2022] GET /compute/v2.1/servers/4390cd8e-2484-4205-9678-fb7332d1c78d => generated 1308 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:53:47.526565 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-2fe58453-ac46-4734-86cb-2208c61a79e3 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:47.527109 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-2fe58453-ac46-4734-86cb-2208c61a79e3 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] [instance: 12eda82b-051e-446c-b78b-6c9c9f6f78d0] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:47.544593 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2fe58453-ac46-4734-86cb-2208c61a79e3 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:47.545298 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2fe58453-ac46-4734-86cb-2208c61a79e3 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:47.545954 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2fe58453-ac46-4734-86cb-2208c61a79e3 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:47.551205 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2fe58453-ac46-4734-86cb-2208c61a79e3 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:47.552011 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2fe58453-ac46-4734-86cb-2208c61a79e3 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:47.552701 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2fe58453-ac46-4734-86cb-2208c61a79e3 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:47.567971 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-a9b607a0-87f4-4b64-8df3-7e4e74a38edd tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:47.576962 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-a9b607a0-87f4-4b64-8df3-7e4e74a38edd tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/f747d5da-322c-4afb-bac6-c614b85656f9" status: 200 len: 1431 microversion: 2.1 time: 0.259994 Aug 10 17:53:47.585372 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 592/1182] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:47 2022] GET /compute/v2.1/servers/f747d5da-322c-4afb-bac6-c614b85656f9 => generated 1431 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:53:47.611175 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-2fe58453-ac46-4734-86cb-2208c61a79e3 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] HTTP exception thrown: Instance 12eda82b-051e-446c-b78b-6c9c9f6f78d0 could not be found. Aug 10 17:53:47.624885 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-2fe58453-ac46-4734-86cb-2208c61a79e3 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Request method failure captured: Aug 10 17:53:47.624885 n-d-852296-2 devstack@n-api.service[129410]: request: GET /compute/v2.1/servers/12eda82b-051e-446c-b78b-6c9c9f6f78d0 HTTP/1.1 Aug 10 17:53:47.624885 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 17:53:47.624885 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 17:53:47.624885 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 17:53:47.624885 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 0 Aug 10 17:53:47.624885 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 17:53:47.624885 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 17:53:47.624885 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 17:53:47.624885 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 17:53:47.624885 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8_ATDuqUJcrY2G1NcAiR2K35RtyTwj8XOyzsgOdlms7E-Yi4db2DnRE4b_OTnceSzuTrQc9t-CzsQdrp68P4PChqFPB5pZHACMpcquu7mMlJ7wKiyjvUXZUUkvJa3m2iS-6_ZEeqkP8HDhDVtYG1XBBkQbjwy3new3R-j0JxuybWBIE Aug 10 17:53:47.624885 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 17:53:47.624885 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 17:53:47.624885 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 17:53:47.624885 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 17:53:47.624885 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 17:53:47.624885 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 17:53:47.624885 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: 6b7c2481a908406fa9c4562513fff665 Aug 10 17:53:47.624885 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-ServersAdminTestJSON-148547485 Aug 10 17:53:47.624885 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 17:53:47.624885 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 17:53:47.624885 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6b7c2481a908406fa9c4562513fff665"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6b7c2481a908406fa9c4562513fff665"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6b7c2481a908406fa9c4562513fff665"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6b7c2481a908406fa9c4562513fff665", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:53:47.624885 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-ServersAdminTestJSON-148547485 Aug 10 17:53:47.624885 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: 6b7c2481a908406fa9c4562513fff665 Aug 10 17:53:47.624885 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-ServersAdminTestJSON-148547485 Aug 10 17:53:47.624885 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-ServersAdminTestJSON-148547485-project Aug 10 17:53:47.624885 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 17:53:47.624885 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 17:53:47.624885 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: 1b2fd6acf18d4218ad143ccee2d0bb5b Aug 10 17:53:47.624885 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-ServersAdminTestJSON-148547485-project Aug 10 17:53:47.624885 n-d-852296-2 devstack@n-api.service[129410]: method: > Aug 10 17:53:47.624885 n-d-852296-2 devstack@n-api.service[129410]: exception: Instance 12eda82b-051e-446c-b78b-6c9c9f6f78d0 could not be found. Aug 10 17:53:47.624885 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'id': '12eda82b-051e-446c-b78b-6c9c9f6f78d0'} Aug 10 17:53:47.624885 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:53:47.624885 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:53:47.624885 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 17:53:47.624885 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 17:53:47.624885 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 17:53:47.624885 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 17:53:47.624885 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 17:53:47.624885 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 17:53:47.624885 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 17:53:47.624885 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 17:53:47.624885 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12eda82b-051e-446c-b78b-6c9c9f6f78d0 could not be found. Aug 10 17:53:47.624885 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:53:47.624885 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:53:47.624885 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:53:47.624885 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:53:47.624885 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:53:47.624885 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:53:47.624885 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:53:47.624885 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:53:47.624885 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:53:47.624885 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:53:47.624885 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 17:53:47.624885 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 17:53:47.624885 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 17:53:47.624885 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 17:53:47.624885 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 17:53:47.624885 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:53:47.624885 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12eda82b-051e-446c-b78b-6c9c9f6f78d0 could not be found. Aug 10 17:53:47.624885 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:53:47.624885 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:53:47.624885 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:53:47.629924 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:53:47.629924 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:53:47.629924 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:53:47.629924 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:53:47.629924 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:53:47.629924 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12eda82b-051e-446c-b78b-6c9c9f6f78d0 could not be found. Aug 10 17:53:47.629924 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:53:47.634739 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-2fe58453-ac46-4734-86cb-2208c61a79e3 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Returning 404 to user: Instance 12eda82b-051e-446c-b78b-6c9c9f6f78d0 could not be found. {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:53:47.637389 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-2fe58453-ac46-4734-86cb-2208c61a79e3 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] 10.222.0.50 "GET /compute/v2.1/servers/12eda82b-051e-446c-b78b-6c9c9f6f78d0" status: 404 len: 111 microversion: 2.1 time: 0.114177 Aug 10 17:53:47.637990 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 591/1183] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:47 2022] GET /compute/v2.1/servers/12eda82b-051e-446c-b78b-6c9c9f6f78d0 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:53:47.652015 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-487075e7-f09e-42fc-92b5-852ab1de636e tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:47.653632 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-487075e7-f09e-42fc-92b5-852ab1de636e tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] [instance: 4db20dd7-9c34-41ea-a53f-e61c197ca66c] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:47.673492 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-487075e7-f09e-42fc-92b5-852ab1de636e tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:47.676180 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-487075e7-f09e-42fc-92b5-852ab1de636e tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:47.679947 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-487075e7-f09e-42fc-92b5-852ab1de636e tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:47.683896 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-487075e7-f09e-42fc-92b5-852ab1de636e tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:47.687180 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-487075e7-f09e-42fc-92b5-852ab1de636e tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:47.687849 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-487075e7-f09e-42fc-92b5-852ab1de636e tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:47.775026 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-487075e7-f09e-42fc-92b5-852ab1de636e tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] [instance: 4db20dd7-9c34-41ea-a53f-e61c197ca66c] Going to try to terminate instance {{(pid=129409) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 17:53:47.823664 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [req-f250efd0-2c1d-4e99-98bf-143432a22484 req-68dfeb48-d2aa-448c-8677-31c78a7ee181 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4390cd8e-2484-4205-9678-fb7332d1c78d", "name": "network-vif-deleted", "tag": "5248f076-be99-4a79-a578-5fcdf9112aab"}]} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:53:47.855236 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-f250efd0-2c1d-4e99-98bf-143432a22484 req-68dfeb48-d2aa-448c-8677-31c78a7ee181 service nova] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:47.861037 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-f250efd0-2c1d-4e99-98bf-143432a22484 req-68dfeb48-d2aa-448c-8677-31c78a7ee181 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:47.861513 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-f250efd0-2c1d-4e99-98bf-143432a22484 req-68dfeb48-d2aa-448c-8677-31c78a7ee181 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:47.902124 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.compute.server_external_events [req-f250efd0-2c1d-4e99-98bf-143432a22484 req-68dfeb48-d2aa-448c-8677-31c78a7ee181 service nova] Creating event network-vif-deleted:5248f076-be99-4a79-a578-5fcdf9112aab for instance 4390cd8e-2484-4205-9678-fb7332d1c78d on n-h1-852296-2 Aug 10 17:53:47.916541 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [req-f250efd0-2c1d-4e99-98bf-143432a22484 req-68dfeb48-d2aa-448c-8677-31c78a7ee181 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099653 Aug 10 17:53:47.920664 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 592/1184] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 10 17:53:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:53:48.303786 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-487075e7-f09e-42fc-92b5-852ab1de636e tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] 10.222.0.50 "DELETE /compute/v2.1/servers/4db20dd7-9c34-41ea-a53f-e61c197ca66c" status: 204 len: 0 microversion: 2.1 time: 0.661796 Aug 10 17:53:48.314080 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 593/1185] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 10 17:53:47 2022] DELETE /compute/v2.1/servers/4db20dd7-9c34-41ea-a53f-e61c197ca66c => generated 0 bytes in 665 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 17:53:48.316307 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-a22408ba-fd69-45e0-9b04-aabf40e27c2b tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:48.317477 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-a22408ba-fd69-45e0-9b04-aabf40e27c2b tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] [instance: 4db20dd7-9c34-41ea-a53f-e61c197ca66c] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:48.334173 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a22408ba-fd69-45e0-9b04-aabf40e27c2b tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:48.334940 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a22408ba-fd69-45e0-9b04-aabf40e27c2b tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:48.335379 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a22408ba-fd69-45e0-9b04-aabf40e27c2b tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:48.336089 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a22408ba-fd69-45e0-9b04-aabf40e27c2b tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:48.336586 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a22408ba-fd69-45e0-9b04-aabf40e27c2b tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:48.337065 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a22408ba-fd69-45e0-9b04-aabf40e27c2b tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:48.507441 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-fe0c7ae1-27da-4da5-84cb-7cc6c2c706e8 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:48.508311 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-fe0c7ae1-27da-4da5-84cb-7cc6c2c706e8 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] [instance: 4390cd8e-2484-4205-9678-fb7332d1c78d] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:48.519725 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-fe0c7ae1-27da-4da5-84cb-7cc6c2c706e8 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:48.521547 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-fe0c7ae1-27da-4da5-84cb-7cc6c2c706e8 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:48.522754 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-fe0c7ae1-27da-4da5-84cb-7cc6c2c706e8 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:48.526166 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-fe0c7ae1-27da-4da5-84cb-7cc6c2c706e8 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:48.526736 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-fe0c7ae1-27da-4da5-84cb-7cc6c2c706e8 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:48.527285 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-fe0c7ae1-27da-4da5-84cb-7cc6c2c706e8 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:48.567562 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-fe0c7ae1-27da-4da5-84cb-7cc6c2c706e8 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] HTTP exception thrown: Instance 4390cd8e-2484-4205-9678-fb7332d1c78d could not be found. Aug 10 17:53:48.568298 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-a22408ba-fd69-45e0-9b04-aabf40e27c2b tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2fd6acf18d4218ad143ccee2d0bb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7c2481a908406fa9c4562513fff665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:48.571440 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-fe0c7ae1-27da-4da5-84cb-7cc6c2c706e8 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Request method failure captured: Aug 10 17:53:48.571440 n-d-852296-2 devstack@n-api.service[129409]: request: GET /compute/v2.1/servers/4390cd8e-2484-4205-9678-fb7332d1c78d HTTP/1.1 Aug 10 17:53:48.571440 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 17:53:48.571440 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 17:53:48.571440 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 17:53:48.571440 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 0 Aug 10 17:53:48.571440 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 17:53:48.571440 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 17:53:48.571440 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 17:53:48.571440 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 17:53:48.571440 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8_Bz-ncDsBWNKyZ4_jYLLfu0M2gBltm_395AUJGbfnIKvGU_xH87cu4Gfq6_Q7pRNSEaW0QAoVtPYey2WWKK3hahsMb6loEhrCHbv3ZNEa4kfOI9pcyADpkoM1d6fDFkq3ogr023FiuFWHWsa6SVV9MSQF_GHnjT0KxVS46wHcnHNUc Aug 10 17:53:48.571440 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 17:53:48.571440 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 17:53:48.571440 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 17:53:48.571440 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 17:53:48.571440 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 17:53:48.571440 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 17:53:48.571440 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: 8e1c7c8eeb1b4065b25fe28eba30d0eb Aug 10 17:53:48.571440 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-LiveMigrationNegativeTest-1001885511 Aug 10 17:53:48.571440 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 17:53:48.571440 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 17:53:48.571440 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8e1c7c8eeb1b4065b25fe28eba30d0eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8e1c7c8eeb1b4065b25fe28eba30d0eb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8e1c7c8eeb1b4065b25fe28eba30d0eb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8e1c7c8eeb1b4065b25fe28eba30d0eb", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:53:48.571440 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-LiveMigrationNegativeTest-1001885511 Aug 10 17:53:48.571440 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: 8e1c7c8eeb1b4065b25fe28eba30d0eb Aug 10 17:53:48.571440 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1001885511 Aug 10 17:53:48.571440 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-LiveMigrationNegativeTest-1001885511-project Aug 10 17:53:48.571440 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 17:53:48.571440 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 17:53:48.571440 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: 5f082ed04bc143679029c204e8a97160 Aug 10 17:53:48.571440 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-LiveMigrationNegativeTest-1001885511-project Aug 10 17:53:48.571440 n-d-852296-2 devstack@n-api.service[129409]: method: > Aug 10 17:53:48.571440 n-d-852296-2 devstack@n-api.service[129409]: exception: Instance 4390cd8e-2484-4205-9678-fb7332d1c78d could not be found. Aug 10 17:53:48.571440 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'id': '4390cd8e-2484-4205-9678-fb7332d1c78d'} Aug 10 17:53:48.571440 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:53:48.571440 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:53:48.571440 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 17:53:48.571440 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 17:53:48.571440 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 17:53:48.571440 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 17:53:48.571440 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 17:53:48.571440 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 17:53:48.571440 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 17:53:48.571440 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 17:53:48.571440 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4390cd8e-2484-4205-9678-fb7332d1c78d could not be found. Aug 10 17:53:48.571440 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:53:48.571440 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:53:48.571440 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:53:48.571440 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:53:48.571440 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:53:48.571440 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:53:48.571440 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:53:48.571440 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:53:48.571440 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:53:48.571440 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:53:48.571440 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 17:53:48.571440 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 17:53:48.571440 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 17:53:48.571440 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 17:53:48.571440 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 17:53:48.571440 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:53:48.571440 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4390cd8e-2484-4205-9678-fb7332d1c78d could not be found. Aug 10 17:53:48.571440 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:53:48.571440 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:53:48.571440 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:53:48.577908 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:53:48.577908 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:53:48.577908 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:53:48.577908 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:53:48.577908 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:53:48.577908 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4390cd8e-2484-4205-9678-fb7332d1c78d could not be found. Aug 10 17:53:48.577908 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:53:48.577908 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-fe0c7ae1-27da-4da5-84cb-7cc6c2c706e8 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Returning 404 to user: Instance 4390cd8e-2484-4205-9678-fb7332d1c78d could not be found. {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:53:48.577908 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-fe0c7ae1-27da-4da5-84cb-7cc6c2c706e8 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] 10.222.0.50 "GET /compute/v2.1/servers/4390cd8e-2484-4205-9678-fb7332d1c78d" status: 404 len: 111 microversion: 2.1 time: 0.075503 Aug 10 17:53:48.578794 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 594/1186] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:48 2022] GET /compute/v2.1/servers/4390cd8e-2484-4205-9678-fb7332d1c78d => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 17:53:48.590758 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-a22408ba-fd69-45e0-9b04-aabf40e27c2b tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] 10.222.0.50 "GET /compute/v2.1/servers/4db20dd7-9c34-41ea-a53f-e61c197ca66c" status: 200 len: 1470 microversion: 2.1 time: 0.280263 Aug 10 17:53:48.592367 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 593/1187] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:48 2022] GET /compute/v2.1/servers/4db20dd7-9c34-41ea-a53f-e61c197ca66c => generated 1470 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:53:48.605707 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-d198e9c0-4014-4009-ab26-dc7a760611c5 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:48.609591 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-d198e9c0-4014-4009-ab26-dc7a760611c5 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] [instance: 2c8728f2-55fb-4306-acc5-227ba55ec278] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:48.610163 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-234be5f0-3e26-4084-9666-b6d1db31b7b1 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:48.610782 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-234be5f0-3e26-4084-9666-b6d1db31b7b1 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: f747d5da-322c-4afb-bac6-c614b85656f9] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:48.619553 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-d198e9c0-4014-4009-ab26-dc7a760611c5 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:48.624720 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-d198e9c0-4014-4009-ab26-dc7a760611c5 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:48.624720 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-d198e9c0-4014-4009-ab26-dc7a760611c5 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:48.624720 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-d198e9c0-4014-4009-ab26-dc7a760611c5 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:48.625425 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-234be5f0-3e26-4084-9666-b6d1db31b7b1 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:48.625935 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-234be5f0-3e26-4084-9666-b6d1db31b7b1 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:48.626386 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-234be5f0-3e26-4084-9666-b6d1db31b7b1 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:48.627113 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-234be5f0-3e26-4084-9666-b6d1db31b7b1 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:48.627577 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-234be5f0-3e26-4084-9666-b6d1db31b7b1 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:48.628033 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-234be5f0-3e26-4084-9666-b6d1db31b7b1 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:48.629608 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-d198e9c0-4014-4009-ab26-dc7a760611c5 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:48.630604 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-d198e9c0-4014-4009-ab26-dc7a760611c5 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:48.690753 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-d198e9c0-4014-4009-ab26-dc7a760611c5 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] [instance: 2c8728f2-55fb-4306-acc5-227ba55ec278] Going to try to terminate instance {{(pid=129409) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 17:53:48.802214 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-234be5f0-3e26-4084-9666-b6d1db31b7b1 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:48.814076 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-234be5f0-3e26-4084-9666-b6d1db31b7b1 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/f747d5da-322c-4afb-bac6-c614b85656f9" status: 200 len: 1302 microversion: 2.1 time: 0.207611 Aug 10 17:53:48.829456 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 594/1188] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:48 2022] GET /compute/v2.1/servers/f747d5da-322c-4afb-bac6-c614b85656f9 => generated 1302 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:53:49.109768 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=4 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:53:49.238742 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-d198e9c0-4014-4009-ab26-dc7a760611c5 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] 10.222.0.50 "DELETE /compute/v2.1/servers/2c8728f2-55fb-4306-acc5-227ba55ec278" status: 204 len: 0 microversion: 2.1 time: 0.655606 Aug 10 17:53:49.240915 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 595/1189] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 10 17:53:48 2022] DELETE /compute/v2.1/servers/2c8728f2-55fb-4306-acc5-227ba55ec278 => generated 0 bytes in 657 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 10 17:53:49.262983 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-0103f275-ef48-4e88-9d62-fda6fdc38ed3 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:49.263993 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-0103f275-ef48-4e88-9d62-fda6fdc38ed3 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] [instance: 2c8728f2-55fb-4306-acc5-227ba55ec278] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:49.282929 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-0103f275-ef48-4e88-9d62-fda6fdc38ed3 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:49.285913 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-0103f275-ef48-4e88-9d62-fda6fdc38ed3 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:49.287355 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-0103f275-ef48-4e88-9d62-fda6fdc38ed3 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:49.288978 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-0103f275-ef48-4e88-9d62-fda6fdc38ed3 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:49.315549 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-0103f275-ef48-4e88-9d62-fda6fdc38ed3 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:49.315549 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-0103f275-ef48-4e88-9d62-fda6fdc38ed3 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:49.547879 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-0103f275-ef48-4e88-9d62-fda6fdc38ed3 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f082ed04bc143679029c204e8a97160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c7c8eeb1b4065b25fe28eba30d0eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:49.568982 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-0103f275-ef48-4e88-9d62-fda6fdc38ed3 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] 10.222.0.50 "GET /compute/v2.1/servers/2c8728f2-55fb-4306-acc5-227ba55ec278" status: 200 len: 1474 microversion: 2.1 time: 0.313194 Aug 10 17:53:49.569575 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 595/1190] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:49 2022] GET /compute/v2.1/servers/2c8728f2-55fb-4306-acc5-227ba55ec278 => generated 1474 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:53:49.620183 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-766553a1-02ff-4b3b-bd07-5519451dbe57 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:49.620967 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-766553a1-02ff-4b3b-bd07-5519451dbe57 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] [instance: 4db20dd7-9c34-41ea-a53f-e61c197ca66c] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:49.635123 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-766553a1-02ff-4b3b-bd07-5519451dbe57 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:49.635623 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-766553a1-02ff-4b3b-bd07-5519451dbe57 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:49.637388 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-766553a1-02ff-4b3b-bd07-5519451dbe57 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:49.638654 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-766553a1-02ff-4b3b-bd07-5519451dbe57 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:49.639269 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-766553a1-02ff-4b3b-bd07-5519451dbe57 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:49.639856 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-766553a1-02ff-4b3b-bd07-5519451dbe57 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:49.847161 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-756853ca-fe1d-4509-91ca-fef32ef3ab29 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:49.848179 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-756853ca-fe1d-4509-91ca-fef32ef3ab29 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: f747d5da-322c-4afb-bac6-c614b85656f9] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:49.860345 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-756853ca-fe1d-4509-91ca-fef32ef3ab29 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:49.865534 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-756853ca-fe1d-4509-91ca-fef32ef3ab29 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:49.866249 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-756853ca-fe1d-4509-91ca-fef32ef3ab29 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:49.868659 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-756853ca-fe1d-4509-91ca-fef32ef3ab29 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:49.885196 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-756853ca-fe1d-4509-91ca-fef32ef3ab29 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:49.888207 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-756853ca-fe1d-4509-91ca-fef32ef3ab29 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:49.948909 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-766553a1-02ff-4b3b-bd07-5519451dbe57 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2fd6acf18d4218ad143ccee2d0bb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7c2481a908406fa9c4562513fff665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:49.952312 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-756853ca-fe1d-4509-91ca-fef32ef3ab29 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:49.952312 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-756853ca-fe1d-4509-91ca-fef32ef3ab29 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:49.952312 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-756853ca-fe1d-4509-91ca-fef32ef3ab29 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:49.952814 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.objects.instance [None req-756853ca-fe1d-4509-91ca-fef32ef3ab29 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lazy-loading 'fault' on Instance uuid f747d5da-322c-4afb-bac6-c614b85656f9 {{(pid=129410) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:53:49.958759 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-766553a1-02ff-4b3b-bd07-5519451dbe57 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] 10.222.0.50 "GET /compute/v2.1/servers/4db20dd7-9c34-41ea-a53f-e61c197ca66c" status: 200 len: 1470 microversion: 2.1 time: 0.346055 Aug 10 17:53:49.972776 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 596/1191] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:49 2022] GET /compute/v2.1/servers/4db20dd7-9c34-41ea-a53f-e61c197ca66c => generated 1470 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:53:50.011829 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [req-c4877d00-fc2b-46a3-9540-4a07b85246ac req-7c74c746-a054-41ca-bfeb-93b726c41532 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f747d5da-322c-4afb-bac6-c614b85656f9", "name": "network-vif-deleted", "tag": "fdf7ca0a-1e47-4466-96d3-61b2385956a4"}]} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:53:50.017101 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-756853ca-fe1d-4509-91ca-fef32ef3ab29 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:50.028753 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-756853ca-fe1d-4509-91ca-fef32ef3ab29 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/f747d5da-322c-4afb-bac6-c614b85656f9" status: 200 len: 1307 microversion: 2.1 time: 0.193073 Aug 10 17:53:50.040019 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-c4877d00-fc2b-46a3-9540-4a07b85246ac req-7c74c746-a054-41ca-bfeb-93b726c41532 service nova] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:50.040532 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-c4877d00-fc2b-46a3-9540-4a07b85246ac req-7c74c746-a054-41ca-bfeb-93b726c41532 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:50.044106 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 596/1192] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:49 2022] GET /compute/v2.1/servers/f747d5da-322c-4afb-bac6-c614b85656f9 => generated 1307 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:53:50.046083 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-c4877d00-fc2b-46a3-9540-4a07b85246ac req-7c74c746-a054-41ca-bfeb-93b726c41532 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:50.114628 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.compute.server_external_events [req-c4877d00-fc2b-46a3-9540-4a07b85246ac req-7c74c746-a054-41ca-bfeb-93b726c41532 service nova] Creating event network-vif-deleted:fdf7ca0a-1e47-4466-96d3-61b2385956a4 for instance f747d5da-322c-4afb-bac6-c614b85656f9 on n-h2-852296-2 Aug 10 17:53:50.128381 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [req-c4877d00-fc2b-46a3-9540-4a07b85246ac req-7c74c746-a054-41ca-bfeb-93b726c41532 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136727 Aug 10 17:53:50.129476 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 597/1193] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 10 17:53:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:53:50.593616 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-a2b4bdab-4d3e-4e6f-8298-26fe12c0fdb6 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:50.593616 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-a2b4bdab-4d3e-4e6f-8298-26fe12c0fdb6 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] [instance: 2c8728f2-55fb-4306-acc5-227ba55ec278] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:50.608088 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a2b4bdab-4d3e-4e6f-8298-26fe12c0fdb6 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:50.608892 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a2b4bdab-4d3e-4e6f-8298-26fe12c0fdb6 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:50.609500 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a2b4bdab-4d3e-4e6f-8298-26fe12c0fdb6 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:50.610376 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a2b4bdab-4d3e-4e6f-8298-26fe12c0fdb6 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:50.610999 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a2b4bdab-4d3e-4e6f-8298-26fe12c0fdb6 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:50.611769 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a2b4bdab-4d3e-4e6f-8298-26fe12c0fdb6 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:50.985604 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-064776f1-602a-44b5-b1cb-590b15a04d85 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:50.986588 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-064776f1-602a-44b5-b1cb-590b15a04d85 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] [instance: 4db20dd7-9c34-41ea-a53f-e61c197ca66c] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:51.004847 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-064776f1-602a-44b5-b1cb-590b15a04d85 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:51.007352 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-064776f1-602a-44b5-b1cb-590b15a04d85 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:51.009834 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-064776f1-602a-44b5-b1cb-590b15a04d85 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:51.011046 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-064776f1-602a-44b5-b1cb-590b15a04d85 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:51.013167 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-064776f1-602a-44b5-b1cb-590b15a04d85 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:51.014523 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-064776f1-602a-44b5-b1cb-590b15a04d85 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:51.105914 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-a2b4bdab-4d3e-4e6f-8298-26fe12c0fdb6 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f082ed04bc143679029c204e8a97160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c7c8eeb1b4065b25fe28eba30d0eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:51.122134 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-a2b4bdab-4d3e-4e6f-8298-26fe12c0fdb6 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] 10.222.0.50 "GET /compute/v2.1/servers/2c8728f2-55fb-4306-acc5-227ba55ec278" status: 200 len: 1474 microversion: 2.1 time: 0.532632 Aug 10 17:53:51.124910 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 597/1194] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:50 2022] GET /compute/v2.1/servers/2c8728f2-55fb-4306-acc5-227ba55ec278 => generated 1474 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:53:51.136021 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-c821077a-684f-4387-9319-6bc4fdd2abac tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:51.136903 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-c821077a-684f-4387-9319-6bc4fdd2abac tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: f747d5da-322c-4afb-bac6-c614b85656f9] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:51.153310 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-c821077a-684f-4387-9319-6bc4fdd2abac tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:51.160221 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-c821077a-684f-4387-9319-6bc4fdd2abac tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:51.161019 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-c821077a-684f-4387-9319-6bc4fdd2abac tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:51.162979 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-c821077a-684f-4387-9319-6bc4fdd2abac tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:51.163952 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-c821077a-684f-4387-9319-6bc4fdd2abac tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:51.164503 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-c821077a-684f-4387-9319-6bc4fdd2abac tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:51.235356 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-c821077a-684f-4387-9319-6bc4fdd2abac tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:51.238078 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-c821077a-684f-4387-9319-6bc4fdd2abac tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:51.243347 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-c821077a-684f-4387-9319-6bc4fdd2abac tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:51.245731 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.objects.instance [None req-c821077a-684f-4387-9319-6bc4fdd2abac tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lazy-loading 'fault' on Instance uuid f747d5da-322c-4afb-bac6-c614b85656f9 {{(pid=129410) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:53:51.389158 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-c821077a-684f-4387-9319-6bc4fdd2abac tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:51.398479 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-c821077a-684f-4387-9319-6bc4fdd2abac tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/f747d5da-322c-4afb-bac6-c614b85656f9" status: 200 len: 1307 microversion: 2.1 time: 0.272229 Aug 10 17:53:51.410068 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 598/1195] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:51 2022] GET /compute/v2.1/servers/f747d5da-322c-4afb-bac6-c614b85656f9 => generated 1307 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:53:51.463897 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_cell0:SELECT=2 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:53:51.581727 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-064776f1-602a-44b5-b1cb-590b15a04d85 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2fd6acf18d4218ad143ccee2d0bb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7c2481a908406fa9c4562513fff665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:51.597265 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-064776f1-602a-44b5-b1cb-590b15a04d85 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] 10.222.0.50 "GET /compute/v2.1/servers/4db20dd7-9c34-41ea-a53f-e61c197ca66c" status: 200 len: 1470 microversion: 2.1 time: 0.616273 Aug 10 17:53:51.614084 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 598/1196] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:50 2022] GET /compute/v2.1/servers/4db20dd7-9c34-41ea-a53f-e61c197ca66c => generated 1470 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:53:51.993060 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-e3808ab4-15b5-4622-a047-8b6e10282e47 tempest-ImagesMetadataTestJSON-317502035 tempest-ImagesMetadataTestJSON-317502035-project] Calling method '.version_select at 0x7fb345ff2e50>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:52.067599 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-e3808ab4-15b5-4622-a047-8b6e10282e47 tempest-ImagesMetadataTestJSON-317502035 tempest-ImagesMetadataTestJSON-317502035-project] 10.222.0.50 "GET /compute/v2.1/images/6ad0a7b7-7276-4c8b-bc0c-3a4c43436327" status: 200 len: 636 microversion: 2.1 time: 0.080547 Aug 10 17:53:52.075226 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 599/1197] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:53:51 2022] GET /compute/v2.1/images/6ad0a7b7-7276-4c8b-bc0c-3a4c43436327 => generated 636 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:53:52.083972 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-5b599629-714e-4f64-a933-cb30cdf84ee8 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-644524912", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452"}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:53:52.084539 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-eb835f71-b162-45fe-b1e3-1e26669cb663 tempest-ImagesMetadataTestJSON-317502035 tempest-ImagesMetadataTestJSON-317502035-project] Action: 'update_all', calling method: .version_select at 0x7fb346178160>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:53:52.162243 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-eb835f71-b162-45fe-b1e3-1e26669cb663 tempest-ImagesMetadataTestJSON-317502035 tempest-ImagesMetadataTestJSON-317502035-project] Getting quotas for project efb9e6629f9f42fe96f757214f538f5a. Resources: dict_keys(['metadata_items']) {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:53:52.180618 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-eb835f71-b162-45fe-b1e3-1e26669cb663 tempest-ImagesMetadataTestJSON-317502035 tempest-ImagesMetadataTestJSON-317502035-project] Getting quotas for user 0c0dc124415f42799e788b4489a23afa and project efb9e6629f9f42fe96f757214f538f5a. Resources: dict_keys(['metadata_items']) {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:53:52.204362 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.network.neutron [None req-5b599629-714e-4f64-a933-cb30cdf84ee8 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] validate_networks() for None {{(pid=129410) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 17:53:52.691147 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.virt.hardware [None req-5b599629-714e-4f64-a933-cb30cdf84ee8 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Flavor limits 0:0:0 {{(pid=129410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 17:53:52.691801 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.virt.hardware [None req-5b599629-714e-4f64-a933-cb30cdf84ee8 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Image limits 0:0:0 {{(pid=129410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 17:53:52.692470 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.virt.hardware [None req-5b599629-714e-4f64-a933-cb30cdf84ee8 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Flavor pref 0:0:0 {{(pid=129410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 17:53:52.693058 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.virt.hardware [None req-5b599629-714e-4f64-a933-cb30cdf84ee8 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Image pref 0:0:0 {{(pid=129410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 17:53:52.693467 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.virt.hardware [None req-5b599629-714e-4f64-a933-cb30cdf84ee8 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 17:53:52.713429 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-5b599629-714e-4f64-a933-cb30cdf84ee8 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:52.713924 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-5b599629-714e-4f64-a933-cb30cdf84ee8 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:52.714359 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-5b599629-714e-4f64-a933-cb30cdf84ee8 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:52.715135 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-5b599629-714e-4f64-a933-cb30cdf84ee8 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:52.715788 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-5b599629-714e-4f64-a933-cb30cdf84ee8 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:52.716413 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-5b599629-714e-4f64-a933-cb30cdf84ee8 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:52.764499 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.quota [None req-5b599629-714e-4f64-a933-cb30cdf84ee8 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Getting quotas for project 8014941eeb974f0bb3a4d26a65346f6c. Resources: {'instances', 'ram', 'cores'} {{(pid=129410) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:53:52.773587 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-eb835f71-b162-45fe-b1e3-1e26669cb663 tempest-ImagesMetadataTestJSON-317502035 tempest-ImagesMetadataTestJSON-317502035-project] 10.222.0.50 "PUT /compute/v2.1/images/6ad0a7b7-7276-4c8b-bc0c-3a4c43436327/metadata" status: 200 len: 61 microversion: 2.1 time: 0.693172 Aug 10 17:53:52.775456 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 600/1198] 10.222.0.50 () {60 vars in 1280 bytes} [Wed Aug 10 17:53:52 2022] PUT /compute/v2.1/images/6ad0a7b7-7276-4c8b-bc0c-3a4c43436327/metadata => generated 61 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 17:53:52.776348 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.quota [None req-5b599629-714e-4f64-a933-cb30cdf84ee8 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Getting quotas for user 9dac2a95483d4be99f06a2aeeb379339 and project 8014941eeb974f0bb3a4d26a65346f6c. Resources: {'instances', 'ram', 'cores'} {{(pid=129410) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:53:52.783842 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-0ad5e258-d9f2-4670-b3ed-4afba1d31366 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:52.785723 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-0ad5e258-d9f2-4670-b3ed-4afba1d31366 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] [instance: 2c8728f2-55fb-4306-acc5-227ba55ec278] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:52.798349 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-0ad5e258-d9f2-4670-b3ed-4afba1d31366 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:52.798830 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-0ad5e258-d9f2-4670-b3ed-4afba1d31366 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:52.799572 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-0ad5e258-d9f2-4670-b3ed-4afba1d31366 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:52.800980 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-0ad5e258-d9f2-4670-b3ed-4afba1d31366 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:52.802048 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-0ad5e258-d9f2-4670-b3ed-4afba1d31366 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:52.802738 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-0ad5e258-d9f2-4670-b3ed-4afba1d31366 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:52.807124 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-5b599629-714e-4f64-a933-cb30cdf84ee8 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Going to run 1 instances... {{(pid=129410) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 17:53:52.811124 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-5b599629-714e-4f64-a933-cb30cdf84ee8 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] [instance: 2a0c8868-b8d4-494c-b716-d637d1320340] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a735ff26-463a-4ffe-a981-ab9d9baa494f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129410) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 17:53:52.987313 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-5b599629-714e-4f64-a933-cb30cdf84ee8 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.494362 Aug 10 17:53:52.990199 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 599/1199] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 17:53:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1497 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 17:53:53.002917 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-e7bab109-7b8b-4cf0-bfa3-fca4b9542280 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:53.004734 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-e7bab109-7b8b-4cf0-bfa3-fca4b9542280 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: f747d5da-322c-4afb-bac6-c614b85656f9] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:53.021773 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e7bab109-7b8b-4cf0-bfa3-fca4b9542280 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:53.022809 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e7bab109-7b8b-4cf0-bfa3-fca4b9542280 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:53.028159 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e7bab109-7b8b-4cf0-bfa3-fca4b9542280 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:53.029244 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e7bab109-7b8b-4cf0-bfa3-fca4b9542280 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:53.035097 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e7bab109-7b8b-4cf0-bfa3-fca4b9542280 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:53.035097 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e7bab109-7b8b-4cf0-bfa3-fca4b9542280 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:53.094044 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-e7bab109-7b8b-4cf0-bfa3-fca4b9542280 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] HTTP exception thrown: Instance f747d5da-322c-4afb-bac6-c614b85656f9 could not be found. Aug 10 17:53:53.097112 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-e7bab109-7b8b-4cf0-bfa3-fca4b9542280 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Request method failure captured: Aug 10 17:53:53.097112 n-d-852296-2 devstack@n-api.service[129410]: request: GET /compute/v2.1/servers/f747d5da-322c-4afb-bac6-c614b85656f9 HTTP/1.1 Aug 10 17:53:53.097112 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 17:53:53.097112 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 17:53:53.097112 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 17:53:53.097112 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 0 Aug 10 17:53:53.097112 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 17:53:53.097112 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 17:53:53.097112 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 17:53:53.097112 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 17:53:53.097112 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8-_vb7x9x9F8-sP6h5pKdcrrsXpPJ2RlEbuCXnu2ZTWdSKtHarFJLe7Hjf1WLDt_yPDFFQT5gzj11kqkxwhqMHpazNhmqyhgrlC3SoXOue_P66sN7aOFIkgqmKczGGaSXM3e-yfy_FvawvLBNZry68s7Q1kz50eCpVoZBo2bvZ2yTNc Aug 10 17:53:53.097112 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 17:53:53.097112 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 17:53:53.097112 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 17:53:53.097112 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 17:53:53.097112 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 17:53:53.097112 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 17:53:53.097112 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: 0638146d08704b2983761619745290b3 Aug 10 17:53:53.097112 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-ServersOnMultiNodesTest-946016060 Aug 10 17:53:53.097112 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 17:53:53.097112 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 17:53:53.097112 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0638146d08704b2983761619745290b3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/0638146d08704b2983761619745290b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0638146d08704b2983761619745290b3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_0638146d08704b2983761619745290b3", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:53:53.097112 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-ServersOnMultiNodesTest-946016060 Aug 10 17:53:53.097112 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: 0638146d08704b2983761619745290b3 Aug 10 17:53:53.097112 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-946016060 Aug 10 17:53:53.097112 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-ServersOnMultiNodesTest-946016060-project Aug 10 17:53:53.097112 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 17:53:53.097112 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 17:53:53.097112 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: f76b870a54454956b3926c34f9f27442 Aug 10 17:53:53.097112 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-ServersOnMultiNodesTest-946016060-project Aug 10 17:53:53.097112 n-d-852296-2 devstack@n-api.service[129410]: method: > Aug 10 17:53:53.097112 n-d-852296-2 devstack@n-api.service[129410]: exception: Instance f747d5da-322c-4afb-bac6-c614b85656f9 could not be found. Aug 10 17:53:53.097112 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'id': 'f747d5da-322c-4afb-bac6-c614b85656f9'} Aug 10 17:53:53.097112 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:53:53.097112 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:53:53.097112 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 17:53:53.097112 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 17:53:53.097112 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 17:53:53.097112 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 17:53:53.097112 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 17:53:53.097112 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 17:53:53.097112 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 17:53:53.097112 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 17:53:53.097112 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f747d5da-322c-4afb-bac6-c614b85656f9 could not be found. Aug 10 17:53:53.097112 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:53:53.097112 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:53:53.097112 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:53:53.097112 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:53:53.097112 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:53:53.097112 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:53:53.097112 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:53:53.097112 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:53:53.097112 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:53:53.097112 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:53:53.097112 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 17:53:53.097112 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 17:53:53.097112 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 17:53:53.097112 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 17:53:53.097112 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 17:53:53.097112 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:53:53.097112 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f747d5da-322c-4afb-bac6-c614b85656f9 could not be found. Aug 10 17:53:53.097112 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:53:53.097112 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:53:53.097112 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:53:53.108646 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:53:53.108646 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:53:53.108646 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:53:53.108646 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:53:53.108646 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:53:53.108646 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f747d5da-322c-4afb-bac6-c614b85656f9 could not be found. Aug 10 17:53:53.108646 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:53:53.108646 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-e7bab109-7b8b-4cf0-bfa3-fca4b9542280 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Returning 404 to user: Instance f747d5da-322c-4afb-bac6-c614b85656f9 could not be found. {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:53:53.108646 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-e7bab109-7b8b-4cf0-bfa3-fca4b9542280 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/f747d5da-322c-4afb-bac6-c614b85656f9" status: 404 len: 111 microversion: 2.1 time: 0.107561 Aug 10 17:53:53.108646 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 600/1200] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:52 2022] GET /compute/v2.1/servers/f747d5da-322c-4afb-bac6-c614b85656f9 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:53:53.143600 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-0ad5e258-d9f2-4670-b3ed-4afba1d31366 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f082ed04bc143679029c204e8a97160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c7c8eeb1b4065b25fe28eba30d0eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:53.148597 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-7baf30d6-5a9d-46f0-9928-a23562a2d4c7 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:53.149627 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-7baf30d6-5a9d-46f0-9928-a23562a2d4c7 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] [instance: 4db20dd7-9c34-41ea-a53f-e61c197ca66c] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:53.158417 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-0ad5e258-d9f2-4670-b3ed-4afba1d31366 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] 10.222.0.50 "GET /compute/v2.1/servers/2c8728f2-55fb-4306-acc5-227ba55ec278" status: 200 len: 1474 microversion: 2.1 time: 0.380261 Aug 10 17:53:53.159621 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 601/1201] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:52 2022] GET /compute/v2.1/servers/2c8728f2-55fb-4306-acc5-227ba55ec278 => generated 1474 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:53:53.160022 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-7baf30d6-5a9d-46f0-9928-a23562a2d4c7 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:53.162064 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-7baf30d6-5a9d-46f0-9928-a23562a2d4c7 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:53.163309 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-7baf30d6-5a9d-46f0-9928-a23562a2d4c7 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:53.164387 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-7baf30d6-5a9d-46f0-9928-a23562a2d4c7 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:53.165226 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-7baf30d6-5a9d-46f0-9928-a23562a2d4c7 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:53.166653 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-7baf30d6-5a9d-46f0-9928-a23562a2d4c7 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:53.174567 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-22a966a9-9344-4482-a689-9cd207c43a28 tempest-ImagesMetadataTestJSON-317502035 tempest-ImagesMetadataTestJSON-317502035-project] Calling method '.version_select at 0x7fb346178af0>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:53.874737 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-22a966a9-9344-4482-a689-9cd207c43a28 tempest-ImagesMetadataTestJSON-317502035 tempest-ImagesMetadataTestJSON-317502035-project] 10.222.0.50 "DELETE /compute/v2.1/images/6ad0a7b7-7276-4c8b-bc0c-3a4c43436327/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.710124 Aug 10 17:53:53.877514 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 602/1202] 10.222.0.50 () {58 vars in 1296 bytes} [Wed Aug 10 17:53:53 2022] DELETE /compute/v2.1/images/6ad0a7b7-7276-4c8b-bc0c-3a4c43436327/metadata/os_version => generated 0 bytes in 717 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 17:53:53.917833 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-9c43a7a6-6382-46ac-ac14-6c13e96e9d02 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:53.921212 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-9c43a7a6-6382-46ac-ac14-6c13e96e9d02 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] [instance: 2a0c8868-b8d4-494c-b716-d637d1320340] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:53.934058 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-7baf30d6-5a9d-46f0-9928-a23562a2d4c7 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2fd6acf18d4218ad143ccee2d0bb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7c2481a908406fa9c4562513fff665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:53.971596 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-7baf30d6-5a9d-46f0-9928-a23562a2d4c7 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] 10.222.0.50 "GET /compute/v2.1/servers/4db20dd7-9c34-41ea-a53f-e61c197ca66c" status: 200 len: 1470 microversion: 2.1 time: 0.831170 Aug 10 17:53:53.977338 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 601/1203] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:53 2022] GET /compute/v2.1/servers/4db20dd7-9c34-41ea-a53f-e61c197ca66c => generated 1470 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:53:53.990548 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-321c45c1-2f02-4e42-a722-1d53e7952de8 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:54.003998 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-321c45c1-2f02-4e42-a722-1d53e7952de8 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: 0d821054-dce7-4015-8eaa-d8c56e7c3cd3] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:54.030839 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-321c45c1-2f02-4e42-a722-1d53e7952de8 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:54.032830 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-321c45c1-2f02-4e42-a722-1d53e7952de8 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:54.037327 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-321c45c1-2f02-4e42-a722-1d53e7952de8 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:54.037327 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-321c45c1-2f02-4e42-a722-1d53e7952de8 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:54.038985 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-321c45c1-2f02-4e42-a722-1d53e7952de8 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:54.039712 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-321c45c1-2f02-4e42-a722-1d53e7952de8 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:54.087881 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-321c45c1-2f02-4e42-a722-1d53e7952de8 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: 0d821054-dce7-4015-8eaa-d8c56e7c3cd3] Going to try to terminate instance {{(pid=129410) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 17:53:54.096881 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-9c43a7a6-6382-46ac-ac14-6c13e96e9d02 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dac2a95483d4be99f06a2aeeb379339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8014941eeb974f0bb3a4d26a65346f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:54.108339 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-9c43a7a6-6382-46ac-ac14-6c13e96e9d02 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] 10.222.0.50 "GET /compute/v2.1/servers/2a0c8868-b8d4-494c-b716-d637d1320340" status: 200 len: 1222 microversion: 2.1 time: 0.228958 Aug 10 17:53:54.110188 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 603/1204] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:53 2022] GET /compute/v2.1/servers/2a0c8868-b8d4-494c-b716-d637d1320340 => generated 1222 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:53:54.117721 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [req-f0519a48-edbb-413d-b341-33763efc0679 req-ac61f4b0-ed8f-4935-bcbe-143f366c4306 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4db20dd7-9c34-41ea-a53f-e61c197ca66c", "name": "network-vif-deleted", "tag": "b5482a58-669d-4814-9cde-e98d0998e7fe"}]} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:53:54.135992 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-f0519a48-edbb-413d-b341-33763efc0679 req-ac61f4b0-ed8f-4935-bcbe-143f366c4306 service nova] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:54.136983 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-f0519a48-edbb-413d-b341-33763efc0679 req-ac61f4b0-ed8f-4935-bcbe-143f366c4306 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:54.138174 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-f0519a48-edbb-413d-b341-33763efc0679 req-ac61f4b0-ed8f-4935-bcbe-143f366c4306 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:54.153644 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.compute.server_external_events [req-f0519a48-edbb-413d-b341-33763efc0679 req-ac61f4b0-ed8f-4935-bcbe-143f366c4306 service nova] Creating event network-vif-deleted:b5482a58-669d-4814-9cde-e98d0998e7fe for instance 4db20dd7-9c34-41ea-a53f-e61c197ca66c on n-h2-852296-2 Aug 10 17:53:54.159929 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [req-f0519a48-edbb-413d-b341-33763efc0679 req-ac61f4b0-ed8f-4935-bcbe-143f366c4306 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047192 Aug 10 17:53:54.160891 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 604/1205] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 10 17:53:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:53:54.206444 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-d1f8f07e-ed29-42cc-9d54-04d0b44ed6b2 tempest-ImagesMetadataTestJSON-317502035 tempest-ImagesMetadataTestJSON-317502035-project] Calling method '.version_select at 0x7fb346178160>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:54.293827 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-d1f8f07e-ed29-42cc-9d54-04d0b44ed6b2 tempest-ImagesMetadataTestJSON-317502035 tempest-ImagesMetadataTestJSON-317502035-project] 10.222.0.50 "GET /compute/v2.1/images/6ad0a7b7-7276-4c8b-bc0c-3a4c43436327/metadata" status: 200 len: 37 microversion: 2.1 time: 0.131069 Aug 10 17:53:54.294412 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 605/1206] 10.222.0.50 () {58 vars in 1260 bytes} [Wed Aug 10 17:53:54 2022] GET /compute/v2.1/images/6ad0a7b7-7276-4c8b-bc0c-3a4c43436327/metadata => generated 37 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 17:53:54.301147 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-1c97c69b-283a-48ae-b804-f9277d711a87 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:54.302158 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-1c97c69b-283a-48ae-b804-f9277d711a87 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] [instance: 2c8728f2-55fb-4306-acc5-227ba55ec278] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:54.311493 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-1c97c69b-283a-48ae-b804-f9277d711a87 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:54.312310 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-1c97c69b-283a-48ae-b804-f9277d711a87 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:54.312921 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-1c97c69b-283a-48ae-b804-f9277d711a87 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:54.314018 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-1c97c69b-283a-48ae-b804-f9277d711a87 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:54.314659 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-1c97c69b-283a-48ae-b804-f9277d711a87 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:54.315433 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-1c97c69b-283a-48ae-b804-f9277d711a87 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:54.715784 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-321c45c1-2f02-4e42-a722-1d53e7952de8 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "DELETE /compute/v2.1/servers/0d821054-dce7-4015-8eaa-d8c56e7c3cd3" status: 204 len: 0 microversion: 2.1 time: 0.736890 Aug 10 17:53:54.717163 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 602/1207] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 10 17:53:53 2022] DELETE /compute/v2.1/servers/0d821054-dce7-4015-8eaa-d8c56e7c3cd3 => generated 0 bytes in 739 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 17:53:54.727780 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-90cfd88a-51ef-49f4-8ce6-ba6c43088caa tempest-ImagesMetadataTestJSON-317502035 tempest-ImagesMetadataTestJSON-317502035-project] Action: 'update_all', calling method: .version_select at 0x7fb345beb9d0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:53:54.826130 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-1c97c69b-283a-48ae-b804-f9277d711a87 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f082ed04bc143679029c204e8a97160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c7c8eeb1b4065b25fe28eba30d0eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:54.842581 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-1c97c69b-283a-48ae-b804-f9277d711a87 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] 10.222.0.50 "GET /compute/v2.1/servers/2c8728f2-55fb-4306-acc5-227ba55ec278" status: 200 len: 1432 microversion: 2.1 time: 0.546426 Aug 10 17:53:54.847011 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 606/1208] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:54 2022] GET /compute/v2.1/servers/2c8728f2-55fb-4306-acc5-227ba55ec278 => generated 1432 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:53:54.889440 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-90c69e9b-2fac-4578-be28-dedcf0d7d3a2 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:54.896838 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-90c69e9b-2fac-4578-be28-dedcf0d7d3a2 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: 83268d7f-5375-4b01-9b5c-519be7daf0a4] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:54.909491 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.quota [None req-90cfd88a-51ef-49f4-8ce6-ba6c43088caa tempest-ImagesMetadataTestJSON-317502035 tempest-ImagesMetadataTestJSON-317502035-project] Getting quotas for project efb9e6629f9f42fe96f757214f538f5a. Resources: dict_keys(['metadata_items']) {{(pid=129410) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:53:54.914851 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-90c69e9b-2fac-4578-be28-dedcf0d7d3a2 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:54.920733 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.quota [None req-90cfd88a-51ef-49f4-8ce6-ba6c43088caa tempest-ImagesMetadataTestJSON-317502035 tempest-ImagesMetadataTestJSON-317502035-project] Getting quotas for user 0c0dc124415f42799e788b4489a23afa and project efb9e6629f9f42fe96f757214f538f5a. Resources: dict_keys(['metadata_items']) {{(pid=129410) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:53:54.921093 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-90c69e9b-2fac-4578-be28-dedcf0d7d3a2 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:54.922190 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-90c69e9b-2fac-4578-be28-dedcf0d7d3a2 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:54.922943 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-90c69e9b-2fac-4578-be28-dedcf0d7d3a2 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:54.923402 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-90c69e9b-2fac-4578-be28-dedcf0d7d3a2 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:54.923830 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-90c69e9b-2fac-4578-be28-dedcf0d7d3a2 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:55.020366 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-90c69e9b-2fac-4578-be28-dedcf0d7d3a2 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: 83268d7f-5375-4b01-9b5c-519be7daf0a4] Going to try to terminate instance {{(pid=129409) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 17:53:55.596097 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-90cfd88a-51ef-49f4-8ce6-ba6c43088caa tempest-ImagesMetadataTestJSON-317502035 tempest-ImagesMetadataTestJSON-317502035-project] 10.222.0.50 "PUT /compute/v2.1/images/6ad0a7b7-7276-4c8b-bc0c-3a4c43436327/metadata" status: 200 len: 61 microversion: 2.1 time: 0.877278 Aug 10 17:53:55.597326 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 603/1209] 10.222.0.50 () {60 vars in 1280 bytes} [Wed Aug 10 17:53:54 2022] PUT /compute/v2.1/images/6ad0a7b7-7276-4c8b-bc0c-3a4c43436327/metadata => generated 61 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 17:53:55.603221 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-2af6ff81-29ed-44da-bbab-4b1643e11477 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:55.604345 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-2af6ff81-29ed-44da-bbab-4b1643e11477 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] [instance: 4db20dd7-9c34-41ea-a53f-e61c197ca66c] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:55.621962 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2af6ff81-29ed-44da-bbab-4b1643e11477 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:55.625201 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2af6ff81-29ed-44da-bbab-4b1643e11477 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:55.626752 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2af6ff81-29ed-44da-bbab-4b1643e11477 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:55.628354 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2af6ff81-29ed-44da-bbab-4b1643e11477 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:55.630239 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2af6ff81-29ed-44da-bbab-4b1643e11477 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:55.630708 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2af6ff81-29ed-44da-bbab-4b1643e11477 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:55.681611 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2af6ff81-29ed-44da-bbab-4b1643e11477 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:55.682727 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2af6ff81-29ed-44da-bbab-4b1643e11477 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:55.683221 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2af6ff81-29ed-44da-bbab-4b1643e11477 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:55.683685 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.objects.instance [None req-2af6ff81-29ed-44da-bbab-4b1643e11477 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lazy-loading 'fault' on Instance uuid 4db20dd7-9c34-41ea-a53f-e61c197ca66c {{(pid=129410) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:53:55.687137 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:53:55.783191 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-2af6ff81-29ed-44da-bbab-4b1643e11477 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2fd6acf18d4218ad143ccee2d0bb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7c2481a908406fa9c4562513fff665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:55.798759 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-2af6ff81-29ed-44da-bbab-4b1643e11477 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] 10.222.0.50 "GET /compute/v2.1/servers/4db20dd7-9c34-41ea-a53f-e61c197ca66c" status: 200 len: 1304 microversion: 2.1 time: 0.200124 Aug 10 17:53:55.799390 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 604/1210] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:55 2022] GET /compute/v2.1/servers/4db20dd7-9c34-41ea-a53f-e61c197ca66c => generated 1304 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:53:55.825455 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-d2007034-0b9c-44eb-90bc-3b67ba2a68c3 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:55.826519 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-d2007034-0b9c-44eb-90bc-3b67ba2a68c3 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] [instance: 2a0c8868-b8d4-494c-b716-d637d1320340] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:55.844006 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d2007034-0b9c-44eb-90bc-3b67ba2a68c3 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:55.846902 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d2007034-0b9c-44eb-90bc-3b67ba2a68c3 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:55.847736 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d2007034-0b9c-44eb-90bc-3b67ba2a68c3 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:55.850106 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d2007034-0b9c-44eb-90bc-3b67ba2a68c3 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:55.850781 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d2007034-0b9c-44eb-90bc-3b67ba2a68c3 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:55.851736 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d2007034-0b9c-44eb-90bc-3b67ba2a68c3 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:55.913056 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-90c69e9b-2fac-4578-be28-dedcf0d7d3a2 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "DELETE /compute/v2.1/servers/83268d7f-5375-4b01-9b5c-519be7daf0a4" status: 204 len: 0 microversion: 2.1 time: 1.046408 Aug 10 17:53:55.917065 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 607/1211] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 10 17:53:54 2022] DELETE /compute/v2.1/servers/83268d7f-5375-4b01-9b5c-519be7daf0a4 => generated 0 bytes in 1066 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 17:53:55.919608 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-f44886ef-7a44-4244-ad13-636d6105d72f tempest-ImagesMetadataTestJSON-317502035 tempest-ImagesMetadataTestJSON-317502035-project] Calling method '.version_select at 0x7fb345ff2c10>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:55.990342 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-f44886ef-7a44-4244-ad13-636d6105d72f tempest-ImagesMetadataTestJSON-317502035 tempest-ImagesMetadataTestJSON-317502035-project] 10.222.0.50 "GET /compute/v2.1/images/6ad0a7b7-7276-4c8b-bc0c-3a4c43436327/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.075057 Aug 10 17:53:55.991573 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 608/1212] 10.222.0.50 () {58 vars in 1290 bytes} [Wed Aug 10 17:53:55 2022] GET /compute/v2.1/images/6ad0a7b7-7276-4c8b-bc0c-3a4c43436327/metadata/os_distro => generated 33 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 17:53:56.000078 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-22ab9fa0-4d4b-4967-8ea7-b964658de052 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:56.008576 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-22ab9fa0-4d4b-4967-8ea7-b964658de052 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] [instance: 2c8728f2-55fb-4306-acc5-227ba55ec278] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:56.019398 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-22ab9fa0-4d4b-4967-8ea7-b964658de052 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:56.019894 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-22ab9fa0-4d4b-4967-8ea7-b964658de052 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:56.020351 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-22ab9fa0-4d4b-4967-8ea7-b964658de052 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:56.020503 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-d2007034-0b9c-44eb-90bc-3b67ba2a68c3 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dac2a95483d4be99f06a2aeeb379339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8014941eeb974f0bb3a4d26a65346f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:56.021053 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-22ab9fa0-4d4b-4967-8ea7-b964658de052 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:56.021670 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-22ab9fa0-4d4b-4967-8ea7-b964658de052 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:56.022101 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-22ab9fa0-4d4b-4967-8ea7-b964658de052 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:56.031491 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-d2007034-0b9c-44eb-90bc-3b67ba2a68c3 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] 10.222.0.50 "GET /compute/v2.1/servers/2a0c8868-b8d4-494c-b716-d637d1320340" status: 200 len: 1226 microversion: 2.1 time: 0.227871 Aug 10 17:53:56.032090 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 605/1213] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:55 2022] GET /compute/v2.1/servers/2a0c8868-b8d4-494c-b716-d637d1320340 => generated 1226 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:53:56.051951 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-ace579a3-f306-474f-97a9-fa3fe58ee043 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:56.051951 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-ace579a3-f306-474f-97a9-fa3fe58ee043 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: 0d821054-dce7-4015-8eaa-d8c56e7c3cd3] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:56.063154 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-ace579a3-f306-474f-97a9-fa3fe58ee043 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:56.063784 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-ace579a3-f306-474f-97a9-fa3fe58ee043 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:56.064226 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-ace579a3-f306-474f-97a9-fa3fe58ee043 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:56.064988 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-ace579a3-f306-474f-97a9-fa3fe58ee043 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:56.065610 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-ace579a3-f306-474f-97a9-fa3fe58ee043 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:56.066039 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-ace579a3-f306-474f-97a9-fa3fe58ee043 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:56.096852 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-22ab9fa0-4d4b-4967-8ea7-b964658de052 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:56.097347 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-22ab9fa0-4d4b-4967-8ea7-b964658de052 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:56.097785 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-22ab9fa0-4d4b-4967-8ea7-b964658de052 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:56.098237 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.objects.instance [None req-22ab9fa0-4d4b-4967-8ea7-b964658de052 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lazy-loading 'fault' on Instance uuid 2c8728f2-55fb-4306-acc5-227ba55ec278 {{(pid=129409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:53:56.299799 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-22ab9fa0-4d4b-4967-8ea7-b964658de052 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f082ed04bc143679029c204e8a97160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c7c8eeb1b4065b25fe28eba30d0eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:56.311944 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-22ab9fa0-4d4b-4967-8ea7-b964658de052 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] 10.222.0.50 "GET /compute/v2.1/servers/2c8728f2-55fb-4306-acc5-227ba55ec278" status: 200 len: 1308 microversion: 2.1 time: 0.319078 Aug 10 17:53:56.312571 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 609/1214] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:55 2022] GET /compute/v2.1/servers/2c8728f2-55fb-4306-acc5-227ba55ec278 => generated 1308 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:53:56.323177 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-e9e2f9a8-6e77-4975-803c-f72eacad9107 tempest-ImagesMetadataTestJSON-317502035 tempest-ImagesMetadataTestJSON-317502035-project] Action: 'update_all', calling method: .version_select at 0x7fb345ff2f70>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:53:56.433142 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-e9e2f9a8-6e77-4975-803c-f72eacad9107 tempest-ImagesMetadataTestJSON-317502035 tempest-ImagesMetadataTestJSON-317502035-project] Getting quotas for project efb9e6629f9f42fe96f757214f538f5a. Resources: dict_keys(['metadata_items']) {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:53:56.438862 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-e9e2f9a8-6e77-4975-803c-f72eacad9107 tempest-ImagesMetadataTestJSON-317502035 tempest-ImagesMetadataTestJSON-317502035-project] Getting quotas for user 0c0dc124415f42799e788b4489a23afa and project efb9e6629f9f42fe96f757214f538f5a. Resources: dict_keys(['metadata_items']) {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:53:56.555325 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-ace579a3-f306-474f-97a9-fa3fe58ee043 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:56.597321 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-ace579a3-f306-474f-97a9-fa3fe58ee043 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/0d821054-dce7-4015-8eaa-d8c56e7c3cd3" status: 200 len: 1475 microversion: 2.1 time: 0.555059 Aug 10 17:53:56.597942 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 606/1215] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:56 2022] GET /compute/v2.1/servers/0d821054-dce7-4015-8eaa-d8c56e7c3cd3 => generated 1475 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:53:56.618677 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [req-af7e61cc-e51b-488d-a299-ab52dcf4eb94 req-1a29518e-4117-4771-b062-15f1789b9b99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c8728f2-55fb-4306-acc5-227ba55ec278", "name": "network-vif-deleted", "tag": "e250e1f9-19b1-4cb6-be9d-02413ac740e5"}]} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:53:56.657978 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-af7e61cc-e51b-488d-a299-ab52dcf4eb94 req-1a29518e-4117-4771-b062-15f1789b9b99 service nova] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:56.664863 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-af7e61cc-e51b-488d-a299-ab52dcf4eb94 req-1a29518e-4117-4771-b062-15f1789b9b99 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:56.666102 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-af7e61cc-e51b-488d-a299-ab52dcf4eb94 req-1a29518e-4117-4771-b062-15f1789b9b99 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:56.686682 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-e9e2f9a8-6e77-4975-803c-f72eacad9107 tempest-ImagesMetadataTestJSON-317502035 tempest-ImagesMetadataTestJSON-317502035-project] 10.222.0.50 "PUT /compute/v2.1/images/6ad0a7b7-7276-4c8b-bc0c-3a4c43436327/metadata" status: 200 len: 61 microversion: 2.1 time: 0.371489 Aug 10 17:53:56.692772 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 610/1216] 10.222.0.50 () {60 vars in 1280 bytes} [Wed Aug 10 17:53:56 2022] PUT /compute/v2.1/images/6ad0a7b7-7276-4c8b-bc0c-3a4c43436327/metadata => generated 61 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 17:53:56.692989 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.compute.server_external_events [req-af7e61cc-e51b-488d-a299-ab52dcf4eb94 req-1a29518e-4117-4771-b062-15f1789b9b99 service nova] Creating event network-vif-deleted:e250e1f9-19b1-4cb6-be9d-02413ac740e5 for instance 2c8728f2-55fb-4306-acc5-227ba55ec278 on n-h2-852296-2 Aug 10 17:53:56.700922 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-4948eaf5-b31a-4855-826f-88038ad37f65 tempest-ImagesMetadataTestJSON-317502035 tempest-ImagesMetadataTestJSON-317502035-project] Calling method '.version_select at 0x7fb345ff21f0>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:56.703272 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [req-af7e61cc-e51b-488d-a299-ab52dcf4eb94 req-1a29518e-4117-4771-b062-15f1789b9b99 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102936 Aug 10 17:53:56.706002 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 607/1217] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 10 17:53:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:53:56.776410 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-4948eaf5-b31a-4855-826f-88038ad37f65 tempest-ImagesMetadataTestJSON-317502035 tempest-ImagesMetadataTestJSON-317502035-project] 10.222.0.50 "GET /compute/v2.1/images/6ad0a7b7-7276-4c8b-bc0c-3a4c43436327/metadata" status: 200 len: 61 microversion: 2.1 time: 0.081847 Aug 10 17:53:56.779230 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 611/1218] 10.222.0.50 () {58 vars in 1260 bytes} [Wed Aug 10 17:53:56 2022] GET /compute/v2.1/images/6ad0a7b7-7276-4c8b-bc0c-3a4c43436327/metadata => generated 61 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 17:53:56.792813 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-ff59467f-7b25-49bf-9106-3f8c61dfdbff tempest-ImagesMetadataTestJSON-317502035 tempest-ImagesMetadataTestJSON-317502035-project] Action: 'update_all', calling method: .version_select at 0x7fb345bde670>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:53:56.823126 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-4daee34b-8d83-4734-845d-e096a8d8bc0f tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:56.823743 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-4daee34b-8d83-4734-845d-e096a8d8bc0f tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] [instance: 4db20dd7-9c34-41ea-a53f-e61c197ca66c] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:56.843096 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-4daee34b-8d83-4734-845d-e096a8d8bc0f tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:56.843096 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-4daee34b-8d83-4734-845d-e096a8d8bc0f tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:56.843096 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-4daee34b-8d83-4734-845d-e096a8d8bc0f tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:56.843096 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-4daee34b-8d83-4734-845d-e096a8d8bc0f tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:56.843096 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-4daee34b-8d83-4734-845d-e096a8d8bc0f tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:56.843096 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-4daee34b-8d83-4734-845d-e096a8d8bc0f tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:56.873160 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-4daee34b-8d83-4734-845d-e096a8d8bc0f tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] HTTP exception thrown: Instance 4db20dd7-9c34-41ea-a53f-e61c197ca66c could not be found. Aug 10 17:53:56.889728 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-4daee34b-8d83-4734-845d-e096a8d8bc0f tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Request method failure captured: Aug 10 17:53:56.889728 n-d-852296-2 devstack@n-api.service[129409]: request: GET /compute/v2.1/servers/4db20dd7-9c34-41ea-a53f-e61c197ca66c HTTP/1.1 Aug 10 17:53:56.889728 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 17:53:56.889728 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 17:53:56.889728 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 17:53:56.889728 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 0 Aug 10 17:53:56.889728 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 17:53:56.889728 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 17:53:56.889728 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 17:53:56.889728 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 17:53:56.889728 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8_ATDuqUJcrY2G1NcAiR2K35RtyTwj8XOyzsgOdlms7E-Yi4db2DnRE4b_OTnceSzuTrQc9t-CzsQdrp68P4PChqFPB5pZHACMpcquu7mMlJ7wKiyjvUXZUUkvJa3m2iS-6_ZEeqkP8HDhDVtYG1XBBkQbjwy3new3R-j0JxuybWBIE Aug 10 17:53:56.889728 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 17:53:56.889728 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 17:53:56.889728 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 17:53:56.889728 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 17:53:56.889728 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 17:53:56.889728 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 17:53:56.889728 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: 6b7c2481a908406fa9c4562513fff665 Aug 10 17:53:56.889728 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-ServersAdminTestJSON-148547485 Aug 10 17:53:56.889728 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 17:53:56.889728 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 17:53:56.889728 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6b7c2481a908406fa9c4562513fff665"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6b7c2481a908406fa9c4562513fff665"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6b7c2481a908406fa9c4562513fff665"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6b7c2481a908406fa9c4562513fff665", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:53:56.889728 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-ServersAdminTestJSON-148547485 Aug 10 17:53:56.889728 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: 6b7c2481a908406fa9c4562513fff665 Aug 10 17:53:56.889728 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-ServersAdminTestJSON-148547485 Aug 10 17:53:56.889728 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-ServersAdminTestJSON-148547485-project Aug 10 17:53:56.889728 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 17:53:56.889728 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 17:53:56.889728 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: 1b2fd6acf18d4218ad143ccee2d0bb5b Aug 10 17:53:56.889728 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-ServersAdminTestJSON-148547485-project Aug 10 17:53:56.889728 n-d-852296-2 devstack@n-api.service[129409]: method: > Aug 10 17:53:56.889728 n-d-852296-2 devstack@n-api.service[129409]: exception: Instance 4db20dd7-9c34-41ea-a53f-e61c197ca66c could not be found. Aug 10 17:53:56.889728 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'id': '4db20dd7-9c34-41ea-a53f-e61c197ca66c'} Aug 10 17:53:56.889728 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:53:56.889728 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:53:56.889728 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 17:53:56.889728 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 17:53:56.889728 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 17:53:56.889728 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 17:53:56.889728 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 17:53:56.889728 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 17:53:56.889728 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 17:53:56.889728 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 17:53:56.889728 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4db20dd7-9c34-41ea-a53f-e61c197ca66c could not be found. Aug 10 17:53:56.889728 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:53:56.889728 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:53:56.889728 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:53:56.889728 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:53:56.889728 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:53:56.889728 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:53:56.889728 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:53:56.889728 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:53:56.889728 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:53:56.889728 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:53:56.889728 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 17:53:56.889728 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 17:53:56.889728 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 17:53:56.889728 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 17:53:56.889728 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 17:53:56.889728 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:53:56.889728 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4db20dd7-9c34-41ea-a53f-e61c197ca66c could not be found. Aug 10 17:53:56.889728 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:53:56.889728 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:53:56.889728 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:53:56.894116 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:53:56.894116 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:53:56.894116 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:53:56.894116 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:53:56.894116 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:53:56.894116 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4db20dd7-9c34-41ea-a53f-e61c197ca66c could not be found. Aug 10 17:53:56.894116 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:53:56.894116 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-4daee34b-8d83-4734-845d-e096a8d8bc0f tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Returning 404 to user: Instance 4db20dd7-9c34-41ea-a53f-e61c197ca66c could not be found. {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:53:56.894116 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-4daee34b-8d83-4734-845d-e096a8d8bc0f tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] 10.222.0.50 "GET /compute/v2.1/servers/4db20dd7-9c34-41ea-a53f-e61c197ca66c" status: 404 len: 111 microversion: 2.1 time: 0.074072 Aug 10 17:53:56.911301 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.quota [None req-ff59467f-7b25-49bf-9106-3f8c61dfdbff tempest-ImagesMetadataTestJSON-317502035 tempest-ImagesMetadataTestJSON-317502035-project] Getting quotas for project efb9e6629f9f42fe96f757214f538f5a. Resources: dict_keys(['metadata_items']) {{(pid=129410) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:53:56.919191 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 612/1219] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:56 2022] GET /compute/v2.1/servers/4db20dd7-9c34-41ea-a53f-e61c197ca66c => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 17:53:56.926332 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-c6f3f562-1f45-4e1d-bd6e-eb142c95d59c tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:56.926846 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-c6f3f562-1f45-4e1d-bd6e-eb142c95d59c tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] [instance: bee3148a-3834-41bd-99e7-b5da75217256] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:56.929646 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.quota [None req-ff59467f-7b25-49bf-9106-3f8c61dfdbff tempest-ImagesMetadataTestJSON-317502035 tempest-ImagesMetadataTestJSON-317502035-project] Getting quotas for user 0c0dc124415f42799e788b4489a23afa and project efb9e6629f9f42fe96f757214f538f5a. Resources: dict_keys(['metadata_items']) {{(pid=129410) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:53:56.946119 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c6f3f562-1f45-4e1d-bd6e-eb142c95d59c tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:56.948034 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c6f3f562-1f45-4e1d-bd6e-eb142c95d59c tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:56.948495 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c6f3f562-1f45-4e1d-bd6e-eb142c95d59c tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:56.949968 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c6f3f562-1f45-4e1d-bd6e-eb142c95d59c tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:56.950436 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c6f3f562-1f45-4e1d-bd6e-eb142c95d59c tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:56.950862 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c6f3f562-1f45-4e1d-bd6e-eb142c95d59c tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:56.955463 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:53:57.042222 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-c6f3f562-1f45-4e1d-bd6e-eb142c95d59c tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] [instance: bee3148a-3834-41bd-99e7-b5da75217256] Going to try to terminate instance {{(pid=129409) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 17:53:57.249382 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-ff59467f-7b25-49bf-9106-3f8c61dfdbff tempest-ImagesMetadataTestJSON-317502035 tempest-ImagesMetadataTestJSON-317502035-project] 10.222.0.50 "PUT /compute/v2.1/images/6ad0a7b7-7276-4c8b-bc0c-3a4c43436327/metadata" status: 200 len: 61 microversion: 2.1 time: 0.463392 Aug 10 17:53:57.250234 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 608/1220] 10.222.0.50 () {60 vars in 1280 bytes} [Wed Aug 10 17:53:56 2022] PUT /compute/v2.1/images/6ad0a7b7-7276-4c8b-bc0c-3a4c43436327/metadata => generated 61 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 17:53:57.266640 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-71b73ad0-9439-4a48-a56c-e88becee7f78 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:57.274217 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-71b73ad0-9439-4a48-a56c-e88becee7f78 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] [instance: 2a0c8868-b8d4-494c-b716-d637d1320340] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:57.298546 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-71b73ad0-9439-4a48-a56c-e88becee7f78 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:57.301322 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-71b73ad0-9439-4a48-a56c-e88becee7f78 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:57.303053 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-71b73ad0-9439-4a48-a56c-e88becee7f78 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:57.304320 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-71b73ad0-9439-4a48-a56c-e88becee7f78 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:57.309709 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-71b73ad0-9439-4a48-a56c-e88becee7f78 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:57.310439 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-71b73ad0-9439-4a48-a56c-e88becee7f78 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:57.476669 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-71b73ad0-9439-4a48-a56c-e88becee7f78 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dac2a95483d4be99f06a2aeeb379339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8014941eeb974f0bb3a4d26a65346f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:57.489197 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-71b73ad0-9439-4a48-a56c-e88becee7f78 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] 10.222.0.50 "GET /compute/v2.1/servers/2a0c8868-b8d4-494c-b716-d637d1320340" status: 200 len: 1226 microversion: 2.1 time: 0.236616 Aug 10 17:53:57.491818 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 609/1221] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:57 2022] GET /compute/v2.1/servers/2a0c8868-b8d4-494c-b716-d637d1320340 => generated 1226 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:53:57.499354 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-1b417dcd-1334-45ef-a60d-dfe996e6ac1e tempest-ImagesMetadataTestJSON-317502035 tempest-ImagesMetadataTestJSON-317502035-project] Action: 'update_all', calling method: .version_select at 0x7fb345bc4af0>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:53:57.596405 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.quota [None req-1b417dcd-1334-45ef-a60d-dfe996e6ac1e tempest-ImagesMetadataTestJSON-317502035 tempest-ImagesMetadataTestJSON-317502035-project] Getting quotas for project efb9e6629f9f42fe96f757214f538f5a. Resources: dict_keys(['metadata_items']) {{(pid=129410) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:53:57.602592 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.quota [None req-1b417dcd-1334-45ef-a60d-dfe996e6ac1e tempest-ImagesMetadataTestJSON-317502035 tempest-ImagesMetadataTestJSON-317502035-project] Getting quotas for user 0c0dc124415f42799e788b4489a23afa and project efb9e6629f9f42fe96f757214f538f5a. Resources: dict_keys(['metadata_items']) {{(pid=129410) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:53:57.817774 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-c6f3f562-1f45-4e1d-bd6e-eb142c95d59c tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] 10.222.0.50 "DELETE /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256" status: 204 len: 0 microversion: 2.1 time: 0.891463 Aug 10 17:53:57.819076 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 613/1222] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 10 17:53:56 2022] DELETE /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256 => generated 0 bytes in 897 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 10 17:53:57.838200 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-1f258fe8-cdfd-4e0b-b929-384d05a50a67 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:57.838978 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-1f258fe8-cdfd-4e0b-b929-384d05a50a67 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] [instance: 2c8728f2-55fb-4306-acc5-227ba55ec278] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:57.860033 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-1f258fe8-cdfd-4e0b-b929-384d05a50a67 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:57.862758 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-1f258fe8-cdfd-4e0b-b929-384d05a50a67 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:57.863256 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-1f258fe8-cdfd-4e0b-b929-384d05a50a67 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:57.866187 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-1f258fe8-cdfd-4e0b-b929-384d05a50a67 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:57.868818 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-1f258fe8-cdfd-4e0b-b929-384d05a50a67 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:57.870291 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-1f258fe8-cdfd-4e0b-b929-384d05a50a67 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:57.927065 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-1f258fe8-cdfd-4e0b-b929-384d05a50a67 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] HTTP exception thrown: Instance 2c8728f2-55fb-4306-acc5-227ba55ec278 could not be found. Aug 10 17:53:57.931829 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-1f258fe8-cdfd-4e0b-b929-384d05a50a67 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Request method failure captured: Aug 10 17:53:57.931829 n-d-852296-2 devstack@n-api.service[129409]: request: GET /compute/v2.1/servers/2c8728f2-55fb-4306-acc5-227ba55ec278 HTTP/1.1 Aug 10 17:53:57.931829 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 17:53:57.931829 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 17:53:57.931829 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 17:53:57.931829 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 0 Aug 10 17:53:57.931829 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 17:53:57.931829 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 17:53:57.931829 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 17:53:57.931829 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 17:53:57.931829 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8_Bz-ncDsBWNKyZ4_jYLLfu0M2gBltm_395AUJGbfnIKvGU_xH87cu4Gfq6_Q7pRNSEaW0QAoVtPYey2WWKK3hahsMb6loEhrCHbv3ZNEa4kfOI9pcyADpkoM1d6fDFkq3ogr023FiuFWHWsa6SVV9MSQF_GHnjT0KxVS46wHcnHNUc Aug 10 17:53:57.931829 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 17:53:57.931829 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 17:53:57.931829 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 17:53:57.931829 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 17:53:57.931829 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 17:53:57.931829 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 17:53:57.931829 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: 8e1c7c8eeb1b4065b25fe28eba30d0eb Aug 10 17:53:57.931829 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-LiveMigrationNegativeTest-1001885511 Aug 10 17:53:57.931829 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 17:53:57.931829 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 17:53:57.931829 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8e1c7c8eeb1b4065b25fe28eba30d0eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8e1c7c8eeb1b4065b25fe28eba30d0eb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8e1c7c8eeb1b4065b25fe28eba30d0eb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8e1c7c8eeb1b4065b25fe28eba30d0eb", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:53:57.931829 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-LiveMigrationNegativeTest-1001885511 Aug 10 17:53:57.931829 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: 8e1c7c8eeb1b4065b25fe28eba30d0eb Aug 10 17:53:57.931829 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1001885511 Aug 10 17:53:57.931829 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-LiveMigrationNegativeTest-1001885511-project Aug 10 17:53:57.931829 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 17:53:57.931829 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 17:53:57.931829 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: 5f082ed04bc143679029c204e8a97160 Aug 10 17:53:57.931829 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-LiveMigrationNegativeTest-1001885511-project Aug 10 17:53:57.931829 n-d-852296-2 devstack@n-api.service[129409]: method: > Aug 10 17:53:57.931829 n-d-852296-2 devstack@n-api.service[129409]: exception: Instance 2c8728f2-55fb-4306-acc5-227ba55ec278 could not be found. Aug 10 17:53:57.931829 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'id': '2c8728f2-55fb-4306-acc5-227ba55ec278'} Aug 10 17:53:57.931829 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:53:57.931829 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:53:57.931829 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 17:53:57.931829 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 17:53:57.931829 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 17:53:57.931829 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 17:53:57.931829 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 17:53:57.931829 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 17:53:57.931829 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 17:53:57.931829 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 17:53:57.931829 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c8728f2-55fb-4306-acc5-227ba55ec278 could not be found. Aug 10 17:53:57.931829 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:53:57.931829 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:53:57.931829 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:53:57.931829 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:53:57.931829 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:53:57.931829 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:53:57.931829 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:53:57.931829 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:53:57.931829 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:53:57.931829 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:53:57.931829 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 17:53:57.931829 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 17:53:57.931829 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 17:53:57.931829 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 17:53:57.931829 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 17:53:57.931829 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:53:57.931829 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c8728f2-55fb-4306-acc5-227ba55ec278 could not be found. Aug 10 17:53:57.931829 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:53:57.931829 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:53:57.931829 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:53:57.936555 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:53:57.936555 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:53:57.936555 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:53:57.936555 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:53:57.936555 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:53:57.936555 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c8728f2-55fb-4306-acc5-227ba55ec278 could not be found. Aug 10 17:53:57.936555 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:53:57.936555 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-1f258fe8-cdfd-4e0b-b929-384d05a50a67 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] Returning 404 to user: Instance 2c8728f2-55fb-4306-acc5-227ba55ec278 could not be found. {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:53:57.937568 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-1f258fe8-cdfd-4e0b-b929-384d05a50a67 tempest-LiveMigrationNegativeTest-1001885511 tempest-LiveMigrationNegativeTest-1001885511-project] 10.222.0.50 "GET /compute/v2.1/servers/2c8728f2-55fb-4306-acc5-227ba55ec278" status: 404 len: 111 microversion: 2.1 time: 0.115877 Aug 10 17:53:57.940301 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 614/1223] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:57 2022] GET /compute/v2.1/servers/2c8728f2-55fb-4306-acc5-227ba55ec278 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:53:57.952915 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-a7245b92-d770-4012-969d-2df4073e37ae tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:57.953552 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-a7245b92-d770-4012-969d-2df4073e37ae tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: 0d821054-dce7-4015-8eaa-d8c56e7c3cd3] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:57.973800 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a7245b92-d770-4012-969d-2df4073e37ae tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:57.974570 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a7245b92-d770-4012-969d-2df4073e37ae tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:57.975016 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a7245b92-d770-4012-969d-2df4073e37ae tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:57.975927 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a7245b92-d770-4012-969d-2df4073e37ae tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:57.977663 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a7245b92-d770-4012-969d-2df4073e37ae tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:57.978522 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a7245b92-d770-4012-969d-2df4073e37ae tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:58.268540 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-1b417dcd-1334-45ef-a60d-dfe996e6ac1e tempest-ImagesMetadataTestJSON-317502035 tempest-ImagesMetadataTestJSON-317502035-project] 10.222.0.50 "PUT /compute/v2.1/images/6ad0a7b7-7276-4c8b-bc0c-3a4c43436327/metadata" status: 200 len: 64 microversion: 2.1 time: 0.775099 Aug 10 17:53:58.269136 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 610/1224] 10.222.0.50 () {60 vars in 1280 bytes} [Wed Aug 10 17:53:57 2022] PUT /compute/v2.1/images/6ad0a7b7-7276-4c8b-bc0c-3a4c43436327/metadata => generated 64 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 17:53:58.280950 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-389ddf3c-83f6-409b-b5b8-b66005908e80 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:58.281612 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-389ddf3c-83f6-409b-b5b8-b66005908e80 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] [instance: bee3148a-3834-41bd-99e7-b5da75217256] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:58.285151 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:53:58.293486 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-389ddf3c-83f6-409b-b5b8-b66005908e80 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:58.294360 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-389ddf3c-83f6-409b-b5b8-b66005908e80 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:58.294894 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-389ddf3c-83f6-409b-b5b8-b66005908e80 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:58.295873 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-389ddf3c-83f6-409b-b5b8-b66005908e80 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:58.296721 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-389ddf3c-83f6-409b-b5b8-b66005908e80 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:58.297267 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-389ddf3c-83f6-409b-b5b8-b66005908e80 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:58.429804 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-a7245b92-d770-4012-969d-2df4073e37ae tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:58.438083 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-a7245b92-d770-4012-969d-2df4073e37ae tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/0d821054-dce7-4015-8eaa-d8c56e7c3cd3" status: 200 len: 1475 microversion: 2.1 time: 0.495605 Aug 10 17:53:58.439322 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 615/1225] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:57 2022] GET /compute/v2.1/servers/0d821054-dce7-4015-8eaa-d8c56e7c3cd3 => generated 1475 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:53:58.455115 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-389ddf3c-83f6-409b-b5b8-b66005908e80 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2fd6acf18d4218ad143ccee2d0bb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7c2481a908406fa9c4562513fff665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:58.467967 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-389ddf3c-83f6-409b-b5b8-b66005908e80 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] 10.222.0.50 "GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256" status: 200 len: 1468 microversion: 2.1 time: 0.191056 Aug 10 17:53:58.468888 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 611/1226] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:58 2022] GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256 => generated 1468 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:53:58.469093 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-38a4c050-ec3d-4bfa-ae8f-64f4630b358d tempest-ImagesMetadataTestJSON-317502035 tempest-ImagesMetadataTestJSON-317502035-project] Calling method '.version_select at 0x7fb345f5eb80>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:58.524662 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-845569ca-eac6-485c-a16c-c80bc8ecc952 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:58.525652 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-845569ca-eac6-485c-a16c-c80bc8ecc952 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] [instance: 2a0c8868-b8d4-494c-b716-d637d1320340] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:58.534465 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-38a4c050-ec3d-4bfa-ae8f-64f4630b358d tempest-ImagesMetadataTestJSON-317502035 tempest-ImagesMetadataTestJSON-317502035-project] 10.222.0.50 "GET /compute/v2.1/images/6ad0a7b7-7276-4c8b-bc0c-3a4c43436327/metadata" status: 200 len: 64 microversion: 2.1 time: 0.093505 Aug 10 17:53:58.535075 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 616/1227] 10.222.0.50 () {58 vars in 1260 bytes} [Wed Aug 10 17:53:58 2022] GET /compute/v2.1/images/6ad0a7b7-7276-4c8b-bc0c-3a4c43436327/metadata => generated 64 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 17:53:58.538946 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-845569ca-eac6-485c-a16c-c80bc8ecc952 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:58.539730 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-845569ca-eac6-485c-a16c-c80bc8ecc952 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:58.540746 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-845569ca-eac6-485c-a16c-c80bc8ecc952 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:58.541541 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-845569ca-eac6-485c-a16c-c80bc8ecc952 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:58.543706 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-845569ca-eac6-485c-a16c-c80bc8ecc952 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:58.548848 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-5b580834-ea91-4a0a-b65c-26462e3ba4dd tempest-ImagesMetadataTestJSON-317502035 tempest-ImagesMetadataTestJSON-317502035-project] Action: 'update_all', calling method: .version_select at 0x7fb346059af0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:53:58.549717 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-845569ca-eac6-485c-a16c-c80bc8ecc952 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:58.655214 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-5b580834-ea91-4a0a-b65c-26462e3ba4dd tempest-ImagesMetadataTestJSON-317502035 tempest-ImagesMetadataTestJSON-317502035-project] Getting quotas for project efb9e6629f9f42fe96f757214f538f5a. Resources: dict_keys(['metadata_items']) {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:53:58.667181 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-5b580834-ea91-4a0a-b65c-26462e3ba4dd tempest-ImagesMetadataTestJSON-317502035 tempest-ImagesMetadataTestJSON-317502035-project] Getting quotas for user 0c0dc124415f42799e788b4489a23afa and project efb9e6629f9f42fe96f757214f538f5a. Resources: dict_keys(['metadata_items']) {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:53:58.685841 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-845569ca-eac6-485c-a16c-c80bc8ecc952 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dac2a95483d4be99f06a2aeeb379339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8014941eeb974f0bb3a4d26a65346f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:58.694719 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-845569ca-eac6-485c-a16c-c80bc8ecc952 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] 10.222.0.50 "GET /compute/v2.1/servers/2a0c8868-b8d4-494c-b716-d637d1320340" status: 200 len: 1274 microversion: 2.1 time: 0.181755 Aug 10 17:53:58.707747 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 612/1228] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:58 2022] GET /compute/v2.1/servers/2a0c8868-b8d4-494c-b716-d637d1320340 => generated 1274 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:53:58.839788 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [req-fae20ab5-f1b3-43e1-9506-41b5041a63fd req-ac12a723-81e2-4426-8073-277bc3a83838 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d821054-dce7-4015-8eaa-d8c56e7c3cd3", "name": "network-vif-deleted", "tag": "b2611f6e-dc7c-4074-b71e-211cff945882"}]} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:53:58.872113 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-fae20ab5-f1b3-43e1-9506-41b5041a63fd req-ac12a723-81e2-4426-8073-277bc3a83838 service nova] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:58.872923 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-fae20ab5-f1b3-43e1-9506-41b5041a63fd req-ac12a723-81e2-4426-8073-277bc3a83838 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:58.876988 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-fae20ab5-f1b3-43e1-9506-41b5041a63fd req-ac12a723-81e2-4426-8073-277bc3a83838 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:58.940210 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.compute.server_external_events [req-fae20ab5-f1b3-43e1-9506-41b5041a63fd req-ac12a723-81e2-4426-8073-277bc3a83838 service nova] Creating event network-vif-deleted:b2611f6e-dc7c-4074-b71e-211cff945882 for instance 0d821054-dce7-4015-8eaa-d8c56e7c3cd3 on n-h2-852296-2 Aug 10 17:53:58.957384 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [req-fae20ab5-f1b3-43e1-9506-41b5041a63fd req-ac12a723-81e2-4426-8073-277bc3a83838 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124552 Aug 10 17:53:58.961259 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 613/1229] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 10 17:53:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:53:59.379408 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-5b580834-ea91-4a0a-b65c-26462e3ba4dd tempest-ImagesMetadataTestJSON-317502035 tempest-ImagesMetadataTestJSON-317502035-project] 10.222.0.50 "PUT /compute/v2.1/images/6ad0a7b7-7276-4c8b-bc0c-3a4c43436327/metadata" status: 200 len: 61 microversion: 2.1 time: 0.836038 Aug 10 17:53:59.380315 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 617/1230] 10.222.0.50 () {60 vars in 1280 bytes} [Wed Aug 10 17:53:58 2022] PUT /compute/v2.1/images/6ad0a7b7-7276-4c8b-bc0c-3a4c43436327/metadata => generated 61 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 17:53:59.391351 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-0c8b9c93-1774-4d87-835d-d85118955764 tempest-ImagesMetadataTestJSON-317502035 tempest-ImagesMetadataTestJSON-317502035-project] Action: 'update', calling method: .version_select at 0x7fb345bf8670>, body: {"meta": {"os_version": "alt"}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:53:59.470661 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-87844b25-133d-44e9-bc00-1b8e694bebd9 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:59.480463 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-87844b25-133d-44e9-bc00-1b8e694bebd9 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: 0d821054-dce7-4015-8eaa-d8c56e7c3cd3] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:59.508016 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.quota [None req-0c8b9c93-1774-4d87-835d-d85118955764 tempest-ImagesMetadataTestJSON-317502035 tempest-ImagesMetadataTestJSON-317502035-project] Getting quotas for project efb9e6629f9f42fe96f757214f538f5a. Resources: dict_keys(['metadata_items']) {{(pid=129410) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:53:59.514752 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-87844b25-133d-44e9-bc00-1b8e694bebd9 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:59.517904 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-87844b25-133d-44e9-bc00-1b8e694bebd9 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:59.524036 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-87844b25-133d-44e9-bc00-1b8e694bebd9 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:59.525456 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.quota [None req-0c8b9c93-1774-4d87-835d-d85118955764 tempest-ImagesMetadataTestJSON-317502035 tempest-ImagesMetadataTestJSON-317502035-project] Getting quotas for user 0c0dc124415f42799e788b4489a23afa and project efb9e6629f9f42fe96f757214f538f5a. Resources: dict_keys(['metadata_items']) {{(pid=129410) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:53:59.526796 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-87844b25-133d-44e9-bc00-1b8e694bebd9 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:59.555495 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-87844b25-133d-44e9-bc00-1b8e694bebd9 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:59.560401 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-87844b25-133d-44e9-bc00-1b8e694bebd9 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:59.786095 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-87844b25-133d-44e9-bc00-1b8e694bebd9 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:53:59.793155 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-87844b25-133d-44e9-bc00-1b8e694bebd9 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/0d821054-dce7-4015-8eaa-d8c56e7c3cd3" status: 200 len: 1304 microversion: 2.1 time: 0.337654 Aug 10 17:53:59.796684 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 618/1231] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:59 2022] GET /compute/v2.1/servers/0d821054-dce7-4015-8eaa-d8c56e7c3cd3 => generated 1304 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:53:59.844144 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-8f819ca0-bb6f-4dab-a685-c6866890d1fc tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:53:59.846607 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-8f819ca0-bb6f-4dab-a685-c6866890d1fc tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] [instance: bee3148a-3834-41bd-99e7-b5da75217256] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:53:59.874646 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-8f819ca0-bb6f-4dab-a685-c6866890d1fc tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:59.877369 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-8f819ca0-bb6f-4dab-a685-c6866890d1fc tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:59.880369 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-8f819ca0-bb6f-4dab-a685-c6866890d1fc tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:53:59.881157 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-8f819ca0-bb6f-4dab-a685-c6866890d1fc tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:53:59.881638 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-8f819ca0-bb6f-4dab-a685-c6866890d1fc tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:53:59.882073 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-8f819ca0-bb6f-4dab-a685-c6866890d1fc tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:00.340372 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-0c8b9c93-1774-4d87-835d-d85118955764 tempest-ImagesMetadataTestJSON-317502035 tempest-ImagesMetadataTestJSON-317502035-project] 10.222.0.50 "PUT /compute/v2.1/images/6ad0a7b7-7276-4c8b-bc0c-3a4c43436327/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.953330 Aug 10 17:54:00.358977 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-8f819ca0-bb6f-4dab-a685-c6866890d1fc tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2fd6acf18d4218ad143ccee2d0bb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7c2481a908406fa9c4562513fff665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:54:00.364953 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 614/1232] 10.222.0.50 () {60 vars in 1313 bytes} [Wed Aug 10 17:53:59 2022] PUT /compute/v2.1/images/6ad0a7b7-7276-4c8b-bc0c-3a4c43436327/metadata/os_version => generated 31 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 17:54:00.373699 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-8f819ca0-bb6f-4dab-a685-c6866890d1fc tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] 10.222.0.50 "GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256" status: 200 len: 1468 microversion: 2.1 time: 0.575210 Aug 10 17:54:00.374680 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 619/1233] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:53:59 2022] GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256 => generated 1468 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:54:00.401579 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-a127069e-6e68-46b0-ab4a-0b3d0484fe83 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:54:00.408484 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-413fdab5-c870-4425-8163-5b9e97bf98e5 tempest-ImagesMetadataTestJSON-317502035 tempest-ImagesMetadataTestJSON-317502035-project] Calling method '.version_select at 0x7fb3460159d0>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:54:00.410762 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-a127069e-6e68-46b0-ab4a-0b3d0484fe83 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] [instance: 2a0c8868-b8d4-494c-b716-d637d1320340] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:54:00.460773 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a127069e-6e68-46b0-ab4a-0b3d0484fe83 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:00.463563 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a127069e-6e68-46b0-ab4a-0b3d0484fe83 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:00.469184 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a127069e-6e68-46b0-ab4a-0b3d0484fe83 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:00.469184 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a127069e-6e68-46b0-ab4a-0b3d0484fe83 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:00.470807 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a127069e-6e68-46b0-ab4a-0b3d0484fe83 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:00.473037 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a127069e-6e68-46b0-ab4a-0b3d0484fe83 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:00.555274 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-413fdab5-c870-4425-8163-5b9e97bf98e5 tempest-ImagesMetadataTestJSON-317502035 tempest-ImagesMetadataTestJSON-317502035-project] 10.222.0.50 "GET /compute/v2.1/images/6ad0a7b7-7276-4c8b-bc0c-3a4c43436327/metadata" status: 200 len: 58 microversion: 2.1 time: 0.178521 Aug 10 17:54:00.556222 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 620/1234] 10.222.0.50 () {58 vars in 1260 bytes} [Wed Aug 10 17:54:00 2022] GET /compute/v2.1/images/6ad0a7b7-7276-4c8b-bc0c-3a4c43436327/metadata => generated 58 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 17:54:00.590072 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-dffc6702-94b6-4a35-9753-0c75edb6c3e1 tempest-ImagesMetadataTestJSON-317502035 tempest-ImagesMetadataTestJSON-317502035-project] Action: 'update_all', calling method: .version_select at 0x7fb345ff2ca0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:54:00.770358 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-dffc6702-94b6-4a35-9753-0c75edb6c3e1 tempest-ImagesMetadataTestJSON-317502035 tempest-ImagesMetadataTestJSON-317502035-project] Getting quotas for project efb9e6629f9f42fe96f757214f538f5a. Resources: dict_keys(['metadata_items']) {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:54:00.779650 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-dffc6702-94b6-4a35-9753-0c75edb6c3e1 tempest-ImagesMetadataTestJSON-317502035 tempest-ImagesMetadataTestJSON-317502035-project] Getting quotas for user 0c0dc124415f42799e788b4489a23afa and project efb9e6629f9f42fe96f757214f538f5a. Resources: dict_keys(['metadata_items']) {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:54:01.042646 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-a127069e-6e68-46b0-ab4a-0b3d0484fe83 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dac2a95483d4be99f06a2aeeb379339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8014941eeb974f0bb3a4d26a65346f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:54:01.085343 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-a127069e-6e68-46b0-ab4a-0b3d0484fe83 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] 10.222.0.50 "GET /compute/v2.1/servers/2a0c8868-b8d4-494c-b716-d637d1320340" status: 200 len: 1280 microversion: 2.1 time: 0.719185 Aug 10 17:54:01.099205 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 615/1235] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:54:00 2022] GET /compute/v2.1/servers/2a0c8868-b8d4-494c-b716-d637d1320340 => generated 1280 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:54:01.109174 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-d2f5597a-b9c7-4248-b8b7-1d383bb8bdcf tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:54:01.109797 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-d2f5597a-b9c7-4248-b8b7-1d383bb8bdcf tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: 0d821054-dce7-4015-8eaa-d8c56e7c3cd3] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:54:01.151493 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d2f5597a-b9c7-4248-b8b7-1d383bb8bdcf tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:01.153877 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d2f5597a-b9c7-4248-b8b7-1d383bb8bdcf tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:01.160990 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d2f5597a-b9c7-4248-b8b7-1d383bb8bdcf tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:01.162196 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d2f5597a-b9c7-4248-b8b7-1d383bb8bdcf tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:01.162889 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d2f5597a-b9c7-4248-b8b7-1d383bb8bdcf tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:01.163547 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d2f5597a-b9c7-4248-b8b7-1d383bb8bdcf tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:01.202218 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-d2f5597a-b9c7-4248-b8b7-1d383bb8bdcf tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] HTTP exception thrown: Instance 0d821054-dce7-4015-8eaa-d8c56e7c3cd3 could not be found. Aug 10 17:54:01.204074 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-d2f5597a-b9c7-4248-b8b7-1d383bb8bdcf tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Request method failure captured: Aug 10 17:54:01.204074 n-d-852296-2 devstack@n-api.service[129410]: request: GET /compute/v2.1/servers/0d821054-dce7-4015-8eaa-d8c56e7c3cd3 HTTP/1.1 Aug 10 17:54:01.204074 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 17:54:01.204074 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 17:54:01.204074 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 17:54:01.204074 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 0 Aug 10 17:54:01.204074 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 17:54:01.204074 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 17:54:01.204074 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 17:54:01.204074 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 17:54:01.204074 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8-_vb7x9x9F8-sP6h5pKdcrrsXpPJ2RlEbuCXnu2ZTWdSKtHarFJLe7Hjf1WLDt_yPDFFQT5gzj11kqkxwhqMHpazNhmqyhgrlC3SoXOue_P66sN7aOFIkgqmKczGGaSXM3e-yfy_FvawvLBNZry68s7Q1kz50eCpVoZBo2bvZ2yTNc Aug 10 17:54:01.204074 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 17:54:01.204074 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 17:54:01.204074 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 17:54:01.204074 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 17:54:01.204074 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 17:54:01.204074 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 17:54:01.204074 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: 0638146d08704b2983761619745290b3 Aug 10 17:54:01.204074 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-ServersOnMultiNodesTest-946016060 Aug 10 17:54:01.204074 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 17:54:01.204074 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 17:54:01.204074 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0638146d08704b2983761619745290b3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/0638146d08704b2983761619745290b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0638146d08704b2983761619745290b3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_0638146d08704b2983761619745290b3", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:54:01.204074 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-ServersOnMultiNodesTest-946016060 Aug 10 17:54:01.204074 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: 0638146d08704b2983761619745290b3 Aug 10 17:54:01.204074 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-946016060 Aug 10 17:54:01.204074 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-ServersOnMultiNodesTest-946016060-project Aug 10 17:54:01.204074 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 17:54:01.204074 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 17:54:01.204074 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: f76b870a54454956b3926c34f9f27442 Aug 10 17:54:01.204074 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-ServersOnMultiNodesTest-946016060-project Aug 10 17:54:01.204074 n-d-852296-2 devstack@n-api.service[129410]: method: > Aug 10 17:54:01.204074 n-d-852296-2 devstack@n-api.service[129410]: exception: Instance 0d821054-dce7-4015-8eaa-d8c56e7c3cd3 could not be found. Aug 10 17:54:01.204074 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'id': '0d821054-dce7-4015-8eaa-d8c56e7c3cd3'} Aug 10 17:54:01.204074 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:54:01.204074 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:01.204074 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 17:54:01.204074 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 17:54:01.204074 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 17:54:01.204074 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 17:54:01.204074 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 17:54:01.204074 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 17:54:01.204074 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 17:54:01.204074 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 17:54:01.204074 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d821054-dce7-4015-8eaa-d8c56e7c3cd3 could not be found. Aug 10 17:54:01.204074 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:54:01.204074 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:54:01.204074 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:54:01.204074 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:01.204074 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:54:01.204074 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:54:01.204074 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:54:01.204074 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:54:01.204074 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:54:01.204074 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:54:01.204074 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 17:54:01.204074 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 17:54:01.204074 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 17:54:01.204074 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 17:54:01.204074 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 17:54:01.204074 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:54:01.204074 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d821054-dce7-4015-8eaa-d8c56e7c3cd3 could not be found. Aug 10 17:54:01.204074 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:54:01.204074 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:54:01.204074 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:54:01.209453 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:01.209453 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:54:01.209453 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:54:01.209453 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:54:01.209453 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:54:01.209453 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d821054-dce7-4015-8eaa-d8c56e7c3cd3 could not be found. Aug 10 17:54:01.209453 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:54:01.209453 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-d2f5597a-b9c7-4248-b8b7-1d383bb8bdcf tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Returning 404 to user: Instance 0d821054-dce7-4015-8eaa-d8c56e7c3cd3 could not be found. {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:54:01.210608 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-d2f5597a-b9c7-4248-b8b7-1d383bb8bdcf tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/0d821054-dce7-4015-8eaa-d8c56e7c3cd3" status: 404 len: 111 microversion: 2.1 time: 0.110320 Aug 10 17:54:01.215443 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 616/1236] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:54:01 2022] GET /compute/v2.1/servers/0d821054-dce7-4015-8eaa-d8c56e7c3cd3 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:54:01.230156 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [req-1fcea276-d2b0-493e-abad-d6f2437cb0f9 req-0d158e8f-3fe0-4c63-8012-3601849c1467 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83268d7f-5375-4b01-9b5c-519be7daf0a4", "name": "network-vif-deleted", "tag": "7e62831c-3860-4779-a6c1-a2c8317ac744"}]} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:54:01.268507 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-1fcea276-d2b0-493e-abad-d6f2437cb0f9 req-0d158e8f-3fe0-4c63-8012-3601849c1467 service nova] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:01.269176 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-1fcea276-d2b0-493e-abad-d6f2437cb0f9 req-0d158e8f-3fe0-4c63-8012-3601849c1467 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:01.272611 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-1fcea276-d2b0-493e-abad-d6f2437cb0f9 req-0d158e8f-3fe0-4c63-8012-3601849c1467 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:01.302615 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.compute.server_external_events [req-1fcea276-d2b0-493e-abad-d6f2437cb0f9 req-0d158e8f-3fe0-4c63-8012-3601849c1467 service nova] Creating event network-vif-deleted:7e62831c-3860-4779-a6c1-a2c8317ac744 for instance 83268d7f-5375-4b01-9b5c-519be7daf0a4 on n-h1-852296-2 Aug 10 17:54:01.322104 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [req-1fcea276-d2b0-493e-abad-d6f2437cb0f9 req-0d158e8f-3fe0-4c63-8012-3601849c1467 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104283 Aug 10 17:54:01.323060 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 617/1237] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 10 17:54:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:54:01.330029 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-46c5fbcc-6b77-4135-884d-e18989437af1 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:54:01.333140 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-46c5fbcc-6b77-4135-884d-e18989437af1 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: 83268d7f-5375-4b01-9b5c-519be7daf0a4] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:54:01.350218 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-46c5fbcc-6b77-4135-884d-e18989437af1 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:01.351085 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-46c5fbcc-6b77-4135-884d-e18989437af1 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:01.353320 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-46c5fbcc-6b77-4135-884d-e18989437af1 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:01.355926 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-46c5fbcc-6b77-4135-884d-e18989437af1 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:01.356717 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-46c5fbcc-6b77-4135-884d-e18989437af1 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:01.360938 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-46c5fbcc-6b77-4135-884d-e18989437af1 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:01.397311 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-46c5fbcc-6b77-4135-884d-e18989437af1 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] HTTP exception thrown: Instance 83268d7f-5375-4b01-9b5c-519be7daf0a4 could not be found. Aug 10 17:54:01.400499 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-46c5fbcc-6b77-4135-884d-e18989437af1 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Request method failure captured: Aug 10 17:54:01.400499 n-d-852296-2 devstack@n-api.service[129410]: request: GET /compute/v2.1/servers/83268d7f-5375-4b01-9b5c-519be7daf0a4 HTTP/1.1 Aug 10 17:54:01.400499 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 17:54:01.400499 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 17:54:01.400499 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 17:54:01.400499 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 0 Aug 10 17:54:01.400499 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 17:54:01.400499 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 17:54:01.400499 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 17:54:01.400499 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 17:54:01.400499 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8-_vb7x9x9F8-sP6h5pKdcrrsXpPJ2RlEbuCXnu2ZTWdSKtHarFJLe7Hjf1WLDt_yPDFFQT5gzj11kqkxwhqMHpazNhmqyhgrlC3SoXOue_P66sN7aOFIkgqmKczGGaSXM3e-yfy_FvawvLBNZry68s7Q1kz50eCpVoZBo2bvZ2yTNc Aug 10 17:54:01.400499 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 17:54:01.400499 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 17:54:01.400499 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 17:54:01.400499 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 17:54:01.400499 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 17:54:01.400499 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 17:54:01.400499 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: 0638146d08704b2983761619745290b3 Aug 10 17:54:01.400499 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-ServersOnMultiNodesTest-946016060 Aug 10 17:54:01.400499 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 17:54:01.400499 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 17:54:01.400499 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0638146d08704b2983761619745290b3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/0638146d08704b2983761619745290b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0638146d08704b2983761619745290b3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_0638146d08704b2983761619745290b3", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:54:01.400499 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-ServersOnMultiNodesTest-946016060 Aug 10 17:54:01.400499 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: 0638146d08704b2983761619745290b3 Aug 10 17:54:01.400499 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-946016060 Aug 10 17:54:01.400499 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-ServersOnMultiNodesTest-946016060-project Aug 10 17:54:01.400499 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 17:54:01.400499 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 17:54:01.400499 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: f76b870a54454956b3926c34f9f27442 Aug 10 17:54:01.400499 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-ServersOnMultiNodesTest-946016060-project Aug 10 17:54:01.400499 n-d-852296-2 devstack@n-api.service[129410]: method: > Aug 10 17:54:01.400499 n-d-852296-2 devstack@n-api.service[129410]: exception: Instance 83268d7f-5375-4b01-9b5c-519be7daf0a4 could not be found. Aug 10 17:54:01.400499 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'id': '83268d7f-5375-4b01-9b5c-519be7daf0a4'} Aug 10 17:54:01.400499 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:54:01.400499 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:01.400499 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 17:54:01.400499 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 17:54:01.400499 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 17:54:01.400499 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 17:54:01.400499 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 17:54:01.400499 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 17:54:01.400499 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 17:54:01.400499 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 17:54:01.400499 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83268d7f-5375-4b01-9b5c-519be7daf0a4 could not be found. Aug 10 17:54:01.400499 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:54:01.400499 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:54:01.400499 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:54:01.400499 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:01.400499 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:54:01.400499 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:54:01.400499 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:54:01.400499 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:54:01.400499 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:54:01.400499 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:54:01.400499 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 17:54:01.400499 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 17:54:01.400499 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 17:54:01.400499 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 17:54:01.400499 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 17:54:01.400499 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:54:01.400499 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83268d7f-5375-4b01-9b5c-519be7daf0a4 could not be found. Aug 10 17:54:01.400499 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:54:01.400499 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:54:01.400499 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:54:01.408193 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:01.408193 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:54:01.408193 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:54:01.408193 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:54:01.408193 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:54:01.408193 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83268d7f-5375-4b01-9b5c-519be7daf0a4 could not be found. Aug 10 17:54:01.408193 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:54:01.415773 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-46c5fbcc-6b77-4135-884d-e18989437af1 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Returning 404 to user: Instance 83268d7f-5375-4b01-9b5c-519be7daf0a4 could not be found. {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:54:01.415773 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-46c5fbcc-6b77-4135-884d-e18989437af1 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/83268d7f-5375-4b01-9b5c-519be7daf0a4" status: 404 len: 111 microversion: 2.1 time: 0.089823 Aug 10 17:54:01.421575 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 618/1238] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:54:01 2022] GET /compute/v2.1/servers/83268d7f-5375-4b01-9b5c-519be7daf0a4 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:54:01.427099 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-7310d597-6efc-4ecb-b232-f45586b9a95f tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:54:01.434695 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-7310d597-6efc-4ecb-b232-f45586b9a95f tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] [instance: bee3148a-3834-41bd-99e7-b5da75217256] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:54:01.449384 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-7310d597-6efc-4ecb-b232-f45586b9a95f tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:01.449384 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-7310d597-6efc-4ecb-b232-f45586b9a95f tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:01.449384 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-7310d597-6efc-4ecb-b232-f45586b9a95f tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:01.452261 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-7310d597-6efc-4ecb-b232-f45586b9a95f tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:01.454730 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-7310d597-6efc-4ecb-b232-f45586b9a95f tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:01.455456 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-7310d597-6efc-4ecb-b232-f45586b9a95f tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:01.571441 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-7310d597-6efc-4ecb-b232-f45586b9a95f tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2fd6acf18d4218ad143ccee2d0bb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7c2481a908406fa9c4562513fff665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:54:01.580037 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-7310d597-6efc-4ecb-b232-f45586b9a95f tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] 10.222.0.50 "GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256" status: 200 len: 1426 microversion: 2.1 time: 0.156639 Aug 10 17:54:01.589716 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 619/1239] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:54:01 2022] GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256 => generated 1426 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:54:01.603278 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-f4bab281-8c01-42e1-bf06-617f8e4d2507 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:54:01.614951 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-dffc6702-94b6-4a35-9753-0c75edb6c3e1 tempest-ImagesMetadataTestJSON-317502035 tempest-ImagesMetadataTestJSON-317502035-project] 10.222.0.50 "PUT /compute/v2.1/images/6ad0a7b7-7276-4c8b-bc0c-3a4c43436327/metadata" status: 200 len: 61 microversion: 2.1 time: 1.042613 Aug 10 17:54:01.616783 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 621/1240] 10.222.0.50 () {60 vars in 1280 bytes} [Wed Aug 10 17:54:00 2022] PUT /compute/v2.1/images/6ad0a7b7-7276-4c8b-bc0c-3a4c43436327/metadata => generated 61 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 17:54:01.627871 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-a630d951-76b9-4bf2-b291-8cee5ae685ab tempest-ImagesMetadataTestJSON-317502035 tempest-ImagesMetadataTestJSON-317502035-project] Action: 'create', calling method: .version_select at 0x7fb3460599d0>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:54:01.736036 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-a630d951-76b9-4bf2-b291-8cee5ae685ab tempest-ImagesMetadataTestJSON-317502035 tempest-ImagesMetadataTestJSON-317502035-project] Getting quotas for project efb9e6629f9f42fe96f757214f538f5a. Resources: dict_keys(['metadata_items']) {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:54:01.741937 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-f4bab281-8c01-42e1-bf06-617f8e4d2507 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "DELETE /compute/v2.1/os-server-groups/d19eb39d-b249-4bed-928d-da2a8027d1dc" status: 204 len: 0 microversion: 2.1 time: 0.143974 Aug 10 17:54:01.743164 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 620/1241] 10.222.0.50 () {58 vars in 1266 bytes} [Wed Aug 10 17:54:01 2022] DELETE /compute/v2.1/os-server-groups/d19eb39d-b249-4bed-928d-da2a8027d1dc => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 17:54:01.753685 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-0f87cf6c-1445-48f9-8dc2-8c8f787c2640 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:54:01.754434 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-0f87cf6c-1445-48f9-8dc2-8c8f787c2640 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: 6c7e2e8c-4638-4952-9474-acc6ef457abc] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:54:01.782750 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-0f87cf6c-1445-48f9-8dc2-8c8f787c2640 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:01.783119 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-a630d951-76b9-4bf2-b291-8cee5ae685ab tempest-ImagesMetadataTestJSON-317502035 tempest-ImagesMetadataTestJSON-317502035-project] Getting quotas for user 0c0dc124415f42799e788b4489a23afa and project efb9e6629f9f42fe96f757214f538f5a. Resources: dict_keys(['metadata_items']) {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:54:01.783849 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-0f87cf6c-1445-48f9-8dc2-8c8f787c2640 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:01.784811 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-0f87cf6c-1445-48f9-8dc2-8c8f787c2640 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:01.785779 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-0f87cf6c-1445-48f9-8dc2-8c8f787c2640 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:01.787238 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-0f87cf6c-1445-48f9-8dc2-8c8f787c2640 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:01.788275 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-0f87cf6c-1445-48f9-8dc2-8c8f787c2640 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:01.836740 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-0f87cf6c-1445-48f9-8dc2-8c8f787c2640 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: 6c7e2e8c-4638-4952-9474-acc6ef457abc] Going to try to terminate instance {{(pid=129410) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 17:54:02.270870 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-0f87cf6c-1445-48f9-8dc2-8c8f787c2640 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "DELETE /compute/v2.1/servers/6c7e2e8c-4638-4952-9474-acc6ef457abc" status: 204 len: 0 microversion: 2.1 time: 0.523014 Aug 10 17:54:02.271478 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 621/1242] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 10 17:54:01 2022] DELETE /compute/v2.1/servers/6c7e2e8c-4638-4952-9474-acc6ef457abc => generated 0 bytes in 525 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 17:54:02.280177 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-2cdf051a-e1ab-49b8-90c7-7bbb4305eb61 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:54:02.281813 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-2cdf051a-e1ab-49b8-90c7-7bbb4305eb61 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] [instance: 2a0c8868-b8d4-494c-b716-d637d1320340] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:54:02.327118 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2cdf051a-e1ab-49b8-90c7-7bbb4305eb61 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:02.339134 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2cdf051a-e1ab-49b8-90c7-7bbb4305eb61 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:02.339633 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2cdf051a-e1ab-49b8-90c7-7bbb4305eb61 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:02.340617 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2cdf051a-e1ab-49b8-90c7-7bbb4305eb61 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:02.341544 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2cdf051a-e1ab-49b8-90c7-7bbb4305eb61 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:02.346869 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2cdf051a-e1ab-49b8-90c7-7bbb4305eb61 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:02.600001 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-a630d951-76b9-4bf2-b291-8cee5ae685ab tempest-ImagesMetadataTestJSON-317502035 tempest-ImagesMetadataTestJSON-317502035-project] 10.222.0.50 "POST /compute/v2.1/images/6ad0a7b7-7276-4c8b-bc0c-3a4c43436327/metadata" status: 200 len: 85 microversion: 2.1 time: 0.976457 Aug 10 17:54:02.601160 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 622/1243] 10.222.0.50 () {60 vars in 1281 bytes} [Wed Aug 10 17:54:01 2022] POST /compute/v2.1/images/6ad0a7b7-7276-4c8b-bc0c-3a4c43436327/metadata => generated 85 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 17:54:02.607263 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-53e008b9-afed-440f-8a17-5169fc463bd6 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:54:02.608844 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-53e008b9-afed-440f-8a17-5169fc463bd6 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: f174eccc-36df-40a9-9831-0fb5848664ba] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:54:02.625189 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-53e008b9-afed-440f-8a17-5169fc463bd6 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:02.626332 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-53e008b9-afed-440f-8a17-5169fc463bd6 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:02.626947 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-53e008b9-afed-440f-8a17-5169fc463bd6 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:02.628486 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-53e008b9-afed-440f-8a17-5169fc463bd6 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:02.630211 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-53e008b9-afed-440f-8a17-5169fc463bd6 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:02.631372 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-53e008b9-afed-440f-8a17-5169fc463bd6 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:02.691819 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-53e008b9-afed-440f-8a17-5169fc463bd6 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: f174eccc-36df-40a9-9831-0fb5848664ba] Going to try to terminate instance {{(pid=129409) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 17:54:02.728625 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_cell0:SELECT=2 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:54:03.102249 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-53e008b9-afed-440f-8a17-5169fc463bd6 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "DELETE /compute/v2.1/servers/f174eccc-36df-40a9-9831-0fb5848664ba" status: 204 len: 0 microversion: 2.1 time: 0.499152 Aug 10 17:54:03.104315 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 623/1244] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 10 17:54:02 2022] DELETE /compute/v2.1/servers/f174eccc-36df-40a9-9831-0fb5848664ba => generated 0 bytes in 502 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 17:54:03.115376 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-73269fed-5321-462b-85ce-dafe3e270195 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:54:03.119219 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-73269fed-5321-462b-85ce-dafe3e270195 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] [instance: bee3148a-3834-41bd-99e7-b5da75217256] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:54:03.141536 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-73269fed-5321-462b-85ce-dafe3e270195 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:03.143734 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-73269fed-5321-462b-85ce-dafe3e270195 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:03.146471 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-73269fed-5321-462b-85ce-dafe3e270195 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:03.147233 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-73269fed-5321-462b-85ce-dafe3e270195 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:03.147709 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-73269fed-5321-462b-85ce-dafe3e270195 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:03.148141 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-73269fed-5321-462b-85ce-dafe3e270195 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:03.248469 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_api:UPDATE=4,nova_api:SELECT=96 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:54:03.262842 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-73269fed-5321-462b-85ce-dafe3e270195 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:03.264054 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-73269fed-5321-462b-85ce-dafe3e270195 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:03.264694 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-73269fed-5321-462b-85ce-dafe3e270195 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:03.265399 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.objects.instance [None req-73269fed-5321-462b-85ce-dafe3e270195 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lazy-loading 'fault' on Instance uuid bee3148a-3834-41bd-99e7-b5da75217256 {{(pid=129409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:54:03.371310 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-73269fed-5321-462b-85ce-dafe3e270195 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2fd6acf18d4218ad143ccee2d0bb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7c2481a908406fa9c4562513fff665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:54:03.381297 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-73269fed-5321-462b-85ce-dafe3e270195 tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] 10.222.0.50 "GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256" status: 200 len: 1303 microversion: 2.1 time: 0.275307 Aug 10 17:54:03.381888 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 624/1245] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:54:03 2022] GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256 => generated 1303 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:54:03.390203 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-b561af8b-0144-4b37-96c4-b8cf5ad86bd1 tempest-ImagesMetadataTestJSON-317502035 tempest-ImagesMetadataTestJSON-317502035-project] Calling method '.version_select at 0x7fb345f1be50>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:54:03.455871 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-b561af8b-0144-4b37-96c4-b8cf5ad86bd1 tempest-ImagesMetadataTestJSON-317502035 tempest-ImagesMetadataTestJSON-317502035-project] 10.222.0.50 "GET /compute/v2.1/images/6ad0a7b7-7276-4c8b-bc0c-3a4c43436327/metadata" status: 200 len: 85 microversion: 2.1 time: 0.072170 Aug 10 17:54:03.456769 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 625/1246] 10.222.0.50 () {58 vars in 1260 bytes} [Wed Aug 10 17:54:03 2022] GET /compute/v2.1/images/6ad0a7b7-7276-4c8b-bc0c-3a4c43436327/metadata => generated 85 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 17:54:03.465050 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-424ac9f2-259b-4ea9-87d1-442e6f5016e8 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:54:03.496393 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-424ac9f2-259b-4ea9-87d1-442e6f5016e8 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: 6c7e2e8c-4638-4952-9474-acc6ef457abc] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:54:03.528008 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-424ac9f2-259b-4ea9-87d1-442e6f5016e8 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:03.528129 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-424ac9f2-259b-4ea9-87d1-442e6f5016e8 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:03.528556 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-424ac9f2-259b-4ea9-87d1-442e6f5016e8 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:03.538677 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-424ac9f2-259b-4ea9-87d1-442e6f5016e8 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:03.539451 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-424ac9f2-259b-4ea9-87d1-442e6f5016e8 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:03.541899 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-424ac9f2-259b-4ea9-87d1-442e6f5016e8 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:03.821579 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-424ac9f2-259b-4ea9-87d1-442e6f5016e8 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:54:03.830336 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-424ac9f2-259b-4ea9-87d1-442e6f5016e8 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/6c7e2e8c-4638-4952-9474-acc6ef457abc" status: 200 len: 1473 microversion: 2.1 time: 0.370799 Aug 10 17:54:03.831600 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 626/1247] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:54:03 2022] GET /compute/v2.1/servers/6c7e2e8c-4638-4952-9474-acc6ef457abc => generated 1473 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:54:03.837176 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [req-192c32be-b239-409d-983b-41eb568dafe3 req-57ccb3ac-af9a-4339-a39e-ee685d593458 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bee3148a-3834-41bd-99e7-b5da75217256", "name": "network-vif-deleted", "tag": "2f16a409-b711-4b31-9eb5-9884dbbe9489"}]} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:54:03.849868 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-192c32be-b239-409d-983b-41eb568dafe3 req-57ccb3ac-af9a-4339-a39e-ee685d593458 service nova] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:03.850687 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-192c32be-b239-409d-983b-41eb568dafe3 req-57ccb3ac-af9a-4339-a39e-ee685d593458 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:03.851130 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-192c32be-b239-409d-983b-41eb568dafe3 req-57ccb3ac-af9a-4339-a39e-ee685d593458 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:03.919984 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.compute.server_external_events [req-192c32be-b239-409d-983b-41eb568dafe3 req-57ccb3ac-af9a-4339-a39e-ee685d593458 service nova] Creating event network-vif-deleted:2f16a409-b711-4b31-9eb5-9884dbbe9489 for instance bee3148a-3834-41bd-99e7-b5da75217256 on n-h2-852296-2 Aug 10 17:54:03.938284 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-2cdf051a-e1ab-49b8-90c7-7bbb4305eb61 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dac2a95483d4be99f06a2aeeb379339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8014941eeb974f0bb3a4d26a65346f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:54:03.948360 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [req-192c32be-b239-409d-983b-41eb568dafe3 req-57ccb3ac-af9a-4339-a39e-ee685d593458 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115389 Aug 10 17:54:03.949772 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-2cdf051a-e1ab-49b8-90c7-7bbb4305eb61 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] 10.222.0.50 "GET /compute/v2.1/servers/2a0c8868-b8d4-494c-b716-d637d1320340" status: 200 len: 1322 microversion: 2.1 time: 1.673101 Aug 10 17:54:03.951078 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 627/1248] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 10 17:54:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:54:03.952868 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 622/1249] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:54:02 2022] GET /compute/v2.1/servers/2a0c8868-b8d4-494c-b716-d637d1320340 => generated 1322 bytes in 1681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:54:04.410482 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-16921f99-2e0f-446f-be50-83d1fcbfceaf tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:54:04.411465 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-16921f99-2e0f-446f-be50-83d1fcbfceaf tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] [instance: bee3148a-3834-41bd-99e7-b5da75217256] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:54:04.425078 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-16921f99-2e0f-446f-be50-83d1fcbfceaf tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:04.426123 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-16921f99-2e0f-446f-be50-83d1fcbfceaf tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:04.427299 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-16921f99-2e0f-446f-be50-83d1fcbfceaf tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:04.428177 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-16921f99-2e0f-446f-be50-83d1fcbfceaf tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:04.428822 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-16921f99-2e0f-446f-be50-83d1fcbfceaf tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:04.429631 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-16921f99-2e0f-446f-be50-83d1fcbfceaf tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:04.452476 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [req-38f2d843-7c1f-43b7-9317-04779add015c req-9a48f503-d6c9-471a-ab7c-fddfb87dc7ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a0c8868-b8d4-494c-b716-d637d1320340", "tag": "450e9793-7d3c-4aff-a62a-01badf6fa11d"}]} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:54:04.489011 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-38f2d843-7c1f-43b7-9317-04779add015c req-9a48f503-d6c9-471a-ab7c-fddfb87dc7ab service nova] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:04.492674 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-38f2d843-7c1f-43b7-9317-04779add015c req-9a48f503-d6c9-471a-ab7c-fddfb87dc7ab service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:04.493522 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-38f2d843-7c1f-43b7-9317-04779add015c req-9a48f503-d6c9-471a-ab7c-fddfb87dc7ab service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:04.509791 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-16921f99-2e0f-446f-be50-83d1fcbfceaf tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] HTTP exception thrown: Instance bee3148a-3834-41bd-99e7-b5da75217256 could not be found. Aug 10 17:54:04.512774 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-16921f99-2e0f-446f-be50-83d1fcbfceaf tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Request method failure captured: Aug 10 17:54:04.512774 n-d-852296-2 devstack@n-api.service[129409]: request: GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256 HTTP/1.1 Aug 10 17:54:04.512774 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 17:54:04.512774 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 17:54:04.512774 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 17:54:04.512774 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 0 Aug 10 17:54:04.512774 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 17:54:04.512774 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 17:54:04.512774 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 17:54:04.512774 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 17:54:04.512774 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8_ATDuqUJcrY2G1NcAiR2K35RtyTwj8XOyzsgOdlms7E-Yi4db2DnRE4b_OTnceSzuTrQc9t-CzsQdrp68P4PChqFPB5pZHACMpcquu7mMlJ7wKiyjvUXZUUkvJa3m2iS-6_ZEeqkP8HDhDVtYG1XBBkQbjwy3new3R-j0JxuybWBIE Aug 10 17:54:04.512774 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 17:54:04.512774 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 17:54:04.512774 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 17:54:04.512774 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 17:54:04.512774 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 17:54:04.512774 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 17:54:04.512774 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: 6b7c2481a908406fa9c4562513fff665 Aug 10 17:54:04.512774 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-ServersAdminTestJSON-148547485 Aug 10 17:54:04.512774 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 17:54:04.512774 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 17:54:04.512774 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6b7c2481a908406fa9c4562513fff665"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6b7c2481a908406fa9c4562513fff665"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6b7c2481a908406fa9c4562513fff665"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6b7c2481a908406fa9c4562513fff665", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:54:04.512774 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-ServersAdminTestJSON-148547485 Aug 10 17:54:04.512774 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: 6b7c2481a908406fa9c4562513fff665 Aug 10 17:54:04.512774 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-ServersAdminTestJSON-148547485 Aug 10 17:54:04.512774 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-ServersAdminTestJSON-148547485-project Aug 10 17:54:04.512774 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 17:54:04.512774 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 17:54:04.512774 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: 1b2fd6acf18d4218ad143ccee2d0bb5b Aug 10 17:54:04.512774 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-ServersAdminTestJSON-148547485-project Aug 10 17:54:04.512774 n-d-852296-2 devstack@n-api.service[129409]: method: > Aug 10 17:54:04.512774 n-d-852296-2 devstack@n-api.service[129409]: exception: Instance bee3148a-3834-41bd-99e7-b5da75217256 could not be found. Aug 10 17:54:04.512774 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'id': 'bee3148a-3834-41bd-99e7-b5da75217256'} Aug 10 17:54:04.512774 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:54:04.512774 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:04.512774 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 17:54:04.512774 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 17:54:04.512774 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 17:54:04.512774 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 17:54:04.512774 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 17:54:04.512774 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 17:54:04.512774 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 17:54:04.512774 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 17:54:04.512774 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bee3148a-3834-41bd-99e7-b5da75217256 could not be found. Aug 10 17:54:04.512774 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:04.512774 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:54:04.512774 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:04.512774 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:04.512774 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:54:04.512774 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:54:04.512774 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:54:04.512774 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:54:04.512774 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:54:04.512774 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:54:04.512774 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 17:54:04.512774 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 17:54:04.512774 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 17:54:04.512774 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 17:54:04.512774 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 17:54:04.512774 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:54:04.512774 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bee3148a-3834-41bd-99e7-b5da75217256 could not be found. Aug 10 17:54:04.512774 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:04.512774 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:54:04.512774 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:04.517889 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:04.517889 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:54:04.517889 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:54:04.517889 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:54:04.517889 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:54:04.517889 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bee3148a-3834-41bd-99e7-b5da75217256 could not be found. Aug 10 17:54:04.517889 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:04.526646 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-16921f99-2e0f-446f-be50-83d1fcbfceaf tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] Returning 404 to user: Instance bee3148a-3834-41bd-99e7-b5da75217256 could not be found. {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:54:04.527812 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-16921f99-2e0f-446f-be50-83d1fcbfceaf tempest-ServersAdminTestJSON-148547485 tempest-ServersAdminTestJSON-148547485-project] 10.222.0.50 "GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256" status: 404 len: 111 microversion: 2.1 time: 0.122702 Aug 10 17:54:04.530525 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 628/1250] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:54:04 2022] GET /compute/v2.1/servers/bee3148a-3834-41bd-99e7-b5da75217256 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:54:04.562193 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.compute.server_external_events [req-38f2d843-7c1f-43b7-9317-04779add015c req-9a48f503-d6c9-471a-ab7c-fddfb87dc7ab service nova] Creating event network-changed:450e9793-7d3c-4aff-a62a-01badf6fa11d for instance 2a0c8868-b8d4-494c-b716-d637d1320340 on n-h1-852296-2 Aug 10 17:54:04.575942 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [req-38f2d843-7c1f-43b7-9317-04779add015c req-9a48f503-d6c9-471a-ab7c-fddfb87dc7ab service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132964 Aug 10 17:54:04.578767 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 623/1251] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 10 17:54:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:54:04.858323 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-41ae265d-709e-4b07-a851-2a28511c25cc tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:54:04.859684 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-41ae265d-709e-4b07-a851-2a28511c25cc tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: 6c7e2e8c-4638-4952-9474-acc6ef457abc] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:54:04.871927 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-41ae265d-709e-4b07-a851-2a28511c25cc tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:04.872731 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-41ae265d-709e-4b07-a851-2a28511c25cc tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:04.874978 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-41ae265d-709e-4b07-a851-2a28511c25cc tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:04.876068 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-41ae265d-709e-4b07-a851-2a28511c25cc tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:04.878281 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-41ae265d-709e-4b07-a851-2a28511c25cc tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:04.888622 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-41ae265d-709e-4b07-a851-2a28511c25cc tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:04.976391 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-2bcbf53b-692b-4198-b60c-b47b875f74da tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:54:04.980043 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-2bcbf53b-692b-4198-b60c-b47b875f74da tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] [instance: 2a0c8868-b8d4-494c-b716-d637d1320340] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:54:04.990724 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2bcbf53b-692b-4198-b60c-b47b875f74da tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:04.991467 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2bcbf53b-692b-4198-b60c-b47b875f74da tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:04.992073 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2bcbf53b-692b-4198-b60c-b47b875f74da tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:04.999270 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2bcbf53b-692b-4198-b60c-b47b875f74da tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:05.000187 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2bcbf53b-692b-4198-b60c-b47b875f74da tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:05.000854 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2bcbf53b-692b-4198-b60c-b47b875f74da tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:05.293777 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-2bcbf53b-692b-4198-b60c-b47b875f74da tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dac2a95483d4be99f06a2aeeb379339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8014941eeb974f0bb3a4d26a65346f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:54:05.306389 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-2bcbf53b-692b-4198-b60c-b47b875f74da tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] 10.222.0.50 "GET /compute/v2.1/servers/2a0c8868-b8d4-494c-b716-d637d1320340" status: 200 len: 1322 microversion: 2.1 time: 0.333062 Aug 10 17:54:05.307733 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 624/1252] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:54:04 2022] GET /compute/v2.1/servers/2a0c8868-b8d4-494c-b716-d637d1320340 => generated 1322 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:54:06.282463 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-41ae265d-709e-4b07-a851-2a28511c25cc tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:54:06.304678 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-41ae265d-709e-4b07-a851-2a28511c25cc tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/6c7e2e8c-4638-4952-9474-acc6ef457abc" status: 200 len: 1473 microversion: 2.1 time: 1.451976 Aug 10 17:54:06.318562 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 629/1253] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:54:04 2022] GET /compute/v2.1/servers/6c7e2e8c-4638-4952-9474-acc6ef457abc => generated 1473 bytes in 1466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:54:06.339389 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-7ae7d951-ce23-477e-b2da-551c59055227 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:54:06.340025 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-7ae7d951-ce23-477e-b2da-551c59055227 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] [instance: 2a0c8868-b8d4-494c-b716-d637d1320340] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:54:06.360535 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-7ae7d951-ce23-477e-b2da-551c59055227 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:06.361040 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-7ae7d951-ce23-477e-b2da-551c59055227 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:06.361483 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-7ae7d951-ce23-477e-b2da-551c59055227 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:06.362204 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-7ae7d951-ce23-477e-b2da-551c59055227 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:06.362665 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-7ae7d951-ce23-477e-b2da-551c59055227 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:06.371786 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-7ae7d951-ce23-477e-b2da-551c59055227 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:07.329542 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [req-660f639d-b27d-434e-9634-0889901b399f req-ffb0fc86-37f2-4d7e-9c3e-caa4cce49e7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c7e2e8c-4638-4952-9474-acc6ef457abc", "name": "network-vif-deleted", "tag": "c1c98211-758c-4205-9ef2-cb54d2f38b9a"}]} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:54:07.353942 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-660f639d-b27d-434e-9634-0889901b399f req-ffb0fc86-37f2-4d7e-9c3e-caa4cce49e7f service nova] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:07.362505 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-660f639d-b27d-434e-9634-0889901b399f req-ffb0fc86-37f2-4d7e-9c3e-caa4cce49e7f service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:07.364186 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-660f639d-b27d-434e-9634-0889901b399f req-ffb0fc86-37f2-4d7e-9c3e-caa4cce49e7f service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:07.407527 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.compute.server_external_events [req-660f639d-b27d-434e-9634-0889901b399f req-ffb0fc86-37f2-4d7e-9c3e-caa4cce49e7f service nova] Creating event network-vif-deleted:c1c98211-758c-4205-9ef2-cb54d2f38b9a for instance 6c7e2e8c-4638-4952-9474-acc6ef457abc on n-h1-852296-2 Aug 10 17:54:07.427013 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [req-660f639d-b27d-434e-9634-0889901b399f req-ffb0fc86-37f2-4d7e-9c3e-caa4cce49e7f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105052 Aug 10 17:54:07.429617 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 630/1254] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 10 17:54:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:54:07.434478 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-7ae7d951-ce23-477e-b2da-551c59055227 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dac2a95483d4be99f06a2aeeb379339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8014941eeb974f0bb3a4d26a65346f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:54:07.451693 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-a3c169c2-a21a-4668-8406-c9a0e58dfde8 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:54:07.453499 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-a3c169c2-a21a-4668-8406-c9a0e58dfde8 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: 6c7e2e8c-4638-4952-9474-acc6ef457abc] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:54:07.456661 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-7ae7d951-ce23-477e-b2da-551c59055227 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] 10.222.0.50 "GET /compute/v2.1/servers/2a0c8868-b8d4-494c-b716-d637d1320340" status: 200 len: 1322 microversion: 2.1 time: 1.121734 Aug 10 17:54:07.468289 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 625/1255] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:54:06 2022] GET /compute/v2.1/servers/2a0c8868-b8d4-494c-b716-d637d1320340 => generated 1322 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:54:07.489294 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a3c169c2-a21a-4668-8406-c9a0e58dfde8 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:07.490549 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a3c169c2-a21a-4668-8406-c9a0e58dfde8 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:07.491011 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a3c169c2-a21a-4668-8406-c9a0e58dfde8 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:07.493691 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a3c169c2-a21a-4668-8406-c9a0e58dfde8 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:07.495421 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a3c169c2-a21a-4668-8406-c9a0e58dfde8 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:07.496737 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a3c169c2-a21a-4668-8406-c9a0e58dfde8 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:08.157425 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-a3c169c2-a21a-4668-8406-c9a0e58dfde8 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:54:08.168700 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-a3c169c2-a21a-4668-8406-c9a0e58dfde8 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/6c7e2e8c-4638-4952-9474-acc6ef457abc" status: 200 len: 1431 microversion: 2.1 time: 0.735581 Aug 10 17:54:08.184416 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [req-a6efe791-b788-41d1-a3f6-e3be27ffb8c1 req-49bb1a01-4fb7-48ca-9c55-cf22b0f3caf4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f174eccc-36df-40a9-9831-0fb5848664ba", "name": "network-vif-deleted", "tag": "1a43209c-8ece-439a-9a58-8148b9b4a77c"}]} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:54:08.184665 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 631/1256] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:54:07 2022] GET /compute/v2.1/servers/6c7e2e8c-4638-4952-9474-acc6ef457abc => generated 1431 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:54:08.202416 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-a6efe791-b788-41d1-a3f6-e3be27ffb8c1 req-49bb1a01-4fb7-48ca-9c55-cf22b0f3caf4 service nova] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:08.203054 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-a6efe791-b788-41d1-a3f6-e3be27ffb8c1 req-49bb1a01-4fb7-48ca-9c55-cf22b0f3caf4 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:08.203508 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-a6efe791-b788-41d1-a3f6-e3be27ffb8c1 req-49bb1a01-4fb7-48ca-9c55-cf22b0f3caf4 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:08.235361 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.compute.server_external_events [req-a6efe791-b788-41d1-a3f6-e3be27ffb8c1 req-49bb1a01-4fb7-48ca-9c55-cf22b0f3caf4 service nova] Creating event network-vif-deleted:1a43209c-8ece-439a-9a58-8148b9b4a77c for instance f174eccc-36df-40a9-9831-0fb5848664ba on n-h1-852296-2 Aug 10 17:54:08.249684 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [req-a6efe791-b788-41d1-a3f6-e3be27ffb8c1 req-49bb1a01-4fb7-48ca-9c55-cf22b0f3caf4 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072747 Aug 10 17:54:08.255656 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 626/1257] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 10 17:54:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:54:08.495190 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-253f340a-66d7-4eb0-b0a3-d1497aae828c tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:54:08.495982 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-253f340a-66d7-4eb0-b0a3-d1497aae828c tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] [instance: 2a0c8868-b8d4-494c-b716-d637d1320340] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:54:08.510641 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-253f340a-66d7-4eb0-b0a3-d1497aae828c tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:08.511169 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-253f340a-66d7-4eb0-b0a3-d1497aae828c tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:08.511604 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-253f340a-66d7-4eb0-b0a3-d1497aae828c tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:08.512362 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-253f340a-66d7-4eb0-b0a3-d1497aae828c tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:08.513071 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-253f340a-66d7-4eb0-b0a3-d1497aae828c tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:08.513503 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-253f340a-66d7-4eb0-b0a3-d1497aae828c tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:09.117146 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-253f340a-66d7-4eb0-b0a3-d1497aae828c tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dac2a95483d4be99f06a2aeeb379339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8014941eeb974f0bb3a4d26a65346f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:54:09.127697 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-253f340a-66d7-4eb0-b0a3-d1497aae828c tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] 10.222.0.50 "GET /compute/v2.1/servers/2a0c8868-b8d4-494c-b716-d637d1320340" status: 200 len: 1322 microversion: 2.1 time: 0.638306 Aug 10 17:54:09.136744 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 632/1258] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:54:08 2022] GET /compute/v2.1/servers/2a0c8868-b8d4-494c-b716-d637d1320340 => generated 1322 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:54:09.192301 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-1f02651a-43a3-4ca4-8c47-260a55e78ccb tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:54:09.193693 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-1f02651a-43a3-4ca4-8c47-260a55e78ccb tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: 6c7e2e8c-4638-4952-9474-acc6ef457abc] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:54:09.225419 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-1f02651a-43a3-4ca4-8c47-260a55e78ccb tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:09.231814 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-1f02651a-43a3-4ca4-8c47-260a55e78ccb tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:09.234816 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-1f02651a-43a3-4ca4-8c47-260a55e78ccb tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:09.238615 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-1f02651a-43a3-4ca4-8c47-260a55e78ccb tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:09.240774 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-1f02651a-43a3-4ca4-8c47-260a55e78ccb tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:09.244505 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-1f02651a-43a3-4ca4-8c47-260a55e78ccb tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:09.326955 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-1f02651a-43a3-4ca4-8c47-260a55e78ccb tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:09.327725 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-1f02651a-43a3-4ca4-8c47-260a55e78ccb tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:09.328389 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-1f02651a-43a3-4ca4-8c47-260a55e78ccb tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:09.329054 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.objects.instance [None req-1f02651a-43a3-4ca4-8c47-260a55e78ccb tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lazy-loading 'fault' on Instance uuid 6c7e2e8c-4638-4952-9474-acc6ef457abc {{(pid=129410) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:54:09.396518 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-1f02651a-43a3-4ca4-8c47-260a55e78ccb tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:54:09.401933 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:54:09.411559 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-1f02651a-43a3-4ca4-8c47-260a55e78ccb tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/6c7e2e8c-4638-4952-9474-acc6ef457abc" status: 200 len: 1308 microversion: 2.1 time: 0.224142 Aug 10 17:54:09.412439 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 627/1259] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:54:09 2022] GET /compute/v2.1/servers/6c7e2e8c-4638-4952-9474-acc6ef457abc => generated 1308 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:54:10.158700 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-a28794b8-5e9f-4c13-8088-6aadbc4bc956 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:54:10.160470 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-a28794b8-5e9f-4c13-8088-6aadbc4bc956 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] [instance: 2a0c8868-b8d4-494c-b716-d637d1320340] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:54:10.175685 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a28794b8-5e9f-4c13-8088-6aadbc4bc956 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:10.176639 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a28794b8-5e9f-4c13-8088-6aadbc4bc956 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:10.177188 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a28794b8-5e9f-4c13-8088-6aadbc4bc956 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:10.178013 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a28794b8-5e9f-4c13-8088-6aadbc4bc956 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:10.180816 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a28794b8-5e9f-4c13-8088-6aadbc4bc956 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:10.181600 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a28794b8-5e9f-4c13-8088-6aadbc4bc956 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:10.439999 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-6f8b0031-0dc8-4a99-a3eb-47b1c004bd09 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:54:10.440693 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-6f8b0031-0dc8-4a99-a3eb-47b1c004bd09 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: 6c7e2e8c-4638-4952-9474-acc6ef457abc] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:54:10.442723 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_cell0:SELECT=22 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:54:10.448914 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-6f8b0031-0dc8-4a99-a3eb-47b1c004bd09 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:10.449871 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-6f8b0031-0dc8-4a99-a3eb-47b1c004bd09 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:10.450490 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-6f8b0031-0dc8-4a99-a3eb-47b1c004bd09 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:10.451361 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-6f8b0031-0dc8-4a99-a3eb-47b1c004bd09 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:10.451977 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-6f8b0031-0dc8-4a99-a3eb-47b1c004bd09 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:10.452652 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-6f8b0031-0dc8-4a99-a3eb-47b1c004bd09 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:10.542256 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-6f8b0031-0dc8-4a99-a3eb-47b1c004bd09 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:10.542256 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-6f8b0031-0dc8-4a99-a3eb-47b1c004bd09 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:10.542256 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-6f8b0031-0dc8-4a99-a3eb-47b1c004bd09 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:10.545324 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.objects.instance [None req-6f8b0031-0dc8-4a99-a3eb-47b1c004bd09 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lazy-loading 'fault' on Instance uuid 6c7e2e8c-4638-4952-9474-acc6ef457abc {{(pid=129410) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:54:10.621826 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-6f8b0031-0dc8-4a99-a3eb-47b1c004bd09 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:54:10.632002 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-6f8b0031-0dc8-4a99-a3eb-47b1c004bd09 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/6c7e2e8c-4638-4952-9474-acc6ef457abc" status: 200 len: 1308 microversion: 2.1 time: 0.196636 Aug 10 17:54:10.634209 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 628/1260] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:54:10 2022] GET /compute/v2.1/servers/6c7e2e8c-4638-4952-9474-acc6ef457abc => generated 1308 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:54:10.851556 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-a28794b8-5e9f-4c13-8088-6aadbc4bc956 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dac2a95483d4be99f06a2aeeb379339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8014941eeb974f0bb3a4d26a65346f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:54:10.898982 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-a28794b8-5e9f-4c13-8088-6aadbc4bc956 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] 10.222.0.50 "GET /compute/v2.1/servers/2a0c8868-b8d4-494c-b716-d637d1320340" status: 200 len: 1322 microversion: 2.1 time: 0.747634 Aug 10 17:54:10.907844 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 633/1261] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:54:10 2022] GET /compute/v2.1/servers/2a0c8868-b8d4-494c-b716-d637d1320340 => generated 1322 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:54:11.667752 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-d61aac7e-2b8d-4dbd-8754-0efa136efaf8 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:54:11.667752 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-d61aac7e-2b8d-4dbd-8754-0efa136efaf8 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: 6c7e2e8c-4638-4952-9474-acc6ef457abc] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:54:11.677449 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d61aac7e-2b8d-4dbd-8754-0efa136efaf8 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:11.681025 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d61aac7e-2b8d-4dbd-8754-0efa136efaf8 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:11.683613 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d61aac7e-2b8d-4dbd-8754-0efa136efaf8 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:11.685349 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d61aac7e-2b8d-4dbd-8754-0efa136efaf8 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:11.688810 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d61aac7e-2b8d-4dbd-8754-0efa136efaf8 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:11.689903 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d61aac7e-2b8d-4dbd-8754-0efa136efaf8 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:11.720129 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-d61aac7e-2b8d-4dbd-8754-0efa136efaf8 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] HTTP exception thrown: Instance 6c7e2e8c-4638-4952-9474-acc6ef457abc could not be found. Aug 10 17:54:11.722154 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-d61aac7e-2b8d-4dbd-8754-0efa136efaf8 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Request method failure captured: Aug 10 17:54:11.722154 n-d-852296-2 devstack@n-api.service[129410]: request: GET /compute/v2.1/servers/6c7e2e8c-4638-4952-9474-acc6ef457abc HTTP/1.1 Aug 10 17:54:11.722154 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 17:54:11.722154 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 17:54:11.722154 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 17:54:11.722154 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 0 Aug 10 17:54:11.722154 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 17:54:11.722154 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 17:54:11.722154 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 17:54:11.722154 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 17:54:11.722154 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8-_vb7x9x9F8-sP6h5pKdcrrsXpPJ2RlEbuCXnu2ZTWdSKtHarFJLe7Hjf1WLDt_yPDFFQT5gzj11kqkxwhqMHpazNhmqyhgrlC3SoXOue_P66sN7aOFIkgqmKczGGaSXM3e-yfy_FvawvLBNZry68s7Q1kz50eCpVoZBo2bvZ2yTNc Aug 10 17:54:11.722154 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 17:54:11.722154 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 17:54:11.722154 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 17:54:11.722154 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 17:54:11.722154 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 17:54:11.722154 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 17:54:11.722154 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: 0638146d08704b2983761619745290b3 Aug 10 17:54:11.722154 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-ServersOnMultiNodesTest-946016060 Aug 10 17:54:11.722154 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 17:54:11.722154 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 17:54:11.722154 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0638146d08704b2983761619745290b3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/0638146d08704b2983761619745290b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0638146d08704b2983761619745290b3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_0638146d08704b2983761619745290b3", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:54:11.722154 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-ServersOnMultiNodesTest-946016060 Aug 10 17:54:11.722154 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: 0638146d08704b2983761619745290b3 Aug 10 17:54:11.722154 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-946016060 Aug 10 17:54:11.722154 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-ServersOnMultiNodesTest-946016060-project Aug 10 17:54:11.722154 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 17:54:11.722154 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 17:54:11.722154 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: f76b870a54454956b3926c34f9f27442 Aug 10 17:54:11.722154 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-ServersOnMultiNodesTest-946016060-project Aug 10 17:54:11.722154 n-d-852296-2 devstack@n-api.service[129410]: method: > Aug 10 17:54:11.722154 n-d-852296-2 devstack@n-api.service[129410]: exception: Instance 6c7e2e8c-4638-4952-9474-acc6ef457abc could not be found. Aug 10 17:54:11.722154 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'id': '6c7e2e8c-4638-4952-9474-acc6ef457abc'} Aug 10 17:54:11.722154 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:54:11.722154 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:11.722154 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 17:54:11.722154 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 17:54:11.722154 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 17:54:11.722154 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 17:54:11.722154 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 17:54:11.722154 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 17:54:11.722154 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 17:54:11.722154 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 17:54:11.722154 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c7e2e8c-4638-4952-9474-acc6ef457abc could not be found. Aug 10 17:54:11.722154 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:54:11.722154 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:54:11.722154 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:54:11.722154 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:11.722154 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:54:11.722154 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:54:11.722154 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:54:11.722154 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:54:11.722154 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:54:11.722154 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:54:11.722154 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 17:54:11.722154 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 17:54:11.722154 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 17:54:11.722154 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 17:54:11.722154 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 17:54:11.722154 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:54:11.722154 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c7e2e8c-4638-4952-9474-acc6ef457abc could not be found. Aug 10 17:54:11.722154 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:54:11.722154 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:54:11.722154 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:54:11.727568 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:11.727568 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:54:11.727568 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:54:11.727568 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:54:11.727568 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:54:11.727568 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c7e2e8c-4638-4952-9474-acc6ef457abc could not be found. Aug 10 17:54:11.727568 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:54:11.730334 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-d61aac7e-2b8d-4dbd-8754-0efa136efaf8 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Returning 404 to user: Instance 6c7e2e8c-4638-4952-9474-acc6ef457abc could not be found. {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:54:11.731604 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-d61aac7e-2b8d-4dbd-8754-0efa136efaf8 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/6c7e2e8c-4638-4952-9474-acc6ef457abc" status: 404 len: 111 microversion: 2.1 time: 0.072383 Aug 10 17:54:11.744333 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 629/1262] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:54:11 2022] GET /compute/v2.1/servers/6c7e2e8c-4638-4952-9474-acc6ef457abc => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:54:11.747056 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-c1196d71-2fec-4f5b-b1c8-b2ba6d94a7f5 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:54:11.747056 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-c1196d71-2fec-4f5b-b1c8-b2ba6d94a7f5 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: f174eccc-36df-40a9-9831-0fb5848664ba] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:54:11.759721 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c1196d71-2fec-4f5b-b1c8-b2ba6d94a7f5 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:11.760225 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c1196d71-2fec-4f5b-b1c8-b2ba6d94a7f5 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:11.761782 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c1196d71-2fec-4f5b-b1c8-b2ba6d94a7f5 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:11.763994 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c1196d71-2fec-4f5b-b1c8-b2ba6d94a7f5 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:11.764504 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c1196d71-2fec-4f5b-b1c8-b2ba6d94a7f5 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:11.764940 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c1196d71-2fec-4f5b-b1c8-b2ba6d94a7f5 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:11.805086 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_cell0:SELECT=22 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:54:11.807695 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-c1196d71-2fec-4f5b-b1c8-b2ba6d94a7f5 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] HTTP exception thrown: Instance f174eccc-36df-40a9-9831-0fb5848664ba could not be found. Aug 10 17:54:11.809802 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-c1196d71-2fec-4f5b-b1c8-b2ba6d94a7f5 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Request method failure captured: Aug 10 17:54:11.809802 n-d-852296-2 devstack@n-api.service[129409]: request: GET /compute/v2.1/servers/f174eccc-36df-40a9-9831-0fb5848664ba HTTP/1.1 Aug 10 17:54:11.809802 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 17:54:11.809802 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 17:54:11.809802 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 17:54:11.809802 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 0 Aug 10 17:54:11.809802 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 17:54:11.809802 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 17:54:11.809802 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 17:54:11.809802 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 17:54:11.809802 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8-_vb7x9x9F8-sP6h5pKdcrrsXpPJ2RlEbuCXnu2ZTWdSKtHarFJLe7Hjf1WLDt_yPDFFQT5gzj11kqkxwhqMHpazNhmqyhgrlC3SoXOue_P66sN7aOFIkgqmKczGGaSXM3e-yfy_FvawvLBNZry68s7Q1kz50eCpVoZBo2bvZ2yTNc Aug 10 17:54:11.809802 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 17:54:11.809802 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 17:54:11.809802 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 17:54:11.809802 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 17:54:11.809802 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 17:54:11.809802 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 17:54:11.809802 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: 0638146d08704b2983761619745290b3 Aug 10 17:54:11.809802 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-ServersOnMultiNodesTest-946016060 Aug 10 17:54:11.809802 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 17:54:11.809802 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 17:54:11.809802 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0638146d08704b2983761619745290b3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/0638146d08704b2983761619745290b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0638146d08704b2983761619745290b3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_0638146d08704b2983761619745290b3", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:54:11.809802 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-ServersOnMultiNodesTest-946016060 Aug 10 17:54:11.809802 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: 0638146d08704b2983761619745290b3 Aug 10 17:54:11.809802 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-946016060 Aug 10 17:54:11.809802 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-ServersOnMultiNodesTest-946016060-project Aug 10 17:54:11.809802 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 17:54:11.809802 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 17:54:11.809802 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: f76b870a54454956b3926c34f9f27442 Aug 10 17:54:11.809802 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-ServersOnMultiNodesTest-946016060-project Aug 10 17:54:11.809802 n-d-852296-2 devstack@n-api.service[129409]: method: > Aug 10 17:54:11.809802 n-d-852296-2 devstack@n-api.service[129409]: exception: Instance f174eccc-36df-40a9-9831-0fb5848664ba could not be found. Aug 10 17:54:11.809802 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'id': 'f174eccc-36df-40a9-9831-0fb5848664ba'} Aug 10 17:54:11.809802 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:54:11.809802 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:11.809802 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 17:54:11.809802 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 17:54:11.809802 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 17:54:11.809802 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 17:54:11.809802 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 17:54:11.809802 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 17:54:11.809802 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 17:54:11.809802 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 17:54:11.809802 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f174eccc-36df-40a9-9831-0fb5848664ba could not be found. Aug 10 17:54:11.809802 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:11.809802 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:54:11.809802 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:11.809802 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:11.809802 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:54:11.809802 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:54:11.809802 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:54:11.809802 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:54:11.809802 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:54:11.809802 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:54:11.809802 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 17:54:11.809802 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 17:54:11.809802 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 17:54:11.809802 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 17:54:11.809802 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 17:54:11.809802 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:54:11.809802 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f174eccc-36df-40a9-9831-0fb5848664ba could not be found. Aug 10 17:54:11.809802 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:11.809802 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:54:11.809802 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:11.814755 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:11.814755 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:54:11.814755 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:54:11.814755 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:54:11.814755 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:54:11.814755 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f174eccc-36df-40a9-9831-0fb5848664ba could not be found. Aug 10 17:54:11.814755 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:11.834905 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-c1196d71-2fec-4f5b-b1c8-b2ba6d94a7f5 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Returning 404 to user: Instance f174eccc-36df-40a9-9831-0fb5848664ba could not be found. {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:54:11.836357 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-c1196d71-2fec-4f5b-b1c8-b2ba6d94a7f5 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/f174eccc-36df-40a9-9831-0fb5848664ba" status: 404 len: 111 microversion: 2.1 time: 0.095728 Aug 10 17:54:11.840075 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 634/1263] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:54:11 2022] GET /compute/v2.1/servers/f174eccc-36df-40a9-9831-0fb5848664ba => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 17:54:11.850539 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-9e4f7023-94d3-4f23-a8a8-45377979bfda tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:54:11.930870 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-6eb73cfe-4ff1-4ba7-9a3e-37e47c223a87 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:54:11.932153 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-6eb73cfe-4ff1-4ba7-9a3e-37e47c223a87 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] [instance: 2a0c8868-b8d4-494c-b716-d637d1320340] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:54:11.959216 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-6eb73cfe-4ff1-4ba7-9a3e-37e47c223a87 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:11.959216 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-6eb73cfe-4ff1-4ba7-9a3e-37e47c223a87 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:11.959216 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-6eb73cfe-4ff1-4ba7-9a3e-37e47c223a87 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:11.967013 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-6eb73cfe-4ff1-4ba7-9a3e-37e47c223a87 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:11.968827 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-6eb73cfe-4ff1-4ba7-9a3e-37e47c223a87 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:11.969546 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-6eb73cfe-4ff1-4ba7-9a3e-37e47c223a87 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:12.006798 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:54:12.067354 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-9e4f7023-94d3-4f23-a8a8-45377979bfda tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "DELETE /compute/v2.1/os-server-groups/206e4d1a-3cdd-468f-8feb-a78dff8ee33c" status: 204 len: 0 microversion: 2.1 time: 0.223552 Aug 10 17:54:12.069551 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 630/1264] 10.222.0.50 () {58 vars in 1266 bytes} [Wed Aug 10 17:54:11 2022] DELETE /compute/v2.1/os-server-groups/206e4d1a-3cdd-468f-8feb-a78dff8ee33c => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 17:54:12.082523 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-328dd602-92bd-4656-85f4-7a3955172f67 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:54:12.091754 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-328dd602-92bd-4656-85f4-7a3955172f67 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: af745ef7-21f0-4149-ba68-33f45f73f2dd] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:54:12.127492 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-328dd602-92bd-4656-85f4-7a3955172f67 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:12.128038 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-328dd602-92bd-4656-85f4-7a3955172f67 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:12.131756 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-328dd602-92bd-4656-85f4-7a3955172f67 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:12.133705 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-328dd602-92bd-4656-85f4-7a3955172f67 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:12.135682 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-328dd602-92bd-4656-85f4-7a3955172f67 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:12.139017 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-328dd602-92bd-4656-85f4-7a3955172f67 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:12.247064 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-328dd602-92bd-4656-85f4-7a3955172f67 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: af745ef7-21f0-4149-ba68-33f45f73f2dd] Going to try to terminate instance {{(pid=129410) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 17:54:12.262874 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-6eb73cfe-4ff1-4ba7-9a3e-37e47c223a87 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dac2a95483d4be99f06a2aeeb379339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8014941eeb974f0bb3a4d26a65346f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:54:12.273362 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-6eb73cfe-4ff1-4ba7-9a3e-37e47c223a87 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] 10.222.0.50 "GET /compute/v2.1/servers/2a0c8868-b8d4-494c-b716-d637d1320340" status: 200 len: 1322 microversion: 2.1 time: 0.353981 Aug 10 17:54:12.286068 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 635/1265] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:54:11 2022] GET /compute/v2.1/servers/2a0c8868-b8d4-494c-b716-d637d1320340 => generated 1322 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:54:12.692888 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-328dd602-92bd-4656-85f4-7a3955172f67 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "DELETE /compute/v2.1/servers/af745ef7-21f0-4149-ba68-33f45f73f2dd" status: 204 len: 0 microversion: 2.1 time: 0.618710 Aug 10 17:54:12.699355 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 631/1266] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 10 17:54:12 2022] DELETE /compute/v2.1/servers/af745ef7-21f0-4149-ba68-33f45f73f2dd => generated 0 bytes in 623 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 17:54:12.706047 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-d60dc7f6-1b3d-4a9d-b33f-56fac6e381a7 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:54:12.706987 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-d60dc7f6-1b3d-4a9d-b33f-56fac6e381a7 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: af745ef7-21f0-4149-ba68-33f45f73f2dd] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:54:12.730225 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-d60dc7f6-1b3d-4a9d-b33f-56fac6e381a7 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:12.731158 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-d60dc7f6-1b3d-4a9d-b33f-56fac6e381a7 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:12.732043 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-d60dc7f6-1b3d-4a9d-b33f-56fac6e381a7 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:12.754481 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-d60dc7f6-1b3d-4a9d-b33f-56fac6e381a7 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:12.754481 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-d60dc7f6-1b3d-4a9d-b33f-56fac6e381a7 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:12.754481 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-d60dc7f6-1b3d-4a9d-b33f-56fac6e381a7 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:13.287344 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-d60dc7f6-1b3d-4a9d-b33f-56fac6e381a7 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:54:13.306998 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-d60dc7f6-1b3d-4a9d-b33f-56fac6e381a7 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/af745ef7-21f0-4149-ba68-33f45f73f2dd" status: 200 len: 1472 microversion: 2.1 time: 0.600065 Aug 10 17:54:13.306998 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 636/1267] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:54:12 2022] GET /compute/v2.1/servers/af745ef7-21f0-4149-ba68-33f45f73f2dd => generated 1472 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:54:13.323806 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-14fcd2ac-40cb-40ae-95f1-6ef224902251 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:54:13.325198 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-14fcd2ac-40cb-40ae-95f1-6ef224902251 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] [instance: 2a0c8868-b8d4-494c-b716-d637d1320340] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:54:13.345313 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-14fcd2ac-40cb-40ae-95f1-6ef224902251 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:13.351604 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-14fcd2ac-40cb-40ae-95f1-6ef224902251 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:13.352920 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-14fcd2ac-40cb-40ae-95f1-6ef224902251 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:13.353937 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-14fcd2ac-40cb-40ae-95f1-6ef224902251 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:13.358590 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-14fcd2ac-40cb-40ae-95f1-6ef224902251 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:13.361600 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-14fcd2ac-40cb-40ae-95f1-6ef224902251 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:13.393424 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-7891a355-de9e-4cf5-a94b-1b9f8aadfc63 tempest-QuotaClassesAdminTestJSON-1230798137 tempest-QuotaClassesAdminTestJSON-1230798137-project-admin] Calling method '.version_select at 0x7fb345b74790>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:54:13.395130 n-d-852296-2 devstack@n-api.service[129410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:54:13.395130 n-d-852296-2 devstack@n-api.service[129410]: warnings.warn(msg) Aug 10 17:54:13.422856 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-7891a355-de9e-4cf5-a94b-1b9f8aadfc63 tempest-QuotaClassesAdminTestJSON-1230798137 tempest-QuotaClassesAdminTestJSON-1230798137-project-admin] 10.222.0.50 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.711263 Aug 10 17:54:13.426108 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 632/1268] 10.222.0.50 () {58 vars in 1185 bytes} [Wed Aug 10 17:54:12 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:54:13.438780 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-55015a14-2e8b-4d1e-9d50-4d877d27e31a tempest-QuotaClassesAdminTestJSON-1230798137 tempest-QuotaClassesAdminTestJSON-1230798137-project-admin] Action: 'update', calling method: .version_select at 0x7fb345bc4940>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:54:13.442434 n-d-852296-2 devstack@n-api.service[129410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:54:13.442434 n-d-852296-2 devstack@n-api.service[129410]: warnings.warn(msg) Aug 10 17:54:13.604357 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-14fcd2ac-40cb-40ae-95f1-6ef224902251 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dac2a95483d4be99f06a2aeeb379339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8014941eeb974f0bb3a4d26a65346f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:54:13.624166 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-14fcd2ac-40cb-40ae-95f1-6ef224902251 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] 10.222.0.50 "GET /compute/v2.1/servers/2a0c8868-b8d4-494c-b716-d637d1320340" status: 200 len: 1322 microversion: 2.1 time: 0.308563 Aug 10 17:54:13.634402 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 637/1269] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:54:13 2022] GET /compute/v2.1/servers/2a0c8868-b8d4-494c-b716-d637d1320340 => generated 1322 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:54:14.223764 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_api:SELECT=82,nova_api:DELETE=6,nova_api:UPDATE=8,nova_api:INSERT=4 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:54:14.569856 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-9ad84d8f-292d-4d9c-b9a9-4b7f5cc32426 tempest-ImagesMetadataNegativeTestJSON-280812347 tempest-ImagesMetadataNegativeTestJSON-280812347-project] Calling method '.version_select at 0x7fb345f1b3a0>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:54:14.606530 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-9ad84d8f-292d-4d9c-b9a9-4b7f5cc32426 tempest-ImagesMetadataNegativeTestJSON-280812347 tempest-ImagesMetadataNegativeTestJSON-280812347-project] HTTP exception thrown: Image not found. Aug 10 17:54:14.649808 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-9ad84d8f-292d-4d9c-b9a9-4b7f5cc32426 tempest-ImagesMetadataNegativeTestJSON-280812347 tempest-ImagesMetadataNegativeTestJSON-280812347-project] Request method failure captured: Aug 10 17:54:14.649808 n-d-852296-2 devstack@n-api.service[129409]: request: DELETE /compute/v2.1/images/267a4532-655b-4803-88ec-5047c43892f6/metadata/os_distro HTTP/1.1 Aug 10 17:54:14.649808 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 17:54:14.649808 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 17:54:14.649808 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 17:54:14.649808 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 0 Aug 10 17:54:14.649808 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 17:54:14.649808 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 17:54:14.649808 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 17:54:14.649808 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 17:54:14.649808 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8_DFZmmNV1NbM-SqpqfR-W8j_6aFzq73le16EQSwbwYELv_m3-9TfvFi3iYvBjTNK_tKgVnOZnnhsAbNQVVBjUw2SxdNMrHNs3tCO5Ii9wlVpPgt31LTrGCWFlmed4jYm7he2UCTTzEn9958zOn7Xe_0aNCDyLZpgeopOBBWjO2czFc Aug 10 17:54:14.649808 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 17:54:14.649808 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 17:54:14.649808 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 17:54:14.649808 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 17:54:14.649808 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 17:54:14.649808 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 17:54:14.649808 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: aa974e28736c4704a6eb4d236ac9c553 Aug 10 17:54:14.649808 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-280812347 Aug 10 17:54:14.649808 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 17:54:14.649808 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 17:54:14.649808 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/aa974e28736c4704a6eb4d236ac9c553"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/aa974e28736c4704a6eb4d236ac9c553"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/aa974e28736c4704a6eb4d236ac9c553"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_aa974e28736c4704a6eb4d236ac9c553", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:54:14.649808 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-280812347 Aug 10 17:54:14.649808 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: aa974e28736c4704a6eb4d236ac9c553 Aug 10 17:54:14.649808 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-280812347 Aug 10 17:54:14.649808 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-ImagesMetadataNegativeTestJSON-280812347-project Aug 10 17:54:14.649808 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 17:54:14.649808 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 17:54:14.649808 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: cb252f65ad814b1eb190b8419de8508f Aug 10 17:54:14.649808 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-280812347-project Aug 10 17:54:14.649808 n-d-852296-2 devstack@n-api.service[129409]: method: Aug 10 17:54:14.649808 n-d-852296-2 devstack@n-api.service[129409]: exception: Image not found. Aug 10 17:54:14.649808 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'image_id': '267a4532-655b-4803-88ec-5047c43892f6', 'id': 'os_distro'} Aug 10 17:54:14.649808 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:54:14.649808 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:14.649808 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 10 17:54:14.649808 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 10 17:54:14.649808 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 10 17:54:14.649808 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 10 17:54:14.649808 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 10 17:54:14.649808 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 10 17:54:14.649808 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 10 17:54:14.649808 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 10 17:54:14.649808 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 10 17:54:14.649808 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 10 17:54:14.649808 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 10 17:54:14.649808 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 10 17:54:14.649808 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 10 17:54:14.649808 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 10 17:54:14.649808 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 10 17:54:14.649808 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 10 17:54:14.649808 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 267a4532-655b-4803-88ec-5047c43892f6 Aug 10 17:54:14.649808 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:14.649808 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:54:14.649808 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:14.649808 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:14.649808 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 10 17:54:14.649808 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 10 17:54:14.649808 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 10 17:54:14.649808 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 10 17:54:14.649808 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 10 17:54:14.649808 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 10 17:54:14.655480 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 10 17:54:14.655480 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 10 17:54:14.655480 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 10 17:54:14.655480 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 10 17:54:14.655480 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 10 17:54:14.655480 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 10 17:54:14.655480 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 10 17:54:14.655480 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 10 17:54:14.655480 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 10 17:54:14.655480 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 10 17:54:14.655480 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 10 17:54:14.655480 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 10 17:54:14.655480 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 10 17:54:14.655480 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 10 17:54:14.655480 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 10 17:54:14.655480 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 10 17:54:14.655480 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 10 17:54:14.655480 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 10 17:54:14.655480 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 267a4532-655b-4803-88ec-5047c43892f6 could not be found. Aug 10 17:54:14.655480 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:14.655480 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:54:14.655480 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:14.655480 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:14.655480 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:54:14.655480 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:54:14.655480 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:54:14.655480 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:54:14.655480 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 17:54:14.655480 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 17:54:14.655480 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:54:14.655480 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:54:14.655480 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Aug 10 17:54:14.655480 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 10 17:54:14.655480 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 10 17:54:14.655480 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 10 17:54:14.655480 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 10 17:54:14.655480 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:14.655480 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:54:14.655480 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:14.655480 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:14.655480 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:54:14.655480 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:54:14.655480 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:54:14.655480 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:54:14.655480 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 10 17:54:14.655480 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:14.655480 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-9ad84d8f-292d-4d9c-b9a9-4b7f5cc32426 tempest-ImagesMetadataNegativeTestJSON-280812347 tempest-ImagesMetadataNegativeTestJSON-280812347-project] Returning 404 to user: Image not found. {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:54:14.655480 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-9ad84d8f-292d-4d9c-b9a9-4b7f5cc32426 tempest-ImagesMetadataNegativeTestJSON-280812347 tempest-ImagesMetadataNegativeTestJSON-280812347-project] 10.222.0.50 "DELETE /compute/v2.1/images/267a4532-655b-4803-88ec-5047c43892f6/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.706279 Aug 10 17:54:14.655480 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 638/1270] 10.222.0.50 () {58 vars in 1293 bytes} [Wed Aug 10 17:54:13 2022] DELETE /compute/v2.1/images/267a4532-655b-4803-88ec-5047c43892f6/metadata/os_distro => generated 62 bytes in 707 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 10 17:54:14.655480 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-5393c7f2-94e4-4feb-af25-cc9e3b197207 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:54:14.661831 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-5393c7f2-94e4-4feb-af25-cc9e3b197207 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: af745ef7-21f0-4149-ba68-33f45f73f2dd] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:54:14.675348 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-5393c7f2-94e4-4feb-af25-cc9e3b197207 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:14.677459 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-5393c7f2-94e4-4feb-af25-cc9e3b197207 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:14.678710 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-5393c7f2-94e4-4feb-af25-cc9e3b197207 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:14.681317 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-5393c7f2-94e4-4feb-af25-cc9e3b197207 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:14.681906 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-5393c7f2-94e4-4feb-af25-cc9e3b197207 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:14.682351 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-5393c7f2-94e4-4feb-af25-cc9e3b197207 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:15.005566 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-5393c7f2-94e4-4feb-af25-cc9e3b197207 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:54:15.018611 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-5393c7f2-94e4-4feb-af25-cc9e3b197207 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/af745ef7-21f0-4149-ba68-33f45f73f2dd" status: 200 len: 1472 microversion: 2.1 time: 0.374384 Aug 10 17:54:15.029701 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 639/1271] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:54:14 2022] GET /compute/v2.1/servers/af745ef7-21f0-4149-ba68-33f45f73f2dd => generated 1472 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:54:15.045250 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-55015a14-2e8b-4d1e-9d50-4d877d27e31a tempest-QuotaClassesAdminTestJSON-1230798137 tempest-QuotaClassesAdminTestJSON-1230798137-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 1.610383 Aug 10 17:54:15.051793 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 633/1272] 10.222.0.50 () {60 vars in 1206 bytes} [Wed Aug 10 17:54:13 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 1612 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:54:15.064006 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-90374e53-a048-494a-8acc-eced6d7040ea tempest-ImagesMetadataNegativeTestJSON-280812347 tempest-ImagesMetadataNegativeTestJSON-280812347-project] Calling method '.version_select at 0x7fb345f1bdc0>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:54:15.073555 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-567d1762-ef5e-47b6-beb6-42562077a34f tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:54:15.075464 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-567d1762-ef5e-47b6-beb6-42562077a34f tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] [instance: 2a0c8868-b8d4-494c-b716-d637d1320340] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:54:15.096552 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-90374e53-a048-494a-8acc-eced6d7040ea tempest-ImagesMetadataNegativeTestJSON-280812347 tempest-ImagesMetadataNegativeTestJSON-280812347-project] HTTP exception thrown: Image not found. Aug 10 17:54:15.098776 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-567d1762-ef5e-47b6-beb6-42562077a34f tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:15.099371 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-567d1762-ef5e-47b6-beb6-42562077a34f tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:15.100598 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-567d1762-ef5e-47b6-beb6-42562077a34f tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:15.101341 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-567d1762-ef5e-47b6-beb6-42562077a34f tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:15.101638 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-90374e53-a048-494a-8acc-eced6d7040ea tempest-ImagesMetadataNegativeTestJSON-280812347 tempest-ImagesMetadataNegativeTestJSON-280812347-project] Request method failure captured: Aug 10 17:54:15.101638 n-d-852296-2 devstack@n-api.service[129409]: request: GET /compute/v2.1/images/6287c01e-1eab-4489-9cf1-04d4114b27af/metadata/os_version HTTP/1.1 Aug 10 17:54:15.101638 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 17:54:15.101638 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 17:54:15.101638 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 17:54:15.101638 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 0 Aug 10 17:54:15.101638 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 17:54:15.101638 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 17:54:15.101638 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 17:54:15.101638 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 17:54:15.101638 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8_DFZmmNV1NbM-SqpqfR-W8j_6aFzq73le16EQSwbwYELv_m3-9TfvFi3iYvBjTNK_tKgVnOZnnhsAbNQVVBjUw2SxdNMrHNs3tCO5Ii9wlVpPgt31LTrGCWFlmed4jYm7he2UCTTzEn9958zOn7Xe_0aNCDyLZpgeopOBBWjO2czFc Aug 10 17:54:15.101638 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 17:54:15.101638 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 17:54:15.101638 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 17:54:15.101638 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 17:54:15.101638 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 17:54:15.101638 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 17:54:15.101638 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: aa974e28736c4704a6eb4d236ac9c553 Aug 10 17:54:15.101638 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-280812347 Aug 10 17:54:15.101638 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 17:54:15.101638 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 17:54:15.101638 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/aa974e28736c4704a6eb4d236ac9c553"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/aa974e28736c4704a6eb4d236ac9c553"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/aa974e28736c4704a6eb4d236ac9c553"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_aa974e28736c4704a6eb4d236ac9c553", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:54:15.101638 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-280812347 Aug 10 17:54:15.101638 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: aa974e28736c4704a6eb4d236ac9c553 Aug 10 17:54:15.101638 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-280812347 Aug 10 17:54:15.101638 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-ImagesMetadataNegativeTestJSON-280812347-project Aug 10 17:54:15.101638 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 17:54:15.101638 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 17:54:15.101638 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: cb252f65ad814b1eb190b8419de8508f Aug 10 17:54:15.101638 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-280812347-project Aug 10 17:54:15.101638 n-d-852296-2 devstack@n-api.service[129409]: method: Aug 10 17:54:15.101638 n-d-852296-2 devstack@n-api.service[129409]: exception: Image not found. Aug 10 17:54:15.101638 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'image_id': '6287c01e-1eab-4489-9cf1-04d4114b27af', 'id': 'os_version'} Aug 10 17:54:15.101638 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:54:15.101638 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:15.101638 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 10 17:54:15.101638 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 10 17:54:15.101638 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 10 17:54:15.101638 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 10 17:54:15.101638 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 10 17:54:15.101638 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 10 17:54:15.101638 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 10 17:54:15.101638 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 10 17:54:15.101638 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 10 17:54:15.101638 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 10 17:54:15.101638 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 10 17:54:15.101638 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 10 17:54:15.101638 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 10 17:54:15.101638 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 10 17:54:15.101638 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 10 17:54:15.101638 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 10 17:54:15.101638 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 6287c01e-1eab-4489-9cf1-04d4114b27af Aug 10 17:54:15.101638 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:15.101638 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:54:15.101638 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:15.101638 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:15.101638 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 10 17:54:15.101638 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 10 17:54:15.101638 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 10 17:54:15.101638 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 10 17:54:15.101638 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 10 17:54:15.101638 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 10 17:54:15.106797 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 10 17:54:15.106797 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 10 17:54:15.106797 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 10 17:54:15.106797 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 10 17:54:15.106797 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 10 17:54:15.106797 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 10 17:54:15.106797 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 10 17:54:15.106797 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 10 17:54:15.106797 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 10 17:54:15.106797 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 10 17:54:15.106797 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 10 17:54:15.106797 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 10 17:54:15.106797 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 10 17:54:15.106797 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 10 17:54:15.106797 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 10 17:54:15.106797 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 10 17:54:15.106797 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 10 17:54:15.106797 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 10 17:54:15.106797 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 6287c01e-1eab-4489-9cf1-04d4114b27af could not be found. Aug 10 17:54:15.106797 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:15.106797 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:54:15.106797 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:15.106797 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:15.106797 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:54:15.106797 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:54:15.106797 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:54:15.106797 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:54:15.106797 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 17:54:15.106797 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 17:54:15.106797 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:54:15.106797 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:54:15.106797 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Aug 10 17:54:15.106797 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Aug 10 17:54:15.106797 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 10 17:54:15.106797 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 10 17:54:15.106797 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 10 17:54:15.106797 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:15.106797 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:54:15.106797 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:15.106797 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:15.106797 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:54:15.106797 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:54:15.106797 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:54:15.106797 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:54:15.106797 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 10 17:54:15.106797 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:15.110812 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-567d1762-ef5e-47b6-beb6-42562077a34f tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:15.110812 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-567d1762-ef5e-47b6-beb6-42562077a34f tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:15.113471 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-90374e53-a048-494a-8acc-eced6d7040ea tempest-ImagesMetadataNegativeTestJSON-280812347 tempest-ImagesMetadataNegativeTestJSON-280812347-project] Returning 404 to user: Image not found. {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:54:15.113471 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-90374e53-a048-494a-8acc-eced6d7040ea tempest-ImagesMetadataNegativeTestJSON-280812347 tempest-ImagesMetadataNegativeTestJSON-280812347-project] 10.222.0.50 "GET /compute/v2.1/images/6287c01e-1eab-4489-9cf1-04d4114b27af/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.079427 Aug 10 17:54:15.118499 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 640/1273] 10.222.0.50 () {58 vars in 1293 bytes} [Wed Aug 10 17:54:15 2022] GET /compute/v2.1/images/6287c01e-1eab-4489-9cf1-04d4114b27af/metadata/os_version => generated 62 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 10 17:54:15.127783 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [req-be4ed428-60b1-4994-b7a4-232aef758151 req-ded76aa2-3201-42dd-9576-22f2e998e4e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a0c8868-b8d4-494c-b716-d637d1320340", "name": "network-vif-plugged", "status": "completed", "tag": "450e9793-7d3c-4aff-a62a-01badf6fa11d"}]} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:54:15.151290 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-be4ed428-60b1-4994-b7a4-232aef758151 req-ded76aa2-3201-42dd-9576-22f2e998e4e2 service nova] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:15.152159 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-be4ed428-60b1-4994-b7a4-232aef758151 req-ded76aa2-3201-42dd-9576-22f2e998e4e2 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:15.152788 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-be4ed428-60b1-4994-b7a4-232aef758151 req-ded76aa2-3201-42dd-9576-22f2e998e4e2 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:15.194797 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.compute.server_external_events [req-be4ed428-60b1-4994-b7a4-232aef758151 req-ded76aa2-3201-42dd-9576-22f2e998e4e2 service nova] Creating event network-vif-plugged:450e9793-7d3c-4aff-a62a-01badf6fa11d for instance 2a0c8868-b8d4-494c-b716-d637d1320340 on n-h1-852296-2 Aug 10 17:54:15.203775 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [req-be4ed428-60b1-4994-b7a4-232aef758151 req-ded76aa2-3201-42dd-9576-22f2e998e4e2 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083691 Aug 10 17:54:15.204434 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 641/1274] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 10 17:54:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:54:15.215255 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-2087800b-a293-4bfb-a6d7-72d86b8ce40b tempest-QuotaClassesAdminTestJSON-1230798137 tempest-QuotaClassesAdminTestJSON-1230798137-project-admin] Calling method '.version_select at 0x7fb346178160>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:54:15.216545 n-d-852296-2 devstack@n-api.service[129409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:54:15.216545 n-d-852296-2 devstack@n-api.service[129409]: warnings.warn(msg) Aug 10 17:54:15.232938 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-2087800b-a293-4bfb-a6d7-72d86b8ce40b tempest-QuotaClassesAdminTestJSON-1230798137 tempest-QuotaClassesAdminTestJSON-1230798137-project-admin] 10.222.0.50 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.026309 Aug 10 17:54:15.234689 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 642/1275] 10.222.0.50 () {58 vars in 1185 bytes} [Wed Aug 10 17:54:15 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:54:15.242867 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-8d409f25-d183-4643-be74-7122bf9a16da tempest-ImagesMetadataNegativeTestJSON-280812347 tempest-ImagesMetadataNegativeTestJSON-280812347-project] Calling method '.version_select at 0x7fb345f1b8b0>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:54:15.274973 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-8d409f25-d183-4643-be74-7122bf9a16da tempest-ImagesMetadataNegativeTestJSON-280812347 tempest-ImagesMetadataNegativeTestJSON-280812347-project] HTTP exception thrown: Image not found. Aug 10 17:54:15.279568 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-8d409f25-d183-4643-be74-7122bf9a16da tempest-ImagesMetadataNegativeTestJSON-280812347 tempest-ImagesMetadataNegativeTestJSON-280812347-project] Request method failure captured: Aug 10 17:54:15.279568 n-d-852296-2 devstack@n-api.service[129409]: request: GET /compute/v2.1/images/dd8fd37e-54c0-4468-a81d-ab05c5915dc9/metadata HTTP/1.1 Aug 10 17:54:15.279568 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 17:54:15.279568 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 17:54:15.279568 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 17:54:15.279568 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 0 Aug 10 17:54:15.279568 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 17:54:15.279568 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 17:54:15.279568 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 17:54:15.279568 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 17:54:15.279568 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8_DFZmmNV1NbM-SqpqfR-W8j_6aFzq73le16EQSwbwYELv_m3-9TfvFi3iYvBjTNK_tKgVnOZnnhsAbNQVVBjUw2SxdNMrHNs3tCO5Ii9wlVpPgt31LTrGCWFlmed4jYm7he2UCTTzEn9958zOn7Xe_0aNCDyLZpgeopOBBWjO2czFc Aug 10 17:54:15.279568 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 17:54:15.279568 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 17:54:15.279568 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 17:54:15.279568 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 17:54:15.279568 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 17:54:15.279568 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 17:54:15.279568 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: aa974e28736c4704a6eb4d236ac9c553 Aug 10 17:54:15.279568 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-280812347 Aug 10 17:54:15.279568 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 17:54:15.279568 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 17:54:15.279568 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/aa974e28736c4704a6eb4d236ac9c553"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/aa974e28736c4704a6eb4d236ac9c553"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/aa974e28736c4704a6eb4d236ac9c553"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_aa974e28736c4704a6eb4d236ac9c553", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:54:15.279568 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-280812347 Aug 10 17:54:15.279568 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: aa974e28736c4704a6eb4d236ac9c553 Aug 10 17:54:15.279568 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-280812347 Aug 10 17:54:15.279568 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-ImagesMetadataNegativeTestJSON-280812347-project Aug 10 17:54:15.279568 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 17:54:15.279568 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 17:54:15.279568 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: cb252f65ad814b1eb190b8419de8508f Aug 10 17:54:15.279568 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-280812347-project Aug 10 17:54:15.279568 n-d-852296-2 devstack@n-api.service[129409]: method: Aug 10 17:54:15.279568 n-d-852296-2 devstack@n-api.service[129409]: exception: Image not found. Aug 10 17:54:15.279568 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'image_id': 'dd8fd37e-54c0-4468-a81d-ab05c5915dc9'} Aug 10 17:54:15.279568 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:54:15.279568 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:15.279568 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 10 17:54:15.279568 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 10 17:54:15.279568 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 10 17:54:15.279568 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 10 17:54:15.279568 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 10 17:54:15.279568 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 10 17:54:15.279568 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 10 17:54:15.279568 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 10 17:54:15.279568 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 10 17:54:15.279568 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 10 17:54:15.279568 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 10 17:54:15.279568 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 10 17:54:15.279568 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 10 17:54:15.279568 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 10 17:54:15.279568 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 10 17:54:15.279568 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 10 17:54:15.279568 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID dd8fd37e-54c0-4468-a81d-ab05c5915dc9 Aug 10 17:54:15.279568 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:15.279568 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:54:15.279568 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:15.279568 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:15.279568 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 10 17:54:15.279568 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 10 17:54:15.279568 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 10 17:54:15.279568 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 10 17:54:15.279568 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 10 17:54:15.279568 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 10 17:54:15.284324 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 10 17:54:15.284324 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 10 17:54:15.284324 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 10 17:54:15.284324 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 10 17:54:15.284324 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 10 17:54:15.284324 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 10 17:54:15.284324 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 10 17:54:15.284324 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 10 17:54:15.284324 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 10 17:54:15.284324 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 10 17:54:15.284324 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 10 17:54:15.284324 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 10 17:54:15.284324 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 10 17:54:15.284324 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 10 17:54:15.284324 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 10 17:54:15.284324 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 10 17:54:15.284324 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 10 17:54:15.284324 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 10 17:54:15.284324 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image dd8fd37e-54c0-4468-a81d-ab05c5915dc9 could not be found. Aug 10 17:54:15.284324 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:15.284324 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:54:15.284324 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:15.284324 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:15.284324 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:54:15.284324 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:54:15.284324 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:54:15.284324 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:54:15.284324 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 17:54:15.284324 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 17:54:15.284324 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:54:15.284324 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:54:15.284324 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Aug 10 17:54:15.284324 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Aug 10 17:54:15.284324 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 10 17:54:15.284324 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 10 17:54:15.284324 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 10 17:54:15.284324 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:15.284324 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:54:15.284324 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:15.284324 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:15.284324 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:54:15.284324 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:54:15.284324 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:54:15.284324 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:54:15.284324 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 10 17:54:15.284324 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:15.294145 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-8d409f25-d183-4643-be74-7122bf9a16da tempest-ImagesMetadataNegativeTestJSON-280812347 tempest-ImagesMetadataNegativeTestJSON-280812347-project] Returning 404 to user: Image not found. {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:54:15.295999 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-8d409f25-d183-4643-be74-7122bf9a16da tempest-ImagesMetadataNegativeTestJSON-280812347 tempest-ImagesMetadataNegativeTestJSON-280812347-project] 10.222.0.50 "GET /compute/v2.1/images/dd8fd37e-54c0-4468-a81d-ab05c5915dc9/metadata" status: 404 len: 62 microversion: 2.1 time: 0.059636 Aug 10 17:54:15.297329 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 643/1276] 10.222.0.50 () {58 vars in 1260 bytes} [Wed Aug 10 17:54:15 2022] GET /compute/v2.1/images/dd8fd37e-54c0-4468-a81d-ab05c5915dc9/metadata => generated 62 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 10 17:54:15.305790 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-7e64114d-4c1d-416a-88ec-9ac6f3ca4f82 tempest-QuotaClassesAdminTestJSON-1230798137 tempest-QuotaClassesAdminTestJSON-1230798137-project-admin] Action: 'update', calling method: .version_select at 0x7fb346015a60>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:54:15.312660 n-d-852296-2 devstack@n-api.service[129409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:54:15.312660 n-d-852296-2 devstack@n-api.service[129409]: warnings.warn(msg) Aug 10 17:54:15.534382 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-567d1762-ef5e-47b6-beb6-42562077a34f tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dac2a95483d4be99f06a2aeeb379339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8014941eeb974f0bb3a4d26a65346f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:54:15.545452 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-567d1762-ef5e-47b6-beb6-42562077a34f tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] 10.222.0.50 "GET /compute/v2.1/servers/2a0c8868-b8d4-494c-b716-d637d1320340" status: 200 len: 1322 microversion: 2.1 time: 0.495211 Aug 10 17:54:15.557022 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 634/1277] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:54:15 2022] GET /compute/v2.1/servers/2a0c8868-b8d4-494c-b716-d637d1320340 => generated 1322 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:54:15.576294 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-89c794ce-8bb6-4121-a40c-89b9ee9e5927 tempest-ImagesMetadataNegativeTestJSON-280812347 tempest-ImagesMetadataNegativeTestJSON-280812347-project] Action: 'update_all', calling method: .version_select at 0x7fb345b5fca0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:54:15.622202 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-89c794ce-8bb6-4121-a40c-89b9ee9e5927 tempest-ImagesMetadataNegativeTestJSON-280812347 tempest-ImagesMetadataNegativeTestJSON-280812347-project] HTTP exception thrown: Image not found. Aug 10 17:54:15.626236 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-89c794ce-8bb6-4121-a40c-89b9ee9e5927 tempest-ImagesMetadataNegativeTestJSON-280812347 tempest-ImagesMetadataNegativeTestJSON-280812347-project] Request method failure captured: Aug 10 17:54:15.626236 n-d-852296-2 devstack@n-api.service[129410]: request: PUT /compute/v2.1/images/13e8eec0-88e1-46ac-8aa5-6b8e17d753b3/metadata HTTP/1.1 Aug 10 17:54:15.626236 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 17:54:15.626236 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 17:54:15.626236 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 17:54:15.626236 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 57 Aug 10 17:54:15.626236 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 17:54:15.626236 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 17:54:15.626236 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 17:54:15.626236 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 17:54:15.626236 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8_DFZmmNV1NbM-SqpqfR-W8j_6aFzq73le16EQSwbwYELv_m3-9TfvFi3iYvBjTNK_tKgVnOZnnhsAbNQVVBjUw2SxdNMrHNs3tCO5Ii9wlVpPgt31LTrGCWFlmed4jYm7he2UCTTzEn9958zOn7Xe_0aNCDyLZpgeopOBBWjO2czFc Aug 10 17:54:15.626236 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 17:54:15.626236 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 17:54:15.626236 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 17:54:15.626236 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 17:54:15.626236 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 17:54:15.626236 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 17:54:15.626236 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: aa974e28736c4704a6eb4d236ac9c553 Aug 10 17:54:15.626236 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-280812347 Aug 10 17:54:15.626236 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 17:54:15.626236 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 17:54:15.626236 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/aa974e28736c4704a6eb4d236ac9c553"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/aa974e28736c4704a6eb4d236ac9c553"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/aa974e28736c4704a6eb4d236ac9c553"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_aa974e28736c4704a6eb4d236ac9c553", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:54:15.626236 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-280812347 Aug 10 17:54:15.626236 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: aa974e28736c4704a6eb4d236ac9c553 Aug 10 17:54:15.626236 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-280812347 Aug 10 17:54:15.626236 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-ImagesMetadataNegativeTestJSON-280812347-project Aug 10 17:54:15.626236 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 17:54:15.626236 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 17:54:15.626236 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: cb252f65ad814b1eb190b8419de8508f Aug 10 17:54:15.626236 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-280812347-project Aug 10 17:54:15.626236 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 17:54:15.626236 n-d-852296-2 devstack@n-api.service[129410]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Aug 10 17:54:15.626236 n-d-852296-2 devstack@n-api.service[129410]: method: Aug 10 17:54:15.626236 n-d-852296-2 devstack@n-api.service[129410]: exception: Image not found. Aug 10 17:54:15.626236 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'image_id': '13e8eec0-88e1-46ac-8aa5-6b8e17d753b3', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Aug 10 17:54:15.626236 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:54:15.626236 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:15.626236 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 10 17:54:15.626236 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 10 17:54:15.626236 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 10 17:54:15.626236 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 10 17:54:15.626236 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 10 17:54:15.626236 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 10 17:54:15.626236 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 10 17:54:15.626236 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 10 17:54:15.626236 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 10 17:54:15.626236 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 10 17:54:15.626236 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 10 17:54:15.626236 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 10 17:54:15.626236 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 10 17:54:15.626236 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 10 17:54:15.626236 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 10 17:54:15.626236 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 10 17:54:15.626236 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 13e8eec0-88e1-46ac-8aa5-6b8e17d753b3 Aug 10 17:54:15.626236 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:54:15.626236 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:54:15.626236 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:54:15.626236 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:15.626236 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 10 17:54:15.626236 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 10 17:54:15.626236 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 10 17:54:15.626236 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 10 17:54:15.626236 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 10 17:54:15.626236 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 10 17:54:15.631597 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 10 17:54:15.631597 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 10 17:54:15.631597 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 10 17:54:15.631597 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 10 17:54:15.631597 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 10 17:54:15.631597 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 10 17:54:15.631597 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 10 17:54:15.631597 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 10 17:54:15.631597 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 10 17:54:15.631597 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 10 17:54:15.631597 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 10 17:54:15.631597 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 10 17:54:15.631597 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 10 17:54:15.631597 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 10 17:54:15.631597 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 10 17:54:15.631597 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 10 17:54:15.631597 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 10 17:54:15.631597 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 10 17:54:15.631597 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 13e8eec0-88e1-46ac-8aa5-6b8e17d753b3 could not be found. Aug 10 17:54:15.631597 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:54:15.631597 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:54:15.631597 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:54:15.631597 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:15.631597 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:54:15.631597 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:54:15.631597 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:54:15.631597 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:54:15.631597 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 17:54:15.631597 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 17:54:15.631597 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:54:15.631597 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:54:15.631597 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:54:15.631597 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:54:15.631597 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Aug 10 17:54:15.631597 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 10 17:54:15.631597 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 10 17:54:15.631597 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 10 17:54:15.631597 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 10 17:54:15.631597 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:54:15.631597 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:54:15.631597 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:54:15.631597 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:15.631597 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:54:15.631597 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:54:15.631597 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:54:15.631597 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:54:15.631597 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 10 17:54:15.631597 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:54:15.642378 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-89c794ce-8bb6-4121-a40c-89b9ee9e5927 tempest-ImagesMetadataNegativeTestJSON-280812347 tempest-ImagesMetadataNegativeTestJSON-280812347-project] Returning 404 to user: Image not found. {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:54:15.642378 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-89c794ce-8bb6-4121-a40c-89b9ee9e5927 tempest-ImagesMetadataNegativeTestJSON-280812347 tempest-ImagesMetadataNegativeTestJSON-280812347-project] 10.222.0.50 "PUT /compute/v2.1/images/13e8eec0-88e1-46ac-8aa5-6b8e17d753b3/metadata" status: 404 len: 62 microversion: 2.1 time: 0.079054 Aug 10 17:54:15.642378 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 635/1278] 10.222.0.50 () {60 vars in 1280 bytes} [Wed Aug 10 17:54:15 2022] PUT /compute/v2.1/images/13e8eec0-88e1-46ac-8aa5-6b8e17d753b3/metadata => generated 62 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 10 17:54:15.651241 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-0964f74f-0eaa-4f9e-aa31-6b5eaa4a1994 tempest-ImagesMetadataNegativeTestJSON-280812347 tempest-ImagesMetadataNegativeTestJSON-280812347-project] Action: 'update', calling method: .version_select at 0x7fb345b80c10>, body: {"meta": {"os_distro": "alt"}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:54:15.708026 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-0964f74f-0eaa-4f9e-aa31-6b5eaa4a1994 tempest-ImagesMetadataNegativeTestJSON-280812347 tempest-ImagesMetadataNegativeTestJSON-280812347-project] HTTP exception thrown: Image not found. Aug 10 17:54:15.710188 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-0964f74f-0eaa-4f9e-aa31-6b5eaa4a1994 tempest-ImagesMetadataNegativeTestJSON-280812347 tempest-ImagesMetadataNegativeTestJSON-280812347-project] Request method failure captured: Aug 10 17:54:15.710188 n-d-852296-2 devstack@n-api.service[129410]: request: PUT /compute/v2.1/images/c1ac9834-bb4e-49a1-b86c-54d5813096ac/metadata/os_distro HTTP/1.1 Aug 10 17:54:15.710188 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 17:54:15.710188 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 17:54:15.710188 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 17:54:15.710188 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 30 Aug 10 17:54:15.710188 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 17:54:15.710188 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 17:54:15.710188 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 17:54:15.710188 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 17:54:15.710188 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8_DFZmmNV1NbM-SqpqfR-W8j_6aFzq73le16EQSwbwYELv_m3-9TfvFi3iYvBjTNK_tKgVnOZnnhsAbNQVVBjUw2SxdNMrHNs3tCO5Ii9wlVpPgt31LTrGCWFlmed4jYm7he2UCTTzEn9958zOn7Xe_0aNCDyLZpgeopOBBWjO2czFc Aug 10 17:54:15.710188 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 17:54:15.710188 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 17:54:15.710188 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 17:54:15.710188 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 17:54:15.710188 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 17:54:15.710188 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 17:54:15.710188 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: aa974e28736c4704a6eb4d236ac9c553 Aug 10 17:54:15.710188 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-280812347 Aug 10 17:54:15.710188 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 17:54:15.710188 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 17:54:15.710188 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/aa974e28736c4704a6eb4d236ac9c553"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/aa974e28736c4704a6eb4d236ac9c553"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/aa974e28736c4704a6eb4d236ac9c553"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_aa974e28736c4704a6eb4d236ac9c553", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:54:15.710188 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-280812347 Aug 10 17:54:15.710188 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: aa974e28736c4704a6eb4d236ac9c553 Aug 10 17:54:15.710188 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-280812347 Aug 10 17:54:15.710188 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-ImagesMetadataNegativeTestJSON-280812347-project Aug 10 17:54:15.710188 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 17:54:15.710188 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 17:54:15.710188 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: cb252f65ad814b1eb190b8419de8508f Aug 10 17:54:15.710188 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-280812347-project Aug 10 17:54:15.710188 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 17:54:15.710188 n-d-852296-2 devstack@n-api.service[129410]: {"meta": {"os_distro": "alt"}} Aug 10 17:54:15.710188 n-d-852296-2 devstack@n-api.service[129410]: method: Aug 10 17:54:15.710188 n-d-852296-2 devstack@n-api.service[129410]: exception: Image not found. Aug 10 17:54:15.710188 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'image_id': 'c1ac9834-bb4e-49a1-b86c-54d5813096ac', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Aug 10 17:54:15.710188 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:54:15.710188 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:15.710188 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 10 17:54:15.710188 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 10 17:54:15.710188 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 10 17:54:15.710188 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 10 17:54:15.710188 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 10 17:54:15.710188 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 10 17:54:15.710188 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 10 17:54:15.710188 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 10 17:54:15.710188 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 10 17:54:15.710188 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 10 17:54:15.710188 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 10 17:54:15.710188 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 10 17:54:15.710188 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 10 17:54:15.710188 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 10 17:54:15.710188 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 10 17:54:15.710188 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 10 17:54:15.710188 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID c1ac9834-bb4e-49a1-b86c-54d5813096ac Aug 10 17:54:15.710188 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:54:15.710188 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:54:15.710188 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:54:15.710188 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:15.710188 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 10 17:54:15.710188 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 10 17:54:15.710188 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 10 17:54:15.710188 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 10 17:54:15.710188 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 10 17:54:15.710188 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 10 17:54:15.717539 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 10 17:54:15.717539 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 10 17:54:15.717539 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 10 17:54:15.717539 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 10 17:54:15.717539 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 10 17:54:15.717539 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 10 17:54:15.717539 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 10 17:54:15.717539 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 10 17:54:15.717539 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 10 17:54:15.717539 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 10 17:54:15.717539 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 10 17:54:15.717539 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 10 17:54:15.717539 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 10 17:54:15.717539 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 10 17:54:15.717539 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 10 17:54:15.717539 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 10 17:54:15.717539 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 10 17:54:15.717539 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 10 17:54:15.717539 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c1ac9834-bb4e-49a1-b86c-54d5813096ac could not be found. Aug 10 17:54:15.717539 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:54:15.717539 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:54:15.717539 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:54:15.717539 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:15.717539 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:54:15.717539 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:54:15.717539 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:54:15.717539 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:54:15.717539 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 17:54:15.717539 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 17:54:15.717539 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:54:15.717539 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:54:15.717539 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:54:15.717539 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:54:15.717539 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Aug 10 17:54:15.717539 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 10 17:54:15.717539 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 10 17:54:15.717539 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 10 17:54:15.717539 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 10 17:54:15.717539 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:54:15.717539 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:54:15.717539 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:54:15.717539 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:15.717539 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:54:15.717539 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:54:15.717539 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:54:15.717539 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:54:15.717539 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 10 17:54:15.717539 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:54:15.717539 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-0964f74f-0eaa-4f9e-aa31-6b5eaa4a1994 tempest-ImagesMetadataNegativeTestJSON-280812347 tempest-ImagesMetadataNegativeTestJSON-280812347-project] Returning 404 to user: Image not found. {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:54:15.717539 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-0964f74f-0eaa-4f9e-aa31-6b5eaa4a1994 tempest-ImagesMetadataNegativeTestJSON-280812347 tempest-ImagesMetadataNegativeTestJSON-280812347-project] 10.222.0.50 "PUT /compute/v2.1/images/c1ac9834-bb4e-49a1-b86c-54d5813096ac/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.068033 Aug 10 17:54:15.717539 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 636/1279] 10.222.0.50 () {60 vars in 1310 bytes} [Wed Aug 10 17:54:15 2022] PUT /compute/v2.1/images/c1ac9834-bb4e-49a1-b86c-54d5813096ac/metadata/os_distro => generated 62 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 10 17:54:15.734084 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-ef22faf6-90d9-4c3b-b8a4-5fd744b49f02 tempest-ImagesMetadataNegativeTestJSON-280812347 tempest-ImagesMetadataNegativeTestJSON-280812347-project] Action: 'create', calling method: .version_select at 0x7fb345b5fee0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:54:15.790242 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-ef22faf6-90d9-4c3b-b8a4-5fd744b49f02 tempest-ImagesMetadataNegativeTestJSON-280812347 tempest-ImagesMetadataNegativeTestJSON-280812347-project] HTTP exception thrown: Image not found. Aug 10 17:54:15.792454 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-ef22faf6-90d9-4c3b-b8a4-5fd744b49f02 tempest-ImagesMetadataNegativeTestJSON-280812347 tempest-ImagesMetadataNegativeTestJSON-280812347-project] Request method failure captured: Aug 10 17:54:15.792454 n-d-852296-2 devstack@n-api.service[129410]: request: POST /compute/v2.1/images/30212794-19e9-4f69-a14c-4a64ef826184/metadata HTTP/1.1 Aug 10 17:54:15.792454 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 17:54:15.792454 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 17:54:15.792454 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 17:54:15.792454 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 57 Aug 10 17:54:15.792454 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 17:54:15.792454 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 17:54:15.792454 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 17:54:15.792454 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 17:54:15.792454 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8_DFZmmNV1NbM-SqpqfR-W8j_6aFzq73le16EQSwbwYELv_m3-9TfvFi3iYvBjTNK_tKgVnOZnnhsAbNQVVBjUw2SxdNMrHNs3tCO5Ii9wlVpPgt31LTrGCWFlmed4jYm7he2UCTTzEn9958zOn7Xe_0aNCDyLZpgeopOBBWjO2czFc Aug 10 17:54:15.792454 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 17:54:15.792454 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 17:54:15.792454 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 17:54:15.792454 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 17:54:15.792454 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 17:54:15.792454 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 17:54:15.792454 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: aa974e28736c4704a6eb4d236ac9c553 Aug 10 17:54:15.792454 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-280812347 Aug 10 17:54:15.792454 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 17:54:15.792454 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 17:54:15.792454 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/aa974e28736c4704a6eb4d236ac9c553"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/aa974e28736c4704a6eb4d236ac9c553"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/aa974e28736c4704a6eb4d236ac9c553"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_aa974e28736c4704a6eb4d236ac9c553", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:54:15.792454 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-280812347 Aug 10 17:54:15.792454 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: aa974e28736c4704a6eb4d236ac9c553 Aug 10 17:54:15.792454 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-280812347 Aug 10 17:54:15.792454 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-ImagesMetadataNegativeTestJSON-280812347-project Aug 10 17:54:15.792454 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 17:54:15.792454 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 17:54:15.792454 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: cb252f65ad814b1eb190b8419de8508f Aug 10 17:54:15.792454 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-280812347-project Aug 10 17:54:15.792454 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 17:54:15.792454 n-d-852296-2 devstack@n-api.service[129410]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Aug 10 17:54:15.792454 n-d-852296-2 devstack@n-api.service[129410]: method: Aug 10 17:54:15.792454 n-d-852296-2 devstack@n-api.service[129410]: exception: Image not found. Aug 10 17:54:15.792454 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'image_id': '30212794-19e9-4f69-a14c-4a64ef826184', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Aug 10 17:54:15.792454 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:54:15.792454 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:15.792454 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 10 17:54:15.792454 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 10 17:54:15.792454 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 10 17:54:15.792454 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 10 17:54:15.792454 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 10 17:54:15.792454 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 10 17:54:15.792454 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 10 17:54:15.792454 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 10 17:54:15.792454 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 10 17:54:15.792454 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 10 17:54:15.792454 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 10 17:54:15.792454 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 10 17:54:15.792454 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 10 17:54:15.792454 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 10 17:54:15.792454 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 10 17:54:15.792454 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 10 17:54:15.792454 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 30212794-19e9-4f69-a14c-4a64ef826184 Aug 10 17:54:15.792454 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:54:15.792454 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:54:15.792454 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:54:15.792454 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:15.792454 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 10 17:54:15.792454 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 10 17:54:15.792454 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 10 17:54:15.792454 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 10 17:54:15.792454 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 10 17:54:15.792454 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 10 17:54:15.797886 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 10 17:54:15.797886 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 10 17:54:15.797886 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 10 17:54:15.797886 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 10 17:54:15.797886 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 10 17:54:15.797886 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 10 17:54:15.797886 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 10 17:54:15.797886 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 10 17:54:15.797886 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 10 17:54:15.797886 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 10 17:54:15.797886 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 10 17:54:15.797886 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 10 17:54:15.797886 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 10 17:54:15.797886 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 10 17:54:15.797886 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 10 17:54:15.797886 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 10 17:54:15.797886 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 10 17:54:15.797886 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 10 17:54:15.797886 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 30212794-19e9-4f69-a14c-4a64ef826184 could not be found. Aug 10 17:54:15.797886 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:54:15.797886 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:54:15.797886 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:54:15.797886 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:15.797886 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:54:15.797886 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:54:15.797886 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:54:15.797886 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:54:15.797886 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 17:54:15.797886 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 17:54:15.797886 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:54:15.797886 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:54:15.797886 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:54:15.797886 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:54:15.797886 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Aug 10 17:54:15.797886 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 10 17:54:15.797886 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 10 17:54:15.797886 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 10 17:54:15.797886 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 10 17:54:15.797886 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:54:15.797886 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:54:15.797886 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:54:15.797886 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:15.797886 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:54:15.797886 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:54:15.797886 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:54:15.797886 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:54:15.797886 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 10 17:54:15.797886 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:54:15.802712 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-ef22faf6-90d9-4c3b-b8a4-5fd744b49f02 tempest-ImagesMetadataNegativeTestJSON-280812347 tempest-ImagesMetadataNegativeTestJSON-280812347-project] Returning 404 to user: Image not found. {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:54:15.804207 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-ef22faf6-90d9-4c3b-b8a4-5fd744b49f02 tempest-ImagesMetadataNegativeTestJSON-280812347 tempest-ImagesMetadataNegativeTestJSON-280812347-project] 10.222.0.50 "POST /compute/v2.1/images/30212794-19e9-4f69-a14c-4a64ef826184/metadata" status: 404 len: 62 microversion: 2.1 time: 0.086062 Aug 10 17:54:15.804623 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 637/1280] 10.222.0.50 () {60 vars in 1281 bytes} [Wed Aug 10 17:54:15 2022] POST /compute/v2.1/images/30212794-19e9-4f69-a14c-4a64ef826184/metadata => generated 62 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 10 17:54:16.043474 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-47d2e054-d283-4876-9654-b687b36ee0cd tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:54:16.045296 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-47d2e054-d283-4876-9654-b687b36ee0cd tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: af745ef7-21f0-4149-ba68-33f45f73f2dd] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:54:16.050985 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-47d2e054-d283-4876-9654-b687b36ee0cd tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:16.051479 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-47d2e054-d283-4876-9654-b687b36ee0cd tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:16.052043 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-47d2e054-d283-4876-9654-b687b36ee0cd tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:16.052641 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-47d2e054-d283-4876-9654-b687b36ee0cd tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:16.053094 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-47d2e054-d283-4876-9654-b687b36ee0cd tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:16.053517 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-47d2e054-d283-4876-9654-b687b36ee0cd tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:16.865671 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-47d2e054-d283-4876-9654-b687b36ee0cd tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:54:16.875903 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-47d2e054-d283-4876-9654-b687b36ee0cd tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/af745ef7-21f0-4149-ba68-33f45f73f2dd" status: 200 len: 1430 microversion: 2.1 time: 0.837126 Aug 10 17:54:16.876773 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 638/1281] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:54:16 2022] GET /compute/v2.1/servers/af745ef7-21f0-4149-ba68-33f45f73f2dd => generated 1430 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:54:16.894884 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-cb701eae-654e-45c7-8ae6-4fac9a2b8234 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:54:16.897898 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-cb701eae-654e-45c7-8ae6-4fac9a2b8234 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] [instance: 2a0c8868-b8d4-494c-b716-d637d1320340] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:54:16.909891 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-cb701eae-654e-45c7-8ae6-4fac9a2b8234 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:16.913749 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-cb701eae-654e-45c7-8ae6-4fac9a2b8234 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:16.920819 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-cb701eae-654e-45c7-8ae6-4fac9a2b8234 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:16.920819 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-cb701eae-654e-45c7-8ae6-4fac9a2b8234 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:16.920819 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-cb701eae-654e-45c7-8ae6-4fac9a2b8234 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:16.920819 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-cb701eae-654e-45c7-8ae6-4fac9a2b8234 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:16.962439 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-7e64114d-4c1d-416a-88ec-9ac6f3ca4f82 tempest-QuotaClassesAdminTestJSON-1230798137 tempest-QuotaClassesAdminTestJSON-1230798137-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 1.663557 Aug 10 17:54:16.977381 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 644/1282] 10.222.0.50 () {60 vars in 1206 bytes} [Wed Aug 10 17:54:15 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 1678 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:54:16.992679 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [req-9696474d-a8e1-44a2-8171-a9007db1b8a7 req-46bd5443-929e-48bd-905f-3704bdb18a0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af745ef7-21f0-4149-ba68-33f45f73f2dd", "name": "network-vif-deleted", "tag": "fdbd759d-9bf2-43a9-9597-36bcdc4fb718"}]} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:54:17.041759 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-9696474d-a8e1-44a2-8171-a9007db1b8a7 req-46bd5443-929e-48bd-905f-3704bdb18a0b service nova] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:17.042632 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-9696474d-a8e1-44a2-8171-a9007db1b8a7 req-46bd5443-929e-48bd-905f-3704bdb18a0b service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:17.043380 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-9696474d-a8e1-44a2-8171-a9007db1b8a7 req-46bd5443-929e-48bd-905f-3704bdb18a0b service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:17.073511 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.compute.server_external_events [req-9696474d-a8e1-44a2-8171-a9007db1b8a7 req-46bd5443-929e-48bd-905f-3704bdb18a0b service nova] Creating event network-vif-deleted:fdbd759d-9bf2-43a9-9597-36bcdc4fb718 for instance af745ef7-21f0-4149-ba68-33f45f73f2dd on n-h1-852296-2 Aug 10 17:54:17.097493 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [req-9696474d-a8e1-44a2-8171-a9007db1b8a7 req-46bd5443-929e-48bd-905f-3704bdb18a0b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119714 Aug 10 17:54:17.098975 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 645/1283] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 10 17:54:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:54:17.297648 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-cb701eae-654e-45c7-8ae6-4fac9a2b8234 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dac2a95483d4be99f06a2aeeb379339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8014941eeb974f0bb3a4d26a65346f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:54:17.306460 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-cb701eae-654e-45c7-8ae6-4fac9a2b8234 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] 10.222.0.50 "GET /compute/v2.1/servers/2a0c8868-b8d4-494c-b716-d637d1320340" status: 200 len: 1322 microversion: 2.1 time: 0.428451 Aug 10 17:54:17.313480 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 639/1284] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:54:16 2022] GET /compute/v2.1/servers/2a0c8868-b8d4-494c-b716-d637d1320340 => generated 1322 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:54:17.902184 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-03b663dd-3649-4e68-8d00-9cbeb208f018 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:54:17.903307 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-03b663dd-3649-4e68-8d00-9cbeb208f018 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: af745ef7-21f0-4149-ba68-33f45f73f2dd] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:54:17.929547 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-03b663dd-3649-4e68-8d00-9cbeb208f018 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:17.933071 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-03b663dd-3649-4e68-8d00-9cbeb208f018 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:17.935821 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-03b663dd-3649-4e68-8d00-9cbeb208f018 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:17.961936 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-03b663dd-3649-4e68-8d00-9cbeb208f018 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:17.965998 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-03b663dd-3649-4e68-8d00-9cbeb208f018 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:17.966618 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-03b663dd-3649-4e68-8d00-9cbeb208f018 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:18.111716 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-03b663dd-3649-4e68-8d00-9cbeb208f018 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:18.115416 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-03b663dd-3649-4e68-8d00-9cbeb208f018 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:18.115416 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-03b663dd-3649-4e68-8d00-9cbeb208f018 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:18.117793 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.objects.instance [None req-03b663dd-3649-4e68-8d00-9cbeb208f018 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lazy-loading 'fault' on Instance uuid af745ef7-21f0-4149-ba68-33f45f73f2dd {{(pid=129409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:54:18.299156 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-03b663dd-3649-4e68-8d00-9cbeb208f018 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76b870a54454956b3926c34f9f27442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638146d08704b2983761619745290b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:54:18.309682 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-03b663dd-3649-4e68-8d00-9cbeb208f018 tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/af745ef7-21f0-4149-ba68-33f45f73f2dd" status: 200 len: 1306 microversion: 2.1 time: 0.411048 Aug 10 17:54:18.310868 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 646/1285] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:54:17 2022] GET /compute/v2.1/servers/af745ef7-21f0-4149-ba68-33f45f73f2dd => generated 1306 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:54:18.334483 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-910eb2f9-b2d0-443c-8bae-50ad0b339ac7 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:54:18.337079 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-910eb2f9-b2d0-443c-8bae-50ad0b339ac7 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] [instance: 2a0c8868-b8d4-494c-b716-d637d1320340] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:54:18.349922 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-910eb2f9-b2d0-443c-8bae-50ad0b339ac7 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:18.355381 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-910eb2f9-b2d0-443c-8bae-50ad0b339ac7 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:18.356346 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-910eb2f9-b2d0-443c-8bae-50ad0b339ac7 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:18.358231 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-910eb2f9-b2d0-443c-8bae-50ad0b339ac7 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:18.359341 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-910eb2f9-b2d0-443c-8bae-50ad0b339ac7 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:18.362157 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-910eb2f9-b2d0-443c-8bae-50ad0b339ac7 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:18.951457 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-910eb2f9-b2d0-443c-8bae-50ad0b339ac7 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dac2a95483d4be99f06a2aeeb379339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8014941eeb974f0bb3a4d26a65346f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:54:18.979971 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-910eb2f9-b2d0-443c-8bae-50ad0b339ac7 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] 10.222.0.50 "GET /compute/v2.1/servers/2a0c8868-b8d4-494c-b716-d637d1320340" status: 200 len: 1472 microversion: 2.1 time: 0.649834 Aug 10 17:54:18.995602 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 640/1286] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:54:18 2022] GET /compute/v2.1/servers/2a0c8868-b8d4-494c-b716-d637d1320340 => generated 1472 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:54:19.022925 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-17872c71-8c9e-409b-aab3-a813f6baafa6 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:54:19.023907 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-17872c71-8c9e-409b-aab3-a813f6baafa6 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] [instance: 2a0c8868-b8d4-494c-b716-d637d1320340] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:54:19.035896 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-17872c71-8c9e-409b-aab3-a813f6baafa6 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:19.043722 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-17872c71-8c9e-409b-aab3-a813f6baafa6 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:19.047345 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-17872c71-8c9e-409b-aab3-a813f6baafa6 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:19.052672 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-17872c71-8c9e-409b-aab3-a813f6baafa6 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:19.058398 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-17872c71-8c9e-409b-aab3-a813f6baafa6 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:19.061127 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-17872c71-8c9e-409b-aab3-a813f6baafa6 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:19.170566 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-17872c71-8c9e-409b-aab3-a813f6baafa6 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '9dac2a95483d4be99f06a2aeeb379339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8014941eeb974f0bb3a4d26a65346f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:54:19.188816 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-17872c71-8c9e-409b-aab3-a813f6baafa6 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Request method failure captured: Aug 10 17:54:19.188816 n-d-852296-2 devstack@n-api.service[129409]: request: GET /compute/v2.1/servers/2a0c8868-b8d4-494c-b716-d637d1320340/diagnostics HTTP/1.1 Aug 10 17:54:19.188816 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 17:54:19.188816 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 17:54:19.188816 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 17:54:19.188816 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 0 Aug 10 17:54:19.188816 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 17:54:19.188816 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 17:54:19.188816 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 17:54:19.188816 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 17:54:19.188816 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8_CtkgeQKp7H9OIF6E1lkjWAO0DrGABgUTi40YZy6i15PZE0QBXCWqFWBQtd2ZoZbUE-Ah_8B5h01Rv76XO-NAvb7pHWnNfuicPyjXEHbQyCEskNJmkp6omDru-qa7F9ExXwHkJnnlDsCQNibBPJXtNbsmwfQVKpShk6TVNg9NGjXd8 Aug 10 17:54:19.188816 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 17:54:19.188816 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 17:54:19.188816 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 17:54:19.188816 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 17:54:19.188816 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 17:54:19.188816 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 17:54:19.188816 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: 8014941eeb974f0bb3a4d26a65346f6c Aug 10 17:54:19.188816 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-478229192 Aug 10 17:54:19.188816 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 17:54:19.188816 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 17:54:19.188816 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8014941eeb974f0bb3a4d26a65346f6c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8014941eeb974f0bb3a4d26a65346f6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8014941eeb974f0bb3a4d26a65346f6c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8014941eeb974f0bb3a4d26a65346f6c", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:54:19.188816 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-478229192 Aug 10 17:54:19.188816 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: 8014941eeb974f0bb3a4d26a65346f6c Aug 10 17:54:19.188816 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-478229192 Aug 10 17:54:19.188816 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-ServerDiagnosticsNegativeTest-478229192-project Aug 10 17:54:19.188816 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 17:54:19.188816 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 17:54:19.188816 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: 9dac2a95483d4be99f06a2aeeb379339 Aug 10 17:54:19.188816 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-478229192-project Aug 10 17:54:19.188816 n-d-852296-2 devstack@n-api.service[129409]: method: > Aug 10 17:54:19.188816 n-d-852296-2 devstack@n-api.service[129409]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Aug 10 17:54:19.188816 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'server_id': '2a0c8868-b8d4-494c-b716-d637d1320340'} Aug 10 17:54:19.188816 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:54:19.188816 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:19.188816 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:54:19.188816 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:54:19.188816 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:54:19.188816 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:54:19.188816 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:54:19.188816 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:54:19.188816 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Aug 10 17:54:19.188816 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Aug 10 17:54:19.188816 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 10 17:54:19.188816 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 10 17:54:19.188816 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 10 17:54:19.188816 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 10 17:54:19.188816 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 10 17:54:19.188816 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 10 17:54:19.188816 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 10 17:54:19.188816 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise self.value Aug 10 17:54:19.188816 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 10 17:54:19.188816 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 10 17:54:19.188816 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 10 17:54:19.188816 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 10 17:54:19.188816 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 10 17:54:19.188816 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 10 17:54:19.188816 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Aug 10 17:54:19.188816 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:19.188816 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:54:19.188816 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:19.188816 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:19.194631 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:54:19.194631 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:54:19.194631 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 10 17:54:19.194631 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 10 17:54:19.194631 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Aug 10 17:54:19.194631 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:19.194631 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-17872c71-8c9e-409b-aab3-a813f6baafa6 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:54:19.194631 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-17872c71-8c9e-409b-aab3-a813f6baafa6 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] 10.222.0.50 "GET /compute/v2.1/servers/2a0c8868-b8d4-494c-b716-d637d1320340/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.171667 Aug 10 17:54:19.205560 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 647/1287] 10.222.0.50 () {58 vars in 1272 bytes} [Wed Aug 10 17:54:19 2022] GET /compute/v2.1/servers/2a0c8868-b8d4-494c-b716-d637d1320340/diagnostics => generated 117 bytes in 188 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:54:19.243754 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-676e1e0b-d89c-4296-8a1f-e721828d1a8d tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:54:19.244595 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-676e1e0b-d89c-4296-8a1f-e721828d1a8d tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] [instance: 2a0c8868-b8d4-494c-b716-d637d1320340] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:54:19.259615 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-676e1e0b-d89c-4296-8a1f-e721828d1a8d tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:19.266679 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-676e1e0b-d89c-4296-8a1f-e721828d1a8d tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:19.267801 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-676e1e0b-d89c-4296-8a1f-e721828d1a8d tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:19.269687 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-676e1e0b-d89c-4296-8a1f-e721828d1a8d tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:19.271728 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-676e1e0b-d89c-4296-8a1f-e721828d1a8d tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:19.274218 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-676e1e0b-d89c-4296-8a1f-e721828d1a8d tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:19.331844 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-9c56120f-9c04-4a29-b45e-c7ffcfff83aa tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:54:19.332544 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-9c56120f-9c04-4a29-b45e-c7ffcfff83aa tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] [instance: af745ef7-21f0-4149-ba68-33f45f73f2dd] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:54:19.350202 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-9c56120f-9c04-4a29-b45e-c7ffcfff83aa tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:19.350699 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-9c56120f-9c04-4a29-b45e-c7ffcfff83aa tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:19.362071 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-9c56120f-9c04-4a29-b45e-c7ffcfff83aa tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:19.366069 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-9c56120f-9c04-4a29-b45e-c7ffcfff83aa tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:19.370681 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-9c56120f-9c04-4a29-b45e-c7ffcfff83aa tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:19.373546 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-9c56120f-9c04-4a29-b45e-c7ffcfff83aa tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:19.404193 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-676e1e0b-d89c-4296-8a1f-e721828d1a8d tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] [instance: 2a0c8868-b8d4-494c-b716-d637d1320340] Going to try to terminate instance {{(pid=129410) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 17:54:19.458169 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-9c56120f-9c04-4a29-b45e-c7ffcfff83aa tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] HTTP exception thrown: Instance af745ef7-21f0-4149-ba68-33f45f73f2dd could not be found. Aug 10 17:54:19.463562 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-9c56120f-9c04-4a29-b45e-c7ffcfff83aa tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Request method failure captured: Aug 10 17:54:19.463562 n-d-852296-2 devstack@n-api.service[129409]: request: GET /compute/v2.1/servers/af745ef7-21f0-4149-ba68-33f45f73f2dd HTTP/1.1 Aug 10 17:54:19.463562 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 17:54:19.463562 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 17:54:19.463562 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 17:54:19.463562 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 0 Aug 10 17:54:19.463562 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 17:54:19.463562 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 17:54:19.463562 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 17:54:19.463562 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 17:54:19.463562 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8-_vb7x9x9F8-sP6h5pKdcrrsXpPJ2RlEbuCXnu2ZTWdSKtHarFJLe7Hjf1WLDt_yPDFFQT5gzj11kqkxwhqMHpazNhmqyhgrlC3SoXOue_P66sN7aOFIkgqmKczGGaSXM3e-yfy_FvawvLBNZry68s7Q1kz50eCpVoZBo2bvZ2yTNc Aug 10 17:54:19.463562 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 17:54:19.463562 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 17:54:19.463562 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 17:54:19.463562 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 17:54:19.463562 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 17:54:19.463562 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 17:54:19.463562 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: 0638146d08704b2983761619745290b3 Aug 10 17:54:19.463562 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-ServersOnMultiNodesTest-946016060 Aug 10 17:54:19.463562 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 17:54:19.463562 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 17:54:19.463562 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0638146d08704b2983761619745290b3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/0638146d08704b2983761619745290b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0638146d08704b2983761619745290b3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_0638146d08704b2983761619745290b3", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:54:19.463562 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-ServersOnMultiNodesTest-946016060 Aug 10 17:54:19.463562 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: 0638146d08704b2983761619745290b3 Aug 10 17:54:19.463562 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-946016060 Aug 10 17:54:19.463562 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-ServersOnMultiNodesTest-946016060-project Aug 10 17:54:19.463562 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 17:54:19.463562 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 17:54:19.463562 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: f76b870a54454956b3926c34f9f27442 Aug 10 17:54:19.463562 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-ServersOnMultiNodesTest-946016060-project Aug 10 17:54:19.463562 n-d-852296-2 devstack@n-api.service[129409]: method: > Aug 10 17:54:19.463562 n-d-852296-2 devstack@n-api.service[129409]: exception: Instance af745ef7-21f0-4149-ba68-33f45f73f2dd could not be found. Aug 10 17:54:19.463562 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'id': 'af745ef7-21f0-4149-ba68-33f45f73f2dd'} Aug 10 17:54:19.463562 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:54:19.463562 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:19.463562 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 17:54:19.463562 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 17:54:19.463562 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 17:54:19.463562 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 17:54:19.463562 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 17:54:19.463562 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 17:54:19.463562 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 17:54:19.463562 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 17:54:19.463562 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af745ef7-21f0-4149-ba68-33f45f73f2dd could not be found. Aug 10 17:54:19.463562 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:19.463562 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:54:19.463562 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:19.463562 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:19.463562 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:54:19.463562 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:54:19.463562 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:54:19.463562 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:54:19.463562 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:54:19.463562 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:54:19.463562 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 17:54:19.463562 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 17:54:19.463562 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 17:54:19.463562 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 17:54:19.463562 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 17:54:19.463562 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:54:19.463562 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af745ef7-21f0-4149-ba68-33f45f73f2dd could not be found. Aug 10 17:54:19.463562 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:19.463562 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:54:19.463562 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:19.470488 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:19.470488 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:54:19.470488 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:54:19.470488 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:54:19.470488 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:54:19.470488 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af745ef7-21f0-4149-ba68-33f45f73f2dd could not be found. Aug 10 17:54:19.470488 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:19.472741 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-9c56120f-9c04-4a29-b45e-c7ffcfff83aa tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] Returning 404 to user: Instance af745ef7-21f0-4149-ba68-33f45f73f2dd could not be found. {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:54:19.477232 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-9c56120f-9c04-4a29-b45e-c7ffcfff83aa tempest-ServersOnMultiNodesTest-946016060 tempest-ServersOnMultiNodesTest-946016060-project] 10.222.0.50 "GET /compute/v2.1/servers/af745ef7-21f0-4149-ba68-33f45f73f2dd" status: 404 len: 111 microversion: 2.1 time: 0.149925 Aug 10 17:54:19.483002 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 648/1288] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:54:19 2022] GET /compute/v2.1/servers/af745ef7-21f0-4149-ba68-33f45f73f2dd => generated 111 bytes in 153 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 17:54:19.965094 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-676e1e0b-d89c-4296-8a1f-e721828d1a8d tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] 10.222.0.50 "DELETE /compute/v2.1/servers/2a0c8868-b8d4-494c-b716-d637d1320340" status: 204 len: 0 microversion: 2.1 time: 0.732266 Aug 10 17:54:19.966004 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 641/1289] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 10 17:54:19 2022] DELETE /compute/v2.1/servers/2a0c8868-b8d4-494c-b716-d637d1320340 => generated 0 bytes in 737 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 17:54:19.977632 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-4b4ca09a-0a0a-451a-8420-80fa7fe5882a tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:54:19.978371 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-4b4ca09a-0a0a-451a-8420-80fa7fe5882a tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] [instance: 2a0c8868-b8d4-494c-b716-d637d1320340] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:54:19.991766 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-4b4ca09a-0a0a-451a-8420-80fa7fe5882a tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:19.996013 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-4b4ca09a-0a0a-451a-8420-80fa7fe5882a tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:20.002031 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-4b4ca09a-0a0a-451a-8420-80fa7fe5882a tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:20.002031 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-4b4ca09a-0a0a-451a-8420-80fa7fe5882a tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:20.006190 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-4b4ca09a-0a0a-451a-8420-80fa7fe5882a tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:20.009965 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-4b4ca09a-0a0a-451a-8420-80fa7fe5882a tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:20.337139 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-4b4ca09a-0a0a-451a-8420-80fa7fe5882a tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dac2a95483d4be99f06a2aeeb379339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8014941eeb974f0bb3a4d26a65346f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:54:20.354146 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-4b4ca09a-0a0a-451a-8420-80fa7fe5882a tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] 10.222.0.50 "GET /compute/v2.1/servers/2a0c8868-b8d4-494c-b716-d637d1320340" status: 200 len: 1478 microversion: 2.1 time: 0.383605 Aug 10 17:54:20.355427 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 649/1290] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:54:19 2022] GET /compute/v2.1/servers/2a0c8868-b8d4-494c-b716-d637d1320340 => generated 1478 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:54:20.545771 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-537e127f-747e-4055-b684-f86c65f53a9e tempest-InstanceActionsTestJSON-1055369087 tempest-InstanceActionsTestJSON-1055369087-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-1107198711", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "c1687eb9-a03f-49fe-b744-87ddf49e8ee0"}]}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:54:20.676645 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.network.neutron [None req-537e127f-747e-4055-b684-f86c65f53a9e tempest-InstanceActionsTestJSON-1055369087 tempest-InstanceActionsTestJSON-1055369087-project] validate_networks() for [('c1687eb9-a03f-49fe-b744-87ddf49e8ee0', None, None, None, None, None)] {{(pid=129410) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 17:54:21.387773 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-2f2fd346-850f-489f-8ccf-58c4f99c6c8b tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:54:21.387773 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-2f2fd346-850f-489f-8ccf-58c4f99c6c8b tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] [instance: 2a0c8868-b8d4-494c-b716-d637d1320340] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:54:21.391157 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-2f2fd346-850f-489f-8ccf-58c4f99c6c8b tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:21.394294 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-2f2fd346-850f-489f-8ccf-58c4f99c6c8b tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:21.395505 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-2f2fd346-850f-489f-8ccf-58c4f99c6c8b tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:21.397793 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-2f2fd346-850f-489f-8ccf-58c4f99c6c8b tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:21.399056 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-2f2fd346-850f-489f-8ccf-58c4f99c6c8b tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:21.399699 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-2f2fd346-850f-489f-8ccf-58c4f99c6c8b tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:21.582405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [None req-537e127f-747e-4055-b684-f86c65f53a9e tempest-InstanceActionsTestJSON-1055369087 tempest-InstanceActionsTestJSON-1055369087-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-3b8631c1-be9a-49ce-a025-051d868160e3) Aug 10 17:54:21.582405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:21.582405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:54:21.582405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:54:21.582405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:54:21.582405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:54:21.582405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:54:21.582405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:54:21.582405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:54:21.582405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:54:21.582405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 17:54:21.582405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 17:54:21.582405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 17:54:21.582405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 17:54:21.582405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 17:54:21.582405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 17:54:21.582405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 17:54:21.582405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 17:54:21.582405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 17:54:21.582405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 17:54:21.582405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 17:54:21.582405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 17:54:21.582405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 17:54:21.582405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 17:54:21.582405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 17:54:21.582405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 17:54:21.582405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 17:54:21.582405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:54:21.582405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:54:21.582405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 17:54:21.582405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 17:54:21.582405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:54:21.582405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:54:21.582405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:54:21.582405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:54:21.582405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:54:21.582405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:54:21.582405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:54:21.582405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:54:21.582405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:54:21.582405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:54:21.582405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 17:54:21.582405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 17:54:21.582405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 17:54:21.582405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 17:54:21.582405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 17:54:21.582405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 17:54:21.582405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 17:54:21.582405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 17:54:21.582405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 17:54:21.582405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 17:54:21.582405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 17:54:21.587937 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 17:54:21.587937 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 17:54:21.587937 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 17:54:21.587937 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 17:54:21.587937 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 17:54:21.587937 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 17:54:21.587937 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 17:54:21.587937 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 17:54:21.587937 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 17:54:21.587937 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 17:54:21.587937 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 17:54:21.587937 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 17:54:21.587937 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 17:54:21.587937 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 17:54:21.587937 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 17:54:21.587937 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-3b8631c1-be9a-49ce-a025-051d868160e3) Aug 10 17:54:21.587937 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:54:21.587937 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-537e127f-747e-4055-b684-f86c65f53a9e tempest-InstanceActionsTestJSON-1055369087 tempest-InstanceActionsTestJSON-1055369087-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:54:21.587937 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 17:54:21.587937 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-537e127f-747e-4055-b684-f86c65f53a9e tempest-InstanceActionsTestJSON-1055369087 tempest-InstanceActionsTestJSON-1055369087-project] Request method failure captured: Aug 10 17:54:21.587937 n-d-852296-2 devstack@n-api.service[129410]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 17:54:21.587937 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 17:54:21.587937 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 17:54:21.587937 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 17:54:21.587937 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 209 Aug 10 17:54:21.587937 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 17:54:21.587937 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 17:54:21.587937 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 17:54:21.587937 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 17:54:21.587937 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8_DLgaQbzZ2GxsRt8-4A9AevIeQ1L9IzpBaoKGnwkjTMCIvJ3ztRxLKHZ7ElRtJN3xsMq3c7z40UcyzYxx3xmzoJbjSUW33R2yex0vSnDVwh0bbFiquMHrhHL6AVr4Y-ujCtk6Wy4Z5lRRsaLWV--OVWx4TnmWduNG086mCo8bNbtfE Aug 10 17:54:21.587937 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 17:54:21.587937 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 17:54:21.587937 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 17:54:21.587937 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 17:54:21.587937 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 17:54:21.587937 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 17:54:21.587937 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: e02963428af44e2db61651c3c664c5b8 Aug 10 17:54:21.587937 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-InstanceActionsTestJSON-1055369087 Aug 10 17:54:21.587937 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 17:54:21.587937 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 17:54:21.587937 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e02963428af44e2db61651c3c664c5b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/e02963428af44e2db61651c3c664c5b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e02963428af44e2db61651c3c664c5b8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_e02963428af44e2db61651c3c664c5b8", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:54:21.587937 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-InstanceActionsTestJSON-1055369087 Aug 10 17:54:21.587937 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: e02963428af44e2db61651c3c664c5b8 Aug 10 17:54:21.587937 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-InstanceActionsTestJSON-1055369087 Aug 10 17:54:21.587937 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-InstanceActionsTestJSON-1055369087-project Aug 10 17:54:21.587937 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 17:54:21.587937 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 17:54:21.587937 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: 6a7ae1b1415a4788bfbd5ddbc06e3bb5 Aug 10 17:54:21.587937 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-InstanceActionsTestJSON-1055369087-project Aug 10 17:54:21.587937 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 17:54:21.587937 n-d-852296-2 devstack@n-api.service[129410]: {"server": {"name": "tempest-InstanceActionsTestJSON-server-1107198711", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "c1687eb9-a03f-49fe-b744-87ddf49e8ee0"}]}} Aug 10 17:54:21.587937 n-d-852296-2 devstack@n-api.service[129410]: method: > Aug 10 17:54:21.587937 n-d-852296-2 devstack@n-api.service[129410]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:54:21.587937 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 17:54:21.587937 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'body': {'server': {'name': 'tempest-InstanceActionsTestJSON-server-1107198711', 'imageRef': 'a735ff26-463a-4ffe-a981-ab9d9baa494f', 'flavorRef': '452', 'networks': [{'uuid': 'c1687eb9-a03f-49fe-b744-87ddf49e8ee0'}]}}} Aug 10 17:54:21.598437 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:54:21.598437 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:21.598437 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:54:21.598437 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:54:21.598437 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:54:21.598437 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:54:21.598437 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:54:21.598437 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:54:21.598437 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:54:21.598437 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:54:21.598437 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 17:54:21.598437 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 17:54:21.598437 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 17:54:21.598437 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 17:54:21.598437 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 17:54:21.598437 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 17:54:21.598437 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 17:54:21.598437 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 17:54:21.598437 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 17:54:21.598437 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 17:54:21.598437 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 17:54:21.598437 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 17:54:21.598437 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 17:54:21.598437 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 17:54:21.598437 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 17:54:21.598437 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 17:54:21.598437 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 17:54:21.598437 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:54:21.598437 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:54:21.598437 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 17:54:21.598437 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 17:54:21.598437 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:54:21.598437 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:54:21.598437 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:54:21.598437 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:54:21.598437 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:54:21.598437 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:54:21.598437 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:54:21.598437 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:54:21.598437 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:54:21.598437 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:54:21.598437 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 17:54:21.598437 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 17:54:21.598437 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 17:54:21.598437 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 17:54:21.598437 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 17:54:21.598437 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 17:54:21.598437 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 17:54:21.598437 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 17:54:21.598437 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 17:54:21.598437 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 17:54:21.598437 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 17:54:21.598437 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 17:54:21.598437 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 17:54:21.598437 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 17:54:21.598437 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 17:54:21.609728 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 17:54:21.609728 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 17:54:21.609728 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 17:54:21.609728 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 17:54:21.609728 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 17:54:21.609728 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 17:54:21.609728 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 17:54:21.609728 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 17:54:21.609728 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 17:54:21.609728 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 17:54:21.609728 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 17:54:21.609728 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-3b8631c1-be9a-49ce-a025-051d868160e3) Aug 10 17:54:21.609728 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:54:21.609728 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:54:21.609728 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:54:21.609728 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:21.609728 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:54:21.609728 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:54:21.609728 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:54:21.609728 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:54:21.609728 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 10 17:54:21.609728 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 10 17:54:21.609728 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:54:21.609728 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:54:21.609728 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:54:21.609728 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:54:21.609728 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:54:21.609728 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:21.609728 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:54:21.609728 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:54:21.609728 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:54:21.609728 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:54:21.609728 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:54:21.609728 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:54:21.609728 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:54:21.609728 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-537e127f-747e-4055-b684-f86c65f53a9e tempest-InstanceActionsTestJSON-1055369087 tempest-InstanceActionsTestJSON-1055369087-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:54:21.609728 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:54:21.609728 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-537e127f-747e-4055-b684-f86c65f53a9e tempest-InstanceActionsTestJSON-1055369087 tempest-InstanceActionsTestJSON-1055369087-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.407136 Aug 10 17:54:21.609728 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 642/1291] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 17:54:20 2022] POST /compute/v2.1/servers => generated 214 bytes in 1408 msecs (HTTP/1.1 500) 9 headers in 391 bytes (2 switches on core 0) Aug 10 17:54:21.831790 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-2f2fd346-850f-489f-8ccf-58c4f99c6c8b tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dac2a95483d4be99f06a2aeeb379339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8014941eeb974f0bb3a4d26a65346f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:54:21.847123 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-2f2fd346-850f-489f-8ccf-58c4f99c6c8b tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] 10.222.0.50 "GET /compute/v2.1/servers/2a0c8868-b8d4-494c-b716-d637d1320340" status: 200 len: 1478 microversion: 2.1 time: 0.470949 Aug 10 17:54:21.847747 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 650/1292] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:54:21 2022] GET /compute/v2.1/servers/2a0c8868-b8d4-494c-b716-d637d1320340 => generated 1478 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:54:22.536336 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [req-673f77e0-fa11-439e-b5ba-fd67d16689df req-8dcc9dce-55a5-44df-8496-240f41b71c82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a0c8868-b8d4-494c-b716-d637d1320340", "name": "network-vif-deleted", "tag": "450e9793-7d3c-4aff-a62a-01badf6fa11d"}]} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:54:22.560342 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-673f77e0-fa11-439e-b5ba-fd67d16689df req-8dcc9dce-55a5-44df-8496-240f41b71c82 service nova] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:22.560833 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-673f77e0-fa11-439e-b5ba-fd67d16689df req-8dcc9dce-55a5-44df-8496-240f41b71c82 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:22.561268 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-673f77e0-fa11-439e-b5ba-fd67d16689df req-8dcc9dce-55a5-44df-8496-240f41b71c82 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:22.597790 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.compute.server_external_events [req-673f77e0-fa11-439e-b5ba-fd67d16689df req-8dcc9dce-55a5-44df-8496-240f41b71c82 service nova] Creating event network-vif-deleted:450e9793-7d3c-4aff-a62a-01badf6fa11d for instance 2a0c8868-b8d4-494c-b716-d637d1320340 on n-h1-852296-2 Aug 10 17:54:22.612525 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [req-673f77e0-fa11-439e-b5ba-fd67d16689df req-8dcc9dce-55a5-44df-8496-240f41b71c82 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079921 Aug 10 17:54:22.628663 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 643/1293] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 10 17:54:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:54:22.869358 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-745780fb-9de7-4398-ba80-25660512d23c tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:54:22.869988 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-745780fb-9de7-4398-ba80-25660512d23c tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] [instance: 2a0c8868-b8d4-494c-b716-d637d1320340] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:54:22.880575 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-745780fb-9de7-4398-ba80-25660512d23c tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:22.881340 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-745780fb-9de7-4398-ba80-25660512d23c tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:22.882053 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-745780fb-9de7-4398-ba80-25660512d23c tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:22.883620 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-745780fb-9de7-4398-ba80-25660512d23c tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:22.884273 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-745780fb-9de7-4398-ba80-25660512d23c tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:22.884867 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-745780fb-9de7-4398-ba80-25660512d23c tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:23.120131 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-745780fb-9de7-4398-ba80-25660512d23c tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dac2a95483d4be99f06a2aeeb379339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8014941eeb974f0bb3a4d26a65346f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:54:23.136740 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-745780fb-9de7-4398-ba80-25660512d23c tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] 10.222.0.50 "GET /compute/v2.1/servers/2a0c8868-b8d4-494c-b716-d637d1320340" status: 200 len: 1307 microversion: 2.1 time: 0.270552 Aug 10 17:54:23.136740 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 651/1294] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:54:22 2022] GET /compute/v2.1/servers/2a0c8868-b8d4-494c-b716-d637d1320340 => generated 1307 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:54:24.157513 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-2482383c-d355-4913-ab1c-57140852c8c6 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:54:24.158398 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-2482383c-d355-4913-ab1c-57140852c8c6 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] [instance: 2a0c8868-b8d4-494c-b716-d637d1320340] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:54:24.180643 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2482383c-d355-4913-ab1c-57140852c8c6 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:24.185231 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2482383c-d355-4913-ab1c-57140852c8c6 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:24.186516 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2482383c-d355-4913-ab1c-57140852c8c6 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:24.192533 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2482383c-d355-4913-ab1c-57140852c8c6 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:24.194469 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2482383c-d355-4913-ab1c-57140852c8c6 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:24.198474 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2482383c-d355-4913-ab1c-57140852c8c6 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:24.257848 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-2482383c-d355-4913-ab1c-57140852c8c6 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] HTTP exception thrown: Instance 2a0c8868-b8d4-494c-b716-d637d1320340 could not be found. Aug 10 17:54:24.264741 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-2482383c-d355-4913-ab1c-57140852c8c6 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Request method failure captured: Aug 10 17:54:24.264741 n-d-852296-2 devstack@n-api.service[129410]: request: GET /compute/v2.1/servers/2a0c8868-b8d4-494c-b716-d637d1320340 HTTP/1.1 Aug 10 17:54:24.264741 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 17:54:24.264741 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 17:54:24.264741 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 17:54:24.264741 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 0 Aug 10 17:54:24.264741 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 17:54:24.264741 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 17:54:24.264741 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 17:54:24.264741 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 17:54:24.264741 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8_CtkgeQKp7H9OIF6E1lkjWAO0DrGABgUTi40YZy6i15PZE0QBXCWqFWBQtd2ZoZbUE-Ah_8B5h01Rv76XO-NAvb7pHWnNfuicPyjXEHbQyCEskNJmkp6omDru-qa7F9ExXwHkJnnlDsCQNibBPJXtNbsmwfQVKpShk6TVNg9NGjXd8 Aug 10 17:54:24.264741 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 17:54:24.264741 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 17:54:24.264741 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 17:54:24.264741 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 17:54:24.264741 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 17:54:24.264741 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 17:54:24.264741 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: 8014941eeb974f0bb3a4d26a65346f6c Aug 10 17:54:24.264741 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-478229192 Aug 10 17:54:24.264741 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 17:54:24.264741 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 17:54:24.264741 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8014941eeb974f0bb3a4d26a65346f6c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8014941eeb974f0bb3a4d26a65346f6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8014941eeb974f0bb3a4d26a65346f6c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8014941eeb974f0bb3a4d26a65346f6c", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:54:24.264741 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-478229192 Aug 10 17:54:24.264741 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: 8014941eeb974f0bb3a4d26a65346f6c Aug 10 17:54:24.264741 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-478229192 Aug 10 17:54:24.264741 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-ServerDiagnosticsNegativeTest-478229192-project Aug 10 17:54:24.264741 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 17:54:24.264741 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 17:54:24.264741 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: 9dac2a95483d4be99f06a2aeeb379339 Aug 10 17:54:24.264741 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-478229192-project Aug 10 17:54:24.264741 n-d-852296-2 devstack@n-api.service[129410]: method: > Aug 10 17:54:24.264741 n-d-852296-2 devstack@n-api.service[129410]: exception: Instance 2a0c8868-b8d4-494c-b716-d637d1320340 could not be found. Aug 10 17:54:24.264741 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'id': '2a0c8868-b8d4-494c-b716-d637d1320340'} Aug 10 17:54:24.264741 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:54:24.264741 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:24.264741 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 17:54:24.264741 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 17:54:24.264741 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 17:54:24.264741 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 17:54:24.264741 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 17:54:24.264741 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 17:54:24.264741 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 17:54:24.264741 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 17:54:24.264741 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a0c8868-b8d4-494c-b716-d637d1320340 could not be found. Aug 10 17:54:24.264741 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:54:24.264741 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:54:24.264741 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:54:24.264741 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:24.264741 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:54:24.264741 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:54:24.264741 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:54:24.264741 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:54:24.264741 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:54:24.264741 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:54:24.264741 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 17:54:24.264741 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 17:54:24.264741 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 17:54:24.264741 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 17:54:24.264741 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 17:54:24.264741 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:54:24.264741 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a0c8868-b8d4-494c-b716-d637d1320340 could not be found. Aug 10 17:54:24.264741 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:54:24.264741 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:54:24.272312 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:54:24.272312 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:24.272312 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:54:24.272312 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:54:24.272312 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:54:24.272312 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:54:24.272312 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a0c8868-b8d4-494c-b716-d637d1320340 could not be found. Aug 10 17:54:24.272312 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:54:24.281531 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-2482383c-d355-4913-ab1c-57140852c8c6 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] Returning 404 to user: Instance 2a0c8868-b8d4-494c-b716-d637d1320340 could not be found. {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:54:24.286622 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-2482383c-d355-4913-ab1c-57140852c8c6 tempest-ServerDiagnosticsNegativeTest-478229192 tempest-ServerDiagnosticsNegativeTest-478229192-project] 10.222.0.50 "GET /compute/v2.1/servers/2a0c8868-b8d4-494c-b716-d637d1320340" status: 404 len: 111 microversion: 2.1 time: 0.134546 Aug 10 17:54:24.287592 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 644/1295] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:54:24 2022] GET /compute/v2.1/servers/2a0c8868-b8d4-494c-b716-d637d1320340 => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:54:28.251789 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_cell0:SELECT=4 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:54:29.121316 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-6527312b-5d49-4fb9-9df8-b22ee49de38a tempest-ImagesDeleteNegativeTestJSON-1472567914 tempest-ImagesDeleteNegativeTestJSON-1472567914-project] 10.222.0.50 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.873321 Aug 10 17:54:29.122426 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 652/1296] 10.222.0.50 () {58 vars in 1128 bytes} [Wed Aug 10 17:54:28 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 883 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 10 17:54:29.135534 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-08b84f60-942a-4a73-9841-1c0c1c522ba9 tempest-ImagesDeleteNegativeTestJSON-1472567914 tempest-ImagesDeleteNegativeTestJSON-1472567914-project] Calling method '.version_select at 0x7fb345b740d0>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:54:29.150257 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_cell0:SELECT=25,nova_cell0:UPDATE=7 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:54:29.232044 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-08b84f60-942a-4a73-9841-1c0c1c522ba9 tempest-ImagesDeleteNegativeTestJSON-1472567914 tempest-ImagesDeleteNegativeTestJSON-1472567914-project] HTTP exception thrown: Image not found. Aug 10 17:54:29.234672 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-08b84f60-942a-4a73-9841-1c0c1c522ba9 tempest-ImagesDeleteNegativeTestJSON-1472567914 tempest-ImagesDeleteNegativeTestJSON-1472567914-project] Request method failure captured: Aug 10 17:54:29.234672 n-d-852296-2 devstack@n-api.service[129410]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Aug 10 17:54:29.234672 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 17:54:29.234672 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 17:54:29.234672 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 17:54:29.234672 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 0 Aug 10 17:54:29.234672 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 17:54:29.234672 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 17:54:29.234672 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 17:54:29.234672 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 17:54:29.234672 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8_DUojxwc8N8mS1kp0hFwFsywCLrL-TD5PgIIk9EdtzyNfhrP7GbddVyP8CFPW1UaDUfc8qjxA79VnL1YyBGeWfNaN-_WiSonWueDQg53UMbGLDpWbMnhdLhqCThJO_cN88cqhJffusaGx_SjGOczVeOw5PTN1a3rHXWpXBib4QTIGg Aug 10 17:54:29.234672 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 17:54:29.234672 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 17:54:29.234672 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 17:54:29.234672 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 17:54:29.234672 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 17:54:29.234672 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 17:54:29.234672 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: 7265a49b3414431080f35a127f7de841 Aug 10 17:54:29.234672 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1472567914 Aug 10 17:54:29.234672 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 17:54:29.234672 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 17:54:29.234672 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7265a49b3414431080f35a127f7de841"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/7265a49b3414431080f35a127f7de841"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7265a49b3414431080f35a127f7de841"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_7265a49b3414431080f35a127f7de841", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:54:29.234672 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1472567914 Aug 10 17:54:29.234672 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: 7265a49b3414431080f35a127f7de841 Aug 10 17:54:29.234672 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1472567914 Aug 10 17:54:29.234672 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-ImagesDeleteNegativeTestJSON-1472567914-project Aug 10 17:54:29.234672 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 17:54:29.234672 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 17:54:29.234672 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: 8e0cc43e8e9a4dcf9499b7e46f40b71f Aug 10 17:54:29.234672 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1472567914-project Aug 10 17:54:29.234672 n-d-852296-2 devstack@n-api.service[129410]: method: Aug 10 17:54:29.234672 n-d-852296-2 devstack@n-api.service[129410]: exception: Image not found. Aug 10 17:54:29.234672 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'id': '-1'} Aug 10 17:54:29.234672 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:54:29.234672 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:29.234672 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 10 17:54:29.234672 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 10 17:54:29.234672 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 10 17:54:29.234672 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 10 17:54:29.234672 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 10 17:54:29.234672 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 10 17:54:29.234672 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 10 17:54:29.234672 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 10 17:54:29.234672 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 10 17:54:29.234672 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 10 17:54:29.234672 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 10 17:54:29.234672 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 10 17:54:29.234672 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 10 17:54:29.234672 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 10 17:54:29.234672 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Aug 10 17:54:29.234672 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:54:29.234672 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:54:29.234672 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:54:29.234672 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:29.234672 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 10 17:54:29.234672 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 10 17:54:29.234672 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 10 17:54:29.234672 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 10 17:54:29.234672 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 10 17:54:29.234672 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 10 17:54:29.234672 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Aug 10 17:54:29.234672 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:54:29.234672 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:54:29.234672 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:54:29.234672 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:29.240307 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:54:29.240307 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:54:29.240307 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:54:29.240307 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:54:29.240307 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 17:54:29.240307 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 17:54:29.240307 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:54:29.240307 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:54:29.240307 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 10 17:54:29.240307 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 10 17:54:29.240307 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 10 17:54:29.240307 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:54:29.240307 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:54:29.240307 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:54:29.240307 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:29.240307 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:54:29.240307 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:54:29.240307 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:54:29.240307 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:54:29.240307 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 10 17:54:29.240307 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:54:29.245549 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-08b84f60-942a-4a73-9841-1c0c1c522ba9 tempest-ImagesDeleteNegativeTestJSON-1472567914 tempest-ImagesDeleteNegativeTestJSON-1472567914-project] Returning 404 to user: Image not found. {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:54:29.245549 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-08b84f60-942a-4a73-9841-1c0c1c522ba9 tempest-ImagesDeleteNegativeTestJSON-1472567914 tempest-ImagesDeleteNegativeTestJSON-1472567914-project] 10.222.0.50 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.112663 Aug 10 17:54:29.245549 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 645/1297] 10.222.0.50 () {58 vars in 1134 bytes} [Wed Aug 10 17:54:29 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 10 17:54:29.253383 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-bc1d2c04-ab9d-467a-8615-a2fa1c05247d tempest-ImagesDeleteNegativeTestJSON-1472567914 tempest-ImagesDeleteNegativeTestJSON-1472567914-project] Calling method '.version_select at 0x7fb345f5e1f0>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:54:29.307338 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-bc1d2c04-ab9d-467a-8615-a2fa1c05247d tempest-ImagesDeleteNegativeTestJSON-1472567914 tempest-ImagesDeleteNegativeTestJSON-1472567914-project] HTTP exception thrown: Image not found. Aug 10 17:54:29.309471 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-bc1d2c04-ab9d-467a-8615-a2fa1c05247d tempest-ImagesDeleteNegativeTestJSON-1472567914 tempest-ImagesDeleteNegativeTestJSON-1472567914-project] Request method failure captured: Aug 10 17:54:29.309471 n-d-852296-2 devstack@n-api.service[129409]: request: DELETE /compute/v2.1/images/df67ec69-9a09-4fa6-867f-49bfc113100j HTTP/1.1 Aug 10 17:54:29.309471 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 17:54:29.309471 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 17:54:29.309471 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 17:54:29.309471 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 0 Aug 10 17:54:29.309471 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 17:54:29.309471 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 17:54:29.309471 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 17:54:29.309471 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 17:54:29.309471 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8_DUojxwc8N8mS1kp0hFwFsywCLrL-TD5PgIIk9EdtzyNfhrP7GbddVyP8CFPW1UaDUfc8qjxA79VnL1YyBGeWfNaN-_WiSonWueDQg53UMbGLDpWbMnhdLhqCThJO_cN88cqhJffusaGx_SjGOczVeOw5PTN1a3rHXWpXBib4QTIGg Aug 10 17:54:29.309471 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 17:54:29.309471 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 17:54:29.309471 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 17:54:29.309471 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 17:54:29.309471 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 17:54:29.309471 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 17:54:29.309471 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: 7265a49b3414431080f35a127f7de841 Aug 10 17:54:29.309471 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1472567914 Aug 10 17:54:29.309471 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 17:54:29.309471 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 17:54:29.309471 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7265a49b3414431080f35a127f7de841"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/7265a49b3414431080f35a127f7de841"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7265a49b3414431080f35a127f7de841"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_7265a49b3414431080f35a127f7de841", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:54:29.309471 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1472567914 Aug 10 17:54:29.309471 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: 7265a49b3414431080f35a127f7de841 Aug 10 17:54:29.309471 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1472567914 Aug 10 17:54:29.309471 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-ImagesDeleteNegativeTestJSON-1472567914-project Aug 10 17:54:29.309471 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 17:54:29.309471 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 17:54:29.309471 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: 8e0cc43e8e9a4dcf9499b7e46f40b71f Aug 10 17:54:29.309471 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1472567914-project Aug 10 17:54:29.309471 n-d-852296-2 devstack@n-api.service[129409]: method: Aug 10 17:54:29.309471 n-d-852296-2 devstack@n-api.service[129409]: exception: Image not found. Aug 10 17:54:29.309471 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'id': 'df67ec69-9a09-4fa6-867f-49bfc113100j'} Aug 10 17:54:29.309471 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:54:29.309471 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:29.309471 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 10 17:54:29.309471 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 10 17:54:29.309471 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 10 17:54:29.309471 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 10 17:54:29.309471 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 10 17:54:29.309471 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 10 17:54:29.309471 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 10 17:54:29.309471 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 10 17:54:29.309471 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 10 17:54:29.309471 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 10 17:54:29.309471 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 10 17:54:29.309471 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 10 17:54:29.309471 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 10 17:54:29.309471 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 10 17:54:29.309471 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image df67ec69-9a09-4fa6-867f-49bfc113100j to delete Aug 10 17:54:29.309471 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:29.309471 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:54:29.309471 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:29.309471 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:29.309471 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 10 17:54:29.309471 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 10 17:54:29.309471 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 10 17:54:29.309471 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 10 17:54:29.309471 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 10 17:54:29.309471 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 10 17:54:29.309471 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image df67ec69-9a09-4fa6-867f-49bfc113100j could not be found. Aug 10 17:54:29.309471 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:29.309471 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:54:29.309471 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:29.314759 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:29.314759 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:54:29.314759 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:54:29.314759 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:54:29.314759 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:54:29.314759 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 17:54:29.314759 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 17:54:29.314759 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:54:29.314759 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:54:29.314759 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 10 17:54:29.314759 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 10 17:54:29.314759 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 10 17:54:29.314759 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:29.314759 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:54:29.314759 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:29.314759 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:29.314759 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:54:29.314759 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:54:29.314759 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:54:29.314759 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:54:29.314759 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 10 17:54:29.314759 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:29.314759 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-bc1d2c04-ab9d-467a-8615-a2fa1c05247d tempest-ImagesDeleteNegativeTestJSON-1472567914 tempest-ImagesDeleteNegativeTestJSON-1472567914-project] Returning 404 to user: Image not found. {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:54:29.314759 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-bc1d2c04-ab9d-467a-8615-a2fa1c05247d tempest-ImagesDeleteNegativeTestJSON-1472567914 tempest-ImagesDeleteNegativeTestJSON-1472567914-project] 10.222.0.50 "DELETE /compute/v2.1/images/df67ec69-9a09-4fa6-867f-49bfc113100j" status: 404 len: 62 microversion: 2.1 time: 0.062292 Aug 10 17:54:29.316668 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 653/1298] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:54:29 2022] DELETE /compute/v2.1/images/df67ec69-9a09-4fa6-867f-49bfc113100j => generated 62 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 10 17:54:29.325717 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-79a91421-960b-42d0-b401-7d882962006c tempest-ImagesDeleteNegativeTestJSON-1472567914 tempest-ImagesDeleteNegativeTestJSON-1472567914-project] Calling method '.version_select at 0x7fb345b74700>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:54:29.345165 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-79a91421-960b-42d0-b401-7d882962006c tempest-ImagesDeleteNegativeTestJSON-1472567914 tempest-ImagesDeleteNegativeTestJSON-1472567914-project] HTTP exception thrown: Image not found. Aug 10 17:54:29.346919 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-79a91421-960b-42d0-b401-7d882962006c tempest-ImagesDeleteNegativeTestJSON-1472567914 tempest-ImagesDeleteNegativeTestJSON-1472567914-project] Request method failure captured: Aug 10 17:54:29.346919 n-d-852296-2 devstack@n-api.service[129410]: request: DELETE /compute/v2.1/images/c291a998-3335-4dd6-b636-763a5ab67b0f1 HTTP/1.1 Aug 10 17:54:29.346919 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 17:54:29.346919 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 17:54:29.346919 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 17:54:29.346919 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 0 Aug 10 17:54:29.346919 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 17:54:29.346919 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 17:54:29.346919 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 17:54:29.346919 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 17:54:29.346919 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8_DUojxwc8N8mS1kp0hFwFsywCLrL-TD5PgIIk9EdtzyNfhrP7GbddVyP8CFPW1UaDUfc8qjxA79VnL1YyBGeWfNaN-_WiSonWueDQg53UMbGLDpWbMnhdLhqCThJO_cN88cqhJffusaGx_SjGOczVeOw5PTN1a3rHXWpXBib4QTIGg Aug 10 17:54:29.346919 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 17:54:29.346919 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 17:54:29.346919 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 17:54:29.346919 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 17:54:29.346919 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 17:54:29.346919 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 17:54:29.346919 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: 7265a49b3414431080f35a127f7de841 Aug 10 17:54:29.346919 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1472567914 Aug 10 17:54:29.346919 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 17:54:29.346919 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 17:54:29.346919 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7265a49b3414431080f35a127f7de841"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/7265a49b3414431080f35a127f7de841"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7265a49b3414431080f35a127f7de841"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_7265a49b3414431080f35a127f7de841", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:54:29.346919 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1472567914 Aug 10 17:54:29.346919 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: 7265a49b3414431080f35a127f7de841 Aug 10 17:54:29.346919 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1472567914 Aug 10 17:54:29.346919 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-ImagesDeleteNegativeTestJSON-1472567914-project Aug 10 17:54:29.346919 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 17:54:29.346919 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 17:54:29.346919 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: 8e0cc43e8e9a4dcf9499b7e46f40b71f Aug 10 17:54:29.346919 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1472567914-project Aug 10 17:54:29.346919 n-d-852296-2 devstack@n-api.service[129410]: method: Aug 10 17:54:29.346919 n-d-852296-2 devstack@n-api.service[129410]: exception: Image not found. Aug 10 17:54:29.346919 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'id': 'c291a998-3335-4dd6-b636-763a5ab67b0f1'} Aug 10 17:54:29.346919 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:54:29.346919 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:29.346919 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 10 17:54:29.346919 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 10 17:54:29.346919 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 10 17:54:29.346919 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 10 17:54:29.346919 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 10 17:54:29.346919 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 10 17:54:29.346919 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 10 17:54:29.346919 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 10 17:54:29.346919 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 10 17:54:29.346919 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 10 17:54:29.346919 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 10 17:54:29.346919 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 10 17:54:29.346919 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 10 17:54:29.346919 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 10 17:54:29.346919 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image c291a998-3335-4dd6-b636-763a5ab67b0f1 to delete Aug 10 17:54:29.346919 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:54:29.346919 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:54:29.346919 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:54:29.346919 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:29.346919 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 10 17:54:29.346919 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 10 17:54:29.346919 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 10 17:54:29.346919 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 10 17:54:29.346919 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 10 17:54:29.346919 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 10 17:54:29.346919 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c291a998-3335-4dd6-b636-763a5ab67b0f1 could not be found. Aug 10 17:54:29.346919 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:54:29.346919 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:54:29.346919 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:54:29.352010 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:29.352010 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:54:29.352010 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:54:29.352010 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:54:29.352010 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:54:29.352010 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 17:54:29.352010 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 17:54:29.352010 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:54:29.352010 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:54:29.352010 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 10 17:54:29.352010 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 10 17:54:29.352010 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 10 17:54:29.352010 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:54:29.352010 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:54:29.352010 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:54:29.352010 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:29.352010 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:54:29.352010 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:54:29.352010 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:54:29.352010 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:54:29.352010 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 10 17:54:29.352010 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:54:29.352010 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-79a91421-960b-42d0-b401-7d882962006c tempest-ImagesDeleteNegativeTestJSON-1472567914 tempest-ImagesDeleteNegativeTestJSON-1472567914-project] Returning 404 to user: Image not found. {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:54:29.352010 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-79a91421-960b-42d0-b401-7d882962006c tempest-ImagesDeleteNegativeTestJSON-1472567914 tempest-ImagesDeleteNegativeTestJSON-1472567914-project] 10.222.0.50 "DELETE /compute/v2.1/images/c291a998-3335-4dd6-b636-763a5ab67b0f1" status: 404 len: 62 microversion: 2.1 time: 0.030025 Aug 10 17:54:29.361028 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-e0f3ee7a-f0d5-40bc-ae4e-974fec5f9e20 tempest-ImagesDeleteNegativeTestJSON-1472567914 tempest-ImagesDeleteNegativeTestJSON-1472567914-project] Calling method '.version_select at 0x7fb346015310>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:54:29.363527 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 646/1299] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 10 17:54:29 2022] DELETE /compute/v2.1/images/c291a998-3335-4dd6-b636-763a5ab67b0f1 => generated 62 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 10 17:54:29.391577 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-e0f3ee7a-f0d5-40bc-ae4e-974fec5f9e20 tempest-ImagesDeleteNegativeTestJSON-1472567914 tempest-ImagesDeleteNegativeTestJSON-1472567914-project] HTTP exception thrown: Image not found. Aug 10 17:54:29.393603 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-e0f3ee7a-f0d5-40bc-ae4e-974fec5f9e20 tempest-ImagesDeleteNegativeTestJSON-1472567914 tempest-ImagesDeleteNegativeTestJSON-1472567914-project] Request method failure captured: Aug 10 17:54:29.393603 n-d-852296-2 devstack@n-api.service[129409]: request: DELETE /compute/v2.1/images/tempest-invalid-1104898102 HTTP/1.1 Aug 10 17:54:29.393603 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 17:54:29.393603 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 17:54:29.393603 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 17:54:29.393603 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 0 Aug 10 17:54:29.393603 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 17:54:29.393603 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 17:54:29.393603 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 17:54:29.393603 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 17:54:29.393603 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8_DUojxwc8N8mS1kp0hFwFsywCLrL-TD5PgIIk9EdtzyNfhrP7GbddVyP8CFPW1UaDUfc8qjxA79VnL1YyBGeWfNaN-_WiSonWueDQg53UMbGLDpWbMnhdLhqCThJO_cN88cqhJffusaGx_SjGOczVeOw5PTN1a3rHXWpXBib4QTIGg Aug 10 17:54:29.393603 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 17:54:29.393603 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 17:54:29.393603 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 17:54:29.393603 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 17:54:29.393603 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 17:54:29.393603 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 17:54:29.393603 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: 7265a49b3414431080f35a127f7de841 Aug 10 17:54:29.393603 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1472567914 Aug 10 17:54:29.393603 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 17:54:29.393603 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 17:54:29.393603 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7265a49b3414431080f35a127f7de841"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/7265a49b3414431080f35a127f7de841"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7265a49b3414431080f35a127f7de841"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_7265a49b3414431080f35a127f7de841", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:54:29.393603 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1472567914 Aug 10 17:54:29.393603 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: 7265a49b3414431080f35a127f7de841 Aug 10 17:54:29.393603 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1472567914 Aug 10 17:54:29.393603 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-ImagesDeleteNegativeTestJSON-1472567914-project Aug 10 17:54:29.393603 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 17:54:29.393603 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 17:54:29.393603 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: 8e0cc43e8e9a4dcf9499b7e46f40b71f Aug 10 17:54:29.393603 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1472567914-project Aug 10 17:54:29.393603 n-d-852296-2 devstack@n-api.service[129409]: method: Aug 10 17:54:29.393603 n-d-852296-2 devstack@n-api.service[129409]: exception: Image not found. Aug 10 17:54:29.393603 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'id': 'tempest-invalid-1104898102'} Aug 10 17:54:29.393603 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:54:29.393603 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:29.393603 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 10 17:54:29.393603 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 10 17:54:29.393603 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 10 17:54:29.393603 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 10 17:54:29.393603 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 10 17:54:29.393603 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 10 17:54:29.393603 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 10 17:54:29.393603 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 10 17:54:29.393603 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 10 17:54:29.393603 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 10 17:54:29.393603 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 10 17:54:29.393603 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 10 17:54:29.393603 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 10 17:54:29.393603 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 10 17:54:29.393603 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-1104898102 to delete Aug 10 17:54:29.393603 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:29.393603 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:54:29.393603 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:29.393603 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:29.393603 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 10 17:54:29.393603 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 10 17:54:29.393603 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 10 17:54:29.393603 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 10 17:54:29.393603 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 10 17:54:29.393603 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 10 17:54:29.393603 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-1104898102 could not be found. Aug 10 17:54:29.393603 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:29.393603 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:54:29.393603 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:29.393603 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:29.404696 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:54:29.404696 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:54:29.404696 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:54:29.404696 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:54:29.404696 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 17:54:29.404696 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 17:54:29.404696 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:54:29.404696 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:54:29.404696 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 10 17:54:29.404696 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 10 17:54:29.404696 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 10 17:54:29.404696 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:29.404696 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:54:29.404696 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:29.404696 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:29.404696 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:54:29.404696 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:54:29.404696 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:54:29.404696 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:54:29.404696 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 10 17:54:29.404696 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:29.404696 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-e0f3ee7a-f0d5-40bc-ae4e-974fec5f9e20 tempest-ImagesDeleteNegativeTestJSON-1472567914 tempest-ImagesDeleteNegativeTestJSON-1472567914-project] Returning 404 to user: Image not found. {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:54:29.404696 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-e0f3ee7a-f0d5-40bc-ae4e-974fec5f9e20 tempest-ImagesDeleteNegativeTestJSON-1472567914 tempest-ImagesDeleteNegativeTestJSON-1472567914-project] 10.222.0.50 "DELETE /compute/v2.1/images/tempest-invalid-1104898102" status: 404 len: 62 microversion: 2.1 time: 0.038808 Aug 10 17:54:29.409833 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-62176e52-d762-4ce4-9fb5-ead06dec5ea2 tempest-ImagesDeleteNegativeTestJSON-1472567914 tempest-ImagesDeleteNegativeTestJSON-1472567914-project] Calling method '.version_select at 0x7fb345b61b80>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:54:29.414207 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 654/1300] 10.222.0.50 () {58 vars in 1206 bytes} [Wed Aug 10 17:54:29 2022] DELETE /compute/v2.1/images/tempest-invalid-1104898102 => generated 62 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 10 17:54:29.438590 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-62176e52-d762-4ce4-9fb5-ead06dec5ea2 tempest-ImagesDeleteNegativeTestJSON-1472567914 tempest-ImagesDeleteNegativeTestJSON-1472567914-project] HTTP exception thrown: Image not found. Aug 10 17:54:29.440483 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-62176e52-d762-4ce4-9fb5-ead06dec5ea2 tempest-ImagesDeleteNegativeTestJSON-1472567914 tempest-ImagesDeleteNegativeTestJSON-1472567914-project] Request method failure captured: Aug 10 17:54:29.440483 n-d-852296-2 devstack@n-api.service[129410]: request: DELETE /compute/v2.1/images/af32a887-c02a-44ca-8148-dffbaa99448a HTTP/1.1 Aug 10 17:54:29.440483 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 17:54:29.440483 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 17:54:29.440483 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 17:54:29.440483 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 0 Aug 10 17:54:29.440483 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 17:54:29.440483 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 17:54:29.440483 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 17:54:29.440483 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 17:54:29.440483 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8_DUojxwc8N8mS1kp0hFwFsywCLrL-TD5PgIIk9EdtzyNfhrP7GbddVyP8CFPW1UaDUfc8qjxA79VnL1YyBGeWfNaN-_WiSonWueDQg53UMbGLDpWbMnhdLhqCThJO_cN88cqhJffusaGx_SjGOczVeOw5PTN1a3rHXWpXBib4QTIGg Aug 10 17:54:29.440483 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 17:54:29.440483 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 17:54:29.440483 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 17:54:29.440483 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 17:54:29.440483 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 17:54:29.440483 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 17:54:29.440483 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: 7265a49b3414431080f35a127f7de841 Aug 10 17:54:29.440483 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1472567914 Aug 10 17:54:29.440483 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 17:54:29.440483 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 17:54:29.440483 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7265a49b3414431080f35a127f7de841"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/7265a49b3414431080f35a127f7de841"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7265a49b3414431080f35a127f7de841"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_7265a49b3414431080f35a127f7de841", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:54:29.440483 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1472567914 Aug 10 17:54:29.440483 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: 7265a49b3414431080f35a127f7de841 Aug 10 17:54:29.440483 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1472567914 Aug 10 17:54:29.440483 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-ImagesDeleteNegativeTestJSON-1472567914-project Aug 10 17:54:29.440483 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 17:54:29.440483 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 17:54:29.440483 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: 8e0cc43e8e9a4dcf9499b7e46f40b71f Aug 10 17:54:29.440483 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1472567914-project Aug 10 17:54:29.440483 n-d-852296-2 devstack@n-api.service[129410]: method: Aug 10 17:54:29.440483 n-d-852296-2 devstack@n-api.service[129410]: exception: Image not found. Aug 10 17:54:29.440483 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'id': 'af32a887-c02a-44ca-8148-dffbaa99448a'} Aug 10 17:54:29.440483 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:54:29.440483 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:29.440483 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 10 17:54:29.440483 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 10 17:54:29.440483 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 10 17:54:29.440483 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 10 17:54:29.440483 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 10 17:54:29.440483 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 10 17:54:29.440483 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 10 17:54:29.440483 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 10 17:54:29.440483 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 10 17:54:29.440483 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 10 17:54:29.440483 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 10 17:54:29.440483 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 10 17:54:29.440483 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 10 17:54:29.440483 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 10 17:54:29.440483 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image af32a887-c02a-44ca-8148-dffbaa99448a to delete Aug 10 17:54:29.440483 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:54:29.440483 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:54:29.440483 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:54:29.440483 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:29.440483 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 10 17:54:29.440483 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 10 17:54:29.440483 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 10 17:54:29.440483 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 10 17:54:29.440483 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 10 17:54:29.440483 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 10 17:54:29.440483 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image af32a887-c02a-44ca-8148-dffbaa99448a could not be found. Aug 10 17:54:29.440483 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:54:29.440483 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:54:29.440483 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:54:29.448107 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:29.448107 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:54:29.448107 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:54:29.448107 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:54:29.448107 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:54:29.448107 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 17:54:29.448107 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 17:54:29.448107 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:54:29.448107 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:54:29.448107 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 10 17:54:29.448107 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 10 17:54:29.448107 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 10 17:54:29.448107 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:54:29.448107 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:54:29.448107 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:54:29.448107 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:29.448107 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:54:29.448107 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:54:29.448107 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:54:29.448107 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:54:29.448107 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 10 17:54:29.448107 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:54:29.448107 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-62176e52-d762-4ce4-9fb5-ead06dec5ea2 tempest-ImagesDeleteNegativeTestJSON-1472567914 tempest-ImagesDeleteNegativeTestJSON-1472567914-project] Returning 404 to user: Image not found. {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:54:29.448107 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-62176e52-d762-4ce4-9fb5-ead06dec5ea2 tempest-ImagesDeleteNegativeTestJSON-1472567914 tempest-ImagesDeleteNegativeTestJSON-1472567914-project] 10.222.0.50 "DELETE /compute/v2.1/images/af32a887-c02a-44ca-8148-dffbaa99448a" status: 404 len: 62 microversion: 2.1 time: 0.038818 Aug 10 17:54:29.448107 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 647/1301] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:54:29 2022] DELETE /compute/v2.1/images/af32a887-c02a-44ca-8148-dffbaa99448a => generated 62 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 10 17:54:32.389900 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-61aadc81-4876-4e0e-90bf-2c7344212c87 tempest-ImagesTestJSON-338650746 tempest-ImagesTestJSON-338650746-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-2080627286", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "281ad327-3497-4601-a7be-cb62e0dcd014"}]}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:54:32.470268 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.network.neutron [None req-61aadc81-4876-4e0e-90bf-2c7344212c87 tempest-ImagesTestJSON-338650746 tempest-ImagesTestJSON-338650746-project] validate_networks() for [('281ad327-3497-4601-a7be-cb62e0dcd014', None, None, None, None, None)] {{(pid=129409) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 17:54:33.125920 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_cell1:SELECT=56 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:54:33.501615 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [None req-61aadc81-4876-4e0e-90bf-2c7344212c87 tempest-ImagesTestJSON-338650746 tempest-ImagesTestJSON-338650746-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-4f2f489a-5161-4fce-9628-9aff8fa025bb) Aug 10 17:54:33.501615 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:33.501615 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:54:33.501615 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:54:33.501615 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:54:33.501615 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:54:33.501615 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:54:33.501615 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:54:33.501615 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:54:33.501615 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:54:33.501615 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 17:54:33.501615 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 17:54:33.501615 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 17:54:33.501615 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 17:54:33.501615 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 17:54:33.501615 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 17:54:33.501615 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 17:54:33.501615 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 17:54:33.501615 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 17:54:33.501615 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 17:54:33.501615 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 17:54:33.501615 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 17:54:33.501615 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 17:54:33.501615 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 17:54:33.501615 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 17:54:33.501615 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 17:54:33.501615 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 17:54:33.501615 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:54:33.501615 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:54:33.501615 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 17:54:33.501615 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 17:54:33.501615 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:54:33.501615 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:54:33.501615 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:54:33.501615 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:54:33.501615 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:54:33.501615 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:54:33.501615 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:54:33.501615 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:54:33.501615 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:54:33.501615 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:54:33.501615 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 17:54:33.501615 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 17:54:33.501615 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 17:54:33.501615 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 17:54:33.501615 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 17:54:33.501615 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 17:54:33.501615 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 17:54:33.501615 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 17:54:33.501615 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 17:54:33.501615 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 17:54:33.501615 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 17:54:33.501615 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 17:54:33.505967 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 17:54:33.505967 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 17:54:33.505967 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 17:54:33.505967 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 17:54:33.505967 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 17:54:33.505967 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 17:54:33.505967 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 17:54:33.505967 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 17:54:33.505967 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 17:54:33.505967 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 17:54:33.505967 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 17:54:33.505967 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 17:54:33.505967 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 17:54:33.505967 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 17:54:33.505967 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-4f2f489a-5161-4fce-9628-9aff8fa025bb) Aug 10 17:54:33.505967 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:33.505967 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-61aadc81-4876-4e0e-90bf-2c7344212c87 tempest-ImagesTestJSON-338650746 tempest-ImagesTestJSON-338650746-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:54:33.505967 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:54:33.505967 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-61aadc81-4876-4e0e-90bf-2c7344212c87 tempest-ImagesTestJSON-338650746 tempest-ImagesTestJSON-338650746-project] Request method failure captured: Aug 10 17:54:33.505967 n-d-852296-2 devstack@n-api.service[129409]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 17:54:33.505967 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 17:54:33.505967 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 17:54:33.505967 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 17:54:33.505967 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 200 Aug 10 17:54:33.505967 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 17:54:33.505967 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 17:54:33.505967 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 17:54:33.505967 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 17:54:33.505967 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8_DVNhmG4av-2HdzU7SsTYhuJPKSeoQopQiUJr5rGWNGYDIq9uDxFoh8wtzwDFj6SNY3cN2WjyMtd2HyVixzeE95pvIkLFaWalZ0iG7v26ywSQS8oOlwzIytADNUAkE8JVJ5d6g6Oce0N7pPZa8XEyJqeqiUXVnUnZ61qJwNFsWitEI Aug 10 17:54:33.505967 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 17:54:33.505967 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 17:54:33.505967 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 17:54:33.505967 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 17:54:33.505967 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 17:54:33.505967 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 17:54:33.505967 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: a4a20ed151a648a6b816c0de87eb117e Aug 10 17:54:33.505967 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-ImagesTestJSON-338650746 Aug 10 17:54:33.505967 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 17:54:33.505967 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 17:54:33.505967 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a4a20ed151a648a6b816c0de87eb117e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a4a20ed151a648a6b816c0de87eb117e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a4a20ed151a648a6b816c0de87eb117e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a4a20ed151a648a6b816c0de87eb117e", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:54:33.505967 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-ImagesTestJSON-338650746 Aug 10 17:54:33.505967 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: a4a20ed151a648a6b816c0de87eb117e Aug 10 17:54:33.505967 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-ImagesTestJSON-338650746 Aug 10 17:54:33.505967 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-ImagesTestJSON-338650746-project Aug 10 17:54:33.505967 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 17:54:33.505967 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 17:54:33.505967 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: 6509cef8fdd54dba8b7a810addc63b61 Aug 10 17:54:33.505967 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-ImagesTestJSON-338650746-project Aug 10 17:54:33.505967 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:54:33.505967 n-d-852296-2 devstack@n-api.service[129409]: {"server": {"name": "tempest-ImagesTestJSON-server-2080627286", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "281ad327-3497-4601-a7be-cb62e0dcd014"}]}} Aug 10 17:54:33.505967 n-d-852296-2 devstack@n-api.service[129409]: method: > Aug 10 17:54:33.505967 n-d-852296-2 devstack@n-api.service[129409]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:54:33.505967 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:54:33.505967 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'body': {'server': {'name': 'tempest-ImagesTestJSON-server-2080627286', 'imageRef': 'a735ff26-463a-4ffe-a981-ab9d9baa494f', 'flavorRef': '452', 'networks': [{'uuid': '281ad327-3497-4601-a7be-cb62e0dcd014'}]}}} Aug 10 17:54:33.505967 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:54:33.505967 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:33.513532 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:54:33.513532 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:54:33.513532 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:54:33.513532 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:54:33.513532 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:54:33.513532 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:54:33.513532 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:54:33.513532 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:54:33.513532 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 17:54:33.513532 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 17:54:33.513532 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 17:54:33.513532 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 17:54:33.513532 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 17:54:33.513532 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 17:54:33.513532 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 17:54:33.513532 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 17:54:33.513532 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 17:54:33.513532 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 17:54:33.513532 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 17:54:33.513532 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 17:54:33.513532 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 17:54:33.513532 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 17:54:33.513532 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 17:54:33.513532 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 17:54:33.513532 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 17:54:33.513532 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:54:33.513532 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:54:33.513532 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 17:54:33.513532 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 17:54:33.513532 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:54:33.513532 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:54:33.513532 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:54:33.513532 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:54:33.513532 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:54:33.513532 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:54:33.513532 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:54:33.513532 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:54:33.513532 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:54:33.513532 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:54:33.513532 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 17:54:33.513532 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 17:54:33.513532 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 17:54:33.513532 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 17:54:33.513532 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 17:54:33.513532 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 17:54:33.513532 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 17:54:33.513532 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 17:54:33.513532 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 17:54:33.513532 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 17:54:33.513532 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 17:54:33.513532 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 17:54:33.513532 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 17:54:33.513532 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 17:54:33.513532 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 17:54:33.513532 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 17:54:33.522600 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 17:54:33.522600 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 17:54:33.522600 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 17:54:33.522600 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 17:54:33.522600 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 17:54:33.522600 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 17:54:33.522600 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 17:54:33.522600 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 17:54:33.522600 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 17:54:33.522600 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 17:54:33.522600 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-4f2f489a-5161-4fce-9628-9aff8fa025bb) Aug 10 17:54:33.522600 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:33.522600 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:54:33.522600 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:33.522600 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:33.522600 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:54:33.522600 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:54:33.522600 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:54:33.522600 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:54:33.522600 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 10 17:54:33.522600 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 10 17:54:33.522600 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:54:33.522600 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:33.522600 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:33.522600 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:54:33.522600 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:33.522600 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:33.522600 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:54:33.522600 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:54:33.522600 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:54:33.522600 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:54:33.522600 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:54:33.522600 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:33.522600 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:33.522600 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-61aadc81-4876-4e0e-90bf-2c7344212c87 tempest-ImagesTestJSON-338650746 tempest-ImagesTestJSON-338650746-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:54:33.522600 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:54:33.522600 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-61aadc81-4876-4e0e-90bf-2c7344212c87 tempest-ImagesTestJSON-338650746 tempest-ImagesTestJSON-338650746-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 2.148604 Aug 10 17:54:33.522600 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 655/1302] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 17:54:31 2022] POST /compute/v2.1/servers => generated 214 bytes in 2151 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 10 17:54:34.202456 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3,nova_api:UPDATE=7 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:54:34.208097 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-4cafcef7-b049-4521-8a09-5e834fb05533 tempest-ImagesTestJSON-338650746 tempest-ImagesTestJSON-338650746-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-656511487", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "281ad327-3497-4601-a7be-cb62e0dcd014"}]}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:54:34.253443 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:54:34.277192 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.network.neutron [None req-4cafcef7-b049-4521-8a09-5e834fb05533 tempest-ImagesTestJSON-338650746 tempest-ImagesTestJSON-338650746-project] validate_networks() for [('281ad327-3497-4601-a7be-cb62e0dcd014', None, None, None, None, None)] {{(pid=129410) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 17:54:34.955413 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [None req-4cafcef7-b049-4521-8a09-5e834fb05533 tempest-ImagesTestJSON-338650746 tempest-ImagesTestJSON-338650746-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-bbfb2ab6-0882-4755-b204-7a24b18a08a8) Aug 10 17:54:34.955413 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:34.955413 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:54:34.955413 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:54:34.955413 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:54:34.955413 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:54:34.955413 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:54:34.955413 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:54:34.955413 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:54:34.955413 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:54:34.955413 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 17:54:34.955413 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 17:54:34.955413 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 17:54:34.955413 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 17:54:34.955413 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 17:54:34.955413 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 17:54:34.955413 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 17:54:34.955413 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 17:54:34.955413 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 17:54:34.955413 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 17:54:34.955413 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 17:54:34.955413 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 17:54:34.955413 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 17:54:34.955413 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 17:54:34.955413 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 17:54:34.955413 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 17:54:34.955413 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 17:54:34.955413 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:54:34.955413 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:54:34.955413 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 17:54:34.955413 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 17:54:34.955413 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:54:34.955413 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:54:34.955413 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:54:34.955413 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:54:34.955413 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:54:34.955413 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:54:34.955413 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:54:34.955413 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:54:34.955413 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:54:34.955413 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:54:34.955413 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 17:54:34.955413 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 17:54:34.955413 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 17:54:34.955413 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 17:54:34.955413 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 17:54:34.955413 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 17:54:34.955413 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 17:54:34.955413 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 17:54:34.955413 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 17:54:34.955413 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 17:54:34.955413 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 17:54:34.955413 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 17:54:34.961752 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 17:54:34.961752 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 17:54:34.961752 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 17:54:34.961752 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 17:54:34.961752 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 17:54:34.961752 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 17:54:34.961752 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 17:54:34.961752 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 17:54:34.961752 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 17:54:34.961752 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 17:54:34.961752 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 17:54:34.961752 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 17:54:34.961752 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 17:54:34.961752 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 17:54:34.961752 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-bbfb2ab6-0882-4755-b204-7a24b18a08a8) Aug 10 17:54:34.961752 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:54:34.961752 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-4cafcef7-b049-4521-8a09-5e834fb05533 tempest-ImagesTestJSON-338650746 tempest-ImagesTestJSON-338650746-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:54:34.961752 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 17:54:34.961752 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-4cafcef7-b049-4521-8a09-5e834fb05533 tempest-ImagesTestJSON-338650746 tempest-ImagesTestJSON-338650746-project] Request method failure captured: Aug 10 17:54:34.961752 n-d-852296-2 devstack@n-api.service[129410]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 17:54:34.961752 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 17:54:34.961752 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 17:54:34.961752 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 17:54:34.961752 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 199 Aug 10 17:54:34.961752 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 17:54:34.961752 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 17:54:34.961752 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 17:54:34.961752 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 17:54:34.961752 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8_DVNhmG4av-2HdzU7SsTYhuJPKSeoQopQiUJr5rGWNGYDIq9uDxFoh8wtzwDFj6SNY3cN2WjyMtd2HyVixzeE95pvIkLFaWalZ0iG7v26ywSQS8oOlwzIytADNUAkE8JVJ5d6g6Oce0N7pPZa8XEyJqeqiUXVnUnZ61qJwNFsWitEI Aug 10 17:54:34.961752 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 17:54:34.961752 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 17:54:34.961752 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 17:54:34.961752 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 17:54:34.961752 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 17:54:34.961752 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 17:54:34.961752 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: a4a20ed151a648a6b816c0de87eb117e Aug 10 17:54:34.961752 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-ImagesTestJSON-338650746 Aug 10 17:54:34.961752 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 17:54:34.961752 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 17:54:34.961752 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a4a20ed151a648a6b816c0de87eb117e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a4a20ed151a648a6b816c0de87eb117e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a4a20ed151a648a6b816c0de87eb117e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a4a20ed151a648a6b816c0de87eb117e", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:54:34.961752 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-ImagesTestJSON-338650746 Aug 10 17:54:34.961752 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: a4a20ed151a648a6b816c0de87eb117e Aug 10 17:54:34.961752 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-ImagesTestJSON-338650746 Aug 10 17:54:34.961752 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-ImagesTestJSON-338650746-project Aug 10 17:54:34.961752 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 17:54:34.961752 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 17:54:34.961752 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: 6509cef8fdd54dba8b7a810addc63b61 Aug 10 17:54:34.961752 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-ImagesTestJSON-338650746-project Aug 10 17:54:34.961752 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 17:54:34.961752 n-d-852296-2 devstack@n-api.service[129410]: {"server": {"name": "tempest-ImagesTestJSON-server-656511487", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "281ad327-3497-4601-a7be-cb62e0dcd014"}]}} Aug 10 17:54:34.961752 n-d-852296-2 devstack@n-api.service[129410]: method: > Aug 10 17:54:34.961752 n-d-852296-2 devstack@n-api.service[129410]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:54:34.961752 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 17:54:34.961752 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'body': {'server': {'name': 'tempest-ImagesTestJSON-server-656511487', 'imageRef': 'a735ff26-463a-4ffe-a981-ab9d9baa494f', 'flavorRef': '452', 'networks': [{'uuid': '281ad327-3497-4601-a7be-cb62e0dcd014'}]}}} Aug 10 17:54:34.961752 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:54:34.961752 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:34.966873 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:54:34.966873 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:54:34.966873 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:54:34.966873 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:54:34.966873 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:54:34.966873 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:54:34.966873 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:54:34.966873 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:54:34.966873 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 17:54:34.966873 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 17:54:34.966873 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 17:54:34.966873 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 17:54:34.966873 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 17:54:34.966873 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 17:54:34.966873 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 17:54:34.966873 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 17:54:34.966873 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 17:54:34.966873 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 17:54:34.966873 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 17:54:34.966873 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 17:54:34.966873 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 17:54:34.966873 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 17:54:34.966873 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 17:54:34.966873 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 17:54:34.966873 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 17:54:34.966873 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:54:34.966873 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:54:34.966873 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 17:54:34.966873 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 17:54:34.966873 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:54:34.966873 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:54:34.966873 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:54:34.966873 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:54:34.966873 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:54:34.966873 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:54:34.966873 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:54:34.966873 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:54:34.966873 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:54:34.966873 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:54:34.966873 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 17:54:34.966873 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 17:54:34.966873 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 17:54:34.966873 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 17:54:34.966873 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 17:54:34.966873 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 17:54:34.966873 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 17:54:34.966873 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 17:54:34.966873 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 17:54:34.966873 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 17:54:34.966873 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 17:54:34.966873 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 17:54:34.966873 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 17:54:34.966873 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 17:54:34.966873 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 17:54:34.966873 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 17:54:34.971670 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 17:54:34.971670 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 17:54:34.971670 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 17:54:34.971670 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 17:54:34.971670 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 17:54:34.971670 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 17:54:34.971670 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 17:54:34.971670 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 17:54:34.971670 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 17:54:34.971670 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 17:54:34.971670 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-bbfb2ab6-0882-4755-b204-7a24b18a08a8) Aug 10 17:54:34.971670 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:54:34.971670 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:54:34.971670 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:54:34.971670 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:34.971670 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:54:34.971670 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:54:34.971670 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:54:34.971670 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:54:34.971670 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 10 17:54:34.971670 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 10 17:54:34.971670 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:54:34.971670 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:54:34.971670 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:54:34.971670 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:54:34.971670 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:54:34.971670 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:34.971670 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:54:34.971670 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:54:34.971670 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:54:34.971670 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:54:34.971670 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:54:34.971670 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:54:34.971670 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:54:34.971670 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-4cafcef7-b049-4521-8a09-5e834fb05533 tempest-ImagesTestJSON-338650746 tempest-ImagesTestJSON-338650746-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:54:34.971670 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:54:34.971670 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-4cafcef7-b049-4521-8a09-5e834fb05533 tempest-ImagesTestJSON-338650746 tempest-ImagesTestJSON-338650746-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.717396 Aug 10 17:54:34.971670 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 648/1303] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 17:54:34 2022] POST /compute/v2.1/servers => generated 214 bytes in 719 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 10 17:54:35.746601 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-ac898ee3-30a8-4969-99e1-09381f550224 tempest-ImagesTestJSON-338650746 tempest-ImagesTestJSON-338650746-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1217367476", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "281ad327-3497-4601-a7be-cb62e0dcd014"}]}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:54:35.810176 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.network.neutron [None req-ac898ee3-30a8-4969-99e1-09381f550224 tempest-ImagesTestJSON-338650746 tempest-ImagesTestJSON-338650746-project] validate_networks() for [('281ad327-3497-4601-a7be-cb62e0dcd014', None, None, None, None, None)] {{(pid=129409) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 17:54:36.451347 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [None req-ac898ee3-30a8-4969-99e1-09381f550224 tempest-ImagesTestJSON-338650746 tempest-ImagesTestJSON-338650746-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-914d8a50-6c07-4413-b866-5055f5fdd478) Aug 10 17:54:36.451347 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:36.451347 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:54:36.451347 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:54:36.451347 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:54:36.451347 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:54:36.451347 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:54:36.451347 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:54:36.451347 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:54:36.451347 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:54:36.451347 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 17:54:36.451347 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 17:54:36.451347 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 17:54:36.451347 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 17:54:36.451347 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 17:54:36.451347 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 17:54:36.451347 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 17:54:36.451347 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 17:54:36.451347 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 17:54:36.451347 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 17:54:36.451347 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 17:54:36.451347 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 17:54:36.451347 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 17:54:36.451347 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 17:54:36.451347 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 17:54:36.451347 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 17:54:36.451347 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 17:54:36.451347 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:54:36.451347 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:54:36.451347 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 17:54:36.451347 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 17:54:36.451347 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:54:36.451347 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:54:36.451347 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:54:36.451347 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:54:36.451347 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:54:36.451347 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:54:36.451347 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:54:36.451347 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:54:36.451347 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:54:36.451347 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:54:36.451347 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 17:54:36.451347 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 17:54:36.451347 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 17:54:36.451347 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 17:54:36.451347 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 17:54:36.451347 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 17:54:36.451347 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 17:54:36.451347 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 17:54:36.451347 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 17:54:36.451347 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 17:54:36.451347 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 17:54:36.451347 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 17:54:36.455436 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 17:54:36.455436 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 17:54:36.455436 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 17:54:36.455436 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 17:54:36.455436 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 17:54:36.455436 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 17:54:36.455436 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 17:54:36.455436 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 17:54:36.455436 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 17:54:36.455436 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 17:54:36.455436 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 17:54:36.455436 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 17:54:36.455436 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 17:54:36.455436 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 17:54:36.455436 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-914d8a50-6c07-4413-b866-5055f5fdd478) Aug 10 17:54:36.455436 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:36.455436 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-ac898ee3-30a8-4969-99e1-09381f550224 tempest-ImagesTestJSON-338650746 tempest-ImagesTestJSON-338650746-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:54:36.455436 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:54:36.455436 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-ac898ee3-30a8-4969-99e1-09381f550224 tempest-ImagesTestJSON-338650746 tempest-ImagesTestJSON-338650746-project] Request method failure captured: Aug 10 17:54:36.455436 n-d-852296-2 devstack@n-api.service[129409]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 17:54:36.455436 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 17:54:36.455436 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 17:54:36.455436 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 17:54:36.455436 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 200 Aug 10 17:54:36.455436 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 17:54:36.455436 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 17:54:36.455436 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 17:54:36.455436 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 17:54:36.455436 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8_DVNhmG4av-2HdzU7SsTYhuJPKSeoQopQiUJr5rGWNGYDIq9uDxFoh8wtzwDFj6SNY3cN2WjyMtd2HyVixzeE95pvIkLFaWalZ0iG7v26ywSQS8oOlwzIytADNUAkE8JVJ5d6g6Oce0N7pPZa8XEyJqeqiUXVnUnZ61qJwNFsWitEI Aug 10 17:54:36.455436 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 17:54:36.455436 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 17:54:36.455436 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 17:54:36.455436 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 17:54:36.455436 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 17:54:36.455436 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 17:54:36.455436 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: a4a20ed151a648a6b816c0de87eb117e Aug 10 17:54:36.455436 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-ImagesTestJSON-338650746 Aug 10 17:54:36.455436 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 17:54:36.455436 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 17:54:36.455436 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a4a20ed151a648a6b816c0de87eb117e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a4a20ed151a648a6b816c0de87eb117e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a4a20ed151a648a6b816c0de87eb117e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a4a20ed151a648a6b816c0de87eb117e", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:54:36.455436 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-ImagesTestJSON-338650746 Aug 10 17:54:36.455436 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: a4a20ed151a648a6b816c0de87eb117e Aug 10 17:54:36.455436 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-ImagesTestJSON-338650746 Aug 10 17:54:36.455436 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-ImagesTestJSON-338650746-project Aug 10 17:54:36.455436 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 17:54:36.455436 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 17:54:36.455436 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: 6509cef8fdd54dba8b7a810addc63b61 Aug 10 17:54:36.455436 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-ImagesTestJSON-338650746-project Aug 10 17:54:36.455436 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:54:36.455436 n-d-852296-2 devstack@n-api.service[129409]: {"server": {"name": "tempest-ImagesTestJSON-server-1217367476", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "281ad327-3497-4601-a7be-cb62e0dcd014"}]}} Aug 10 17:54:36.455436 n-d-852296-2 devstack@n-api.service[129409]: method: > Aug 10 17:54:36.455436 n-d-852296-2 devstack@n-api.service[129409]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:54:36.455436 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:54:36.455436 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'body': {'server': {'name': 'tempest-ImagesTestJSON-server-1217367476', 'imageRef': 'a735ff26-463a-4ffe-a981-ab9d9baa494f', 'flavorRef': '452', 'networks': [{'uuid': '281ad327-3497-4601-a7be-cb62e0dcd014'}]}}} Aug 10 17:54:36.455436 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:54:36.455436 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:36.460788 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:54:36.460788 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:54:36.460788 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:54:36.460788 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:54:36.460788 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:54:36.460788 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:54:36.460788 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:54:36.460788 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:54:36.460788 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 17:54:36.460788 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 17:54:36.460788 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 17:54:36.460788 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 17:54:36.460788 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 17:54:36.460788 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 17:54:36.460788 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 17:54:36.460788 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 17:54:36.460788 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 17:54:36.460788 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 17:54:36.460788 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 17:54:36.460788 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 17:54:36.460788 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 17:54:36.460788 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 17:54:36.460788 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 17:54:36.460788 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 17:54:36.460788 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 17:54:36.460788 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:54:36.460788 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:54:36.460788 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 17:54:36.460788 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 17:54:36.460788 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:54:36.460788 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:54:36.460788 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:54:36.460788 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:54:36.460788 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:54:36.460788 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:54:36.460788 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:54:36.460788 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:54:36.460788 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:54:36.460788 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:54:36.460788 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 17:54:36.460788 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 17:54:36.460788 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 17:54:36.460788 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 17:54:36.460788 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 17:54:36.460788 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 17:54:36.460788 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 17:54:36.460788 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 17:54:36.460788 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 17:54:36.460788 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 17:54:36.460788 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 17:54:36.460788 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 17:54:36.460788 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 17:54:36.460788 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 17:54:36.460788 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 17:54:36.460788 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 17:54:36.465659 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 17:54:36.465659 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 17:54:36.465659 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 17:54:36.465659 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 17:54:36.465659 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 17:54:36.465659 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 17:54:36.465659 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 17:54:36.465659 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 17:54:36.465659 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 17:54:36.465659 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 17:54:36.465659 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-914d8a50-6c07-4413-b866-5055f5fdd478) Aug 10 17:54:36.465659 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:36.465659 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:54:36.465659 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:36.465659 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:36.465659 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:54:36.465659 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:54:36.465659 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:54:36.465659 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:54:36.465659 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 10 17:54:36.465659 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 10 17:54:36.465659 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:54:36.465659 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:36.465659 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:36.465659 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:54:36.465659 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:36.465659 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:36.465659 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:54:36.465659 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:54:36.465659 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:54:36.465659 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:54:36.465659 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:54:36.465659 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:36.465659 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:36.465659 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-ac898ee3-30a8-4969-99e1-09381f550224 tempest-ImagesTestJSON-338650746 tempest-ImagesTestJSON-338650746-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:54:36.465659 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:54:36.465659 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-ac898ee3-30a8-4969-99e1-09381f550224 tempest-ImagesTestJSON-338650746 tempest-ImagesTestJSON-338650746-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.715539 Aug 10 17:54:36.465659 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 656/1304] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 17:54:35 2022] POST /compute/v2.1/servers => generated 214 bytes in 717 msecs (HTTP/1.1 500) 9 headers in 391 bytes (2 switches on core 0) Aug 10 17:54:36.774925 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-ebfff3b3-9596-42c9-98a9-ad44114e3284 tempest-ImagesTestJSON-338650746 tempest-ImagesTestJSON-338650746-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-541401509", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "281ad327-3497-4601-a7be-cb62e0dcd014"}]}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:54:36.832951 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.network.neutron [None req-ebfff3b3-9596-42c9-98a9-ad44114e3284 tempest-ImagesTestJSON-338650746 tempest-ImagesTestJSON-338650746-project] validate_networks() for [('281ad327-3497-4601-a7be-cb62e0dcd014', None, None, None, None, None)] {{(pid=129409) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 17:54:37.253468 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-0375ac46-e142-4495-a171-f99e0b93fde1 tempest-AttachSCSIVolumeTestJSON-37533962 tempest-AttachSCSIVolumeTestJSON-37533962-project] Action: 'create', calling method: .version_select at 0x7fb345bc48b0>, body: {"keypair": {"name": "tempest-keypair-1866649603", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGvY8n+CYenO2AKHvpdRGmotzRwo+AKkXkY+SvnMJeNgmntelYVZRREy4L9H39Xpwca3VV0ZxRlAAEZJ7FAsFXG1O/6HVi04G29rXJm8I2uJOFu+ALUpGPiLpqjpb9iLGg=="}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:54:37.271606 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.quota [None req-0375ac46-e142-4495-a171-f99e0b93fde1 tempest-AttachSCSIVolumeTestJSON-37533962 tempest-AttachSCSIVolumeTestJSON-37533962-project] Getting quotas for project c9882a16473b434c8f1b5dec3c2e7218. Resources: {'key_pairs'} {{(pid=129410) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:54:37.277937 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.quota [None req-0375ac46-e142-4495-a171-f99e0b93fde1 tempest-AttachSCSIVolumeTestJSON-37533962 tempest-AttachSCSIVolumeTestJSON-37533962-project] Getting quotas for user b0ba04bf1c5245d7bf01c1cccbbfdb72 and project c9882a16473b434c8f1b5dec3c2e7218. Resources: {'key_pairs'} {{(pid=129410) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:54:37.425016 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-0375ac46-e142-4495-a171-f99e0b93fde1 tempest-AttachSCSIVolumeTestJSON-37533962 tempest-AttachSCSIVolumeTestJSON-37533962-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.735545 Aug 10 17:54:37.432599 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 649/1305] 10.222.0.50 () {60 vars in 1159 bytes} [Wed Aug 10 17:54:36 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:54:37.452173 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [None req-ebfff3b3-9596-42c9-98a9-ad44114e3284 tempest-ImagesTestJSON-338650746 tempest-ImagesTestJSON-338650746-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-a28ff932-d347-4f2e-aa2e-5212ad10387a) Aug 10 17:54:37.452173 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:37.452173 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:54:37.452173 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:54:37.452173 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:54:37.452173 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:54:37.452173 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:54:37.452173 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:54:37.452173 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:54:37.452173 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:54:37.452173 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 17:54:37.452173 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 17:54:37.452173 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 17:54:37.452173 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 17:54:37.452173 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 17:54:37.452173 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 17:54:37.452173 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 17:54:37.452173 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 17:54:37.452173 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 17:54:37.452173 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 17:54:37.452173 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 17:54:37.452173 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 17:54:37.452173 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 17:54:37.452173 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 17:54:37.452173 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 17:54:37.452173 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 17:54:37.452173 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 17:54:37.452173 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:54:37.452173 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:54:37.452173 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 17:54:37.452173 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 17:54:37.452173 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:54:37.452173 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:54:37.452173 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:54:37.452173 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:54:37.452173 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:54:37.452173 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:54:37.452173 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:54:37.452173 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:54:37.452173 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:54:37.452173 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:54:37.452173 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 17:54:37.452173 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 17:54:37.452173 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 17:54:37.452173 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 17:54:37.452173 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 17:54:37.452173 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 17:54:37.452173 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 17:54:37.452173 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 17:54:37.452173 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 17:54:37.452173 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 17:54:37.452173 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 17:54:37.452173 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 17:54:37.457050 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 17:54:37.457050 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 17:54:37.457050 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 17:54:37.457050 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 17:54:37.457050 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 17:54:37.457050 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 17:54:37.457050 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 17:54:37.457050 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 17:54:37.457050 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 17:54:37.457050 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 17:54:37.457050 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 17:54:37.457050 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 17:54:37.457050 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 17:54:37.457050 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 17:54:37.457050 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-a28ff932-d347-4f2e-aa2e-5212ad10387a) Aug 10 17:54:37.457050 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:37.457050 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-ebfff3b3-9596-42c9-98a9-ad44114e3284 tempest-ImagesTestJSON-338650746 tempest-ImagesTestJSON-338650746-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:54:37.457050 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:54:37.458533 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-ebfff3b3-9596-42c9-98a9-ad44114e3284 tempest-ImagesTestJSON-338650746 tempest-ImagesTestJSON-338650746-project] Request method failure captured: Aug 10 17:54:37.458533 n-d-852296-2 devstack@n-api.service[129409]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 17:54:37.458533 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 17:54:37.458533 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 17:54:37.458533 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 17:54:37.458533 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 199 Aug 10 17:54:37.458533 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 17:54:37.458533 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 17:54:37.458533 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 17:54:37.458533 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 17:54:37.458533 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8_DVNhmG4av-2HdzU7SsTYhuJPKSeoQopQiUJr5rGWNGYDIq9uDxFoh8wtzwDFj6SNY3cN2WjyMtd2HyVixzeE95pvIkLFaWalZ0iG7v26ywSQS8oOlwzIytADNUAkE8JVJ5d6g6Oce0N7pPZa8XEyJqeqiUXVnUnZ61qJwNFsWitEI Aug 10 17:54:37.458533 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 17:54:37.458533 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 17:54:37.458533 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 17:54:37.458533 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 17:54:37.458533 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 17:54:37.458533 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 17:54:37.458533 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: a4a20ed151a648a6b816c0de87eb117e Aug 10 17:54:37.458533 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-ImagesTestJSON-338650746 Aug 10 17:54:37.458533 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 17:54:37.458533 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 17:54:37.458533 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a4a20ed151a648a6b816c0de87eb117e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a4a20ed151a648a6b816c0de87eb117e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a4a20ed151a648a6b816c0de87eb117e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a4a20ed151a648a6b816c0de87eb117e", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:54:37.458533 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-ImagesTestJSON-338650746 Aug 10 17:54:37.458533 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: a4a20ed151a648a6b816c0de87eb117e Aug 10 17:54:37.458533 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-ImagesTestJSON-338650746 Aug 10 17:54:37.458533 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-ImagesTestJSON-338650746-project Aug 10 17:54:37.458533 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 17:54:37.458533 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 17:54:37.458533 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: 6509cef8fdd54dba8b7a810addc63b61 Aug 10 17:54:37.458533 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-ImagesTestJSON-338650746-project Aug 10 17:54:37.458533 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:54:37.458533 n-d-852296-2 devstack@n-api.service[129409]: {"server": {"name": "tempest-ImagesTestJSON-server-541401509", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "281ad327-3497-4601-a7be-cb62e0dcd014"}]}} Aug 10 17:54:37.458533 n-d-852296-2 devstack@n-api.service[129409]: method: > Aug 10 17:54:37.458533 n-d-852296-2 devstack@n-api.service[129409]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:54:37.458533 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:54:37.458533 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'body': {'server': {'name': 'tempest-ImagesTestJSON-server-541401509', 'imageRef': 'a735ff26-463a-4ffe-a981-ab9d9baa494f', 'flavorRef': '452', 'networks': [{'uuid': '281ad327-3497-4601-a7be-cb62e0dcd014'}]}}} Aug 10 17:54:37.458533 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:54:37.458533 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:37.458533 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:54:37.458533 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:54:37.458533 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:54:37.458533 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:54:37.458533 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:54:37.458533 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:54:37.458533 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:54:37.458533 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:54:37.458533 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 17:54:37.458533 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 17:54:37.458533 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 17:54:37.458533 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 17:54:37.458533 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 17:54:37.458533 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 17:54:37.458533 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 17:54:37.458533 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 17:54:37.458533 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 17:54:37.458533 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 17:54:37.458533 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 17:54:37.458533 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 17:54:37.458533 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 17:54:37.458533 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 17:54:37.458533 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 17:54:37.458533 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 17:54:37.476717 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 17:54:37.476717 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:54:37.476717 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:54:37.476717 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 17:54:37.476717 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 17:54:37.476717 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:54:37.476717 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:54:37.476717 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:54:37.476717 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:54:37.476717 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:54:37.476717 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:54:37.476717 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:54:37.476717 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:54:37.476717 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:54:37.476717 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:54:37.476717 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 17:54:37.476717 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 17:54:37.476717 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 17:54:37.476717 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 17:54:37.476717 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 17:54:37.476717 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 17:54:37.476717 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 17:54:37.476717 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 17:54:37.476717 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 17:54:37.476717 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 17:54:37.476717 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 17:54:37.476717 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 17:54:37.476717 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 17:54:37.476717 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 17:54:37.476717 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 17:54:37.476717 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 17:54:37.476717 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 17:54:37.476717 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 17:54:37.476717 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 17:54:37.476717 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 17:54:37.476717 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 17:54:37.476717 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 17:54:37.476717 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 17:54:37.476717 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 17:54:37.476717 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 17:54:37.476717 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 17:54:37.476717 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-a28ff932-d347-4f2e-aa2e-5212ad10387a) Aug 10 17:54:37.476717 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:37.476717 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:54:37.476717 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:37.476717 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:37.476717 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:54:37.476717 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:54:37.476717 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:54:37.476717 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:54:37.476717 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 10 17:54:37.476717 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 10 17:54:37.476717 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:54:37.481221 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:37.481221 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:37.481221 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:54:37.481221 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:37.481221 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:37.481221 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:54:37.481221 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:54:37.481221 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:54:37.481221 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:54:37.481221 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:54:37.481221 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:37.481221 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:37.481221 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-ebfff3b3-9596-42c9-98a9-ad44114e3284 tempest-ImagesTestJSON-338650746 tempest-ImagesTestJSON-338650746-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:54:37.481221 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:54:37.481221 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-ebfff3b3-9596-42c9-98a9-ad44114e3284 tempest-ImagesTestJSON-338650746 tempest-ImagesTestJSON-338650746-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.689378 Aug 10 17:54:37.481221 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 657/1306] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 17:54:36 2022] POST /compute/v2.1/servers => generated 214 bytes in 691 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 10 17:54:38.018648 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-cafdeeaa-0448-45b0-940e-24494a2cf96d tempest-QuotasAdminNegativeTest-1442736489 tempest-QuotasAdminNegativeTest-1442736489-project-admin] Calling method '.version_select at 0x7fb345ad3ca0>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:54:38.262739 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-cb40bc67-a2f4-4b05-9e31-0eb135c54175 tempest-ServicesAdminNegativeV253TestJSON-1671924197 tempest-ServicesAdminNegativeV253TestJSON-1671924197-project-admin] Action: 'update', calling method: .version_select at 0x7fb345f5e310>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:54:38.265746 n-d-852296-2 devstack@n-api.service[129409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:54:38.265746 n-d-852296-2 devstack@n-api.service[129409]: warnings.warn(msg) Aug 10 17:54:38.266820 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-cb40bc67-a2f4-4b05-9e31-0eb135c54175 tempest-ServicesAdminNegativeV253TestJSON-1671924197 tempest-ServicesAdminNegativeV253TestJSON-1671924197-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:38.267504 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-cb40bc67-a2f4-4b05-9e31-0eb135c54175 tempest-ServicesAdminNegativeV253TestJSON-1671924197 tempest-ServicesAdminNegativeV253TestJSON-1671924197-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:38.267961 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-cb40bc67-a2f4-4b05-9e31-0eb135c54175 tempest-ServicesAdminNegativeV253TestJSON-1671924197 tempest-ServicesAdminNegativeV253TestJSON-1671924197-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:38.289139 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-cb40bc67-a2f4-4b05-9e31-0eb135c54175 tempest-ServicesAdminNegativeV253TestJSON-1671924197 tempest-ServicesAdminNegativeV253TestJSON-1671924197-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:38.289899 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-cb40bc67-a2f4-4b05-9e31-0eb135c54175 tempest-ServicesAdminNegativeV253TestJSON-1671924197 tempest-ServicesAdminNegativeV253TestJSON-1671924197-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:38.290950 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-cb40bc67-a2f4-4b05-9e31-0eb135c54175 tempest-ServicesAdminNegativeV253TestJSON-1671924197 tempest-ServicesAdminNegativeV253TestJSON-1671924197-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:38.298249 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-cb40bc67-a2f4-4b05-9e31-0eb135c54175 tempest-ServicesAdminNegativeV253TestJSON-1671924197 tempest-ServicesAdminNegativeV253TestJSON-1671924197-project-admin] HTTP exception thrown: Service 49796a6e-1593-43b6-8c13-f77b1319ea3a could not be found. Aug 10 17:54:38.300213 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-cb40bc67-a2f4-4b05-9e31-0eb135c54175 tempest-ServicesAdminNegativeV253TestJSON-1671924197 tempest-ServicesAdminNegativeV253TestJSON-1671924197-project-admin] Request method failure captured: Aug 10 17:54:38.300213 n-d-852296-2 devstack@n-api.service[129409]: request: PUT /compute/v2.1/os-services/49796a6e-1593-43b6-8c13-f77b1319ea3a HTTP/1.1 Aug 10 17:54:38.300213 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 17:54:38.300213 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 17:54:38.300213 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 17:54:38.300213 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 56 Aug 10 17:54:38.300213 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 17:54:38.300213 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 17:54:38.300213 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 17:54:38.300213 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 17:54:38.300213 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8_DdpBIfZMYZCg9-G9ELd6-F9IR1AerGXmWe1hPYQx5E8KBRJYQI5O9gmRP_S3ZIpCxarqRSQhi5BrgNfR5LEavbsB7E7nBSP4YvSpE7Ym-LP1_0b3VJUvCUIhAt2TjRh7bfN8H0VNGv9B66G1s1IoOGGqj7VvbaI3tZRxrSEM-fkaI Aug 10 17:54:38.300213 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 17:54:38.300213 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 17:54:38.300213 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 17:54:38.300213 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 17:54:38.300213 n-d-852296-2 devstack@n-api.service[129409]: X-Openstack-Nova-Api-Version: 2.53 Aug 10 17:54:38.300213 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 17:54:38.300213 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 17:54:38.300213 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: fdf59894cf61482eab3ea6608b106f1c Aug 10 17:54:38.300213 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1671924197 Aug 10 17:54:38.300213 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member,admin Aug 10 17:54:38.300213 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member,admin Aug 10 17:54:38.300213 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/fdf59894cf61482eab3ea6608b106f1c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/fdf59894cf61482eab3ea6608b106f1c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/fdf59894cf61482eab3ea6608b106f1c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_fdf59894cf61482eab3ea6608b106f1c", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:54:38.300213 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1671924197 Aug 10 17:54:38.300213 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: fdf59894cf61482eab3ea6608b106f1c Aug 10 17:54:38.300213 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1671924197 Aug 10 17:54:38.300213 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1671924197-project-admin Aug 10 17:54:38.300213 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 17:54:38.300213 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 17:54:38.300213 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: 6063beabeefc470bbfc9ebc527c26f26 Aug 10 17:54:38.300213 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1671924197-project-admin Aug 10 17:54:38.300213 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:54:38.300213 n-d-852296-2 devstack@n-api.service[129409]: {"status": "disabled", "disabled_reason": "maintenance"} Aug 10 17:54:38.300213 n-d-852296-2 devstack@n-api.service[129409]: method: Aug 10 17:54:38.300213 n-d-852296-2 devstack@n-api.service[129409]: exception: Service 49796a6e-1593-43b6-8c13-f77b1319ea3a could not be found. Aug 10 17:54:38.300213 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'id': '49796a6e-1593-43b6-8c13-f77b1319ea3a', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Aug 10 17:54:38.300213 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:54:38.300213 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:38.300213 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6157, in service_get_by_id Aug 10 17:54:38.300213 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Aug 10 17:54:38.300213 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6017, in _find_service_in_cell Aug 10 17:54:38.300213 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 10 17:54:38.300213 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 10 17:54:38.300213 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:38.300213 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:54:38.300213 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:38.300213 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:38.300213 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Aug 10 17:54:38.300213 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Aug 10 17:54:38.300213 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6159, in service_get_by_id Aug 10 17:54:38.300213 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Aug 10 17:54:38.300213 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 49796a6e-1593-43b6-8c13-f77b1319ea3a could not be found. Aug 10 17:54:38.300213 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:38.300213 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:54:38.300213 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:38.300213 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:38.300213 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:54:38.300213 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:54:38.300213 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:54:38.300213 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:54:38.300213 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 17:54:38.300213 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 17:54:38.300213 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:54:38.300213 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:54:38.300213 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:54:38.300213 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:54:38.305868 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Aug 10 17:54:38.305868 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:54:38.305868 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 49796a6e-1593-43b6-8c13-f77b1319ea3a could not be found. Aug 10 17:54:38.305868 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:38.305868 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:54:38.305868 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:38.305868 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:38.305868 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:54:38.305868 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:54:38.305868 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:54:38.305868 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:54:38.305868 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 49796a6e-1593-43b6-8c13-f77b1319ea3a could not be found. Aug 10 17:54:38.305868 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:38.305868 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-cb40bc67-a2f4-4b05-9e31-0eb135c54175 tempest-ServicesAdminNegativeV253TestJSON-1671924197 tempest-ServicesAdminNegativeV253TestJSON-1671924197-project-admin] Returning 404 to user: Service 49796a6e-1593-43b6-8c13-f77b1319ea3a could not be found. {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:54:38.305868 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-cb40bc67-a2f4-4b05-9e31-0eb135c54175 tempest-ServicesAdminNegativeV253TestJSON-1671924197 tempest-ServicesAdminNegativeV253TestJSON-1671924197-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-services/49796a6e-1593-43b6-8c13-f77b1319ea3a" status: 404 len: 110 microversion: 2.53 time: 0.241488 Aug 10 17:54:38.305868 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 658/1307] 10.222.0.50 () {62 vars in 1309 bytes} [Wed Aug 10 17:54:38 2022] PUT /compute/v2.1/os-services/49796a6e-1593-43b6-8c13-f77b1319ea3a => generated 110 bytes in 243 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 10 17:54:38.314167 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-482155e8-e2da-49f4-9d38-97403126b9cb tempest-ServicesAdminNegativeV253TestJSON-1671924197 tempest-ServicesAdminNegativeV253TestJSON-1671924197-project-admin] Action: 'update', calling method: .version_select at 0x7fb3460159d0>, body: {"status": "disabled"} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:54:38.317773 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-482155e8-e2da-49f4-9d38-97403126b9cb tempest-ServicesAdminNegativeV253TestJSON-1671924197 tempest-ServicesAdminNegativeV253TestJSON-1671924197-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:38.318606 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-482155e8-e2da-49f4-9d38-97403126b9cb tempest-ServicesAdminNegativeV253TestJSON-1671924197 tempest-ServicesAdminNegativeV253TestJSON-1671924197-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:38.319287 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-482155e8-e2da-49f4-9d38-97403126b9cb tempest-ServicesAdminNegativeV253TestJSON-1671924197 tempest-ServicesAdminNegativeV253TestJSON-1671924197-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:38.325792 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-482155e8-e2da-49f4-9d38-97403126b9cb tempest-ServicesAdminNegativeV253TestJSON-1671924197 tempest-ServicesAdminNegativeV253TestJSON-1671924197-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:38.326482 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-482155e8-e2da-49f4-9d38-97403126b9cb tempest-ServicesAdminNegativeV253TestJSON-1671924197 tempest-ServicesAdminNegativeV253TestJSON-1671924197-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:38.327083 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-482155e8-e2da-49f4-9d38-97403126b9cb tempest-ServicesAdminNegativeV253TestJSON-1671924197 tempest-ServicesAdminNegativeV253TestJSON-1671924197-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:38.335317 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-482155e8-e2da-49f4-9d38-97403126b9cb tempest-ServicesAdminNegativeV253TestJSON-1671924197 tempest-ServicesAdminNegativeV253TestJSON-1671924197-project-admin] HTTP exception thrown: Service 49796a6e-1593-43b6-8c13-f77b1319ea3a could not be found. Aug 10 17:54:38.337244 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-482155e8-e2da-49f4-9d38-97403126b9cb tempest-ServicesAdminNegativeV253TestJSON-1671924197 tempest-ServicesAdminNegativeV253TestJSON-1671924197-project-admin] Request method failure captured: Aug 10 17:54:38.337244 n-d-852296-2 devstack@n-api.service[129409]: request: PUT /compute/v2.1/os-services/49796a6e-1593-43b6-8c13-f77b1319ea3a HTTP/1.1 Aug 10 17:54:38.337244 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 17:54:38.337244 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 17:54:38.337244 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 17:54:38.337244 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 22 Aug 10 17:54:38.337244 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 17:54:38.337244 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 17:54:38.337244 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 17:54:38.337244 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 17:54:38.337244 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8_DdpBIfZMYZCg9-G9ELd6-F9IR1AerGXmWe1hPYQx5E8KBRJYQI5O9gmRP_S3ZIpCxarqRSQhi5BrgNfR5LEavbsB7E7nBSP4YvSpE7Ym-LP1_0b3VJUvCUIhAt2TjRh7bfN8H0VNGv9B66G1s1IoOGGqj7VvbaI3tZRxrSEM-fkaI Aug 10 17:54:38.337244 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 17:54:38.337244 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 17:54:38.337244 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 17:54:38.337244 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 17:54:38.337244 n-d-852296-2 devstack@n-api.service[129409]: X-Openstack-Nova-Api-Version: 2.53 Aug 10 17:54:38.337244 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 17:54:38.337244 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 17:54:38.337244 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: fdf59894cf61482eab3ea6608b106f1c Aug 10 17:54:38.337244 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1671924197 Aug 10 17:54:38.337244 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member,admin Aug 10 17:54:38.337244 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member,admin Aug 10 17:54:38.337244 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/fdf59894cf61482eab3ea6608b106f1c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/fdf59894cf61482eab3ea6608b106f1c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/fdf59894cf61482eab3ea6608b106f1c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_fdf59894cf61482eab3ea6608b106f1c", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:54:38.337244 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1671924197 Aug 10 17:54:38.337244 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: fdf59894cf61482eab3ea6608b106f1c Aug 10 17:54:38.337244 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1671924197 Aug 10 17:54:38.337244 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1671924197-project-admin Aug 10 17:54:38.337244 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 17:54:38.337244 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 17:54:38.337244 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: 6063beabeefc470bbfc9ebc527c26f26 Aug 10 17:54:38.337244 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1671924197-project-admin Aug 10 17:54:38.337244 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:54:38.337244 n-d-852296-2 devstack@n-api.service[129409]: {"status": "disabled"} Aug 10 17:54:38.337244 n-d-852296-2 devstack@n-api.service[129409]: method: Aug 10 17:54:38.337244 n-d-852296-2 devstack@n-api.service[129409]: exception: Service 49796a6e-1593-43b6-8c13-f77b1319ea3a could not be found. Aug 10 17:54:38.337244 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'id': '49796a6e-1593-43b6-8c13-f77b1319ea3a', 'body': {'status': 'disabled'}} Aug 10 17:54:38.337244 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:54:38.337244 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:38.337244 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6157, in service_get_by_id Aug 10 17:54:38.337244 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Aug 10 17:54:38.337244 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6017, in _find_service_in_cell Aug 10 17:54:38.337244 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 10 17:54:38.337244 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 10 17:54:38.337244 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:38.337244 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:54:38.337244 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:38.337244 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:38.337244 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Aug 10 17:54:38.337244 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Aug 10 17:54:38.337244 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6159, in service_get_by_id Aug 10 17:54:38.337244 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Aug 10 17:54:38.337244 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 49796a6e-1593-43b6-8c13-f77b1319ea3a could not be found. Aug 10 17:54:38.337244 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:38.337244 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:54:38.337244 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:38.337244 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:38.337244 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:54:38.337244 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:54:38.337244 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:54:38.337244 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:54:38.337244 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 17:54:38.337244 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 17:54:38.337244 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:54:38.337244 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:54:38.337244 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:54:38.337244 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:54:38.346892 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Aug 10 17:54:38.346892 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:54:38.346892 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 49796a6e-1593-43b6-8c13-f77b1319ea3a could not be found. Aug 10 17:54:38.346892 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:38.346892 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:54:38.346892 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:38.346892 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:38.346892 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:54:38.346892 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:54:38.346892 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:54:38.346892 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:54:38.346892 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 49796a6e-1593-43b6-8c13-f77b1319ea3a could not be found. Aug 10 17:54:38.346892 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:38.346892 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-482155e8-e2da-49f4-9d38-97403126b9cb tempest-ServicesAdminNegativeV253TestJSON-1671924197 tempest-ServicesAdminNegativeV253TestJSON-1671924197-project-admin] Returning 404 to user: Service 49796a6e-1593-43b6-8c13-f77b1319ea3a could not be found. {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:54:38.346892 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-482155e8-e2da-49f4-9d38-97403126b9cb tempest-ServicesAdminNegativeV253TestJSON-1671924197 tempest-ServicesAdminNegativeV253TestJSON-1671924197-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-services/49796a6e-1593-43b6-8c13-f77b1319ea3a" status: 404 len: 110 microversion: 2.53 time: 0.030554 Aug 10 17:54:38.346892 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 659/1308] 10.222.0.50 () {62 vars in 1309 bytes} [Wed Aug 10 17:54:38 2022] PUT /compute/v2.1/os-services/49796a6e-1593-43b6-8c13-f77b1319ea3a => generated 110 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 10 17:54:38.361374 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-a7a88334-1e09-402c-a67d-a1657e8028eb tempest-ServicesAdminNegativeV253TestJSON-1671924197 tempest-ServicesAdminNegativeV253TestJSON-1671924197-project-admin] Action: 'update', calling method: .version_select at 0x7fb3464164c0>, body: {"status": "enabled"} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:54:38.365753 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a7a88334-1e09-402c-a67d-a1657e8028eb tempest-ServicesAdminNegativeV253TestJSON-1671924197 tempest-ServicesAdminNegativeV253TestJSON-1671924197-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:38.366948 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a7a88334-1e09-402c-a67d-a1657e8028eb tempest-ServicesAdminNegativeV253TestJSON-1671924197 tempest-ServicesAdminNegativeV253TestJSON-1671924197-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:38.367507 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a7a88334-1e09-402c-a67d-a1657e8028eb tempest-ServicesAdminNegativeV253TestJSON-1671924197 tempest-ServicesAdminNegativeV253TestJSON-1671924197-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:38.374536 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a7a88334-1e09-402c-a67d-a1657e8028eb tempest-ServicesAdminNegativeV253TestJSON-1671924197 tempest-ServicesAdminNegativeV253TestJSON-1671924197-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:38.376809 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a7a88334-1e09-402c-a67d-a1657e8028eb tempest-ServicesAdminNegativeV253TestJSON-1671924197 tempest-ServicesAdminNegativeV253TestJSON-1671924197-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:38.376809 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a7a88334-1e09-402c-a67d-a1657e8028eb tempest-ServicesAdminNegativeV253TestJSON-1671924197 tempest-ServicesAdminNegativeV253TestJSON-1671924197-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:38.401109 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-a7a88334-1e09-402c-a67d-a1657e8028eb tempest-ServicesAdminNegativeV253TestJSON-1671924197 tempest-ServicesAdminNegativeV253TestJSON-1671924197-project-admin] HTTP exception thrown: Service 49796a6e-1593-43b6-8c13-f77b1319ea3a could not be found. Aug 10 17:54:38.416840 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-a7a88334-1e09-402c-a67d-a1657e8028eb tempest-ServicesAdminNegativeV253TestJSON-1671924197 tempest-ServicesAdminNegativeV253TestJSON-1671924197-project-admin] Request method failure captured: Aug 10 17:54:38.416840 n-d-852296-2 devstack@n-api.service[129409]: request: PUT /compute/v2.1/os-services/49796a6e-1593-43b6-8c13-f77b1319ea3a HTTP/1.1 Aug 10 17:54:38.416840 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 17:54:38.416840 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 17:54:38.416840 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 17:54:38.416840 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 21 Aug 10 17:54:38.416840 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 17:54:38.416840 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 17:54:38.416840 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 17:54:38.416840 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 17:54:38.416840 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8_DdpBIfZMYZCg9-G9ELd6-F9IR1AerGXmWe1hPYQx5E8KBRJYQI5O9gmRP_S3ZIpCxarqRSQhi5BrgNfR5LEavbsB7E7nBSP4YvSpE7Ym-LP1_0b3VJUvCUIhAt2TjRh7bfN8H0VNGv9B66G1s1IoOGGqj7VvbaI3tZRxrSEM-fkaI Aug 10 17:54:38.416840 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 17:54:38.416840 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 17:54:38.416840 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 17:54:38.416840 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 17:54:38.416840 n-d-852296-2 devstack@n-api.service[129409]: X-Openstack-Nova-Api-Version: 2.53 Aug 10 17:54:38.416840 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 17:54:38.416840 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 17:54:38.416840 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: fdf59894cf61482eab3ea6608b106f1c Aug 10 17:54:38.416840 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1671924197 Aug 10 17:54:38.416840 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member,admin Aug 10 17:54:38.416840 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member,admin Aug 10 17:54:38.416840 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/fdf59894cf61482eab3ea6608b106f1c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/fdf59894cf61482eab3ea6608b106f1c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/fdf59894cf61482eab3ea6608b106f1c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_fdf59894cf61482eab3ea6608b106f1c", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:54:38.416840 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1671924197 Aug 10 17:54:38.416840 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: fdf59894cf61482eab3ea6608b106f1c Aug 10 17:54:38.416840 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1671924197 Aug 10 17:54:38.416840 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1671924197-project-admin Aug 10 17:54:38.416840 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 17:54:38.416840 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 17:54:38.416840 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: 6063beabeefc470bbfc9ebc527c26f26 Aug 10 17:54:38.416840 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1671924197-project-admin Aug 10 17:54:38.416840 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:54:38.416840 n-d-852296-2 devstack@n-api.service[129409]: {"status": "enabled"} Aug 10 17:54:38.416840 n-d-852296-2 devstack@n-api.service[129409]: method: Aug 10 17:54:38.416840 n-d-852296-2 devstack@n-api.service[129409]: exception: Service 49796a6e-1593-43b6-8c13-f77b1319ea3a could not be found. Aug 10 17:54:38.416840 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'id': '49796a6e-1593-43b6-8c13-f77b1319ea3a', 'body': {'status': 'enabled'}} Aug 10 17:54:38.416840 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:54:38.416840 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:38.416840 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6157, in service_get_by_id Aug 10 17:54:38.416840 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Aug 10 17:54:38.416840 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6017, in _find_service_in_cell Aug 10 17:54:38.416840 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 10 17:54:38.416840 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 10 17:54:38.416840 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:38.416840 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:54:38.416840 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:38.416840 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:38.416840 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Aug 10 17:54:38.416840 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Aug 10 17:54:38.416840 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6159, in service_get_by_id Aug 10 17:54:38.416840 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Aug 10 17:54:38.416840 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 49796a6e-1593-43b6-8c13-f77b1319ea3a could not be found. Aug 10 17:54:38.416840 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:38.416840 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:54:38.416840 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:38.416840 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:38.416840 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:54:38.416840 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:54:38.416840 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:54:38.416840 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:54:38.416840 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 17:54:38.416840 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 17:54:38.416840 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:54:38.416840 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:54:38.416840 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:54:38.416840 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:54:38.426645 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Aug 10 17:54:38.426645 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:54:38.426645 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 49796a6e-1593-43b6-8c13-f77b1319ea3a could not be found. Aug 10 17:54:38.426645 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:38.426645 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:54:38.426645 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:38.426645 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:38.426645 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:54:38.426645 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:54:38.426645 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:54:38.426645 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:54:38.426645 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 49796a6e-1593-43b6-8c13-f77b1319ea3a could not be found. Aug 10 17:54:38.426645 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:38.426645 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-a7a88334-1e09-402c-a67d-a1657e8028eb tempest-ServicesAdminNegativeV253TestJSON-1671924197 tempest-ServicesAdminNegativeV253TestJSON-1671924197-project-admin] Returning 404 to user: Service 49796a6e-1593-43b6-8c13-f77b1319ea3a could not be found. {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:54:38.426645 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-a7a88334-1e09-402c-a67d-a1657e8028eb tempest-ServicesAdminNegativeV253TestJSON-1671924197 tempest-ServicesAdminNegativeV253TestJSON-1671924197-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-services/49796a6e-1593-43b6-8c13-f77b1319ea3a" status: 404 len: 110 microversion: 2.53 time: 0.049178 Aug 10 17:54:38.428625 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-cafdeeaa-0448-45b0-940e-24494a2cf96d tempest-QuotasAdminNegativeTest-1442736489 tempest-QuotasAdminNegativeTest-1442736489-project-admin] 10.222.0.50 "GET /compute/v2.1/os-quota-sets/9f945b16d78641f9a814167717da4317" status: 200 len: 371 microversion: 2.1 time: 0.998158 Aug 10 17:54:38.428625 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 650/1309] 10.222.0.50 () {58 vars in 1242 bytes} [Wed Aug 10 17:54:37 2022] GET /compute/v2.1/os-quota-sets/9f945b16d78641f9a814167717da4317 => generated 371 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:54:38.429155 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 660/1310] 10.222.0.50 () {62 vars in 1309 bytes} [Wed Aug 10 17:54:38 2022] PUT /compute/v2.1/os-services/49796a6e-1593-43b6-8c13-f77b1319ea3a => generated 110 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 10 17:54:38.436606 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-fd6c8268-e118-4e12-9697-a529be1412ed tempest-ServicesAdminNegativeV253TestJSON-1671924197 tempest-ServicesAdminNegativeV253TestJSON-1671924197-project-admin] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:54:38.438309 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-0c1bd9ac-3c02-43a2-91cb-728f2e8280ff tempest-QuotasAdminNegativeTest-1442736489 tempest-QuotasAdminNegativeTest-1442736489-project-admin] Action: 'update', calling method: .version_select at 0x7fb346015f70>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:54:38.439807 n-d-852296-2 devstack@n-api.service[129410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:54:38.439807 n-d-852296-2 devstack@n-api.service[129410]: warnings.warn(msg) Aug 10 17:54:38.442088 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-fd6c8268-e118-4e12-9697-a529be1412ed tempest-ServicesAdminNegativeV253TestJSON-1671924197 tempest-ServicesAdminNegativeV253TestJSON-1671924197-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:38.442710 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-fd6c8268-e118-4e12-9697-a529be1412ed tempest-ServicesAdminNegativeV253TestJSON-1671924197 tempest-ServicesAdminNegativeV253TestJSON-1671924197-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:38.443157 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-fd6c8268-e118-4e12-9697-a529be1412ed tempest-ServicesAdminNegativeV253TestJSON-1671924197 tempest-ServicesAdminNegativeV253TestJSON-1671924197-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:38.444452 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-fd6c8268-e118-4e12-9697-a529be1412ed tempest-ServicesAdminNegativeV253TestJSON-1671924197 tempest-ServicesAdminNegativeV253TestJSON-1671924197-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:38.444912 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-fd6c8268-e118-4e12-9697-a529be1412ed tempest-ServicesAdminNegativeV253TestJSON-1671924197 tempest-ServicesAdminNegativeV253TestJSON-1671924197-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:38.445504 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-fd6c8268-e118-4e12-9697-a529be1412ed tempest-ServicesAdminNegativeV253TestJSON-1671924197 tempest-ServicesAdminNegativeV253TestJSON-1671924197-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:38.483637 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-fd6c8268-e118-4e12-9697-a529be1412ed tempest-ServicesAdminNegativeV253TestJSON-1671924197 tempest-ServicesAdminNegativeV253TestJSON-1671924197-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.056495 Aug 10 17:54:38.492699 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 651/1311] 10.222.0.50 () {60 vars in 1178 bytes} [Wed Aug 10 17:54:38 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:54:38.503231 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-2ef05139-8c87-4069-9f42-c1256051c69d tempest-ServicesAdminNegativeV253TestJSON-1671924197 tempest-ServicesAdminNegativeV253TestJSON-1671924197-project-admin] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:54:38.509529 n-d-852296-2 devstack@n-api.service[129410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:54:38.509529 n-d-852296-2 devstack@n-api.service[129410]: warnings.warn(msg) Aug 10 17:54:38.514956 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2ef05139-8c87-4069-9f42-c1256051c69d tempest-ServicesAdminNegativeV253TestJSON-1671924197 tempest-ServicesAdminNegativeV253TestJSON-1671924197-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:38.517740 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2ef05139-8c87-4069-9f42-c1256051c69d tempest-ServicesAdminNegativeV253TestJSON-1671924197 tempest-ServicesAdminNegativeV253TestJSON-1671924197-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:38.518479 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2ef05139-8c87-4069-9f42-c1256051c69d tempest-ServicesAdminNegativeV253TestJSON-1671924197 tempest-ServicesAdminNegativeV253TestJSON-1671924197-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:38.519017 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2ef05139-8c87-4069-9f42-c1256051c69d tempest-ServicesAdminNegativeV253TestJSON-1671924197 tempest-ServicesAdminNegativeV253TestJSON-1671924197-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:38.519483 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2ef05139-8c87-4069-9f42-c1256051c69d tempest-ServicesAdminNegativeV253TestJSON-1671924197 tempest-ServicesAdminNegativeV253TestJSON-1671924197-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:38.519999 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2ef05139-8c87-4069-9f42-c1256051c69d tempest-ServicesAdminNegativeV253TestJSON-1671924197 tempest-ServicesAdminNegativeV253TestJSON-1671924197-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:38.559119 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-2ef05139-8c87-4069-9f42-c1256051c69d tempest-ServicesAdminNegativeV253TestJSON-1671924197 tempest-ServicesAdminNegativeV253TestJSON-1671924197-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.063148 Aug 10 17:54:38.560445 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 652/1312] 10.222.0.50 () {60 vars in 1211 bytes} [Wed Aug 10 17:54:38 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1239 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 17:54:38.578759 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-81698dea-a205-497a-addb-63ba7c7944d7 tempest-ServicesAdminNegativeV253TestJSON-1671924197 tempest-ServicesAdminNegativeV253TestJSON-1671924197-project-admin] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:54:38.581731 n-d-852296-2 devstack@n-api.service[129410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:54:38.581731 n-d-852296-2 devstack@n-api.service[129410]: warnings.warn(msg) Aug 10 17:54:38.584140 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-81698dea-a205-497a-addb-63ba7c7944d7 tempest-ServicesAdminNegativeV253TestJSON-1671924197 tempest-ServicesAdminNegativeV253TestJSON-1671924197-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:38.585541 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-81698dea-a205-497a-addb-63ba7c7944d7 tempest-ServicesAdminNegativeV253TestJSON-1671924197 tempest-ServicesAdminNegativeV253TestJSON-1671924197-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:38.586378 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-81698dea-a205-497a-addb-63ba7c7944d7 tempest-ServicesAdminNegativeV253TestJSON-1671924197 tempest-ServicesAdminNegativeV253TestJSON-1671924197-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:38.587349 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-81698dea-a205-497a-addb-63ba7c7944d7 tempest-ServicesAdminNegativeV253TestJSON-1671924197 tempest-ServicesAdminNegativeV253TestJSON-1671924197-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:38.588032 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-81698dea-a205-497a-addb-63ba7c7944d7 tempest-ServicesAdminNegativeV253TestJSON-1671924197 tempest-ServicesAdminNegativeV253TestJSON-1671924197-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:38.588881 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-81698dea-a205-497a-addb-63ba7c7944d7 tempest-ServicesAdminNegativeV253TestJSON-1671924197 tempest-ServicesAdminNegativeV253TestJSON-1671924197-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:38.620081 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-81698dea-a205-497a-addb-63ba7c7944d7 tempest-ServicesAdminNegativeV253TestJSON-1671924197 tempest-ServicesAdminNegativeV253TestJSON-1671924197-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.045208 Aug 10 17:54:38.621436 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 653/1313] 10.222.0.50 () {60 vars in 1178 bytes} [Wed Aug 10 17:54:38 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 17:54:38.637743 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-d00938a0-840a-4274-b1f4-a71f657953f9 tempest-ServicesAdminNegativeV253TestJSON-1671924197 tempest-ServicesAdminNegativeV253TestJSON-1671924197-project-admin] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:54:38.643319 n-d-852296-2 devstack@n-api.service[129410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:54:38.643319 n-d-852296-2 devstack@n-api.service[129410]: warnings.warn(msg) Aug 10 17:54:38.646087 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d00938a0-840a-4274-b1f4-a71f657953f9 tempest-ServicesAdminNegativeV253TestJSON-1671924197 tempest-ServicesAdminNegativeV253TestJSON-1671924197-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:38.652489 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d00938a0-840a-4274-b1f4-a71f657953f9 tempest-ServicesAdminNegativeV253TestJSON-1671924197 tempest-ServicesAdminNegativeV253TestJSON-1671924197-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:38.653173 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d00938a0-840a-4274-b1f4-a71f657953f9 tempest-ServicesAdminNegativeV253TestJSON-1671924197 tempest-ServicesAdminNegativeV253TestJSON-1671924197-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:38.664600 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d00938a0-840a-4274-b1f4-a71f657953f9 tempest-ServicesAdminNegativeV253TestJSON-1671924197 tempest-ServicesAdminNegativeV253TestJSON-1671924197-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:38.666154 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d00938a0-840a-4274-b1f4-a71f657953f9 tempest-ServicesAdminNegativeV253TestJSON-1671924197 tempest-ServicesAdminNegativeV253TestJSON-1671924197-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:38.668545 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d00938a0-840a-4274-b1f4-a71f657953f9 tempest-ServicesAdminNegativeV253TestJSON-1671924197 tempest-ServicesAdminNegativeV253TestJSON-1671924197-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:38.702878 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-d00938a0-840a-4274-b1f4-a71f657953f9 tempest-ServicesAdminNegativeV253TestJSON-1671924197 tempest-ServicesAdminNegativeV253TestJSON-1671924197-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services?host=n-d-852296-2&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.073073 Aug 10 17:54:38.704273 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 654/1314] 10.222.0.50 () {60 vars in 1235 bytes} [Wed Aug 10 17:54:38 2022] GET /compute/v2.1/os-services?host=n-d-852296-2&binary=xxx => generated 16 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:54:38.720545 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-72310cb9-7cf5-41a6-85b6-24feefa67198 tempest-ServicesAdminNegativeV253TestJSON-1671924197 tempest-ServicesAdminNegativeV253TestJSON-1671924197-project-admin] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:54:38.726854 n-d-852296-2 devstack@n-api.service[129410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:54:38.726854 n-d-852296-2 devstack@n-api.service[129410]: warnings.warn(msg) Aug 10 17:54:38.726854 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-72310cb9-7cf5-41a6-85b6-24feefa67198 tempest-ServicesAdminNegativeV253TestJSON-1671924197 tempest-ServicesAdminNegativeV253TestJSON-1671924197-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:38.726854 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-72310cb9-7cf5-41a6-85b6-24feefa67198 tempest-ServicesAdminNegativeV253TestJSON-1671924197 tempest-ServicesAdminNegativeV253TestJSON-1671924197-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:38.726854 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-72310cb9-7cf5-41a6-85b6-24feefa67198 tempest-ServicesAdminNegativeV253TestJSON-1671924197 tempest-ServicesAdminNegativeV253TestJSON-1671924197-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:38.728018 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-72310cb9-7cf5-41a6-85b6-24feefa67198 tempest-ServicesAdminNegativeV253TestJSON-1671924197 tempest-ServicesAdminNegativeV253TestJSON-1671924197-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:38.728741 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-72310cb9-7cf5-41a6-85b6-24feefa67198 tempest-ServicesAdminNegativeV253TestJSON-1671924197 tempest-ServicesAdminNegativeV253TestJSON-1671924197-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:38.729373 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-72310cb9-7cf5-41a6-85b6-24feefa67198 tempest-ServicesAdminNegativeV253TestJSON-1671924197 tempest-ServicesAdminNegativeV253TestJSON-1671924197-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:38.760692 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-72310cb9-7cf5-41a6-85b6-24feefa67198 tempest-ServicesAdminNegativeV253TestJSON-1671924197 tempest-ServicesAdminNegativeV253TestJSON-1671924197-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.043290 Aug 10 17:54:38.761659 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 655/1315] 10.222.0.50 () {60 vars in 1178 bytes} [Wed Aug 10 17:54:38 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:54:38.780279 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-69c84b4e-5ff2-4cd0-b53c-f39232db22a7 tempest-ServicesAdminNegativeV253TestJSON-1671924197 tempest-ServicesAdminNegativeV253TestJSON-1671924197-project-admin] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:54:38.783332 n-d-852296-2 devstack@n-api.service[129410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:54:38.783332 n-d-852296-2 devstack@n-api.service[129410]: warnings.warn(msg) Aug 10 17:54:38.785629 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-69c84b4e-5ff2-4cd0-b53c-f39232db22a7 tempest-ServicesAdminNegativeV253TestJSON-1671924197 tempest-ServicesAdminNegativeV253TestJSON-1671924197-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:38.785824 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-69c84b4e-5ff2-4cd0-b53c-f39232db22a7 tempest-ServicesAdminNegativeV253TestJSON-1671924197 tempest-ServicesAdminNegativeV253TestJSON-1671924197-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:38.797429 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-69c84b4e-5ff2-4cd0-b53c-f39232db22a7 tempest-ServicesAdminNegativeV253TestJSON-1671924197 tempest-ServicesAdminNegativeV253TestJSON-1671924197-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:38.798889 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-69c84b4e-5ff2-4cd0-b53c-f39232db22a7 tempest-ServicesAdminNegativeV253TestJSON-1671924197 tempest-ServicesAdminNegativeV253TestJSON-1671924197-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:38.799551 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-69c84b4e-5ff2-4cd0-b53c-f39232db22a7 tempest-ServicesAdminNegativeV253TestJSON-1671924197 tempest-ServicesAdminNegativeV253TestJSON-1671924197-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:38.800170 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-69c84b4e-5ff2-4cd0-b53c-f39232db22a7 tempest-ServicesAdminNegativeV253TestJSON-1671924197 tempest-ServicesAdminNegativeV253TestJSON-1671924197-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:38.849358 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-69c84b4e-5ff2-4cd0-b53c-f39232db22a7 tempest-ServicesAdminNegativeV253TestJSON-1671924197 tempest-ServicesAdminNegativeV253TestJSON-1671924197-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.076564 Aug 10 17:54:38.860969 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 656/1316] 10.222.0.50 () {60 vars in 1239 bytes} [Wed Aug 10 17:54:38 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:54:39.202127 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=12 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:54:39.204541 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-0c1bd9ac-3c02-43a2-91cb-728f2e8280ff tempest-QuotasAdminNegativeTest-1442736489 tempest-QuotasAdminNegativeTest-1442736489-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:39.205026 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-0c1bd9ac-3c02-43a2-91cb-728f2e8280ff tempest-QuotasAdminNegativeTest-1442736489 tempest-QuotasAdminNegativeTest-1442736489-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:39.213219 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-0c1bd9ac-3c02-43a2-91cb-728f2e8280ff tempest-QuotasAdminNegativeTest-1442736489 tempest-QuotasAdminNegativeTest-1442736489-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:39.214451 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-0c1bd9ac-3c02-43a2-91cb-728f2e8280ff tempest-QuotasAdminNegativeTest-1442736489 tempest-QuotasAdminNegativeTest-1442736489-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:39.215115 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-0c1bd9ac-3c02-43a2-91cb-728f2e8280ff tempest-QuotasAdminNegativeTest-1442736489 tempest-QuotasAdminNegativeTest-1442736489-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:39.215904 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-0c1bd9ac-3c02-43a2-91cb-728f2e8280ff tempest-QuotasAdminNegativeTest-1442736489 tempest-QuotasAdminNegativeTest-1442736489-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:39.377869 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-0bdece0c-be1d-4814-81d1-b871d35d6b9e tempest-ServicesAdminNegativeV253TestJSON-637210355 tempest-ServicesAdminNegativeV253TestJSON-637210355-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:54:39.380767 n-d-852296-2 devstack@n-api.service[129410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:54:39.380767 n-d-852296-2 devstack@n-api.service[129410]: warnings.warn(msg) Aug 10 17:54:39.383205 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-0bdece0c-be1d-4814-81d1-b871d35d6b9e tempest-ServicesAdminNegativeV253TestJSON-637210355 tempest-ServicesAdminNegativeV253TestJSON-637210355-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '411f4ecb264a4d2aab3e74d6418e3e9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9946b544cdfa42ec90a01b0f7b9b419c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:54:39.384874 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-0bdece0c-be1d-4814-81d1-b871d35d6b9e tempest-ServicesAdminNegativeV253TestJSON-637210355 tempest-ServicesAdminNegativeV253TestJSON-637210355-project] Request method failure captured: Aug 10 17:54:39.384874 n-d-852296-2 devstack@n-api.service[129410]: request: GET /compute/v2.1/os-services HTTP/1.1 Aug 10 17:54:39.384874 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 17:54:39.384874 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 17:54:39.384874 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 17:54:39.384874 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 0 Aug 10 17:54:39.384874 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 17:54:39.384874 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 17:54:39.384874 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 17:54:39.384874 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 17:54:39.384874 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8_DaQN8gTUwdhzVRMjcexNTt0CtqRwhA6jyHHaYeDwFKQJxYiydpPAWdC5XJxOLXb5i65u2c1crrRWlj6UxT8XVF_o0uAsUBOLmFjtULdiksq1q9N_405lRUJVfzGNMCWkVds6Wz931Tdc-f_VToLDm5L9AcbXTnxbJDGqgrvD_iaXc Aug 10 17:54:39.384874 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 17:54:39.384874 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 17:54:39.384874 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 17:54:39.384874 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 17:54:39.384874 n-d-852296-2 devstack@n-api.service[129410]: X-Openstack-Nova-Api-Version: 2.53 Aug 10 17:54:39.384874 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 17:54:39.384874 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 17:54:39.384874 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: 9946b544cdfa42ec90a01b0f7b9b419c Aug 10 17:54:39.384874 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-637210355 Aug 10 17:54:39.384874 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 17:54:39.384874 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 17:54:39.384874 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9946b544cdfa42ec90a01b0f7b9b419c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9946b544cdfa42ec90a01b0f7b9b419c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9946b544cdfa42ec90a01b0f7b9b419c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9946b544cdfa42ec90a01b0f7b9b419c", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:54:39.384874 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-637210355 Aug 10 17:54:39.384874 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: 9946b544cdfa42ec90a01b0f7b9b419c Aug 10 17:54:39.384874 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-637210355 Aug 10 17:54:39.384874 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-ServicesAdminNegativeV253TestJSON-637210355-project Aug 10 17:54:39.384874 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 17:54:39.384874 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 17:54:39.384874 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: 411f4ecb264a4d2aab3e74d6418e3e9e Aug 10 17:54:39.384874 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-637210355-project Aug 10 17:54:39.384874 n-d-852296-2 devstack@n-api.service[129410]: method: > Aug 10 17:54:39.384874 n-d-852296-2 devstack@n-api.service[129410]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 10 17:54:39.384874 n-d-852296-2 devstack@n-api.service[129410]: action_args: {} Aug 10 17:54:39.384874 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:54:39.384874 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:39.384874 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:54:39.384874 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:54:39.384874 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:54:39.384874 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:54:39.384874 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 10 17:54:39.384874 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:54:39.384874 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 10 17:54:39.384874 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:54:39.384874 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:54:39.384874 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:54:39.384874 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 387, in index Aug 10 17:54:39.384874 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Aug 10 17:54:39.384874 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 10 17:54:39.384874 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 10 17:54:39.384874 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 10 17:54:39.384874 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 10 17:54:39.384874 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 10 17:54:39.384874 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 10 17:54:39.384874 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 10 17:54:39.384874 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise self.value Aug 10 17:54:39.384874 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 10 17:54:39.384874 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 10 17:54:39.384874 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 10 17:54:39.384874 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 10 17:54:39.384874 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 10 17:54:39.384874 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 10 17:54:39.384874 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 10 17:54:39.393703 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:54:39.393703 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:54:39.393703 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:54:39.393703 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:39.393703 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:54:39.393703 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:54:39.393703 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 10 17:54:39.393703 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 10 17:54:39.393703 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 10 17:54:39.393703 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:54:39.393703 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-0bdece0c-be1d-4814-81d1-b871d35d6b9e tempest-ServicesAdminNegativeV253TestJSON-637210355 tempest-ServicesAdminNegativeV253TestJSON-637210355-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:54:39.393703 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-0bdece0c-be1d-4814-81d1-b871d35d6b9e tempest-ServicesAdminNegativeV253TestJSON-637210355 tempest-ServicesAdminNegativeV253TestJSON-637210355-project] 10.222.0.50 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.523518 Aug 10 17:54:39.393703 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 657/1317] 10.222.0.50 () {60 vars in 1178 bytes} [Wed Aug 10 17:54:38 2022] GET /compute/v2.1/os-services => generated 112 bytes in 530 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Aug 10 17:54:39.412567 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-0c1bd9ac-3c02-43a2-91cb-728f2e8280ff tempest-QuotasAdminNegativeTest-1442736489 tempest-QuotasAdminNegativeTest-1442736489-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-quota-sets/9f945b16d78641f9a814167717da4317" status: 200 len: 328 microversion: 2.1 time: 0.977862 Aug 10 17:54:39.432666 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 661/1318] 10.222.0.50 () {60 vars in 1262 bytes} [Wed Aug 10 17:54:38 2022] PUT /compute/v2.1/os-quota-sets/9f945b16d78641f9a814167717da4317 => generated 328 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:54:39.897484 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-e2e3b961-4bf3-43e1-9fc4-af8acc27e2a5 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-1511758148", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452"}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:54:39.987897 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.network.neutron [None req-e2e3b961-4bf3-43e1-9fc4-af8acc27e2a5 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] validate_networks() for None {{(pid=129410) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 17:54:40.381832 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-fe1d4273-eed9-4cd8-b169-8c4fb7a30063 tempest-QuotasAdminNegativeTest-217090064 tempest-QuotasAdminNegativeTest-217090064-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1684197793", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452"}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:54:40.478827 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.virt.hardware [None req-e2e3b961-4bf3-43e1-9fc4-af8acc27e2a5 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Flavor limits 0:0:0 {{(pid=129410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 17:54:40.479439 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.virt.hardware [None req-e2e3b961-4bf3-43e1-9fc4-af8acc27e2a5 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Image limits 0:0:0 {{(pid=129410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 17:54:40.480657 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.network.neutron [None req-fe1d4273-eed9-4cd8-b169-8c4fb7a30063 tempest-QuotasAdminNegativeTest-217090064 tempest-QuotasAdminNegativeTest-217090064-project] validate_networks() for None {{(pid=129409) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 17:54:40.481623 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.virt.hardware [None req-e2e3b961-4bf3-43e1-9fc4-af8acc27e2a5 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Flavor pref 0:0:0 {{(pid=129410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 17:54:40.482135 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.virt.hardware [None req-e2e3b961-4bf3-43e1-9fc4-af8acc27e2a5 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Image pref 0:0:0 {{(pid=129410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 17:54:40.483743 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.virt.hardware [None req-e2e3b961-4bf3-43e1-9fc4-af8acc27e2a5 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 17:54:40.502794 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e2e3b961-4bf3-43e1-9fc4-af8acc27e2a5 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:40.503559 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e2e3b961-4bf3-43e1-9fc4-af8acc27e2a5 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:40.504235 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e2e3b961-4bf3-43e1-9fc4-af8acc27e2a5 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:40.505162 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e2e3b961-4bf3-43e1-9fc4-af8acc27e2a5 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:40.507449 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e2e3b961-4bf3-43e1-9fc4-af8acc27e2a5 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:40.508232 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e2e3b961-4bf3-43e1-9fc4-af8acc27e2a5 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:40.527718 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.quota [None req-e2e3b961-4bf3-43e1-9fc4-af8acc27e2a5 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Getting quotas for project 0ea1bedbf4fa421198a38dbfad95db72. Resources: {'instances', 'ram', 'cores'} {{(pid=129410) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:54:40.533308 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.quota [None req-e2e3b961-4bf3-43e1-9fc4-af8acc27e2a5 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Getting quotas for user a36de414913b4223aba37ecb0f74e467 and project 0ea1bedbf4fa421198a38dbfad95db72. Resources: {'instances', 'ram', 'cores'} {{(pid=129410) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:54:40.546816 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-e2e3b961-4bf3-43e1-9fc4-af8acc27e2a5 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Going to run 1 instances... {{(pid=129410) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 17:54:40.550007 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-e2e3b961-4bf3-43e1-9fc4-af8acc27e2a5 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] [instance: 5b41d7b5-e888-47ec-a57e-5b474e76ef45] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a735ff26-463a-4ffe-a981-ab9d9baa494f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129410) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 17:54:40.682290 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-e2e3b961-4bf3-43e1-9fc4-af8acc27e2a5 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.289534 Aug 10 17:54:40.684147 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 658/1319] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 17:54:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1292 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 17:54:40.696031 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-b6cfd8e3-e6c9-4b3e-a8bf-429fb5fe74a0 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:54:40.697130 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-b6cfd8e3-e6c9-4b3e-a8bf-429fb5fe74a0 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] [instance: 5b41d7b5-e888-47ec-a57e-5b474e76ef45] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:54:40.806333 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-b6cfd8e3-e6c9-4b3e-a8bf-429fb5fe74a0 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36de414913b4223aba37ecb0f74e467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea1bedbf4fa421198a38dbfad95db72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:54:40.814418 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-b6cfd8e3-e6c9-4b3e-a8bf-429fb5fe74a0 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] 10.222.0.50 "GET /compute/v2.1/servers/5b41d7b5-e888-47ec-a57e-5b474e76ef45" status: 200 len: 1217 microversion: 2.1 time: 0.123450 Aug 10 17:54:40.816924 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 659/1320] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:54:40 2022] GET /compute/v2.1/servers/5b41d7b5-e888-47ec-a57e-5b474e76ef45 => generated 1217 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:54:41.343896 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.virt.hardware [None req-fe1d4273-eed9-4cd8-b169-8c4fb7a30063 tempest-QuotasAdminNegativeTest-217090064 tempest-QuotasAdminNegativeTest-217090064-project] Flavor limits 0:0:0 {{(pid=129409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 17:54:41.344341 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.virt.hardware [None req-fe1d4273-eed9-4cd8-b169-8c4fb7a30063 tempest-QuotasAdminNegativeTest-217090064 tempest-QuotasAdminNegativeTest-217090064-project] Image limits 0:0:0 {{(pid=129409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 17:54:41.344820 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.virt.hardware [None req-fe1d4273-eed9-4cd8-b169-8c4fb7a30063 tempest-QuotasAdminNegativeTest-217090064 tempest-QuotasAdminNegativeTest-217090064-project] Flavor pref 0:0:0 {{(pid=129409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 17:54:41.345235 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.virt.hardware [None req-fe1d4273-eed9-4cd8-b169-8c4fb7a30063 tempest-QuotasAdminNegativeTest-217090064 tempest-QuotasAdminNegativeTest-217090064-project] Image pref 0:0:0 {{(pid=129409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 17:54:41.345661 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.virt.hardware [None req-fe1d4273-eed9-4cd8-b169-8c4fb7a30063 tempest-QuotasAdminNegativeTest-217090064 tempest-QuotasAdminNegativeTest-217090064-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 17:54:41.356105 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-fe1d4273-eed9-4cd8-b169-8c4fb7a30063 tempest-QuotasAdminNegativeTest-217090064 tempest-QuotasAdminNegativeTest-217090064-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:41.356856 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-fe1d4273-eed9-4cd8-b169-8c4fb7a30063 tempest-QuotasAdminNegativeTest-217090064 tempest-QuotasAdminNegativeTest-217090064-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:41.360432 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-fe1d4273-eed9-4cd8-b169-8c4fb7a30063 tempest-QuotasAdminNegativeTest-217090064 tempest-QuotasAdminNegativeTest-217090064-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:41.360432 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-fe1d4273-eed9-4cd8-b169-8c4fb7a30063 tempest-QuotasAdminNegativeTest-217090064 tempest-QuotasAdminNegativeTest-217090064-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:41.360432 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-fe1d4273-eed9-4cd8-b169-8c4fb7a30063 tempest-QuotasAdminNegativeTest-217090064 tempest-QuotasAdminNegativeTest-217090064-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:41.360432 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-fe1d4273-eed9-4cd8-b169-8c4fb7a30063 tempest-QuotasAdminNegativeTest-217090064 tempest-QuotasAdminNegativeTest-217090064-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:41.379480 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-fe1d4273-eed9-4cd8-b169-8c4fb7a30063 tempest-QuotasAdminNegativeTest-217090064 tempest-QuotasAdminNegativeTest-217090064-project] Getting quotas for project 9f945b16d78641f9a814167717da4317. Resources: {'instances', 'ram', 'cores'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:54:41.392121 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-fe1d4273-eed9-4cd8-b169-8c4fb7a30063 tempest-QuotasAdminNegativeTest-217090064 tempest-QuotasAdminNegativeTest-217090064-project] Getting quotas for user a3ebd93ac6a549d99e957cd2c9f4077c and project 9f945b16d78641f9a814167717da4317. Resources: {'instances', 'ram', 'cores'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:54:41.409412 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.utils [None req-fe1d4273-eed9-4cd8-b169-8c4fb7a30063 tempest-QuotasAdminNegativeTest-217090064 tempest-QuotasAdminNegativeTest-217090064-project] cores quota exceeded for 9f945b16d78641f9a814167717da4317, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=129409) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Aug 10 17:54:41.410540 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-fe1d4273-eed9-4cd8-b169-8c4fb7a30063 tempest-QuotasAdminNegativeTest-217090064 tempest-QuotasAdminNegativeTest-217090064-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 10 17:54:41.455464 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-fe1d4273-eed9-4cd8-b169-8c4fb7a30063 tempest-QuotasAdminNegativeTest-217090064 tempest-QuotasAdminNegativeTest-217090064-project] Request method failure captured: Aug 10 17:54:41.455464 n-d-852296-2 devstack@n-api.service[129409]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 17:54:41.455464 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 17:54:41.455464 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 17:54:41.455464 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 17:54:41.455464 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 145 Aug 10 17:54:41.455464 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 17:54:41.455464 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 17:54:41.455464 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 17:54:41.455464 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 17:54:41.455464 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8_DZgwIGcOc3mWuWXPleqrH29EuGx4NOSCrQXa126gu62H-sHkvCki_2Svgb__O9KrqFTswYyq12sWpY6RxsGF2jkQo-WXUOuMJEtkSxJDDmwsfU5LbAyZnNBs7W_VlQUJ1UhCWh8_IG4hH99hFFVXiW8QJaZhcGi5r48VbLl05Gq6U Aug 10 17:54:41.455464 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 17:54:41.455464 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 17:54:41.455464 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 17:54:41.455464 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 17:54:41.455464 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 17:54:41.455464 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 17:54:41.455464 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: 9f945b16d78641f9a814167717da4317 Aug 10 17:54:41.455464 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-QuotasAdminNegativeTest-217090064 Aug 10 17:54:41.455464 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 17:54:41.455464 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 17:54:41.455464 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9f945b16d78641f9a814167717da4317"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9f945b16d78641f9a814167717da4317"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9f945b16d78641f9a814167717da4317"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9f945b16d78641f9a814167717da4317", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:54:41.455464 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-QuotasAdminNegativeTest-217090064 Aug 10 17:54:41.455464 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: 9f945b16d78641f9a814167717da4317 Aug 10 17:54:41.455464 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-217090064 Aug 10 17:54:41.455464 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-QuotasAdminNegativeTest-217090064-project Aug 10 17:54:41.455464 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 17:54:41.455464 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 17:54:41.455464 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: a3ebd93ac6a549d99e957cd2c9f4077c Aug 10 17:54:41.455464 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-QuotasAdminNegativeTest-217090064-project Aug 10 17:54:41.455464 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:54:41.455464 n-d-852296-2 devstack@n-api.service[129409]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1684197793", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452"}} Aug 10 17:54:41.455464 n-d-852296-2 devstack@n-api.service[129409]: method: > Aug 10 17:54:41.455464 n-d-852296-2 devstack@n-api.service[129409]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 10 17:54:41.455464 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1684197793', 'imageRef': 'a735ff26-463a-4ffe-a981-ab9d9baa494f', 'flavorRef': '452'}}} Aug 10 17:54:41.455464 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:54:41.455464 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:41.455464 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Aug 10 17:54:41.455464 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Aug 10 17:54:41.455464 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 17:54:41.455464 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 17:54:41.455464 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 10 17:54:41.455464 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exc Aug 10 17:54:41.455464 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 10 17:54:41.455464 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 10 17:54:41.455464 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 17:54:41.455464 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 17:54:41.455464 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 10 17:54:41.455464 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 10 17:54:41.455464 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 10 17:54:41.455464 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 10 17:54:41.455464 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Aug 10 17:54:41.455464 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 10 17:54:41.455464 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Aug 10 17:54:41.455464 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:41.455464 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:54:41.455464 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:41.455464 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:41.455464 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 17:54:41.455464 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 17:54:41.455464 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 17:54:41.455464 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 17:54:41.455464 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1678, in _create_instance Aug 10 17:54:41.463591 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Aug 10 17:54:41.463591 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1350, in _provision_instances Aug 10 17:54:41.463591 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Aug 10 17:54:41.463591 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Aug 10 17:54:41.463591 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 10 17:54:41.463591 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 10 17:54:41.463591 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:41.463591 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:54:41.463591 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:41.463591 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:41.463591 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:54:41.463591 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:54:41.463591 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:54:41.463591 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:54:41.463591 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:54:41.463591 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:54:41.463591 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:54:41.463591 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:54:41.463591 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:54:41.463591 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:54:41.463591 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:54:41.463591 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:54:41.463591 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 17:54:41.463591 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 10 17:54:41.463591 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 10 17:54:41.463591 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 10 17:54:41.463591 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:41.463591 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:54:41.463591 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:41.463591 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:41.463591 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:54:41.463591 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:54:41.463591 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:54:41.463591 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:54:41.463591 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 10 17:54:41.463591 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:41.463591 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-fe1d4273-eed9-4cd8-b169-8c4fb7a30063 tempest-QuotasAdminNegativeTest-217090064 tempest-QuotasAdminNegativeTest-217090064-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:54:41.463591 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-fe1d4273-eed9-4cd8-b169-8c4fb7a30063 tempest-QuotasAdminNegativeTest-217090064 tempest-QuotasAdminNegativeTest-217090064-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 1.412729 Aug 10 17:54:41.469292 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 662/1321] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 17:54:40 2022] POST /compute/v2.1/servers => generated 111 bytes in 1419 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:54:41.474177 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-df851f0a-db4e-4a4b-9201-330d46ecf4c6 tempest-QuotasAdminNegativeTest-1442736489 tempest-QuotasAdminNegativeTest-1442736489-project-admin] Action: 'update', calling method: .version_select at 0x7fb345ad34c0>, body: {"quota_set": {"cores": 20}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:54:41.708407 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-df851f0a-db4e-4a4b-9201-330d46ecf4c6 tempest-QuotasAdminNegativeTest-1442736489 tempest-QuotasAdminNegativeTest-1442736489-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:41.710613 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-df851f0a-db4e-4a4b-9201-330d46ecf4c6 tempest-QuotasAdminNegativeTest-1442736489 tempest-QuotasAdminNegativeTest-1442736489-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:41.711264 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-df851f0a-db4e-4a4b-9201-330d46ecf4c6 tempest-QuotasAdminNegativeTest-1442736489 tempest-QuotasAdminNegativeTest-1442736489-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:41.712214 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-df851f0a-db4e-4a4b-9201-330d46ecf4c6 tempest-QuotasAdminNegativeTest-1442736489 tempest-QuotasAdminNegativeTest-1442736489-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:41.712897 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-df851f0a-db4e-4a4b-9201-330d46ecf4c6 tempest-QuotasAdminNegativeTest-1442736489 tempest-QuotasAdminNegativeTest-1442736489-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:41.713531 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-df851f0a-db4e-4a4b-9201-330d46ecf4c6 tempest-QuotasAdminNegativeTest-1442736489 tempest-QuotasAdminNegativeTest-1442736489-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:41.854380 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-a09fb605-f793-4faa-9450-5e8d9da8bc79 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:54:41.868549 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-a09fb605-f793-4faa-9450-5e8d9da8bc79 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] [instance: 5b41d7b5-e888-47ec-a57e-5b474e76ef45] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:54:41.987050 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-a09fb605-f793-4faa-9450-5e8d9da8bc79 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36de414913b4223aba37ecb0f74e467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea1bedbf4fa421198a38dbfad95db72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:54:41.996259 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-a09fb605-f793-4faa-9450-5e8d9da8bc79 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] 10.222.0.50 "GET /compute/v2.1/servers/5b41d7b5-e888-47ec-a57e-5b474e76ef45" status: 200 len: 1217 microversion: 2.1 time: 0.159584 Aug 10 17:54:41.997147 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 663/1322] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:54:41 2022] GET /compute/v2.1/servers/5b41d7b5-e888-47ec-a57e-5b474e76ef45 => generated 1217 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:54:42.017806 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-df851f0a-db4e-4a4b-9201-330d46ecf4c6 tempest-QuotasAdminNegativeTest-1442736489 tempest-QuotasAdminNegativeTest-1442736489-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-quota-sets/9f945b16d78641f9a814167717da4317" status: 200 len: 329 microversion: 2.1 time: 0.547289 Aug 10 17:54:42.020720 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 660/1323] 10.222.0.50 () {60 vars in 1262 bytes} [Wed Aug 10 17:54:41 2022] PUT /compute/v2.1/os-quota-sets/9f945b16d78641f9a814167717da4317 => generated 329 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:54:42.030771 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-95689397-3ff0-42c4-90e8-3ba6fbf01549 tempest-QuotasAdminNegativeTest-1442736489 tempest-QuotasAdminNegativeTest-1442736489-project-admin] Calling method '.version_select at 0x7fb345eba820>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:54:42.112703 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-95689397-3ff0-42c4-90e8-3ba6fbf01549 tempest-QuotasAdminNegativeTest-1442736489 tempest-QuotasAdminNegativeTest-1442736489-project-admin] 10.222.0.50 "GET /compute/v2.1/os-quota-sets/9f945b16d78641f9a814167717da4317" status: 200 len: 371 microversion: 2.1 time: 0.085535 Aug 10 17:54:42.113695 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 664/1324] 10.222.0.50 () {58 vars in 1242 bytes} [Wed Aug 10 17:54:42 2022] GET /compute/v2.1/os-quota-sets/9f945b16d78641f9a814167717da4317 => generated 371 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:54:42.125528 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-6150e596-5ac5-4040-88ec-b5b75308cc42 tempest-QuotasAdminNegativeTest-1442736489 tempest-QuotasAdminNegativeTest-1442736489-project-admin] Action: 'update', calling method: .version_select at 0x7fb345b82160>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:54:42.261783 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-6150e596-5ac5-4040-88ec-b5b75308cc42 tempest-QuotasAdminNegativeTest-1442736489 tempest-QuotasAdminNegativeTest-1442736489-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:42.262508 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-6150e596-5ac5-4040-88ec-b5b75308cc42 tempest-QuotasAdminNegativeTest-1442736489 tempest-QuotasAdminNegativeTest-1442736489-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:42.263122 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-6150e596-5ac5-4040-88ec-b5b75308cc42 tempest-QuotasAdminNegativeTest-1442736489 tempest-QuotasAdminNegativeTest-1442736489-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:42.264073 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-6150e596-5ac5-4040-88ec-b5b75308cc42 tempest-QuotasAdminNegativeTest-1442736489 tempest-QuotasAdminNegativeTest-1442736489-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:42.264755 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-6150e596-5ac5-4040-88ec-b5b75308cc42 tempest-QuotasAdminNegativeTest-1442736489 tempest-QuotasAdminNegativeTest-1442736489-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:42.265370 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-6150e596-5ac5-4040-88ec-b5b75308cc42 tempest-QuotasAdminNegativeTest-1442736489 tempest-QuotasAdminNegativeTest-1442736489-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:42.407744 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-2832010f-d1fa-4662-8d5b-ea6c18081df8 tempest-AttachSCSIVolumeTestJSON-37533962 tempest-AttachSCSIVolumeTestJSON-37533962-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1096236660", "imageRef": "eb634111-773a-4287-a31b-761fbe47c444", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "d78692be-6254-41c2-a111-b38b6979dbc2"}], "security_groups": [{"name": "tempest-securitygroup--1910720072"}], "key_name": "tempest-keypair-1866649603", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:54:42.469904 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-6150e596-5ac5-4040-88ec-b5b75308cc42 tempest-QuotasAdminNegativeTest-1442736489 tempest-QuotasAdminNegativeTest-1442736489-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-quota-sets/9f945b16d78641f9a814167717da4317" status: 200 len: 328 microversion: 2.1 time: 0.348190 Aug 10 17:54:42.487344 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 661/1325] 10.222.0.50 () {60 vars in 1262 bytes} [Wed Aug 10 17:54:42 2022] PUT /compute/v2.1/os-quota-sets/9f945b16d78641f9a814167717da4317 => generated 328 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:54:42.551511 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.network.neutron [None req-2832010f-d1fa-4662-8d5b-ea6c18081df8 tempest-AttachSCSIVolumeTestJSON-37533962 tempest-AttachSCSIVolumeTestJSON-37533962-project] validate_networks() for [('d78692be-6254-41c2-a111-b38b6979dbc2', None, None, None, None, None)] {{(pid=129409) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 17:54:42.605693 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-8d254d0d-4868-46f2-8b03-821c86a7cc8e tempest-QuotasAdminNegativeTest-217090064 tempest-QuotasAdminNegativeTest-217090064-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-199875909", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452"}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:54:42.670915 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.network.neutron [None req-8d254d0d-4868-46f2-8b03-821c86a7cc8e tempest-QuotasAdminNegativeTest-217090064 tempest-QuotasAdminNegativeTest-217090064-project] validate_networks() for None {{(pid=129410) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 17:54:43.243636 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [None req-2832010f-d1fa-4662-8d5b-ea6c18081df8 tempest-AttachSCSIVolumeTestJSON-37533962 tempest-AttachSCSIVolumeTestJSON-37533962-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-f5a9e6ac-5439-4597-b360-d8e0364a7043) Aug 10 17:54:43.243636 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:43.243636 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:54:43.243636 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:54:43.243636 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:54:43.243636 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:54:43.243636 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:54:43.243636 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:54:43.243636 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:54:43.243636 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:54:43.243636 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 17:54:43.243636 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 17:54:43.243636 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 17:54:43.243636 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 17:54:43.243636 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 17:54:43.243636 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 17:54:43.243636 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 17:54:43.243636 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 17:54:43.243636 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 17:54:43.243636 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 17:54:43.243636 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 17:54:43.243636 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 17:54:43.243636 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 17:54:43.243636 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 17:54:43.243636 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 17:54:43.243636 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 17:54:43.243636 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 17:54:43.243636 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:54:43.243636 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:54:43.243636 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 17:54:43.243636 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 17:54:43.243636 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:54:43.243636 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:54:43.243636 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:54:43.243636 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:54:43.243636 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:54:43.243636 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:54:43.243636 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:54:43.243636 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:54:43.243636 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:54:43.243636 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:54:43.243636 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 17:54:43.243636 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 17:54:43.243636 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 17:54:43.243636 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 17:54:43.243636 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 17:54:43.243636 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 17:54:43.243636 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 17:54:43.243636 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 17:54:43.243636 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 17:54:43.243636 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 17:54:43.243636 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 17:54:43.243636 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 17:54:43.249034 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 17:54:43.249034 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 17:54:43.249034 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 17:54:43.249034 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 17:54:43.249034 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 17:54:43.249034 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 17:54:43.249034 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 17:54:43.249034 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 17:54:43.249034 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 17:54:43.249034 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 17:54:43.249034 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 17:54:43.249034 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 17:54:43.249034 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 17:54:43.249034 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 17:54:43.249034 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-f5a9e6ac-5439-4597-b360-d8e0364a7043) Aug 10 17:54:43.249034 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:43.252989 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-2832010f-d1fa-4662-8d5b-ea6c18081df8 tempest-AttachSCSIVolumeTestJSON-37533962 tempest-AttachSCSIVolumeTestJSON-37533962-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:54:43.252989 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:54:43.255869 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-2832010f-d1fa-4662-8d5b-ea6c18081df8 tempest-AttachSCSIVolumeTestJSON-37533962 tempest-AttachSCSIVolumeTestJSON-37533962-project] Request method failure captured: Aug 10 17:54:43.255869 n-d-852296-2 devstack@n-api.service[129409]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 17:54:43.255869 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 17:54:43.255869 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 17:54:43.255869 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 17:54:43.255869 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 487 Aug 10 17:54:43.255869 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 17:54:43.255869 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 17:54:43.255869 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 17:54:43.255869 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 17:54:43.255869 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8_CmdaTZKzPLd6IwMYo2TaGEoMrwvgXxJ4-li5njZc9MN4q7ECd3vo6qGfusa9TJtq3UXPtQf54GIuPl5Jalgu9yN4Ot0jPUlHHKylFEt2FudkFS7pH70D_D430iHGqgU9ibOSw6clBYaU74tDVyGL6R31m4vQkv71l6WMpU1ra-z6g Aug 10 17:54:43.255869 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 17:54:43.255869 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 17:54:43.255869 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 17:54:43.255869 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 17:54:43.255869 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 17:54:43.255869 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 17:54:43.255869 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: c9882a16473b434c8f1b5dec3c2e7218 Aug 10 17:54:43.255869 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-37533962 Aug 10 17:54:43.255869 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 17:54:43.255869 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 17:54:43.255869 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c9882a16473b434c8f1b5dec3c2e7218"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c9882a16473b434c8f1b5dec3c2e7218"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c9882a16473b434c8f1b5dec3c2e7218"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c9882a16473b434c8f1b5dec3c2e7218", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:54:43.255869 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-37533962 Aug 10 17:54:43.255869 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: c9882a16473b434c8f1b5dec3c2e7218 Aug 10 17:54:43.255869 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-37533962 Aug 10 17:54:43.255869 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-AttachSCSIVolumeTestJSON-37533962-project Aug 10 17:54:43.255869 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 17:54:43.255869 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 17:54:43.255869 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: b0ba04bf1c5245d7bf01c1cccbbfdb72 Aug 10 17:54:43.255869 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-37533962-project Aug 10 17:54:43.255869 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:54:43.255869 n-d-852296-2 devstack@n-api.service[129409]: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1096236660", "imageRef": "eb634111-773a-4287-a31b-761fbe47c444", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "d78692be-6254-41c2-a111-b38b6979dbc2"}], "security_groups": [{"name": "tempest-securitygroup--1910720072"}], "key_name": "tempest-keypair-1866649603", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} Aug 10 17:54:43.255869 n-d-852296-2 devstack@n-api.service[129409]: method: > Aug 10 17:54:43.255869 n-d-852296-2 devstack@n-api.service[129409]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:54:43.255869 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:54:43.255869 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'body': {'server': {'name': 'tempest-AttachSCSIVolumeTestJSON-server-1096236660', 'imageRef': 'eb634111-773a-4287-a31b-761fbe47c444', 'flavorRef': '452', 'config_drive': True, 'networks': [{'uuid': 'd78692be-6254-41c2-a111-b38b6979dbc2'}], 'security_groups': [{'name': 'tempest-securitygroup--1910720072'}], 'key_name': 'tempest-keypair-1866649603', 'user_data': 'IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo='}}} Aug 10 17:54:43.255869 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:54:43.255869 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:43.255869 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:54:43.255869 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:54:43.255869 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:54:43.255869 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:54:43.255869 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:54:43.255869 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:54:43.255869 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:54:43.255869 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:54:43.255869 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 17:54:43.255869 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 17:54:43.255869 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 17:54:43.255869 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 17:54:43.255869 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 17:54:43.255869 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 17:54:43.255869 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 17:54:43.255869 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 17:54:43.255869 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 17:54:43.255869 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 17:54:43.262137 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 17:54:43.262137 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 17:54:43.262137 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 17:54:43.262137 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 17:54:43.262137 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 17:54:43.262137 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 17:54:43.262137 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 17:54:43.262137 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:54:43.262137 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:54:43.262137 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 17:54:43.262137 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 17:54:43.262137 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:54:43.262137 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:54:43.262137 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:54:43.262137 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:54:43.262137 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:54:43.262137 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:54:43.262137 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:54:43.262137 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:54:43.262137 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:54:43.262137 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:54:43.262137 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 17:54:43.262137 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 17:54:43.262137 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 17:54:43.262137 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 17:54:43.262137 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 17:54:43.262137 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 17:54:43.262137 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 17:54:43.262137 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 17:54:43.262137 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 17:54:43.262137 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 17:54:43.262137 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 17:54:43.262137 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 17:54:43.262137 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 17:54:43.262137 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 17:54:43.262137 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 17:54:43.262137 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 17:54:43.262137 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 17:54:43.262137 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 17:54:43.262137 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 17:54:43.262137 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 17:54:43.262137 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 17:54:43.262137 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 17:54:43.262137 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 17:54:43.262137 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 17:54:43.262137 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 17:54:43.262137 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 17:54:43.262137 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-f5a9e6ac-5439-4597-b360-d8e0364a7043) Aug 10 17:54:43.262137 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:43.262137 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:54:43.262137 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:43.262137 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:43.262137 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:54:43.266614 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:54:43.266614 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:54:43.266614 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:54:43.266614 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 10 17:54:43.266614 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 10 17:54:43.266614 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:54:43.266614 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:43.266614 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:43.266614 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:54:43.266614 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:43.266614 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:43.266614 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:54:43.266614 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:54:43.266614 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:54:43.266614 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:54:43.266614 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:54:43.266614 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:43.266614 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:43.273685 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-2832010f-d1fa-4662-8d5b-ea6c18081df8 tempest-AttachSCSIVolumeTestJSON-37533962 tempest-AttachSCSIVolumeTestJSON-37533962-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:54:43.273685 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:54:43.273685 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-2832010f-d1fa-4662-8d5b-ea6c18081df8 tempest-AttachSCSIVolumeTestJSON-37533962 tempest-AttachSCSIVolumeTestJSON-37533962-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.866924 Aug 10 17:54:43.273685 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 665/1326] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 17:54:42 2022] POST /compute/v2.1/servers => generated 214 bytes in 868 msecs (HTTP/1.1 500) 9 headers in 391 bytes (2 switches on core 0) Aug 10 17:54:43.286654 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-4ea56a8c-677f-4a71-9a76-b4a1218bf266 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:54:43.287622 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-4ea56a8c-677f-4a71-9a76-b4a1218bf266 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] [instance: 5b41d7b5-e888-47ec-a57e-5b474e76ef45] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:54:43.296511 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-4ea56a8c-677f-4a71-9a76-b4a1218bf266 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:43.297286 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-4ea56a8c-677f-4a71-9a76-b4a1218bf266 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:43.299252 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-4ea56a8c-677f-4a71-9a76-b4a1218bf266 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:43.300488 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-4ea56a8c-677f-4a71-9a76-b4a1218bf266 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:43.301116 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-4ea56a8c-677f-4a71-9a76-b4a1218bf266 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:43.301765 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-4ea56a8c-677f-4a71-9a76-b4a1218bf266 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:43.401447 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-4ea56a8c-677f-4a71-9a76-b4a1218bf266 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36de414913b4223aba37ecb0f74e467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea1bedbf4fa421198a38dbfad95db72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:54:43.411666 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-4ea56a8c-677f-4a71-9a76-b4a1218bf266 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] 10.222.0.50 "GET /compute/v2.1/servers/5b41d7b5-e888-47ec-a57e-5b474e76ef45" status: 200 len: 1221 microversion: 2.1 time: 0.136245 Aug 10 17:54:43.425628 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 666/1327] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:54:43 2022] GET /compute/v2.1/servers/5b41d7b5-e888-47ec-a57e-5b474e76ef45 => generated 1221 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:54:43.425628 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-0bf4ac7d-df04-40d2-9bcf-a86f67ac1361 tempest-AttachSCSIVolumeTestJSON-37533962 tempest-AttachSCSIVolumeTestJSON-37533962-project] Calling method '.version_select at 0x7fb345eba430>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:54:43.561720 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-0bf4ac7d-df04-40d2-9bcf-a86f67ac1361 tempest-AttachSCSIVolumeTestJSON-37533962 tempest-AttachSCSIVolumeTestJSON-37533962-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1866649603" status: 202 len: 0 microversion: 2.1 time: 0.145654 Aug 10 17:54:43.567234 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 667/1328] 10.222.0.50 () {58 vars in 1221 bytes} [Wed Aug 10 17:54:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1866649603 => generated 0 bytes in 148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 17:54:43.669674 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.virt.hardware [None req-8d254d0d-4868-46f2-8b03-821c86a7cc8e tempest-QuotasAdminNegativeTest-217090064 tempest-QuotasAdminNegativeTest-217090064-project] Flavor limits 0:0:0 {{(pid=129410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 17:54:43.670718 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.virt.hardware [None req-8d254d0d-4868-46f2-8b03-821c86a7cc8e tempest-QuotasAdminNegativeTest-217090064 tempest-QuotasAdminNegativeTest-217090064-project] Image limits 0:0:0 {{(pid=129410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 17:54:43.672047 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.virt.hardware [None req-8d254d0d-4868-46f2-8b03-821c86a7cc8e tempest-QuotasAdminNegativeTest-217090064 tempest-QuotasAdminNegativeTest-217090064-project] Flavor pref 0:0:0 {{(pid=129410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 17:54:43.672687 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.virt.hardware [None req-8d254d0d-4868-46f2-8b03-821c86a7cc8e tempest-QuotasAdminNegativeTest-217090064 tempest-QuotasAdminNegativeTest-217090064-project] Image pref 0:0:0 {{(pid=129410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 17:54:43.673307 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.virt.hardware [None req-8d254d0d-4868-46f2-8b03-821c86a7cc8e tempest-QuotasAdminNegativeTest-217090064 tempest-QuotasAdminNegativeTest-217090064-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 17:54:43.694235 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-8d254d0d-4868-46f2-8b03-821c86a7cc8e tempest-QuotasAdminNegativeTest-217090064 tempest-QuotasAdminNegativeTest-217090064-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:43.715502 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-8d254d0d-4868-46f2-8b03-821c86a7cc8e tempest-QuotasAdminNegativeTest-217090064 tempest-QuotasAdminNegativeTest-217090064-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:43.718426 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-8d254d0d-4868-46f2-8b03-821c86a7cc8e tempest-QuotasAdminNegativeTest-217090064 tempest-QuotasAdminNegativeTest-217090064-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:43.722803 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-8d254d0d-4868-46f2-8b03-821c86a7cc8e tempest-QuotasAdminNegativeTest-217090064 tempest-QuotasAdminNegativeTest-217090064-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:43.724759 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-8d254d0d-4868-46f2-8b03-821c86a7cc8e tempest-QuotasAdminNegativeTest-217090064 tempest-QuotasAdminNegativeTest-217090064-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:43.727664 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-8d254d0d-4868-46f2-8b03-821c86a7cc8e tempest-QuotasAdminNegativeTest-217090064 tempest-QuotasAdminNegativeTest-217090064-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:43.780678 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.quota [None req-8d254d0d-4868-46f2-8b03-821c86a7cc8e tempest-QuotasAdminNegativeTest-217090064 tempest-QuotasAdminNegativeTest-217090064-project] Getting quotas for project 9f945b16d78641f9a814167717da4317. Resources: {'instances', 'ram', 'cores'} {{(pid=129410) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:54:43.787134 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:54:43.799076 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.quota [None req-8d254d0d-4868-46f2-8b03-821c86a7cc8e tempest-QuotasAdminNegativeTest-217090064 tempest-QuotasAdminNegativeTest-217090064-project] Getting quotas for user a3ebd93ac6a549d99e957cd2c9f4077c and project 9f945b16d78641f9a814167717da4317. Resources: {'instances', 'ram', 'cores'} {{(pid=129410) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:54:43.829333 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.utils [None req-8d254d0d-4868-46f2-8b03-821c86a7cc8e tempest-QuotasAdminNegativeTest-217090064 tempest-QuotasAdminNegativeTest-217090064-project] instances quota exceeded for 9f945b16d78641f9a814167717da4317, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=129410) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Aug 10 17:54:43.832130 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-8d254d0d-4868-46f2-8b03-821c86a7cc8e tempest-QuotasAdminNegativeTest-217090064 tempest-QuotasAdminNegativeTest-217090064-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 10 17:54:43.838303 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-8d254d0d-4868-46f2-8b03-821c86a7cc8e tempest-QuotasAdminNegativeTest-217090064 tempest-QuotasAdminNegativeTest-217090064-project] Request method failure captured: Aug 10 17:54:43.838303 n-d-852296-2 devstack@n-api.service[129410]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 17:54:43.838303 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 17:54:43.838303 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 17:54:43.838303 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 17:54:43.838303 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 144 Aug 10 17:54:43.838303 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 17:54:43.838303 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 17:54:43.838303 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 17:54:43.838303 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 17:54:43.838303 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8_DZgwIGcOc3mWuWXPleqrH29EuGx4NOSCrQXa126gu62H-sHkvCki_2Svgb__O9KrqFTswYyq12sWpY6RxsGF2jkQo-WXUOuMJEtkSxJDDmwsfU5LbAyZnNBs7W_VlQUJ1UhCWh8_IG4hH99hFFVXiW8QJaZhcGi5r48VbLl05Gq6U Aug 10 17:54:43.838303 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 17:54:43.838303 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 17:54:43.838303 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 17:54:43.838303 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 17:54:43.838303 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 17:54:43.838303 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 17:54:43.838303 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: 9f945b16d78641f9a814167717da4317 Aug 10 17:54:43.838303 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-QuotasAdminNegativeTest-217090064 Aug 10 17:54:43.838303 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 17:54:43.838303 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 17:54:43.838303 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9f945b16d78641f9a814167717da4317"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9f945b16d78641f9a814167717da4317"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9f945b16d78641f9a814167717da4317"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9f945b16d78641f9a814167717da4317", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:54:43.838303 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-QuotasAdminNegativeTest-217090064 Aug 10 17:54:43.838303 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: 9f945b16d78641f9a814167717da4317 Aug 10 17:54:43.838303 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-217090064 Aug 10 17:54:43.838303 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-QuotasAdminNegativeTest-217090064-project Aug 10 17:54:43.838303 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 17:54:43.838303 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 17:54:43.838303 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: a3ebd93ac6a549d99e957cd2c9f4077c Aug 10 17:54:43.838303 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-QuotasAdminNegativeTest-217090064-project Aug 10 17:54:43.838303 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 17:54:43.838303 n-d-852296-2 devstack@n-api.service[129410]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-199875909", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452"}} Aug 10 17:54:43.838303 n-d-852296-2 devstack@n-api.service[129410]: method: > Aug 10 17:54:43.838303 n-d-852296-2 devstack@n-api.service[129410]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 10 17:54:43.838303 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-199875909', 'imageRef': 'a735ff26-463a-4ffe-a981-ab9d9baa494f', 'flavorRef': '452'}}} Aug 10 17:54:43.838303 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:54:43.838303 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:43.838303 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Aug 10 17:54:43.838303 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Aug 10 17:54:43.838303 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 17:54:43.838303 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 17:54:43.838303 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 10 17:54:43.838303 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exc Aug 10 17:54:43.838303 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 10 17:54:43.838303 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 10 17:54:43.838303 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 17:54:43.838303 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 17:54:43.838303 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 10 17:54:43.838303 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 10 17:54:43.838303 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 10 17:54:43.838303 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 10 17:54:43.838303 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Aug 10 17:54:43.838303 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 10 17:54:43.838303 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Aug 10 17:54:43.838303 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:54:43.838303 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:54:43.838303 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:54:43.838303 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:43.838303 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 17:54:43.838303 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 17:54:43.838303 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 17:54:43.838303 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 17:54:43.838303 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1678, in _create_instance Aug 10 17:54:43.844123 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Aug 10 17:54:43.844123 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1350, in _provision_instances Aug 10 17:54:43.844123 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Aug 10 17:54:43.844123 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Aug 10 17:54:43.844123 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 10 17:54:43.844123 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 10 17:54:43.844123 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:54:43.844123 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:54:43.844123 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:54:43.844123 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:43.844123 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:54:43.844123 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:54:43.844123 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:54:43.844123 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:54:43.844123 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:54:43.844123 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:54:43.844123 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:54:43.844123 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:54:43.844123 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:54:43.844123 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:54:43.844123 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:54:43.844123 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:54:43.844123 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 17:54:43.844123 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 10 17:54:43.844123 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 10 17:54:43.844123 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 10 17:54:43.844123 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:54:43.844123 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:54:43.844123 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:54:43.844123 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:43.844123 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:54:43.844123 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:54:43.844123 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:54:43.844123 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:54:43.844123 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 10 17:54:43.844123 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:54:43.856324 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-8d254d0d-4868-46f2-8b03-821c86a7cc8e tempest-QuotasAdminNegativeTest-217090064 tempest-QuotasAdminNegativeTest-217090064-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:54:43.860765 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-8d254d0d-4868-46f2-8b03-821c86a7cc8e tempest-QuotasAdminNegativeTest-217090064 tempest-QuotasAdminNegativeTest-217090064-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 1.254457 Aug 10 17:54:43.865007 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 662/1329] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 17:54:42 2022] POST /compute/v2.1/servers => generated 119 bytes in 1265 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:54:43.871563 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-2b894e30-39ca-46b1-8910-1555d693b940 tempest-QuotasAdminNegativeTest-1442736489 tempest-QuotasAdminNegativeTest-1442736489-project-admin] Action: 'update', calling method: .version_select at 0x7fb345ebf4c0>, body: {"quota_set": {"instances": 10}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:54:44.249854 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-2b894e30-39ca-46b1-8910-1555d693b940 tempest-QuotasAdminNegativeTest-1442736489 tempest-QuotasAdminNegativeTest-1442736489-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:44.250500 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-2b894e30-39ca-46b1-8910-1555d693b940 tempest-QuotasAdminNegativeTest-1442736489 tempest-QuotasAdminNegativeTest-1442736489-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:44.250766 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-2b894e30-39ca-46b1-8910-1555d693b940 tempest-QuotasAdminNegativeTest-1442736489 tempest-QuotasAdminNegativeTest-1442736489-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:44.251956 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-2b894e30-39ca-46b1-8910-1555d693b940 tempest-QuotasAdminNegativeTest-1442736489 tempest-QuotasAdminNegativeTest-1442736489-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:44.252633 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-2b894e30-39ca-46b1-8910-1555d693b940 tempest-QuotasAdminNegativeTest-1442736489 tempest-QuotasAdminNegativeTest-1442736489-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:44.253236 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-2b894e30-39ca-46b1-8910-1555d693b940 tempest-QuotasAdminNegativeTest-1442736489 tempest-QuotasAdminNegativeTest-1442736489-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:44.436975 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-5bc385e1-1c8f-4989-a12e-e6b3326dc344 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:54:44.438166 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-5bc385e1-1c8f-4989-a12e-e6b3326dc344 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] [instance: 5b41d7b5-e888-47ec-a57e-5b474e76ef45] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:54:44.449699 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-5bc385e1-1c8f-4989-a12e-e6b3326dc344 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:44.450213 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-5bc385e1-1c8f-4989-a12e-e6b3326dc344 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:44.450872 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-5bc385e1-1c8f-4989-a12e-e6b3326dc344 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:44.451860 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-5bc385e1-1c8f-4989-a12e-e6b3326dc344 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:44.453720 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-5bc385e1-1c8f-4989-a12e-e6b3326dc344 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:44.455249 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-5bc385e1-1c8f-4989-a12e-e6b3326dc344 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:44.505053 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-2b894e30-39ca-46b1-8910-1555d693b940 tempest-QuotasAdminNegativeTest-1442736489 tempest-QuotasAdminNegativeTest-1442736489-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-quota-sets/9f945b16d78641f9a814167717da4317" status: 200 len: 329 microversion: 2.1 time: 0.637533 Aug 10 17:54:44.507610 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 668/1330] 10.222.0.50 () {60 vars in 1262 bytes} [Wed Aug 10 17:54:43 2022] PUT /compute/v2.1/os-quota-sets/9f945b16d78641f9a814167717da4317 => generated 329 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:54:44.529513 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-d3782e61-dda2-4aa7-8947-e4acd4ccee90 tempest-QuotasAdminNegativeTest-1442736489 tempest-QuotasAdminNegativeTest-1442736489-project-admin] Calling method '.version_select at 0x7fb345ec5940>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:54:44.746715 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-d3782e61-dda2-4aa7-8947-e4acd4ccee90 tempest-QuotasAdminNegativeTest-1442736489 tempest-QuotasAdminNegativeTest-1442736489-project-admin] 10.222.0.50 "GET /compute/v2.1/os-quota-sets/9f945b16d78641f9a814167717da4317" status: 200 len: 371 microversion: 2.1 time: 0.229060 Aug 10 17:54:44.746715 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 669/1331] 10.222.0.50 () {58 vars in 1242 bytes} [Wed Aug 10 17:54:44 2022] GET /compute/v2.1/os-quota-sets/9f945b16d78641f9a814167717da4317 => generated 371 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:54:44.752890 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-5bc385e1-1c8f-4989-a12e-e6b3326dc344 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36de414913b4223aba37ecb0f74e467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea1bedbf4fa421198a38dbfad95db72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:54:44.756862 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-dd3b5364-aa8f-4a89-a1cc-0da4f615f6a9 tempest-QuotasAdminNegativeTest-1442736489 tempest-QuotasAdminNegativeTest-1442736489-project-admin] Action: 'update', calling method: .version_select at 0x7fb345ebf9d0>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:54:44.781520 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-5bc385e1-1c8f-4989-a12e-e6b3326dc344 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] 10.222.0.50 "GET /compute/v2.1/servers/5b41d7b5-e888-47ec-a57e-5b474e76ef45" status: 200 len: 1269 microversion: 2.1 time: 0.346390 Aug 10 17:54:44.781520 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 663/1332] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:54:44 2022] GET /compute/v2.1/servers/5b41d7b5-e888-47ec-a57e-5b474e76ef45 => generated 1269 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:54:44.869374 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-dd3b5364-aa8f-4a89-a1cc-0da4f615f6a9 tempest-QuotasAdminNegativeTest-1442736489 tempest-QuotasAdminNegativeTest-1442736489-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:44.870058 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-dd3b5364-aa8f-4a89-a1cc-0da4f615f6a9 tempest-QuotasAdminNegativeTest-1442736489 tempest-QuotasAdminNegativeTest-1442736489-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:44.870607 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-dd3b5364-aa8f-4a89-a1cc-0da4f615f6a9 tempest-QuotasAdminNegativeTest-1442736489 tempest-QuotasAdminNegativeTest-1442736489-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:44.871777 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-dd3b5364-aa8f-4a89-a1cc-0da4f615f6a9 tempest-QuotasAdminNegativeTest-1442736489 tempest-QuotasAdminNegativeTest-1442736489-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:44.872636 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-dd3b5364-aa8f-4a89-a1cc-0da4f615f6a9 tempest-QuotasAdminNegativeTest-1442736489 tempest-QuotasAdminNegativeTest-1442736489-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:44.873427 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-dd3b5364-aa8f-4a89-a1cc-0da4f615f6a9 tempest-QuotasAdminNegativeTest-1442736489 tempest-QuotasAdminNegativeTest-1442736489-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:45.083205 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-dd3b5364-aa8f-4a89-a1cc-0da4f615f6a9 tempest-QuotasAdminNegativeTest-1442736489 tempest-QuotasAdminNegativeTest-1442736489-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-quota-sets/9f945b16d78641f9a814167717da4317" status: 200 len: 325 microversion: 2.1 time: 0.328789 Aug 10 17:54:45.089062 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 670/1333] 10.222.0.50 () {60 vars in 1262 bytes} [Wed Aug 10 17:54:44 2022] PUT /compute/v2.1/os-quota-sets/9f945b16d78641f9a814167717da4317 => generated 325 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:54:45.483172 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-1a056222-db2e-43ed-9bbe-7359d8c6ab84 tempest-QuotasAdminNegativeTest-217090064 tempest-QuotasAdminNegativeTest-217090064-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-2119063418", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452"}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:54:45.603965 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.network.neutron [None req-1a056222-db2e-43ed-9bbe-7359d8c6ab84 tempest-QuotasAdminNegativeTest-217090064 tempest-QuotasAdminNegativeTest-217090064-project] validate_networks() for None {{(pid=129410) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 17:54:45.800605 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-f15294d8-77b7-42ee-9982-fbb176f516da tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:54:45.801217 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-f15294d8-77b7-42ee-9982-fbb176f516da tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] [instance: 5b41d7b5-e888-47ec-a57e-5b474e76ef45] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:54:45.807760 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-f15294d8-77b7-42ee-9982-fbb176f516da tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:45.808276 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-f15294d8-77b7-42ee-9982-fbb176f516da tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:45.809021 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-f15294d8-77b7-42ee-9982-fbb176f516da tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:45.810184 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-f15294d8-77b7-42ee-9982-fbb176f516da tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:45.811167 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-f15294d8-77b7-42ee-9982-fbb176f516da tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:45.811677 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-f15294d8-77b7-42ee-9982-fbb176f516da tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:45.901326 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-f15294d8-77b7-42ee-9982-fbb176f516da tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36de414913b4223aba37ecb0f74e467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea1bedbf4fa421198a38dbfad95db72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:54:45.914519 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-f15294d8-77b7-42ee-9982-fbb176f516da tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] 10.222.0.50 "GET /compute/v2.1/servers/5b41d7b5-e888-47ec-a57e-5b474e76ef45" status: 200 len: 1275 microversion: 2.1 time: 0.117763 Aug 10 17:54:45.915779 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 671/1334] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:54:45 2022] GET /compute/v2.1/servers/5b41d7b5-e888-47ec-a57e-5b474e76ef45 => generated 1275 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:54:46.516213 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.virt.hardware [None req-1a056222-db2e-43ed-9bbe-7359d8c6ab84 tempest-QuotasAdminNegativeTest-217090064 tempest-QuotasAdminNegativeTest-217090064-project] Flavor limits 0:0:0 {{(pid=129410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 17:54:46.516846 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.virt.hardware [None req-1a056222-db2e-43ed-9bbe-7359d8c6ab84 tempest-QuotasAdminNegativeTest-217090064 tempest-QuotasAdminNegativeTest-217090064-project] Image limits 0:0:0 {{(pid=129410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 17:54:46.517318 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.virt.hardware [None req-1a056222-db2e-43ed-9bbe-7359d8c6ab84 tempest-QuotasAdminNegativeTest-217090064 tempest-QuotasAdminNegativeTest-217090064-project] Flavor pref 0:0:0 {{(pid=129410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 17:54:46.517916 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.virt.hardware [None req-1a056222-db2e-43ed-9bbe-7359d8c6ab84 tempest-QuotasAdminNegativeTest-217090064 tempest-QuotasAdminNegativeTest-217090064-project] Image pref 0:0:0 {{(pid=129410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 17:54:46.518505 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.virt.hardware [None req-1a056222-db2e-43ed-9bbe-7359d8c6ab84 tempest-QuotasAdminNegativeTest-217090064 tempest-QuotasAdminNegativeTest-217090064-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 17:54:46.538721 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-1a056222-db2e-43ed-9bbe-7359d8c6ab84 tempest-QuotasAdminNegativeTest-217090064 tempest-QuotasAdminNegativeTest-217090064-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:46.538721 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-1a056222-db2e-43ed-9bbe-7359d8c6ab84 tempest-QuotasAdminNegativeTest-217090064 tempest-QuotasAdminNegativeTest-217090064-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:46.538721 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-1a056222-db2e-43ed-9bbe-7359d8c6ab84 tempest-QuotasAdminNegativeTest-217090064 tempest-QuotasAdminNegativeTest-217090064-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:46.538721 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-1a056222-db2e-43ed-9bbe-7359d8c6ab84 tempest-QuotasAdminNegativeTest-217090064 tempest-QuotasAdminNegativeTest-217090064-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:46.538721 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-1a056222-db2e-43ed-9bbe-7359d8c6ab84 tempest-QuotasAdminNegativeTest-217090064 tempest-QuotasAdminNegativeTest-217090064-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:46.538721 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-1a056222-db2e-43ed-9bbe-7359d8c6ab84 tempest-QuotasAdminNegativeTest-217090064 tempest-QuotasAdminNegativeTest-217090064-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:46.554640 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.quota [None req-1a056222-db2e-43ed-9bbe-7359d8c6ab84 tempest-QuotasAdminNegativeTest-217090064 tempest-QuotasAdminNegativeTest-217090064-project] Getting quotas for project 9f945b16d78641f9a814167717da4317. Resources: {'instances', 'ram', 'cores'} {{(pid=129410) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:54:46.560729 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.quota [None req-1a056222-db2e-43ed-9bbe-7359d8c6ab84 tempest-QuotasAdminNegativeTest-217090064 tempest-QuotasAdminNegativeTest-217090064-project] Getting quotas for user a3ebd93ac6a549d99e957cd2c9f4077c and project 9f945b16d78641f9a814167717da4317. Resources: {'instances', 'ram', 'cores'} {{(pid=129410) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:54:46.574276 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.utils [None req-1a056222-db2e-43ed-9bbe-7359d8c6ab84 tempest-QuotasAdminNegativeTest-217090064 tempest-QuotasAdminNegativeTest-217090064-project] ram quota exceeded for 9f945b16d78641f9a814167717da4317, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=129410) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Aug 10 17:54:46.574746 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-1a056222-db2e-43ed-9bbe-7359d8c6ab84 tempest-QuotasAdminNegativeTest-217090064 tempest-QuotasAdminNegativeTest-217090064-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 10 17:54:46.576738 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-1a056222-db2e-43ed-9bbe-7359d8c6ab84 tempest-QuotasAdminNegativeTest-217090064 tempest-QuotasAdminNegativeTest-217090064-project] Request method failure captured: Aug 10 17:54:46.576738 n-d-852296-2 devstack@n-api.service[129410]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 17:54:46.576738 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 17:54:46.576738 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 17:54:46.576738 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 17:54:46.576738 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 145 Aug 10 17:54:46.576738 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 17:54:46.576738 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 17:54:46.576738 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 17:54:46.576738 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 17:54:46.576738 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8_DZgwIGcOc3mWuWXPleqrH29EuGx4NOSCrQXa126gu62H-sHkvCki_2Svgb__O9KrqFTswYyq12sWpY6RxsGF2jkQo-WXUOuMJEtkSxJDDmwsfU5LbAyZnNBs7W_VlQUJ1UhCWh8_IG4hH99hFFVXiW8QJaZhcGi5r48VbLl05Gq6U Aug 10 17:54:46.576738 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 17:54:46.576738 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 17:54:46.576738 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 17:54:46.576738 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 17:54:46.576738 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 17:54:46.576738 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 17:54:46.576738 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: 9f945b16d78641f9a814167717da4317 Aug 10 17:54:46.576738 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-QuotasAdminNegativeTest-217090064 Aug 10 17:54:46.576738 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 17:54:46.576738 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 17:54:46.576738 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9f945b16d78641f9a814167717da4317"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9f945b16d78641f9a814167717da4317"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9f945b16d78641f9a814167717da4317"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9f945b16d78641f9a814167717da4317", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:54:46.576738 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-QuotasAdminNegativeTest-217090064 Aug 10 17:54:46.576738 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: 9f945b16d78641f9a814167717da4317 Aug 10 17:54:46.576738 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-217090064 Aug 10 17:54:46.576738 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-QuotasAdminNegativeTest-217090064-project Aug 10 17:54:46.576738 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 17:54:46.576738 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 17:54:46.576738 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: a3ebd93ac6a549d99e957cd2c9f4077c Aug 10 17:54:46.576738 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-QuotasAdminNegativeTest-217090064-project Aug 10 17:54:46.576738 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 17:54:46.576738 n-d-852296-2 devstack@n-api.service[129410]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-2119063418", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452"}} Aug 10 17:54:46.576738 n-d-852296-2 devstack@n-api.service[129410]: method: > Aug 10 17:54:46.576738 n-d-852296-2 devstack@n-api.service[129410]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 10 17:54:46.576738 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-2119063418', 'imageRef': 'a735ff26-463a-4ffe-a981-ab9d9baa494f', 'flavorRef': '452'}}} Aug 10 17:54:46.576738 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:54:46.576738 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:46.576738 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Aug 10 17:54:46.576738 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Aug 10 17:54:46.576738 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 17:54:46.576738 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 17:54:46.576738 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 10 17:54:46.576738 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exc Aug 10 17:54:46.576738 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 10 17:54:46.576738 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 10 17:54:46.576738 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 17:54:46.576738 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 17:54:46.576738 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 10 17:54:46.576738 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 10 17:54:46.576738 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 10 17:54:46.576738 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 10 17:54:46.576738 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Aug 10 17:54:46.576738 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 10 17:54:46.576738 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Aug 10 17:54:46.576738 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:54:46.576738 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:54:46.576738 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:54:46.576738 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:46.576738 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 17:54:46.576738 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 17:54:46.576738 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 17:54:46.576738 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 17:54:46.576738 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1678, in _create_instance Aug 10 17:54:46.582042 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Aug 10 17:54:46.582042 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1350, in _provision_instances Aug 10 17:54:46.582042 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Aug 10 17:54:46.582042 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Aug 10 17:54:46.582042 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 10 17:54:46.582042 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 10 17:54:46.582042 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:54:46.582042 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:54:46.582042 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:54:46.582042 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:46.582042 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:54:46.582042 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:54:46.582042 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:54:46.582042 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:54:46.582042 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:54:46.582042 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:54:46.582042 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:54:46.582042 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:54:46.582042 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:54:46.582042 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:54:46.582042 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:54:46.582042 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:54:46.582042 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 17:54:46.582042 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 10 17:54:46.582042 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 10 17:54:46.582042 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 10 17:54:46.582042 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:54:46.582042 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:54:46.582042 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:54:46.582042 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:46.582042 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:54:46.582042 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:54:46.582042 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:54:46.582042 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:54:46.582042 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 10 17:54:46.582042 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:54:46.582042 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-1a056222-db2e-43ed-9bbe-7359d8c6ab84 tempest-QuotasAdminNegativeTest-217090064 tempest-QuotasAdminNegativeTest-217090064-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:54:46.582042 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-1a056222-db2e-43ed-9bbe-7359d8c6ab84 tempest-QuotasAdminNegativeTest-217090064 tempest-QuotasAdminNegativeTest-217090064-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 1.099910 Aug 10 17:54:46.582042 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 664/1335] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 17:54:45 2022] POST /compute/v2.1/servers => generated 110 bytes in 1101 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:54:46.591774 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-10b0aa6a-f2b5-4145-9d74-f7690c9a21fc tempest-QuotasAdminNegativeTest-1442736489 tempest-QuotasAdminNegativeTest-1442736489-project-admin] Action: 'update', calling method: .version_select at 0x7fb345ebea60>, body: {"quota_set": {"ram": 51200}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:54:46.949150 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-e5efdb31-1d6a-4d10-8f88-1efa0aa84b74 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:54:46.949898 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-e5efdb31-1d6a-4d10-8f88-1efa0aa84b74 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] [instance: 5b41d7b5-e888-47ec-a57e-5b474e76ef45] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:54:46.958157 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e5efdb31-1d6a-4d10-8f88-1efa0aa84b74 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:46.958726 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e5efdb31-1d6a-4d10-8f88-1efa0aa84b74 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:46.959861 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e5efdb31-1d6a-4d10-8f88-1efa0aa84b74 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:46.961021 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e5efdb31-1d6a-4d10-8f88-1efa0aa84b74 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:46.961620 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e5efdb31-1d6a-4d10-8f88-1efa0aa84b74 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:46.962192 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e5efdb31-1d6a-4d10-8f88-1efa0aa84b74 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:47.060940 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-10b0aa6a-f2b5-4145-9d74-f7690c9a21fc tempest-QuotasAdminNegativeTest-1442736489 tempest-QuotasAdminNegativeTest-1442736489-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:47.067299 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-10b0aa6a-f2b5-4145-9d74-f7690c9a21fc tempest-QuotasAdminNegativeTest-1442736489 tempest-QuotasAdminNegativeTest-1442736489-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:47.067299 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-10b0aa6a-f2b5-4145-9d74-f7690c9a21fc tempest-QuotasAdminNegativeTest-1442736489 tempest-QuotasAdminNegativeTest-1442736489-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:47.067299 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-10b0aa6a-f2b5-4145-9d74-f7690c9a21fc tempest-QuotasAdminNegativeTest-1442736489 tempest-QuotasAdminNegativeTest-1442736489-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:47.067299 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-10b0aa6a-f2b5-4145-9d74-f7690c9a21fc tempest-QuotasAdminNegativeTest-1442736489 tempest-QuotasAdminNegativeTest-1442736489-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:47.067299 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-10b0aa6a-f2b5-4145-9d74-f7690c9a21fc tempest-QuotasAdminNegativeTest-1442736489 tempest-QuotasAdminNegativeTest-1442736489-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:47.082142 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-e5efdb31-1d6a-4d10-8f88-1efa0aa84b74 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36de414913b4223aba37ecb0f74e467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea1bedbf4fa421198a38dbfad95db72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:54:47.095900 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-e5efdb31-1d6a-4d10-8f88-1efa0aa84b74 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] 10.222.0.50 "GET /compute/v2.1/servers/5b41d7b5-e888-47ec-a57e-5b474e76ef45" status: 200 len: 1275 microversion: 2.1 time: 0.151147 Aug 10 17:54:47.098719 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 665/1336] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:54:46 2022] GET /compute/v2.1/servers/5b41d7b5-e888-47ec-a57e-5b474e76ef45 => generated 1275 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:54:47.340755 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-10b0aa6a-f2b5-4145-9d74-f7690c9a21fc tempest-QuotasAdminNegativeTest-1442736489 tempest-QuotasAdminNegativeTest-1442736489-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-quota-sets/9f945b16d78641f9a814167717da4317" status: 200 len: 329 microversion: 2.1 time: 0.757474 Aug 10 17:54:47.341943 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 672/1337] 10.222.0.50 () {60 vars in 1262 bytes} [Wed Aug 10 17:54:46 2022] PUT /compute/v2.1/os-quota-sets/9f945b16d78641f9a814167717da4317 => generated 329 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:54:47.356481 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-304c6859-80ff-4242-8b23-3b457e237ee7 tempest-QuotasAdminNegativeTest-217090064 tempest-QuotasAdminNegativeTest-217090064-project] Action: 'update', calling method: .version_select at 0x7fb345b444c0>, body: {"quota_set": {"ram": 0}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:54:47.361895 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-304c6859-80ff-4242-8b23-3b457e237ee7 tempest-QuotasAdminNegativeTest-217090064 tempest-QuotasAdminNegativeTest-217090064-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': 'a3ebd93ac6a549d99e957cd2c9f4077c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f945b16d78641f9a814167717da4317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:54:47.370966 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-304c6859-80ff-4242-8b23-3b457e237ee7 tempest-QuotasAdminNegativeTest-217090064 tempest-QuotasAdminNegativeTest-217090064-project] Request method failure captured: Aug 10 17:54:47.370966 n-d-852296-2 devstack@n-api.service[129410]: request: PUT /compute/v2.1/os-quota-sets/9f945b16d78641f9a814167717da4317 HTTP/1.1 Aug 10 17:54:47.370966 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 17:54:47.370966 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 17:54:47.370966 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 17:54:47.370966 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 25 Aug 10 17:54:47.370966 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 17:54:47.370966 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 17:54:47.370966 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 17:54:47.370966 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 17:54:47.370966 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8_DZgwIGcOc3mWuWXPleqrH29EuGx4NOSCrQXa126gu62H-sHkvCki_2Svgb__O9KrqFTswYyq12sWpY6RxsGF2jkQo-WXUOuMJEtkSxJDDmwsfU5LbAyZnNBs7W_VlQUJ1UhCWh8_IG4hH99hFFVXiW8QJaZhcGi5r48VbLl05Gq6U Aug 10 17:54:47.370966 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 17:54:47.370966 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 17:54:47.370966 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 17:54:47.370966 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 17:54:47.370966 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 17:54:47.370966 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 17:54:47.370966 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: 9f945b16d78641f9a814167717da4317 Aug 10 17:54:47.370966 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-QuotasAdminNegativeTest-217090064 Aug 10 17:54:47.370966 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 17:54:47.370966 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 17:54:47.370966 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9f945b16d78641f9a814167717da4317"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9f945b16d78641f9a814167717da4317"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9f945b16d78641f9a814167717da4317"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9f945b16d78641f9a814167717da4317", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:54:47.370966 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-QuotasAdminNegativeTest-217090064 Aug 10 17:54:47.370966 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: 9f945b16d78641f9a814167717da4317 Aug 10 17:54:47.370966 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-217090064 Aug 10 17:54:47.370966 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-QuotasAdminNegativeTest-217090064-project Aug 10 17:54:47.370966 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 17:54:47.370966 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 17:54:47.370966 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: a3ebd93ac6a549d99e957cd2c9f4077c Aug 10 17:54:47.370966 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-QuotasAdminNegativeTest-217090064-project Aug 10 17:54:47.370966 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 17:54:47.370966 n-d-852296-2 devstack@n-api.service[129410]: {"quota_set": {"ram": 0}} Aug 10 17:54:47.370966 n-d-852296-2 devstack@n-api.service[129410]: method: Aug 10 17:54:47.370966 n-d-852296-2 devstack@n-api.service[129410]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Aug 10 17:54:47.370966 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'id': '9f945b16d78641f9a814167717da4317', 'body': {'quota_set': {'ram': 0}}} Aug 10 17:54:47.370966 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:54:47.370966 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:47.370966 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:54:47.370966 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:54:47.370966 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:54:47.370966 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:54:47.370966 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 17:54:47.370966 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 17:54:47.370966 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:54:47.370966 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:54:47.370966 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:54:47.370966 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:54:47.370966 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Aug 10 17:54:47.370966 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Aug 10 17:54:47.370966 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 10 17:54:47.370966 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:54:47.370966 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 10 17:54:47.370966 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:54:47.370966 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Aug 10 17:54:47.370966 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Aug 10 17:54:47.370966 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 10 17:54:47.370966 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 10 17:54:47.370966 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 10 17:54:47.370966 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 10 17:54:47.370966 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 10 17:54:47.370966 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 10 17:54:47.370966 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 10 17:54:47.370966 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise self.value Aug 10 17:54:47.370966 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 10 17:54:47.370966 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 10 17:54:47.380054 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 10 17:54:47.380054 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 10 17:54:47.380054 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 10 17:54:47.380054 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 10 17:54:47.380054 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Aug 10 17:54:47.380054 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:54:47.380054 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:54:47.380054 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:54:47.380054 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:47.380054 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:54:47.380054 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:54:47.380054 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 10 17:54:47.380054 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 10 17:54:47.380054 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Aug 10 17:54:47.380054 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:54:47.385530 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-304c6859-80ff-4242-8b23-3b457e237ee7 tempest-QuotasAdminNegativeTest-217090064 tempest-QuotasAdminNegativeTest-217090064-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:54:47.386513 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-304c6859-80ff-4242-8b23-3b457e237ee7 tempest-QuotasAdminNegativeTest-217090064 tempest-QuotasAdminNegativeTest-217090064-project] 10.222.0.50 "PUT /compute/v2.1/os-quota-sets/9f945b16d78641f9a814167717da4317" status: 403 len: 116 microversion: 2.1 time: 0.035824 Aug 10 17:54:47.387380 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 666/1338] 10.222.0.50 () {60 vars in 1262 bytes} [Wed Aug 10 17:54:47 2022] PUT /compute/v2.1/os-quota-sets/9f945b16d78641f9a814167717da4317 => generated 116 bytes in 37 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 10 17:54:48.130863 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-821a5361-ff2e-4a4a-8057-99891e03edd3 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:54:48.133537 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-821a5361-ff2e-4a4a-8057-99891e03edd3 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] [instance: 5b41d7b5-e888-47ec-a57e-5b474e76ef45] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:54:48.145137 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-821a5361-ff2e-4a4a-8057-99891e03edd3 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:48.148940 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-821a5361-ff2e-4a4a-8057-99891e03edd3 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:48.153831 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-821a5361-ff2e-4a4a-8057-99891e03edd3 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:48.153831 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-821a5361-ff2e-4a4a-8057-99891e03edd3 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:48.153831 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-821a5361-ff2e-4a4a-8057-99891e03edd3 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:48.153831 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-821a5361-ff2e-4a4a-8057-99891e03edd3 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:48.676109 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-821a5361-ff2e-4a4a-8057-99891e03edd3 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36de414913b4223aba37ecb0f74e467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea1bedbf4fa421198a38dbfad95db72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:54:48.689667 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-821a5361-ff2e-4a4a-8057-99891e03edd3 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] 10.222.0.50 "GET /compute/v2.1/servers/5b41d7b5-e888-47ec-a57e-5b474e76ef45" status: 200 len: 1317 microversion: 2.1 time: 0.562997 Aug 10 17:54:48.690264 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 673/1339] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:54:48 2022] GET /compute/v2.1/servers/5b41d7b5-e888-47ec-a57e-5b474e76ef45 => generated 1317 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:54:49.092976 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-d511eb1f-3ac4-4772-a3d6-01210a570600 tempest-AbsoluteLimitsNegativeTestJSON-564830112 tempest-AbsoluteLimitsNegativeTestJSON-564830112-project] Calling method '.version_select at 0x7fb345ad3940>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:54:49.121363 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d511eb1f-3ac4-4772-a3d6-01210a570600 tempest-AbsoluteLimitsNegativeTestJSON-564830112 tempest-AbsoluteLimitsNegativeTestJSON-564830112-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:49.121871 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d511eb1f-3ac4-4772-a3d6-01210a570600 tempest-AbsoluteLimitsNegativeTestJSON-564830112 tempest-AbsoluteLimitsNegativeTestJSON-564830112-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:49.122325 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d511eb1f-3ac4-4772-a3d6-01210a570600 tempest-AbsoluteLimitsNegativeTestJSON-564830112 tempest-AbsoluteLimitsNegativeTestJSON-564830112-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:49.123072 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d511eb1f-3ac4-4772-a3d6-01210a570600 tempest-AbsoluteLimitsNegativeTestJSON-564830112 tempest-AbsoluteLimitsNegativeTestJSON-564830112-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:49.123560 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d511eb1f-3ac4-4772-a3d6-01210a570600 tempest-AbsoluteLimitsNegativeTestJSON-564830112 tempest-AbsoluteLimitsNegativeTestJSON-564830112-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:49.123994 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d511eb1f-3ac4-4772-a3d6-01210a570600 tempest-AbsoluteLimitsNegativeTestJSON-564830112 tempest-AbsoluteLimitsNegativeTestJSON-564830112-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:49.153634 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-d511eb1f-3ac4-4772-a3d6-01210a570600 tempest-AbsoluteLimitsNegativeTestJSON-564830112 tempest-AbsoluteLimitsNegativeTestJSON-564830112-project] 10.222.0.50 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.222773 Aug 10 17:54:49.154885 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 667/1340] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 10 17:54:48 2022] GET /compute/v2.1/limits => generated 511 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:54:49.231142 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-4a6259e7-b0a0-42b5-a1fc-50687cf77113 tempest-AbsoluteLimitsNegativeTestJSON-564830112 tempest-AbsoluteLimitsNegativeTestJSON-564830112-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-155221000", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:54:49.320606 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.network.neutron [None req-4a6259e7-b0a0-42b5-a1fc-50687cf77113 tempest-AbsoluteLimitsNegativeTestJSON-564830112 tempest-AbsoluteLimitsNegativeTestJSON-564830112-project] validate_networks() for None {{(pid=129409) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 17:54:49.717413 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-21eea503-8ac3-4a79-a5ae-59c3b6f20f6f tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:54:49.719253 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-21eea503-8ac3-4a79-a5ae-59c3b6f20f6f tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] [instance: 5b41d7b5-e888-47ec-a57e-5b474e76ef45] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:54:49.732847 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-21eea503-8ac3-4a79-a5ae-59c3b6f20f6f tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:49.733793 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-21eea503-8ac3-4a79-a5ae-59c3b6f20f6f tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:49.734720 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-21eea503-8ac3-4a79-a5ae-59c3b6f20f6f tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:49.735854 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-21eea503-8ac3-4a79-a5ae-59c3b6f20f6f tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:49.736612 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-21eea503-8ac3-4a79-a5ae-59c3b6f20f6f tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:49.737286 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-21eea503-8ac3-4a79-a5ae-59c3b6f20f6f tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:50.072433 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:54:50.104501 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-4a6259e7-b0a0-42b5-a1fc-50687cf77113 tempest-AbsoluteLimitsNegativeTestJSON-564830112 tempest-AbsoluteLimitsNegativeTestJSON-564830112-project] Getting quotas for project f658cf673fd14a76b2c7c4e4922f95c7. Resources: dict_keys(['metadata_items']) {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:54:50.115430 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-4a6259e7-b0a0-42b5-a1fc-50687cf77113 tempest-AbsoluteLimitsNegativeTestJSON-564830112 tempest-AbsoluteLimitsNegativeTestJSON-564830112-project] Getting quotas for user eddba494dda74a969634efa280016d2d and project f658cf673fd14a76b2c7c4e4922f95c7. Resources: dict_keys(['metadata_items']) {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:54:50.149682 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-4a6259e7-b0a0-42b5-a1fc-50687cf77113 tempest-AbsoluteLimitsNegativeTestJSON-564830112 tempest-AbsoluteLimitsNegativeTestJSON-564830112-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Aug 10 17:54:50.152733 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-4a6259e7-b0a0-42b5-a1fc-50687cf77113 tempest-AbsoluteLimitsNegativeTestJSON-564830112 tempest-AbsoluteLimitsNegativeTestJSON-564830112-project] Request method failure captured: Aug 10 17:54:50.152733 n-d-852296-2 devstack@n-api.service[129409]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 17:54:50.152733 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 17:54:50.152733 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 17:54:50.152733 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 17:54:50.152733 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 1751 Aug 10 17:54:50.152733 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 17:54:50.152733 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 17:54:50.152733 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 17:54:50.152733 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 17:54:50.152733 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8_DoXAeQ6VIpc2AFElQm_g_d6ju_3S927pOl4GWHQWc2tR1U4T0tngSg4OQU_wWJhRXye7Q_7mLXn5IazJ7Uln-d24ImJtJvlOFyrmJNSV4l1Dn0YK7X34ADTEa4ErFSabgESBzqy7KiED6igBFuHgE9OcT8xYU9hUpAPo79JoLL4RA Aug 10 17:54:50.152733 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 17:54:50.152733 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 17:54:50.152733 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 17:54:50.152733 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 17:54:50.152733 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 17:54:50.152733 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 17:54:50.152733 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: f658cf673fd14a76b2c7c4e4922f95c7 Aug 10 17:54:50.152733 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-564830112 Aug 10 17:54:50.152733 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 17:54:50.152733 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 17:54:50.152733 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f658cf673fd14a76b2c7c4e4922f95c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f658cf673fd14a76b2c7c4e4922f95c7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f658cf673fd14a76b2c7c4e4922f95c7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f658cf673fd14a76b2c7c4e4922f95c7", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:54:50.152733 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-564830112 Aug 10 17:54:50.152733 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: f658cf673fd14a76b2c7c4e4922f95c7 Aug 10 17:54:50.152733 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-564830112 Aug 10 17:54:50.152733 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-564830112-project Aug 10 17:54:50.152733 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 17:54:50.152733 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 17:54:50.152733 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: eddba494dda74a969634efa280016d2d Aug 10 17:54:50.152733 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-564830112-project Aug 10 17:54:50.152733 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:54:50.152733 n-d-852296-2 devstack@n-api.service[129409]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-155221000", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Aug 10 17:54:50.152733 n-d-852296-2 devstack@n-api.service[129409]: method: > Aug 10 17:54:50.152733 n-d-852296-2 devstack@n-api.service[129409]: exception: Maximum number of metadata items exceeds 128 Aug 10 17:54:50.155659 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-155221000', 'imageRef': 'a735ff26-463a-4ffe-a981-ab9d9baa494f', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Aug 10 17:54:50.155659 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:54:50.155659 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:50.155659 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 464, in _check_metadata_properties_quota Aug 10 17:54:50.155659 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Aug 10 17:54:50.155659 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 17:54:50.155659 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 17:54:50.155659 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Aug 10 17:54:50.155659 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Aug 10 17:54:50.155659 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Aug 10 17:54:50.155659 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Aug 10 17:54:50.155659 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Aug 10 17:54:50.155659 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Aug 10 17:54:50.155659 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Aug 10 17:54:50.155659 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:50.155659 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:54:50.155659 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:50.155659 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:50.155659 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 17:54:50.155659 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 17:54:50.155659 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 17:54:50.155659 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 17:54:50.155659 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 10 17:54:50.155659 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Aug 10 17:54:50.155659 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1004, in _checks_for_create_and_rebuild Aug 10 17:54:50.155659 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Aug 10 17:54:50.155659 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 471, in _check_metadata_properties_quota Aug 10 17:54:50.155659 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Aug 10 17:54:50.155659 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Aug 10 17:54:50.155659 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:50.155659 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:54:50.155659 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:50.155659 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:50.155659 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:54:50.155659 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:54:50.155659 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:54:50.155659 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:54:50.155659 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:54:50.155659 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:54:50.155659 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:54:50.155659 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:54:50.155659 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:54:50.155659 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:54:50.155659 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:54:50.162854 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:54:50.162854 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 17:54:50.162854 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 10 17:54:50.162854 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 10 17:54:50.162854 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Aug 10 17:54:50.162854 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:50.162854 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:54:50.162854 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:50.162854 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:50.162854 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:54:50.162854 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:54:50.162854 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:54:50.162854 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:54:50.162854 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Aug 10 17:54:50.162854 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:50.162854 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-4a6259e7-b0a0-42b5-a1fc-50687cf77113 tempest-AbsoluteLimitsNegativeTestJSON-564830112 tempest-AbsoluteLimitsNegativeTestJSON-564830112-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:54:50.166563 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-4a6259e7-b0a0-42b5-a1fc-50687cf77113 tempest-AbsoluteLimitsNegativeTestJSON-564830112 tempest-AbsoluteLimitsNegativeTestJSON-564830112-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.940055 Aug 10 17:54:50.167296 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 674/1341] 10.222.0.50 () {60 vars in 1148 bytes} [Wed Aug 10 17:54:49 2022] POST /compute/v2.1/servers => generated 87 bytes in 943 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Aug 10 17:54:50.387096 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-21eea503-8ac3-4a79-a5ae-59c3b6f20f6f tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36de414913b4223aba37ecb0f74e467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea1bedbf4fa421198a38dbfad95db72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:54:50.404514 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-21eea503-8ac3-4a79-a5ae-59c3b6f20f6f tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] 10.222.0.50 "GET /compute/v2.1/servers/5b41d7b5-e888-47ec-a57e-5b474e76ef45" status: 200 len: 1317 microversion: 2.1 time: 0.697611 Aug 10 17:54:50.405126 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 668/1342] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:54:49 2022] GET /compute/v2.1/servers/5b41d7b5-e888-47ec-a57e-5b474e76ef45 => generated 1317 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:54:50.823026 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [req-ca06f50f-6f6b-49cb-9c0c-1dd971dd2b33 req-377caf63-eb13-4c62-9e42-e8c9929f3f2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b41d7b5-e888-47ec-a57e-5b474e76ef45", "tag": "8aff8e43-12e5-4e3e-bb1f-efb7af31ddbe"}]} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:54:50.853758 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-ca06f50f-6f6b-49cb-9c0c-1dd971dd2b33 req-377caf63-eb13-4c62-9e42-e8c9929f3f2a service nova] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:50.855006 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-ca06f50f-6f6b-49cb-9c0c-1dd971dd2b33 req-377caf63-eb13-4c62-9e42-e8c9929f3f2a service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:50.856584 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-ca06f50f-6f6b-49cb-9c0c-1dd971dd2b33 req-377caf63-eb13-4c62-9e42-e8c9929f3f2a service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:50.907457 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.compute.server_external_events [req-ca06f50f-6f6b-49cb-9c0c-1dd971dd2b33 req-377caf63-eb13-4c62-9e42-e8c9929f3f2a service nova] Creating event network-changed:8aff8e43-12e5-4e3e-bb1f-efb7af31ddbe for instance 5b41d7b5-e888-47ec-a57e-5b474e76ef45 on n-h1-852296-2 Aug 10 17:54:50.921671 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [req-ca06f50f-6f6b-49cb-9c0c-1dd971dd2b33 req-377caf63-eb13-4c62-9e42-e8c9929f3f2a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106413 Aug 10 17:54:50.922915 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 675/1343] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 10 17:54:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:54:51.429337 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-81483b61-2d51-4c67-bee0-2b903cae7ad3 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:54:51.432677 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-81483b61-2d51-4c67-bee0-2b903cae7ad3 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] [instance: 5b41d7b5-e888-47ec-a57e-5b474e76ef45] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:54:51.441835 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-81483b61-2d51-4c67-bee0-2b903cae7ad3 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:51.442577 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-81483b61-2d51-4c67-bee0-2b903cae7ad3 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:51.451112 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-81483b61-2d51-4c67-bee0-2b903cae7ad3 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:51.452732 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-81483b61-2d51-4c67-bee0-2b903cae7ad3 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:51.453422 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-81483b61-2d51-4c67-bee0-2b903cae7ad3 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:51.454320 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-81483b61-2d51-4c67-bee0-2b903cae7ad3 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:51.862565 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-81483b61-2d51-4c67-bee0-2b903cae7ad3 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36de414913b4223aba37ecb0f74e467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea1bedbf4fa421198a38dbfad95db72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:54:51.875852 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-81483b61-2d51-4c67-bee0-2b903cae7ad3 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] 10.222.0.50 "GET /compute/v2.1/servers/5b41d7b5-e888-47ec-a57e-5b474e76ef45" status: 200 len: 1317 microversion: 2.1 time: 0.452844 Aug 10 17:54:51.895830 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 669/1344] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:54:51 2022] GET /compute/v2.1/servers/5b41d7b5-e888-47ec-a57e-5b474e76ef45 => generated 1317 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:54:52.904365 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-9977733b-dea9-4861-8d11-6a3bbe2677a3 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:54:52.905919 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-9977733b-dea9-4861-8d11-6a3bbe2677a3 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] [instance: 5b41d7b5-e888-47ec-a57e-5b474e76ef45] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:54:52.916264 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-9977733b-dea9-4861-8d11-6a3bbe2677a3 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:52.917005 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-9977733b-dea9-4861-8d11-6a3bbe2677a3 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:52.917635 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-9977733b-dea9-4861-8d11-6a3bbe2677a3 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:52.918738 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-9977733b-dea9-4861-8d11-6a3bbe2677a3 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:52.919628 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-9977733b-dea9-4861-8d11-6a3bbe2677a3 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:52.920378 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-9977733b-dea9-4861-8d11-6a3bbe2677a3 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:53.547753 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-9977733b-dea9-4861-8d11-6a3bbe2677a3 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36de414913b4223aba37ecb0f74e467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea1bedbf4fa421198a38dbfad95db72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:54:53.559708 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-9977733b-dea9-4861-8d11-6a3bbe2677a3 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] 10.222.0.50 "GET /compute/v2.1/servers/5b41d7b5-e888-47ec-a57e-5b474e76ef45" status: 200 len: 1317 microversion: 2.1 time: 0.660379 Aug 10 17:54:53.560970 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 676/1345] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:54:52 2022] GET /compute/v2.1/servers/5b41d7b5-e888-47ec-a57e-5b474e76ef45 => generated 1317 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:54:54.583871 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-dc687516-77b8-4861-8f6c-4d9e5684fdab tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:54:54.585538 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-dc687516-77b8-4861-8f6c-4d9e5684fdab tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] [instance: 5b41d7b5-e888-47ec-a57e-5b474e76ef45] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:54:54.598952 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-dc687516-77b8-4861-8f6c-4d9e5684fdab tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:54.600788 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-dc687516-77b8-4861-8f6c-4d9e5684fdab tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:54.604845 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-dc687516-77b8-4861-8f6c-4d9e5684fdab tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:54.609869 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-dc687516-77b8-4861-8f6c-4d9e5684fdab tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:54.611134 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-dc687516-77b8-4861-8f6c-4d9e5684fdab tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:54.611757 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-dc687516-77b8-4861-8f6c-4d9e5684fdab tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:55.196955 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-dc687516-77b8-4861-8f6c-4d9e5684fdab tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36de414913b4223aba37ecb0f74e467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea1bedbf4fa421198a38dbfad95db72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:54:55.206743 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-dc687516-77b8-4861-8f6c-4d9e5684fdab tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] 10.222.0.50 "GET /compute/v2.1/servers/5b41d7b5-e888-47ec-a57e-5b474e76ef45" status: 200 len: 1317 microversion: 2.1 time: 0.626949 Aug 10 17:54:55.207905 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 670/1346] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:54:54 2022] GET /compute/v2.1/servers/5b41d7b5-e888-47ec-a57e-5b474e76ef45 => generated 1317 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:54:55.933561 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-14e127fc-eea5-4d89-be32-123d14707d19 tempest-ServerRescueTestJSON-1882297630 tempest-ServerRescueTestJSON-1882297630-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-672103842", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:54:56.043670 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.network.neutron [None req-14e127fc-eea5-4d89-be32-123d14707d19 tempest-ServerRescueTestJSON-1882297630 tempest-ServerRescueTestJSON-1882297630-project] validate_networks() for [('cbf0d8a8-ae99-4af3-9445-3812568e751c', None, None, None, None, None)] {{(pid=129409) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 17:54:56.323460 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-e6da45c4-ee16-4656-b044-bed7f6aa6311 tempest-FloatingIPsTestJSON-416546987 tempest-FloatingIPsTestJSON-416546987-project] Action: 'create', calling method: .version_select at 0x7fb345b9d0d0>, body: {"pool": null} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:54:57.001153 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [None req-14e127fc-eea5-4d89-be32-123d14707d19 tempest-ServerRescueTestJSON-1882297630 tempest-ServerRescueTestJSON-1882297630-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-7cf6b2b2-0d9b-45e7-bed1-f6b00d67e87e) Aug 10 17:54:57.001153 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:57.001153 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:54:57.001153 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:54:57.001153 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:54:57.001153 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:54:57.001153 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:54:57.001153 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:54:57.001153 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:54:57.001153 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:54:57.001153 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 17:54:57.001153 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 17:54:57.001153 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 17:54:57.001153 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 17:54:57.001153 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 17:54:57.001153 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 17:54:57.001153 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 17:54:57.001153 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 17:54:57.001153 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 17:54:57.001153 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 17:54:57.001153 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 17:54:57.001153 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 17:54:57.001153 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 17:54:57.001153 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 17:54:57.001153 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 17:54:57.001153 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 17:54:57.001153 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 17:54:57.001153 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:54:57.001153 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:54:57.001153 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 17:54:57.001153 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 17:54:57.001153 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:54:57.001153 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:54:57.001153 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:54:57.001153 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:54:57.001153 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:54:57.001153 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:54:57.001153 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:54:57.001153 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:54:57.001153 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:54:57.001153 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:54:57.001153 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 17:54:57.001153 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 17:54:57.001153 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 17:54:57.001153 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 17:54:57.001153 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 17:54:57.001153 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 17:54:57.001153 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 17:54:57.001153 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 17:54:57.001153 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 17:54:57.001153 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 17:54:57.001153 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 17:54:57.001153 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 17:54:57.009718 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 17:54:57.009718 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 17:54:57.009718 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 17:54:57.009718 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 17:54:57.009718 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 17:54:57.009718 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 17:54:57.009718 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 17:54:57.009718 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 17:54:57.009718 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 17:54:57.009718 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 17:54:57.009718 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 17:54:57.009718 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 17:54:57.009718 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 17:54:57.009718 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 17:54:57.009718 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-7cf6b2b2-0d9b-45e7-bed1-f6b00d67e87e) Aug 10 17:54:57.009718 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:57.009718 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-14e127fc-eea5-4d89-be32-123d14707d19 tempest-ServerRescueTestJSON-1882297630 tempest-ServerRescueTestJSON-1882297630-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:54:57.009718 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:54:57.009718 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-14e127fc-eea5-4d89-be32-123d14707d19 tempest-ServerRescueTestJSON-1882297630 tempest-ServerRescueTestJSON-1882297630-project] Request method failure captured: Aug 10 17:54:57.009718 n-d-852296-2 devstack@n-api.service[129409]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 17:54:57.009718 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 17:54:57.009718 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 17:54:57.009718 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 17:54:57.009718 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 237 Aug 10 17:54:57.009718 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 17:54:57.009718 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 17:54:57.009718 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 17:54:57.009718 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 17:54:57.009718 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8_DuM0cBv0uIO4kRZW-Op8b-DSI2M7MYlKraAzcti84sPvX29qF9x5-K6lPAWvWP8SruTzBSb-pUP9KhB0fXOshGcyss8GJYr1ypEoTLg8Xaigsh-kGqeV398lbGSRWdllCTctHrPJsn-KUjXmpp4HY17K6qavIqtYuzAa18rzCAhdE Aug 10 17:54:57.009718 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 17:54:57.009718 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 17:54:57.009718 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 17:54:57.009718 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 17:54:57.009718 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 17:54:57.009718 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 17:54:57.009718 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: 5ed0115354d24d07a0bf8467c3049abe Aug 10 17:54:57.009718 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-ServerRescueTestJSON-1882297630 Aug 10 17:54:57.009718 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 17:54:57.009718 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 17:54:57.009718 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5ed0115354d24d07a0bf8467c3049abe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/5ed0115354d24d07a0bf8467c3049abe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5ed0115354d24d07a0bf8467c3049abe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_5ed0115354d24d07a0bf8467c3049abe", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:54:57.009718 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-ServerRescueTestJSON-1882297630 Aug 10 17:54:57.009718 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: 5ed0115354d24d07a0bf8467c3049abe Aug 10 17:54:57.009718 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-ServerRescueTestJSON-1882297630 Aug 10 17:54:57.009718 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-ServerRescueTestJSON-1882297630-project Aug 10 17:54:57.009718 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 17:54:57.009718 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 17:54:57.009718 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: e2b49f8b0d5c4860ab5e42cdfd846eec Aug 10 17:54:57.009718 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-ServerRescueTestJSON-1882297630-project Aug 10 17:54:57.009718 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:54:57.009718 n-d-852296-2 devstack@n-api.service[129409]: {"server": {"name": "tempest-ServerRescueTestJSON-server-672103842", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "adminPass": "G4~E*+Atq7en8YU", "networks": [{"uuid": "cbf0d8a8-ae99-4af3-9445-3812568e751c"}]}} Aug 10 17:54:57.009718 n-d-852296-2 devstack@n-api.service[129409]: method: > Aug 10 17:54:57.009718 n-d-852296-2 devstack@n-api.service[129409]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:54:57.009718 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:54:57.009718 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'body': {'server': {'name': 'tempest-ServerRescueTestJSON-server-672103842', 'imageRef': 'a735ff26-463a-4ffe-a981-ab9d9baa494f', 'flavorRef': '452', 'adminPass': 'G4~E*+Atq7en8YU', 'networks': [{'uuid': 'cbf0d8a8-ae99-4af3-9445-3812568e751c'}]}}} Aug 10 17:54:57.009718 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:54:57.014475 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:57.014475 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:54:57.014475 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:54:57.014475 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:54:57.014475 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:54:57.014475 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:54:57.014475 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:54:57.014475 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:54:57.014475 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:54:57.014475 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 17:54:57.014475 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 17:54:57.014475 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 17:54:57.014475 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 17:54:57.014475 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 17:54:57.014475 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 17:54:57.014475 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 17:54:57.014475 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 17:54:57.014475 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 17:54:57.014475 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 17:54:57.014475 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 17:54:57.014475 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 17:54:57.014475 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 17:54:57.014475 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 17:54:57.014475 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 17:54:57.014475 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 17:54:57.014475 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 17:54:57.014475 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:54:57.014475 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:54:57.014475 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 17:54:57.014475 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 17:54:57.014475 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:54:57.014475 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:54:57.014475 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:54:57.014475 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:54:57.014475 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:54:57.014475 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:54:57.014475 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:54:57.014475 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:54:57.014475 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:54:57.014475 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:54:57.014475 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 17:54:57.014475 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 17:54:57.014475 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 17:54:57.014475 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 17:54:57.014475 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 17:54:57.014475 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 17:54:57.014475 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 17:54:57.014475 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 17:54:57.014475 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 17:54:57.014475 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 17:54:57.014475 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 17:54:57.014475 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 17:54:57.014475 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 17:54:57.014475 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 17:54:57.014475 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 17:54:57.014475 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 17:54:57.020037 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 17:54:57.020037 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 17:54:57.020037 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 17:54:57.020037 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 17:54:57.020037 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 17:54:57.020037 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 17:54:57.020037 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 17:54:57.020037 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 17:54:57.020037 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 17:54:57.020037 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 17:54:57.020037 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-7cf6b2b2-0d9b-45e7-bed1-f6b00d67e87e) Aug 10 17:54:57.020037 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:57.020037 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:54:57.020037 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:57.020037 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:57.020037 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:54:57.020037 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:54:57.020037 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:54:57.020037 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:54:57.020037 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 10 17:54:57.020037 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 10 17:54:57.020037 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:54:57.020037 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:57.020037 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:57.020037 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:54:57.020037 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:57.020037 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:54:57.020037 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:54:57.020037 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:54:57.020037 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:54:57.020037 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:54:57.020037 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:54:57.020037 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:57.020037 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:54:57.020037 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-14e127fc-eea5-4d89-be32-123d14707d19 tempest-ServerRescueTestJSON-1882297630 tempest-ServerRescueTestJSON-1882297630-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:54:57.020037 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:54:57.020037 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-14e127fc-eea5-4d89-be32-123d14707d19 tempest-ServerRescueTestJSON-1882297630 tempest-ServerRescueTestJSON-1882297630-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 2.010395 Aug 10 17:54:57.025819 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 677/1347] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 17:54:54 2022] POST /compute/v2.1/servers => generated 214 bytes in 2025 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 10 17:54:57.043361 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-b3197e4b-f1c0-436d-9d3c-8d15e12ebb33 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:54:57.049071 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-b3197e4b-f1c0-436d-9d3c-8d15e12ebb33 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] [instance: 5b41d7b5-e888-47ec-a57e-5b474e76ef45] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:54:57.060901 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-b3197e4b-f1c0-436d-9d3c-8d15e12ebb33 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:57.061424 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-b3197e4b-f1c0-436d-9d3c-8d15e12ebb33 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:57.065068 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-b3197e4b-f1c0-436d-9d3c-8d15e12ebb33 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:57.065952 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-b3197e4b-f1c0-436d-9d3c-8d15e12ebb33 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:57.066434 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-b3197e4b-f1c0-436d-9d3c-8d15e12ebb33 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:57.066874 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-b3197e4b-f1c0-436d-9d3c-8d15e12ebb33 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:57.082545 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_cell0:SELECT=16 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:54:57.730237 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-b3197e4b-f1c0-436d-9d3c-8d15e12ebb33 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36de414913b4223aba37ecb0f74e467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea1bedbf4fa421198a38dbfad95db72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:54:57.747809 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-b3197e4b-f1c0-436d-9d3c-8d15e12ebb33 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] 10.222.0.50 "GET /compute/v2.1/servers/5b41d7b5-e888-47ec-a57e-5b474e76ef45" status: 200 len: 1317 microversion: 2.1 time: 0.721381 Aug 10 17:54:57.750515 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 678/1348] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:54:57 2022] GET /compute/v2.1/servers/5b41d7b5-e888-47ec-a57e-5b474e76ef45 => generated 1317 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:54:58.772444 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-2f91a796-c1a3-41ed-8546-89fe88b6a07e tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:54:58.773641 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-2f91a796-c1a3-41ed-8546-89fe88b6a07e tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] [instance: 5b41d7b5-e888-47ec-a57e-5b474e76ef45] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:54:58.790675 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-2f91a796-c1a3-41ed-8546-89fe88b6a07e tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:58.791174 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-2f91a796-c1a3-41ed-8546-89fe88b6a07e tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:58.791689 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-2f91a796-c1a3-41ed-8546-89fe88b6a07e tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:58.806506 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-2f91a796-c1a3-41ed-8546-89fe88b6a07e tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:54:58.807130 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-2f91a796-c1a3-41ed-8546-89fe88b6a07e tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:54:58.812430 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-2f91a796-c1a3-41ed-8546-89fe88b6a07e tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:54:59.115555 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_cell0:SELECT=44 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:54:59.141144 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_cell0:SELECT=24 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:54:59.178522 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-2f91a796-c1a3-41ed-8546-89fe88b6a07e tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36de414913b4223aba37ecb0f74e467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea1bedbf4fa421198a38dbfad95db72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:54:59.193435 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-2f91a796-c1a3-41ed-8546-89fe88b6a07e tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] 10.222.0.50 "GET /compute/v2.1/servers/5b41d7b5-e888-47ec-a57e-5b474e76ef45" status: 200 len: 1317 microversion: 2.1 time: 0.424689 Aug 10 17:54:59.195490 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 679/1349] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:54:58 2022] GET /compute/v2.1/servers/5b41d7b5-e888-47ec-a57e-5b474e76ef45 => generated 1317 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:55:00.131361 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_cell0:SELECT=48 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:55:00.162629 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-892eab5e-7add-454b-9272-ecc0aea6ba27 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-1752750232", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452"}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:55:00.250094 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.network.neutron [None req-892eab5e-7add-454b-9272-ecc0aea6ba27 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] validate_networks() for None {{(pid=129409) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 17:55:00.879491 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.virt.hardware [None req-892eab5e-7add-454b-9272-ecc0aea6ba27 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Flavor limits 0:0:0 {{(pid=129409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 17:55:00.880975 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.virt.hardware [None req-892eab5e-7add-454b-9272-ecc0aea6ba27 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Image limits 0:0:0 {{(pid=129409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 17:55:00.881794 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.virt.hardware [None req-892eab5e-7add-454b-9272-ecc0aea6ba27 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Flavor pref 0:0:0 {{(pid=129409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 17:55:00.882702 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.virt.hardware [None req-892eab5e-7add-454b-9272-ecc0aea6ba27 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Image pref 0:0:0 {{(pid=129409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 17:55:00.883307 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.virt.hardware [None req-892eab5e-7add-454b-9272-ecc0aea6ba27 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 17:55:00.916703 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-892eab5e-7add-454b-9272-ecc0aea6ba27 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:55:00.918023 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-892eab5e-7add-454b-9272-ecc0aea6ba27 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:55:00.919540 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-892eab5e-7add-454b-9272-ecc0aea6ba27 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:55:00.924987 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-892eab5e-7add-454b-9272-ecc0aea6ba27 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:55:00.927635 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-892eab5e-7add-454b-9272-ecc0aea6ba27 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:55:00.930006 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-892eab5e-7add-454b-9272-ecc0aea6ba27 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:55:00.952611 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-892eab5e-7add-454b-9272-ecc0aea6ba27 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Getting quotas for project d8d145145fc940989314face9d0c6d71. Resources: {'instances', 'ram', 'cores'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:55:00.960972 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-892eab5e-7add-454b-9272-ecc0aea6ba27 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Getting quotas for user 6b630d54357347fbbac739ee86be06e4 and project d8d145145fc940989314face9d0c6d71. Resources: {'instances', 'ram', 'cores'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:55:00.979138 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-892eab5e-7add-454b-9272-ecc0aea6ba27 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Going to run 1 instances... {{(pid=129409) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 17:55:00.999555 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-892eab5e-7add-454b-9272-ecc0aea6ba27 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] [instance: 152d83cd-bbca-4280-afd6-48d6aee9049e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a735ff26-463a-4ffe-a981-ab9d9baa494f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 17:55:01.281486 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-892eab5e-7add-454b-9272-ecc0aea6ba27 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.321212 Aug 10 17:55:01.289606 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 680/1350] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 17:54:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1330 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 10 17:55:01.299179 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-e3807e14-6560-4ff6-8a42-b263f923e9bb tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:55:01.308418 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-e3807e14-6560-4ff6-8a42-b263f923e9bb tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] [instance: 5b41d7b5-e888-47ec-a57e-5b474e76ef45] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:55:01.315814 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e3807e14-6560-4ff6-8a42-b263f923e9bb tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:55:01.317362 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e3807e14-6560-4ff6-8a42-b263f923e9bb tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:55:01.320394 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e3807e14-6560-4ff6-8a42-b263f923e9bb tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:55:01.321137 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e3807e14-6560-4ff6-8a42-b263f923e9bb tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:55:01.321608 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e3807e14-6560-4ff6-8a42-b263f923e9bb tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:55:01.322094 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e3807e14-6560-4ff6-8a42-b263f923e9bb tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:55:02.144317 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-e3807e14-6560-4ff6-8a42-b263f923e9bb tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36de414913b4223aba37ecb0f74e467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea1bedbf4fa421198a38dbfad95db72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:55:02.181256 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-e3807e14-6560-4ff6-8a42-b263f923e9bb tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] 10.222.0.50 "GET /compute/v2.1/servers/5b41d7b5-e888-47ec-a57e-5b474e76ef45" status: 200 len: 1317 microversion: 2.1 time: 0.889955 Aug 10 17:55:02.186390 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 681/1351] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:55:01 2022] GET /compute/v2.1/servers/5b41d7b5-e888-47ec-a57e-5b474e76ef45 => generated 1317 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:55:02.205903 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-7135c47e-114f-4580-996c-1bae99abc950 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:55:02.214014 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-7135c47e-114f-4580-996c-1bae99abc950 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] [instance: 152d83cd-bbca-4280-afd6-48d6aee9049e] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:55:02.812380 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-7135c47e-114f-4580-996c-1bae99abc950 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b630d54357347fbbac739ee86be06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d145145fc940989314face9d0c6d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:55:02.834163 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-7135c47e-114f-4580-996c-1bae99abc950 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] 10.222.0.50 "GET /compute/v2.1/servers/152d83cd-bbca-4280-afd6-48d6aee9049e" status: 200 len: 1214 microversion: 2.1 time: 0.632599 Aug 10 17:55:02.834163 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 682/1352] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:55:02 2022] GET /compute/v2.1/servers/152d83cd-bbca-4280-afd6-48d6aee9049e => generated 1214 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:55:03.014728 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-e6da45c4-ee16-4656-b044-bed7f6aa6311 tempest-FloatingIPsTestJSON-416546987 tempest-FloatingIPsTestJSON-416546987-project] 10.222.0.50 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 6.857065 Aug 10 17:55:03.015382 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 671/1353] 10.222.0.50 () {60 vars in 1170 bytes} [Wed Aug 10 17:54:56 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 6858 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:55:03.057157 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-44a1cbdf-e018-4547-863c-a5f2b1a9a488 tempest-FloatingIPsTestJSON-416546987 tempest-FloatingIPsTestJSON-416546987-project] Calling method '.version_select at 0x7fb345eba790>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:55:03.208568 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-1b50b504-118d-4901-a4b9-17f7d8053af9 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:55:03.209192 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-1b50b504-118d-4901-a4b9-17f7d8053af9 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] [instance: 5b41d7b5-e888-47ec-a57e-5b474e76ef45] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:55:03.217884 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-1b50b504-118d-4901-a4b9-17f7d8053af9 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:55:03.220484 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-1b50b504-118d-4901-a4b9-17f7d8053af9 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:55:03.221230 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-1b50b504-118d-4901-a4b9-17f7d8053af9 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:55:03.223344 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-1b50b504-118d-4901-a4b9-17f7d8053af9 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:55:03.224435 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-1b50b504-118d-4901-a4b9-17f7d8053af9 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:55:03.225111 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-1b50b504-118d-4901-a4b9-17f7d8053af9 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:55:03.701950 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-44a1cbdf-e018-4547-863c-a5f2b1a9a488 tempest-FloatingIPsTestJSON-416546987 tempest-FloatingIPsTestJSON-416546987-project] 10.222.0.50 "GET /compute/v2.1/os-floating-ips/01d6e27b-b264-4eaa-b7e9-574d0e9ca256" status: 200 len: 142 microversion: 2.1 time: 0.666838 Aug 10 17:55:03.701950 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 683/1354] 10.222.0.50 () {58 vars in 1260 bytes} [Wed Aug 10 17:55:03 2022] GET /compute/v2.1/os-floating-ips/01d6e27b-b264-4eaa-b7e9-574d0e9ca256 => generated 142 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:55:03.712170 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-6a960433-394d-4e77-8235-f260dd2b45e0 tempest-FloatingIPsTestJSON-416546987 tempest-FloatingIPsTestJSON-416546987-project] Calling method '.version_select at 0x7fb345eba160>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:55:04.417815 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-6a960433-394d-4e77-8235-f260dd2b45e0 tempest-FloatingIPsTestJSON-416546987 tempest-FloatingIPsTestJSON-416546987-project] 10.222.0.50 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 0.710644 Aug 10 17:55:04.418745 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 684/1355] 10.222.0.50 () {58 vars in 1149 bytes} [Wed Aug 10 17:55:03 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:55:04.560228 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-1b50b504-118d-4901-a4b9-17f7d8053af9 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36de414913b4223aba37ecb0f74e467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea1bedbf4fa421198a38dbfad95db72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:55:04.570199 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-1b50b504-118d-4901-a4b9-17f7d8053af9 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] 10.222.0.50 "GET /compute/v2.1/servers/5b41d7b5-e888-47ec-a57e-5b474e76ef45" status: 200 len: 1317 microversion: 2.1 time: 1.367518 Aug 10 17:55:04.589582 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 672/1356] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:55:03 2022] GET /compute/v2.1/servers/5b41d7b5-e888-47ec-a57e-5b474e76ef45 => generated 1317 bytes in 1374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:55:04.608603 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-98cb0d54-46b1-43ac-970b-b313b0f577e5 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:55:04.618782 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-98cb0d54-46b1-43ac-970b-b313b0f577e5 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] [instance: 152d83cd-bbca-4280-afd6-48d6aee9049e] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:55:04.636546 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-98cb0d54-46b1-43ac-970b-b313b0f577e5 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:55:04.644811 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-98cb0d54-46b1-43ac-970b-b313b0f577e5 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:55:04.648566 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-98cb0d54-46b1-43ac-970b-b313b0f577e5 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:55:04.649607 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-98cb0d54-46b1-43ac-970b-b313b0f577e5 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:55:04.650799 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-98cb0d54-46b1-43ac-970b-b313b0f577e5 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:55:04.652618 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-98cb0d54-46b1-43ac-970b-b313b0f577e5 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:55:04.941254 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-98cb0d54-46b1-43ac-970b-b313b0f577e5 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b630d54357347fbbac739ee86be06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d145145fc940989314face9d0c6d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:55:04.960973 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-98cb0d54-46b1-43ac-970b-b313b0f577e5 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] 10.222.0.50 "GET /compute/v2.1/servers/152d83cd-bbca-4280-afd6-48d6aee9049e" status: 200 len: 1266 microversion: 2.1 time: 0.360346 Aug 10 17:55:04.971350 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 673/1357] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:55:04 2022] GET /compute/v2.1/servers/152d83cd-bbca-4280-afd6-48d6aee9049e => generated 1266 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:55:05.069714 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-b2a271d4-b877-470a-b286-d76e8f23aa94 tempest-FloatingIPDetailsNegativeTestJSON-1797061134 tempest-FloatingIPDetailsNegativeTestJSON-1797061134-project] Calling method '.version_select at 0x7fb345ec58b0>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:55:05.177895 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [req-40421dd3-11dd-487c-8dc4-bfeb92e30a13 req-9785ddc3-fc58-4688-ab8e-2cb36ca03d6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b41d7b5-e888-47ec-a57e-5b474e76ef45", "name": "network-vif-plugged", "status": "completed", "tag": "8aff8e43-12e5-4e3e-bb1f-efb7af31ddbe"}]} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:55:05.237571 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-40421dd3-11dd-487c-8dc4-bfeb92e30a13 req-9785ddc3-fc58-4688-ab8e-2cb36ca03d6a service nova] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:55:05.238634 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-40421dd3-11dd-487c-8dc4-bfeb92e30a13 req-9785ddc3-fc58-4688-ab8e-2cb36ca03d6a service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:55:05.239087 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-40421dd3-11dd-487c-8dc4-bfeb92e30a13 req-9785ddc3-fc58-4688-ab8e-2cb36ca03d6a service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:55:05.323687 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.compute.server_external_events [req-40421dd3-11dd-487c-8dc4-bfeb92e30a13 req-9785ddc3-fc58-4688-ab8e-2cb36ca03d6a service nova] Creating event network-vif-plugged:8aff8e43-12e5-4e3e-bb1f-efb7af31ddbe for instance 5b41d7b5-e888-47ec-a57e-5b474e76ef45 on n-h1-852296-2 Aug 10 17:55:05.359851 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [req-40421dd3-11dd-487c-8dc4-bfeb92e30a13 req-9785ddc3-fc58-4688-ab8e-2cb36ca03d6a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.384001 Aug 10 17:55:05.369536 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 674/1358] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 10 17:55:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:55:05.378426 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-62d47e8b-5b12-4036-9ce3-d2da70084666 tempest-FloatingIPsTestJSON-416546987 tempest-FloatingIPsTestJSON-416546987-project] Calling method '.version_select at 0x7fb345b440d0>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:55:05.448908 n-d-852296-2 devstack@n-api.service[129409]: DEBUG neutronclient.v2_0.client [None req-b2a271d4-b877-470a-b286-d76e8f23aa94 tempest-FloatingIPDetailsNegativeTestJSON-1797061134 tempest-FloatingIPDetailsNegativeTestJSON-1797061134-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 5bc319e2-5325-4dae-a53b-9212d0b1aaa5 could not be found", "detail": ""}} {{(pid=129409) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 10 17:55:05.450057 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-b2a271d4-b877-470a-b286-d76e8f23aa94 tempest-FloatingIPDetailsNegativeTestJSON-1797061134 tempest-FloatingIPDetailsNegativeTestJSON-1797061134-project] HTTP exception thrown: Floating IP not found for ID 5bc319e2-5325-4dae-a53b-9212d0b1aaa5 Aug 10 17:55:05.461680 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-b2a271d4-b877-470a-b286-d76e8f23aa94 tempest-FloatingIPDetailsNegativeTestJSON-1797061134 tempest-FloatingIPDetailsNegativeTestJSON-1797061134-project] Request method failure captured: Aug 10 17:55:05.461680 n-d-852296-2 devstack@n-api.service[129409]: request: GET /compute/v2.1/os-floating-ips/5bc319e2-5325-4dae-a53b-9212d0b1aaa5 HTTP/1.1 Aug 10 17:55:05.461680 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 17:55:05.461680 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 17:55:05.461680 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 17:55:05.461680 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 0 Aug 10 17:55:05.461680 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 17:55:05.461680 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 17:55:05.461680 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 17:55:05.461680 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 17:55:05.461680 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8_D3xjIAdDMaanM0FmH7y8Qsc3W-s1vxaQxl3Qy-BxfT7_4DMt1HrsmH0aW7xOkTk2wB4PEaZvB_AgQCIOTpv9IOWjSMlUGzsd-0bkyLMmw7uGVxe_rtikd_35p4sGquoHnl9AohLlVrmqAFgBZvwAZpuS7Pp1kA-oQwLjwiSsqLUPQ Aug 10 17:55:05.461680 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 17:55:05.461680 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 17:55:05.461680 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 17:55:05.461680 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 17:55:05.461680 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 17:55:05.461680 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 17:55:05.461680 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: 8067bcdf2bc541e9a622a28b46d92e82 Aug 10 17:55:05.461680 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-1797061134 Aug 10 17:55:05.461680 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 17:55:05.461680 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 17:55:05.461680 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8067bcdf2bc541e9a622a28b46d92e82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8067bcdf2bc541e9a622a28b46d92e82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8067bcdf2bc541e9a622a28b46d92e82"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8067bcdf2bc541e9a622a28b46d92e82", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:55:05.461680 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-1797061134 Aug 10 17:55:05.461680 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: 8067bcdf2bc541e9a622a28b46d92e82 Aug 10 17:55:05.461680 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-1797061134 Aug 10 17:55:05.461680 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-1797061134-project Aug 10 17:55:05.461680 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 17:55:05.461680 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 17:55:05.461680 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: 9fc3cfd1a6064a6faa59ceaabe8eb1cb Aug 10 17:55:05.461680 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-1797061134-project Aug 10 17:55:05.461680 n-d-852296-2 devstack@n-api.service[129409]: method: Aug 10 17:55:05.461680 n-d-852296-2 devstack@n-api.service[129409]: exception: Floating IP not found for ID 5bc319e2-5325-4dae-a53b-9212d0b1aaa5 Aug 10 17:55:05.461680 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'id': '5bc319e2-5325-4dae-a53b-9212d0b1aaa5'} Aug 10 17:55:05.461680 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:55:05.461680 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:55:05.461680 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 10 17:55:05.461680 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 10 17:55:05.461680 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:55:05.461680 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:55:05.461680 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 10 17:55:05.461680 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 10 17:55:05.461680 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:55:05.461680 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:55:05.461680 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:55:05.461680 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:55:05.461680 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:55:05.461680 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:55:05.461680 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:55:05.461680 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:55:05.461680 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:55:05.461680 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:55:05.461680 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 10 17:55:05.461680 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 10 17:55:05.461680 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:55:05.461680 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:55:05.461680 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 10 17:55:05.461680 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 10 17:55:05.461680 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 10 17:55:05.461680 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 10 17:55:05.461680 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 5bc319e2-5325-4dae-a53b-9212d0b1aaa5 could not be found Aug 10 17:55:05.467668 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ecc4d8f1-475b-4eb0-bf61-89320883a471'] Aug 10 17:55:05.467668 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:55:05.467668 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:55:05.467668 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:55:05.467668 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:55:05.467668 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Aug 10 17:55:05.467668 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 10 17:55:05.467668 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 10 17:55:05.467668 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 10 17:55:05.467668 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 5bc319e2-5325-4dae-a53b-9212d0b1aaa5. Aug 10 17:55:05.467668 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:55:05.467668 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:55:05.467668 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:55:05.467668 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:55:05.467668 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:55:05.467668 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:55:05.467668 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:55:05.467668 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:55:05.467668 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 17:55:05.467668 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 17:55:05.467668 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:55:05.467668 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:55:05.467668 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Aug 10 17:55:05.467668 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 10 17:55:05.467668 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 5bc319e2-5325-4dae-a53b-9212d0b1aaa5 Aug 10 17:55:05.467668 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:55:05.467668 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:55:05.467668 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:55:05.467668 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:55:05.467668 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:55:05.467668 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:55:05.467668 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:55:05.467668 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:55:05.467668 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 5bc319e2-5325-4dae-a53b-9212d0b1aaa5 Aug 10 17:55:05.467668 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:55:05.467668 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-b2a271d4-b877-470a-b286-d76e8f23aa94 tempest-FloatingIPDetailsNegativeTestJSON-1797061134 tempest-FloatingIPDetailsNegativeTestJSON-1797061134-project] Returning 404 to user: Floating IP not found for ID 5bc319e2-5325-4dae-a53b-9212d0b1aaa5 {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:55:05.467668 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-b2a271d4-b877-470a-b286-d76e8f23aa94 tempest-FloatingIPDetailsNegativeTestJSON-1797061134 tempest-FloatingIPDetailsNegativeTestJSON-1797061134-project] 10.222.0.50 "GET /compute/v2.1/os-floating-ips/5bc319e2-5325-4dae-a53b-9212d0b1aaa5" status: 404 len: 111 microversion: 2.1 time: 1.043490 Aug 10 17:55:05.467668 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 685/1359] 10.222.0.50 () {58 vars in 1260 bytes} [Wed Aug 10 17:55:04 2022] GET /compute/v2.1/os-floating-ips/5bc319e2-5325-4dae-a53b-9212d0b1aaa5 => generated 111 bytes in 1046 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:55:05.602143 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-153d8529-c35c-4317-b8fb-ce9b785f9759 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:55:05.602993 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-153d8529-c35c-4317-b8fb-ce9b785f9759 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] [instance: 5b41d7b5-e888-47ec-a57e-5b474e76ef45] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:55:05.616901 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-153d8529-c35c-4317-b8fb-ce9b785f9759 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:55:05.617899 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-153d8529-c35c-4317-b8fb-ce9b785f9759 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:55:05.622101 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-153d8529-c35c-4317-b8fb-ce9b785f9759 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:55:05.623169 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-153d8529-c35c-4317-b8fb-ce9b785f9759 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:55:05.623843 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-153d8529-c35c-4317-b8fb-ce9b785f9759 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:55:05.624521 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-153d8529-c35c-4317-b8fb-ce9b785f9759 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:55:06.828530 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-153d8529-c35c-4317-b8fb-ce9b785f9759 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36de414913b4223aba37ecb0f74e467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea1bedbf4fa421198a38dbfad95db72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:55:06.831193 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_cell1:SELECT=67 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:55:06.840278 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-153d8529-c35c-4317-b8fb-ce9b785f9759 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] 10.222.0.50 "GET /compute/v2.1/servers/5b41d7b5-e888-47ec-a57e-5b474e76ef45" status: 200 len: 1317 microversion: 2.1 time: 1.244306 Aug 10 17:55:06.843785 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 686/1360] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:55:05 2022] GET /compute/v2.1/servers/5b41d7b5-e888-47ec-a57e-5b474e76ef45 => generated 1317 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:55:06.856519 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-26c38502-019d-468d-90e6-8456d759b62a tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:55:06.858074 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-26c38502-019d-468d-90e6-8456d759b62a tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] [instance: 152d83cd-bbca-4280-afd6-48d6aee9049e] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:55:06.878386 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-26c38502-019d-468d-90e6-8456d759b62a tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:55:06.879225 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-26c38502-019d-468d-90e6-8456d759b62a tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:55:06.879883 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-26c38502-019d-468d-90e6-8456d759b62a tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:55:06.880864 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-26c38502-019d-468d-90e6-8456d759b62a tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:55:06.881492 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-26c38502-019d-468d-90e6-8456d759b62a tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:55:06.882084 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-26c38502-019d-468d-90e6-8456d759b62a tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:55:07.108503 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-26c38502-019d-468d-90e6-8456d759b62a tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b630d54357347fbbac739ee86be06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d145145fc940989314face9d0c6d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:55:07.125340 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-26c38502-019d-468d-90e6-8456d759b62a tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] 10.222.0.50 "GET /compute/v2.1/servers/152d83cd-bbca-4280-afd6-48d6aee9049e" status: 200 len: 1272 microversion: 2.1 time: 0.280363 Aug 10 17:55:07.129021 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 687/1361] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:55:06 2022] GET /compute/v2.1/servers/152d83cd-bbca-4280-afd6-48d6aee9049e => generated 1272 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:55:07.861536 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-a78159db-5c92-4cfd-bf00-1093af0401cd tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:55:07.862843 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-a78159db-5c92-4cfd-bf00-1093af0401cd tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] [instance: 5b41d7b5-e888-47ec-a57e-5b474e76ef45] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:55:07.869627 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a78159db-5c92-4cfd-bf00-1093af0401cd tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:55:07.870348 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a78159db-5c92-4cfd-bf00-1093af0401cd tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:55:07.870794 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a78159db-5c92-4cfd-bf00-1093af0401cd tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:55:07.874571 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a78159db-5c92-4cfd-bf00-1093af0401cd tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:55:07.874571 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a78159db-5c92-4cfd-bf00-1093af0401cd tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:55:07.874571 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a78159db-5c92-4cfd-bf00-1093af0401cd tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:55:08.361635 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-62d47e8b-5b12-4036-9ce3-d2da70084666 tempest-FloatingIPsTestJSON-416546987 tempest-FloatingIPsTestJSON-416546987-project] 10.222.0.50 "DELETE /compute/v2.1/os-floating-ips/01d6e27b-b264-4eaa-b7e9-574d0e9ca256" status: 202 len: 0 microversion: 2.1 time: 2.990260 Aug 10 17:55:08.367583 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 675/1362] 10.222.0.50 () {58 vars in 1263 bytes} [Wed Aug 10 17:55:05 2022] DELETE /compute/v2.1/os-floating-ips/01d6e27b-b264-4eaa-b7e9-574d0e9ca256 => generated 0 bytes in 2997 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 17:55:08.377652 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-a52de205-dd3d-4aaf-b558-7be31874e06f tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:55:08.377652 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-a52de205-dd3d-4aaf-b558-7be31874e06f tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] [instance: 152d83cd-bbca-4280-afd6-48d6aee9049e] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:55:08.390112 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a52de205-dd3d-4aaf-b558-7be31874e06f tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:55:08.393303 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a52de205-dd3d-4aaf-b558-7be31874e06f tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:55:08.393993 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a52de205-dd3d-4aaf-b558-7be31874e06f tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:55:08.394939 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a52de205-dd3d-4aaf-b558-7be31874e06f tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:55:08.398558 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a52de205-dd3d-4aaf-b558-7be31874e06f tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:55:08.401361 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a52de205-dd3d-4aaf-b558-7be31874e06f tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:55:08.405070 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_cell1:SELECT=69 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:55:08.507627 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-a52de205-dd3d-4aaf-b558-7be31874e06f tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b630d54357347fbbac739ee86be06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d145145fc940989314face9d0c6d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:55:08.523526 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-a52de205-dd3d-4aaf-b558-7be31874e06f tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] 10.222.0.50 "GET /compute/v2.1/servers/152d83cd-bbca-4280-afd6-48d6aee9049e" status: 200 len: 1272 microversion: 2.1 time: 0.154483 Aug 10 17:55:08.526186 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 676/1363] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:55:08 2022] GET /compute/v2.1/servers/152d83cd-bbca-4280-afd6-48d6aee9049e => generated 1272 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:55:08.532324 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-a7307fbc-f61c-46ac-b64a-9307172ee7e8 tempest-FloatingIPsTestJSON-416546987 tempest-FloatingIPsTestJSON-416546987-project] Action: 'create', calling method: .version_select at 0x7fb345b44310>, body: {"pool": null} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:55:08.725070 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-a78159db-5c92-4cfd-bf00-1093af0401cd tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36de414913b4223aba37ecb0f74e467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea1bedbf4fa421198a38dbfad95db72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:55:08.737510 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-a78159db-5c92-4cfd-bf00-1093af0401cd tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] 10.222.0.50 "GET /compute/v2.1/servers/5b41d7b5-e888-47ec-a57e-5b474e76ef45" status: 200 len: 1467 microversion: 2.1 time: 0.879683 Aug 10 17:55:08.740276 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 688/1364] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:55:07 2022] GET /compute/v2.1/servers/5b41d7b5-e888-47ec-a57e-5b474e76ef45 => generated 1467 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:55:08.762112 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-64cb0eed-994d-48cf-b6a7-f78e06e4e303 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-1536733090", "metadata": {"image_type": "test"}}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:55:08.765667 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-64cb0eed-994d-48cf-b6a7-f78e06e4e303 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] [instance: 5b41d7b5-e888-47ec-a57e-5b474e76ef45] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:55:08.774432 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-64cb0eed-994d-48cf-b6a7-f78e06e4e303 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:55:08.775488 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-64cb0eed-994d-48cf-b6a7-f78e06e4e303 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:55:08.778051 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-64cb0eed-994d-48cf-b6a7-f78e06e4e303 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:55:08.781229 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-64cb0eed-994d-48cf-b6a7-f78e06e4e303 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:55:08.781972 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-64cb0eed-994d-48cf-b6a7-f78e06e4e303 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:55:08.782610 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-64cb0eed-994d-48cf-b6a7-f78e06e4e303 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:55:08.859729 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-64cb0eed-994d-48cf-b6a7-f78e06e4e303 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Getting quotas for project 0ea1bedbf4fa421198a38dbfad95db72. Resources: dict_keys(['metadata_items']) {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:55:08.868399 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-64cb0eed-994d-48cf-b6a7-f78e06e4e303 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Getting quotas for user a36de414913b4223aba37ecb0f74e467 and project 0ea1bedbf4fa421198a38dbfad95db72. Resources: dict_keys(['metadata_items']) {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:55:09.542828 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-64cb0eed-994d-48cf-b6a7-f78e06e4e303 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] 10.222.0.50 "POST /compute/v2.1/servers/5b41d7b5-e888-47ec-a57e-5b474e76ef45/action" status: 202 len: 0 microversion: 2.1 time: 0.784260 Aug 10 17:55:09.557493 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 689/1365] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 10 17:55:08 2022] POST /compute/v2.1/servers/5b41d7b5-e888-47ec-a57e-5b474e76ef45/action => generated 0 bytes in 800 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Aug 10 17:55:09.574251 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-bb2d159f-999e-4e3d-8fe4-1a53d62939c7 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:55:09.575794 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-bb2d159f-999e-4e3d-8fe4-1a53d62939c7 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] [instance: 152d83cd-bbca-4280-afd6-48d6aee9049e] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:55:09.590808 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-bb2d159f-999e-4e3d-8fe4-1a53d62939c7 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:55:09.594106 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-bb2d159f-999e-4e3d-8fe4-1a53d62939c7 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:55:09.596091 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-bb2d159f-999e-4e3d-8fe4-1a53d62939c7 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:55:09.597908 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-bb2d159f-999e-4e3d-8fe4-1a53d62939c7 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:55:09.599556 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-bb2d159f-999e-4e3d-8fe4-1a53d62939c7 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:55:09.601151 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-bb2d159f-999e-4e3d-8fe4-1a53d62939c7 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:55:09.803492 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-bb2d159f-999e-4e3d-8fe4-1a53d62939c7 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b630d54357347fbbac739ee86be06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d145145fc940989314face9d0c6d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:55:09.814292 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-bb2d159f-999e-4e3d-8fe4-1a53d62939c7 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] 10.222.0.50 "GET /compute/v2.1/servers/152d83cd-bbca-4280-afd6-48d6aee9049e" status: 200 len: 1272 microversion: 2.1 time: 0.254304 Aug 10 17:55:09.819626 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 690/1366] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:55:09 2022] GET /compute/v2.1/servers/152d83cd-bbca-4280-afd6-48d6aee9049e => generated 1272 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:55:09.837455 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-1e39d04a-eec3-4649-bf5b-db698bab0889 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Calling method '.version_select at 0x7fb345eba940>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:55:09.913681 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-1e39d04a-eec3-4649-bf5b-db698bab0889 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] 10.222.0.50 "GET /compute/v2.1/images/baf689aa-d2ab-491b-8055-a8e57b8f8962" status: 200 len: 1424 microversion: 2.1 time: 0.092462 Aug 10 17:55:09.914280 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 691/1367] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:55:09 2022] GET /compute/v2.1/images/baf689aa-d2ab-491b-8055-a8e57b8f8962 => generated 1424 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:55:10.855550 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-767ab102-bf06-403f-9ae1-98d5566f0283 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:55:10.856313 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-767ab102-bf06-403f-9ae1-98d5566f0283 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] [instance: 152d83cd-bbca-4280-afd6-48d6aee9049e] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:55:10.867863 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-767ab102-bf06-403f-9ae1-98d5566f0283 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:55:10.868397 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-767ab102-bf06-403f-9ae1-98d5566f0283 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:55:10.868927 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-767ab102-bf06-403f-9ae1-98d5566f0283 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:55:10.869539 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-767ab102-bf06-403f-9ae1-98d5566f0283 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:55:10.870008 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-767ab102-bf06-403f-9ae1-98d5566f0283 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:55:10.870434 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-767ab102-bf06-403f-9ae1-98d5566f0283 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:55:10.940026 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_cell0:SELECT=2 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:55:11.329085 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-767ab102-bf06-403f-9ae1-98d5566f0283 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b630d54357347fbbac739ee86be06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d145145fc940989314face9d0c6d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:55:11.350442 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-767ab102-bf06-403f-9ae1-98d5566f0283 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] 10.222.0.50 "GET /compute/v2.1/servers/152d83cd-bbca-4280-afd6-48d6aee9049e" status: 200 len: 1314 microversion: 2.1 time: 0.496302 Aug 10 17:55:11.351316 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 692/1368] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:55:10 2022] GET /compute/v2.1/servers/152d83cd-bbca-4280-afd6-48d6aee9049e => generated 1314 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:55:11.367600 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-55138348-852d-4a9a-8341-9b3088b6081d tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Calling method '.version_select at 0x7fb345ec5e50>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:55:11.445596 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-55138348-852d-4a9a-8341-9b3088b6081d tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] 10.222.0.50 "GET /compute/v2.1/images/baf689aa-d2ab-491b-8055-a8e57b8f8962" status: 200 len: 1424 microversion: 2.1 time: 0.092635 Aug 10 17:55:11.446536 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 693/1369] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:55:11 2022] GET /compute/v2.1/images/baf689aa-d2ab-491b-8055-a8e57b8f8962 => generated 1424 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:55:12.379962 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-888d6aad-df3d-4bc9-bcb9-43818dcc8944 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:55:12.379962 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-888d6aad-df3d-4bc9-bcb9-43818dcc8944 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] [instance: 152d83cd-bbca-4280-afd6-48d6aee9049e] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:55:12.400313 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-888d6aad-df3d-4bc9-bcb9-43818dcc8944 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:55:12.400313 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-888d6aad-df3d-4bc9-bcb9-43818dcc8944 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:55:12.404274 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-888d6aad-df3d-4bc9-bcb9-43818dcc8944 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:55:12.405175 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-888d6aad-df3d-4bc9-bcb9-43818dcc8944 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:55:12.412269 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-888d6aad-df3d-4bc9-bcb9-43818dcc8944 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:55:12.412269 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-888d6aad-df3d-4bc9-bcb9-43818dcc8944 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:55:12.815555 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-888d6aad-df3d-4bc9-bcb9-43818dcc8944 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b630d54357347fbbac739ee86be06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d145145fc940989314face9d0c6d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:55:12.818395 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_cell0:SELECT=8 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:55:12.830395 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-888d6aad-df3d-4bc9-bcb9-43818dcc8944 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] 10.222.0.50 "GET /compute/v2.1/servers/152d83cd-bbca-4280-afd6-48d6aee9049e" status: 200 len: 1314 microversion: 2.1 time: 0.461387 Aug 10 17:55:12.838680 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 694/1370] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:55:12 2022] GET /compute/v2.1/servers/152d83cd-bbca-4280-afd6-48d6aee9049e => generated 1314 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:55:12.860227 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-63a93541-42b1-4881-a504-f51811ea0e9c tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Calling method '.version_select at 0x7fb345eba160>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:55:12.929182 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-63a93541-42b1-4881-a504-f51811ea0e9c tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] 10.222.0.50 "GET /compute/v2.1/images/baf689aa-d2ab-491b-8055-a8e57b8f8962" status: 200 len: 1424 microversion: 2.1 time: 0.073961 Aug 10 17:55:12.936866 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 695/1371] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:55:12 2022] GET /compute/v2.1/images/baf689aa-d2ab-491b-8055-a8e57b8f8962 => generated 1424 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:55:13.428953 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [req-9026ced7-eeb9-4b11-8267-f38ca05f1d3e req-12224a76-2445-4e57-b0a2-ee11aee75911 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "152d83cd-bbca-4280-afd6-48d6aee9049e", "tag": "35097c87-a647-4d25-a592-2d9969cbdd35"}]} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:55:13.457315 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-9026ced7-eeb9-4b11-8267-f38ca05f1d3e req-12224a76-2445-4e57-b0a2-ee11aee75911 service nova] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:55:13.457315 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-9026ced7-eeb9-4b11-8267-f38ca05f1d3e req-12224a76-2445-4e57-b0a2-ee11aee75911 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:55:13.457315 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-9026ced7-eeb9-4b11-8267-f38ca05f1d3e req-12224a76-2445-4e57-b0a2-ee11aee75911 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:55:13.491031 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.compute.server_external_events [req-9026ced7-eeb9-4b11-8267-f38ca05f1d3e req-12224a76-2445-4e57-b0a2-ee11aee75911 service nova] Creating event network-changed:35097c87-a647-4d25-a592-2d9969cbdd35 for instance 152d83cd-bbca-4280-afd6-48d6aee9049e on n-h2-852296-2 Aug 10 17:55:13.508378 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [req-9026ced7-eeb9-4b11-8267-f38ca05f1d3e req-12224a76-2445-4e57-b0a2-ee11aee75911 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.326209 Aug 10 17:55:13.510985 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 696/1372] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 10 17:55:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:55:13.655617 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-a7307fbc-f61c-46ac-b64a-9307172ee7e8 tempest-FloatingIPsTestJSON-416546987 tempest-FloatingIPsTestJSON-416546987-project] 10.222.0.50 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 5.128125 Aug 10 17:55:13.656415 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 677/1373] 10.222.0.50 () {60 vars in 1170 bytes} [Wed Aug 10 17:55:08 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 5130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:55:13.673719 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-c0f5e6f1-88c0-4888-a68a-e1b06e5a4ace tempest-FloatingIPsTestJSON-416546987 tempest-FloatingIPsTestJSON-416546987-project] Calling method '.version_select at 0x7fb345eba700>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:55:13.863451 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-546589e2-e535-457e-b550-c7f3d84248b4 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:55:13.864215 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-546589e2-e535-457e-b550-c7f3d84248b4 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] [instance: 152d83cd-bbca-4280-afd6-48d6aee9049e] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:55:13.874216 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-546589e2-e535-457e-b550-c7f3d84248b4 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:55:13.874706 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-546589e2-e535-457e-b550-c7f3d84248b4 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:55:13.875144 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-546589e2-e535-457e-b550-c7f3d84248b4 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:55:13.875850 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-546589e2-e535-457e-b550-c7f3d84248b4 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:55:13.876328 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-546589e2-e535-457e-b550-c7f3d84248b4 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:55:13.880292 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-546589e2-e535-457e-b550-c7f3d84248b4 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:55:14.251672 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-546589e2-e535-457e-b550-c7f3d84248b4 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b630d54357347fbbac739ee86be06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d145145fc940989314face9d0c6d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:55:14.312576 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-546589e2-e535-457e-b550-c7f3d84248b4 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] 10.222.0.50 "GET /compute/v2.1/servers/152d83cd-bbca-4280-afd6-48d6aee9049e" status: 200 len: 1314 microversion: 2.1 time: 0.452782 Aug 10 17:55:14.325748 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 678/1374] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:55:13 2022] GET /compute/v2.1/servers/152d83cd-bbca-4280-afd6-48d6aee9049e => generated 1314 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:55:14.338967 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-059c92d5-c4dc-429b-a3a3-1d074b924351 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Calling method '.version_select at 0x7fb345abc790>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:55:14.425573 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-059c92d5-c4dc-429b-a3a3-1d074b924351 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] 10.222.0.50 "GET /compute/v2.1/images/baf689aa-d2ab-491b-8055-a8e57b8f8962" status: 200 len: 1424 microversion: 2.1 time: 0.097952 Aug 10 17:55:14.431445 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 679/1375] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:55:14 2022] GET /compute/v2.1/images/baf689aa-d2ab-491b-8055-a8e57b8f8962 => generated 1424 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:55:15.337569 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-4ef1ed93-9d3d-4385-b3ea-ef2657e4143b tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:55:15.338236 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-4ef1ed93-9d3d-4385-b3ea-ef2657e4143b tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] [instance: 152d83cd-bbca-4280-afd6-48d6aee9049e] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:55:15.347126 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-4ef1ed93-9d3d-4385-b3ea-ef2657e4143b tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:55:15.359100 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-4ef1ed93-9d3d-4385-b3ea-ef2657e4143b tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:55:15.359693 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-4ef1ed93-9d3d-4385-b3ea-ef2657e4143b tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:55:15.360501 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-4ef1ed93-9d3d-4385-b3ea-ef2657e4143b tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:55:15.360985 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-4ef1ed93-9d3d-4385-b3ea-ef2657e4143b tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:55:15.361419 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-4ef1ed93-9d3d-4385-b3ea-ef2657e4143b tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:55:15.668108 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-4ef1ed93-9d3d-4385-b3ea-ef2657e4143b tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b630d54357347fbbac739ee86be06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d145145fc940989314face9d0c6d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:55:15.683537 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-4ef1ed93-9d3d-4385-b3ea-ef2657e4143b tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] 10.222.0.50 "GET /compute/v2.1/servers/152d83cd-bbca-4280-afd6-48d6aee9049e" status: 200 len: 1314 microversion: 2.1 time: 0.350374 Aug 10 17:55:15.702345 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 680/1376] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:55:15 2022] GET /compute/v2.1/servers/152d83cd-bbca-4280-afd6-48d6aee9049e => generated 1314 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:55:15.719033 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-a52d4db8-216d-4dd1-aa14-e92ab45f1743 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Calling method '.version_select at 0x7fb345bc40d0>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:55:15.791770 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-a52d4db8-216d-4dd1-aa14-e92ab45f1743 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] 10.222.0.50 "GET /compute/v2.1/images/baf689aa-d2ab-491b-8055-a8e57b8f8962" status: 200 len: 1424 microversion: 2.1 time: 0.087531 Aug 10 17:55:15.800830 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 681/1377] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:55:15 2022] GET /compute/v2.1/images/baf689aa-d2ab-491b-8055-a8e57b8f8962 => generated 1424 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:55:16.245808 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-820cbeb6-bcef-4ce2-b7b7-d475a10e6266 tempest-SecurityGroupRulesTestJSON-1965211628 tempest-SecurityGroupRulesTestJSON-1965211628-project] Action: 'create', calling method: .version_select at 0x7fb345b80820>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1353215536", "description": "tempest-description-1282843160"}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:55:16.550014 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-c0f5e6f1-88c0-4888-a68a-e1b06e5a4ace tempest-FloatingIPsTestJSON-416546987 tempest-FloatingIPsTestJSON-416546987-project] 10.222.0.50 "DELETE /compute/v2.1/os-floating-ips/52c7fbdb-26ca-4e51-9e36-19be53d498e4" status: 202 len: 0 microversion: 2.1 time: 2.883317 Aug 10 17:55:16.554863 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 697/1378] 10.222.0.50 () {58 vars in 1263 bytes} [Wed Aug 10 17:55:13 2022] DELETE /compute/v2.1/os-floating-ips/52c7fbdb-26ca-4e51-9e36-19be53d498e4 => generated 0 bytes in 2885 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 17:55:16.560982 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-c5d8d7cd-2d1e-4842-b4bb-59d0af95488c tempest-FloatingIPsTestJSON-416546987 tempest-FloatingIPsTestJSON-416546987-project] Calling method '.version_select at 0x7fb345ec5dc0>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:55:16.633625 n-d-852296-2 devstack@n-api.service[129409]: DEBUG neutronclient.v2_0.client [None req-c5d8d7cd-2d1e-4842-b4bb-59d0af95488c tempest-FloatingIPsTestJSON-416546987 tempest-FloatingIPsTestJSON-416546987-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 52c7fbdb-26ca-4e51-9e36-19be53d498e4 could not be found", "detail": ""}} {{(pid=129409) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 10 17:55:16.634046 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-c5d8d7cd-2d1e-4842-b4bb-59d0af95488c tempest-FloatingIPsTestJSON-416546987 tempest-FloatingIPsTestJSON-416546987-project] HTTP exception thrown: Floating IP not found for ID 52c7fbdb-26ca-4e51-9e36-19be53d498e4 Aug 10 17:55:16.635965 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-c5d8d7cd-2d1e-4842-b4bb-59d0af95488c tempest-FloatingIPsTestJSON-416546987 tempest-FloatingIPsTestJSON-416546987-project] Request method failure captured: Aug 10 17:55:16.635965 n-d-852296-2 devstack@n-api.service[129409]: request: GET /compute/v2.1/os-floating-ips/52c7fbdb-26ca-4e51-9e36-19be53d498e4 HTTP/1.1 Aug 10 17:55:16.635965 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 17:55:16.635965 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 17:55:16.635965 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 17:55:16.635965 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 0 Aug 10 17:55:16.635965 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 17:55:16.635965 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 17:55:16.635965 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 17:55:16.635965 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 17:55:16.635965 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8_DwWhGkL6PVwUEuMotvMGjK8-x_dHz3VNJleOGAZtIIbrOVS_VtPffWAvbJk92RqfnNKpY67qjqsw676IMK_RW-2-2BXsHqx2ucs_sAw7IoeLKpO_femXkUVQTpzEB4foAZTv8SM6pDuAmQFMUukYb_X1y9azkAyLLdWCOCurMB0v8 Aug 10 17:55:16.635965 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 17:55:16.635965 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 17:55:16.635965 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 17:55:16.635965 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 17:55:16.635965 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 17:55:16.635965 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 17:55:16.635965 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: 80c014d2749642afa57afebde2cb3269 Aug 10 17:55:16.635965 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-FloatingIPsTestJSON-416546987 Aug 10 17:55:16.635965 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 17:55:16.635965 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 17:55:16.635965 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/80c014d2749642afa57afebde2cb3269"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/80c014d2749642afa57afebde2cb3269"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/80c014d2749642afa57afebde2cb3269"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_80c014d2749642afa57afebde2cb3269", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:55:16.635965 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-FloatingIPsTestJSON-416546987 Aug 10 17:55:16.635965 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: 80c014d2749642afa57afebde2cb3269 Aug 10 17:55:16.635965 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-FloatingIPsTestJSON-416546987 Aug 10 17:55:16.635965 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-FloatingIPsTestJSON-416546987-project Aug 10 17:55:16.635965 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 17:55:16.635965 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 17:55:16.635965 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: 070285915487467a92a1bed39e05f102 Aug 10 17:55:16.635965 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-FloatingIPsTestJSON-416546987-project Aug 10 17:55:16.635965 n-d-852296-2 devstack@n-api.service[129409]: method: Aug 10 17:55:16.635965 n-d-852296-2 devstack@n-api.service[129409]: exception: Floating IP not found for ID 52c7fbdb-26ca-4e51-9e36-19be53d498e4 Aug 10 17:55:16.635965 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'id': '52c7fbdb-26ca-4e51-9e36-19be53d498e4'} Aug 10 17:55:16.635965 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:55:16.635965 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:55:16.635965 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 10 17:55:16.635965 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 10 17:55:16.635965 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:55:16.635965 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:55:16.635965 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 10 17:55:16.635965 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 10 17:55:16.635965 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:55:16.635965 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:55:16.635965 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:55:16.635965 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:55:16.635965 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:55:16.635965 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:55:16.635965 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:55:16.635965 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:55:16.635965 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:55:16.635965 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:55:16.635965 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 10 17:55:16.635965 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 10 17:55:16.635965 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:55:16.635965 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:55:16.635965 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 10 17:55:16.635965 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 10 17:55:16.635965 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 10 17:55:16.635965 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 10 17:55:16.635965 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 52c7fbdb-26ca-4e51-9e36-19be53d498e4 could not be found Aug 10 17:55:16.635965 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e385aae0-7f98-4c41-b497-f9e5278a1e37'] Aug 10 17:55:16.635965 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:55:16.644022 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:55:16.644022 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:55:16.644022 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:55:16.644022 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Aug 10 17:55:16.644022 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 10 17:55:16.644022 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 10 17:55:16.644022 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 10 17:55:16.644022 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 52c7fbdb-26ca-4e51-9e36-19be53d498e4. Aug 10 17:55:16.644022 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:55:16.644022 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:55:16.644022 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:55:16.644022 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:55:16.644022 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:55:16.644022 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:55:16.644022 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:55:16.644022 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:55:16.644022 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 17:55:16.644022 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 17:55:16.644022 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:55:16.644022 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:55:16.644022 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Aug 10 17:55:16.644022 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 10 17:55:16.644022 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 52c7fbdb-26ca-4e51-9e36-19be53d498e4 Aug 10 17:55:16.644022 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:55:16.644022 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:55:16.644022 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:55:16.644022 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:55:16.644022 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:55:16.644022 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:55:16.644022 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:55:16.644022 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:55:16.644022 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 52c7fbdb-26ca-4e51-9e36-19be53d498e4 Aug 10 17:55:16.644022 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:55:16.644022 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-c5d8d7cd-2d1e-4842-b4bb-59d0af95488c tempest-FloatingIPsTestJSON-416546987 tempest-FloatingIPsTestJSON-416546987-project] Returning 404 to user: Floating IP not found for ID 52c7fbdb-26ca-4e51-9e36-19be53d498e4 {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:55:16.644022 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-c5d8d7cd-2d1e-4842-b4bb-59d0af95488c tempest-FloatingIPsTestJSON-416546987 tempest-FloatingIPsTestJSON-416546987-project] 10.222.0.50 "GET /compute/v2.1/os-floating-ips/52c7fbdb-26ca-4e51-9e36-19be53d498e4" status: 404 len: 111 microversion: 2.1 time: 0.082112 Aug 10 17:55:16.644022 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 698/1379] 10.222.0.50 () {58 vars in 1260 bytes} [Wed Aug 10 17:55:16 2022] GET /compute/v2.1/os-floating-ips/52c7fbdb-26ca-4e51-9e36-19be53d498e4 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 17:55:16.650710 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-a4db63b2-293d-4d5b-8fc1-d47db067c667 tempest-FloatingIPsTestJSON-416546987 tempest-FloatingIPsTestJSON-416546987-project] Calling method '.version_select at 0x7fb345f1bca0>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:55:16.807017 n-d-852296-2 devstack@n-api.service[129409]: DEBUG neutronclient.v2_0.client [None req-a4db63b2-293d-4d5b-8fc1-d47db067c667 tempest-FloatingIPsTestJSON-416546987 tempest-FloatingIPsTestJSON-416546987-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 52c7fbdb-26ca-4e51-9e36-19be53d498e4 could not be found", "detail": ""}} {{(pid=129409) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 10 17:55:16.807907 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-a4db63b2-293d-4d5b-8fc1-d47db067c667 tempest-FloatingIPsTestJSON-416546987 tempest-FloatingIPsTestJSON-416546987-project] HTTP exception thrown: Floating IP not found for ID 52c7fbdb-26ca-4e51-9e36-19be53d498e4 Aug 10 17:55:16.810455 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-a4db63b2-293d-4d5b-8fc1-d47db067c667 tempest-FloatingIPsTestJSON-416546987 tempest-FloatingIPsTestJSON-416546987-project] Request method failure captured: Aug 10 17:55:16.810455 n-d-852296-2 devstack@n-api.service[129409]: request: DELETE /compute/v2.1/os-floating-ips/52c7fbdb-26ca-4e51-9e36-19be53d498e4 HTTP/1.1 Aug 10 17:55:16.810455 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 17:55:16.810455 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 17:55:16.810455 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 17:55:16.810455 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 0 Aug 10 17:55:16.810455 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 17:55:16.810455 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 17:55:16.810455 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 17:55:16.810455 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 17:55:16.810455 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8_DwWhGkL6PVwUEuMotvMGjK8-x_dHz3VNJleOGAZtIIbrOVS_VtPffWAvbJk92RqfnNKpY67qjqsw676IMK_RW-2-2BXsHqx2ucs_sAw7IoeLKpO_femXkUVQTpzEB4foAZTv8SM6pDuAmQFMUukYb_X1y9azkAyLLdWCOCurMB0v8 Aug 10 17:55:16.810455 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 17:55:16.810455 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 17:55:16.810455 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 17:55:16.810455 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 17:55:16.810455 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 17:55:16.810455 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 17:55:16.810455 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: 80c014d2749642afa57afebde2cb3269 Aug 10 17:55:16.810455 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-FloatingIPsTestJSON-416546987 Aug 10 17:55:16.810455 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 17:55:16.810455 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 17:55:16.810455 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/80c014d2749642afa57afebde2cb3269"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/80c014d2749642afa57afebde2cb3269"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/80c014d2749642afa57afebde2cb3269"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_80c014d2749642afa57afebde2cb3269", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:55:16.810455 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-FloatingIPsTestJSON-416546987 Aug 10 17:55:16.810455 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: 80c014d2749642afa57afebde2cb3269 Aug 10 17:55:16.810455 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-FloatingIPsTestJSON-416546987 Aug 10 17:55:16.810455 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-FloatingIPsTestJSON-416546987-project Aug 10 17:55:16.810455 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 17:55:16.810455 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 17:55:16.810455 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: 070285915487467a92a1bed39e05f102 Aug 10 17:55:16.810455 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-FloatingIPsTestJSON-416546987-project Aug 10 17:55:16.810455 n-d-852296-2 devstack@n-api.service[129409]: method: Aug 10 17:55:16.810455 n-d-852296-2 devstack@n-api.service[129409]: exception: Floating IP not found for ID 52c7fbdb-26ca-4e51-9e36-19be53d498e4 Aug 10 17:55:16.810455 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'id': '52c7fbdb-26ca-4e51-9e36-19be53d498e4'} Aug 10 17:55:16.810455 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:55:16.810455 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:55:16.810455 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 10 17:55:16.810455 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 10 17:55:16.810455 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:55:16.810455 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:55:16.810455 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 10 17:55:16.810455 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 10 17:55:16.810455 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:55:16.810455 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:55:16.810455 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:55:16.810455 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:55:16.810455 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:55:16.810455 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:55:16.810455 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:55:16.810455 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:55:16.810455 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:55:16.810455 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:55:16.810455 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 10 17:55:16.810455 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 10 17:55:16.810455 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:55:16.810455 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:55:16.810455 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 10 17:55:16.810455 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 10 17:55:16.810455 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 10 17:55:16.810455 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 10 17:55:16.810455 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 52c7fbdb-26ca-4e51-9e36-19be53d498e4 could not be found Aug 10 17:55:16.810455 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d906b29f-3a6b-49ab-a6c8-b43796e2b375'] Aug 10 17:55:16.810455 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:55:16.817236 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:55:16.817236 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:55:16.817236 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:55:16.817236 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Aug 10 17:55:16.817236 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 10 17:55:16.817236 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 10 17:55:16.817236 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 10 17:55:16.817236 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 52c7fbdb-26ca-4e51-9e36-19be53d498e4. Aug 10 17:55:16.817236 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:55:16.817236 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:55:16.817236 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:55:16.817236 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:55:16.817236 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:55:16.817236 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:55:16.817236 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:55:16.817236 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:55:16.817236 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 17:55:16.817236 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 17:55:16.817236 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:55:16.817236 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:55:16.817236 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Aug 10 17:55:16.817236 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 10 17:55:16.817236 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 52c7fbdb-26ca-4e51-9e36-19be53d498e4 Aug 10 17:55:16.817236 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:55:16.817236 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:55:16.817236 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:55:16.817236 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:55:16.817236 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:55:16.817236 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:55:16.817236 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:55:16.817236 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:55:16.817236 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 52c7fbdb-26ca-4e51-9e36-19be53d498e4 Aug 10 17:55:16.817236 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:55:16.817236 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-a4db63b2-293d-4d5b-8fc1-d47db067c667 tempest-FloatingIPsTestJSON-416546987 tempest-FloatingIPsTestJSON-416546987-project] Returning 404 to user: Floating IP not found for ID 52c7fbdb-26ca-4e51-9e36-19be53d498e4 {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:55:16.817236 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-a4db63b2-293d-4d5b-8fc1-d47db067c667 tempest-FloatingIPsTestJSON-416546987 tempest-FloatingIPsTestJSON-416546987-project] 10.222.0.50 "DELETE /compute/v2.1/os-floating-ips/52c7fbdb-26ca-4e51-9e36-19be53d498e4" status: 404 len: 111 microversion: 2.1 time: 0.171074 Aug 10 17:55:16.817236 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 699/1380] 10.222.0.50 () {58 vars in 1263 bytes} [Wed Aug 10 17:55:16 2022] DELETE /compute/v2.1/os-floating-ips/52c7fbdb-26ca-4e51-9e36-19be53d498e4 => generated 111 bytes in 172 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:55:16.829360 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-2448c089-708b-4ab2-9e18-79d8ad8506a9 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:55:16.830413 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-2448c089-708b-4ab2-9e18-79d8ad8506a9 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] [instance: 152d83cd-bbca-4280-afd6-48d6aee9049e] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:55:16.841309 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-2448c089-708b-4ab2-9e18-79d8ad8506a9 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:55:16.842398 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-2448c089-708b-4ab2-9e18-79d8ad8506a9 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:55:16.843079 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-2448c089-708b-4ab2-9e18-79d8ad8506a9 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:55:16.844052 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-2448c089-708b-4ab2-9e18-79d8ad8506a9 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:55:16.844795 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-2448c089-708b-4ab2-9e18-79d8ad8506a9 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:55:16.845388 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-2448c089-708b-4ab2-9e18-79d8ad8506a9 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:55:17.094397 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-2448c089-708b-4ab2-9e18-79d8ad8506a9 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b630d54357347fbbac739ee86be06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d145145fc940989314face9d0c6d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:55:17.105958 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-2448c089-708b-4ab2-9e18-79d8ad8506a9 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] 10.222.0.50 "GET /compute/v2.1/servers/152d83cd-bbca-4280-afd6-48d6aee9049e" status: 200 len: 1314 microversion: 2.1 time: 0.289993 Aug 10 17:55:17.106553 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 700/1381] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:55:16 2022] GET /compute/v2.1/servers/152d83cd-bbca-4280-afd6-48d6aee9049e => generated 1314 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:55:17.116168 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-f266e3af-a9a9-423d-b13d-5ea7f75cc4f4 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Calling method '.version_select at 0x7fb345eba160>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:55:17.251801 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-f266e3af-a9a9-423d-b13d-5ea7f75cc4f4 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] 10.222.0.50 "GET /compute/v2.1/images/baf689aa-d2ab-491b-8055-a8e57b8f8962" status: 200 len: 1424 microversion: 2.1 time: 0.144113 Aug 10 17:55:17.263832 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 701/1382] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:55:17 2022] GET /compute/v2.1/images/baf689aa-d2ab-491b-8055-a8e57b8f8962 => generated 1424 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:55:17.971996 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-820cbeb6-bcef-4ce2-b7b7-d475a10e6266 tempest-SecurityGroupRulesTestJSON-1965211628 tempest-SecurityGroupRulesTestJSON-1965211628-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 2.146632 Aug 10 17:55:17.973480 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 682/1383] 10.222.0.50 () {60 vars in 1180 bytes} [Wed Aug 10 17:55:15 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 2150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:55:17.986747 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-867aa08f-bc3b-4cf1-b153-a0d619eca1aa tempest-SecurityGroupRulesTestJSON-1965211628 tempest-SecurityGroupRulesTestJSON-1965211628-project] Action: 'create', calling method: .version_select at 0x7fb3460159d0>, body: {"security_group_rule": {"parent_group_id": "9922e7f9-7fc6-4817-ba39-f50809be55ba", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:55:18.129016 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-c4ada276-adf6-44d8-a2d3-054cdb1dcbf8 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:55:18.129669 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-c4ada276-adf6-44d8-a2d3-054cdb1dcbf8 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] [instance: 152d83cd-bbca-4280-afd6-48d6aee9049e] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:55:18.147073 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-c4ada276-adf6-44d8-a2d3-054cdb1dcbf8 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:55:18.147581 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-c4ada276-adf6-44d8-a2d3-054cdb1dcbf8 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:55:18.148033 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-c4ada276-adf6-44d8-a2d3-054cdb1dcbf8 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:55:18.148783 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-c4ada276-adf6-44d8-a2d3-054cdb1dcbf8 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:55:18.149249 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-c4ada276-adf6-44d8-a2d3-054cdb1dcbf8 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:55:18.149683 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-c4ada276-adf6-44d8-a2d3-054cdb1dcbf8 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:55:18.604571 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-867aa08f-bc3b-4cf1-b153-a0d619eca1aa tempest-SecurityGroupRulesTestJSON-1965211628 tempest-SecurityGroupRulesTestJSON-1965211628-project] 10.222.0.50 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.622140 Aug 10 17:55:18.605718 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 702/1384] 10.222.0.50 () {60 vars in 1195 bytes} [Wed Aug 10 17:55:17 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:55:18.616533 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-a380ede8-7c58-49b8-899f-102cca11a353 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Calling method '.version_select at 0x7fb345ebe430>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:55:18.679157 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-a380ede8-7c58-49b8-899f-102cca11a353 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] 10.222.0.50 "GET /compute/v2.1/images/baf689aa-d2ab-491b-8055-a8e57b8f8962" status: 200 len: 1424 microversion: 2.1 time: 0.072156 Aug 10 17:55:18.680016 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 703/1385] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:55:18 2022] GET /compute/v2.1/images/baf689aa-d2ab-491b-8055-a8e57b8f8962 => generated 1424 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:55:18.692756 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-10aec334-e08b-41fc-96e1-6a286e608471 tempest-SecurityGroupRulesTestJSON-1965211628 tempest-SecurityGroupRulesTestJSON-1965211628-project] Action: 'create', calling method: .version_select at 0x7fb345f1b5e0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1639593641", "description": "tempest-description-892083576"}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:55:19.111006 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-c4ada276-adf6-44d8-a2d3-054cdb1dcbf8 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b630d54357347fbbac739ee86be06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d145145fc940989314face9d0c6d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:55:19.122670 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-c4ada276-adf6-44d8-a2d3-054cdb1dcbf8 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] 10.222.0.50 "GET /compute/v2.1/servers/152d83cd-bbca-4280-afd6-48d6aee9049e" status: 200 len: 1314 microversion: 2.1 time: 0.997446 Aug 10 17:55:19.125887 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 683/1386] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:55:18 2022] GET /compute/v2.1/servers/152d83cd-bbca-4280-afd6-48d6aee9049e => generated 1314 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:55:19.299932 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-10aec334-e08b-41fc-96e1-6a286e608471 tempest-SecurityGroupRulesTestJSON-1965211628 tempest-SecurityGroupRulesTestJSON-1965211628-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.609387 Aug 10 17:55:19.299932 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 704/1387] 10.222.0.50 () {60 vars in 1180 bytes} [Wed Aug 10 17:55:18 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:55:19.311729 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-277ff107-a9bb-4ede-bc2e-6f7188b99f97 tempest-SecurityGroupRulesTestJSON-1965211628 tempest-SecurityGroupRulesTestJSON-1965211628-project] Action: 'create', calling method: .version_select at 0x7fb345b4b280>, body: {"security_group_rule": {"parent_group_id": "b6b7b9dd-5def-4061-bc81-175c2fcbf53e", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:55:19.654950 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [req-7baec9dc-e625-4276-88bb-5b952b40ae27 req-13880b45-0350-43f6-ba51-7a8c559fb480 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b41d7b5-e888-47ec-a57e-5b474e76ef45", "name": "network-vif-plugged", "status": "completed", "tag": "8aff8e43-12e5-4e3e-bb1f-efb7af31ddbe"}]} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:55:19.693466 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-7baec9dc-e625-4276-88bb-5b952b40ae27 req-13880b45-0350-43f6-ba51-7a8c559fb480 service nova] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:55:19.693965 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-7baec9dc-e625-4276-88bb-5b952b40ae27 req-13880b45-0350-43f6-ba51-7a8c559fb480 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:55:19.694403 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-7baec9dc-e625-4276-88bb-5b952b40ae27 req-13880b45-0350-43f6-ba51-7a8c559fb480 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:55:19.732566 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.compute.server_external_events [req-7baec9dc-e625-4276-88bb-5b952b40ae27 req-13880b45-0350-43f6-ba51-7a8c559fb480 service nova] Creating event network-vif-plugged:8aff8e43-12e5-4e3e-bb1f-efb7af31ddbe for instance 5b41d7b5-e888-47ec-a57e-5b474e76ef45 on n-h1-852296-2 Aug 10 17:55:19.756037 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [req-7baec9dc-e625-4276-88bb-5b952b40ae27 req-13880b45-0350-43f6-ba51-7a8c559fb480 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101982 Aug 10 17:55:19.758083 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 705/1388] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 10 17:55:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:55:19.772379 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-f5fad2f0-8e85-4f1c-ae3e-669f2ac0919f tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Calling method '.version_select at 0x7fb345ebaf70>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:55:19.860604 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-f5fad2f0-8e85-4f1c-ae3e-669f2ac0919f tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] 10.222.0.50 "GET /compute/v2.1/images/baf689aa-d2ab-491b-8055-a8e57b8f8962" status: 200 len: 1424 microversion: 2.1 time: 0.097886 Aug 10 17:55:19.870090 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 706/1389] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:55:19 2022] GET /compute/v2.1/images/baf689aa-d2ab-491b-8055-a8e57b8f8962 => generated 1424 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:55:20.146601 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-599a83da-5213-4fea-bfc1-86981091dd36 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:55:20.148001 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-599a83da-5213-4fea-bfc1-86981091dd36 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] [instance: 152d83cd-bbca-4280-afd6-48d6aee9049e] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:55:20.161588 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-599a83da-5213-4fea-bfc1-86981091dd36 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:55:20.162239 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-599a83da-5213-4fea-bfc1-86981091dd36 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:55:20.162749 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-599a83da-5213-4fea-bfc1-86981091dd36 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:55:20.163490 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-599a83da-5213-4fea-bfc1-86981091dd36 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:55:20.163965 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-599a83da-5213-4fea-bfc1-86981091dd36 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:55:20.164437 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-599a83da-5213-4fea-bfc1-86981091dd36 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:55:20.827081 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-599a83da-5213-4fea-bfc1-86981091dd36 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b630d54357347fbbac739ee86be06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d145145fc940989314face9d0c6d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:55:20.843119 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-599a83da-5213-4fea-bfc1-86981091dd36 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] 10.222.0.50 "GET /compute/v2.1/servers/152d83cd-bbca-4280-afd6-48d6aee9049e" status: 200 len: 1314 microversion: 2.1 time: 0.696884 Aug 10 17:55:20.858264 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 707/1390] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:55:20 2022] GET /compute/v2.1/servers/152d83cd-bbca-4280-afd6-48d6aee9049e => generated 1314 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:55:20.876417 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-b9232996-b6fc-409a-9566-08165d2cf6cd tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Calling method '.version_select at 0x7fb3460159d0>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:55:20.972278 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-b9232996-b6fc-409a-9566-08165d2cf6cd tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] 10.222.0.50 "GET /compute/v2.1/images/baf689aa-d2ab-491b-8055-a8e57b8f8962" status: 200 len: 1424 microversion: 2.1 time: 0.099416 Aug 10 17:55:20.972909 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 708/1391] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:55:20 2022] GET /compute/v2.1/images/baf689aa-d2ab-491b-8055-a8e57b8f8962 => generated 1424 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:55:21.354713 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-277ff107-a9bb-4ede-bc2e-6f7188b99f97 tempest-SecurityGroupRulesTestJSON-1965211628 tempest-SecurityGroupRulesTestJSON-1965211628-project] 10.222.0.50 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 2.044700 Aug 10 17:55:21.354713 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 684/1392] 10.222.0.50 () {60 vars in 1195 bytes} [Wed Aug 10 17:55:19 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 2047 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:55:21.368065 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-c334dd31-5b89-41ba-8486-6a1eb0c57474 tempest-SecurityGroupRulesTestJSON-1965211628 tempest-SecurityGroupRulesTestJSON-1965211628-project] Action: 'create', calling method: .version_select at 0x7fb345eba3a0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-759842698", "description": "tempest-description-1005295873"}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:55:21.783981 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [req-a6299223-5488-44e7-80fb-39855e80944d req-31e1dacb-8d2d-480c-b880-96280fc11dc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "152d83cd-bbca-4280-afd6-48d6aee9049e", "name": "network-vif-plugged", "status": "completed", "tag": "35097c87-a647-4d25-a592-2d9969cbdd35"}]} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:55:21.804180 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_api:SELECT=47 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:55:21.813049 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-a6299223-5488-44e7-80fb-39855e80944d req-31e1dacb-8d2d-480c-b880-96280fc11dc1 service nova] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:55:21.813556 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-a6299223-5488-44e7-80fb-39855e80944d req-31e1dacb-8d2d-480c-b880-96280fc11dc1 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:55:21.813985 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-a6299223-5488-44e7-80fb-39855e80944d req-31e1dacb-8d2d-480c-b880-96280fc11dc1 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:55:21.839566 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.compute.server_external_events [req-a6299223-5488-44e7-80fb-39855e80944d req-31e1dacb-8d2d-480c-b880-96280fc11dc1 service nova] Creating event network-vif-plugged:35097c87-a647-4d25-a592-2d9969cbdd35 for instance 152d83cd-bbca-4280-afd6-48d6aee9049e on n-h2-852296-2 Aug 10 17:55:21.852289 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [req-a6299223-5488-44e7-80fb-39855e80944d req-31e1dacb-8d2d-480c-b880-96280fc11dc1 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072292 Aug 10 17:55:21.856939 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 685/1393] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 10 17:55:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:55:21.872303 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-25c25ed9-59a0-4cf2-a56e-04561c0ea55b tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:55:21.873376 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-25c25ed9-59a0-4cf2-a56e-04561c0ea55b tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] [instance: 152d83cd-bbca-4280-afd6-48d6aee9049e] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:55:21.898479 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-25c25ed9-59a0-4cf2-a56e-04561c0ea55b tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:55:21.909665 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-25c25ed9-59a0-4cf2-a56e-04561c0ea55b tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:55:21.910567 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-25c25ed9-59a0-4cf2-a56e-04561c0ea55b tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:55:21.914429 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-25c25ed9-59a0-4cf2-a56e-04561c0ea55b tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:55:21.915909 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-25c25ed9-59a0-4cf2-a56e-04561c0ea55b tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:55:21.918345 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-25c25ed9-59a0-4cf2-a56e-04561c0ea55b tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:55:22.282896 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-25c25ed9-59a0-4cf2-a56e-04561c0ea55b tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b630d54357347fbbac739ee86be06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d145145fc940989314face9d0c6d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:55:22.296170 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-25c25ed9-59a0-4cf2-a56e-04561c0ea55b tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] 10.222.0.50 "GET /compute/v2.1/servers/152d83cd-bbca-4280-afd6-48d6aee9049e" status: 200 len: 1314 microversion: 2.1 time: 0.433934 Aug 10 17:55:22.298265 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 686/1394] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:55:21 2022] GET /compute/v2.1/servers/152d83cd-bbca-4280-afd6-48d6aee9049e => generated 1314 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:55:22.321340 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-77a1bf30-8b80-4fa7-86f3-3ff6c88ae972 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Calling method '.version_select at 0x7fb345a60af0>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:55:22.464236 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-77a1bf30-8b80-4fa7-86f3-3ff6c88ae972 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] 10.222.0.50 "GET /compute/v2.1/images/baf689aa-d2ab-491b-8055-a8e57b8f8962" status: 200 len: 1424 microversion: 2.1 time: 0.159811 Aug 10 17:55:22.466021 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 687/1395] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:55:22 2022] GET /compute/v2.1/images/baf689aa-d2ab-491b-8055-a8e57b8f8962 => generated 1424 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:55:22.805925 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-c334dd31-5b89-41ba-8486-6a1eb0c57474 tempest-SecurityGroupRulesTestJSON-1965211628 tempest-SecurityGroupRulesTestJSON-1965211628-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 1.444138 Aug 10 17:55:22.808070 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 709/1396] 10.222.0.50 () {60 vars in 1180 bytes} [Wed Aug 10 17:55:21 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 1447 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:55:22.826420 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-1611eb7c-a78a-411f-8e35-9ff4d7e6c62d tempest-SecurityGroupRulesTestJSON-1965211628 tempest-SecurityGroupRulesTestJSON-1965211628-project] Action: 'create', calling method: .version_select at 0x7fb345b80ca0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-958994183", "description": "tempest-description-2071575694"}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:55:23.514124 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-951e6cee-6814-4ca6-bd8f-bcd77701aa71 tempest-ListImageFiltersNegativeTestJSON-27237617 tempest-ListImageFiltersNegativeTestJSON-27237617-project] Calling method '.version_select at 0x7fb345ebeca0>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:55:23.553481 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-951e6cee-6814-4ca6-bd8f-bcd77701aa71 tempest-ListImageFiltersNegativeTestJSON-27237617 tempest-ListImageFiltersNegativeTestJSON-27237617-project] HTTP exception thrown: Image not found. Aug 10 17:55:23.559344 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-951e6cee-6814-4ca6-bd8f-bcd77701aa71 tempest-ListImageFiltersNegativeTestJSON-27237617 tempest-ListImageFiltersNegativeTestJSON-27237617-project] Request method failure captured: Aug 10 17:55:23.559344 n-d-852296-2 devstack@n-api.service[129409]: request: GET /compute/v2.1/images/9d8cbf27-0ea7-4dba-923a-287644d8eca4 HTTP/1.1 Aug 10 17:55:23.559344 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 17:55:23.559344 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 17:55:23.559344 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 17:55:23.559344 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 0 Aug 10 17:55:23.559344 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 17:55:23.559344 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 17:55:23.559344 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 17:55:23.559344 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 17:55:23.559344 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8_ELTS4FR9KdQ3_6eWfNipm1uPDnVORDGw6qaLdbHpmuaJ_byetXD0eIufrJzIt9bQqvaOeh0QEVkmiqwkmschyA-BYH5AixydjPZfI254ycZeoiDNayEkqhKKqCRmTpMfVH5gJjVcCKjmyR8swAFVYvCj08N6YVO1WLcC6TAxDWQK0 Aug 10 17:55:23.559344 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 17:55:23.559344 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 17:55:23.559344 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 17:55:23.559344 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 17:55:23.559344 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 17:55:23.559344 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 17:55:23.559344 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: c198556f63f146f596abbae59eda523c Aug 10 17:55:23.559344 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-27237617 Aug 10 17:55:23.559344 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 17:55:23.559344 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 17:55:23.559344 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c198556f63f146f596abbae59eda523c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c198556f63f146f596abbae59eda523c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c198556f63f146f596abbae59eda523c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c198556f63f146f596abbae59eda523c", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:55:23.559344 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-27237617 Aug 10 17:55:23.559344 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: c198556f63f146f596abbae59eda523c Aug 10 17:55:23.559344 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-27237617 Aug 10 17:55:23.559344 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-ListImageFiltersNegativeTestJSON-27237617-project Aug 10 17:55:23.559344 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 17:55:23.559344 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 17:55:23.559344 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: afe66ef040f344238e9ae85c0d09a78b Aug 10 17:55:23.559344 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-27237617-project Aug 10 17:55:23.559344 n-d-852296-2 devstack@n-api.service[129409]: method: Aug 10 17:55:23.559344 n-d-852296-2 devstack@n-api.service[129409]: exception: Image not found. Aug 10 17:55:23.559344 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'id': '9d8cbf27-0ea7-4dba-923a-287644d8eca4'} Aug 10 17:55:23.559344 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:55:23.559344 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:55:23.559344 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 10 17:55:23.559344 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 10 17:55:23.559344 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 10 17:55:23.559344 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 10 17:55:23.559344 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 10 17:55:23.559344 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 10 17:55:23.559344 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 10 17:55:23.559344 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 10 17:55:23.559344 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 10 17:55:23.559344 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 10 17:55:23.559344 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 10 17:55:23.559344 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 10 17:55:23.559344 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 10 17:55:23.559344 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 10 17:55:23.559344 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 10 17:55:23.559344 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 10 17:55:23.559344 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 9d8cbf27-0ea7-4dba-923a-287644d8eca4 Aug 10 17:55:23.559344 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:55:23.559344 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:55:23.559344 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:55:23.559344 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:55:23.559344 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 10 17:55:23.559344 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 10 17:55:23.559344 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 10 17:55:23.559344 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 10 17:55:23.559344 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 10 17:55:23.559344 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 10 17:55:23.559344 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 10 17:55:23.565538 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 10 17:55:23.565538 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 10 17:55:23.565538 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 10 17:55:23.565538 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 10 17:55:23.565538 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 10 17:55:23.565538 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 10 17:55:23.565538 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 10 17:55:23.565538 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 10 17:55:23.565538 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 10 17:55:23.565538 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 10 17:55:23.565538 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 10 17:55:23.565538 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 10 17:55:23.565538 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 10 17:55:23.565538 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 10 17:55:23.565538 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 10 17:55:23.565538 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 10 17:55:23.565538 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 10 17:55:23.565538 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9d8cbf27-0ea7-4dba-923a-287644d8eca4 could not be found. Aug 10 17:55:23.565538 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:55:23.565538 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:55:23.565538 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:55:23.565538 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:55:23.565538 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:55:23.565538 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:55:23.565538 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:55:23.565538 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:55:23.565538 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 17:55:23.565538 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 17:55:23.565538 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:55:23.565538 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:55:23.565538 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 10 17:55:23.565538 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 10 17:55:23.565538 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 10 17:55:23.565538 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:55:23.565538 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:55:23.565538 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:55:23.565538 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:55:23.565538 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:55:23.565538 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:55:23.565538 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:55:23.565538 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:55:23.565538 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 10 17:55:23.565538 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:55:23.591003 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-951e6cee-6814-4ca6-bd8f-bcd77701aa71 tempest-ListImageFiltersNegativeTestJSON-27237617 tempest-ListImageFiltersNegativeTestJSON-27237617-project] Returning 404 to user: Image not found. {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:55:23.591003 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-951e6cee-6814-4ca6-bd8f-bcd77701aa71 tempest-ListImageFiltersNegativeTestJSON-27237617 tempest-ListImageFiltersNegativeTestJSON-27237617-project] 10.222.0.50 "GET /compute/v2.1/images/9d8cbf27-0ea7-4dba-923a-287644d8eca4" status: 404 len: 62 microversion: 2.1 time: 0.273133 Aug 10 17:55:23.596009 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 710/1397] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:55:23 2022] GET /compute/v2.1/images/9d8cbf27-0ea7-4dba-923a-287644d8eca4 => generated 62 bytes in 297 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 10 17:55:23.625265 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-f2107f92-d6fd-486f-9ca2-43746fe1ec18 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:55:23.626269 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-f2107f92-d6fd-486f-9ca2-43746fe1ec18 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] [instance: 152d83cd-bbca-4280-afd6-48d6aee9049e] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:55:23.642206 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-f2107f92-d6fd-486f-9ca2-43746fe1ec18 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:55:23.644931 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-f2107f92-d6fd-486f-9ca2-43746fe1ec18 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:55:23.646100 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-f2107f92-d6fd-486f-9ca2-43746fe1ec18 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:55:23.647078 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-f2107f92-d6fd-486f-9ca2-43746fe1ec18 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:55:23.647747 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-f2107f92-d6fd-486f-9ca2-43746fe1ec18 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:55:23.648384 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-f2107f92-d6fd-486f-9ca2-43746fe1ec18 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:55:23.927284 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-1611eb7c-a78a-411f-8e35-9ff4d7e6c62d tempest-SecurityGroupRulesTestJSON-1965211628 tempest-SecurityGroupRulesTestJSON-1965211628-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 1.104863 Aug 10 17:55:23.929027 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 688/1398] 10.222.0.50 () {60 vars in 1180 bytes} [Wed Aug 10 17:55:22 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:55:23.934458 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-e8dc7382-2020-46aa-9541-42b623db9570 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Calling method '.version_select at 0x7fb345b82160>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:55:24.285108 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-f2107f92-d6fd-486f-9ca2-43746fe1ec18 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b630d54357347fbbac739ee86be06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d145145fc940989314face9d0c6d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:55:24.285108 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-f2107f92-d6fd-486f-9ca2-43746fe1ec18 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] 10.222.0.50 "GET /compute/v2.1/servers/152d83cd-bbca-4280-afd6-48d6aee9049e" status: 200 len: 1314 microversion: 2.1 time: 0.687522 Aug 10 17:55:24.286516 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 711/1399] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:55:23 2022] GET /compute/v2.1/servers/152d83cd-bbca-4280-afd6-48d6aee9049e => generated 1314 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:55:24.292403 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-79d833de-5eb8-477f-b1a2-7868ca314b91 tempest-SecurityGroupRulesTestJSON-1965211628 tempest-SecurityGroupRulesTestJSON-1965211628-project] Action: 'create', calling method: .version_select at 0x7fb345ec5dc0>, body: {"security_group_rule": {"parent_group_id": "a29f4dc6-a719-4782-a4bb-05d8bb234980", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "299fd495-ce39-415a-9e71-5d74b10a4916"}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:55:25.660903 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-e8dc7382-2020-46aa-9541-42b623db9570 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] 10.222.0.50 "GET /compute/v2.1/images/baf689aa-d2ab-491b-8055-a8e57b8f8962" status: 200 len: 1424 microversion: 2.1 time: 1.730492 Aug 10 17:55:25.669422 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 689/1400] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:55:23 2022] GET /compute/v2.1/images/baf689aa-d2ab-491b-8055-a8e57b8f8962 => generated 1424 bytes in 1739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:55:25.682321 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-56feb7e2-8a48-47eb-a30e-0f0642cd4beb tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:55:25.689351 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-56feb7e2-8a48-47eb-a30e-0f0642cd4beb tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] [instance: 152d83cd-bbca-4280-afd6-48d6aee9049e] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:55:25.698465 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-56feb7e2-8a48-47eb-a30e-0f0642cd4beb tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:55:25.700932 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-56feb7e2-8a48-47eb-a30e-0f0642cd4beb tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:55:25.707394 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-56feb7e2-8a48-47eb-a30e-0f0642cd4beb tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:55:25.707394 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-56feb7e2-8a48-47eb-a30e-0f0642cd4beb tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:55:25.707394 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-56feb7e2-8a48-47eb-a30e-0f0642cd4beb tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:55:25.707394 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-56feb7e2-8a48-47eb-a30e-0f0642cd4beb tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:55:25.927604 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-79d833de-5eb8-477f-b1a2-7868ca314b91 tempest-SecurityGroupRulesTestJSON-1965211628 tempest-SecurityGroupRulesTestJSON-1965211628-project] 10.222.0.50 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 1.637631 Aug 10 17:55:25.927604 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 712/1401] 10.222.0.50 () {60 vars in 1195 bytes} [Wed Aug 10 17:55:24 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 1639 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:55:25.940237 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-b77ecc0e-76cc-4d83-9d87-4efe195dafc7 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '.version_select at 0x7fb345ebaee0>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:55:26.009185 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-b77ecc0e-76cc-4d83-9d87-4efe195dafc7 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/images/15fe9892-b542-4067-b0b7-43732e4553b1" status: 200 len: 662 microversion: 2.1 time: 0.073329 Aug 10 17:55:26.009918 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 713/1402] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:55:25 2022] GET /compute/v2.1/images/15fe9892-b542-4067-b0b7-43732e4553b1 => generated 662 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:55:26.029778 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-dc9b6cae-415f-47e5-b0d6-15877b62e82e tempest-SecurityGroupRulesTestJSON-1965211628 tempest-SecurityGroupRulesTestJSON-1965211628-project] Action: 'create', calling method: .version_select at 0x7fb345ebeaf0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1555944823", "description": "tempest-description-8159068"}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:55:26.210878 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-56feb7e2-8a48-47eb-a30e-0f0642cd4beb tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b630d54357347fbbac739ee86be06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d145145fc940989314face9d0c6d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:55:26.222231 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-56feb7e2-8a48-47eb-a30e-0f0642cd4beb tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] 10.222.0.50 "GET /compute/v2.1/servers/152d83cd-bbca-4280-afd6-48d6aee9049e" status: 200 len: 1463 microversion: 2.1 time: 0.551625 Aug 10 17:55:26.222915 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 690/1403] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:55:25 2022] GET /compute/v2.1/servers/152d83cd-bbca-4280-afd6-48d6aee9049e => generated 1463 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:55:26.246299 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-3609e8c0-31f2-4e58-a201-0577939ba310 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '.version_select at 0x7fb345b440d0>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:55:26.345881 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-3609e8c0-31f2-4e58-a201-0577939ba310 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/images/15fe9892-b542-4067-b0b7-43732e4553b1" status: 200 len: 662 microversion: 2.1 time: 0.119811 Aug 10 17:55:26.346517 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 691/1404] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:55:26 2022] GET /compute/v2.1/images/15fe9892-b542-4067-b0b7-43732e4553b1 => generated 662 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:55:26.827591 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-0da64fb3-c6c7-4c4a-aebf-e36b210e427f tempest-TenantUsagesTestJSON-884354098 tempest-TenantUsagesTestJSON-884354098-project-admin] Calling method '.version_select at 0x7fb345bde670>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:55:26.858080 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-0da64fb3-c6c7-4c4a-aebf-e36b210e427f tempest-TenantUsagesTestJSON-884354098 tempest-TenantUsagesTestJSON-884354098-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:55:26.858854 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-0da64fb3-c6c7-4c4a-aebf-e36b210e427f tempest-TenantUsagesTestJSON-884354098 tempest-TenantUsagesTestJSON-884354098-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:55:26.861593 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-0da64fb3-c6c7-4c4a-aebf-e36b210e427f tempest-TenantUsagesTestJSON-884354098 tempest-TenantUsagesTestJSON-884354098-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:55:26.902768 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-0da64fb3-c6c7-4c4a-aebf-e36b210e427f tempest-TenantUsagesTestJSON-884354098 tempest-TenantUsagesTestJSON-884354098-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:55:26.910486 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-0da64fb3-c6c7-4c4a-aebf-e36b210e427f tempest-TenantUsagesTestJSON-884354098 tempest-TenantUsagesTestJSON-884354098-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:55:26.910486 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-0da64fb3-c6c7-4c4a-aebf-e36b210e427f tempest-TenantUsagesTestJSON-884354098 tempest-TenantUsagesTestJSON-884354098-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:55:26.965216 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-0da64fb3-c6c7-4c4a-aebf-e36b210e427f tempest-TenantUsagesTestJSON-884354098 tempest-TenantUsagesTestJSON-884354098-project-admin] 10.222.0.50 "GET /compute/v2.1/os-simple-tenant-usage/d8d145145fc940989314face9d0c6d71?start=2022-08-09T17%3A55%3A26.239481&end=2022-08-11T17%3A55%3A26.239481" status: 200 len: 691 microversion: 2.1 time: 0.603166 Aug 10 17:55:26.965216 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 692/1405] 10.222.0.50 () {58 vars in 1412 bytes} [Wed Aug 10 17:55:26 2022] GET /compute/v2.1/os-simple-tenant-usage/d8d145145fc940989314face9d0c6d71?start=2022-08-09T17%3A55%3A26.239481&end=2022-08-11T17%3A55%3A26.239481 => generated 691 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:55:26.981417 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-76d715a6-3eab-4bee-afae-34215ab548dc tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Calling method '.version_select at 0x7fb345ab5430>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:55:27.060693 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-76d715a6-3eab-4bee-afae-34215ab548dc tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] 10.222.0.50 "GET /compute/v2.1/images/baf689aa-d2ab-491b-8055-a8e57b8f8962" status: 200 len: 1424 microversion: 2.1 time: 0.094212 Aug 10 17:55:27.062285 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 693/1406] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:55:26 2022] GET /compute/v2.1/images/baf689aa-d2ab-491b-8055-a8e57b8f8962 => generated 1424 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:55:27.069469 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-26736beb-cb83-4f8d-99ba-95692ae39e9e tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Calling method '.version_select at 0x7fb345b44430>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:55:27.083577 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-26736beb-cb83-4f8d-99ba-95692ae39e9e tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:55:27.084403 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-26736beb-cb83-4f8d-99ba-95692ae39e9e tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:55:27.085085 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-26736beb-cb83-4f8d-99ba-95692ae39e9e tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:55:27.097659 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-26736beb-cb83-4f8d-99ba-95692ae39e9e tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:55:27.098448 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-26736beb-cb83-4f8d-99ba-95692ae39e9e tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:55:27.099609 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-26736beb-cb83-4f8d-99ba-95692ae39e9e tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:55:27.114393 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-26736beb-cb83-4f8d-99ba-95692ae39e9e tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] 10.222.0.50 "GET /compute/v2.1/os-simple-tenant-usage/d8d145145fc940989314face9d0c6d71?start=2022-08-09T17%3A55%3A26.239481&end=2022-08-11T17%3A55%3A26.239481" status: 200 len: 695 microversion: 2.1 time: 0.050815 Aug 10 17:55:27.115667 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 694/1407] 10.222.0.50 () {58 vars in 1412 bytes} [Wed Aug 10 17:55:27 2022] GET /compute/v2.1/os-simple-tenant-usage/d8d145145fc940989314face9d0c6d71?start=2022-08-09T17%3A55%3A26.239481&end=2022-08-11T17%3A55%3A26.239481 => generated 695 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:55:27.147484 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-035111e9-36f0-466f-bf5e-a7e0a4ef63e5 tempest-TenantUsagesTestJSON-884354098 tempest-TenantUsagesTestJSON-884354098-project-admin] Calling method '.version_select at 0x7fb345ad3ca0>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:55:27.167023 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-035111e9-36f0-466f-bf5e-a7e0a4ef63e5 tempest-TenantUsagesTestJSON-884354098 tempest-TenantUsagesTestJSON-884354098-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:55:27.168455 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-035111e9-36f0-466f-bf5e-a7e0a4ef63e5 tempest-TenantUsagesTestJSON-884354098 tempest-TenantUsagesTestJSON-884354098-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:55:27.169920 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-035111e9-36f0-466f-bf5e-a7e0a4ef63e5 tempest-TenantUsagesTestJSON-884354098 tempest-TenantUsagesTestJSON-884354098-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:55:27.202163 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-035111e9-36f0-466f-bf5e-a7e0a4ef63e5 tempest-TenantUsagesTestJSON-884354098 tempest-TenantUsagesTestJSON-884354098-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:55:27.203548 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-035111e9-36f0-466f-bf5e-a7e0a4ef63e5 tempest-TenantUsagesTestJSON-884354098 tempest-TenantUsagesTestJSON-884354098-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:55:27.204300 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-035111e9-36f0-466f-bf5e-a7e0a4ef63e5 tempest-TenantUsagesTestJSON-884354098 tempest-TenantUsagesTestJSON-884354098-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:55:27.315738 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-035111e9-36f0-466f-bf5e-a7e0a4ef63e5 tempest-TenantUsagesTestJSON-884354098 tempest-TenantUsagesTestJSON-884354098-project-admin] 10.222.0.50 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-09T17%3A55%3A26.239481&end=2022-08-11T17%3A55%3A26.239481&detailed=1" status: 200 len: 13587 microversion: 2.1 time: 0.178498 Aug 10 17:55:27.318650 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 695/1408] 10.222.0.50 () {58 vars in 1335 bytes} [Wed Aug 10 17:55:27 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-09T17%3A55%3A26.239481&end=2022-08-11T17%3A55%3A26.239481&detailed=1 => generated 13587 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 17:55:27.346179 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-a7344dc4-1f66-42b3-865e-a217e8af76d1 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:55:27.347041 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-a7344dc4-1f66-42b3-865e-a217e8af76d1 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] [instance: 152d83cd-bbca-4280-afd6-48d6aee9049e] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:55:27.359548 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a7344dc4-1f66-42b3-865e-a217e8af76d1 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:55:27.371550 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a7344dc4-1f66-42b3-865e-a217e8af76d1 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:55:27.371550 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a7344dc4-1f66-42b3-865e-a217e8af76d1 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:55:27.371550 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a7344dc4-1f66-42b3-865e-a217e8af76d1 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:55:27.371550 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a7344dc4-1f66-42b3-865e-a217e8af76d1 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:55:27.371550 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a7344dc4-1f66-42b3-865e-a217e8af76d1 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:55:27.442686 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-a7344dc4-1f66-42b3-865e-a217e8af76d1 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] [instance: 152d83cd-bbca-4280-afd6-48d6aee9049e] Going to try to terminate instance {{(pid=129410) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 17:55:27.528571 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-dc9b6cae-415f-47e5-b0d6-15877b62e82e tempest-SecurityGroupRulesTestJSON-1965211628 tempest-SecurityGroupRulesTestJSON-1965211628-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 245 microversion: 2.1 time: 1.503101 Aug 10 17:55:27.529175 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 714/1409] 10.222.0.50 () {60 vars in 1180 bytes} [Wed Aug 10 17:55:26 2022] POST /compute/v2.1/os-security-groups => generated 245 bytes in 1504 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:55:27.546495 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-6df729a4-168f-48f9-9207-4cee29176650 tempest-SecurityGroupRulesTestJSON-1965211628 tempest-SecurityGroupRulesTestJSON-1965211628-project] Action: 'create', calling method: .version_select at 0x7fb345ebe940>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1079006808", "description": "tempest-description-1979507314"}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:55:28.157002 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-a7344dc4-1f66-42b3-865e-a217e8af76d1 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] 10.222.0.50 "DELETE /compute/v2.1/servers/152d83cd-bbca-4280-afd6-48d6aee9049e" status: 204 len: 0 microversion: 2.1 time: 0.815214 Aug 10 17:55:28.161880 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 696/1410] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 10 17:55:27 2022] DELETE /compute/v2.1/servers/152d83cd-bbca-4280-afd6-48d6aee9049e => generated 0 bytes in 818 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 17:55:28.169202 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-3821f7d0-6b1d-48ef-8c43-e05529263f65 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Calling method '.version_select at 0x7fb345ad3af0>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:55:28.577016 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-6df729a4-168f-48f9-9207-4cee29176650 tempest-SecurityGroupRulesTestJSON-1965211628 tempest-SecurityGroupRulesTestJSON-1965211628-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 1.033939 Aug 10 17:55:28.577728 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 715/1411] 10.222.0.50 () {60 vars in 1180 bytes} [Wed Aug 10 17:55:27 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:55:28.597155 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-a3674d2b-f95a-49d8-a141-2553cdb71ef2 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:55:28.598848 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-a3674d2b-f95a-49d8-a141-2553cdb71ef2 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] [instance: 152d83cd-bbca-4280-afd6-48d6aee9049e] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:55:28.603179 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:55:28.628025 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a3674d2b-f95a-49d8-a141-2553cdb71ef2 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:55:28.629519 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a3674d2b-f95a-49d8-a141-2553cdb71ef2 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:55:28.630202 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a3674d2b-f95a-49d8-a141-2553cdb71ef2 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:55:28.631210 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a3674d2b-f95a-49d8-a141-2553cdb71ef2 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:55:28.631910 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a3674d2b-f95a-49d8-a141-2553cdb71ef2 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:55:28.632620 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a3674d2b-f95a-49d8-a141-2553cdb71ef2 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:55:28.940527 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-a3674d2b-f95a-49d8-a141-2553cdb71ef2 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b630d54357347fbbac739ee86be06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d145145fc940989314face9d0c6d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:55:28.951715 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-a3674d2b-f95a-49d8-a141-2553cdb71ef2 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] 10.222.0.50 "GET /compute/v2.1/servers/152d83cd-bbca-4280-afd6-48d6aee9049e" status: 200 len: 1469 microversion: 2.1 time: 0.372522 Aug 10 17:55:28.953957 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 716/1412] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:55:28 2022] GET /compute/v2.1/servers/152d83cd-bbca-4280-afd6-48d6aee9049e => generated 1469 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:55:28.963862 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-93514386-baaa-49c4-9d26-ae77f2ae565d tempest-SecurityGroupRulesTestJSON-1965211628 tempest-SecurityGroupRulesTestJSON-1965211628-project] Action: 'create', calling method: .version_select at 0x7fb346015c10>, body: {"security_group_rule": {"parent_group_id": "5fb8bff6-c9aa-418e-87e5-35f0f425bd96", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "b5841026-fdf6-4c01-a0db-08c2de963cf0"}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:55:29.588229 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-3821f7d0-6b1d-48ef-8c43-e05529263f65 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] 10.222.0.50 "GET /compute/v2.1/images/baf689aa-d2ab-491b-8055-a8e57b8f8962" status: 200 len: 1424 microversion: 2.1 time: 1.423221 Aug 10 17:55:29.589742 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 697/1413] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:55:28 2022] GET /compute/v2.1/images/baf689aa-d2ab-491b-8055-a8e57b8f8962 => generated 1424 bytes in 1427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:55:29.602360 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-562f45f6-7c43-4fbd-a014-88d2c6d95953 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '.version_select at 0x7fb345bde670>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:55:29.679020 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-562f45f6-7c43-4fbd-a014-88d2c6d95953 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/images/1a094668-2d91-4302-b3ee-8c4acd8e586b" status: 200 len: 662 microversion: 2.1 time: 0.087897 Aug 10 17:55:29.680739 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 698/1414] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:55:29 2022] GET /compute/v2.1/images/1a094668-2d91-4302-b3ee-8c4acd8e586b => generated 662 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:55:29.697053 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-138e06ac-d8df-4b86-959c-68cd1bb34018 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '.version_select at 0x7fb345b445e0>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:55:29.766739 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-138e06ac-d8df-4b86-959c-68cd1bb34018 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/images/1a094668-2d91-4302-b3ee-8c4acd8e586b" status: 200 len: 662 microversion: 2.1 time: 0.075313 Aug 10 17:55:29.767565 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 699/1415] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:55:29 2022] GET /compute/v2.1/images/1a094668-2d91-4302-b3ee-8c4acd8e586b => generated 662 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:55:29.975982 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-eca71395-3b06-40f3-a73d-d2763623a8a5 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:55:29.977129 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-eca71395-3b06-40f3-a73d-d2763623a8a5 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] [instance: 152d83cd-bbca-4280-afd6-48d6aee9049e] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:55:29.990715 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-eca71395-3b06-40f3-a73d-d2763623a8a5 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:55:29.991078 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-eca71395-3b06-40f3-a73d-d2763623a8a5 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:55:29.991522 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-eca71395-3b06-40f3-a73d-d2763623a8a5 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:55:29.992315 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-eca71395-3b06-40f3-a73d-d2763623a8a5 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:55:29.998661 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-eca71395-3b06-40f3-a73d-d2763623a8a5 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:55:30.000710 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-eca71395-3b06-40f3-a73d-d2763623a8a5 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:55:30.267345 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-93514386-baaa-49c4-9d26-ae77f2ae565d tempest-SecurityGroupRulesTestJSON-1965211628 tempest-SecurityGroupRulesTestJSON-1965211628-project] 10.222.0.50 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 1.312122 Aug 10 17:55:30.268673 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 717/1416] 10.222.0.50 () {60 vars in 1195 bytes} [Wed Aug 10 17:55:28 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 1314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:55:30.287355 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-f0f5b0bc-34fb-4c25-869a-808effb8907c tempest-SecurityGroupRulesTestJSON-1965211628 tempest-SecurityGroupRulesTestJSON-1965211628-project] Calling method '.version_select at 0x7fb345ebeaf0>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:55:30.371768 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-eca71395-3b06-40f3-a73d-d2763623a8a5 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b630d54357347fbbac739ee86be06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d145145fc940989314face9d0c6d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:55:30.384685 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-eca71395-3b06-40f3-a73d-d2763623a8a5 tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] 10.222.0.50 "GET /compute/v2.1/servers/152d83cd-bbca-4280-afd6-48d6aee9049e" status: 200 len: 1469 microversion: 2.1 time: 0.413741 Aug 10 17:55:30.401880 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 700/1417] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:55:29 2022] GET /compute/v2.1/servers/152d83cd-bbca-4280-afd6-48d6aee9049e => generated 1469 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:55:30.605130 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-41920a61-625c-4077-9da5-39ed730dc896 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Calling method '.version_select at 0x7fb345b44f70>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:55:30.760557 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-41920a61-625c-4077-9da5-39ed730dc896 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] 10.222.0.50 "GET /compute/v2.1/images/baf689aa-d2ab-491b-8055-a8e57b8f8962" status: 200 len: 1424 microversion: 2.1 time: 0.160356 Aug 10 17:55:30.769767 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 701/1418] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:55:30 2022] GET /compute/v2.1/images/baf689aa-d2ab-491b-8055-a8e57b8f8962 => generated 1424 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:55:31.298365 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-69dbaf87-c76e-40b9-a00b-836a66a7ad87 tempest-ServerRescueTestJSONUnderV235-896719307 tempest-ServerRescueTestJSONUnderV235-896719307-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-1482735783", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:55:31.425792 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-f0f5b0bc-34fb-4c25-869a-808effb8907c tempest-SecurityGroupRulesTestJSON-1965211628 tempest-SecurityGroupRulesTestJSON-1965211628-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/b5841026-fdf6-4c01-a0db-08c2de963cf0" status: 202 len: 0 microversion: 2.1 time: 1.148336 Aug 10 17:55:31.426541 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 718/1419] 10.222.0.50 () {58 vars in 1272 bytes} [Wed Aug 10 17:55:30 2022] DELETE /compute/v2.1/os-security-groups/b5841026-fdf6-4c01-a0db-08c2de963cf0 => generated 0 bytes in 1150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 17:55:31.436488 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [req-e7cf4e33-0fde-42c4-ac3b-2fe722f9eefc req-67fd277a-50a3-4c66-8a00-09914b5548ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "152d83cd-bbca-4280-afd6-48d6aee9049e", "name": "network-vif-deleted", "tag": "35097c87-a647-4d25-a592-2d9969cbdd35"}]} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:55:31.463611 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-e7cf4e33-0fde-42c4-ac3b-2fe722f9eefc req-67fd277a-50a3-4c66-8a00-09914b5548ca service nova] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:55:31.473668 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-e7cf4e33-0fde-42c4-ac3b-2fe722f9eefc req-67fd277a-50a3-4c66-8a00-09914b5548ca service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:55:31.475297 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-e7cf4e33-0fde-42c4-ac3b-2fe722f9eefc req-67fd277a-50a3-4c66-8a00-09914b5548ca service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:55:31.527000 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.compute.server_external_events [req-e7cf4e33-0fde-42c4-ac3b-2fe722f9eefc req-67fd277a-50a3-4c66-8a00-09914b5548ca service nova] Creating event network-vif-deleted:35097c87-a647-4d25-a592-2d9969cbdd35 for instance 152d83cd-bbca-4280-afd6-48d6aee9049e on n-h2-852296-2 Aug 10 17:55:31.546627 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [req-e7cf4e33-0fde-42c4-ac3b-2fe722f9eefc req-67fd277a-50a3-4c66-8a00-09914b5548ca service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115490 Aug 10 17:55:31.548749 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 719/1420] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 10 17:55:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:55:31.558969 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-8b7c16e0-9ce5-449c-a317-e303a525ed0a tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:55:31.560214 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-8b7c16e0-9ce5-449c-a317-e303a525ed0a tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] [instance: 152d83cd-bbca-4280-afd6-48d6aee9049e] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:55:31.570135 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-8b7c16e0-9ce5-449c-a317-e303a525ed0a tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:55:31.570919 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-8b7c16e0-9ce5-449c-a317-e303a525ed0a tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:55:31.572809 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-8b7c16e0-9ce5-449c-a317-e303a525ed0a tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:55:31.574009 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-8b7c16e0-9ce5-449c-a317-e303a525ed0a tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:55:31.575273 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-8b7c16e0-9ce5-449c-a317-e303a525ed0a tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:55:31.575886 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-8b7c16e0-9ce5-449c-a317-e303a525ed0a tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:55:31.695575 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-8b7c16e0-9ce5-449c-a317-e303a525ed0a tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b630d54357347fbbac739ee86be06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d145145fc940989314face9d0c6d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:55:31.713367 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-8b7c16e0-9ce5-449c-a317-e303a525ed0a tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] 10.222.0.50 "GET /compute/v2.1/servers/152d83cd-bbca-4280-afd6-48d6aee9049e" status: 200 len: 1299 microversion: 2.1 time: 0.161799 Aug 10 17:55:31.714227 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 720/1421] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:55:31 2022] GET /compute/v2.1/servers/152d83cd-bbca-4280-afd6-48d6aee9049e => generated 1299 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:55:31.724099 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-99214cc4-098f-4ee3-ab85-32bea79b8f87 tempest-SecurityGroupRulesTestJSON-1965211628 tempest-SecurityGroupRulesTestJSON-1965211628-project] Calling method '.version_select at 0x7fb345ebe820>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:55:31.832079 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-99214cc4-098f-4ee3-ab85-32bea79b8f87 tempest-SecurityGroupRulesTestJSON-1965211628 tempest-SecurityGroupRulesTestJSON-1965211628-project] 10.222.0.50 "GET /compute/v2.1/os-security-groups/5fb8bff6-c9aa-418e-87e5-35f0f425bd96" status: 200 len: 245 microversion: 2.1 time: 0.116480 Aug 10 17:55:31.844664 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 721/1422] 10.222.0.50 () {58 vars in 1269 bytes} [Wed Aug 10 17:55:31 2022] GET /compute/v2.1/os-security-groups/5fb8bff6-c9aa-418e-87e5-35f0f425bd96 => generated 245 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:55:31.850602 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-8d50cf33-f1cf-496d-a7a1-6453cb4aa369 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Calling method '.version_select at 0x7fb346015ee0>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:55:33.274749 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.network.neutron [None req-69dbaf87-c76e-40b9-a00b-836a66a7ad87 tempest-ServerRescueTestJSONUnderV235-896719307 tempest-ServerRescueTestJSONUnderV235-896719307-project] validate_networks() for [('faba1e6c-ccb1-4e9c-a08c-1482bc1decac', None, None, None, None, None)] {{(pid=129410) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 17:55:33.282199 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-8d50cf33-f1cf-496d-a7a1-6453cb4aa369 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] 10.222.0.50 "GET /compute/v2.1/images/baf689aa-d2ab-491b-8055-a8e57b8f8962" status: 200 len: 1424 microversion: 2.1 time: 1.436265 Aug 10 17:55:33.283561 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 722/1423] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:55:31 2022] GET /compute/v2.1/images/baf689aa-d2ab-491b-8055-a8e57b8f8962 => generated 1424 bytes in 1438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:55:33.289746 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-7ad8a3c1-850b-48bd-96d1-0c2d84b3ebb8 tempest-SecurityGroupRulesTestJSON-1965211628 tempest-SecurityGroupRulesTestJSON-1965211628-project] Action: 'create', calling method: .version_select at 0x7fb345eba940>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-2021722242", "description": "tempest-description-357297823"}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:55:33.730406 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [None req-69dbaf87-c76e-40b9-a00b-836a66a7ad87 tempest-ServerRescueTestJSONUnderV235-896719307 tempest-ServerRescueTestJSONUnderV235-896719307-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-1ecfdd4c-c347-4808-a6f6-0314ad4855d9) Aug 10 17:55:33.730406 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:55:33.730406 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:55:33.730406 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:55:33.730406 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:55:33.730406 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:55:33.730406 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:55:33.730406 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:55:33.730406 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:55:33.730406 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:55:33.730406 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 17:55:33.730406 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 17:55:33.730406 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 17:55:33.730406 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 17:55:33.730406 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 17:55:33.730406 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 17:55:33.730406 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 17:55:33.730406 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 17:55:33.730406 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 17:55:33.730406 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 17:55:33.730406 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 17:55:33.730406 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 17:55:33.730406 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 17:55:33.730406 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 17:55:33.730406 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 17:55:33.730406 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 17:55:33.730406 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 17:55:33.730406 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:55:33.730406 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:55:33.730406 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 17:55:33.730406 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 17:55:33.730406 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:55:33.730406 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:55:33.730406 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:55:33.730406 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:55:33.730406 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:55:33.730406 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:55:33.730406 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:55:33.730406 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:55:33.730406 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:55:33.730406 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:55:33.730406 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 17:55:33.730406 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 17:55:33.730406 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 17:55:33.730406 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 17:55:33.730406 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 17:55:33.730406 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 17:55:33.730406 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 17:55:33.730406 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 17:55:33.730406 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 17:55:33.730406 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 17:55:33.730406 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 17:55:33.735141 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 17:55:33.735141 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 17:55:33.735141 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 17:55:33.735141 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 17:55:33.735141 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 17:55:33.735141 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 17:55:33.735141 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 17:55:33.735141 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 17:55:33.735141 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 17:55:33.735141 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 17:55:33.735141 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 17:55:33.735141 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 17:55:33.735141 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 17:55:33.735141 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 17:55:33.735141 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 17:55:33.735141 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-1ecfdd4c-c347-4808-a6f6-0314ad4855d9) Aug 10 17:55:33.735141 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:55:33.739797 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-69dbaf87-c76e-40b9-a00b-836a66a7ad87 tempest-ServerRescueTestJSONUnderV235-896719307 tempest-ServerRescueTestJSONUnderV235-896719307-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:55:33.739797 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 17:55:33.745299 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-69dbaf87-c76e-40b9-a00b-836a66a7ad87 tempest-ServerRescueTestJSONUnderV235-896719307 tempest-ServerRescueTestJSONUnderV235-896719307-project] Request method failure captured: Aug 10 17:55:33.745299 n-d-852296-2 devstack@n-api.service[129410]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 17:55:33.745299 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 17:55:33.745299 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 17:55:33.745299 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 17:55:33.745299 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 247 Aug 10 17:55:33.745299 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 17:55:33.745299 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 17:55:33.745299 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 17:55:33.745299 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 17:55:33.745299 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8_ESfru_EtUWpRTTeqGOOKgSgcMOPgP9dBqqc4k6zNBdne3TXsggkzgzlhXNr9c6HP4iGclE0l3rfpyS_kKaG3gGUdWynZWK5Xmjsb9WWrG3ETuSpcoI2pfIt3zp_ozqtbP5telpMFcIE6dAzGmTJ9Yb0DzuAgemVuhcvUJsB4YXiXc Aug 10 17:55:33.745299 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 17:55:33.745299 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 17:55:33.745299 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 17:55:33.745299 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 17:55:33.745299 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 17:55:33.745299 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 17:55:33.745299 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: d899c459739c4a3aa24b9ff041352633 Aug 10 17:55:33.745299 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-896719307 Aug 10 17:55:33.745299 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 17:55:33.745299 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 17:55:33.745299 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d899c459739c4a3aa24b9ff041352633"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d899c459739c4a3aa24b9ff041352633"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d899c459739c4a3aa24b9ff041352633"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d899c459739c4a3aa24b9ff041352633", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:55:33.745299 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-896719307 Aug 10 17:55:33.745299 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: d899c459739c4a3aa24b9ff041352633 Aug 10 17:55:33.745299 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-896719307 Aug 10 17:55:33.745299 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-ServerRescueTestJSONUnderV235-896719307-project Aug 10 17:55:33.745299 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 17:55:33.745299 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 17:55:33.745299 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: 63982f5015cd446baa9283100650cfa7 Aug 10 17:55:33.745299 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-896719307-project Aug 10 17:55:33.745299 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 17:55:33.745299 n-d-852296-2 devstack@n-api.service[129410]: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-1482735783", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "adminPass": "M0~JqPD3Pmzdf@H", "networks": [{"uuid": "faba1e6c-ccb1-4e9c-a08c-1482bc1decac"}]}} Aug 10 17:55:33.745299 n-d-852296-2 devstack@n-api.service[129410]: method: > Aug 10 17:55:33.745299 n-d-852296-2 devstack@n-api.service[129410]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:55:33.745299 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 17:55:33.745299 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'body': {'server': {'name': 'tempest-ServerRescueTestJSONUnderV235-server-1482735783', 'imageRef': 'a735ff26-463a-4ffe-a981-ab9d9baa494f', 'flavorRef': '452', 'adminPass': 'M0~JqPD3Pmzdf@H', 'networks': [{'uuid': 'faba1e6c-ccb1-4e9c-a08c-1482bc1decac'}]}}} Aug 10 17:55:33.745299 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:55:33.745299 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:55:33.745299 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:55:33.745299 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:55:33.745299 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:55:33.745299 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:55:33.745299 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:55:33.745299 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:55:33.745299 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:55:33.745299 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:55:33.745299 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 17:55:33.745299 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 17:55:33.745299 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 17:55:33.745299 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 17:55:33.745299 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 17:55:33.745299 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 17:55:33.745299 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 17:55:33.745299 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 17:55:33.745299 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 17:55:33.745299 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 17:55:33.745299 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 17:55:33.745299 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 17:55:33.745299 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 17:55:33.745299 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 17:55:33.750241 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 17:55:33.750241 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 17:55:33.750241 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 17:55:33.750241 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:55:33.750241 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:55:33.750241 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 17:55:33.750241 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 17:55:33.750241 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:55:33.750241 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:55:33.750241 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:55:33.750241 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:55:33.750241 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:55:33.750241 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:55:33.750241 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:55:33.750241 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:55:33.750241 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:55:33.750241 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:55:33.750241 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 17:55:33.750241 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 17:55:33.750241 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 17:55:33.750241 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 17:55:33.750241 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 17:55:33.750241 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 17:55:33.750241 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 17:55:33.750241 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 17:55:33.750241 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 17:55:33.750241 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 17:55:33.750241 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 17:55:33.750241 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 17:55:33.750241 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 17:55:33.750241 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 17:55:33.750241 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 17:55:33.750241 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 17:55:33.750241 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 17:55:33.750241 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 17:55:33.750241 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 17:55:33.750241 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 17:55:33.750241 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 17:55:33.750241 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 17:55:33.750241 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 17:55:33.750241 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 17:55:33.750241 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 17:55:33.750241 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 17:55:33.750241 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-1ecfdd4c-c347-4808-a6f6-0314ad4855d9) Aug 10 17:55:33.750241 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:55:33.750241 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:55:33.750241 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:55:33.750241 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:55:33.750241 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:55:33.750241 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:55:33.750241 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:55:33.750241 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:55:33.750241 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 10 17:55:33.759722 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 10 17:55:33.759722 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:55:33.759722 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:55:33.759722 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:55:33.759722 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:55:33.759722 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:55:33.759722 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:55:33.759722 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:55:33.759722 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:55:33.759722 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:55:33.759722 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:55:33.759722 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:55:33.759722 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:55:33.759722 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:55:33.759722 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-69dbaf87-c76e-40b9-a00b-836a66a7ad87 tempest-ServerRescueTestJSONUnderV235-896719307 tempest-ServerRescueTestJSONUnderV235-896719307-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:55:33.759722 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:55:33.759722 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-69dbaf87-c76e-40b9-a00b-836a66a7ad87 tempest-ServerRescueTestJSONUnderV235-896719307 tempest-ServerRescueTestJSONUnderV235-896719307-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 2.748399 Aug 10 17:55:33.763029 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 702/1424] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 17:55:31 2022] POST /compute/v2.1/servers => generated 214 bytes in 2756 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 10 17:55:33.769871 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-6ea97eaf-7880-4446-aec1-1fc593fd0f7a tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:55:33.772305 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-6ea97eaf-7880-4446-aec1-1fc593fd0f7a tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] [instance: 152d83cd-bbca-4280-afd6-48d6aee9049e] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:55:33.782164 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-6ea97eaf-7880-4446-aec1-1fc593fd0f7a tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:55:33.783465 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-6ea97eaf-7880-4446-aec1-1fc593fd0f7a tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:55:33.784530 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-6ea97eaf-7880-4446-aec1-1fc593fd0f7a tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:55:33.785617 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-6ea97eaf-7880-4446-aec1-1fc593fd0f7a tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:55:33.786242 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-6ea97eaf-7880-4446-aec1-1fc593fd0f7a tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:55:33.786833 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-6ea97eaf-7880-4446-aec1-1fc593fd0f7a tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:55:33.833838 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-6ea97eaf-7880-4446-aec1-1fc593fd0f7a tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] HTTP exception thrown: Instance 152d83cd-bbca-4280-afd6-48d6aee9049e could not be found. Aug 10 17:55:33.842014 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-6ea97eaf-7880-4446-aec1-1fc593fd0f7a tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Request method failure captured: Aug 10 17:55:33.842014 n-d-852296-2 devstack@n-api.service[129410]: request: GET /compute/v2.1/servers/152d83cd-bbca-4280-afd6-48d6aee9049e HTTP/1.1 Aug 10 17:55:33.842014 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 17:55:33.842014 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 17:55:33.842014 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 17:55:33.842014 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 0 Aug 10 17:55:33.842014 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 17:55:33.842014 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 17:55:33.842014 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 17:55:33.842014 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 17:55:33.842014 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8_DxhiaI9Kf1b1U8dbwtfFpLLd4GhjNr5vrO1f-uczOkl8YW8PQpwg3sgY3SGukDKf7kNOorTfzs-RXnaiYscBijpK9BIkxNv0G3IBRQE3nIOrdxcyNIaST0EewJ29rhMXh-q8wwb3JVr9Y3XHvItyIdChfZOd8-6ZeMAV5i4ZkXaXE Aug 10 17:55:33.842014 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 17:55:33.842014 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 17:55:33.842014 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 17:55:33.842014 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 17:55:33.842014 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 17:55:33.842014 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 17:55:33.842014 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: d8d145145fc940989314face9d0c6d71 Aug 10 17:55:33.842014 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-TenantUsagesTestJSON-1805994097 Aug 10 17:55:33.842014 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 17:55:33.842014 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 17:55:33.842014 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d8d145145fc940989314face9d0c6d71"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d8d145145fc940989314face9d0c6d71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d8d145145fc940989314face9d0c6d71"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d8d145145fc940989314face9d0c6d71", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:55:33.842014 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-TenantUsagesTestJSON-1805994097 Aug 10 17:55:33.842014 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: d8d145145fc940989314face9d0c6d71 Aug 10 17:55:33.842014 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-TenantUsagesTestJSON-1805994097 Aug 10 17:55:33.842014 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-TenantUsagesTestJSON-1805994097-project Aug 10 17:55:33.842014 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 17:55:33.842014 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 17:55:33.842014 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: 6b630d54357347fbbac739ee86be06e4 Aug 10 17:55:33.842014 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-TenantUsagesTestJSON-1805994097-project Aug 10 17:55:33.842014 n-d-852296-2 devstack@n-api.service[129410]: method: > Aug 10 17:55:33.842014 n-d-852296-2 devstack@n-api.service[129410]: exception: Instance 152d83cd-bbca-4280-afd6-48d6aee9049e could not be found. Aug 10 17:55:33.842014 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'id': '152d83cd-bbca-4280-afd6-48d6aee9049e'} Aug 10 17:55:33.842014 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:55:33.842014 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:55:33.842014 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 17:55:33.842014 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 17:55:33.842014 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 17:55:33.842014 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 17:55:33.842014 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 17:55:33.842014 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 17:55:33.842014 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 17:55:33.842014 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 17:55:33.842014 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 152d83cd-bbca-4280-afd6-48d6aee9049e could not be found. Aug 10 17:55:33.842014 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:55:33.842014 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:55:33.842014 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:55:33.842014 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:55:33.842014 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:55:33.842014 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:55:33.842014 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:55:33.842014 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:55:33.842014 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:55:33.842014 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:55:33.842014 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 17:55:33.842014 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 17:55:33.842014 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 17:55:33.842014 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 17:55:33.842014 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 17:55:33.842014 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:55:33.842014 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 152d83cd-bbca-4280-afd6-48d6aee9049e could not be found. Aug 10 17:55:33.842014 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:55:33.842014 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:55:33.842014 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:55:33.847616 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:55:33.847616 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:55:33.847616 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:55:33.847616 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:55:33.847616 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:55:33.847616 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 152d83cd-bbca-4280-afd6-48d6aee9049e could not be found. Aug 10 17:55:33.847616 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:55:33.865337 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-6ea97eaf-7880-4446-aec1-1fc593fd0f7a tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] Returning 404 to user: Instance 152d83cd-bbca-4280-afd6-48d6aee9049e could not be found. {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:55:33.868517 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-6ea97eaf-7880-4446-aec1-1fc593fd0f7a tempest-TenantUsagesTestJSON-1805994097 tempest-TenantUsagesTestJSON-1805994097-project] 10.222.0.50 "GET /compute/v2.1/servers/152d83cd-bbca-4280-afd6-48d6aee9049e" status: 404 len: 111 microversion: 2.1 time: 0.103589 Aug 10 17:55:33.874160 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 703/1425] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:55:33 2022] GET /compute/v2.1/servers/152d83cd-bbca-4280-afd6-48d6aee9049e => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:55:33.889592 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-c0c3170f-0a76-4c13-aff8-328f50118a23 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '.version_select at 0x7fb345b440d0>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:55:33.967289 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-c0c3170f-0a76-4c13-aff8-328f50118a23 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/images/c3a967f0-5ce6-4ab7-b44d-8ff730582778" status: 200 len: 661 microversion: 2.1 time: 0.091023 Aug 10 17:55:33.982150 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 704/1426] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:55:33 2022] GET /compute/v2.1/images/c3a967f0-5ce6-4ab7-b44d-8ff730582778 => generated 661 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:55:33.994073 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-07501923-bc90-489e-8199-a6827828ff9c tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '.version_select at 0x7fb345b821f0>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:55:34.088796 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-07501923-bc90-489e-8199-a6827828ff9c tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/images/c3a967f0-5ce6-4ab7-b44d-8ff730582778" status: 200 len: 661 microversion: 2.1 time: 0.102105 Aug 10 17:55:34.089852 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 705/1427] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:55:33 2022] GET /compute/v2.1/images/c3a967f0-5ce6-4ab7-b44d-8ff730582778 => generated 661 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:55:34.300414 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-b6d3213b-6057-4661-895f-92eec412670e tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Calling method '.version_select at 0x7fb345b445e0>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:55:34.412647 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-b6d3213b-6057-4661-895f-92eec412670e tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] 10.222.0.50 "GET /compute/v2.1/images/baf689aa-d2ab-491b-8055-a8e57b8f8962" status: 200 len: 1424 microversion: 2.1 time: 0.116814 Aug 10 17:55:34.420685 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 706/1428] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:55:34 2022] GET /compute/v2.1/images/baf689aa-d2ab-491b-8055-a8e57b8f8962 => generated 1424 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:55:34.685298 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-97c7a02b-c307-4644-a714-1fc7a2247a7a tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-2088646772", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452"}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:55:34.808903 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.network.neutron [None req-97c7a02b-c307-4644-a714-1fc7a2247a7a tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] validate_networks() for None {{(pid=129410) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 17:55:35.031121 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-7ad8a3c1-850b-48bd-96d1-0c2d84b3ebb8 tempest-SecurityGroupRulesTestJSON-1965211628 tempest-SecurityGroupRulesTestJSON-1965211628-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 1.746190 Aug 10 17:55:35.033612 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 723/1429] 10.222.0.50 () {60 vars in 1180 bytes} [Wed Aug 10 17:55:33 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 1749 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:55:35.048202 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-919f4904-1c29-449f-a105-25e4bc2fb47d tempest-SecurityGroupRulesTestJSON-1965211628 tempest-SecurityGroupRulesTestJSON-1965211628-project] Action: 'create', calling method: .version_select at 0x7fb345e67c10>, body: {"security_group_rule": {"parent_group_id": "27c0fd7d-b143-4f40-bb52-260c04ed3855", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:55:35.745181 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.virt.hardware [None req-97c7a02b-c307-4644-a714-1fc7a2247a7a tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Flavor limits 0:0:0 {{(pid=129410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 17:55:35.745649 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.virt.hardware [None req-97c7a02b-c307-4644-a714-1fc7a2247a7a tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Image limits 0:0:0 {{(pid=129410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 17:55:35.746132 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.virt.hardware [None req-97c7a02b-c307-4644-a714-1fc7a2247a7a tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Flavor pref 0:0:0 {{(pid=129410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 17:55:35.746594 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.virt.hardware [None req-97c7a02b-c307-4644-a714-1fc7a2247a7a tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Image pref 0:0:0 {{(pid=129410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 17:55:35.747050 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.virt.hardware [None req-97c7a02b-c307-4644-a714-1fc7a2247a7a tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 17:55:35.786243 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-97c7a02b-c307-4644-a714-1fc7a2247a7a tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:55:35.787149 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-97c7a02b-c307-4644-a714-1fc7a2247a7a tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:55:35.791014 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-97c7a02b-c307-4644-a714-1fc7a2247a7a tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:55:35.793504 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-97c7a02b-c307-4644-a714-1fc7a2247a7a tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:55:35.797589 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-97c7a02b-c307-4644-a714-1fc7a2247a7a tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:55:35.799029 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-97c7a02b-c307-4644-a714-1fc7a2247a7a tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:55:35.889901 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.quota [None req-97c7a02b-c307-4644-a714-1fc7a2247a7a tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Getting quotas for project 0285f1570fe2419c930c80d3a0711858. Resources: {'instances', 'ram', 'cores'} {{(pid=129410) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:55:35.904723 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.quota [None req-97c7a02b-c307-4644-a714-1fc7a2247a7a tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Getting quotas for user dce45e1a545b4d3b8fa2cb4b2af3f306 and project 0285f1570fe2419c930c80d3a0711858. Resources: {'instances', 'ram', 'cores'} {{(pid=129410) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:55:35.930367 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-97c7a02b-c307-4644-a714-1fc7a2247a7a tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Going to run 1 instances... {{(pid=129410) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 17:55:35.932965 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-97c7a02b-c307-4644-a714-1fc7a2247a7a tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] [instance: 8937f92d-1764-4316-86cc-939bc9dc34b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a735ff26-463a-4ffe-a981-ab9d9baa494f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129410) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 17:55:36.252745 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-97c7a02b-c307-4644-a714-1fc7a2247a7a tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.571998 Aug 10 17:55:36.264455 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 707/1430] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 17:55:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1574 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 17:55:36.264455 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-4e438f2a-afd9-4ea9-bf80-f5a6caa633a4 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Calling method '.version_select at 0x7fb345b9d0d0>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:55:36.388607 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-4e438f2a-afd9-4ea9-bf80-f5a6caa633a4 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] 10.222.0.50 "GET /compute/v2.1/images/baf689aa-d2ab-491b-8055-a8e57b8f8962" status: 200 len: 1424 microversion: 2.1 time: 0.133583 Aug 10 17:55:36.389728 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 708/1431] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:55:36 2022] GET /compute/v2.1/images/baf689aa-d2ab-491b-8055-a8e57b8f8962 => generated 1424 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:55:36.568093 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-08d6ecbe-68e6-42fc-9bb7-a8d0dffc2ec0 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-2103909090", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452"}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:55:36.690121 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.network.neutron [None req-08d6ecbe-68e6-42fc-9bb7-a8d0dffc2ec0 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] validate_networks() for None {{(pid=129410) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 17:55:36.910303 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-919f4904-1c29-449f-a105-25e4bc2fb47d tempest-SecurityGroupRulesTestJSON-1965211628 tempest-SecurityGroupRulesTestJSON-1965211628-project] 10.222.0.50 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.860689 Aug 10 17:55:36.918211 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 724/1432] 10.222.0.50 () {60 vars in 1195 bytes} [Wed Aug 10 17:55:35 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1875 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:55:36.923338 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-908ad062-e38f-447b-a69f-cdee5eacaf14 tempest-SecurityGroupRulesTestJSON-1965211628 tempest-SecurityGroupRulesTestJSON-1965211628-project] Action: 'create', calling method: .version_select at 0x7fb345e254c0>, body: {"security_group_rule": {"parent_group_id": "27c0fd7d-b143-4f40-bb52-260c04ed3855", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:55:38.113757 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.virt.hardware [None req-08d6ecbe-68e6-42fc-9bb7-a8d0dffc2ec0 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Flavor limits 0:0:0 {{(pid=129410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 17:55:38.114254 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.virt.hardware [None req-08d6ecbe-68e6-42fc-9bb7-a8d0dffc2ec0 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Image limits 0:0:0 {{(pid=129410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 17:55:38.114644 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.virt.hardware [None req-08d6ecbe-68e6-42fc-9bb7-a8d0dffc2ec0 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Flavor pref 0:0:0 {{(pid=129410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 17:55:38.115052 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.virt.hardware [None req-08d6ecbe-68e6-42fc-9bb7-a8d0dffc2ec0 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Image pref 0:0:0 {{(pid=129410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 17:55:38.115472 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.virt.hardware [None req-08d6ecbe-68e6-42fc-9bb7-a8d0dffc2ec0 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 17:55:38.133401 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-08d6ecbe-68e6-42fc-9bb7-a8d0dffc2ec0 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:55:38.133906 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-08d6ecbe-68e6-42fc-9bb7-a8d0dffc2ec0 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:55:38.134339 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-08d6ecbe-68e6-42fc-9bb7-a8d0dffc2ec0 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:55:38.135598 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-08d6ecbe-68e6-42fc-9bb7-a8d0dffc2ec0 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:55:38.136028 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-08d6ecbe-68e6-42fc-9bb7-a8d0dffc2ec0 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:55:38.149429 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-08d6ecbe-68e6-42fc-9bb7-a8d0dffc2ec0 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:55:38.184780 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.quota [None req-08d6ecbe-68e6-42fc-9bb7-a8d0dffc2ec0 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Getting quotas for project 0285f1570fe2419c930c80d3a0711858. Resources: {'instances', 'ram', 'cores'} {{(pid=129410) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:55:38.202058 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.quota [None req-08d6ecbe-68e6-42fc-9bb7-a8d0dffc2ec0 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Getting quotas for user dce45e1a545b4d3b8fa2cb4b2af3f306 and project 0285f1570fe2419c930c80d3a0711858. Resources: {'instances', 'ram', 'cores'} {{(pid=129410) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:55:38.246374 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-08d6ecbe-68e6-42fc-9bb7-a8d0dffc2ec0 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Going to run 1 instances... {{(pid=129410) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 17:55:38.256528 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-08d6ecbe-68e6-42fc-9bb7-a8d0dffc2ec0 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] [instance: dd4d671c-5a1f-463d-8bec-cd4f7614479f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a735ff26-463a-4ffe-a981-ab9d9baa494f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129410) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 17:55:38.481012 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-908ad062-e38f-447b-a69f-cdee5eacaf14 tempest-SecurityGroupRulesTestJSON-1965211628 tempest-SecurityGroupRulesTestJSON-1965211628-project] 10.222.0.50 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 1.561511 Aug 10 17:55:38.488941 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 725/1433] 10.222.0.50 () {60 vars in 1195 bytes} [Wed Aug 10 17:55:36 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 1570 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:55:38.495427 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-a9b7fe63-fd03-4630-ba81-219439a9db79 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Calling method '.version_select at 0x7fb345e67c10>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:55:38.510956 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-08d6ecbe-68e6-42fc-9bb7-a8d0dffc2ec0 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.947488 Aug 10 17:55:38.514457 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 709/1434] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 17:55:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1952 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 10 17:55:38.521435 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-343aaedc-7368-4884-8790-f5fc6ce0d00e tempest-SecurityGroupRulesTestJSON-1965211628 tempest-SecurityGroupRulesTestJSON-1965211628-project] Calling method '.version_select at 0x7fb345b74af0>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:55:38.577790 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-a9b7fe63-fd03-4630-ba81-219439a9db79 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] 10.222.0.50 "GET /compute/v2.1/images/baf689aa-d2ab-491b-8055-a8e57b8f8962" status: 200 len: 1424 microversion: 2.1 time: 0.087567 Aug 10 17:55:38.589669 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 726/1435] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:55:38 2022] GET /compute/v2.1/images/baf689aa-d2ab-491b-8055-a8e57b8f8962 => generated 1424 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:55:38.594911 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-386419e0-dcba-41bb-b393-2ced8f25ee5a tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:55:38.595720 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-386419e0-dcba-41bb-b393-2ced8f25ee5a tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] [instance: dd4d671c-5a1f-463d-8bec-cd4f7614479f] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:55:38.718377 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-386419e0-dcba-41bb-b393-2ced8f25ee5a tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce45e1a545b4d3b8fa2cb4b2af3f306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0285f1570fe2419c930c80d3a0711858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:55:38.729698 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-386419e0-dcba-41bb-b393-2ced8f25ee5a tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/servers/dd4d671c-5a1f-463d-8bec-cd4f7614479f" status: 200 len: 1218 microversion: 2.1 time: 0.136007 Aug 10 17:55:38.751859 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 727/1436] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:55:38 2022] GET /compute/v2.1/servers/dd4d671c-5a1f-463d-8bec-cd4f7614479f => generated 1218 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:55:39.019053 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-343aaedc-7368-4884-8790-f5fc6ce0d00e tempest-SecurityGroupRulesTestJSON-1965211628 tempest-SecurityGroupRulesTestJSON-1965211628-project] 10.222.0.50 "GET /compute/v2.1/os-security-groups/27c0fd7d-b143-4f40-bb52-260c04ed3855" status: 200 len: 664 microversion: 2.1 time: 0.502329 Aug 10 17:55:39.019965 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 710/1437] 10.222.0.50 () {58 vars in 1269 bytes} [Wed Aug 10 17:55:38 2022] GET /compute/v2.1/os-security-groups/27c0fd7d-b143-4f40-bb52-260c04ed3855 => generated 664 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:55:39.032972 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-30bd1888-8fa7-4e7e-b5e2-d75517ea044e tempest-SecurityGroupRulesTestJSON-1965211628 tempest-SecurityGroupRulesTestJSON-1965211628-project] Calling method '.version_select at 0x7fb345ebe430>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:55:39.595412 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-51f857dc-4aa4-4bec-a87a-046059fe6477 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Calling method '.version_select at 0x7fb345abc820>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:55:39.718963 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-51f857dc-4aa4-4bec-a87a-046059fe6477 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] 10.222.0.50 "GET /compute/v2.1/images/baf689aa-d2ab-491b-8055-a8e57b8f8962" status: 200 len: 1424 microversion: 2.1 time: 0.125025 Aug 10 17:55:39.723032 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 711/1438] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:55:39 2022] GET /compute/v2.1/images/baf689aa-d2ab-491b-8055-a8e57b8f8962 => generated 1424 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:55:39.753067 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-17ef3679-fe2b-49c7-bdf8-0cf1547f1070 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:55:39.754959 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-17ef3679-fe2b-49c7-bdf8-0cf1547f1070 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] [instance: dd4d671c-5a1f-463d-8bec-cd4f7614479f] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:55:39.914910 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-17ef3679-fe2b-49c7-bdf8-0cf1547f1070 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce45e1a545b4d3b8fa2cb4b2af3f306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0285f1570fe2419c930c80d3a0711858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:55:39.930340 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-17ef3679-fe2b-49c7-bdf8-0cf1547f1070 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/servers/dd4d671c-5a1f-463d-8bec-cd4f7614479f" status: 200 len: 1218 microversion: 2.1 time: 0.183082 Aug 10 17:55:39.946066 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 712/1439] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:55:39 2022] GET /compute/v2.1/servers/dd4d671c-5a1f-463d-8bec-cd4f7614479f => generated 1218 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:55:40.110771 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-30bd1888-8fa7-4e7e-b5e2-d75517ea044e tempest-SecurityGroupRulesTestJSON-1965211628 tempest-SecurityGroupRulesTestJSON-1965211628-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-group-rules/524d2741-08d3-49dc-a095-38463c12024e" status: 202 len: 0 microversion: 2.1 time: 1.081616 Aug 10 17:55:40.122186 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 728/1440] 10.222.0.50 () {58 vars in 1287 bytes} [Wed Aug 10 17:55:39 2022] DELETE /compute/v2.1/os-security-group-rules/524d2741-08d3-49dc-a095-38463c12024e => generated 0 bytes in 1094 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 17:55:40.124997 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-5af5eb77-40e4-49c5-b781-d29c288ad143 tempest-SecurityGroupRulesTestJSON-1965211628 tempest-SecurityGroupRulesTestJSON-1965211628-project] Calling method '.version_select at 0x7fb345abc820>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:55:40.736803 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-08e48c12-0280-49f7-b3af-129dee663766 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Calling method '.version_select at 0x7fb345ebee50>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:55:40.857893 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-08e48c12-0280-49f7-b3af-129dee663766 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] 10.222.0.50 "GET /compute/v2.1/images/baf689aa-d2ab-491b-8055-a8e57b8f8962" status: 200 len: 1424 microversion: 2.1 time: 0.124222 Aug 10 17:55:40.859520 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 729/1441] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:55:40 2022] GET /compute/v2.1/images/baf689aa-d2ab-491b-8055-a8e57b8f8962 => generated 1424 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:55:40.956710 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-144c5fdf-4542-4092-b285-bc57aa338551 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:55:40.958077 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-144c5fdf-4542-4092-b285-bc57aa338551 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] [instance: dd4d671c-5a1f-463d-8bec-cd4f7614479f] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:55:40.969351 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-144c5fdf-4542-4092-b285-bc57aa338551 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:55:40.971265 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-144c5fdf-4542-4092-b285-bc57aa338551 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:55:40.972555 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-144c5fdf-4542-4092-b285-bc57aa338551 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:55:40.974003 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-144c5fdf-4542-4092-b285-bc57aa338551 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:55:40.977018 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-144c5fdf-4542-4092-b285-bc57aa338551 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:55:40.977829 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-144c5fdf-4542-4092-b285-bc57aa338551 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:55:40.995806 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:55:41.332663 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-144c5fdf-4542-4092-b285-bc57aa338551 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce45e1a545b4d3b8fa2cb4b2af3f306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0285f1570fe2419c930c80d3a0711858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:55:41.341391 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-144c5fdf-4542-4092-b285-bc57aa338551 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/servers/dd4d671c-5a1f-463d-8bec-cd4f7614479f" status: 200 len: 1214 microversion: 2.1 time: 0.388777 Aug 10 17:55:41.393721 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 730/1442] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:55:40 2022] GET /compute/v2.1/servers/dd4d671c-5a1f-463d-8bec-cd4f7614479f => generated 1214 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:55:41.873513 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-432ca43d-5cdd-46c4-888f-c64a4de8f86e tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Calling method '.version_select at 0x7fb345ec5430>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:55:41.951920 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-432ca43d-5cdd-46c4-888f-c64a4de8f86e tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] 10.222.0.50 "GET /compute/v2.1/images/baf689aa-d2ab-491b-8055-a8e57b8f8962" status: 200 len: 1424 microversion: 2.1 time: 0.082155 Aug 10 17:55:41.953728 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 731/1443] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:55:41 2022] GET /compute/v2.1/images/baf689aa-d2ab-491b-8055-a8e57b8f8962 => generated 1424 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:55:42.022781 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-5af5eb77-40e4-49c5-b781-d29c288ad143 tempest-SecurityGroupRulesTestJSON-1965211628 tempest-SecurityGroupRulesTestJSON-1965211628-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/27c0fd7d-b143-4f40-bb52-260c04ed3855" status: 202 len: 0 microversion: 2.1 time: 1.903184 Aug 10 17:55:42.038846 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 713/1444] 10.222.0.50 () {58 vars in 1272 bytes} [Wed Aug 10 17:55:40 2022] DELETE /compute/v2.1/os-security-groups/27c0fd7d-b143-4f40-bb52-260c04ed3855 => generated 0 bytes in 1920 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 17:55:42.044798 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-de4603ba-37fd-476a-8e39-7f1f698dd7c9 tempest-SecurityGroupRulesTestJSON-1965211628 tempest-SecurityGroupRulesTestJSON-1965211628-project] Calling method '.version_select at 0x7fb345eba550>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:55:42.141449 n-d-852296-2 devstack@n-api.service[129409]: DEBUG neutronclient.v2_0.client [None req-de4603ba-37fd-476a-8e39-7f1f698dd7c9 tempest-SecurityGroupRulesTestJSON-1965211628 tempest-SecurityGroupRulesTestJSON-1965211628-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group b5841026-fdf6-4c01-a0db-08c2de963cf0 does not exist", "detail": ""}} {{(pid=129409) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 10 17:55:42.142658 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.network.security_group_api [None req-de4603ba-37fd-476a-8e39-7f1f698dd7c9 tempest-SecurityGroupRulesTestJSON-1965211628 tempest-SecurityGroupRulesTestJSON-1965211628-project] Neutron security group b5841026-fdf6-4c01-a0db-08c2de963cf0 not found {{(pid=129409) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 10 17:55:42.143910 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-de4603ba-37fd-476a-8e39-7f1f698dd7c9 tempest-SecurityGroupRulesTestJSON-1965211628 tempest-SecurityGroupRulesTestJSON-1965211628-project] HTTP exception thrown: Security group b5841026-fdf6-4c01-a0db-08c2de963cf0 does not exist Aug 10 17:55:42.143910 n-d-852296-2 devstack@n-api.service[129409]: Neutron server returns request_ids: ['req-d868e578-978e-4eb7-8dff-ebbd900a4221'] Aug 10 17:55:42.147278 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-de4603ba-37fd-476a-8e39-7f1f698dd7c9 tempest-SecurityGroupRulesTestJSON-1965211628 tempest-SecurityGroupRulesTestJSON-1965211628-project] Request method failure captured: Aug 10 17:55:42.147278 n-d-852296-2 devstack@n-api.service[129409]: request: DELETE /compute/v2.1/os-security-groups/b5841026-fdf6-4c01-a0db-08c2de963cf0 HTTP/1.1 Aug 10 17:55:42.147278 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 17:55:42.147278 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 17:55:42.147278 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 17:55:42.147278 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 0 Aug 10 17:55:42.147278 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 17:55:42.147278 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 17:55:42.147278 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 17:55:42.147278 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 17:55:42.147278 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8_EDrANYCN_RReO78MH0loPvPUsba7O2oKQxf7xJq9KLim3SRUrd0ToO5_VCd5klLKhZqG_7C_pva0M77Gne1x-RBpE2VfFx_VCKqdS1L5xrf5IqUIX-x8clpwlNmcV9T0WfvngM6H6C0LkNu2ADiT8t-8kSg0yAjiiG4oLC0fynyKA Aug 10 17:55:42.147278 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 17:55:42.147278 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 17:55:42.147278 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 17:55:42.147278 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 17:55:42.147278 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 17:55:42.147278 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 17:55:42.147278 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: 275da5e9d1ed4bd8a6ea436858a209d7 Aug 10 17:55:42.147278 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-1965211628 Aug 10 17:55:42.147278 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 17:55:42.147278 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 17:55:42.147278 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/275da5e9d1ed4bd8a6ea436858a209d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/275da5e9d1ed4bd8a6ea436858a209d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/275da5e9d1ed4bd8a6ea436858a209d7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_275da5e9d1ed4bd8a6ea436858a209d7", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:55:42.147278 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-SecurityGroupRulesTestJSON-1965211628 Aug 10 17:55:42.147278 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: 275da5e9d1ed4bd8a6ea436858a209d7 Aug 10 17:55:42.147278 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-1965211628 Aug 10 17:55:42.147278 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-SecurityGroupRulesTestJSON-1965211628-project Aug 10 17:55:42.147278 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 17:55:42.147278 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 17:55:42.147278 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: 85505ece835a447a828b539be79b61ca Aug 10 17:55:42.147278 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-SecurityGroupRulesTestJSON-1965211628-project Aug 10 17:55:42.147278 n-d-852296-2 devstack@n-api.service[129409]: method: Aug 10 17:55:42.147278 n-d-852296-2 devstack@n-api.service[129409]: exception: Security group b5841026-fdf6-4c01-a0db-08c2de963cf0 does not exist Aug 10 17:55:42.147278 n-d-852296-2 devstack@n-api.service[129409]: Neutron server returns request_ids: ['req-d868e578-978e-4eb7-8dff-ebbd900a4221'] Aug 10 17:55:42.147278 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'id': 'b5841026-fdf6-4c01-a0db-08c2de963cf0'} Aug 10 17:55:42.147278 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:55:42.147278 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:55:42.147278 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 10 17:55:42.147278 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 10 17:55:42.147278 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:55:42.147278 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:55:42.147278 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 10 17:55:42.147278 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 10 17:55:42.147278 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:55:42.147278 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:55:42.147278 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:55:42.147278 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:55:42.147278 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:55:42.147278 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:55:42.147278 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:55:42.147278 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:55:42.147278 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:55:42.147278 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:55:42.147278 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 10 17:55:42.147278 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 10 17:55:42.147278 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:55:42.147278 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:55:42.147278 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 10 17:55:42.147278 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 10 17:55:42.147278 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 10 17:55:42.147278 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 10 17:55:42.147278 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group b5841026-fdf6-4c01-a0db-08c2de963cf0 does not exist Aug 10 17:55:42.155349 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d868e578-978e-4eb7-8dff-ebbd900a4221'] Aug 10 17:55:42.155349 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:55:42.155349 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:55:42.155349 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:55:42.155349 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:55:42.155349 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 10 17:55:42.155349 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 10 17:55:42.155349 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 10 17:55:42.155349 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 10 17:55:42.155349 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group b5841026-fdf6-4c01-a0db-08c2de963cf0 does not exist Aug 10 17:55:42.155349 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d868e578-978e-4eb7-8dff-ebbd900a4221'] Aug 10 17:55:42.155349 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:55:42.155349 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:55:42.155349 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:55:42.155349 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:55:42.155349 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:55:42.155349 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:55:42.155349 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:55:42.155349 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:55:42.155349 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 17:55:42.155349 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 17:55:42.155349 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:55:42.155349 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:55:42.155349 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 10 17:55:42.155349 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 10 17:55:42.155349 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group b5841026-fdf6-4c01-a0db-08c2de963cf0 does not exist Aug 10 17:55:42.155349 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d868e578-978e-4eb7-8dff-ebbd900a4221'] Aug 10 17:55:42.155349 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:55:42.155349 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:55:42.155349 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:55:42.155349 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:55:42.155349 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:55:42.155349 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:55:42.155349 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:55:42.155349 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:55:42.155349 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group b5841026-fdf6-4c01-a0db-08c2de963cf0 does not exist Aug 10 17:55:42.155349 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d868e578-978e-4eb7-8dff-ebbd900a4221'] Aug 10 17:55:42.155349 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:55:42.155349 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-de4603ba-37fd-476a-8e39-7f1f698dd7c9 tempest-SecurityGroupRulesTestJSON-1965211628 tempest-SecurityGroupRulesTestJSON-1965211628-project] Returning 404 to user: Security group b5841026-fdf6-4c01-a0db-08c2de963cf0 does not exist Aug 10 17:55:42.155349 n-d-852296-2 devstack@n-api.service[129409]: Neutron server returns request_ids: ['req-d868e578-978e-4eb7-8dff-ebbd900a4221'] {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:55:42.155349 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-de4603ba-37fd-476a-8e39-7f1f698dd7c9 tempest-SecurityGroupRulesTestJSON-1965211628 tempest-SecurityGroupRulesTestJSON-1965211628-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/b5841026-fdf6-4c01-a0db-08c2de963cf0" status: 404 len: 194 microversion: 2.1 time: 0.118381 Aug 10 17:55:42.155349 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 732/1445] 10.222.0.50 () {58 vars in 1272 bytes} [Wed Aug 10 17:55:42 2022] DELETE /compute/v2.1/os-security-groups/b5841026-fdf6-4c01-a0db-08c2de963cf0 => generated 194 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:55:42.166163 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-403400a7-445e-4406-9f33-f4f736624c2e tempest-SecurityGroupRulesTestJSON-1965211628 tempest-SecurityGroupRulesTestJSON-1965211628-project] Calling method '.version_select at 0x7fb345a60dc0>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:55:42.389917 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-5ec4d570-84ba-4db5-bd14-84bbd2531d6a tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:55:42.392616 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-5ec4d570-84ba-4db5-bd14-84bbd2531d6a tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] [instance: dd4d671c-5a1f-463d-8bec-cd4f7614479f] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:55:42.415164 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-5ec4d570-84ba-4db5-bd14-84bbd2531d6a tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:55:42.416772 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-5ec4d570-84ba-4db5-bd14-84bbd2531d6a tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:55:42.418280 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-5ec4d570-84ba-4db5-bd14-84bbd2531d6a tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:55:42.419866 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-5ec4d570-84ba-4db5-bd14-84bbd2531d6a tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:55:42.421273 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-5ec4d570-84ba-4db5-bd14-84bbd2531d6a tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:55:42.422118 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-5ec4d570-84ba-4db5-bd14-84bbd2531d6a tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:55:42.614460 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-5ec4d570-84ba-4db5-bd14-84bbd2531d6a tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce45e1a545b4d3b8fa2cb4b2af3f306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0285f1570fe2419c930c80d3a0711858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:55:42.637245 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-5ec4d570-84ba-4db5-bd14-84bbd2531d6a tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/servers/dd4d671c-5a1f-463d-8bec-cd4f7614479f" status: 200 len: 1278 microversion: 2.1 time: 0.238418 Aug 10 17:55:42.640884 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 733/1446] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:55:42 2022] GET /compute/v2.1/servers/dd4d671c-5a1f-463d-8bec-cd4f7614479f => generated 1278 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:55:42.967889 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-f94311b1-5e28-4403-afb5-a00b85ad4a44 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Calling method '.version_select at 0x7fb345e67670>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:55:43.035582 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-f94311b1-5e28-4403-afb5-a00b85ad4a44 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] 10.222.0.50 "GET /compute/v2.1/images/baf689aa-d2ab-491b-8055-a8e57b8f8962" status: 200 len: 1433 microversion: 2.1 time: 0.072131 Aug 10 17:55:43.044072 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 734/1447] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:55:42 2022] GET /compute/v2.1/images/baf689aa-d2ab-491b-8055-a8e57b8f8962 => generated 1433 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:55:43.064237 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-e7f47fff-7e44-4212-9cc4-edf63e70803e tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Calling method '.version_select at 0x7fb346015c10>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:55:43.136621 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-e7f47fff-7e44-4212-9cc4-edf63e70803e tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] 10.222.0.50 "GET /compute/v2.1/images/baf689aa-d2ab-491b-8055-a8e57b8f8962" status: 200 len: 1433 microversion: 2.1 time: 0.077133 Aug 10 17:55:43.147087 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 735/1448] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:55:43 2022] GET /compute/v2.1/images/baf689aa-d2ab-491b-8055-a8e57b8f8962 => generated 1433 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:55:43.162633 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-b6f3fd56-ab9b-42f9-a56e-b420d589236f tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:55:43.163349 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-b6f3fd56-ab9b-42f9-a56e-b420d589236f tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] [instance: 5b41d7b5-e888-47ec-a57e-5b474e76ef45] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:55:43.182391 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-b6f3fd56-ab9b-42f9-a56e-b420d589236f tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:55:43.182899 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-b6f3fd56-ab9b-42f9-a56e-b420d589236f tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:55:43.183373 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-b6f3fd56-ab9b-42f9-a56e-b420d589236f tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:55:43.184196 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-b6f3fd56-ab9b-42f9-a56e-b420d589236f tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:55:43.184762 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-b6f3fd56-ab9b-42f9-a56e-b420d589236f tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:55:43.185389 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-b6f3fd56-ab9b-42f9-a56e-b420d589236f tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:55:43.618753 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-b6f3fd56-ab9b-42f9-a56e-b420d589236f tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36de414913b4223aba37ecb0f74e467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea1bedbf4fa421198a38dbfad95db72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:55:43.630630 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-b6f3fd56-ab9b-42f9-a56e-b420d589236f tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] 10.222.0.50 "GET /compute/v2.1/servers/5b41d7b5-e888-47ec-a57e-5b474e76ef45" status: 200 len: 1467 microversion: 2.1 time: 0.473760 Aug 10 17:55:43.645425 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 736/1449] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:55:43 2022] GET /compute/v2.1/servers/5b41d7b5-e888-47ec-a57e-5b474e76ef45 => generated 1467 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:55:43.699004 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-94167acd-7103-4993-a30b-dc88c7e2e027 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Calling method '.version_select at 0x7fb345e673a0>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:55:43.756282 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-94167acd-7103-4993-a30b-dc88c7e2e027 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] 10.222.0.50 "GET /compute/v2.1/images/a735ff26-463a-4ffe-a981-ab9d9baa494f" status: 200 len: 784 microversion: 2.1 time: 0.085298 Aug 10 17:55:43.769159 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 737/1450] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:55:43 2022] GET /compute/v2.1/images/a735ff26-463a-4ffe-a981-ab9d9baa494f => generated 784 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:55:43.774609 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-3d9127c7-2408-4554-84d6-c9fa97eba36a tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:55:43.775749 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-3d9127c7-2408-4554-84d6-c9fa97eba36a tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] [instance: dd4d671c-5a1f-463d-8bec-cd4f7614479f] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:55:43.782718 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-3d9127c7-2408-4554-84d6-c9fa97eba36a tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:55:43.784191 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-3d9127c7-2408-4554-84d6-c9fa97eba36a tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:55:43.785899 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-3d9127c7-2408-4554-84d6-c9fa97eba36a tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:55:43.786824 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-3d9127c7-2408-4554-84d6-c9fa97eba36a tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:55:43.791074 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-3d9127c7-2408-4554-84d6-c9fa97eba36a tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:55:43.791843 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-3d9127c7-2408-4554-84d6-c9fa97eba36a tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:55:43.902140 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-403400a7-445e-4406-9f33-f4f736624c2e tempest-SecurityGroupRulesTestJSON-1965211628 tempest-SecurityGroupRulesTestJSON-1965211628-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/5fb8bff6-c9aa-418e-87e5-35f0f425bd96" status: 202 len: 0 microversion: 2.1 time: 1.747355 Aug 10 17:55:43.902722 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 714/1451] 10.222.0.50 () {58 vars in 1272 bytes} [Wed Aug 10 17:55:42 2022] DELETE /compute/v2.1/os-security-groups/5fb8bff6-c9aa-418e-87e5-35f0f425bd96 => generated 0 bytes in 1749 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 17:55:43.907625 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-97b79926-bbf2-4729-bda9-1110e6724de5 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:55:43.936777 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-97b79926-bbf2-4729-bda9-1110e6724de5 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] 10.222.0.50 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.031733 Aug 10 17:55:43.937362 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 715/1452] 10.222.0.50 () {58 vars in 1137 bytes} [Wed Aug 10 17:55:43 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:55:43.945408 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-3d9127c7-2408-4554-84d6-c9fa97eba36a tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce45e1a545b4d3b8fa2cb4b2af3f306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0285f1570fe2419c930c80d3a0711858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:55:43.946334 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-d2a73ddb-ad5b-4aef-889f-8b61755ed5b6 tempest-SecurityGroupRulesTestJSON-1965211628 tempest-SecurityGroupRulesTestJSON-1965211628-project] Calling method '.version_select at 0x7fb345a42940>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:55:43.958287 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-3d9127c7-2408-4554-84d6-c9fa97eba36a tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/servers/dd4d671c-5a1f-463d-8bec-cd4f7614479f" status: 200 len: 1276 microversion: 2.1 time: 0.185004 Aug 10 17:55:43.962803 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 738/1453] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:55:43 2022] GET /compute/v2.1/servers/dd4d671c-5a1f-463d-8bec-cd4f7614479f => generated 1276 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:55:43.970770 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-fe418e93-0dff-4ccf-bd6f-15ebedc3d07d tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Calling method '.version_select at 0x7fb345f1bc10>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:55:45.586690 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-d2a73ddb-ad5b-4aef-889f-8b61755ed5b6 tempest-SecurityGroupRulesTestJSON-1965211628 tempest-SecurityGroupRulesTestJSON-1965211628-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/299fd495-ce39-415a-9e71-5d74b10a4916" status: 202 len: 0 microversion: 2.1 time: 1.644670 Aug 10 17:55:45.587267 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 716/1454] 10.222.0.50 () {58 vars in 1272 bytes} [Wed Aug 10 17:55:43 2022] DELETE /compute/v2.1/os-security-groups/299fd495-ce39-415a-9e71-5d74b10a4916 => generated 0 bytes in 1647 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 17:55:45.592753 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-b0f807eb-a0b9-471b-8662-0b74b0db584b tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:55:45.593568 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-b0f807eb-a0b9-471b-8662-0b74b0db584b tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] [instance: dd4d671c-5a1f-463d-8bec-cd4f7614479f] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:55:45.606567 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b0f807eb-a0b9-471b-8662-0b74b0db584b tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:55:45.607325 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b0f807eb-a0b9-471b-8662-0b74b0db584b tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:55:45.608045 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b0f807eb-a0b9-471b-8662-0b74b0db584b tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:55:45.609310 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b0f807eb-a0b9-471b-8662-0b74b0db584b tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:55:45.610413 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b0f807eb-a0b9-471b-8662-0b74b0db584b tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:55:45.611021 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b0f807eb-a0b9-471b-8662-0b74b0db584b tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:55:45.616190 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:55:45.766712 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-b0f807eb-a0b9-471b-8662-0b74b0db584b tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce45e1a545b4d3b8fa2cb4b2af3f306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0285f1570fe2419c930c80d3a0711858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:55:45.774311 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-b0f807eb-a0b9-471b-8662-0b74b0db584b tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/servers/dd4d671c-5a1f-463d-8bec-cd4f7614479f" status: 200 len: 1276 microversion: 2.1 time: 0.185776 Aug 10 17:55:45.795134 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 717/1455] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:55:45 2022] GET /compute/v2.1/servers/dd4d671c-5a1f-463d-8bec-cd4f7614479f => generated 1276 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:55:45.795134 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-667e4425-fd02-4037-9e8b-fe51b2aa6716 tempest-SecurityGroupRulesTestJSON-1965211628 tempest-SecurityGroupRulesTestJSON-1965211628-project] Calling method '.version_select at 0x7fb345a42e50>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:55:46.138207 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-fe418e93-0dff-4ccf-bd6f-15ebedc3d07d tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] 10.222.0.50 "DELETE /compute/v2.1/images/baf689aa-d2ab-491b-8055-a8e57b8f8962" status: 204 len: 0 microversion: 2.1 time: 2.177866 Aug 10 17:55:46.144629 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 739/1456] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:55:43 2022] DELETE /compute/v2.1/images/baf689aa-d2ab-491b-8055-a8e57b8f8962 => generated 0 bytes in 2185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 17:55:46.425778 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-9379832e-daf0-4620-84a1-89d3baeedd93 tempest-ServersTestJSON-546717345 tempest-ServersTestJSON-546717345-project] Action: 'create', calling method: .version_select at 0x7fb345e678b0>, body: {"keypair": {"name": "tempest-keypair-534780874", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEabYoP9eLDfNygqmkMrMwSyyrKTJWxpXLlVWeJT68imEMY8sFJt7QRdXMaQkFu7ikE5VW7xX6Bt6w59nB6Os17vaGUkStQkdxTF005ollFUtK+9jPCTQHqf9e0Z30VEfw=="}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:55:46.471581 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-9379832e-daf0-4620-84a1-89d3baeedd93 tempest-ServersTestJSON-546717345 tempest-ServersTestJSON-546717345-project] Getting quotas for project fa0b66e99ebe45aab1cf7270521bf00b. Resources: {'key_pairs'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:55:46.478244 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-9379832e-daf0-4620-84a1-89d3baeedd93 tempest-ServersTestJSON-546717345 tempest-ServersTestJSON-546717345-project] Getting quotas for user 7482c3899b444f2da3da6d1046329574 and project fa0b66e99ebe45aab1cf7270521bf00b. Resources: {'key_pairs'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:55:46.638111 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-9379832e-daf0-4620-84a1-89d3baeedd93 tempest-ServersTestJSON-546717345 tempest-ServersTestJSON-546717345-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.488955 Aug 10 17:55:46.639514 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 740/1457] 10.222.0.50 () {60 vars in 1159 bytes} [Wed Aug 10 17:55:46 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:55:46.649478 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-2f7fdbe2-cccf-4d20-ac8a-45472c8b99cd tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Calling method '.version_select at 0x7fb345e258b0>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:55:46.695974 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-2f7fdbe2-cccf-4d20-ac8a-45472c8b99cd tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] HTTP exception thrown: Image not found. Aug 10 17:55:46.704663 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-2f7fdbe2-cccf-4d20-ac8a-45472c8b99cd tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Request method failure captured: Aug 10 17:55:46.704663 n-d-852296-2 devstack@n-api.service[129409]: request: GET /compute/v2.1/images/baf689aa-d2ab-491b-8055-a8e57b8f8962 HTTP/1.1 Aug 10 17:55:46.704663 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 17:55:46.704663 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 17:55:46.704663 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 17:55:46.704663 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 0 Aug 10 17:55:46.704663 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 17:55:46.704663 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 17:55:46.704663 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 17:55:46.704663 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 17:55:46.704663 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8_DeGkWKrhzv1YghAlAi5icCM62xJGTSdLjrSL8nbEdQU1PuRRnSnbvGJA1wjtHeY7_t4iSOmrFvkPkJxdOPDvZyHHA6DNDPwqbAq_AE2UhTYrp9oeBcNoxv0aPvLSleWwqnJHs51x_B-DT5ee6fDkeykN7mud9mtOqwlBLEf6yQEk0 Aug 10 17:55:46.704663 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 17:55:46.704663 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 17:55:46.704663 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 17:55:46.704663 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 17:55:46.704663 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 17:55:46.704663 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 17:55:46.704663 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: 0ea1bedbf4fa421198a38dbfad95db72 Aug 10 17:55:46.704663 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-ImagesOneServerTestJSON-1673408554 Aug 10 17:55:46.704663 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 17:55:46.704663 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 17:55:46.704663 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0ea1bedbf4fa421198a38dbfad95db72"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/0ea1bedbf4fa421198a38dbfad95db72"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0ea1bedbf4fa421198a38dbfad95db72"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_0ea1bedbf4fa421198a38dbfad95db72", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:55:46.704663 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-ImagesOneServerTestJSON-1673408554 Aug 10 17:55:46.704663 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: 0ea1bedbf4fa421198a38dbfad95db72 Aug 10 17:55:46.704663 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1673408554 Aug 10 17:55:46.704663 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-ImagesOneServerTestJSON-1673408554-project Aug 10 17:55:46.704663 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 17:55:46.704663 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 17:55:46.704663 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: a36de414913b4223aba37ecb0f74e467 Aug 10 17:55:46.704663 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-ImagesOneServerTestJSON-1673408554-project Aug 10 17:55:46.704663 n-d-852296-2 devstack@n-api.service[129409]: method: Aug 10 17:55:46.704663 n-d-852296-2 devstack@n-api.service[129409]: exception: Image not found. Aug 10 17:55:46.704663 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'id': 'baf689aa-d2ab-491b-8055-a8e57b8f8962'} Aug 10 17:55:46.704663 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:55:46.704663 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:55:46.704663 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 10 17:55:46.704663 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 10 17:55:46.704663 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 10 17:55:46.704663 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 10 17:55:46.704663 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 10 17:55:46.704663 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 10 17:55:46.704663 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 10 17:55:46.704663 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 10 17:55:46.704663 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 10 17:55:46.704663 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 10 17:55:46.704663 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 10 17:55:46.704663 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 10 17:55:46.704663 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 10 17:55:46.704663 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 10 17:55:46.704663 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 10 17:55:46.704663 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 10 17:55:46.704663 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID baf689aa-d2ab-491b-8055-a8e57b8f8962 Aug 10 17:55:46.704663 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:55:46.704663 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:55:46.704663 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:55:46.704663 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:55:46.704663 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 10 17:55:46.704663 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 10 17:55:46.704663 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 10 17:55:46.704663 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 10 17:55:46.704663 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 10 17:55:46.704663 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 10 17:55:46.704663 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 10 17:55:46.714201 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 10 17:55:46.714201 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 10 17:55:46.714201 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 10 17:55:46.714201 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 10 17:55:46.714201 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 10 17:55:46.714201 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 10 17:55:46.714201 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 10 17:55:46.714201 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 10 17:55:46.714201 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 10 17:55:46.714201 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 10 17:55:46.714201 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 10 17:55:46.714201 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 10 17:55:46.714201 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 10 17:55:46.714201 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 10 17:55:46.714201 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 10 17:55:46.714201 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 10 17:55:46.714201 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 10 17:55:46.714201 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image baf689aa-d2ab-491b-8055-a8e57b8f8962 could not be found. Aug 10 17:55:46.714201 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:55:46.714201 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:55:46.714201 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:55:46.714201 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:55:46.714201 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:55:46.714201 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:55:46.714201 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:55:46.714201 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:55:46.714201 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 17:55:46.714201 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 17:55:46.714201 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:55:46.714201 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:55:46.714201 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 10 17:55:46.714201 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 10 17:55:46.714201 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 10 17:55:46.714201 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:55:46.714201 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:55:46.714201 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:55:46.714201 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:55:46.714201 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:55:46.714201 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:55:46.714201 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:55:46.714201 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:55:46.714201 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 10 17:55:46.714201 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:55:46.724958 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-667e4425-fd02-4037-9e8b-fe51b2aa6716 tempest-SecurityGroupRulesTestJSON-1965211628 tempest-SecurityGroupRulesTestJSON-1965211628-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/a29f4dc6-a719-4782-a4bb-05d8bb234980" status: 202 len: 0 microversion: 2.1 time: 0.938939 Aug 10 17:55:46.726965 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 718/1458] 10.222.0.50 () {58 vars in 1272 bytes} [Wed Aug 10 17:55:45 2022] DELETE /compute/v2.1/os-security-groups/a29f4dc6-a719-4782-a4bb-05d8bb234980 => generated 0 bytes in 942 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 17:55:46.752705 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-87b4da1d-b1b8-493b-b3df-57688ed44876 tempest-SecurityGroupRulesTestJSON-1965211628 tempest-SecurityGroupRulesTestJSON-1965211628-project] Calling method '.version_select at 0x7fb345a421f0>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:55:46.757969 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-2f7fdbe2-cccf-4d20-ac8a-45472c8b99cd tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Returning 404 to user: Image not found. {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:55:46.761217 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-2f7fdbe2-cccf-4d20-ac8a-45472c8b99cd tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] 10.222.0.50 "GET /compute/v2.1/images/baf689aa-d2ab-491b-8055-a8e57b8f8962" status: 404 len: 62 microversion: 2.1 time: 0.120085 Aug 10 17:55:46.762414 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 741/1459] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:55:46 2022] GET /compute/v2.1/images/baf689aa-d2ab-491b-8055-a8e57b8f8962 => generated 62 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 10 17:55:46.811989 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-5e49e4b6-1e28-4f1f-b5de-32e9aea0f8e8 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-52537877"}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:55:46.820293 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-5e49e4b6-1e28-4f1f-b5de-32e9aea0f8e8 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] [instance: 5b41d7b5-e888-47ec-a57e-5b474e76ef45] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:55:46.832376 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-5e49e4b6-1e28-4f1f-b5de-32e9aea0f8e8 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:55:46.834019 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-5e49e4b6-1e28-4f1f-b5de-32e9aea0f8e8 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:55:46.834019 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-5e49e4b6-1e28-4f1f-b5de-32e9aea0f8e8 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:55:46.834759 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-5e49e4b6-1e28-4f1f-b5de-32e9aea0f8e8 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:55:46.835320 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-5e49e4b6-1e28-4f1f-b5de-32e9aea0f8e8 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:55:46.835762 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-5e49e4b6-1e28-4f1f-b5de-32e9aea0f8e8 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:55:47.449956 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-5e49e4b6-1e28-4f1f-b5de-32e9aea0f8e8 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] 10.222.0.50 "POST /compute/v2.1/servers/5b41d7b5-e888-47ec-a57e-5b474e76ef45/action" status: 202 len: 0 microversion: 2.1 time: 0.670934 Aug 10 17:55:47.456759 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 742/1460] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 10 17:55:46 2022] POST /compute/v2.1/servers/5b41d7b5-e888-47ec-a57e-5b474e76ef45/action => generated 0 bytes in 679 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 10 17:55:47.465835 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-17f5c31c-fb14-4f9a-b557-e6d62663cf1b tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:55:47.467906 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-17f5c31c-fb14-4f9a-b557-e6d62663cf1b tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] [instance: dd4d671c-5a1f-463d-8bec-cd4f7614479f] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:55:47.482289 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-17f5c31c-fb14-4f9a-b557-e6d62663cf1b tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:55:47.482289 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-17f5c31c-fb14-4f9a-b557-e6d62663cf1b tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:55:47.482289 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-17f5c31c-fb14-4f9a-b557-e6d62663cf1b tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:55:47.482289 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-17f5c31c-fb14-4f9a-b557-e6d62663cf1b tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:55:47.482765 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-17f5c31c-fb14-4f9a-b557-e6d62663cf1b tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:55:47.482913 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-17f5c31c-fb14-4f9a-b557-e6d62663cf1b tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:55:47.711665 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-87b4da1d-b1b8-493b-b3df-57688ed44876 tempest-SecurityGroupRulesTestJSON-1965211628 tempest-SecurityGroupRulesTestJSON-1965211628-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/b6b7b9dd-5def-4061-bc81-175c2fcbf53e" status: 202 len: 0 microversion: 2.1 time: 0.979608 Aug 10 17:55:47.715091 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 719/1461] 10.222.0.50 () {58 vars in 1272 bytes} [Wed Aug 10 17:55:46 2022] DELETE /compute/v2.1/os-security-groups/b6b7b9dd-5def-4061-bc81-175c2fcbf53e => generated 0 bytes in 984 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 17:55:47.720513 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-b1988458-2a32-41ef-a598-e40247cc6fd7 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Calling method '.version_select at 0x7fb345ab55e0>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:55:47.850812 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-b1988458-2a32-41ef-a598-e40247cc6fd7 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] 10.222.0.50 "GET /compute/v2.1/images/6fddc991-ae6e-4ca4-aa51-90c2f71d1f0d" status: 200 len: 1427 microversion: 2.1 time: 0.134211 Aug 10 17:55:47.852188 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 720/1462] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:55:47 2022] GET /compute/v2.1/images/6fddc991-ae6e-4ca4-aa51-90c2f71d1f0d => generated 1427 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:55:47.859863 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [req-41ff695a-1429-4def-9f76-f28b7f84979f req-d1f1816d-3e28-45b9-b345-21cb4f7de9f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b41d7b5-e888-47ec-a57e-5b474e76ef45", "name": "network-vif-unplugged", "status": "completed", "tag": "8aff8e43-12e5-4e3e-bb1f-efb7af31ddbe"}]} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:55:47.876161 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-41ff695a-1429-4def-9f76-f28b7f84979f req-d1f1816d-3e28-45b9-b345-21cb4f7de9f4 service nova] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:55:47.876161 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-41ff695a-1429-4def-9f76-f28b7f84979f req-d1f1816d-3e28-45b9-b345-21cb4f7de9f4 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:55:47.876161 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-41ff695a-1429-4def-9f76-f28b7f84979f req-d1f1816d-3e28-45b9-b345-21cb4f7de9f4 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:55:47.885538 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.compute.server_external_events [req-41ff695a-1429-4def-9f76-f28b7f84979f req-d1f1816d-3e28-45b9-b345-21cb4f7de9f4 service nova] Creating event network-vif-unplugged:8aff8e43-12e5-4e3e-bb1f-efb7af31ddbe for instance 5b41d7b5-e888-47ec-a57e-5b474e76ef45 on n-h1-852296-2 Aug 10 17:55:47.891160 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [req-41ff695a-1429-4def-9f76-f28b7f84979f req-d1f1816d-3e28-45b9-b345-21cb4f7de9f4 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036916 Aug 10 17:55:47.892574 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 721/1463] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 10 17:55:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:55:47.907248 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-4a2f92dc-8f27-4f11-bcab-7b3959d70225 tempest-SecurityGroupRulesTestJSON-1965211628 tempest-SecurityGroupRulesTestJSON-1965211628-project] Calling method '.version_select at 0x7fb345a60dc0>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:55:48.164731 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_cell0:SELECT=10 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:55:48.520716 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-4a2f92dc-8f27-4f11-bcab-7b3959d70225 tempest-SecurityGroupRulesTestJSON-1965211628 tempest-SecurityGroupRulesTestJSON-1965211628-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/9922e7f9-7fc6-4817-ba39-f50809be55ba" status: 202 len: 0 microversion: 2.1 time: 0.625543 Aug 10 17:55:48.525242 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 722/1464] 10.222.0.50 () {58 vars in 1272 bytes} [Wed Aug 10 17:55:47 2022] DELETE /compute/v2.1/os-security-groups/9922e7f9-7fc6-4817-ba39-f50809be55ba => generated 0 bytes in 631 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 17:55:48.588009 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [req-b9e8b707-f39a-4c6d-8a65-e483facfb12e req-44d79153-d512-40b1-a968-54c45716a556 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8937f92d-1764-4316-86cc-939bc9dc34b4", "tag": "c4ddeb24-17b7-43ce-b1c2-3516523d5956"}]} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:55:48.613458 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-b9e8b707-f39a-4c6d-8a65-e483facfb12e req-44d79153-d512-40b1-a968-54c45716a556 service nova] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:55:48.616542 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-b9e8b707-f39a-4c6d-8a65-e483facfb12e req-44d79153-d512-40b1-a968-54c45716a556 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:55:48.619145 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-b9e8b707-f39a-4c6d-8a65-e483facfb12e req-44d79153-d512-40b1-a968-54c45716a556 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:55:48.631217 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-17f5c31c-fb14-4f9a-b557-e6d62663cf1b tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce45e1a545b4d3b8fa2cb4b2af3f306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0285f1570fe2419c930c80d3a0711858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:55:48.646600 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-17f5c31c-fb14-4f9a-b557-e6d62663cf1b tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/servers/dd4d671c-5a1f-463d-8bec-cd4f7614479f" status: 200 len: 1318 microversion: 2.1 time: 1.187453 Aug 10 17:55:48.654370 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 743/1465] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:55:47 2022] GET /compute/v2.1/servers/dd4d671c-5a1f-463d-8bec-cd4f7614479f => generated 1318 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:55:48.656607 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.compute.server_external_events [req-b9e8b707-f39a-4c6d-8a65-e483facfb12e req-44d79153-d512-40b1-a968-54c45716a556 service nova] Creating event network-changed:c4ddeb24-17b7-43ce-b1c2-3516523d5956 for instance 8937f92d-1764-4316-86cc-939bc9dc34b4 on n-h2-852296-2 Aug 10 17:55:48.671735 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [req-b9e8b707-f39a-4c6d-8a65-e483facfb12e req-44d79153-d512-40b1-a968-54c45716a556 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088235 Aug 10 17:55:48.674815 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 723/1466] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 10 17:55:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:55:48.868139 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-821b44f7-d947-4e05-a2d1-ff1b870b5da3 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Calling method '.version_select at 0x7fb345e67940>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:55:48.967321 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-821b44f7-d947-4e05-a2d1-ff1b870b5da3 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] 10.222.0.50 "GET /compute/v2.1/images/6fddc991-ae6e-4ca4-aa51-90c2f71d1f0d" status: 200 len: 1427 microversion: 2.1 time: 0.100837 Aug 10 17:55:48.967984 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 744/1467] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:55:48 2022] GET /compute/v2.1/images/6fddc991-ae6e-4ca4-aa51-90c2f71d1f0d => generated 1427 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:55:49.677287 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-ebec4169-1216-4fa2-89ce-eb790e5ce7da tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:55:49.683917 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-ebec4169-1216-4fa2-89ce-eb790e5ce7da tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] [instance: dd4d671c-5a1f-463d-8bec-cd4f7614479f] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:55:49.694149 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-ebec4169-1216-4fa2-89ce-eb790e5ce7da tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:55:49.708113 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-ebec4169-1216-4fa2-89ce-eb790e5ce7da tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:55:49.708113 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-ebec4169-1216-4fa2-89ce-eb790e5ce7da tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:55:49.708113 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-ebec4169-1216-4fa2-89ce-eb790e5ce7da tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:55:49.708113 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-ebec4169-1216-4fa2-89ce-eb790e5ce7da tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:55:49.708113 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-ebec4169-1216-4fa2-89ce-eb790e5ce7da tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:55:49.924311 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_cell0:SELECT=14 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:55:49.983156 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-c62d0f0c-81dc-4d35-a74a-648aa83efc7b tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Calling method '.version_select at 0x7fb346015ca0>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:55:50.061467 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-c62d0f0c-81dc-4d35-a74a-648aa83efc7b tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] 10.222.0.50 "GET /compute/v2.1/images/6fddc991-ae6e-4ca4-aa51-90c2f71d1f0d" status: 200 len: 1427 microversion: 2.1 time: 0.079711 Aug 10 17:55:50.064582 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 745/1468] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:55:49 2022] GET /compute/v2.1/images/6fddc991-ae6e-4ca4-aa51-90c2f71d1f0d => generated 1427 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:55:50.482373 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-ebec4169-1216-4fa2-89ce-eb790e5ce7da tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce45e1a545b4d3b8fa2cb4b2af3f306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0285f1570fe2419c930c80d3a0711858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:55:50.494791 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-ebec4169-1216-4fa2-89ce-eb790e5ce7da tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/servers/dd4d671c-5a1f-463d-8bec-cd4f7614479f" status: 200 len: 1318 microversion: 2.1 time: 0.826054 Aug 10 17:55:50.522136 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 724/1469] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:55:49 2022] GET /compute/v2.1/servers/dd4d671c-5a1f-463d-8bec-cd4f7614479f => generated 1318 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:55:50.962483 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [req-53e7a9fe-b170-428a-807c-f0bc228d01ec req-6c04d720-b8f3-438d-8ee1-e705162b0d27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd4d671c-5a1f-463d-8bec-cd4f7614479f", "tag": "04dec7b8-0911-42c4-b8b2-bdf1fecdec04"}]} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:55:50.998408 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-53e7a9fe-b170-428a-807c-f0bc228d01ec req-6c04d720-b8f3-438d-8ee1-e705162b0d27 service nova] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:55:50.999824 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-53e7a9fe-b170-428a-807c-f0bc228d01ec req-6c04d720-b8f3-438d-8ee1-e705162b0d27 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:55:51.002195 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-53e7a9fe-b170-428a-807c-f0bc228d01ec req-6c04d720-b8f3-438d-8ee1-e705162b0d27 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:55:51.039621 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.compute.server_external_events [req-53e7a9fe-b170-428a-807c-f0bc228d01ec req-6c04d720-b8f3-438d-8ee1-e705162b0d27 service nova] Creating event network-changed:04dec7b8-0911-42c4-b8b2-bdf1fecdec04 for instance dd4d671c-5a1f-463d-8bec-cd4f7614479f on n-h2-852296-2 Aug 10 17:55:51.052694 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [req-53e7a9fe-b170-428a-807c-f0bc228d01ec req-6c04d720-b8f3-438d-8ee1-e705162b0d27 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099022 Aug 10 17:55:51.054460 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 746/1470] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 10 17:55:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:55:51.074293 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-7ec8b4bb-ed98-4e0c-b585-102f093d92af tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Calling method '.version_select at 0x7fb345ad3940>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:55:51.157445 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-7ec8b4bb-ed98-4e0c-b585-102f093d92af tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] 10.222.0.50 "GET /compute/v2.1/images/6fddc991-ae6e-4ca4-aa51-90c2f71d1f0d" status: 200 len: 1427 microversion: 2.1 time: 0.085424 Aug 10 17:55:51.159106 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 725/1471] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:55:51 2022] GET /compute/v2.1/images/6fddc991-ae6e-4ca4-aa51-90c2f71d1f0d => generated 1427 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:55:51.522550 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-0321198f-443e-46dc-8cbe-ba1523fabda2 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:55:51.523257 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-0321198f-443e-46dc-8cbe-ba1523fabda2 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] [instance: dd4d671c-5a1f-463d-8bec-cd4f7614479f] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:55:51.532166 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-0321198f-443e-46dc-8cbe-ba1523fabda2 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:55:51.532684 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-0321198f-443e-46dc-8cbe-ba1523fabda2 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:55:51.534114 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-0321198f-443e-46dc-8cbe-ba1523fabda2 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:55:51.547158 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-0321198f-443e-46dc-8cbe-ba1523fabda2 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:55:51.547918 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-0321198f-443e-46dc-8cbe-ba1523fabda2 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:55:51.556121 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-0321198f-443e-46dc-8cbe-ba1523fabda2 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:55:52.175829 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-8015a3b6-ac9c-48d5-b174-c088a97125d4 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Calling method '.version_select at 0x7fb345a42e50>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:55:52.269744 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-8015a3b6-ac9c-48d5-b174-c088a97125d4 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] 10.222.0.50 "GET /compute/v2.1/images/6fddc991-ae6e-4ca4-aa51-90c2f71d1f0d" status: 200 len: 1427 microversion: 2.1 time: 0.098996 Aug 10 17:55:52.270271 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 726/1472] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:55:52 2022] GET /compute/v2.1/images/6fddc991-ae6e-4ca4-aa51-90c2f71d1f0d => generated 1427 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:55:52.284817 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-0321198f-443e-46dc-8cbe-ba1523fabda2 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce45e1a545b4d3b8fa2cb4b2af3f306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0285f1570fe2419c930c80d3a0711858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:55:52.317016 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-0321198f-443e-46dc-8cbe-ba1523fabda2 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/servers/dd4d671c-5a1f-463d-8bec-cd4f7614479f" status: 200 len: 1318 microversion: 2.1 time: 0.799028 Aug 10 17:55:52.320439 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 747/1473] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:55:51 2022] GET /compute/v2.1/servers/dd4d671c-5a1f-463d-8bec-cd4f7614479f => generated 1318 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:55:53.119699 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-157f7006-d7df-42ad-b595-f3300f41ed79 tempest-ServersTestJSON-546717345 tempest-ServersTestJSON-546717345-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1017230930", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "890425f6-0415-4676-a84b-4bdc479c9d40"}], "security_groups": [{"name": "tempest-securitygroup--448113242"}], "key_name": "tempest-keypair-534780874", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:55:53.144292 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:55:53.286268 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-8d210c32-6e39-4d45-8b8a-486ba89a967d tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Calling method '.version_select at 0x7fb345e67790>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:55:53.357681 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-8d210c32-6e39-4d45-8b8a-486ba89a967d tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] 10.222.0.50 "GET /compute/v2.1/images/6fddc991-ae6e-4ca4-aa51-90c2f71d1f0d" status: 200 len: 1427 microversion: 2.1 time: 0.077325 Aug 10 17:55:53.358556 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 748/1474] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:55:53 2022] GET /compute/v2.1/images/6fddc991-ae6e-4ca4-aa51-90c2f71d1f0d => generated 1427 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:55:53.367129 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-84471b66-8d20-4d3a-83a3-835f10671d21 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:55:53.367759 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-84471b66-8d20-4d3a-83a3-835f10671d21 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] [instance: dd4d671c-5a1f-463d-8bec-cd4f7614479f] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:55:53.386156 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-84471b66-8d20-4d3a-83a3-835f10671d21 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:55:53.386452 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-84471b66-8d20-4d3a-83a3-835f10671d21 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:55:53.389329 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-84471b66-8d20-4d3a-83a3-835f10671d21 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:55:53.392410 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-84471b66-8d20-4d3a-83a3-835f10671d21 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:55:53.393871 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-84471b66-8d20-4d3a-83a3-835f10671d21 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:55:53.396991 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-84471b66-8d20-4d3a-83a3-835f10671d21 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:55:53.590091 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.network.neutron [None req-157f7006-d7df-42ad-b595-f3300f41ed79 tempest-ServersTestJSON-546717345 tempest-ServersTestJSON-546717345-project] validate_networks() for [('890425f6-0415-4676-a84b-4bdc479c9d40', None, None, None, None, None)] {{(pid=129410) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 17:55:54.031635 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [None req-157f7006-d7df-42ad-b595-f3300f41ed79 tempest-ServersTestJSON-546717345 tempest-ServersTestJSON-546717345-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-b6304091-0af7-4127-8b85-10b39058a31a) Aug 10 17:55:54.031635 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:55:54.031635 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:55:54.031635 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:55:54.031635 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:55:54.031635 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:55:54.031635 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:55:54.031635 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:55:54.031635 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:55:54.031635 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:55:54.031635 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 17:55:54.031635 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 17:55:54.031635 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 17:55:54.031635 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 17:55:54.031635 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 17:55:54.031635 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 17:55:54.031635 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 17:55:54.031635 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 17:55:54.031635 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 17:55:54.031635 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 17:55:54.031635 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 17:55:54.031635 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 17:55:54.031635 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 17:55:54.031635 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 17:55:54.031635 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 17:55:54.031635 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 17:55:54.031635 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 17:55:54.031635 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:55:54.031635 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:55:54.031635 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 17:55:54.031635 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 17:55:54.031635 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:55:54.031635 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:55:54.031635 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:55:54.031635 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:55:54.031635 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:55:54.031635 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:55:54.031635 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:55:54.031635 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:55:54.031635 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:55:54.031635 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:55:54.031635 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 17:55:54.031635 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 17:55:54.031635 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 17:55:54.031635 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 17:55:54.031635 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 17:55:54.031635 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 17:55:54.031635 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 17:55:54.031635 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 17:55:54.031635 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 17:55:54.031635 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 17:55:54.031635 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 17:55:54.031635 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 17:55:54.036989 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 17:55:54.036989 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 17:55:54.036989 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 17:55:54.036989 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 17:55:54.036989 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 17:55:54.036989 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 17:55:54.036989 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 17:55:54.036989 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 17:55:54.036989 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 17:55:54.036989 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 17:55:54.036989 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 17:55:54.036989 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 17:55:54.036989 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 17:55:54.036989 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 17:55:54.036989 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-b6304091-0af7-4127-8b85-10b39058a31a) Aug 10 17:55:54.036989 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:55:54.039112 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-157f7006-d7df-42ad-b595-f3300f41ed79 tempest-ServersTestJSON-546717345 tempest-ServersTestJSON-546717345-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:55:54.039112 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 17:55:54.041401 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-157f7006-d7df-42ad-b595-f3300f41ed79 tempest-ServersTestJSON-546717345 tempest-ServersTestJSON-546717345-project] Request method failure captured: Aug 10 17:55:54.041401 n-d-852296-2 devstack@n-api.service[129410]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 17:55:54.041401 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 17:55:54.041401 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 17:55:54.041401 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 17:55:54.041401 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 631 Aug 10 17:55:54.041401 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 17:55:54.041401 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 17:55:54.041401 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 17:55:54.041401 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 17:55:54.041401 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8_EhPPEIL-PviUdj_ToJG97Yx_GARRDnGZkk3EZpPaz5SFI6opvTwjN3f65Hw54cnRPGi5cXzuNprueH9VONMIc7K3MN1ftv4VW5EcFroKvlys35r7FZm3lPWbtTDJn_lPsA2RmsVcRP9uxiyrLLgx1QBN51CAiurrVnRZHDiZh0Ei0 Aug 10 17:55:54.041401 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 17:55:54.041401 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 17:55:54.041401 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 17:55:54.041401 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 17:55:54.041401 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 17:55:54.041401 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 17:55:54.041401 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: fa0b66e99ebe45aab1cf7270521bf00b Aug 10 17:55:54.041401 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-ServersTestJSON-546717345 Aug 10 17:55:54.041401 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 17:55:54.041401 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 17:55:54.041401 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/fa0b66e99ebe45aab1cf7270521bf00b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/fa0b66e99ebe45aab1cf7270521bf00b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/fa0b66e99ebe45aab1cf7270521bf00b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_fa0b66e99ebe45aab1cf7270521bf00b", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:55:54.041401 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-ServersTestJSON-546717345 Aug 10 17:55:54.041401 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: fa0b66e99ebe45aab1cf7270521bf00b Aug 10 17:55:54.041401 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-ServersTestJSON-546717345 Aug 10 17:55:54.041401 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-ServersTestJSON-546717345-project Aug 10 17:55:54.041401 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 17:55:54.041401 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 17:55:54.041401 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: 7482c3899b444f2da3da6d1046329574 Aug 10 17:55:54.041401 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-ServersTestJSON-546717345-project Aug 10 17:55:54.041401 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 17:55:54.041401 n-d-852296-2 devstack@n-api.service[129410]: {"server": {"name": "tempest-ServersTestJSON-server-1017230930", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "Z4_kpaP@z897zIJ", "networks": [{"uuid": "890425f6-0415-4676-a84b-4bdc479c9d40"}], "security_groups": [{"name": "tempest-securitygroup--448113242"}], "key_name": "tempest-keypair-534780874", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "AUTO"}} Aug 10 17:55:54.041401 n-d-852296-2 devstack@n-api.service[129410]: method: > Aug 10 17:55:54.041401 n-d-852296-2 devstack@n-api.service[129410]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:55:54.041401 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 17:55:54.041401 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'body': {'server': {'name': 'tempest-ServersTestJSON-server-1017230930', 'imageRef': 'a735ff26-463a-4ffe-a981-ab9d9baa494f', 'flavorRef': '452', 'metadata': {'hello': 'world'}, 'adminPass': 'Z4_kpaP@z897zIJ', 'networks': [{'uuid': '890425f6-0415-4676-a84b-4bdc479c9d40'}], 'security_groups': [{'name': 'tempest-securitygroup--448113242'}], 'key_name': 'tempest-keypair-534780874', 'user_data': 'IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo='}}} Aug 10 17:55:54.041401 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:55:54.041401 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:55:54.041401 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:55:54.041401 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:55:54.041401 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:55:54.041401 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:55:54.041401 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:55:54.041401 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:55:54.041401 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:55:54.041401 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:55:54.041401 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 17:55:54.041401 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 17:55:54.041401 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 17:55:54.041401 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 17:55:54.041401 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 17:55:54.041401 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 17:55:54.041401 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 17:55:54.041401 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 17:55:54.041401 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 17:55:54.045842 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 17:55:54.045842 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 17:55:54.045842 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 17:55:54.045842 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 17:55:54.045842 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 17:55:54.045842 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 17:55:54.045842 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 17:55:54.045842 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 17:55:54.045842 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:55:54.045842 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:55:54.045842 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 17:55:54.045842 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 17:55:54.045842 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:55:54.045842 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:55:54.045842 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:55:54.045842 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:55:54.045842 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:55:54.045842 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:55:54.045842 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:55:54.045842 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:55:54.045842 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:55:54.045842 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:55:54.045842 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 17:55:54.045842 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 17:55:54.045842 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 17:55:54.045842 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 17:55:54.045842 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 17:55:54.045842 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 17:55:54.045842 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 17:55:54.045842 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 17:55:54.045842 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 17:55:54.045842 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 17:55:54.045842 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 17:55:54.045842 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 17:55:54.045842 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 17:55:54.045842 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 17:55:54.045842 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 17:55:54.045842 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 17:55:54.045842 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 17:55:54.045842 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 17:55:54.045842 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 17:55:54.045842 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 17:55:54.045842 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 17:55:54.045842 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 17:55:54.045842 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 17:55:54.045842 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 17:55:54.045842 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 17:55:54.045842 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 17:55:54.045842 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-b6304091-0af7-4127-8b85-10b39058a31a) Aug 10 17:55:54.045842 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:55:54.045842 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:55:54.045842 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:55:54.045842 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:55:54.053599 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:55:54.053599 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:55:54.053599 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:55:54.053599 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:55:54.053599 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 10 17:55:54.053599 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 10 17:55:54.053599 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:55:54.053599 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:55:54.053599 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:55:54.053599 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:55:54.053599 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:55:54.053599 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:55:54.053599 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:55:54.053599 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:55:54.053599 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:55:54.053599 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:55:54.053599 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:55:54.053599 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:55:54.053599 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:55:54.053599 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-157f7006-d7df-42ad-b595-f3300f41ed79 tempest-ServersTestJSON-546717345 tempest-ServersTestJSON-546717345-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:55:54.053599 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:55:54.053599 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-157f7006-d7df-42ad-b595-f3300f41ed79 tempest-ServersTestJSON-546717345 tempest-ServersTestJSON-546717345-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.927924 Aug 10 17:55:54.053599 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 727/1475] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 17:55:53 2022] POST /compute/v2.1/servers => generated 214 bytes in 929 msecs (HTTP/1.1 500) 9 headers in 391 bytes (2 switches on core 0) Aug 10 17:55:54.059029 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-25a63831-348e-4887-8e3f-725517e998d4 tempest-ServersTestJSON-546717345 tempest-ServersTestJSON-546717345-project] Calling method '.version_select at 0x7fb345bfbc10>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:55:54.209575 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-25a63831-348e-4887-8e3f-725517e998d4 tempest-ServersTestJSON-546717345 tempest-ServersTestJSON-546717345-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-534780874" status: 202 len: 0 microversion: 2.1 time: 0.158719 Aug 10 17:55:54.210845 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 728/1476] 10.222.0.50 () {58 vars in 1218 bytes} [Wed Aug 10 17:55:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-534780874 => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 17:55:54.376110 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-19deca02-d972-42f1-a74a-66d3b1555155 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Calling method '.version_select at 0x7fb345bfb5e0>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:55:54.462350 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-19deca02-d972-42f1-a74a-66d3b1555155 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] 10.222.0.50 "GET /compute/v2.1/images/6fddc991-ae6e-4ca4-aa51-90c2f71d1f0d" status: 200 len: 1427 microversion: 2.1 time: 0.092380 Aug 10 17:55:54.472392 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 729/1477] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:55:54 2022] GET /compute/v2.1/images/6fddc991-ae6e-4ca4-aa51-90c2f71d1f0d => generated 1427 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:55:54.479190 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-84471b66-8d20-4d3a-83a3-835f10671d21 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce45e1a545b4d3b8fa2cb4b2af3f306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0285f1570fe2419c930c80d3a0711858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:55:54.487955 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-84471b66-8d20-4d3a-83a3-835f10671d21 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/servers/dd4d671c-5a1f-463d-8bec-cd4f7614479f" status: 200 len: 1318 microversion: 2.1 time: 1.124850 Aug 10 17:55:54.489210 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 749/1478] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:55:53 2022] GET /compute/v2.1/servers/dd4d671c-5a1f-463d-8bec-cd4f7614479f => generated 1318 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:55:55.478317 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-8f73fa76-0688-4a10-b9a4-5b2b5ff5b246 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Calling method '.version_select at 0x7fb345a42550>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:55:55.524495 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-90082b17-2d64-4d79-8626-f24f01136770 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:55:55.534375 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-90082b17-2d64-4d79-8626-f24f01136770 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] [instance: dd4d671c-5a1f-463d-8bec-cd4f7614479f] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:55:55.549812 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-8f73fa76-0688-4a10-b9a4-5b2b5ff5b246 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] 10.222.0.50 "GET /compute/v2.1/images/6fddc991-ae6e-4ca4-aa51-90c2f71d1f0d" status: 200 len: 1427 microversion: 2.1 time: 0.073311 Aug 10 17:55:55.552017 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 730/1479] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:55:55 2022] GET /compute/v2.1/images/6fddc991-ae6e-4ca4-aa51-90c2f71d1f0d => generated 1427 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:55:55.553065 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-90082b17-2d64-4d79-8626-f24f01136770 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:55:55.553764 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-90082b17-2d64-4d79-8626-f24f01136770 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:55:55.554397 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-90082b17-2d64-4d79-8626-f24f01136770 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:55:55.555321 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-90082b17-2d64-4d79-8626-f24f01136770 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:55:55.555938 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-90082b17-2d64-4d79-8626-f24f01136770 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:55:55.556555 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-90082b17-2d64-4d79-8626-f24f01136770 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:55:55.683651 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [req-5d2ef1ca-4dbc-4b23-b24e-dacd09f2e2db req-c2b18a43-1fbb-4f08-88cc-bc23a7fd9482 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b41d7b5-e888-47ec-a57e-5b474e76ef45", "name": "network-vif-plugged", "status": "completed", "tag": "8aff8e43-12e5-4e3e-bb1f-efb7af31ddbe"}]} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:55:55.706457 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-5d2ef1ca-4dbc-4b23-b24e-dacd09f2e2db req-c2b18a43-1fbb-4f08-88cc-bc23a7fd9482 service nova] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:55:55.708581 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-5d2ef1ca-4dbc-4b23-b24e-dacd09f2e2db req-c2b18a43-1fbb-4f08-88cc-bc23a7fd9482 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:55:55.709117 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-5d2ef1ca-4dbc-4b23-b24e-dacd09f2e2db req-c2b18a43-1fbb-4f08-88cc-bc23a7fd9482 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:55:55.758494 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.compute.server_external_events [req-5d2ef1ca-4dbc-4b23-b24e-dacd09f2e2db req-c2b18a43-1fbb-4f08-88cc-bc23a7fd9482 service nova] Creating event network-vif-plugged:8aff8e43-12e5-4e3e-bb1f-efb7af31ddbe for instance 5b41d7b5-e888-47ec-a57e-5b474e76ef45 on n-h1-852296-2 Aug 10 17:55:55.774726 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [req-5d2ef1ca-4dbc-4b23-b24e-dacd09f2e2db req-c2b18a43-1fbb-4f08-88cc-bc23a7fd9482 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095886 Aug 10 17:55:55.776732 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 731/1480] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 10 17:55:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:55:56.087788 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-90082b17-2d64-4d79-8626-f24f01136770 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce45e1a545b4d3b8fa2cb4b2af3f306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0285f1570fe2419c930c80d3a0711858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:55:56.106923 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-90082b17-2d64-4d79-8626-f24f01136770 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/servers/dd4d671c-5a1f-463d-8bec-cd4f7614479f" status: 200 len: 1318 microversion: 2.1 time: 0.588388 Aug 10 17:55:56.112962 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 750/1481] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:55:55 2022] GET /compute/v2.1/servers/dd4d671c-5a1f-463d-8bec-cd4f7614479f => generated 1318 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:55:56.567968 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-160c9c2a-b385-4826-a5c7-d94cdd5df273 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Calling method '.version_select at 0x7fb345b9d280>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:55:56.630761 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-160c9c2a-b385-4826-a5c7-d94cdd5df273 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] 10.222.0.50 "GET /compute/v2.1/images/6fddc991-ae6e-4ca4-aa51-90c2f71d1f0d" status: 200 len: 1427 microversion: 2.1 time: 0.068585 Aug 10 17:55:56.632348 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 732/1482] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:55:56 2022] GET /compute/v2.1/images/6fddc991-ae6e-4ca4-aa51-90c2f71d1f0d => generated 1427 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:55:57.131412 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-a3bef02b-0a30-40a9-b0df-e325581e8d22 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:55:57.133181 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-a3bef02b-0a30-40a9-b0df-e325581e8d22 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] [instance: dd4d671c-5a1f-463d-8bec-cd4f7614479f] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:55:57.144447 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_cell0:SELECT=6 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:55:57.146350 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a3bef02b-0a30-40a9-b0df-e325581e8d22 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:55:57.147169 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a3bef02b-0a30-40a9-b0df-e325581e8d22 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:55:57.147782 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a3bef02b-0a30-40a9-b0df-e325581e8d22 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:55:57.148707 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a3bef02b-0a30-40a9-b0df-e325581e8d22 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:55:57.149334 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a3bef02b-0a30-40a9-b0df-e325581e8d22 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:55:57.149925 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a3bef02b-0a30-40a9-b0df-e325581e8d22 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:55:57.650397 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-37fc2f27-83a4-4e91-9d4b-845a21eccdf8 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Calling method '.version_select at 0x7fb345b82e50>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:55:57.735688 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-37fc2f27-83a4-4e91-9d4b-845a21eccdf8 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] 10.222.0.50 "GET /compute/v2.1/images/6fddc991-ae6e-4ca4-aa51-90c2f71d1f0d" status: 200 len: 1427 microversion: 2.1 time: 0.092905 Aug 10 17:55:57.749273 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 733/1483] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:55:57 2022] GET /compute/v2.1/images/6fddc991-ae6e-4ca4-aa51-90c2f71d1f0d => generated 1427 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:55:58.578509 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-a3bef02b-0a30-40a9-b0df-e325581e8d22 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce45e1a545b4d3b8fa2cb4b2af3f306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0285f1570fe2419c930c80d3a0711858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:55:58.590123 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-a3bef02b-0a30-40a9-b0df-e325581e8d22 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/servers/dd4d671c-5a1f-463d-8bec-cd4f7614479f" status: 200 len: 1318 microversion: 2.1 time: 1.462841 Aug 10 17:55:58.612567 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 751/1484] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:55:57 2022] GET /compute/v2.1/servers/dd4d671c-5a1f-463d-8bec-cd4f7614479f => generated 1318 bytes in 1486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:55:58.764312 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-35251fa8-1d37-4927-9879-b7163b924832 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Calling method '.version_select at 0x7fb345a3ee50>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:55:58.846021 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-35251fa8-1d37-4927-9879-b7163b924832 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] 10.222.0.50 "GET /compute/v2.1/images/6fddc991-ae6e-4ca4-aa51-90c2f71d1f0d" status: 200 len: 1427 microversion: 2.1 time: 0.091538 Aug 10 17:55:58.853305 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 734/1485] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:55:58 2022] GET /compute/v2.1/images/6fddc991-ae6e-4ca4-aa51-90c2f71d1f0d => generated 1427 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:55:59.621908 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-29afb3fc-9826-4f1a-9732-9621adbee294 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:55:59.623530 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-29afb3fc-9826-4f1a-9732-9621adbee294 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] [instance: dd4d671c-5a1f-463d-8bec-cd4f7614479f] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:55:59.631694 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-29afb3fc-9826-4f1a-9732-9621adbee294 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:55:59.634163 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-29afb3fc-9826-4f1a-9732-9621adbee294 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:55:59.634878 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-29afb3fc-9826-4f1a-9732-9621adbee294 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:55:59.635842 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-29afb3fc-9826-4f1a-9732-9621adbee294 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:55:59.636655 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-29afb3fc-9826-4f1a-9732-9621adbee294 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:55:59.637351 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-29afb3fc-9826-4f1a-9732-9621adbee294 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:55:59.860517 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-f4364e23-04c4-4c5c-bb0a-1d5b93ac9a9c tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Calling method '.version_select at 0x7fb345b5f310>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:55:59.968097 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-f4364e23-04c4-4c5c-bb0a-1d5b93ac9a9c tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] 10.222.0.50 "GET /compute/v2.1/images/6fddc991-ae6e-4ca4-aa51-90c2f71d1f0d" status: 200 len: 1427 microversion: 2.1 time: 0.111700 Aug 10 17:55:59.969196 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 735/1486] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:55:59 2022] GET /compute/v2.1/images/6fddc991-ae6e-4ca4-aa51-90c2f71d1f0d => generated 1427 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:56:00.284642 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-29afb3fc-9826-4f1a-9732-9621adbee294 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce45e1a545b4d3b8fa2cb4b2af3f306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0285f1570fe2419c930c80d3a0711858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:56:00.307034 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-29afb3fc-9826-4f1a-9732-9621adbee294 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/servers/dd4d671c-5a1f-463d-8bec-cd4f7614479f" status: 200 len: 1318 microversion: 2.1 time: 0.690206 Aug 10 17:56:00.308182 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 752/1487] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:55:59 2022] GET /compute/v2.1/servers/dd4d671c-5a1f-463d-8bec-cd4f7614479f => generated 1318 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:56:00.794683 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-145aef5b-3a54-499b-9fe3-35a718cf59ce tempest-FloatingIPsNegativeTestJSON-94181546 tempest-FloatingIPsNegativeTestJSON-94181546-project] Calling method '.version_select at 0x7fb345b805e0>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:56:00.978684 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-145aef5b-3a54-499b-9fe3-35a718cf59ce tempest-FloatingIPsNegativeTestJSON-94181546 tempest-FloatingIPsNegativeTestJSON-94181546-project] 10.222.0.50 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.699338 Aug 10 17:56:00.980962 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 736/1488] 10.222.0.50 () {58 vars in 1149 bytes} [Wed Aug 10 17:56:00 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 17:56:00.988446 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-441de1cf-bb60-4c3c-b1c5-72832e7e993d tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Calling method '.version_select at 0x7fb345eba550>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:56:00.998935 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-cd0e035a-525c-4b0d-848b-be70aa66c02f tempest-FloatingIPsNegativeTestJSON-94181546 tempest-FloatingIPsNegativeTestJSON-94181546-project] Action: 'create', calling method: .version_select at 0x7fb345abc820>, body: {"pool": "non_exist_pool"} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:56:01.090674 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-441de1cf-bb60-4c3c-b1c5-72832e7e993d tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] 10.222.0.50 "GET /compute/v2.1/images/6fddc991-ae6e-4ca4-aa51-90c2f71d1f0d" status: 200 len: 1427 microversion: 2.1 time: 0.106625 Aug 10 17:56:01.091888 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 753/1489] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:56:00 2022] GET /compute/v2.1/images/6fddc991-ae6e-4ca4-aa51-90c2f71d1f0d => generated 1427 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:56:01.334769 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-c863c1ec-cf29-4503-89f2-a269d966dc33 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:56:01.336235 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-c863c1ec-cf29-4503-89f2-a269d966dc33 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] [instance: dd4d671c-5a1f-463d-8bec-cd4f7614479f] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:56:01.350276 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=1 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:56:01.363129 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c863c1ec-cf29-4503-89f2-a269d966dc33 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:56:01.364738 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c863c1ec-cf29-4503-89f2-a269d966dc33 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:56:01.367073 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-cd0e035a-525c-4b0d-848b-be70aa66c02f tempest-FloatingIPsNegativeTestJSON-94181546 tempest-FloatingIPsNegativeTestJSON-94181546-project] HTTP exception thrown: Floating IP pool not found. Aug 10 17:56:01.369272 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-cd0e035a-525c-4b0d-848b-be70aa66c02f tempest-FloatingIPsNegativeTestJSON-94181546 tempest-FloatingIPsNegativeTestJSON-94181546-project] Request method failure captured: Aug 10 17:56:01.369272 n-d-852296-2 devstack@n-api.service[129410]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Aug 10 17:56:01.369272 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 17:56:01.369272 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 17:56:01.369272 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 17:56:01.369272 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 26 Aug 10 17:56:01.369272 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 17:56:01.369272 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 17:56:01.369272 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 17:56:01.369272 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 17:56:01.369272 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8_Ewiy9Z4qZunxD5zvW3H_ofHTP9W3bG4d5VkCvRM2Dv7QX97zSkVOs8xvPl4UNNmQcAhk72uU1IDNGWGk34lX8fNcDH_r97Sp5Yk1Rivqyh4YZY-gpRBVneJDgk89GKi9PGTbMj3TosTst9TsflhYKOqNBPLf3OdJ_rgLAR-FOZ1Sc Aug 10 17:56:01.369272 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 17:56:01.369272 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 17:56:01.369272 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 17:56:01.369272 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 17:56:01.369272 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 17:56:01.369272 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 17:56:01.369272 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: 645b5897b06e43a1bd46e11a6727540f Aug 10 17:56:01.369272 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-94181546 Aug 10 17:56:01.369272 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 17:56:01.369272 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 17:56:01.369272 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/645b5897b06e43a1bd46e11a6727540f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/645b5897b06e43a1bd46e11a6727540f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/645b5897b06e43a1bd46e11a6727540f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_645b5897b06e43a1bd46e11a6727540f", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:56:01.369272 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-94181546 Aug 10 17:56:01.369272 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: 645b5897b06e43a1bd46e11a6727540f Aug 10 17:56:01.369272 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-94181546 Aug 10 17:56:01.369272 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-FloatingIPsNegativeTestJSON-94181546-project Aug 10 17:56:01.369272 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 17:56:01.369272 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 17:56:01.369272 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: 0eb46182f1044918a337b72cc3a83b25 Aug 10 17:56:01.369272 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-94181546-project Aug 10 17:56:01.369272 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 17:56:01.369272 n-d-852296-2 devstack@n-api.service[129410]: {"pool": "non_exist_pool"} Aug 10 17:56:01.369272 n-d-852296-2 devstack@n-api.service[129410]: method: Aug 10 17:56:01.369272 n-d-852296-2 devstack@n-api.service[129410]: exception: Floating IP pool not found. Aug 10 17:56:01.369272 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'body': {'pool': 'non_exist_pool'}} Aug 10 17:56:01.369272 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:56:01.369272 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:56:01.369272 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Aug 10 17:56:01.369272 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Aug 10 17:56:01.369272 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2975, in allocate_floating_ip Aug 10 17:56:01.369272 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Aug 10 17:56:01.369272 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2965, in _get_floating_ip_pool_id_by_name_or_id Aug 10 17:56:01.369272 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Aug 10 17:56:01.369272 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Aug 10 17:56:01.369272 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:56:01.369272 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:56:01.369272 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:56:01.369272 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:56:01.369272 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:56:01.369272 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:56:01.369272 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:56:01.369272 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:56:01.369272 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 17:56:01.369272 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 17:56:01.369272 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:56:01.369272 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:56:01.369272 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Aug 10 17:56:01.369272 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:56:01.369272 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Aug 10 17:56:01.369272 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:56:01.369272 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:56:01.369272 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:56:01.369272 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:56:01.369272 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:56:01.369272 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:56:01.369272 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:56:01.369272 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:56:01.381122 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Aug 10 17:56:01.381122 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:56:01.381122 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-cd0e035a-525c-4b0d-848b-be70aa66c02f tempest-FloatingIPsNegativeTestJSON-94181546 tempest-FloatingIPsNegativeTestJSON-94181546-project] Returning 404 to user: Floating IP pool not found. {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:56:01.381122 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-cd0e035a-525c-4b0d-848b-be70aa66c02f tempest-FloatingIPsNegativeTestJSON-94181546 tempest-FloatingIPsNegativeTestJSON-94181546-project] 10.222.0.50 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.380526 Aug 10 17:56:01.381122 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 737/1490] 10.222.0.50 () {60 vars in 1170 bytes} [Wed Aug 10 17:56:00 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 382 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 10 17:56:01.381528 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c863c1ec-cf29-4503-89f2-a269d966dc33 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:56:01.381528 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c863c1ec-cf29-4503-89f2-a269d966dc33 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:56:01.381712 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c863c1ec-cf29-4503-89f2-a269d966dc33 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:56:01.391686 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c863c1ec-cf29-4503-89f2-a269d966dc33 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:56:01.393216 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-37808a76-2b9d-448c-a38f-520ffefe7550 tempest-FloatingIPsNegativeTestJSON-94181546 tempest-FloatingIPsNegativeTestJSON-94181546-project] Calling method '.version_select at 0x7fb345b80550>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:56:01.618330 n-d-852296-2 devstack@n-api.service[129410]: DEBUG neutronclient.v2_0.client [None req-37808a76-2b9d-448c-a38f-520ffefe7550 tempest-FloatingIPsNegativeTestJSON-94181546 tempest-FloatingIPsNegativeTestJSON-94181546-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 69de1064-63a1-4d43-a46c-bf6a35d01f96 could not be found", "detail": ""}} {{(pid=129410) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 10 17:56:01.619019 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-37808a76-2b9d-448c-a38f-520ffefe7550 tempest-FloatingIPsNegativeTestJSON-94181546 tempest-FloatingIPsNegativeTestJSON-94181546-project] HTTP exception thrown: Floating IP not found for ID 69de1064-63a1-4d43-a46c-bf6a35d01f96 Aug 10 17:56:01.621099 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-37808a76-2b9d-448c-a38f-520ffefe7550 tempest-FloatingIPsNegativeTestJSON-94181546 tempest-FloatingIPsNegativeTestJSON-94181546-project] Request method failure captured: Aug 10 17:56:01.621099 n-d-852296-2 devstack@n-api.service[129410]: request: DELETE /compute/v2.1/os-floating-ips/69de1064-63a1-4d43-a46c-bf6a35d01f96 HTTP/1.1 Aug 10 17:56:01.621099 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 17:56:01.621099 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 17:56:01.621099 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 17:56:01.621099 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 0 Aug 10 17:56:01.621099 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 17:56:01.621099 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 17:56:01.621099 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 17:56:01.621099 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 17:56:01.621099 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8_Ewiy9Z4qZunxD5zvW3H_ofHTP9W3bG4d5VkCvRM2Dv7QX97zSkVOs8xvPl4UNNmQcAhk72uU1IDNGWGk34lX8fNcDH_r97Sp5Yk1Rivqyh4YZY-gpRBVneJDgk89GKi9PGTbMj3TosTst9TsflhYKOqNBPLf3OdJ_rgLAR-FOZ1Sc Aug 10 17:56:01.621099 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 17:56:01.621099 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 17:56:01.621099 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 17:56:01.621099 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 17:56:01.621099 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 17:56:01.621099 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 17:56:01.621099 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: 645b5897b06e43a1bd46e11a6727540f Aug 10 17:56:01.621099 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-94181546 Aug 10 17:56:01.621099 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 17:56:01.621099 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 17:56:01.621099 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/645b5897b06e43a1bd46e11a6727540f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/645b5897b06e43a1bd46e11a6727540f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/645b5897b06e43a1bd46e11a6727540f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_645b5897b06e43a1bd46e11a6727540f", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:56:01.621099 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-94181546 Aug 10 17:56:01.621099 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: 645b5897b06e43a1bd46e11a6727540f Aug 10 17:56:01.621099 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-94181546 Aug 10 17:56:01.621099 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-FloatingIPsNegativeTestJSON-94181546-project Aug 10 17:56:01.621099 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 17:56:01.621099 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 17:56:01.621099 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: 0eb46182f1044918a337b72cc3a83b25 Aug 10 17:56:01.621099 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-94181546-project Aug 10 17:56:01.621099 n-d-852296-2 devstack@n-api.service[129410]: method: Aug 10 17:56:01.621099 n-d-852296-2 devstack@n-api.service[129410]: exception: Floating IP not found for ID 69de1064-63a1-4d43-a46c-bf6a35d01f96 Aug 10 17:56:01.621099 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'id': '69de1064-63a1-4d43-a46c-bf6a35d01f96'} Aug 10 17:56:01.621099 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:56:01.621099 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:56:01.621099 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 10 17:56:01.621099 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 10 17:56:01.621099 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:56:01.621099 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:56:01.621099 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 10 17:56:01.621099 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 10 17:56:01.621099 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:56:01.621099 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:56:01.621099 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:56:01.621099 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:56:01.621099 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:56:01.621099 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:56:01.621099 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:56:01.621099 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:56:01.621099 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:56:01.621099 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:56:01.621099 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 10 17:56:01.621099 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 10 17:56:01.621099 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:56:01.621099 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:56:01.621099 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 10 17:56:01.621099 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 10 17:56:01.621099 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 10 17:56:01.621099 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 10 17:56:01.621099 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 69de1064-63a1-4d43-a46c-bf6a35d01f96 could not be found Aug 10 17:56:01.621099 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-708999c3-d142-419c-8b30-1dc9571132cc'] Aug 10 17:56:01.621099 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:56:01.626248 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:56:01.626248 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:56:01.626248 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:56:01.626248 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Aug 10 17:56:01.626248 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 10 17:56:01.626248 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 10 17:56:01.626248 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 10 17:56:01.626248 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 69de1064-63a1-4d43-a46c-bf6a35d01f96. Aug 10 17:56:01.626248 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:56:01.626248 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:56:01.626248 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:56:01.626248 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:56:01.626248 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:56:01.626248 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:56:01.626248 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:56:01.626248 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:56:01.626248 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 17:56:01.626248 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 17:56:01.626248 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:56:01.626248 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:56:01.626248 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Aug 10 17:56:01.626248 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 10 17:56:01.626248 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 69de1064-63a1-4d43-a46c-bf6a35d01f96 Aug 10 17:56:01.626248 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:56:01.626248 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:56:01.626248 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:56:01.626248 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:56:01.626248 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:56:01.626248 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:56:01.626248 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:56:01.626248 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:56:01.626248 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 69de1064-63a1-4d43-a46c-bf6a35d01f96 Aug 10 17:56:01.626248 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:56:01.626248 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-37808a76-2b9d-448c-a38f-520ffefe7550 tempest-FloatingIPsNegativeTestJSON-94181546 tempest-FloatingIPsNegativeTestJSON-94181546-project] Returning 404 to user: Floating IP not found for ID 69de1064-63a1-4d43-a46c-bf6a35d01f96 {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:56:01.626248 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-37808a76-2b9d-448c-a38f-520ffefe7550 tempest-FloatingIPsNegativeTestJSON-94181546 tempest-FloatingIPsNegativeTestJSON-94181546-project] 10.222.0.50 "DELETE /compute/v2.1/os-floating-ips/69de1064-63a1-4d43-a46c-bf6a35d01f96" status: 404 len: 111 microversion: 2.1 time: 0.244399 Aug 10 17:56:01.626248 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 738/1491] 10.222.0.50 () {58 vars in 1263 bytes} [Wed Aug 10 17:56:01 2022] DELETE /compute/v2.1/os-floating-ips/69de1064-63a1-4d43-a46c-bf6a35d01f96 => generated 111 bytes in 246 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:56:02.107198 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-8e40ce97-f68d-4179-a458-dcd0d00e89bd tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Calling method '.version_select at 0x7fb345b5f280>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:56:02.203382 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-8e40ce97-f68d-4179-a458-dcd0d00e89bd tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] 10.222.0.50 "GET /compute/v2.1/images/6fddc991-ae6e-4ca4-aa51-90c2f71d1f0d" status: 200 len: 1427 microversion: 2.1 time: 0.096764 Aug 10 17:56:02.204024 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 739/1492] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:56:02 2022] GET /compute/v2.1/images/6fddc991-ae6e-4ca4-aa51-90c2f71d1f0d => generated 1427 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:56:02.574880 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-c863c1ec-cf29-4503-89f2-a269d966dc33 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce45e1a545b4d3b8fa2cb4b2af3f306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0285f1570fe2419c930c80d3a0711858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:56:02.585544 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-c863c1ec-cf29-4503-89f2-a269d966dc33 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/servers/dd4d671c-5a1f-463d-8bec-cd4f7614479f" status: 200 len: 1318 microversion: 2.1 time: 1.256727 Aug 10 17:56:02.590958 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 754/1493] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:56:01 2022] GET /compute/v2.1/servers/dd4d671c-5a1f-463d-8bec-cd4f7614479f => generated 1318 bytes in 1263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:56:03.219137 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-555d0af1-8ffa-411d-bcf8-ef5216636d97 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Calling method '.version_select at 0x7fb345b5f670>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:56:03.326193 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-555d0af1-8ffa-411d-bcf8-ef5216636d97 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] 10.222.0.50 "GET /compute/v2.1/images/6fddc991-ae6e-4ca4-aa51-90c2f71d1f0d" status: 200 len: 1427 microversion: 2.1 time: 0.111002 Aug 10 17:56:03.328582 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 740/1494] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:56:03 2022] GET /compute/v2.1/images/6fddc991-ae6e-4ca4-aa51-90c2f71d1f0d => generated 1427 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:56:03.616145 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-880bb8d5-c3a1-4187-97d6-5009d4efdcf0 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:56:03.616899 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-880bb8d5-c3a1-4187-97d6-5009d4efdcf0 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] [instance: dd4d671c-5a1f-463d-8bec-cd4f7614479f] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:56:03.634836 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-880bb8d5-c3a1-4187-97d6-5009d4efdcf0 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:56:03.635389 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-880bb8d5-c3a1-4187-97d6-5009d4efdcf0 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:56:03.639731 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-880bb8d5-c3a1-4187-97d6-5009d4efdcf0 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:56:03.641590 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-880bb8d5-c3a1-4187-97d6-5009d4efdcf0 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:56:03.642561 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-880bb8d5-c3a1-4187-97d6-5009d4efdcf0 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:56:03.647007 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-880bb8d5-c3a1-4187-97d6-5009d4efdcf0 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:56:04.347394 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-087430c6-a106-44ec-aa2a-4ab5b165c890 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Calling method '.version_select at 0x7fb345bc4280>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:56:04.434784 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-087430c6-a106-44ec-aa2a-4ab5b165c890 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] 10.222.0.50 "GET /compute/v2.1/images/6fddc991-ae6e-4ca4-aa51-90c2f71d1f0d" status: 200 len: 1427 microversion: 2.1 time: 0.092162 Aug 10 17:56:04.437489 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 741/1495] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:56:04 2022] GET /compute/v2.1/images/6fddc991-ae6e-4ca4-aa51-90c2f71d1f0d => generated 1427 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:56:04.912561 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-880bb8d5-c3a1-4187-97d6-5009d4efdcf0 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce45e1a545b4d3b8fa2cb4b2af3f306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0285f1570fe2419c930c80d3a0711858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:56:04.947882 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-880bb8d5-c3a1-4187-97d6-5009d4efdcf0 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/servers/dd4d671c-5a1f-463d-8bec-cd4f7614479f" status: 200 len: 1318 microversion: 2.1 time: 1.334374 Aug 10 17:56:04.953462 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 755/1496] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:56:03 2022] GET /compute/v2.1/servers/dd4d671c-5a1f-463d-8bec-cd4f7614479f => generated 1318 bytes in 1346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:56:05.083384 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [req-c6ffe305-3bde-4ab9-9e01-1097ef6695c5 req-0970489d-b320-484f-ab71-188acd22f797 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd4d671c-5a1f-463d-8bec-cd4f7614479f", "name": "network-vif-plugged", "status": "completed", "tag": "04dec7b8-0911-42c4-b8b2-bdf1fecdec04"}]} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:56:05.120962 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-c6ffe305-3bde-4ab9-9e01-1097ef6695c5 req-0970489d-b320-484f-ab71-188acd22f797 service nova] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:56:05.121920 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-c6ffe305-3bde-4ab9-9e01-1097ef6695c5 req-0970489d-b320-484f-ab71-188acd22f797 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:56:05.122550 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-c6ffe305-3bde-4ab9-9e01-1097ef6695c5 req-0970489d-b320-484f-ab71-188acd22f797 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:56:05.169472 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.compute.server_external_events [req-c6ffe305-3bde-4ab9-9e01-1097ef6695c5 req-0970489d-b320-484f-ab71-188acd22f797 service nova] Creating event network-vif-plugged:04dec7b8-0911-42c4-b8b2-bdf1fecdec04 for instance dd4d671c-5a1f-463d-8bec-cd4f7614479f on n-h2-852296-2 Aug 10 17:56:05.179908 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [req-c6ffe305-3bde-4ab9-9e01-1097ef6695c5 req-0970489d-b320-484f-ab71-188acd22f797 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103098 Aug 10 17:56:05.181923 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 742/1497] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 10 17:56:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:56:05.451368 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-29ddb8e6-b956-4bed-a3c7-71f7c5b95329 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Calling method '.version_select at 0x7fb345ebe9d0>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:56:05.557025 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-29ddb8e6-b956-4bed-a3c7-71f7c5b95329 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] 10.222.0.50 "GET /compute/v2.1/images/6fddc991-ae6e-4ca4-aa51-90c2f71d1f0d" status: 200 len: 1427 microversion: 2.1 time: 0.109781 Aug 10 17:56:05.564207 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 756/1498] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:56:05 2022] GET /compute/v2.1/images/6fddc991-ae6e-4ca4-aa51-90c2f71d1f0d => generated 1427 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:56:05.975400 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-e62f8262-ea1d-460b-aed9-f372ed9e3418 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:56:05.976322 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-e62f8262-ea1d-460b-aed9-f372ed9e3418 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] [instance: dd4d671c-5a1f-463d-8bec-cd4f7614479f] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:56:06.002311 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e62f8262-ea1d-460b-aed9-f372ed9e3418 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:56:06.004514 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e62f8262-ea1d-460b-aed9-f372ed9e3418 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:56:06.007086 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e62f8262-ea1d-460b-aed9-f372ed9e3418 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:56:06.012028 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e62f8262-ea1d-460b-aed9-f372ed9e3418 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:56:06.015392 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e62f8262-ea1d-460b-aed9-f372ed9e3418 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:56:06.016875 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e62f8262-ea1d-460b-aed9-f372ed9e3418 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:56:06.573778 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-80a18dd0-7b00-4ed2-9212-099317bcbf58 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Calling method '.version_select at 0x7fb345ebab80>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:56:06.697478 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-80a18dd0-7b00-4ed2-9212-099317bcbf58 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] 10.222.0.50 "GET /compute/v2.1/images/6fddc991-ae6e-4ca4-aa51-90c2f71d1f0d" status: 200 len: 1427 microversion: 2.1 time: 0.130003 Aug 10 17:56:06.698125 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-e62f8262-ea1d-460b-aed9-f372ed9e3418 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce45e1a545b4d3b8fa2cb4b2af3f306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0285f1570fe2419c930c80d3a0711858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:56:06.703931 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 757/1499] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:56:06 2022] GET /compute/v2.1/images/6fddc991-ae6e-4ca4-aa51-90c2f71d1f0d => generated 1427 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:56:06.715386 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-e62f8262-ea1d-460b-aed9-f372ed9e3418 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/servers/dd4d671c-5a1f-463d-8bec-cd4f7614479f" status: 200 len: 1318 microversion: 2.1 time: 0.745371 Aug 10 17:56:06.721331 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 743/1500] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:56:05 2022] GET /compute/v2.1/servers/dd4d671c-5a1f-463d-8bec-cd4f7614479f => generated 1318 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:56:07.601057 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [req-ec98db28-0edb-415e-b520-a24dde2d375b req-46ba91c2-ce8a-45f7-8ddd-562592e8a41c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8937f92d-1764-4316-86cc-939bc9dc34b4", "name": "network-vif-plugged", "status": "completed", "tag": "c4ddeb24-17b7-43ce-b1c2-3516523d5956"}]} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:56:07.628524 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-ec98db28-0edb-415e-b520-a24dde2d375b req-46ba91c2-ce8a-45f7-8ddd-562592e8a41c service nova] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:56:07.630986 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-ec98db28-0edb-415e-b520-a24dde2d375b req-46ba91c2-ce8a-45f7-8ddd-562592e8a41c service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:56:07.631708 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-ec98db28-0edb-415e-b520-a24dde2d375b req-46ba91c2-ce8a-45f7-8ddd-562592e8a41c service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:56:07.662239 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.compute.server_external_events [req-ec98db28-0edb-415e-b520-a24dde2d375b req-46ba91c2-ce8a-45f7-8ddd-562592e8a41c service nova] Creating event network-vif-plugged:c4ddeb24-17b7-43ce-b1c2-3516523d5956 for instance 8937f92d-1764-4316-86cc-939bc9dc34b4 on n-h2-852296-2 Aug 10 17:56:07.675965 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [req-ec98db28-0edb-415e-b520-a24dde2d375b req-46ba91c2-ce8a-45f7-8ddd-562592e8a41c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079283 Aug 10 17:56:07.680407 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 758/1501] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 10 17:56:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:56:07.725718 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-6a99452b-0deb-4e17-af30-1f9fec010dbd tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Calling method '.version_select at 0x7fb345b444c0>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:56:07.749260 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-74716762-c0df-4d6a-b49c-d4d1110a18d2 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:56:07.753537 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-74716762-c0df-4d6a-b49c-d4d1110a18d2 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] [instance: dd4d671c-5a1f-463d-8bec-cd4f7614479f] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:56:07.791171 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-74716762-c0df-4d6a-b49c-d4d1110a18d2 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:56:07.792529 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-74716762-c0df-4d6a-b49c-d4d1110a18d2 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:56:07.793166 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-74716762-c0df-4d6a-b49c-d4d1110a18d2 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:56:07.794057 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-74716762-c0df-4d6a-b49c-d4d1110a18d2 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:56:07.794703 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-74716762-c0df-4d6a-b49c-d4d1110a18d2 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:56:07.795295 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-74716762-c0df-4d6a-b49c-d4d1110a18d2 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:56:07.885002 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-6a99452b-0deb-4e17-af30-1f9fec010dbd tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] 10.222.0.50 "GET /compute/v2.1/images/6fddc991-ae6e-4ca4-aa51-90c2f71d1f0d" status: 200 len: 1427 microversion: 2.1 time: 0.170677 Aug 10 17:56:07.890571 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 744/1502] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:56:07 2022] GET /compute/v2.1/images/6fddc991-ae6e-4ca4-aa51-90c2f71d1f0d => generated 1427 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:56:08.902864 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-74716762-c0df-4d6a-b49c-d4d1110a18d2 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce45e1a545b4d3b8fa2cb4b2af3f306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0285f1570fe2419c930c80d3a0711858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:56:08.904601 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-acab701c-b401-44fe-98b9-5b7e48a2c738 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Calling method '.version_select at 0x7fb345abc550>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:56:08.924217 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-74716762-c0df-4d6a-b49c-d4d1110a18d2 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/servers/dd4d671c-5a1f-463d-8bec-cd4f7614479f" status: 200 len: 1467 microversion: 2.1 time: 1.186910 Aug 10 17:56:08.925215 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 759/1503] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:56:07 2022] GET /compute/v2.1/servers/dd4d671c-5a1f-463d-8bec-cd4f7614479f => generated 1467 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:56:08.949185 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-2d88aa14-f4bc-423a-9406-32b80dcd4a99 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:56:08.958569 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-2d88aa14-f4bc-423a-9406-32b80dcd4a99 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] [instance: 8937f92d-1764-4316-86cc-939bc9dc34b4] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:56:08.968642 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-acab701c-b401-44fe-98b9-5b7e48a2c738 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] 10.222.0.50 "GET /compute/v2.1/images/6fddc991-ae6e-4ca4-aa51-90c2f71d1f0d" status: 200 len: 1427 microversion: 2.1 time: 0.071080 Aug 10 17:56:08.968835 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-2d88aa14-f4bc-423a-9406-32b80dcd4a99 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:56:08.969236 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-2d88aa14-f4bc-423a-9406-32b80dcd4a99 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:56:08.969662 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-2d88aa14-f4bc-423a-9406-32b80dcd4a99 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:56:08.975107 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-2d88aa14-f4bc-423a-9406-32b80dcd4a99 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:56:08.975723 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-2d88aa14-f4bc-423a-9406-32b80dcd4a99 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:56:08.979359 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-2d88aa14-f4bc-423a-9406-32b80dcd4a99 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:56:08.983828 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 745/1504] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:56:08 2022] GET /compute/v2.1/images/6fddc991-ae6e-4ca4-aa51-90c2f71d1f0d => generated 1427 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:56:09.566393 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-2d88aa14-f4bc-423a-9406-32b80dcd4a99 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce45e1a545b4d3b8fa2cb4b2af3f306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0285f1570fe2419c930c80d3a0711858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:56:09.574516 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:56:09.603443 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-2d88aa14-f4bc-423a-9406-32b80dcd4a99 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/servers/8937f92d-1764-4316-86cc-939bc9dc34b4" status: 200 len: 1318 microversion: 2.1 time: 0.657412 Aug 10 17:56:09.617526 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 760/1505] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:56:08 2022] GET /compute/v2.1/servers/8937f92d-1764-4316-86cc-939bc9dc34b4 => generated 1318 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:56:09.992507 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-0da4341a-cf1c-4b81-9318-0b09dea6d662 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Calling method '.version_select at 0x7fb345b44040>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:56:10.089396 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-0da4341a-cf1c-4b81-9318-0b09dea6d662 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] 10.222.0.50 "GET /compute/v2.1/images/6fddc991-ae6e-4ca4-aa51-90c2f71d1f0d" status: 200 len: 1427 microversion: 2.1 time: 0.099987 Aug 10 17:56:10.110993 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 746/1506] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:56:09 2022] GET /compute/v2.1/images/6fddc991-ae6e-4ca4-aa51-90c2f71d1f0d => generated 1427 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:56:10.625644 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-21c9a1e1-1849-47df-8cd0-631b728209bf tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:56:10.626564 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-21c9a1e1-1849-47df-8cd0-631b728209bf tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] [instance: 8937f92d-1764-4316-86cc-939bc9dc34b4] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:56:10.641907 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-21c9a1e1-1849-47df-8cd0-631b728209bf tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:56:10.644469 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-21c9a1e1-1849-47df-8cd0-631b728209bf tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:56:10.646497 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-21c9a1e1-1849-47df-8cd0-631b728209bf tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:56:10.649563 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-21c9a1e1-1849-47df-8cd0-631b728209bf tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:56:10.651648 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-21c9a1e1-1849-47df-8cd0-631b728209bf tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:56:10.652530 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-21c9a1e1-1849-47df-8cd0-631b728209bf tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:56:11.125245 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-1e178788-f0cb-4eeb-ad03-9ddac79b339c tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Calling method '.version_select at 0x7fb345cfa9d0>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:56:11.259393 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-1e178788-f0cb-4eeb-ad03-9ddac79b339c tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] 10.222.0.50 "GET /compute/v2.1/images/6fddc991-ae6e-4ca4-aa51-90c2f71d1f0d" status: 200 len: 1427 microversion: 2.1 time: 0.140836 Aug 10 17:56:11.260462 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 747/1507] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:56:11 2022] GET /compute/v2.1/images/6fddc991-ae6e-4ca4-aa51-90c2f71d1f0d => generated 1427 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:56:11.483249 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-21c9a1e1-1849-47df-8cd0-631b728209bf tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce45e1a545b4d3b8fa2cb4b2af3f306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0285f1570fe2419c930c80d3a0711858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:56:11.497502 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-21c9a1e1-1849-47df-8cd0-631b728209bf tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/servers/8937f92d-1764-4316-86cc-939bc9dc34b4" status: 200 len: 1467 microversion: 2.1 time: 0.874968 Aug 10 17:56:11.498921 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 761/1508] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:56:10 2022] GET /compute/v2.1/servers/8937f92d-1764-4316-86cc-939bc9dc34b4 => generated 1467 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:56:11.524488 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-8b843357-ca6d-4642-aa7b-85dac0d2fcba tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-2074588505"}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:56:11.533269 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-8b843357-ca6d-4642-aa7b-85dac0d2fcba tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] [instance: 8937f92d-1764-4316-86cc-939bc9dc34b4] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:56:11.545841 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-8b843357-ca6d-4642-aa7b-85dac0d2fcba tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:56:11.546341 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-8b843357-ca6d-4642-aa7b-85dac0d2fcba tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:56:11.558522 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-8b843357-ca6d-4642-aa7b-85dac0d2fcba tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:56:11.560135 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-8b843357-ca6d-4642-aa7b-85dac0d2fcba tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:56:11.567340 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-8b843357-ca6d-4642-aa7b-85dac0d2fcba tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:56:11.572513 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-8b843357-ca6d-4642-aa7b-85dac0d2fcba tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:56:12.276831 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-045a09f4-0ab8-4734-bf3a-0d9105083e4e tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Calling method '.version_select at 0x7fb346015a60>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:56:12.344995 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-8b843357-ca6d-4642-aa7b-85dac0d2fcba tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "POST /compute/v2.1/servers/8937f92d-1764-4316-86cc-939bc9dc34b4/action" status: 202 len: 0 microversion: 2.1 time: 0.825072 Aug 10 17:56:12.370102 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 748/1509] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 10 17:56:11 2022] POST /compute/v2.1/servers/8937f92d-1764-4316-86cc-939bc9dc34b4/action => generated 0 bytes in 851 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 10 17:56:12.405212 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-3c719947-64c4-47f9-aa59-24742bbe5f3a tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '.version_select at 0x7fb345b5f820>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:56:12.413749 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-045a09f4-0ab8-4734-bf3a-0d9105083e4e tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] 10.222.0.50 "GET /compute/v2.1/images/6fddc991-ae6e-4ca4-aa51-90c2f71d1f0d" status: 200 len: 1427 microversion: 2.1 time: 0.139811 Aug 10 17:56:12.415601 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 762/1510] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:56:12 2022] GET /compute/v2.1/images/6fddc991-ae6e-4ca4-aa51-90c2f71d1f0d => generated 1427 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:56:12.511733 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-3c719947-64c4-47f9-aa59-24742bbe5f3a tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/images/8dfbef1d-2e17-4e08-b909-b8e888a31709" status: 200 len: 1455 microversion: 2.1 time: 0.136807 Aug 10 17:56:12.525399 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 749/1511] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:56:12 2022] GET /compute/v2.1/images/8dfbef1d-2e17-4e08-b909-b8e888a31709 => generated 1455 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:56:13.443555 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-31876f79-504e-4dc4-8853-dd5fb19519b5 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Calling method '.version_select at 0x7fb345ebaf70>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:56:13.540069 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-08580801-c899-4568-86e9-0e82422fc604 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '.version_select at 0x7fb345a42940>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:56:13.551582 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-31876f79-504e-4dc4-8853-dd5fb19519b5 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] 10.222.0.50 "GET /compute/v2.1/images/6fddc991-ae6e-4ca4-aa51-90c2f71d1f0d" status: 200 len: 1427 microversion: 2.1 time: 0.124532 Aug 10 17:56:13.554870 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 763/1512] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:56:13 2022] GET /compute/v2.1/images/6fddc991-ae6e-4ca4-aa51-90c2f71d1f0d => generated 1427 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:56:13.631204 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-08580801-c899-4568-86e9-0e82422fc604 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/images/8dfbef1d-2e17-4e08-b909-b8e888a31709" status: 200 len: 1455 microversion: 2.1 time: 0.094992 Aug 10 17:56:13.632240 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 750/1513] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:56:13 2022] GET /compute/v2.1/images/8dfbef1d-2e17-4e08-b909-b8e888a31709 => generated 1455 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:56:14.567582 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-f9ead872-99e7-475f-9edd-4beff43856c3 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Calling method '.version_select at 0x7fb345ebe040>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:56:14.654404 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-40e203a3-c525-4b0c-9682-e6ce5d4f7232 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '.version_select at 0x7fb345a421f0>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:56:14.661279 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-f9ead872-99e7-475f-9edd-4beff43856c3 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] 10.222.0.50 "GET /compute/v2.1/images/6fddc991-ae6e-4ca4-aa51-90c2f71d1f0d" status: 200 len: 1427 microversion: 2.1 time: 0.097940 Aug 10 17:56:14.669364 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 764/1514] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:56:14 2022] GET /compute/v2.1/images/6fddc991-ae6e-4ca4-aa51-90c2f71d1f0d => generated 1427 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:56:14.752837 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-40e203a3-c525-4b0c-9682-e6ce5d4f7232 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/images/8dfbef1d-2e17-4e08-b909-b8e888a31709" status: 200 len: 1455 microversion: 2.1 time: 0.110342 Aug 10 17:56:14.754052 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 751/1515] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:56:14 2022] GET /compute/v2.1/images/8dfbef1d-2e17-4e08-b909-b8e888a31709 => generated 1455 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:56:15.525652 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-f9ead872-99e7-475f-9edd-4beff43856c3 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:56:15.526726 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-f9ead872-99e7-475f-9edd-4beff43856c3 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] 10.222.0.50 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001399 Aug 10 17:56:15.527078 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 765/1516] 10.222.0.50 () {56 vars in 886 bytes} [Wed Aug 10 17:56:15 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 10 17:56:15.678844 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-698f6a4d-1171-491d-b957-c23e506461d1 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Calling method '.version_select at 0x7fb3459d60d0>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:56:15.759689 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-698f6a4d-1171-491d-b957-c23e506461d1 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] 10.222.0.50 "GET /compute/v2.1/images/6fddc991-ae6e-4ca4-aa51-90c2f71d1f0d" status: 200 len: 1427 microversion: 2.1 time: 0.087008 Aug 10 17:56:15.767572 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 752/1517] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:56:15 2022] GET /compute/v2.1/images/6fddc991-ae6e-4ca4-aa51-90c2f71d1f0d => generated 1427 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:56:15.769007 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-e941e04d-ba10-47dd-8ded-865b3addc740 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '.version_select at 0x7fb345eba790>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:56:15.872261 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-e941e04d-ba10-47dd-8ded-865b3addc740 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/images/8dfbef1d-2e17-4e08-b909-b8e888a31709" status: 200 len: 1455 microversion: 2.1 time: 0.107247 Aug 10 17:56:15.880090 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 766/1518] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:56:15 2022] GET /compute/v2.1/images/8dfbef1d-2e17-4e08-b909-b8e888a31709 => generated 1455 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:56:16.775968 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-713b254f-74d9-498e-93e9-59efede9acfa tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Calling method '.version_select at 0x7fb345b44790>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:56:16.887144 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-8d234313-1f70-4edd-b690-8c70b3a0f5f1 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '.version_select at 0x7fb345e673a0>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:56:20.634482 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_api:SELECT=11 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:56:21.545709 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_api:SELECT=14,nova_api:DELETE=1 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:56:22.236454 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:56:22.309810 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_cell1:SELECT=7 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:56:27.205594 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-713b254f-74d9-498e-93e9-59efede9acfa tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] 10.222.0.50 "GET /compute/v2.1/images/6fddc991-ae6e-4ca4-aa51-90c2f71d1f0d" status: 200 len: 1427 microversion: 2.1 time: 10.434322 Aug 10 17:56:27.206184 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 753/1519] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:56:16 2022] GET /compute/v2.1/images/6fddc991-ae6e-4ca4-aa51-90c2f71d1f0d => generated 1427 bytes in 10436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:56:27.221894 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [req-546e608a-5d73-4e90-8055-f8747ec84239 req-42e70053-2449-45d5-9a43-b66510acbbe2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8937f92d-1764-4316-86cc-939bc9dc34b4", "name": "network-vif-plugged", "status": "completed", "tag": "c4ddeb24-17b7-43ce-b1c2-3516523d5956"}]} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:56:27.259885 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-546e608a-5d73-4e90-8055-f8747ec84239 req-42e70053-2449-45d5-9a43-b66510acbbe2 service nova] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:56:27.262851 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-546e608a-5d73-4e90-8055-f8747ec84239 req-42e70053-2449-45d5-9a43-b66510acbbe2 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:56:27.263341 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-546e608a-5d73-4e90-8055-f8747ec84239 req-42e70053-2449-45d5-9a43-b66510acbbe2 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:56:27.304421 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.compute.server_external_events [req-546e608a-5d73-4e90-8055-f8747ec84239 req-42e70053-2449-45d5-9a43-b66510acbbe2 service nova] Creating event network-vif-plugged:c4ddeb24-17b7-43ce-b1c2-3516523d5956 for instance 8937f92d-1764-4316-86cc-939bc9dc34b4 on n-h2-852296-2 Aug 10 17:56:27.328846 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-8d234313-1f70-4edd-b690-8c70b3a0f5f1 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/images/8dfbef1d-2e17-4e08-b909-b8e888a31709" status: 200 len: 1455 microversion: 2.1 time: 10.445647 Aug 10 17:56:27.406957 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 767/1520] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:56:16 2022] GET /compute/v2.1/images/8dfbef1d-2e17-4e08-b909-b8e888a31709 => generated 1455 bytes in 10456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:56:27.407720 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [req-546e608a-5d73-4e90-8055-f8747ec84239 req-42e70053-2449-45d5-9a43-b66510acbbe2 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146160 Aug 10 17:56:27.407720 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 754/1521] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 10 17:56:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:56:28.226922 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-1deb064e-2176-40a3-bc3f-6ac79933318e tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Calling method '.version_select at 0x7fb345ebeee0>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:56:28.337489 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-1deb064e-2176-40a3-bc3f-6ac79933318e tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] 10.222.0.50 "GET /compute/v2.1/images/6fddc991-ae6e-4ca4-aa51-90c2f71d1f0d" status: 200 len: 1436 microversion: 2.1 time: 0.120792 Aug 10 17:56:28.349814 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 768/1522] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:56:28 2022] GET /compute/v2.1/images/6fddc991-ae6e-4ca4-aa51-90c2f71d1f0d => generated 1436 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:56:28.356439 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-b338a0c6-152b-4757-b60c-c16b853aef04 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '.version_select at 0x7fb345abcca0>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:56:28.363660 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-2716859b-1065-4fd1-8681-904d47e85c72 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Calling method '.version_select at 0x7fb345e25b80>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:56:28.496451 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-b338a0c6-152b-4757-b60c-c16b853aef04 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/images/8dfbef1d-2e17-4e08-b909-b8e888a31709" status: 200 len: 1455 microversion: 2.1 time: 0.145948 Aug 10 17:56:28.503499 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 755/1523] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:56:28 2022] GET /compute/v2.1/images/8dfbef1d-2e17-4e08-b909-b8e888a31709 => generated 1455 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:56:28.505836 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-2716859b-1065-4fd1-8681-904d47e85c72 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] 10.222.0.50 "GET /compute/v2.1/images/6fddc991-ae6e-4ca4-aa51-90c2f71d1f0d" status: 200 len: 1436 microversion: 2.1 time: 0.154152 Aug 10 17:56:28.506620 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 769/1524] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:56:28 2022] GET /compute/v2.1/images/6fddc991-ae6e-4ca4-aa51-90c2f71d1f0d => generated 1436 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:56:28.521045 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-bc3e976b-aa94-4b05-a668-58f43d458457 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:56:28.529754 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-bc3e976b-aa94-4b05-a668-58f43d458457 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] [instance: 5b41d7b5-e888-47ec-a57e-5b474e76ef45] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:56:28.540715 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-bc3e976b-aa94-4b05-a668-58f43d458457 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:56:28.545953 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-bc3e976b-aa94-4b05-a668-58f43d458457 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:56:28.547342 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-bc3e976b-aa94-4b05-a668-58f43d458457 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:56:28.552735 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-bc3e976b-aa94-4b05-a668-58f43d458457 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:56:28.553552 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-bc3e976b-aa94-4b05-a668-58f43d458457 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:56:28.554171 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-bc3e976b-aa94-4b05-a668-58f43d458457 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:56:29.513727 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-a3625c13-b301-43a8-87fa-3331997db6c1 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '.version_select at 0x7fb345e67430>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:56:29.575489 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-a3625c13-b301-43a8-87fa-3331997db6c1 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/images/8dfbef1d-2e17-4e08-b909-b8e888a31709" status: 200 len: 1455 microversion: 2.1 time: 0.065421 Aug 10 17:56:29.576199 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 770/1525] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:56:29 2022] GET /compute/v2.1/images/8dfbef1d-2e17-4e08-b909-b8e888a31709 => generated 1455 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:56:29.787876 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-bc3e976b-aa94-4b05-a668-58f43d458457 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36de414913b4223aba37ecb0f74e467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea1bedbf4fa421198a38dbfad95db72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:56:29.796161 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-bc3e976b-aa94-4b05-a668-58f43d458457 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] 10.222.0.50 "GET /compute/v2.1/servers/5b41d7b5-e888-47ec-a57e-5b474e76ef45" status: 200 len: 1467 microversion: 2.1 time: 1.279744 Aug 10 17:56:29.798149 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 756/1526] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:56:28 2022] GET /compute/v2.1/servers/5b41d7b5-e888-47ec-a57e-5b474e76ef45 => generated 1467 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:56:29.838880 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-c6c77e4a-9780-4097-bbaa-5c377a3a5713 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Calling method '.version_select at 0x7fb345eba160>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:56:30.591419 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-1d5c7940-f306-428d-ac23-8476dd21fa03 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '.version_select at 0x7fb345abc550>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:56:32.645669 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-c6c77e4a-9780-4097-bbaa-5c377a3a5713 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] 10.222.0.50 "DELETE /compute/v2.1/images/6fddc991-ae6e-4ca4-aa51-90c2f71d1f0d" status: 204 len: 0 microversion: 2.1 time: 2.813408 Aug 10 17:56:32.646551 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 771/1527] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:56:29 2022] DELETE /compute/v2.1/images/6fddc991-ae6e-4ca4-aa51-90c2f71d1f0d => generated 0 bytes in 2815 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 17:56:32.730308 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-1d5c7940-f306-428d-ac23-8476dd21fa03 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/images/8dfbef1d-2e17-4e08-b909-b8e888a31709" status: 200 len: 1455 microversion: 2.1 time: 2.142606 Aug 10 17:56:32.733409 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 757/1528] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:56:30 2022] GET /compute/v2.1/images/8dfbef1d-2e17-4e08-b909-b8e888a31709 => generated 1455 bytes in 2144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:56:32.739030 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-26da2f26-7a51-432d-a728-0743024883ed tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Calling method '.version_select at 0x7fb345a3ee50>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:56:32.785573 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-26da2f26-7a51-432d-a728-0743024883ed tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] HTTP exception thrown: Image not found. Aug 10 17:56:32.789044 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-26da2f26-7a51-432d-a728-0743024883ed tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Request method failure captured: Aug 10 17:56:32.789044 n-d-852296-2 devstack@n-api.service[129410]: request: DELETE /compute/v2.1/images/baf689aa-d2ab-491b-8055-a8e57b8f8962 HTTP/1.1 Aug 10 17:56:32.789044 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 17:56:32.789044 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 17:56:32.789044 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 17:56:32.789044 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 0 Aug 10 17:56:32.789044 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 17:56:32.789044 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 17:56:32.789044 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 17:56:32.789044 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 17:56:32.789044 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8_DeGkWKrhzv1YghAlAi5icCM62xJGTSdLjrSL8nbEdQU1PuRRnSnbvGJA1wjtHeY7_t4iSOmrFvkPkJxdOPDvZyHHA6DNDPwqbAq_AE2UhTYrp9oeBcNoxv0aPvLSleWwqnJHs51x_B-DT5ee6fDkeykN7mud9mtOqwlBLEf6yQEk0 Aug 10 17:56:32.789044 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 17:56:32.789044 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 17:56:32.789044 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 17:56:32.789044 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 17:56:32.789044 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 17:56:32.789044 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 17:56:32.789044 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: 0ea1bedbf4fa421198a38dbfad95db72 Aug 10 17:56:32.789044 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-ImagesOneServerTestJSON-1673408554 Aug 10 17:56:32.789044 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 17:56:32.789044 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 17:56:32.789044 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0ea1bedbf4fa421198a38dbfad95db72"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/0ea1bedbf4fa421198a38dbfad95db72"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0ea1bedbf4fa421198a38dbfad95db72"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_0ea1bedbf4fa421198a38dbfad95db72", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:56:32.789044 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-ImagesOneServerTestJSON-1673408554 Aug 10 17:56:32.789044 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: 0ea1bedbf4fa421198a38dbfad95db72 Aug 10 17:56:32.789044 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1673408554 Aug 10 17:56:32.789044 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-ImagesOneServerTestJSON-1673408554-project Aug 10 17:56:32.789044 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 17:56:32.789044 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 17:56:32.789044 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: a36de414913b4223aba37ecb0f74e467 Aug 10 17:56:32.789044 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-ImagesOneServerTestJSON-1673408554-project Aug 10 17:56:32.789044 n-d-852296-2 devstack@n-api.service[129410]: method: Aug 10 17:56:32.789044 n-d-852296-2 devstack@n-api.service[129410]: exception: Image not found. Aug 10 17:56:32.789044 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'id': 'baf689aa-d2ab-491b-8055-a8e57b8f8962'} Aug 10 17:56:32.789044 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:56:32.789044 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:56:32.789044 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 10 17:56:32.789044 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 10 17:56:32.789044 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 10 17:56:32.789044 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 10 17:56:32.789044 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 10 17:56:32.789044 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 10 17:56:32.789044 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 10 17:56:32.789044 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 10 17:56:32.789044 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 10 17:56:32.789044 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 10 17:56:32.789044 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 10 17:56:32.789044 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 10 17:56:32.789044 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 10 17:56:32.789044 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 10 17:56:32.789044 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image baf689aa-d2ab-491b-8055-a8e57b8f8962 to delete Aug 10 17:56:32.789044 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:56:32.789044 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:56:32.789044 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:56:32.789044 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:56:32.789044 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 10 17:56:32.789044 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 10 17:56:32.789044 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 10 17:56:32.789044 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 10 17:56:32.789044 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 10 17:56:32.789044 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 10 17:56:32.789044 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image baf689aa-d2ab-491b-8055-a8e57b8f8962 could not be found. Aug 10 17:56:32.789044 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:56:32.789044 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:56:32.789044 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:56:32.789044 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:56:32.792958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:56:32.792958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:56:32.792958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:56:32.792958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:56:32.792958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 17:56:32.792958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 17:56:32.792958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:56:32.792958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:56:32.792958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 10 17:56:32.792958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 10 17:56:32.792958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 10 17:56:32.792958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:56:32.792958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:56:32.792958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:56:32.792958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:56:32.792958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:56:32.792958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:56:32.792958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:56:32.792958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:56:32.792958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 10 17:56:32.792958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:56:32.800609 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-26da2f26-7a51-432d-a728-0743024883ed tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Returning 404 to user: Image not found. {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:56:32.805800 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-26da2f26-7a51-432d-a728-0743024883ed tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] 10.222.0.50 "DELETE /compute/v2.1/images/baf689aa-d2ab-491b-8055-a8e57b8f8962" status: 404 len: 62 microversion: 2.1 time: 0.071326 Aug 10 17:56:32.813421 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 758/1529] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:56:32 2022] DELETE /compute/v2.1/images/baf689aa-d2ab-491b-8055-a8e57b8f8962 => generated 62 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 10 17:56:32.830093 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-1bcc5caf-538b-459d-ae95-83191908d36b tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:56:32.832475 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-1bcc5caf-538b-459d-ae95-83191908d36b tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] [instance: 5b41d7b5-e888-47ec-a57e-5b474e76ef45] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:56:32.853647 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-1bcc5caf-538b-459d-ae95-83191908d36b tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:56:32.857091 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-1bcc5caf-538b-459d-ae95-83191908d36b tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:56:32.861129 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-1bcc5caf-538b-459d-ae95-83191908d36b tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:56:32.862758 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-1bcc5caf-538b-459d-ae95-83191908d36b tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:56:32.871156 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-1bcc5caf-538b-459d-ae95-83191908d36b tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:56:32.872761 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-1bcc5caf-538b-459d-ae95-83191908d36b tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:56:32.938841 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-1bcc5caf-538b-459d-ae95-83191908d36b tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] [instance: 5b41d7b5-e888-47ec-a57e-5b474e76ef45] Going to try to terminate instance {{(pid=129410) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 17:56:32.989920 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-0784df14-827d-409b-87e1-4992941ff1f7 tempest-ListServersNegativeTestJSON-332327672 tempest-ListServersNegativeTestJSON-332327672-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-1605068469", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "3e9d96f0-96ae-4ce6-a4e9-b12593e60613"}]}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:56:33.140296 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.network.neutron [None req-0784df14-827d-409b-87e1-4992941ff1f7 tempest-ListServersNegativeTestJSON-332327672 tempest-ListServersNegativeTestJSON-332327672-project] validate_networks() for [('3e9d96f0-96ae-4ce6-a4e9-b12593e60613', None, None, None, None, None)] {{(pid=129409) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 17:56:33.805736 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-1bcc5caf-538b-459d-ae95-83191908d36b tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] 10.222.0.50 "DELETE /compute/v2.1/servers/5b41d7b5-e888-47ec-a57e-5b474e76ef45" status: 204 len: 0 microversion: 2.1 time: 0.990494 Aug 10 17:56:33.806952 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 759/1530] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 10 17:56:32 2022] DELETE /compute/v2.1/servers/5b41d7b5-e888-47ec-a57e-5b474e76ef45 => generated 0 bytes in 993 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 17:56:33.814937 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [req-30033246-b441-40d4-b952-637cc13e279a req-40f71384-12ad-4940-bab6-1b71ded3e509 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b41d7b5-e888-47ec-a57e-5b474e76ef45", "name": "network-vif-unplugged", "status": "completed", "tag": "8aff8e43-12e5-4e3e-bb1f-efb7af31ddbe"}]} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:56:33.841130 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-30033246-b441-40d4-b952-637cc13e279a req-40f71384-12ad-4940-bab6-1b71ded3e509 service nova] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:56:33.841738 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-30033246-b441-40d4-b952-637cc13e279a req-40f71384-12ad-4940-bab6-1b71ded3e509 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:56:33.842255 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-30033246-b441-40d4-b952-637cc13e279a req-40f71384-12ad-4940-bab6-1b71ded3e509 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:56:33.872088 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.compute.server_external_events [req-30033246-b441-40d4-b952-637cc13e279a req-40f71384-12ad-4940-bab6-1b71ded3e509 service nova] Creating event network-vif-unplugged:8aff8e43-12e5-4e3e-bb1f-efb7af31ddbe for instance 5b41d7b5-e888-47ec-a57e-5b474e76ef45 on n-h1-852296-2 Aug 10 17:56:33.901837 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [req-30033246-b441-40d4-b952-637cc13e279a req-40f71384-12ad-4940-bab6-1b71ded3e509 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.093146 Aug 10 17:56:33.905849 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 760/1531] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 10 17:56:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:56:33.962329 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-d838f4e4-87a4-40c4-bf3c-c20f5a8191b5 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '.version_select at 0x7fb345abc8b0>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:56:34.047989 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [None req-0784df14-827d-409b-87e1-4992941ff1f7 tempest-ListServersNegativeTestJSON-332327672 tempest-ListServersNegativeTestJSON-332327672-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-37883b68-fb5d-497b-84ef-381d74dff3a4) Aug 10 17:56:34.047989 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:56:34.047989 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:56:34.047989 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:56:34.047989 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:56:34.047989 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:56:34.047989 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:56:34.047989 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:56:34.047989 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:56:34.047989 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:56:34.047989 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 17:56:34.047989 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 17:56:34.047989 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 17:56:34.047989 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 17:56:34.047989 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 17:56:34.047989 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 17:56:34.047989 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 17:56:34.047989 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 17:56:34.047989 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 17:56:34.047989 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 17:56:34.047989 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 17:56:34.047989 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 17:56:34.047989 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 17:56:34.047989 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 17:56:34.047989 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 17:56:34.047989 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 17:56:34.047989 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 17:56:34.047989 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:56:34.047989 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:56:34.047989 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 17:56:34.047989 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 17:56:34.047989 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:56:34.047989 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:56:34.047989 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:56:34.047989 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:56:34.047989 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:56:34.047989 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:56:34.047989 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:56:34.047989 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:56:34.047989 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:56:34.047989 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:56:34.047989 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 17:56:34.047989 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 17:56:34.047989 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 17:56:34.047989 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 17:56:34.047989 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 17:56:34.047989 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 17:56:34.047989 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 17:56:34.047989 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 17:56:34.047989 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 17:56:34.047989 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 17:56:34.047989 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 17:56:34.051499 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 17:56:34.051499 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 17:56:34.051499 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 17:56:34.051499 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 17:56:34.051499 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 17:56:34.051499 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 17:56:34.051499 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 17:56:34.051499 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 17:56:34.051499 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 17:56:34.051499 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 17:56:34.051499 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 17:56:34.051499 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 17:56:34.051499 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 17:56:34.051499 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 17:56:34.051499 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 17:56:34.051499 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-37883b68-fb5d-497b-84ef-381d74dff3a4) Aug 10 17:56:34.051499 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:56:34.051499 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-0784df14-827d-409b-87e1-4992941ff1f7 tempest-ListServersNegativeTestJSON-332327672 tempest-ListServersNegativeTestJSON-332327672-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:56:34.051499 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:56:34.051499 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-0784df14-827d-409b-87e1-4992941ff1f7 tempest-ListServersNegativeTestJSON-332327672 tempest-ListServersNegativeTestJSON-332327672-project] Request method failure captured: Aug 10 17:56:34.051499 n-d-852296-2 devstack@n-api.service[129409]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 17:56:34.051499 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 17:56:34.051499 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 17:56:34.051499 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 17:56:34.051499 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 229 Aug 10 17:56:34.051499 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 17:56:34.051499 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 17:56:34.051499 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 17:56:34.051499 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 17:56:34.051499 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8_FOPDoUl_XsidEEMZEEoSdNRz4PByMkUOAetja-jrePO4cQAMmmuRX789GBPgwxmMAM_eZ-AMVr9VJMUVUprgVgB3DNGeQD2X6SIpwboJB0_uyZanqOhOTqOKtoL4PIPXtkqwmDeK_-bShNzg7ro9ciopqF_LxMul-jSkNjAro1AK0 Aug 10 17:56:34.051499 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 17:56:34.051499 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 17:56:34.051499 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 17:56:34.051499 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 17:56:34.051499 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 17:56:34.051499 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 17:56:34.051499 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: d2a0b2318bd14504926b592632f06b0c Aug 10 17:56:34.051499 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-ListServersNegativeTestJSON-332327672 Aug 10 17:56:34.051499 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 17:56:34.051499 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 17:56:34.051499 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d2a0b2318bd14504926b592632f06b0c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d2a0b2318bd14504926b592632f06b0c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d2a0b2318bd14504926b592632f06b0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d2a0b2318bd14504926b592632f06b0c", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:56:34.051499 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-ListServersNegativeTestJSON-332327672 Aug 10 17:56:34.051499 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: d2a0b2318bd14504926b592632f06b0c Aug 10 17:56:34.051499 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-332327672 Aug 10 17:56:34.051499 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-ListServersNegativeTestJSON-332327672-project Aug 10 17:56:34.051499 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 17:56:34.051499 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 17:56:34.051499 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: d8b5b1e308994178b856a127082892a9 Aug 10 17:56:34.051499 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-ListServersNegativeTestJSON-332327672-project Aug 10 17:56:34.051499 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:56:34.051499 n-d-852296-2 devstack@n-api.service[129409]: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-1605068469", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "3e9d96f0-96ae-4ce6-a4e9-b12593e60613"}]}} Aug 10 17:56:34.051499 n-d-852296-2 devstack@n-api.service[129409]: method: > Aug 10 17:56:34.051499 n-d-852296-2 devstack@n-api.service[129409]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:56:34.051499 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:56:34.054817 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'body': {'server': {'name': 'tempest-ListServersNegativeTestJSON-server-1605068469', 'imageRef': 'a735ff26-463a-4ffe-a981-ab9d9baa494f', 'flavorRef': '452', 'min_count': 3, 'networks': [{'uuid': '3e9d96f0-96ae-4ce6-a4e9-b12593e60613'}]}}} Aug 10 17:56:34.054817 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:56:34.054817 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:56:34.054817 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:56:34.054817 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:56:34.054817 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:56:34.054817 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:56:34.054817 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:56:34.054817 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:56:34.054817 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:56:34.054817 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:56:34.054817 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 17:56:34.054817 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 17:56:34.054817 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 17:56:34.054817 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 17:56:34.054817 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 17:56:34.054817 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 17:56:34.054817 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 17:56:34.054817 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 17:56:34.054817 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 17:56:34.054817 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 17:56:34.054817 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 17:56:34.054817 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 17:56:34.054817 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 17:56:34.054817 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 17:56:34.054817 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 17:56:34.054817 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 17:56:34.054817 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 17:56:34.054817 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:56:34.054817 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:56:34.054817 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 17:56:34.054817 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 17:56:34.054817 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:56:34.054817 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:56:34.054817 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:56:34.054817 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:56:34.054817 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:56:34.054817 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:56:34.054817 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:56:34.054817 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:56:34.054817 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:56:34.054817 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:56:34.054817 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 17:56:34.054817 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 17:56:34.054817 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 17:56:34.054817 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 17:56:34.054817 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 17:56:34.054817 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 17:56:34.054817 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 17:56:34.054817 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 17:56:34.054817 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 17:56:34.054817 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 17:56:34.054817 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 17:56:34.054817 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 17:56:34.054817 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 17:56:34.059551 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 17:56:34.059551 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 17:56:34.059551 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 17:56:34.059551 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 17:56:34.059551 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 17:56:34.059551 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 17:56:34.059551 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 17:56:34.059551 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 17:56:34.059551 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 17:56:34.059551 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 17:56:34.059551 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 17:56:34.059551 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 17:56:34.059551 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 17:56:34.059551 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-37883b68-fb5d-497b-84ef-381d74dff3a4) Aug 10 17:56:34.059551 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:56:34.059551 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:56:34.059551 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:56:34.059551 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:56:34.059551 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:56:34.059551 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:56:34.059551 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:56:34.059551 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:56:34.059551 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 10 17:56:34.059551 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 10 17:56:34.059551 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:56:34.059551 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:56:34.059551 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:56:34.059551 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:56:34.059551 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:56:34.059551 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:56:34.059551 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:56:34.059551 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:56:34.059551 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:56:34.059551 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:56:34.059551 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:56:34.059551 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:56:34.059551 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:56:34.059551 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-0784df14-827d-409b-87e1-4992941ff1f7 tempest-ListServersNegativeTestJSON-332327672 tempest-ListServersNegativeTestJSON-332327672-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:56:34.059551 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:56:34.059551 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-0784df14-827d-409b-87e1-4992941ff1f7 tempest-ListServersNegativeTestJSON-332327672 tempest-ListServersNegativeTestJSON-332327672-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.404650 Aug 10 17:56:34.059551 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 772/1532] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 17:56:32 2022] POST /compute/v2.1/servers => generated 214 bytes in 1406 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 10 17:56:34.083349 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-e116c213-02ea-48bc-9fba-55967d398754 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:56:34.084078 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-e116c213-02ea-48bc-9fba-55967d398754 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] [instance: 5b41d7b5-e888-47ec-a57e-5b474e76ef45] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:56:34.099428 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e116c213-02ea-48bc-9fba-55967d398754 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:56:34.099939 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e116c213-02ea-48bc-9fba-55967d398754 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:56:34.100414 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e116c213-02ea-48bc-9fba-55967d398754 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:56:34.109324 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e116c213-02ea-48bc-9fba-55967d398754 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:56:34.109819 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e116c213-02ea-48bc-9fba-55967d398754 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:56:34.110367 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e116c213-02ea-48bc-9fba-55967d398754 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:56:34.114904 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-d838f4e4-87a4-40c4-bf3c-c20f5a8191b5 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/images/8dfbef1d-2e17-4e08-b909-b8e888a31709" status: 200 len: 1455 microversion: 2.1 time: 0.207375 Aug 10 17:56:34.122310 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 761/1533] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:56:33 2022] GET /compute/v2.1/images/8dfbef1d-2e17-4e08-b909-b8e888a31709 => generated 1455 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:56:35.137088 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-c2f32c0a-139f-46fb-bfa7-1a49169e1e56 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '.version_select at 0x7fb3459d6f70>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:56:35.247925 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-c2f32c0a-139f-46fb-bfa7-1a49169e1e56 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/images/8dfbef1d-2e17-4e08-b909-b8e888a31709" status: 200 len: 1455 microversion: 2.1 time: 0.121737 Aug 10 17:56:35.251196 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 762/1534] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:56:35 2022] GET /compute/v2.1/images/8dfbef1d-2e17-4e08-b909-b8e888a31709 => generated 1455 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:56:35.782633 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-e116c213-02ea-48bc-9fba-55967d398754 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36de414913b4223aba37ecb0f74e467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea1bedbf4fa421198a38dbfad95db72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:56:35.795119 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-e116c213-02ea-48bc-9fba-55967d398754 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] 10.222.0.50 "GET /compute/v2.1/servers/5b41d7b5-e888-47ec-a57e-5b474e76ef45" status: 200 len: 1473 microversion: 2.1 time: 1.737146 Aug 10 17:56:35.805150 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-7620b3e5-faad-4c78-8f79-a7a60ec4d1b2 tempest-VolumesAdminNegativeTest-28848144 tempest-VolumesAdminNegativeTest-28848144-project] Action: 'create', calling method: .version_select at 0x7fb345abc8b0>, body: {"keypair": {"name": "tempest-keypair-1087527284", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMQkkAqNR9sdHod21coCj0CzANmLxLCjnVpUpHCGMcF6zHihS/0IX2ZUPLoSmkEVwHKwwQxDll4NmIaSGcrip4V2wV4q5KBA8pKW/jMDFLAqmSGIBlgBlFxpoiDiQKnt4w=="}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:56:35.806958 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 773/1535] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:56:34 2022] GET /compute/v2.1/servers/5b41d7b5-e888-47ec-a57e-5b474e76ef45 => generated 1473 bytes in 1751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:56:35.861781 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.quota [None req-7620b3e5-faad-4c78-8f79-a7a60ec4d1b2 tempest-VolumesAdminNegativeTest-28848144 tempest-VolumesAdminNegativeTest-28848144-project] Getting quotas for project dd83596896bc4e80a23e4d9b8a697fb1. Resources: {'key_pairs'} {{(pid=129410) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:56:35.884716 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.quota [None req-7620b3e5-faad-4c78-8f79-a7a60ec4d1b2 tempest-VolumesAdminNegativeTest-28848144 tempest-VolumesAdminNegativeTest-28848144-project] Getting quotas for user 3ebff9a58da54a6ebd14e7271d023ebd and project dd83596896bc4e80a23e4d9b8a697fb1. Resources: {'key_pairs'} {{(pid=129410) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:56:36.020284 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-7620b3e5-faad-4c78-8f79-a7a60ec4d1b2 tempest-VolumesAdminNegativeTest-28848144 tempest-VolumesAdminNegativeTest-28848144-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.664311 Aug 10 17:56:36.021751 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 763/1536] 10.222.0.50 () {60 vars in 1159 bytes} [Wed Aug 10 17:56:35 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:56:36.263029 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-51f16560-4669-44c3-b2e8-c6737f771676 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '.version_select at 0x7fb345ebaca0>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:56:36.378276 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-51f16560-4669-44c3-b2e8-c6737f771676 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/images/8dfbef1d-2e17-4e08-b909-b8e888a31709" status: 200 len: 1455 microversion: 2.1 time: 0.119104 Aug 10 17:56:36.388280 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 774/1537] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:56:36 2022] GET /compute/v2.1/images/8dfbef1d-2e17-4e08-b909-b8e888a31709 => generated 1455 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:56:36.827419 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-7c2f582f-51a9-4d06-8d7b-3c57881ed329 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:56:36.828168 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-7c2f582f-51a9-4d06-8d7b-3c57881ed329 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] [instance: 5b41d7b5-e888-47ec-a57e-5b474e76ef45] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:56:36.841721 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-7c2f582f-51a9-4d06-8d7b-3c57881ed329 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:56:36.850913 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-7c2f582f-51a9-4d06-8d7b-3c57881ed329 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:56:36.852924 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-7c2f582f-51a9-4d06-8d7b-3c57881ed329 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:56:36.853716 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-7c2f582f-51a9-4d06-8d7b-3c57881ed329 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:56:36.854163 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-7c2f582f-51a9-4d06-8d7b-3c57881ed329 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:56:36.854597 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-7c2f582f-51a9-4d06-8d7b-3c57881ed329 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:56:37.398851 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-c801ecb8-abbf-4a1c-9e88-503ce87ee39a tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '.version_select at 0x7fb345ebeca0>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:56:37.502059 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-c801ecb8-abbf-4a1c-9e88-503ce87ee39a tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/images/8dfbef1d-2e17-4e08-b909-b8e888a31709" status: 200 len: 1455 microversion: 2.1 time: 0.107698 Aug 10 17:56:37.510974 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 775/1538] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:56:37 2022] GET /compute/v2.1/images/8dfbef1d-2e17-4e08-b909-b8e888a31709 => generated 1455 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:56:37.740615 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-7c2f582f-51a9-4d06-8d7b-3c57881ed329 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36de414913b4223aba37ecb0f74e467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea1bedbf4fa421198a38dbfad95db72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:56:37.758256 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-7c2f582f-51a9-4d06-8d7b-3c57881ed329 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] 10.222.0.50 "GET /compute/v2.1/servers/5b41d7b5-e888-47ec-a57e-5b474e76ef45" status: 200 len: 1473 microversion: 2.1 time: 0.927964 Aug 10 17:56:37.759362 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 764/1539] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:56:36 2022] GET /compute/v2.1/servers/5b41d7b5-e888-47ec-a57e-5b474e76ef45 => generated 1473 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:56:38.525247 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-8dfbf30e-ffa9-4c90-9846-3d2b1bd4b287 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '.version_select at 0x7fb345e67dc0>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:56:38.715997 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-8dfbf30e-ffa9-4c90-9846-3d2b1bd4b287 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/images/8dfbef1d-2e17-4e08-b909-b8e888a31709" status: 200 len: 1455 microversion: 2.1 time: 0.194530 Aug 10 17:56:38.724630 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 776/1540] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:56:38 2022] GET /compute/v2.1/images/8dfbef1d-2e17-4e08-b909-b8e888a31709 => generated 1455 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:56:38.782776 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-29347f3a-55b1-458a-a9e6-5058af75fe8e tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:56:38.783846 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-29347f3a-55b1-458a-a9e6-5058af75fe8e tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] [instance: 5b41d7b5-e888-47ec-a57e-5b474e76ef45] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:56:38.812056 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-29347f3a-55b1-458a-a9e6-5058af75fe8e tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:56:38.816136 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-29347f3a-55b1-458a-a9e6-5058af75fe8e tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:56:38.816727 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-29347f3a-55b1-458a-a9e6-5058af75fe8e tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:56:38.819683 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-29347f3a-55b1-458a-a9e6-5058af75fe8e tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:56:38.820191 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-29347f3a-55b1-458a-a9e6-5058af75fe8e tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:56:38.835185 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-29347f3a-55b1-458a-a9e6-5058af75fe8e tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:56:39.005753 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-8dfbf30e-ffa9-4c90-9846-3d2b1bd4b287 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:56:39.007236 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-8dfbf30e-ffa9-4c90-9846-3d2b1bd4b287 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001776 Aug 10 17:56:39.008106 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 777/1541] 10.222.0.50 () {56 vars in 886 bytes} [Wed Aug 10 17:56:39 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (2 switches on core 0) Aug 10 17:56:39.016224 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-8dfbf30e-ffa9-4c90-9846-3d2b1bd4b287 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:56:39.018132 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-8dfbf30e-ffa9-4c90-9846-3d2b1bd4b287 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.002420 Aug 10 17:56:39.019065 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 778/1542] 10.222.0.50 () {54 vars in 1035 bytes} [Wed Aug 10 17:56:39 2022] GET /compute/v2/ => generated 379 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 221 bytes (2 switches on core 0) Aug 10 17:56:39.028142 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-8dfbf30e-ffa9-4c90-9846-3d2b1bd4b287 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:56:39.031317 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-8dfbf30e-ffa9-4c90-9846-3d2b1bd4b287 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.003508 Aug 10 17:56:39.032835 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 779/1543] 10.222.0.50 () {54 vars in 1041 bytes} [Wed Aug 10 17:56:39 2022] GET /compute/v2.1/ => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:56:39.050768 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-8dfbf30e-ffa9-4c90-9846-3d2b1bd4b287 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:56:39.052112 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-8dfbf30e-ffa9-4c90-9846-3d2b1bd4b287 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001701 Aug 10 17:56:39.052757 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 780/1544] 10.222.0.50 () {56 vars in 886 bytes} [Wed Aug 10 17:56:39 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (2 switches on core 0) Aug 10 17:56:39.733350 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-07cb62c9-f8d4-4283-826b-d0522081a7ed tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '.version_select at 0x7fb345ebaca0>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:56:39.849635 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-07cb62c9-f8d4-4283-826b-d0522081a7ed tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/images/8dfbef1d-2e17-4e08-b909-b8e888a31709" status: 200 len: 1455 microversion: 2.1 time: 0.119967 Aug 10 17:56:39.851653 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 781/1545] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:56:39 2022] GET /compute/v2.1/images/8dfbef1d-2e17-4e08-b909-b8e888a31709 => generated 1455 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:56:40.881408 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-29347f3a-55b1-458a-a9e6-5058af75fe8e tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36de414913b4223aba37ecb0f74e467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea1bedbf4fa421198a38dbfad95db72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:56:40.893123 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-29347f3a-55b1-458a-a9e6-5058af75fe8e tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] 10.222.0.50 "GET /compute/v2.1/servers/5b41d7b5-e888-47ec-a57e-5b474e76ef45" status: 200 len: 1473 microversion: 2.1 time: 2.115795 Aug 10 17:56:40.913622 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 765/1546] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:56:38 2022] GET /compute/v2.1/servers/5b41d7b5-e888-47ec-a57e-5b474e76ef45 => generated 1473 bytes in 2136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:56:40.926825 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-b4fad86f-7993-49b9-9cbe-050435b550d8 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '.version_select at 0x7fb3459e2ca0>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:56:41.045981 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-b4fad86f-7993-49b9-9cbe-050435b550d8 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/images/8dfbef1d-2e17-4e08-b909-b8e888a31709" status: 200 len: 1455 microversion: 2.1 time: 0.130262 Aug 10 17:56:41.050257 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 766/1547] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:56:40 2022] GET /compute/v2.1/images/8dfbef1d-2e17-4e08-b909-b8e888a31709 => generated 1455 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:56:41.314060 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [req-79e1080e-e8e9-4be2-9fe6-72148f01da31 req-9b967268-f3f7-4aa6-8a43-531617bed527 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b41d7b5-e888-47ec-a57e-5b474e76ef45", "name": "network-vif-deleted", "tag": "8aff8e43-12e5-4e3e-bb1f-efb7af31ddbe"}]} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:56:41.342041 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-79e1080e-e8e9-4be2-9fe6-72148f01da31 req-9b967268-f3f7-4aa6-8a43-531617bed527 service nova] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:56:41.342862 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-79e1080e-e8e9-4be2-9fe6-72148f01da31 req-9b967268-f3f7-4aa6-8a43-531617bed527 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:56:41.343471 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-79e1080e-e8e9-4be2-9fe6-72148f01da31 req-9b967268-f3f7-4aa6-8a43-531617bed527 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:56:41.377128 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.compute.server_external_events [req-79e1080e-e8e9-4be2-9fe6-72148f01da31 req-9b967268-f3f7-4aa6-8a43-531617bed527 service nova] Creating event network-vif-deleted:8aff8e43-12e5-4e3e-bb1f-efb7af31ddbe for instance 5b41d7b5-e888-47ec-a57e-5b474e76ef45 on n-h1-852296-2 Aug 10 17:56:41.390747 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [req-79e1080e-e8e9-4be2-9fe6-72148f01da31 req-9b967268-f3f7-4aa6-8a43-531617bed527 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.590918 Aug 10 17:56:41.395834 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 782/1548] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 10 17:56:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:56:41.922341 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-d543e82f-908c-4460-9bee-f4232fa5a7c2 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:56:41.925409 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-d543e82f-908c-4460-9bee-f4232fa5a7c2 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] [instance: 5b41d7b5-e888-47ec-a57e-5b474e76ef45] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:56:41.942129 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d543e82f-908c-4460-9bee-f4232fa5a7c2 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:56:41.945250 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d543e82f-908c-4460-9bee-f4232fa5a7c2 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:56:41.945836 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d543e82f-908c-4460-9bee-f4232fa5a7c2 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:56:41.946585 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d543e82f-908c-4460-9bee-f4232fa5a7c2 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:56:41.947050 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d543e82f-908c-4460-9bee-f4232fa5a7c2 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:56:41.947473 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d543e82f-908c-4460-9bee-f4232fa5a7c2 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:56:42.024304 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d543e82f-908c-4460-9bee-f4232fa5a7c2 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:56:42.027242 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d543e82f-908c-4460-9bee-f4232fa5a7c2 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:56:42.028532 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d543e82f-908c-4460-9bee-f4232fa5a7c2 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:56:42.029179 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.objects.instance [None req-d543e82f-908c-4460-9bee-f4232fa5a7c2 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Lazy-loading 'fault' on Instance uuid 5b41d7b5-e888-47ec-a57e-5b474e76ef45 {{(pid=129410) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:56:42.064341 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-cd080a96-ab2c-4ddd-8cf9-e7000f052582 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '.version_select at 0x7fb346621040>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:56:42.217551 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-cd080a96-ab2c-4ddd-8cf9-e7000f052582 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/images/8dfbef1d-2e17-4e08-b909-b8e888a31709" status: 200 len: 1455 microversion: 2.1 time: 0.158135 Aug 10 17:56:42.218581 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 783/1549] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:56:42 2022] GET /compute/v2.1/images/8dfbef1d-2e17-4e08-b909-b8e888a31709 => generated 1455 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:56:42.367428 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-d543e82f-908c-4460-9bee-f4232fa5a7c2 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36de414913b4223aba37ecb0f74e467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea1bedbf4fa421198a38dbfad95db72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:56:42.381658 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-d543e82f-908c-4460-9bee-f4232fa5a7c2 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] 10.222.0.50 "GET /compute/v2.1/servers/5b41d7b5-e888-47ec-a57e-5b474e76ef45" status: 200 len: 1307 microversion: 2.1 time: 0.463453 Aug 10 17:56:42.401006 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 767/1550] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:56:41 2022] GET /compute/v2.1/servers/5b41d7b5-e888-47ec-a57e-5b474e76ef45 => generated 1307 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:56:43.235766 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-4b1d78c5-1cc3-4e1d-bc9e-f9aa2b54892a tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '.version_select at 0x7fb345eba940>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:56:43.339391 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-4b1d78c5-1cc3-4e1d-bc9e-f9aa2b54892a tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/images/8dfbef1d-2e17-4e08-b909-b8e888a31709" status: 200 len: 1455 microversion: 2.1 time: 0.109609 Aug 10 17:56:43.348879 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 784/1551] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:56:43 2022] GET /compute/v2.1/images/8dfbef1d-2e17-4e08-b909-b8e888a31709 => generated 1455 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:56:43.427730 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-789bbaa9-672b-4194-8896-05561f911f41 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:56:43.429530 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-789bbaa9-672b-4194-8896-05561f911f41 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] [instance: 5b41d7b5-e888-47ec-a57e-5b474e76ef45] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:56:43.446412 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-789bbaa9-672b-4194-8896-05561f911f41 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:56:43.447232 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-789bbaa9-672b-4194-8896-05561f911f41 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:56:43.448799 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-789bbaa9-672b-4194-8896-05561f911f41 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:56:43.450524 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-789bbaa9-672b-4194-8896-05561f911f41 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:56:43.453503 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-789bbaa9-672b-4194-8896-05561f911f41 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:56:43.454722 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-789bbaa9-672b-4194-8896-05561f911f41 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:56:43.488044 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-789bbaa9-672b-4194-8896-05561f911f41 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] HTTP exception thrown: Instance 5b41d7b5-e888-47ec-a57e-5b474e76ef45 could not be found. Aug 10 17:56:43.490277 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-789bbaa9-672b-4194-8896-05561f911f41 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Request method failure captured: Aug 10 17:56:43.490277 n-d-852296-2 devstack@n-api.service[129410]: request: GET /compute/v2.1/servers/5b41d7b5-e888-47ec-a57e-5b474e76ef45 HTTP/1.1 Aug 10 17:56:43.490277 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 17:56:43.490277 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 17:56:43.490277 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 17:56:43.490277 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 0 Aug 10 17:56:43.490277 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 17:56:43.490277 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 17:56:43.490277 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 17:56:43.490277 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 17:56:43.490277 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8_DeGkWKrhzv1YghAlAi5icCM62xJGTSdLjrSL8nbEdQU1PuRRnSnbvGJA1wjtHeY7_t4iSOmrFvkPkJxdOPDvZyHHA6DNDPwqbAq_AE2UhTYrp9oeBcNoxv0aPvLSleWwqnJHs51x_B-DT5ee6fDkeykN7mud9mtOqwlBLEf6yQEk0 Aug 10 17:56:43.490277 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 17:56:43.490277 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 17:56:43.490277 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 17:56:43.490277 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 17:56:43.490277 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 17:56:43.490277 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 17:56:43.490277 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: 0ea1bedbf4fa421198a38dbfad95db72 Aug 10 17:56:43.490277 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-ImagesOneServerTestJSON-1673408554 Aug 10 17:56:43.490277 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 17:56:43.490277 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 17:56:43.490277 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0ea1bedbf4fa421198a38dbfad95db72"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/0ea1bedbf4fa421198a38dbfad95db72"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0ea1bedbf4fa421198a38dbfad95db72"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_0ea1bedbf4fa421198a38dbfad95db72", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:56:43.490277 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-ImagesOneServerTestJSON-1673408554 Aug 10 17:56:43.490277 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: 0ea1bedbf4fa421198a38dbfad95db72 Aug 10 17:56:43.490277 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1673408554 Aug 10 17:56:43.490277 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-ImagesOneServerTestJSON-1673408554-project Aug 10 17:56:43.490277 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 17:56:43.490277 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 17:56:43.490277 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: a36de414913b4223aba37ecb0f74e467 Aug 10 17:56:43.490277 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-ImagesOneServerTestJSON-1673408554-project Aug 10 17:56:43.490277 n-d-852296-2 devstack@n-api.service[129410]: method: > Aug 10 17:56:43.490277 n-d-852296-2 devstack@n-api.service[129410]: exception: Instance 5b41d7b5-e888-47ec-a57e-5b474e76ef45 could not be found. Aug 10 17:56:43.490277 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'id': '5b41d7b5-e888-47ec-a57e-5b474e76ef45'} Aug 10 17:56:43.490277 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:56:43.490277 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:56:43.490277 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 17:56:43.490277 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 17:56:43.490277 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 17:56:43.490277 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 17:56:43.490277 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 17:56:43.490277 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 17:56:43.490277 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 17:56:43.490277 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 17:56:43.490277 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b41d7b5-e888-47ec-a57e-5b474e76ef45 could not be found. Aug 10 17:56:43.490277 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:56:43.490277 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:56:43.490277 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:56:43.490277 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:56:43.490277 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:56:43.490277 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:56:43.490277 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:56:43.490277 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:56:43.490277 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:56:43.490277 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:56:43.490277 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 17:56:43.490277 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 17:56:43.490277 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 17:56:43.490277 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 17:56:43.490277 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 17:56:43.490277 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:56:43.490277 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b41d7b5-e888-47ec-a57e-5b474e76ef45 could not be found. Aug 10 17:56:43.490277 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:56:43.490277 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:56:43.490277 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:56:43.493427 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:56:43.493427 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:56:43.493427 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:56:43.493427 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:56:43.493427 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:56:43.493427 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b41d7b5-e888-47ec-a57e-5b474e76ef45 could not be found. Aug 10 17:56:43.493427 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:56:43.493427 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-789bbaa9-672b-4194-8896-05561f911f41 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] Returning 404 to user: Instance 5b41d7b5-e888-47ec-a57e-5b474e76ef45 could not be found. {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:56:43.493427 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-789bbaa9-672b-4194-8896-05561f911f41 tempest-ImagesOneServerTestJSON-1673408554 tempest-ImagesOneServerTestJSON-1673408554-project] 10.222.0.50 "GET /compute/v2.1/servers/5b41d7b5-e888-47ec-a57e-5b474e76ef45" status: 404 len: 111 microversion: 2.1 time: 0.068206 Aug 10 17:56:43.497406 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 768/1552] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:56:43 2022] GET /compute/v2.1/servers/5b41d7b5-e888-47ec-a57e-5b474e76ef45 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:56:44.356058 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-49b17ede-0f7d-458f-a973-924aff01aab4 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '.version_select at 0x7fb345e67940>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:56:44.473245 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-49b17ede-0f7d-458f-a973-924aff01aab4 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/images/8dfbef1d-2e17-4e08-b909-b8e888a31709" status: 200 len: 1455 microversion: 2.1 time: 0.111669 Aug 10 17:56:44.473971 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 785/1553] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:56:44 2022] GET /compute/v2.1/images/8dfbef1d-2e17-4e08-b909-b8e888a31709 => generated 1455 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:56:45.492739 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-c691f6c6-dac8-4d1d-acd7-55272bc4f072 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '.version_select at 0x7fb3459e9ee0>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:56:45.648677 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-c691f6c6-dac8-4d1d-acd7-55272bc4f072 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/images/8dfbef1d-2e17-4e08-b909-b8e888a31709" status: 200 len: 1455 microversion: 2.1 time: 0.147941 Aug 10 17:56:45.653456 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 769/1554] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:56:45 2022] GET /compute/v2.1/images/8dfbef1d-2e17-4e08-b909-b8e888a31709 => generated 1455 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:56:46.102705 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-7cb767e8-4994-4fa0-8774-f186a4d52ee4 tempest-MultipleCreateTestJSON-734835856 tempest-MultipleCreateTestJSON-734835856-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-187524892", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "9e8491b6-cbea-467d-a15e-235980bd594d"}]}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:56:46.257473 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.network.neutron [None req-7cb767e8-4994-4fa0-8774-f186a4d52ee4 tempest-MultipleCreateTestJSON-734835856 tempest-MultipleCreateTestJSON-734835856-project] validate_networks() for [('9e8491b6-cbea-467d-a15e-235980bd594d', None, None, None, None, None)] {{(pid=129409) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 17:56:46.663921 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_cell0:SELECT=4 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:56:46.668773 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-9fb4abce-0da7-4229-af32-fd2c0c4e8613 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '.version_select at 0x7fb345b610d0>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:56:46.761657 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-9fb4abce-0da7-4229-af32-fd2c0c4e8613 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/images/8dfbef1d-2e17-4e08-b909-b8e888a31709" status: 200 len: 1464 microversion: 2.1 time: 0.098475 Aug 10 17:56:46.770024 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 770/1555] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:56:46 2022] GET /compute/v2.1/images/8dfbef1d-2e17-4e08-b909-b8e888a31709 => generated 1464 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:56:46.779713 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-fde2285e-798c-4d64-95d5-ba238143b88b tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '.version_select at 0x7fb3459e9670>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:56:46.881390 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-fde2285e-798c-4d64-95d5-ba238143b88b tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/images/8dfbef1d-2e17-4e08-b909-b8e888a31709" status: 200 len: 1464 microversion: 2.1 time: 0.108008 Aug 10 17:56:46.881969 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 771/1556] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:56:46 2022] GET /compute/v2.1/images/8dfbef1d-2e17-4e08-b909-b8e888a31709 => generated 1464 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:56:46.909397 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-dcd6258c-eb9d-49aa-b371-471fd970bda2 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:56:46.910392 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-dcd6258c-eb9d-49aa-b371-471fd970bda2 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] [instance: 8937f92d-1764-4316-86cc-939bc9dc34b4] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:56:46.988661 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-dcd6258c-eb9d-49aa-b371-471fd970bda2 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:56:46.988661 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-dcd6258c-eb9d-49aa-b371-471fd970bda2 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:56:46.988661 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-dcd6258c-eb9d-49aa-b371-471fd970bda2 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:56:46.988661 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-dcd6258c-eb9d-49aa-b371-471fd970bda2 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:56:46.988661 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-dcd6258c-eb9d-49aa-b371-471fd970bda2 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:56:46.988661 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-dcd6258c-eb9d-49aa-b371-471fd970bda2 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:56:47.399927 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [None req-7cb767e8-4994-4fa0-8774-f186a4d52ee4 tempest-MultipleCreateTestJSON-734835856 tempest-MultipleCreateTestJSON-734835856-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-c87075c0-4d15-4ab9-ba97-d8786517c07a) Aug 10 17:56:47.399927 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:56:47.399927 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:56:47.399927 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:56:47.399927 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:56:47.399927 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:56:47.399927 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:56:47.399927 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:56:47.399927 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:56:47.399927 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:56:47.399927 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 17:56:47.399927 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 17:56:47.399927 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 17:56:47.399927 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 17:56:47.399927 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 17:56:47.399927 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 17:56:47.399927 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 17:56:47.399927 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 17:56:47.399927 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 17:56:47.399927 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 17:56:47.399927 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 17:56:47.399927 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 17:56:47.399927 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 17:56:47.399927 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 17:56:47.399927 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 17:56:47.399927 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 17:56:47.399927 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 17:56:47.399927 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:56:47.399927 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:56:47.399927 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 17:56:47.399927 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 17:56:47.399927 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:56:47.399927 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:56:47.399927 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:56:47.399927 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:56:47.399927 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:56:47.399927 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:56:47.399927 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:56:47.399927 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:56:47.399927 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:56:47.399927 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:56:47.399927 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 17:56:47.399927 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 17:56:47.399927 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 17:56:47.399927 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 17:56:47.399927 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 17:56:47.399927 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 17:56:47.399927 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 17:56:47.399927 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 17:56:47.399927 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 17:56:47.399927 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 17:56:47.399927 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 17:56:47.399927 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 17:56:47.406004 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 17:56:47.406004 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 17:56:47.406004 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 17:56:47.406004 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 17:56:47.406004 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 17:56:47.406004 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 17:56:47.406004 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 17:56:47.406004 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 17:56:47.406004 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 17:56:47.406004 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 17:56:47.406004 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 17:56:47.406004 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 17:56:47.406004 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 17:56:47.406004 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 17:56:47.406004 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-c87075c0-4d15-4ab9-ba97-d8786517c07a) Aug 10 17:56:47.406004 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:56:47.406004 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-7cb767e8-4994-4fa0-8774-f186a4d52ee4 tempest-MultipleCreateTestJSON-734835856 tempest-MultipleCreateTestJSON-734835856-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:56:47.406004 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:56:47.408986 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-7cb767e8-4994-4fa0-8774-f186a4d52ee4 tempest-MultipleCreateTestJSON-734835856 tempest-MultipleCreateTestJSON-734835856-project] Request method failure captured: Aug 10 17:56:47.408986 n-d-852296-2 devstack@n-api.service[129409]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 17:56:47.408986 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 17:56:47.408986 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 17:56:47.408986 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 17:56:47.408986 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 225 Aug 10 17:56:47.408986 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 17:56:47.408986 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 17:56:47.408986 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 17:56:47.408986 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 17:56:47.408986 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8_FdGZljqfxmgLgCqcU50k6bTx_HiH2tsu0wQVsqU8cNIPAoB5FWwOf40uRolIRAUQVxFs7a0NS--iXseu0k8cGoAIdaSUxSandaIcnAQiNLn8JNrVedYlXol8223x78LDHFuoewkre4ZNHe_2ZKI7MXddoD8ztS0no3efej3L23HAs Aug 10 17:56:47.408986 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 17:56:47.408986 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 17:56:47.408986 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 17:56:47.408986 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 17:56:47.408986 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 17:56:47.408986 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 17:56:47.408986 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: 3c04cfb01e994b57bf0af93da17129f5 Aug 10 17:56:47.408986 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-MultipleCreateTestJSON-734835856 Aug 10 17:56:47.408986 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 17:56:47.408986 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 17:56:47.408986 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3c04cfb01e994b57bf0af93da17129f5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3c04cfb01e994b57bf0af93da17129f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3c04cfb01e994b57bf0af93da17129f5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3c04cfb01e994b57bf0af93da17129f5", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:56:47.408986 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-MultipleCreateTestJSON-734835856 Aug 10 17:56:47.408986 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: 3c04cfb01e994b57bf0af93da17129f5 Aug 10 17:56:47.408986 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-MultipleCreateTestJSON-734835856 Aug 10 17:56:47.408986 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-MultipleCreateTestJSON-734835856-project Aug 10 17:56:47.408986 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 17:56:47.408986 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 17:56:47.408986 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: 0db2701c78264e93944be921ee01f432 Aug 10 17:56:47.408986 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-MultipleCreateTestJSON-734835856-project Aug 10 17:56:47.408986 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:56:47.408986 n-d-852296-2 devstack@n-api.service[129409]: {"server": {"name": "tempest-tempest.common.compute-instance-187524892", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "9e8491b6-cbea-467d-a15e-235980bd594d"}]}} Aug 10 17:56:47.408986 n-d-852296-2 devstack@n-api.service[129409]: method: > Aug 10 17:56:47.408986 n-d-852296-2 devstack@n-api.service[129409]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:56:47.408986 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:56:47.408986 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'body': {'server': {'name': 'tempest-tempest.common.compute-instance-187524892', 'imageRef': 'a735ff26-463a-4ffe-a981-ab9d9baa494f', 'flavorRef': '452', 'min_count': 2, 'networks': [{'uuid': '9e8491b6-cbea-467d-a15e-235980bd594d'}]}}} Aug 10 17:56:47.408986 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:56:47.408986 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:56:47.408986 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:56:47.408986 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:56:47.408986 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:56:47.408986 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:56:47.408986 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:56:47.408986 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:56:47.408986 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:56:47.408986 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:56:47.408986 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 17:56:47.408986 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 17:56:47.408986 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 17:56:47.408986 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 17:56:47.408986 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 17:56:47.408986 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 17:56:47.408986 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 17:56:47.408986 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 17:56:47.408986 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 17:56:47.408986 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 17:56:47.408986 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 17:56:47.408986 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 17:56:47.408986 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 17:56:47.408986 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 17:56:47.408986 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 17:56:47.413073 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 17:56:47.413073 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 17:56:47.413073 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:56:47.413073 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:56:47.413073 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 17:56:47.413073 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 17:56:47.413073 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:56:47.413073 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:56:47.413073 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:56:47.413073 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:56:47.413073 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:56:47.413073 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:56:47.413073 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:56:47.413073 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:56:47.413073 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:56:47.413073 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:56:47.413073 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 17:56:47.413073 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 17:56:47.413073 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 17:56:47.413073 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 17:56:47.413073 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 17:56:47.413073 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 17:56:47.413073 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 17:56:47.413073 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 17:56:47.413073 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 17:56:47.413073 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 17:56:47.413073 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 17:56:47.413073 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 17:56:47.413073 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 17:56:47.413073 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 17:56:47.413073 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 17:56:47.413073 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 17:56:47.413073 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 17:56:47.413073 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 17:56:47.413073 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 17:56:47.413073 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 17:56:47.413073 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 17:56:47.413073 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 17:56:47.413073 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 17:56:47.413073 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 17:56:47.413073 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 17:56:47.413073 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 17:56:47.413073 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-c87075c0-4d15-4ab9-ba97-d8786517c07a) Aug 10 17:56:47.413073 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:56:47.413073 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:56:47.413073 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:56:47.413073 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:56:47.413073 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:56:47.413073 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:56:47.413073 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:56:47.413073 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:56:47.413073 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 10 17:56:47.413073 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 10 17:56:47.427599 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:56:47.427599 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:56:47.427599 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:56:47.427599 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:56:47.427599 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:56:47.427599 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:56:47.427599 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:56:47.427599 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:56:47.427599 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:56:47.427599 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:56:47.427599 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:56:47.427599 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:56:47.427599 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:56:47.427599 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-7cb767e8-4994-4fa0-8774-f186a4d52ee4 tempest-MultipleCreateTestJSON-734835856 tempest-MultipleCreateTestJSON-734835856-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:56:47.427599 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:56:47.427599 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-7cb767e8-4994-4fa0-8774-f186a4d52ee4 tempest-MultipleCreateTestJSON-734835856 tempest-MultipleCreateTestJSON-734835856-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.500434 Aug 10 17:56:47.434613 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 786/1557] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 17:56:45 2022] POST /compute/v2.1/servers => generated 214 bytes in 1513 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 10 17:56:47.751034 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-dcd6258c-eb9d-49aa-b371-471fd970bda2 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce45e1a545b4d3b8fa2cb4b2af3f306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0285f1570fe2419c930c80d3a0711858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:56:47.760239 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-dcd6258c-eb9d-49aa-b371-471fd970bda2 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/servers/8937f92d-1764-4316-86cc-939bc9dc34b4" status: 200 len: 1467 microversion: 2.1 time: 0.866179 Aug 10 17:56:47.764949 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 772/1558] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:56:46 2022] GET /compute/v2.1/servers/8937f92d-1764-4316-86cc-939bc9dc34b4 => generated 1467 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:56:47.793755 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-8e4a3b9c-8d38-4994-adc2-4d80221ff3f4 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-739692880"}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:56:47.796766 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-8e4a3b9c-8d38-4994-adc2-4d80221ff3f4 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] [instance: dd4d671c-5a1f-463d-8bec-cd4f7614479f] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:56:47.812137 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-8e4a3b9c-8d38-4994-adc2-4d80221ff3f4 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:56:47.813535 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-8e4a3b9c-8d38-4994-adc2-4d80221ff3f4 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:56:47.819740 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-8e4a3b9c-8d38-4994-adc2-4d80221ff3f4 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:56:47.830129 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-8e4a3b9c-8d38-4994-adc2-4d80221ff3f4 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:56:47.831044 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-8e4a3b9c-8d38-4994-adc2-4d80221ff3f4 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:56:47.831669 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-8e4a3b9c-8d38-4994-adc2-4d80221ff3f4 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:56:47.864997 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-9ae8a14d-2b31-4e00-bdc2-5d731e79f446 tempest-MultipleCreateTestJSON-734835856 tempest-MultipleCreateTestJSON-734835856-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-1852798948", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "9e8491b6-cbea-467d-a15e-235980bd594d"}]}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:56:48.009456 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.network.neutron [None req-9ae8a14d-2b31-4e00-bdc2-5d731e79f446 tempest-MultipleCreateTestJSON-734835856 tempest-MultipleCreateTestJSON-734835856-project] validate_networks() for [('9e8491b6-cbea-467d-a15e-235980bd594d', None, None, None, None, None)] {{(pid=129410) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 17:56:48.550584 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [None req-9ae8a14d-2b31-4e00-bdc2-5d731e79f446 tempest-MultipleCreateTestJSON-734835856 tempest-MultipleCreateTestJSON-734835856-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-9789d15e-272b-4adb-a5ab-ececd695eaa8) Aug 10 17:56:48.550584 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:56:48.550584 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:56:48.550584 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:56:48.550584 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:56:48.550584 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:56:48.550584 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:56:48.550584 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:56:48.550584 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:56:48.550584 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:56:48.550584 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 17:56:48.550584 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 17:56:48.550584 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 17:56:48.550584 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 17:56:48.550584 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 17:56:48.550584 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 17:56:48.550584 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 17:56:48.550584 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 17:56:48.550584 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 17:56:48.550584 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 17:56:48.550584 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 17:56:48.550584 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 17:56:48.550584 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 17:56:48.550584 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 17:56:48.550584 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 17:56:48.550584 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 17:56:48.550584 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 17:56:48.550584 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:56:48.550584 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:56:48.550584 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 17:56:48.550584 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 17:56:48.550584 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:56:48.550584 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:56:48.550584 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:56:48.550584 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:56:48.550584 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:56:48.550584 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:56:48.550584 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:56:48.550584 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:56:48.550584 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:56:48.550584 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:56:48.550584 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 17:56:48.550584 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 17:56:48.550584 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 17:56:48.550584 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 17:56:48.550584 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 17:56:48.550584 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 17:56:48.550584 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 17:56:48.550584 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 17:56:48.550584 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 17:56:48.550584 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 17:56:48.550584 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 17:56:48.550584 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 17:56:48.553437 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 17:56:48.553437 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 17:56:48.553437 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 17:56:48.553437 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 17:56:48.553437 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 17:56:48.553437 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 17:56:48.553437 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 17:56:48.553437 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 17:56:48.553437 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 17:56:48.553437 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 17:56:48.553437 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 17:56:48.553437 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 17:56:48.553437 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 17:56:48.553437 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 17:56:48.553437 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-9789d15e-272b-4adb-a5ab-ececd695eaa8) Aug 10 17:56:48.553437 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:56:48.553437 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-9ae8a14d-2b31-4e00-bdc2-5d731e79f446 tempest-MultipleCreateTestJSON-734835856 tempest-MultipleCreateTestJSON-734835856-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:56:48.553437 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 17:56:48.553437 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-9ae8a14d-2b31-4e00-bdc2-5d731e79f446 tempest-MultipleCreateTestJSON-734835856 tempest-MultipleCreateTestJSON-734835856-project] Request method failure captured: Aug 10 17:56:48.553437 n-d-852296-2 devstack@n-api.service[129410]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 17:56:48.553437 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 17:56:48.553437 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 17:56:48.553437 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 17:56:48.553437 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 271 Aug 10 17:56:48.553437 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 17:56:48.553437 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 17:56:48.553437 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 17:56:48.553437 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 17:56:48.553437 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8_FdGZljqfxmgLgCqcU50k6bTx_HiH2tsu0wQVsqU8cNIPAoB5FWwOf40uRolIRAUQVxFs7a0NS--iXseu0k8cGoAIdaSUxSandaIcnAQiNLn8JNrVedYlXol8223x78LDHFuoewkre4ZNHe_2ZKI7MXddoD8ztS0no3efej3L23HAs Aug 10 17:56:48.553437 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 17:56:48.553437 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 17:56:48.553437 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 17:56:48.553437 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 17:56:48.553437 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 17:56:48.553437 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 17:56:48.553437 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: 3c04cfb01e994b57bf0af93da17129f5 Aug 10 17:56:48.553437 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-MultipleCreateTestJSON-734835856 Aug 10 17:56:48.553437 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 17:56:48.553437 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 17:56:48.553437 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3c04cfb01e994b57bf0af93da17129f5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3c04cfb01e994b57bf0af93da17129f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3c04cfb01e994b57bf0af93da17129f5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3c04cfb01e994b57bf0af93da17129f5", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:56:48.553437 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-MultipleCreateTestJSON-734835856 Aug 10 17:56:48.553437 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: 3c04cfb01e994b57bf0af93da17129f5 Aug 10 17:56:48.553437 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-MultipleCreateTestJSON-734835856 Aug 10 17:56:48.553437 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-MultipleCreateTestJSON-734835856-project Aug 10 17:56:48.553437 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 17:56:48.553437 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 17:56:48.553437 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: 0db2701c78264e93944be921ee01f432 Aug 10 17:56:48.553437 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-MultipleCreateTestJSON-734835856-project Aug 10 17:56:48.553437 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 17:56:48.553437 n-d-852296-2 devstack@n-api.service[129410]: {"server": {"name": "tempest-MultipleCreateTestJSON-server-1852798948", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "9e8491b6-cbea-467d-a15e-235980bd594d"}]}} Aug 10 17:56:48.553437 n-d-852296-2 devstack@n-api.service[129410]: method: > Aug 10 17:56:48.553437 n-d-852296-2 devstack@n-api.service[129410]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:56:48.553437 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 17:56:48.553437 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateTestJSON-server-1852798948', 'imageRef': 'a735ff26-463a-4ffe-a981-ab9d9baa494f', 'flavorRef': '452', 'min_count': 1, 'max_count': 2, 'return_reservation_id': True, 'networks': [{'uuid': '9e8491b6-cbea-467d-a15e-235980bd594d'}]}}} Aug 10 17:56:48.558651 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:56:48.558651 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:56:48.558651 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:56:48.558651 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:56:48.558651 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:56:48.558651 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:56:48.558651 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:56:48.558651 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:56:48.558651 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:56:48.558651 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:56:48.558651 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 17:56:48.558651 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 17:56:48.558651 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 17:56:48.558651 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 17:56:48.558651 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 17:56:48.558651 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 17:56:48.558651 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 17:56:48.558651 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 17:56:48.558651 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 17:56:48.558651 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 17:56:48.558651 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 17:56:48.558651 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 17:56:48.558651 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 17:56:48.558651 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 17:56:48.558651 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 17:56:48.558651 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 17:56:48.558651 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 17:56:48.558651 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:56:48.558651 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:56:48.558651 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 17:56:48.558651 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 17:56:48.558651 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:56:48.558651 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:56:48.558651 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:56:48.558651 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:56:48.558651 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:56:48.558651 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:56:48.558651 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:56:48.558651 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:56:48.558651 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:56:48.558651 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:56:48.558651 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 17:56:48.558651 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 17:56:48.558651 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 17:56:48.558651 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 17:56:48.558651 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 17:56:48.558651 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 17:56:48.558651 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 17:56:48.558651 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 17:56:48.558651 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 17:56:48.558651 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 17:56:48.558651 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 17:56:48.558651 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 17:56:48.558651 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 17:56:48.558651 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 17:56:48.558651 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 17:56:48.569677 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 17:56:48.569677 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 17:56:48.569677 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 17:56:48.569677 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 17:56:48.569677 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 17:56:48.569677 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 17:56:48.569677 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 17:56:48.569677 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 17:56:48.569677 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 17:56:48.569677 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 17:56:48.569677 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 17:56:48.569677 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-9789d15e-272b-4adb-a5ab-ececd695eaa8) Aug 10 17:56:48.569677 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:56:48.569677 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:56:48.569677 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:56:48.569677 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:56:48.569677 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:56:48.569677 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:56:48.569677 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:56:48.569677 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:56:48.569677 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 10 17:56:48.569677 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 10 17:56:48.569677 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:56:48.569677 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:56:48.569677 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:56:48.569677 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:56:48.569677 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:56:48.569677 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:56:48.569677 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:56:48.569677 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:56:48.569677 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:56:48.569677 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:56:48.569677 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:56:48.569677 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:56:48.569677 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:56:48.569677 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-9ae8a14d-2b31-4e00-bdc2-5d731e79f446 tempest-MultipleCreateTestJSON-734835856 tempest-MultipleCreateTestJSON-734835856-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:56:48.569677 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:56:48.569677 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-9ae8a14d-2b31-4e00-bdc2-5d731e79f446 tempest-MultipleCreateTestJSON-734835856 tempest-MultipleCreateTestJSON-734835856-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.706739 Aug 10 17:56:48.575751 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-8e4a3b9c-8d38-4994-adc2-4d80221ff3f4 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "POST /compute/v2.1/servers/dd4d671c-5a1f-463d-8bec-cd4f7614479f/action" status: 202 len: 0 microversion: 2.1 time: 0.773058 Aug 10 17:56:48.575751 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 787/1559] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 10 17:56:47 2022] POST /compute/v2.1/servers/dd4d671c-5a1f-463d-8bec-cd4f7614479f/action => generated 0 bytes in 778 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 10 17:56:48.577689 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 773/1560] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 17:56:47 2022] POST /compute/v2.1/servers => generated 214 bytes in 730 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 10 17:56:48.580944 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-6a8c62bb-858a-4c60-9c59-3301a23f7419 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '.version_select at 0x7fb346015ca0>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:56:48.671370 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-6a8c62bb-858a-4c60-9c59-3301a23f7419 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/images/23574b56-3268-4f53-afb9-8d4a9946cf3c" status: 200 len: 1454 microversion: 2.1 time: 0.095089 Aug 10 17:56:48.671968 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 788/1561] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:56:48 2022] GET /compute/v2.1/images/23574b56-3268-4f53-afb9-8d4a9946cf3c => generated 1454 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:56:48.850108 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-9fc44f55-9aad-452d-866e-8ce7d37544d4 tempest-VolumesAdminNegativeTest-28848144 tempest-VolumesAdminNegativeTest-28848144-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1822024962", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "52652bb2-7f82-4cb4-9c89-0b952d4b3952"}], "security_groups": [{"name": "tempest-securitygroup--546854235"}], "key_name": "tempest-keypair-1087527284", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:56:49.335378 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.network.neutron [None req-9fc44f55-9aad-452d-866e-8ce7d37544d4 tempest-VolumesAdminNegativeTest-28848144 tempest-VolumesAdminNegativeTest-28848144-project] validate_networks() for [('52652bb2-7f82-4cb4-9c89-0b952d4b3952', None, None, None, None, None)] {{(pid=129410) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 17:56:49.686704 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-dc7d51bd-ac90-472f-bec9-0df250507aac tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '.version_select at 0x7fb345eba940>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:56:49.762438 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-dc7d51bd-ac90-472f-bec9-0df250507aac tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/images/23574b56-3268-4f53-afb9-8d4a9946cf3c" status: 200 len: 1454 microversion: 2.1 time: 0.079617 Aug 10 17:56:49.774411 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 789/1562] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:56:49 2022] GET /compute/v2.1/images/23574b56-3268-4f53-afb9-8d4a9946cf3c => generated 1454 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:56:49.923375 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [None req-9fc44f55-9aad-452d-866e-8ce7d37544d4 tempest-VolumesAdminNegativeTest-28848144 tempest-VolumesAdminNegativeTest-28848144-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-c8f68740-6b96-4ad2-8633-6f29928b2746) Aug 10 17:56:49.923375 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:56:49.923375 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:56:49.923375 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:56:49.923375 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:56:49.923375 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:56:49.923375 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:56:49.923375 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:56:49.923375 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:56:49.923375 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:56:49.923375 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 17:56:49.923375 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 17:56:49.923375 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 17:56:49.923375 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 17:56:49.923375 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 17:56:49.923375 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 17:56:49.923375 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 17:56:49.923375 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 17:56:49.923375 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 17:56:49.923375 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 17:56:49.923375 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 17:56:49.923375 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 17:56:49.923375 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 17:56:49.923375 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 17:56:49.923375 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 17:56:49.923375 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 17:56:49.923375 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 17:56:49.923375 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:56:49.923375 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:56:49.923375 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 17:56:49.923375 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 17:56:49.923375 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:56:49.923375 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:56:49.923375 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:56:49.923375 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:56:49.923375 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:56:49.923375 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:56:49.923375 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:56:49.923375 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:56:49.923375 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:56:49.923375 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:56:49.923375 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 17:56:49.923375 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 17:56:49.923375 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 17:56:49.923375 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 17:56:49.923375 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 17:56:49.923375 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 17:56:49.923375 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 17:56:49.923375 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 17:56:49.923375 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 17:56:49.923375 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 17:56:49.923375 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 17:56:49.923375 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 17:56:49.927645 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 17:56:49.927645 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 17:56:49.927645 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 17:56:49.927645 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 17:56:49.927645 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 17:56:49.927645 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 17:56:49.927645 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 17:56:49.927645 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 17:56:49.927645 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 17:56:49.927645 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 17:56:49.927645 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 17:56:49.927645 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 17:56:49.927645 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 17:56:49.927645 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 17:56:49.927645 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-c8f68740-6b96-4ad2-8633-6f29928b2746) Aug 10 17:56:49.927645 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:56:49.927645 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-9fc44f55-9aad-452d-866e-8ce7d37544d4 tempest-VolumesAdminNegativeTest-28848144 tempest-VolumesAdminNegativeTest-28848144-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:56:49.927645 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 17:56:49.927645 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-9fc44f55-9aad-452d-866e-8ce7d37544d4 tempest-VolumesAdminNegativeTest-28848144 tempest-VolumesAdminNegativeTest-28848144-project] Request method failure captured: Aug 10 17:56:49.927645 n-d-852296-2 devstack@n-api.service[129410]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 17:56:49.927645 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 17:56:49.927645 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 17:56:49.927645 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 17:56:49.927645 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 464 Aug 10 17:56:49.927645 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 17:56:49.927645 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 17:56:49.927645 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 17:56:49.927645 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 17:56:49.927645 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8_E5E-JM82qPQHlS-ZfYO6XkDC9QrXqSfPHkhWM3jKbtM62VEnBjXuHglKdasXqosdYSmMyS_XRCGOjb3-bAJsVQcRXBgXFccS479J_Rxwx7FjyC1WCv9cG8ASHZhDZchYRzpzqHMnKAZJQCz82IjBfpaS8C6t9TfnHoegQI2VHooUU Aug 10 17:56:49.927645 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 17:56:49.927645 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 17:56:49.927645 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 17:56:49.927645 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 17:56:49.927645 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 17:56:49.927645 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 17:56:49.927645 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: dd83596896bc4e80a23e4d9b8a697fb1 Aug 10 17:56:49.927645 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-VolumesAdminNegativeTest-28848144 Aug 10 17:56:49.927645 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 17:56:49.927645 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 17:56:49.927645 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/dd83596896bc4e80a23e4d9b8a697fb1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/dd83596896bc4e80a23e4d9b8a697fb1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/dd83596896bc4e80a23e4d9b8a697fb1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_dd83596896bc4e80a23e4d9b8a697fb1", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:56:49.927645 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-VolumesAdminNegativeTest-28848144 Aug 10 17:56:49.927645 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: dd83596896bc4e80a23e4d9b8a697fb1 Aug 10 17:56:49.927645 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-28848144 Aug 10 17:56:49.927645 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-VolumesAdminNegativeTest-28848144-project Aug 10 17:56:49.927645 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 17:56:49.927645 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 17:56:49.927645 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: 3ebff9a58da54a6ebd14e7271d023ebd Aug 10 17:56:49.927645 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-VolumesAdminNegativeTest-28848144-project Aug 10 17:56:49.927645 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 17:56:49.927645 n-d-852296-2 devstack@n-api.service[129410]: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1822024962", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "52652bb2-7f82-4cb4-9c89-0b952d4b3952"}], "security_groups": [{"name": "tempest-securitygroup--546854235"}], "key_name": "tempest-keypair-1087527284", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} Aug 10 17:56:49.927645 n-d-852296-2 devstack@n-api.service[129410]: method: > Aug 10 17:56:49.927645 n-d-852296-2 devstack@n-api.service[129410]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:56:49.927645 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 17:56:49.931102 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'body': {'server': {'name': 'tempest-VolumesAdminNegativeTest-server-1822024962', 'imageRef': 'a735ff26-463a-4ffe-a981-ab9d9baa494f', 'flavorRef': '452', 'networks': [{'uuid': '52652bb2-7f82-4cb4-9c89-0b952d4b3952'}], 'security_groups': [{'name': 'tempest-securitygroup--546854235'}], 'key_name': 'tempest-keypair-1087527284', 'user_data': 'IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo='}}} Aug 10 17:56:49.931102 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:56:49.931102 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:56:49.931102 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:56:49.931102 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:56:49.931102 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:56:49.931102 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:56:49.931102 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:56:49.931102 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:56:49.931102 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:56:49.931102 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:56:49.931102 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 17:56:49.931102 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 17:56:49.931102 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 17:56:49.931102 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 17:56:49.931102 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 17:56:49.931102 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 17:56:49.931102 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 17:56:49.931102 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 17:56:49.931102 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 17:56:49.931102 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 17:56:49.931102 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 17:56:49.931102 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 17:56:49.931102 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 17:56:49.931102 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 17:56:49.931102 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 17:56:49.931102 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 17:56:49.931102 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 17:56:49.931102 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:56:49.931102 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:56:49.931102 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 17:56:49.931102 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 17:56:49.931102 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:56:49.931102 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:56:49.931102 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:56:49.931102 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:56:49.931102 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:56:49.931102 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:56:49.931102 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:56:49.931102 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:56:49.931102 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:56:49.931102 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:56:49.931102 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 17:56:49.931102 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 17:56:49.931102 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 17:56:49.931102 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 17:56:49.931102 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 17:56:49.931102 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 17:56:49.931102 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 17:56:49.931102 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 17:56:49.931102 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 17:56:49.931102 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 17:56:49.931102 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 17:56:49.934958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 17:56:49.934958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 17:56:49.934958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 17:56:49.934958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 17:56:49.934958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 17:56:49.934958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 17:56:49.934958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 17:56:49.934958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 17:56:49.934958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 17:56:49.934958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 17:56:49.934958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 17:56:49.934958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 17:56:49.934958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 17:56:49.934958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 17:56:49.934958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 17:56:49.934958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-c8f68740-6b96-4ad2-8633-6f29928b2746) Aug 10 17:56:49.934958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:56:49.934958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:56:49.934958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:56:49.934958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:56:49.934958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:56:49.934958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:56:49.934958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:56:49.934958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:56:49.934958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 10 17:56:49.934958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 10 17:56:49.934958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:56:49.934958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:56:49.934958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:56:49.934958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:56:49.934958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:56:49.934958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:56:49.934958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:56:49.934958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:56:49.934958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:56:49.934958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:56:49.934958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:56:49.934958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:56:49.934958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:56:49.934958 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-9fc44f55-9aad-452d-866e-8ce7d37544d4 tempest-VolumesAdminNegativeTest-28848144 tempest-VolumesAdminNegativeTest-28848144-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:56:49.934958 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:56:49.934958 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-9fc44f55-9aad-452d-866e-8ce7d37544d4 tempest-VolumesAdminNegativeTest-28848144 tempest-VolumesAdminNegativeTest-28848144-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.098734 Aug 10 17:56:49.934958 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 774/1563] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 17:56:48 2022] POST /compute/v2.1/servers => generated 214 bytes in 1103 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 10 17:56:50.529710 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-3df49046-edc4-4c5e-8d54-210f81c17968 tempest-VolumesAdminNegativeTest-28848144 tempest-VolumesAdminNegativeTest-28848144-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1558221992", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "52652bb2-7f82-4cb4-9c89-0b952d4b3952"}]}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:56:50.618517 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.network.neutron [None req-3df49046-edc4-4c5e-8d54-210f81c17968 tempest-VolumesAdminNegativeTest-28848144 tempest-VolumesAdminNegativeTest-28848144-project] validate_networks() for [('52652bb2-7f82-4cb4-9c89-0b952d4b3952', None, None, None, None, None)] {{(pid=129409) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 17:56:50.642675 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [req-3b2eee15-f727-4b13-8080-6c23bbc8b874 req-7bd6bed4-e358-4724-80ae-8bb78919202f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8937f92d-1764-4316-86cc-939bc9dc34b4", "name": "network-vif-unplugged", "status": "completed", "tag": "c4ddeb24-17b7-43ce-b1c2-3516523d5956"}]} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:56:50.681254 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-3b2eee15-f727-4b13-8080-6c23bbc8b874 req-7bd6bed4-e358-4724-80ae-8bb78919202f service nova] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:56:50.681689 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-3b2eee15-f727-4b13-8080-6c23bbc8b874 req-7bd6bed4-e358-4724-80ae-8bb78919202f service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:56:50.682134 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-3b2eee15-f727-4b13-8080-6c23bbc8b874 req-7bd6bed4-e358-4724-80ae-8bb78919202f service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:56:50.725149 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.compute.server_external_events [req-3b2eee15-f727-4b13-8080-6c23bbc8b874 req-7bd6bed4-e358-4724-80ae-8bb78919202f service nova] Creating event network-vif-unplugged:c4ddeb24-17b7-43ce-b1c2-3516523d5956 for instance 8937f92d-1764-4316-86cc-939bc9dc34b4 on n-h2-852296-2 Aug 10 17:56:50.749153 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [req-3b2eee15-f727-4b13-8080-6c23bbc8b874 req-7bd6bed4-e358-4724-80ae-8bb78919202f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.110690 Aug 10 17:56:50.750285 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 775/1564] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 10 17:56:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:56:50.782352 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-31d5e560-c1f1-4a96-8a79-670372f3ee5e tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '.version_select at 0x7fb3459e9700>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:56:50.887236 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-31d5e560-c1f1-4a96-8a79-670372f3ee5e tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/images/23574b56-3268-4f53-afb9-8d4a9946cf3c" status: 200 len: 1454 microversion: 2.1 time: 0.111636 Aug 10 17:56:50.890375 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 776/1565] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:56:50 2022] GET /compute/v2.1/images/23574b56-3268-4f53-afb9-8d4a9946cf3c => generated 1454 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:56:51.576796 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-5aaa03a2-076e-4e0e-83f6-9d6a5f0acc6c tempest-FloatingIPDetailsTestJSON-1800554695 tempest-FloatingIPDetailsTestJSON-1800554695-project] Action: 'create', calling method: .version_select at 0x7fb345bfb160>, body: {"pool": null} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:56:51.600617 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [None req-3df49046-edc4-4c5e-8d54-210f81c17968 tempest-VolumesAdminNegativeTest-28848144 tempest-VolumesAdminNegativeTest-28848144-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-c142aef1-4fa9-4d3e-b83d-d567747263d1) Aug 10 17:56:51.600617 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:56:51.600617 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:56:51.600617 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:56:51.600617 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:56:51.600617 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:56:51.600617 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:56:51.600617 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:56:51.600617 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:56:51.600617 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:56:51.600617 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 17:56:51.600617 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 17:56:51.600617 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 17:56:51.600617 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 17:56:51.600617 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 17:56:51.600617 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 17:56:51.600617 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 17:56:51.600617 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 17:56:51.600617 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 17:56:51.600617 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 17:56:51.600617 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 17:56:51.600617 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 17:56:51.600617 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 17:56:51.600617 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 17:56:51.600617 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 17:56:51.600617 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 17:56:51.600617 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 17:56:51.600617 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:56:51.600617 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:56:51.600617 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 17:56:51.600617 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 17:56:51.600617 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:56:51.600617 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:56:51.600617 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:56:51.600617 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:56:51.600617 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:56:51.600617 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:56:51.600617 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:56:51.600617 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:56:51.600617 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:56:51.600617 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:56:51.600617 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 17:56:51.600617 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 17:56:51.600617 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 17:56:51.600617 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 17:56:51.600617 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 17:56:51.600617 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 17:56:51.600617 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 17:56:51.600617 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 17:56:51.600617 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 17:56:51.600617 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 17:56:51.600617 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 17:56:51.600617 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 17:56:51.609110 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 17:56:51.609110 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 17:56:51.609110 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 17:56:51.609110 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 17:56:51.609110 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 17:56:51.609110 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 17:56:51.609110 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 17:56:51.609110 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 17:56:51.609110 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 17:56:51.609110 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 17:56:51.609110 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 17:56:51.609110 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 17:56:51.609110 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 17:56:51.609110 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 17:56:51.609110 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-c142aef1-4fa9-4d3e-b83d-d567747263d1) Aug 10 17:56:51.609110 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:56:51.609110 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-3df49046-edc4-4c5e-8d54-210f81c17968 tempest-VolumesAdminNegativeTest-28848144 tempest-VolumesAdminNegativeTest-28848144-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:56:51.609110 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:56:51.612729 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-3df49046-edc4-4c5e-8d54-210f81c17968 tempest-VolumesAdminNegativeTest-28848144 tempest-VolumesAdminNegativeTest-28848144-project] Request method failure captured: Aug 10 17:56:51.612729 n-d-852296-2 devstack@n-api.service[129409]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 17:56:51.612729 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 17:56:51.612729 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 17:56:51.612729 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 17:56:51.612729 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 210 Aug 10 17:56:51.612729 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 17:56:51.612729 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 17:56:51.612729 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 17:56:51.612729 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 17:56:51.612729 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8_E5E-JM82qPQHlS-ZfYO6XkDC9QrXqSfPHkhWM3jKbtM62VEnBjXuHglKdasXqosdYSmMyS_XRCGOjb3-bAJsVQcRXBgXFccS479J_Rxwx7FjyC1WCv9cG8ASHZhDZchYRzpzqHMnKAZJQCz82IjBfpaS8C6t9TfnHoegQI2VHooUU Aug 10 17:56:51.612729 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 17:56:51.612729 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 17:56:51.612729 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 17:56:51.612729 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 17:56:51.612729 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 17:56:51.612729 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 17:56:51.612729 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: dd83596896bc4e80a23e4d9b8a697fb1 Aug 10 17:56:51.612729 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-VolumesAdminNegativeTest-28848144 Aug 10 17:56:51.612729 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 17:56:51.612729 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 17:56:51.612729 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/dd83596896bc4e80a23e4d9b8a697fb1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/dd83596896bc4e80a23e4d9b8a697fb1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/dd83596896bc4e80a23e4d9b8a697fb1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_dd83596896bc4e80a23e4d9b8a697fb1", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:56:51.612729 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-VolumesAdminNegativeTest-28848144 Aug 10 17:56:51.612729 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: dd83596896bc4e80a23e4d9b8a697fb1 Aug 10 17:56:51.612729 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-28848144 Aug 10 17:56:51.612729 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-VolumesAdminNegativeTest-28848144-project Aug 10 17:56:51.612729 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 17:56:51.612729 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 17:56:51.612729 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: 3ebff9a58da54a6ebd14e7271d023ebd Aug 10 17:56:51.612729 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-VolumesAdminNegativeTest-28848144-project Aug 10 17:56:51.612729 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:56:51.612729 n-d-852296-2 devstack@n-api.service[129409]: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1558221992", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "52652bb2-7f82-4cb4-9c89-0b952d4b3952"}]}} Aug 10 17:56:51.612729 n-d-852296-2 devstack@n-api.service[129409]: method: > Aug 10 17:56:51.612729 n-d-852296-2 devstack@n-api.service[129409]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:56:51.612729 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:56:51.612729 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'body': {'server': {'name': 'tempest-VolumesAdminNegativeTest-server-1558221992', 'imageRef': 'a735ff26-463a-4ffe-a981-ab9d9baa494f', 'flavorRef': '452', 'networks': [{'uuid': '52652bb2-7f82-4cb4-9c89-0b952d4b3952'}]}}} Aug 10 17:56:51.612729 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:56:51.612729 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:56:51.612729 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:56:51.612729 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:56:51.612729 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:56:51.612729 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:56:51.612729 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:56:51.612729 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:56:51.612729 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:56:51.612729 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:56:51.612729 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 17:56:51.612729 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 17:56:51.612729 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 17:56:51.612729 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 17:56:51.612729 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 17:56:51.612729 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 17:56:51.612729 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 17:56:51.612729 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 17:56:51.612729 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 17:56:51.612729 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 17:56:51.612729 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 17:56:51.612729 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 17:56:51.612729 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 17:56:51.612729 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 17:56:51.612729 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 17:56:51.654306 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 17:56:51.654306 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 17:56:51.654306 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:56:51.654306 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:56:51.654306 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 17:56:51.654306 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 17:56:51.654306 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:56:51.654306 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:56:51.654306 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:56:51.654306 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:56:51.654306 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:56:51.654306 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:56:51.654306 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:56:51.654306 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:56:51.654306 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:56:51.654306 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:56:51.654306 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 17:56:51.654306 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 17:56:51.654306 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 17:56:51.654306 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 17:56:51.654306 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 17:56:51.654306 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 17:56:51.654306 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 17:56:51.654306 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 17:56:51.654306 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 17:56:51.654306 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 17:56:51.654306 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 17:56:51.654306 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 17:56:51.654306 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 17:56:51.654306 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 17:56:51.654306 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 17:56:51.654306 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 17:56:51.654306 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 17:56:51.654306 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 17:56:51.654306 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 17:56:51.654306 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 17:56:51.654306 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 17:56:51.654306 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 17:56:51.654306 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 17:56:51.654306 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 17:56:51.654306 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 17:56:51.654306 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 17:56:51.654306 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-c142aef1-4fa9-4d3e-b83d-d567747263d1) Aug 10 17:56:51.654306 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:56:51.654306 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:56:51.654306 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:56:51.654306 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:56:51.654306 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:56:51.654306 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:56:51.654306 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:56:51.654306 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:56:51.654306 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 10 17:56:51.654306 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 10 17:56:51.658353 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:56:51.658353 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:56:51.658353 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:56:51.658353 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:56:51.658353 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:56:51.658353 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:56:51.658353 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:56:51.658353 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:56:51.658353 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:56:51.658353 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:56:51.658353 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:56:51.658353 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:56:51.658353 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:56:51.658353 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-3df49046-edc4-4c5e-8d54-210f81c17968 tempest-VolumesAdminNegativeTest-28848144 tempest-VolumesAdminNegativeTest-28848144-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:56:51.658353 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:56:51.658353 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-3df49046-edc4-4c5e-8d54-210f81c17968 tempest-VolumesAdminNegativeTest-28848144 tempest-VolumesAdminNegativeTest-28848144-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.091001 Aug 10 17:56:51.658353 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 790/1566] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 17:56:50 2022] POST /compute/v2.1/servers => generated 214 bytes in 1097 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 10 17:56:51.661942 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-6fd73866-b26d-47ed-a618-5dad41825358 tempest-VolumesAdminNegativeTest-28848144 tempest-VolumesAdminNegativeTest-28848144-project] Calling method '.version_select at 0x7fb345f1baf0>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:56:51.825204 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-6fd73866-b26d-47ed-a618-5dad41825358 tempest-VolumesAdminNegativeTest-28848144 tempest-VolumesAdminNegativeTest-28848144-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1087527284" status: 202 len: 0 microversion: 2.1 time: 0.187892 Aug 10 17:56:51.826411 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 791/1567] 10.222.0.50 () {58 vars in 1221 bytes} [Wed Aug 10 17:56:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1087527284 => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 17:56:51.917155 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-a066b9f8-4711-4745-af37-dd9e2627fd50 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '.version_select at 0x7fb345e67940>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:56:52.093991 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-a066b9f8-4711-4745-af37-dd9e2627fd50 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/images/23574b56-3268-4f53-afb9-8d4a9946cf3c" status: 200 len: 1454 microversion: 2.1 time: 0.184429 Aug 10 17:56:52.101381 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 792/1568] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:56:51 2022] GET /compute/v2.1/images/23574b56-3268-4f53-afb9-8d4a9946cf3c => generated 1454 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:56:53.110709 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-cd0e00dc-c9fa-40d7-a042-22e68767d06d tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '.version_select at 0x7fb345eba160>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:56:53.198944 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-cd0e00dc-c9fa-40d7-a042-22e68767d06d tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/images/23574b56-3268-4f53-afb9-8d4a9946cf3c" status: 200 len: 1454 microversion: 2.1 time: 0.093298 Aug 10 17:56:53.208825 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 793/1569] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:56:53 2022] GET /compute/v2.1/images/23574b56-3268-4f53-afb9-8d4a9946cf3c => generated 1454 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:56:54.215325 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-8c6d53ac-ff39-4c24-8055-9e0495c6444d tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '.version_select at 0x7fb345e25af0>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:56:54.299443 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-8c6d53ac-ff39-4c24-8055-9e0495c6444d tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/images/23574b56-3268-4f53-afb9-8d4a9946cf3c" status: 200 len: 1454 microversion: 2.1 time: 0.088161 Aug 10 17:56:54.304032 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 794/1570] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:56:54 2022] GET /compute/v2.1/images/23574b56-3268-4f53-afb9-8d4a9946cf3c => generated 1454 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:56:55.321553 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-911a14b8-70f4-48ef-9bd3-83917c23cfd3 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-824554143", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": "none"}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:56:55.456665 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.virt.hardware [None req-911a14b8-70f4-48ef-9bd3-83917c23cfd3 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Flavor limits 0:0:0 {{(pid=129409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 17:56:55.457418 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.virt.hardware [None req-911a14b8-70f4-48ef-9bd3-83917c23cfd3 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Image limits 0:0:0 {{(pid=129409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 17:56:55.458088 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.virt.hardware [None req-911a14b8-70f4-48ef-9bd3-83917c23cfd3 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Flavor pref 0:0:0 {{(pid=129409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 17:56:55.458704 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.virt.hardware [None req-911a14b8-70f4-48ef-9bd3-83917c23cfd3 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Image pref 0:0:0 {{(pid=129409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 17:56:55.459420 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.virt.hardware [None req-911a14b8-70f4-48ef-9bd3-83917c23cfd3 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 17:56:55.481899 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-911a14b8-70f4-48ef-9bd3-83917c23cfd3 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:56:55.486114 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-911a14b8-70f4-48ef-9bd3-83917c23cfd3 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:56:55.487260 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-911a14b8-70f4-48ef-9bd3-83917c23cfd3 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:56:55.488337 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-911a14b8-70f4-48ef-9bd3-83917c23cfd3 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:56:55.490185 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-911a14b8-70f4-48ef-9bd3-83917c23cfd3 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:56:55.492436 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-911a14b8-70f4-48ef-9bd3-83917c23cfd3 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:56:55.552777 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-911a14b8-70f4-48ef-9bd3-83917c23cfd3 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Getting quotas for project 27ed2f8b25bd416eabdae76d5a00f617. Resources: {'instances', 'ram', 'cores'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:56:55.570600 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-911a14b8-70f4-48ef-9bd3-83917c23cfd3 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Getting quotas for user d3685f6eee4246ea92927a3a9734fa0f and project 27ed2f8b25bd416eabdae76d5a00f617. Resources: {'instances', 'ram', 'cores'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:56:55.606620 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-911a14b8-70f4-48ef-9bd3-83917c23cfd3 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Going to run 1 instances... {{(pid=129409) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 17:56:55.609488 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-911a14b8-70f4-48ef-9bd3-83917c23cfd3 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] [instance: 8982abdf-f7e7-4bde-9c9f-3b00b0be653f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a735ff26-463a-4ffe-a981-ab9d9baa494f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 17:56:55.815447 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-911a14b8-70f4-48ef-9bd3-83917c23cfd3 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.765924 Aug 10 17:56:55.838713 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 795/1571] 10.222.0.50 () {62 vars in 1188 bytes} [Wed Aug 10 17:56:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 790 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 10 17:56:55.849527 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [req-c7531551-8a67-412b-986b-b56ede6e72b5 req-a2f2075e-f3bf-45b0-b103-5610b0c1decf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd4d671c-5a1f-463d-8bec-cd4f7614479f", "name": "network-vif-plugged", "status": "completed", "tag": "04dec7b8-0911-42c4-b8b2-bdf1fecdec04"}]} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:56:55.915485 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-c7531551-8a67-412b-986b-b56ede6e72b5 req-a2f2075e-f3bf-45b0-b103-5610b0c1decf service nova] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:56:55.916088 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-c7531551-8a67-412b-986b-b56ede6e72b5 req-a2f2075e-f3bf-45b0-b103-5610b0c1decf service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:56:55.919705 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-c7531551-8a67-412b-986b-b56ede6e72b5 req-a2f2075e-f3bf-45b0-b103-5610b0c1decf service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:56:55.948109 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.compute.server_external_events [req-c7531551-8a67-412b-986b-b56ede6e72b5 req-a2f2075e-f3bf-45b0-b103-5610b0c1decf service nova] Creating event network-vif-plugged:04dec7b8-0911-42c4-b8b2-bdf1fecdec04 for instance dd4d671c-5a1f-463d-8bec-cd4f7614479f on n-h2-852296-2 Aug 10 17:56:55.958360 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [req-c7531551-8a67-412b-986b-b56ede6e72b5 req-a2f2075e-f3bf-45b0-b103-5610b0c1decf service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117982 Aug 10 17:56:55.960727 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 796/1572] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 10 17:56:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:56:55.967752 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-81d64505-e30c-4727-8ba7-b03a0740c49a tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '.version_select at 0x7fb345e25ee0>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:56:56.051670 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-81d64505-e30c-4727-8ba7-b03a0740c49a tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/images/23574b56-3268-4f53-afb9-8d4a9946cf3c" status: 200 len: 1454 microversion: 2.1 time: 0.089217 Aug 10 17:56:56.060677 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 797/1573] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:56:55 2022] GET /compute/v2.1/images/23574b56-3268-4f53-afb9-8d4a9946cf3c => generated 1454 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:56:56.068578 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-f8bc8f0c-d705-484b-ac43-eea58af032df tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:56:56.071587 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-f8bc8f0c-d705-484b-ac43-eea58af032df tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] [instance: 8982abdf-f7e7-4bde-9c9f-3b00b0be653f] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:56:56.316801 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-f8bc8f0c-d705-484b-ac43-eea58af032df tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3685f6eee4246ea92927a3a9734fa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ed2f8b25bd416eabdae76d5a00f617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:56:56.333072 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-f8bc8f0c-d705-484b-ac43-eea58af032df tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3685f6eee4246ea92927a3a9734fa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ed2f8b25bd416eabdae76d5a00f617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:56:56.334811 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-f8bc8f0c-d705-484b-ac43-eea58af032df tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3685f6eee4246ea92927a3a9734fa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ed2f8b25bd416eabdae76d5a00f617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:56:56.360727 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-f8bc8f0c-d705-484b-ac43-eea58af032df tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] 10.222.0.50 "GET /compute/v2.1/servers/8982abdf-f7e7-4bde-9c9f-3b00b0be653f" status: 200 len: 1280 microversion: 2.47 time: 0.274096 Aug 10 17:56:56.373097 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 798/1574] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:56:56 2022] GET /compute/v2.1/servers/8982abdf-f7e7-4bde-9c9f-3b00b0be653f => generated 1280 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:56:57.068392 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-b87f9a6b-d627-45d1-9a5a-d3534cbbc99b tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '.version_select at 0x7fb345ebe4c0>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:56:57.205016 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-b87f9a6b-d627-45d1-9a5a-d3534cbbc99b tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/images/23574b56-3268-4f53-afb9-8d4a9946cf3c" status: 200 len: 1454 microversion: 2.1 time: 0.141482 Aug 10 17:56:57.207883 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 799/1575] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:56:57 2022] GET /compute/v2.1/images/23574b56-3268-4f53-afb9-8d4a9946cf3c => generated 1454 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:56:57.394022 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-43d25aa8-ea45-433e-9c85-8ecf1e29d911 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:56:57.394716 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-43d25aa8-ea45-433e-9c85-8ecf1e29d911 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] [instance: 8982abdf-f7e7-4bde-9c9f-3b00b0be653f] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:56:57.753425 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-43d25aa8-ea45-433e-9c85-8ecf1e29d911 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3685f6eee4246ea92927a3a9734fa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ed2f8b25bd416eabdae76d5a00f617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:56:57.775603 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-43d25aa8-ea45-433e-9c85-8ecf1e29d911 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3685f6eee4246ea92927a3a9734fa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ed2f8b25bd416eabdae76d5a00f617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:56:57.778214 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-43d25aa8-ea45-433e-9c85-8ecf1e29d911 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3685f6eee4246ea92927a3a9734fa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ed2f8b25bd416eabdae76d5a00f617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:56:57.779632 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-43d25aa8-ea45-433e-9c85-8ecf1e29d911 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] 10.222.0.50 "GET /compute/v2.1/servers/8982abdf-f7e7-4bde-9c9f-3b00b0be653f" status: 200 len: 1280 microversion: 2.47 time: 0.394806 Aug 10 17:56:57.780482 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 800/1576] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:56:57 2022] GET /compute/v2.1/servers/8982abdf-f7e7-4bde-9c9f-3b00b0be653f => generated 1280 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:56:58.225858 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-d35283b9-7d66-406d-80ed-68631999d44b tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '.version_select at 0x7fb345e67c10>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:56:58.328778 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-d35283b9-7d66-406d-80ed-68631999d44b tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/images/23574b56-3268-4f53-afb9-8d4a9946cf3c" status: 200 len: 1454 microversion: 2.1 time: 0.107772 Aug 10 17:56:58.329955 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 801/1577] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:56:58 2022] GET /compute/v2.1/images/23574b56-3268-4f53-afb9-8d4a9946cf3c => generated 1454 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:56:58.804990 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-9c635e12-841e-444f-afc2-f38fc11e4a48 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:56:58.805597 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-9c635e12-841e-444f-afc2-f38fc11e4a48 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] [instance: 8982abdf-f7e7-4bde-9c9f-3b00b0be653f] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:56:58.820319 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-9c635e12-841e-444f-afc2-f38fc11e4a48 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:56:58.820834 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-9c635e12-841e-444f-afc2-f38fc11e4a48 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:56:58.821336 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-9c635e12-841e-444f-afc2-f38fc11e4a48 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:56:58.822316 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-9c635e12-841e-444f-afc2-f38fc11e4a48 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:56:58.825643 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-9c635e12-841e-444f-afc2-f38fc11e4a48 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:56:58.826289 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-9c635e12-841e-444f-afc2-f38fc11e4a48 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:56:59.078878 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-5aaa03a2-076e-4e0e-83f6-9d6a5f0acc6c tempest-FloatingIPDetailsTestJSON-1800554695 tempest-FloatingIPDetailsTestJSON-1800554695-project] 10.222.0.50 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 8.186389 Aug 10 17:56:59.079837 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 777/1578] 10.222.0.50 () {60 vars in 1170 bytes} [Wed Aug 10 17:56:50 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 8189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:56:59.109782 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-bd29185c-4dc2-4a7a-9bbc-caf7db797281 tempest-FloatingIPDetailsTestJSON-1800554695 tempest-FloatingIPDetailsTestJSON-1800554695-project] Action: 'create', calling method: .version_select at 0x7fb3459d6280>, body: {"pool": null} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:56:59.250101 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-9c635e12-841e-444f-afc2-f38fc11e4a48 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3685f6eee4246ea92927a3a9734fa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ed2f8b25bd416eabdae76d5a00f617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:56:59.272808 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-9c635e12-841e-444f-afc2-f38fc11e4a48 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3685f6eee4246ea92927a3a9734fa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ed2f8b25bd416eabdae76d5a00f617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:56:59.275111 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-9c635e12-841e-444f-afc2-f38fc11e4a48 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3685f6eee4246ea92927a3a9734fa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ed2f8b25bd416eabdae76d5a00f617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:56:59.282492 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-9c635e12-841e-444f-afc2-f38fc11e4a48 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] 10.222.0.50 "GET /compute/v2.1/servers/8982abdf-f7e7-4bde-9c9f-3b00b0be653f" status: 200 len: 1276 microversion: 2.47 time: 0.476698 Aug 10 17:56:59.287145 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 802/1579] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:56:58 2022] GET /compute/v2.1/servers/8982abdf-f7e7-4bde-9c9f-3b00b0be653f => generated 1276 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:56:59.345091 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-7a1374e1-334c-4c3a-b1c8-8eb1f7e045cb tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '.version_select at 0x7fb345eba940>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:56:59.519176 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-7a1374e1-334c-4c3a-b1c8-8eb1f7e045cb tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/images/23574b56-3268-4f53-afb9-8d4a9946cf3c" status: 200 len: 1454 microversion: 2.1 time: 0.178399 Aug 10 17:56:59.526967 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 803/1580] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:56:59 2022] GET /compute/v2.1/images/23574b56-3268-4f53-afb9-8d4a9946cf3c => generated 1454 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:57:00.314860 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-10ade45e-067a-4b1e-8c30-18af1197b4c5 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:57:00.315481 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-10ade45e-067a-4b1e-8c30-18af1197b4c5 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] [instance: 8982abdf-f7e7-4bde-9c9f-3b00b0be653f] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:57:00.325080 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-10ade45e-067a-4b1e-8c30-18af1197b4c5 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:57:00.325586 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-10ade45e-067a-4b1e-8c30-18af1197b4c5 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:57:00.326037 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-10ade45e-067a-4b1e-8c30-18af1197b4c5 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:57:00.326769 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-10ade45e-067a-4b1e-8c30-18af1197b4c5 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:57:00.327245 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-10ade45e-067a-4b1e-8c30-18af1197b4c5 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:57:00.327724 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-10ade45e-067a-4b1e-8c30-18af1197b4c5 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:57:00.620776 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-10ade45e-067a-4b1e-8c30-18af1197b4c5 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3685f6eee4246ea92927a3a9734fa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ed2f8b25bd416eabdae76d5a00f617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:57:00.632078 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-10ade45e-067a-4b1e-8c30-18af1197b4c5 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3685f6eee4246ea92927a3a9734fa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ed2f8b25bd416eabdae76d5a00f617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:57:00.645981 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-10ade45e-067a-4b1e-8c30-18af1197b4c5 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3685f6eee4246ea92927a3a9734fa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ed2f8b25bd416eabdae76d5a00f617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:57:00.663239 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-10ade45e-067a-4b1e-8c30-18af1197b4c5 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] 10.222.0.50 "GET /compute/v2.1/servers/8982abdf-f7e7-4bde-9c9f-3b00b0be653f" status: 200 len: 1340 microversion: 2.47 time: 0.353163 Aug 10 17:57:00.677164 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:57:00.683666 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 804/1581] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:57:00 2022] GET /compute/v2.1/servers/8982abdf-f7e7-4bde-9c9f-3b00b0be653f => generated 1340 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 17:57:00.691694 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-23533ccd-22fe-48f6-b773-2fd0e58d3aa0 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '.version_select at 0x7fb345ebe0d0>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:57:00.725802 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:57:00.818758 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-23533ccd-22fe-48f6-b773-2fd0e58d3aa0 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/images/23574b56-3268-4f53-afb9-8d4a9946cf3c" status: 200 len: 1454 microversion: 2.1 time: 0.123099 Aug 10 17:57:00.824160 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 805/1582] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:57:00 2022] GET /compute/v2.1/images/23574b56-3268-4f53-afb9-8d4a9946cf3c => generated 1454 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:57:01.694455 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-993b0aca-809a-4293-b081-8b010aa6f51d tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:57:01.695993 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-993b0aca-809a-4293-b081-8b010aa6f51d tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] [instance: 8982abdf-f7e7-4bde-9c9f-3b00b0be653f] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:57:01.703053 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_api:SELECT=43,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:57:01.706346 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-993b0aca-809a-4293-b081-8b010aa6f51d tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:57:01.707126 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-993b0aca-809a-4293-b081-8b010aa6f51d tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:57:01.707765 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-993b0aca-809a-4293-b081-8b010aa6f51d tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:57:01.708722 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-993b0aca-809a-4293-b081-8b010aa6f51d tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:57:01.709410 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-993b0aca-809a-4293-b081-8b010aa6f51d tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:57:01.710036 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-993b0aca-809a-4293-b081-8b010aa6f51d tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:57:02.036522 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-993b0aca-809a-4293-b081-8b010aa6f51d tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3685f6eee4246ea92927a3a9734fa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ed2f8b25bd416eabdae76d5a00f617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:57:02.051456 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-993b0aca-809a-4293-b081-8b010aa6f51d tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3685f6eee4246ea92927a3a9734fa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ed2f8b25bd416eabdae76d5a00f617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:57:02.059148 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-993b0aca-809a-4293-b081-8b010aa6f51d tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3685f6eee4246ea92927a3a9734fa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ed2f8b25bd416eabdae76d5a00f617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:57:02.060904 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-993b0aca-809a-4293-b081-8b010aa6f51d tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] 10.222.0.50 "GET /compute/v2.1/servers/8982abdf-f7e7-4bde-9c9f-3b00b0be653f" status: 200 len: 1338 microversion: 2.47 time: 0.374488 Aug 10 17:57:02.086262 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 806/1583] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:57:01 2022] GET /compute/v2.1/servers/8982abdf-f7e7-4bde-9c9f-3b00b0be653f => generated 1338 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 17:57:02.102624 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-e87bf3fb-8704-491b-869f-cb71e56f9929 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '.version_select at 0x7fb345e25700>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:57:02.204751 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-e87bf3fb-8704-491b-869f-cb71e56f9929 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/images/23574b56-3268-4f53-afb9-8d4a9946cf3c" status: 200 len: 1454 microversion: 2.1 time: 0.116665 Aug 10 17:57:02.214100 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 807/1584] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:57:02 2022] GET /compute/v2.1/images/23574b56-3268-4f53-afb9-8d4a9946cf3c => generated 1454 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:57:03.086950 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-18c2e047-93b1-4318-82a5-2204f2750984 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:57:03.088436 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-18c2e047-93b1-4318-82a5-2204f2750984 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] [instance: 8982abdf-f7e7-4bde-9c9f-3b00b0be653f] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:57:03.097669 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-18c2e047-93b1-4318-82a5-2204f2750984 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:57:03.098421 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-18c2e047-93b1-4318-82a5-2204f2750984 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:57:03.100974 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-18c2e047-93b1-4318-82a5-2204f2750984 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:57:03.102102 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-18c2e047-93b1-4318-82a5-2204f2750984 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:57:03.102802 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-18c2e047-93b1-4318-82a5-2204f2750984 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:57:03.104519 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-18c2e047-93b1-4318-82a5-2204f2750984 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:57:03.383454 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-18c2e047-93b1-4318-82a5-2204f2750984 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3685f6eee4246ea92927a3a9734fa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ed2f8b25bd416eabdae76d5a00f617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:57:03.391731 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:57:03.397395 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-18c2e047-93b1-4318-82a5-2204f2750984 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3685f6eee4246ea92927a3a9734fa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ed2f8b25bd416eabdae76d5a00f617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:57:03.406185 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-18c2e047-93b1-4318-82a5-2204f2750984 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3685f6eee4246ea92927a3a9734fa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ed2f8b25bd416eabdae76d5a00f617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:57:03.414689 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-18c2e047-93b1-4318-82a5-2204f2750984 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] 10.222.0.50 "GET /compute/v2.1/servers/8982abdf-f7e7-4bde-9c9f-3b00b0be653f" status: 200 len: 1338 microversion: 2.47 time: 0.331370 Aug 10 17:57:03.415510 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 808/1585] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:57:03 2022] GET /compute/v2.1/servers/8982abdf-f7e7-4bde-9c9f-3b00b0be653f => generated 1338 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 17:57:03.440239 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-aa9289d4-8e4b-49a5-aad8-ee26570e191c tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '.version_select at 0x7fb345e253a0>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:57:03.559635 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-aa9289d4-8e4b-49a5-aad8-ee26570e191c tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/images/23574b56-3268-4f53-afb9-8d4a9946cf3c" status: 200 len: 1454 microversion: 2.1 time: 0.142899 Aug 10 17:57:03.560787 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 809/1586] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:57:03 2022] GET /compute/v2.1/images/23574b56-3268-4f53-afb9-8d4a9946cf3c => generated 1454 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:57:04.439922 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-537aa0e3-875e-4bcd-9705-161fa7db9932 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:57:04.440640 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-537aa0e3-875e-4bcd-9705-161fa7db9932 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] [instance: 8982abdf-f7e7-4bde-9c9f-3b00b0be653f] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:57:04.456871 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-537aa0e3-875e-4bcd-9705-161fa7db9932 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:57:04.457572 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-537aa0e3-875e-4bcd-9705-161fa7db9932 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:57:04.458304 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-537aa0e3-875e-4bcd-9705-161fa7db9932 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:57:04.459242 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-537aa0e3-875e-4bcd-9705-161fa7db9932 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:57:04.459913 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-537aa0e3-875e-4bcd-9705-161fa7db9932 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:57:04.464983 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-537aa0e3-875e-4bcd-9705-161fa7db9932 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:57:04.857630 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-bd29185c-4dc2-4a7a-9bbc-caf7db797281 tempest-FloatingIPDetailsTestJSON-1800554695 tempest-FloatingIPDetailsTestJSON-1800554695-project] 10.222.0.50 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 5.767325 Aug 10 17:57:04.858912 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 778/1587] 10.222.0.50 () {60 vars in 1170 bytes} [Wed Aug 10 17:56:59 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 5769 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:57:04.871281 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-537aa0e3-875e-4bcd-9705-161fa7db9932 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3685f6eee4246ea92927a3a9734fa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ed2f8b25bd416eabdae76d5a00f617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:57:04.887994 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-aa8cb769-d6bf-44c1-9df6-41cf3d1541d6 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '.version_select at 0x7fb3459d65e0>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:57:04.894251 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-537aa0e3-875e-4bcd-9705-161fa7db9932 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3685f6eee4246ea92927a3a9734fa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ed2f8b25bd416eabdae76d5a00f617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:57:04.895879 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-537aa0e3-875e-4bcd-9705-161fa7db9932 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3685f6eee4246ea92927a3a9734fa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ed2f8b25bd416eabdae76d5a00f617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:57:04.917213 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-537aa0e3-875e-4bcd-9705-161fa7db9932 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] 10.222.0.50 "GET /compute/v2.1/servers/8982abdf-f7e7-4bde-9c9f-3b00b0be653f" status: 200 len: 1338 microversion: 2.47 time: 0.482411 Aug 10 17:57:04.917811 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 810/1588] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:57:04 2022] GET /compute/v2.1/servers/8982abdf-f7e7-4bde-9c9f-3b00b0be653f => generated 1338 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 17:57:04.927574 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-3b3a8069-632e-40d9-bca7-041bb982f2cb tempest-FloatingIPDetailsTestJSON-1800554695 tempest-FloatingIPDetailsTestJSON-1800554695-project] Action: 'create', calling method: .version_select at 0x7fb345eba5e0>, body: {"pool": null} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:57:05.017021 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-aa8cb769-d6bf-44c1-9df6-41cf3d1541d6 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/images/23574b56-3268-4f53-afb9-8d4a9946cf3c" status: 200 len: 1454 microversion: 2.1 time: 0.142875 Aug 10 17:57:05.024096 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 779/1589] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:57:04 2022] GET /compute/v2.1/images/23574b56-3268-4f53-afb9-8d4a9946cf3c => generated 1454 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:57:05.525180 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_cell0:SELECT=2 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:57:05.950200 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-e8e9de91-189b-428f-972b-1f96a01b8deb tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:57:05.954848 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-e8e9de91-189b-428f-972b-1f96a01b8deb tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] [instance: 8982abdf-f7e7-4bde-9c9f-3b00b0be653f] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:57:05.986635 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e8e9de91-189b-428f-972b-1f96a01b8deb tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:57:05.987448 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e8e9de91-189b-428f-972b-1f96a01b8deb tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:57:05.990232 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e8e9de91-189b-428f-972b-1f96a01b8deb tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:57:05.991930 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e8e9de91-189b-428f-972b-1f96a01b8deb tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:57:05.994634 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e8e9de91-189b-428f-972b-1f96a01b8deb tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:57:05.998467 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e8e9de91-189b-428f-972b-1f96a01b8deb tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:57:06.461264 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-e8e9de91-189b-428f-972b-1f96a01b8deb tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3685f6eee4246ea92927a3a9734fa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ed2f8b25bd416eabdae76d5a00f617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:57:06.497468 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-e8e9de91-189b-428f-972b-1f96a01b8deb tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3685f6eee4246ea92927a3a9734fa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ed2f8b25bd416eabdae76d5a00f617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:57:06.500670 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-e8e9de91-189b-428f-972b-1f96a01b8deb tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3685f6eee4246ea92927a3a9734fa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ed2f8b25bd416eabdae76d5a00f617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:57:06.506526 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-e8e9de91-189b-428f-972b-1f96a01b8deb tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] 10.222.0.50 "GET /compute/v2.1/servers/8982abdf-f7e7-4bde-9c9f-3b00b0be653f" status: 200 len: 1359 microversion: 2.47 time: 0.561709 Aug 10 17:57:06.508475 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 780/1590] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:57:05 2022] GET /compute/v2.1/servers/8982abdf-f7e7-4bde-9c9f-3b00b0be653f => generated 1359 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:57:06.515339 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-3e72c0cf-8fc1-41fd-89c6-51f31e7db3c9 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '.version_select at 0x7fb3459d6b80>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:57:06.624779 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-3e72c0cf-8fc1-41fd-89c6-51f31e7db3c9 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/images/23574b56-3268-4f53-afb9-8d4a9946cf3c" status: 200 len: 1454 microversion: 2.1 time: 0.102643 Aug 10 17:57:06.624779 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 781/1591] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:57:06 2022] GET /compute/v2.1/images/23574b56-3268-4f53-afb9-8d4a9946cf3c => generated 1454 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:57:06.641800 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-b28064bd-33d7-44d7-85a9-c1043d3ad93a tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1832027875"}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:57:06.644677 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-b28064bd-33d7-44d7-85a9-c1043d3ad93a tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] [instance: 8982abdf-f7e7-4bde-9c9f-3b00b0be653f] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:57:06.662907 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b28064bd-33d7-44d7-85a9-c1043d3ad93a tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:57:06.665743 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b28064bd-33d7-44d7-85a9-c1043d3ad93a tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:57:06.666196 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b28064bd-33d7-44d7-85a9-c1043d3ad93a tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:57:06.668090 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b28064bd-33d7-44d7-85a9-c1043d3ad93a tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:57:06.672174 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b28064bd-33d7-44d7-85a9-c1043d3ad93a tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:57:06.672905 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b28064bd-33d7-44d7-85a9-c1043d3ad93a tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:57:07.370095 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-b28064bd-33d7-44d7-85a9-c1043d3ad93a tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] 10.222.0.50 "POST /compute/v2.1/servers/8982abdf-f7e7-4bde-9c9f-3b00b0be653f/action" status: 202 len: 52 microversion: 2.47 time: 0.741790 Aug 10 17:57:07.372846 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 782/1592] 10.222.0.50 () {62 vars in 1319 bytes} [Wed Aug 10 17:57:06 2022] POST /compute/v2.1/servers/8982abdf-f7e7-4bde-9c9f-3b00b0be653f/action => generated 52 bytes in 757 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Aug 10 17:57:07.400645 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-9a59aee7-bfc7-43f1-b555-5c62d1822442 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:57:07.408008 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-9a59aee7-bfc7-43f1-b555-5c62d1822442 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] [instance: 8982abdf-f7e7-4bde-9c9f-3b00b0be653f] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:57:07.422190 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-9a59aee7-bfc7-43f1-b555-5c62d1822442 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:57:07.422925 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-9a59aee7-bfc7-43f1-b555-5c62d1822442 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:57:07.425491 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-9a59aee7-bfc7-43f1-b555-5c62d1822442 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:57:07.426421 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-9a59aee7-bfc7-43f1-b555-5c62d1822442 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:57:07.428657 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-9a59aee7-bfc7-43f1-b555-5c62d1822442 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:57:07.430517 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-9a59aee7-bfc7-43f1-b555-5c62d1822442 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:57:07.537429 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-9a59aee7-bfc7-43f1-b555-5c62d1822442 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] [instance: 8982abdf-f7e7-4bde-9c9f-3b00b0be653f] Going to try to terminate instance {{(pid=129410) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 17:57:07.758477 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_cell0:SELECT=10 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:57:08.461695 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-9a59aee7-bfc7-43f1-b555-5c62d1822442 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] 10.222.0.50 "DELETE /compute/v2.1/servers/8982abdf-f7e7-4bde-9c9f-3b00b0be653f" status: 204 len: 0 microversion: 2.47 time: 1.072851 Aug 10 17:57:08.468316 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 783/1593] 10.222.0.50 () {60 vars in 1280 bytes} [Wed Aug 10 17:57:07 2022] DELETE /compute/v2.1/servers/8982abdf-f7e7-4bde-9c9f-3b00b0be653f => generated 0 bytes in 1084 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 10 17:57:08.473118 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-57c5fade-53ad-403b-8f19-8a1657224cee tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '.version_select at 0x7fb345bfb700>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:57:08.543692 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-57c5fade-53ad-403b-8f19-8a1657224cee tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/images/23574b56-3268-4f53-afb9-8d4a9946cf3c" status: 200 len: 1454 microversion: 2.1 time: 0.075688 Aug 10 17:57:08.544670 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 784/1594] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:57:08 2022] GET /compute/v2.1/images/23574b56-3268-4f53-afb9-8d4a9946cf3c => generated 1454 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:57:08.550429 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-73844a34-cd43-42f1-bd6c-6a7d3e672f04 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:57:08.551396 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-73844a34-cd43-42f1-bd6c-6a7d3e672f04 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] [instance: 8982abdf-f7e7-4bde-9c9f-3b00b0be653f] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:57:08.559604 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-73844a34-cd43-42f1-bd6c-6a7d3e672f04 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:57:08.560375 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-73844a34-cd43-42f1-bd6c-6a7d3e672f04 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:57:08.560991 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-73844a34-cd43-42f1-bd6c-6a7d3e672f04 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:57:08.564962 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-73844a34-cd43-42f1-bd6c-6a7d3e672f04 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:57:08.567464 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-73844a34-cd43-42f1-bd6c-6a7d3e672f04 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:57:08.571543 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-73844a34-cd43-42f1-bd6c-6a7d3e672f04 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:57:08.596470 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-3b3a8069-632e-40d9-bca7-041bb982f2cb tempest-FloatingIPDetailsTestJSON-1800554695 tempest-FloatingIPDetailsTestJSON-1800554695-project] 10.222.0.50 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.672498 Aug 10 17:57:08.599019 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 811/1595] 10.222.0.50 () {60 vars in 1170 bytes} [Wed Aug 10 17:57:04 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3681 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:57:08.615376 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-3f1b3b56-4cde-4550-b272-0041d612f288 tempest-FloatingIPDetailsTestJSON-1800554695 tempest-FloatingIPDetailsTestJSON-1800554695-project] Action: 'create', calling method: .version_select at 0x7fb345ebaaf0>, body: {"pool": null} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:57:08.737809 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-73844a34-cd43-42f1-bd6c-6a7d3e672f04 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3685f6eee4246ea92927a3a9734fa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ed2f8b25bd416eabdae76d5a00f617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:57:08.761391 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-73844a34-cd43-42f1-bd6c-6a7d3e672f04 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3685f6eee4246ea92927a3a9734fa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ed2f8b25bd416eabdae76d5a00f617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:57:08.766669 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-73844a34-cd43-42f1-bd6c-6a7d3e672f04 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3685f6eee4246ea92927a3a9734fa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ed2f8b25bd416eabdae76d5a00f617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:57:08.774063 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-73844a34-cd43-42f1-bd6c-6a7d3e672f04 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] 10.222.0.50 "GET /compute/v2.1/servers/8982abdf-f7e7-4bde-9c9f-3b00b0be653f" status: 200 len: 1365 microversion: 2.47 time: 0.222471 Aug 10 17:57:08.774063 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 785/1596] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:57:08 2022] GET /compute/v2.1/servers/8982abdf-f7e7-4bde-9c9f-3b00b0be653f => generated 1365 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:57:09.566158 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-184da8cc-ff9b-4d71-8b78-525c5d467cfb tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '.version_select at 0x7fb345a3e160>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:57:09.644074 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-184da8cc-ff9b-4d71-8b78-525c5d467cfb tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/images/23574b56-3268-4f53-afb9-8d4a9946cf3c" status: 200 len: 1454 microversion: 2.1 time: 0.086296 Aug 10 17:57:09.647978 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 786/1597] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:57:09 2022] GET /compute/v2.1/images/23574b56-3268-4f53-afb9-8d4a9946cf3c => generated 1454 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:57:09.796606 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-762d70b0-4d46-481e-84ba-70df055dc351 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:57:09.798816 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-762d70b0-4d46-481e-84ba-70df055dc351 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] [instance: 8982abdf-f7e7-4bde-9c9f-3b00b0be653f] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:57:09.825396 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-762d70b0-4d46-481e-84ba-70df055dc351 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:57:09.833164 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-762d70b0-4d46-481e-84ba-70df055dc351 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:57:09.839054 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-762d70b0-4d46-481e-84ba-70df055dc351 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:57:09.847588 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-762d70b0-4d46-481e-84ba-70df055dc351 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:57:09.853627 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-762d70b0-4d46-481e-84ba-70df055dc351 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:57:09.854407 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-762d70b0-4d46-481e-84ba-70df055dc351 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:57:10.724426 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-762d70b0-4d46-481e-84ba-70df055dc351 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3685f6eee4246ea92927a3a9734fa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ed2f8b25bd416eabdae76d5a00f617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:57:10.736786 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-762d70b0-4d46-481e-84ba-70df055dc351 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3685f6eee4246ea92927a3a9734fa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ed2f8b25bd416eabdae76d5a00f617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:57:10.739497 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-762d70b0-4d46-481e-84ba-70df055dc351 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3685f6eee4246ea92927a3a9734fa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ed2f8b25bd416eabdae76d5a00f617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:57:10.741027 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-762d70b0-4d46-481e-84ba-70df055dc351 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] 10.222.0.50 "GET /compute/v2.1/servers/8982abdf-f7e7-4bde-9c9f-3b00b0be653f" status: 200 len: 1365 microversion: 2.47 time: 0.949265 Aug 10 17:57:10.741961 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 787/1598] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:57:09 2022] GET /compute/v2.1/servers/8982abdf-f7e7-4bde-9c9f-3b00b0be653f => generated 1365 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:57:10.748301 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-82d2dd39-0aa9-4612-b060-a82c5156865f tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '.version_select at 0x7fb345bfb280>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:57:11.141944 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-82d2dd39-0aa9-4612-b060-a82c5156865f tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/images/23574b56-3268-4f53-afb9-8d4a9946cf3c" status: 200 len: 1454 microversion: 2.1 time: 0.398083 Aug 10 17:57:11.143384 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 788/1599] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:57:10 2022] GET /compute/v2.1/images/23574b56-3268-4f53-afb9-8d4a9946cf3c => generated 1454 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:57:11.766336 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-84e46857-fc46-490f-95ce-cabf712eedf0 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:57:11.767775 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-84e46857-fc46-490f-95ce-cabf712eedf0 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] [instance: 8982abdf-f7e7-4bde-9c9f-3b00b0be653f] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:57:11.788956 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-84e46857-fc46-490f-95ce-cabf712eedf0 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:57:11.789799 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-84e46857-fc46-490f-95ce-cabf712eedf0 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:57:11.791423 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-84e46857-fc46-490f-95ce-cabf712eedf0 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:57:11.793784 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-84e46857-fc46-490f-95ce-cabf712eedf0 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:57:11.798715 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-84e46857-fc46-490f-95ce-cabf712eedf0 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:57:11.799399 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-84e46857-fc46-490f-95ce-cabf712eedf0 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:57:12.045932 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-84e46857-fc46-490f-95ce-cabf712eedf0 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3685f6eee4246ea92927a3a9734fa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ed2f8b25bd416eabdae76d5a00f617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:57:12.067228 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-84e46857-fc46-490f-95ce-cabf712eedf0 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3685f6eee4246ea92927a3a9734fa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ed2f8b25bd416eabdae76d5a00f617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:57:12.069092 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-84e46857-fc46-490f-95ce-cabf712eedf0 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3685f6eee4246ea92927a3a9734fa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ed2f8b25bd416eabdae76d5a00f617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:57:12.070535 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-84e46857-fc46-490f-95ce-cabf712eedf0 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] 10.222.0.50 "GET /compute/v2.1/servers/8982abdf-f7e7-4bde-9c9f-3b00b0be653f" status: 200 len: 1365 microversion: 2.47 time: 0.309625 Aug 10 17:57:12.072141 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 789/1600] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:57:11 2022] GET /compute/v2.1/servers/8982abdf-f7e7-4bde-9c9f-3b00b0be653f => generated 1365 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:57:12.160466 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-8db01fb2-e71e-4c96-9609-8f4a5e409d10 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '.version_select at 0x7fb345bc4280>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:57:12.176480 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-3f1b3b56-4cde-4550-b272-0041d612f288 tempest-FloatingIPDetailsTestJSON-1800554695 tempest-FloatingIPDetailsTestJSON-1800554695-project] 10.222.0.50 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.563595 Aug 10 17:57:12.176480 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 812/1601] 10.222.0.50 () {60 vars in 1170 bytes} [Wed Aug 10 17:57:08 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3567 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:57:12.198404 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-e5d996f8-56b6-4cbd-8f4c-ce0d7ffa40f9 tempest-FloatingIPDetailsTestJSON-1800554695 tempest-FloatingIPDetailsTestJSON-1800554695-project] Calling method '.version_select at 0x7fb345ebeee0>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:57:12.244620 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-8db01fb2-e71e-4c96-9609-8f4a5e409d10 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/images/23574b56-3268-4f53-afb9-8d4a9946cf3c" status: 200 len: 1454 microversion: 2.1 time: 0.089907 Aug 10 17:57:12.245210 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 790/1602] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:57:12 2022] GET /compute/v2.1/images/23574b56-3268-4f53-afb9-8d4a9946cf3c => generated 1454 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:57:12.698608 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-bbf9a81c-5bfb-4d97-b5b2-95ca14039c63 tempest-ServersTestFqdnHostnames-196460502 tempest-ServersTestFqdnHostnames-196460502-project] Action: 'create', calling method: .version_select at 0x7fb3459e9670>, body: {"keypair": {"name": "tempest-keypair-480646501", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFNZCQreiWVlB5yOz9TL4H3WEUW/1qqbMxwi89y7wgy4KXm+LlTxRF9ye+hdNG1/mWSPAUd0USTXmAQK3FN5wPK6/wtjZF/rTO+kQjXbi7q2t67b5XptZkP2WZLCOW1I5Q=="}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:57:12.729049 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.quota [None req-bbf9a81c-5bfb-4d97-b5b2-95ca14039c63 tempest-ServersTestFqdnHostnames-196460502 tempest-ServersTestFqdnHostnames-196460502-project] Getting quotas for project 177dad7c9b8647c781a48e60c9fb6001. Resources: {'key_pairs'} {{(pid=129410) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:57:12.752728 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.quota [None req-bbf9a81c-5bfb-4d97-b5b2-95ca14039c63 tempest-ServersTestFqdnHostnames-196460502 tempest-ServersTestFqdnHostnames-196460502-project] Getting quotas for user e20517d0eab041238e2736a9c636ca66 and project 177dad7c9b8647c781a48e60c9fb6001. Resources: {'key_pairs'} {{(pid=129410) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:57:12.915357 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-bbf9a81c-5bfb-4d97-b5b2-95ca14039c63 tempest-ServersTestFqdnHostnames-196460502 tempest-ServersTestFqdnHostnames-196460502-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.440850 Aug 10 17:57:12.917039 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 791/1603] 10.222.0.50 () {60 vars in 1159 bytes} [Wed Aug 10 17:57:12 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:57:13.031997 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-e5d996f8-56b6-4cbd-8f4c-ce0d7ffa40f9 tempest-FloatingIPDetailsTestJSON-1800554695 tempest-FloatingIPDetailsTestJSON-1800554695-project] 10.222.0.50 "GET /compute/v2.1/os-floating-ips/ab107546-475b-4715-97df-878c745e3716" status: 200 len: 141 microversion: 2.1 time: 0.846903 Aug 10 17:57:13.039467 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 813/1604] 10.222.0.50 () {58 vars in 1260 bytes} [Wed Aug 10 17:57:12 2022] GET /compute/v2.1/os-floating-ips/ab107546-475b-4715-97df-878c745e3716 => generated 141 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:57:13.049309 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-f8e4a646-532b-44fc-84d3-43ec6e325110 tempest-FloatingIPDetailsTestJSON-1800554695 tempest-FloatingIPDetailsTestJSON-1800554695-project] Calling method '.version_select at 0x7fb345bc4c10>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:57:13.098268 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-c228bc08-2a09-4a72-a7ab-b298630cb259 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:57:13.099070 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-c228bc08-2a09-4a72-a7ab-b298630cb259 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] [instance: 8982abdf-f7e7-4bde-9c9f-3b00b0be653f] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:57:13.127329 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c228bc08-2a09-4a72-a7ab-b298630cb259 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:57:13.128116 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c228bc08-2a09-4a72-a7ab-b298630cb259 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:57:13.128592 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c228bc08-2a09-4a72-a7ab-b298630cb259 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:57:13.131788 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c228bc08-2a09-4a72-a7ab-b298630cb259 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:57:13.133299 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c228bc08-2a09-4a72-a7ab-b298630cb259 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:57:13.135275 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c228bc08-2a09-4a72-a7ab-b298630cb259 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:57:13.471960 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-c228bc08-2a09-4a72-a7ab-b298630cb259 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3685f6eee4246ea92927a3a9734fa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ed2f8b25bd416eabdae76d5a00f617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:57:13.485060 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-c228bc08-2a09-4a72-a7ab-b298630cb259 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3685f6eee4246ea92927a3a9734fa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ed2f8b25bd416eabdae76d5a00f617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:57:13.494471 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-c228bc08-2a09-4a72-a7ab-b298630cb259 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3685f6eee4246ea92927a3a9734fa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ed2f8b25bd416eabdae76d5a00f617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:57:13.499691 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-c228bc08-2a09-4a72-a7ab-b298630cb259 tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] 10.222.0.50 "GET /compute/v2.1/servers/8982abdf-f7e7-4bde-9c9f-3b00b0be653f" status: 200 len: 1365 microversion: 2.47 time: 0.406190 Aug 10 17:57:13.503806 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 814/1605] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:57:13 2022] GET /compute/v2.1/servers/8982abdf-f7e7-4bde-9c9f-3b00b0be653f => generated 1365 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:57:13.508900 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-3451811e-99eb-4459-951a-e831eb4d5d46 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '.version_select at 0x7fb345dfd940>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:57:13.599300 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-3451811e-99eb-4459-951a-e831eb4d5d46 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/images/23574b56-3268-4f53-afb9-8d4a9946cf3c" status: 200 len: 1454 microversion: 2.1 time: 0.094100 Aug 10 17:57:13.601259 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 815/1606] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:57:13 2022] GET /compute/v2.1/images/23574b56-3268-4f53-afb9-8d4a9946cf3c => generated 1454 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:57:14.530057 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-bdeb2dfe-6ed4-4135-850f-ff8d33a08c7e tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:57:14.535542 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-bdeb2dfe-6ed4-4135-850f-ff8d33a08c7e tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] [instance: 8982abdf-f7e7-4bde-9c9f-3b00b0be653f] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:57:14.545479 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-bdeb2dfe-6ed4-4135-850f-ff8d33a08c7e tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:57:14.551723 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-bdeb2dfe-6ed4-4135-850f-ff8d33a08c7e tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:57:14.552907 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-bdeb2dfe-6ed4-4135-850f-ff8d33a08c7e tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:57:14.556008 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-bdeb2dfe-6ed4-4135-850f-ff8d33a08c7e tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:57:14.559166 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-bdeb2dfe-6ed4-4135-850f-ff8d33a08c7e tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:57:14.559762 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-bdeb2dfe-6ed4-4135-850f-ff8d33a08c7e tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:57:14.596583 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-bdeb2dfe-6ed4-4135-850f-ff8d33a08c7e tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] HTTP exception thrown: Instance 8982abdf-f7e7-4bde-9c9f-3b00b0be653f could not be found. Aug 10 17:57:14.602673 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-bdeb2dfe-6ed4-4135-850f-ff8d33a08c7e tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Request method failure captured: Aug 10 17:57:14.602673 n-d-852296-2 devstack@n-api.service[129409]: request: GET /compute/v2.1/servers/8982abdf-f7e7-4bde-9c9f-3b00b0be653f HTTP/1.1 Aug 10 17:57:14.602673 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 17:57:14.602673 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 17:57:14.602673 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 17:57:14.602673 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 0 Aug 10 17:57:14.602673 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 17:57:14.602673 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 17:57:14.602673 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 17:57:14.602673 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 17:57:14.602673 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8_FmBKC6xChNAiNwympKFD2F25eL2uuViKGLaF5FJixIGG8p-M1_E6OA_wuUIF2trm_H6NzHp1hTilB2m6Y5M6S7ckG7kG3_ZR7NG3XCdrl6LJYiNS-08zeJSC1ImIqmm8NELYux53aIST8o5Qp47LqZYnEdaf_iaCorsKfHOUNTDkU Aug 10 17:57:14.602673 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 17:57:14.602673 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 17:57:14.602673 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 17:57:14.602673 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 17:57:14.602673 n-d-852296-2 devstack@n-api.service[129409]: X-Openstack-Nova-Api-Version: 2.47 Aug 10 17:57:14.602673 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 17:57:14.602673 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 17:57:14.602673 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: 27ed2f8b25bd416eabdae76d5a00f617 Aug 10 17:57:14.602673 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-ServersAaction247Test-546765640 Aug 10 17:57:14.602673 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 17:57:14.602673 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 17:57:14.602673 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/27ed2f8b25bd416eabdae76d5a00f617"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/27ed2f8b25bd416eabdae76d5a00f617"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/27ed2f8b25bd416eabdae76d5a00f617"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_27ed2f8b25bd416eabdae76d5a00f617", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:57:14.602673 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-ServersAaction247Test-546765640 Aug 10 17:57:14.602673 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: 27ed2f8b25bd416eabdae76d5a00f617 Aug 10 17:57:14.602673 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-ServersAaction247Test-546765640 Aug 10 17:57:14.602673 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-ServersAaction247Test-546765640-project Aug 10 17:57:14.602673 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 17:57:14.602673 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 17:57:14.602673 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: d3685f6eee4246ea92927a3a9734fa0f Aug 10 17:57:14.602673 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-ServersAaction247Test-546765640-project Aug 10 17:57:14.602673 n-d-852296-2 devstack@n-api.service[129409]: method: > Aug 10 17:57:14.602673 n-d-852296-2 devstack@n-api.service[129409]: exception: Instance 8982abdf-f7e7-4bde-9c9f-3b00b0be653f could not be found. Aug 10 17:57:14.602673 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'id': '8982abdf-f7e7-4bde-9c9f-3b00b0be653f'} Aug 10 17:57:14.602673 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:57:14.602673 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:57:14.602673 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 17:57:14.602673 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 17:57:14.602673 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 17:57:14.602673 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 17:57:14.602673 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 17:57:14.602673 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 17:57:14.602673 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 17:57:14.602673 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 17:57:14.602673 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8982abdf-f7e7-4bde-9c9f-3b00b0be653f could not be found. Aug 10 17:57:14.602673 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:57:14.602673 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:57:14.602673 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:57:14.602673 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:57:14.602673 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:57:14.602673 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:57:14.602673 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:57:14.602673 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:57:14.602673 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:57:14.602673 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:57:14.602673 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 17:57:14.602673 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 17:57:14.602673 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 17:57:14.602673 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 17:57:14.602673 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 17:57:14.602673 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:57:14.602673 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8982abdf-f7e7-4bde-9c9f-3b00b0be653f could not be found. Aug 10 17:57:14.602673 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:57:14.602673 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:57:14.602673 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:57:14.614710 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:57:14.614710 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:57:14.614710 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:57:14.614710 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:57:14.614710 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:57:14.614710 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8982abdf-f7e7-4bde-9c9f-3b00b0be653f could not be found. Aug 10 17:57:14.614710 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:57:14.623211 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-bdeb2dfe-6ed4-4135-850f-ff8d33a08c7e tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] Returning 404 to user: Instance 8982abdf-f7e7-4bde-9c9f-3b00b0be653f could not be found. {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:57:14.625516 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-bdeb2dfe-6ed4-4135-850f-ff8d33a08c7e tempest-ServersAaction247Test-546765640 tempest-ServersAaction247Test-546765640-project] 10.222.0.50 "GET /compute/v2.1/servers/8982abdf-f7e7-4bde-9c9f-3b00b0be653f" status: 404 len: 111 microversion: 2.47 time: 0.098396 Aug 10 17:57:14.627895 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 816/1607] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:57:14 2022] GET /compute/v2.1/servers/8982abdf-f7e7-4bde-9c9f-3b00b0be653f => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 10 17:57:14.641108 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-2caf279f-7f47-410f-82d7-61e2d7c0672d tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '.version_select at 0x7fb345ebe550>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:57:14.737495 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-2caf279f-7f47-410f-82d7-61e2d7c0672d tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/images/23574b56-3268-4f53-afb9-8d4a9946cf3c" status: 200 len: 1454 microversion: 2.1 time: 0.107654 Aug 10 17:57:14.738089 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 817/1608] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:57:14 2022] GET /compute/v2.1/images/23574b56-3268-4f53-afb9-8d4a9946cf3c => generated 1454 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:57:15.007896 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-f8e4a646-532b-44fc-84d3-43ec6e325110 tempest-FloatingIPDetailsTestJSON-1800554695 tempest-FloatingIPDetailsTestJSON-1800554695-project] 10.222.0.50 "DELETE /compute/v2.1/os-floating-ips/ab107546-475b-4715-97df-878c745e3716" status: 202 len: 0 microversion: 2.1 time: 1.966822 Aug 10 17:57:15.008469 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 792/1609] 10.222.0.50 () {58 vars in 1263 bytes} [Wed Aug 10 17:57:13 2022] DELETE /compute/v2.1/os-floating-ips/ab107546-475b-4715-97df-878c745e3716 => generated 0 bytes in 1968 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 17:57:15.019950 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-09ed9810-357b-4ad1-87f6-7f02879c1ecb tempest-FloatingIPDetailsTestJSON-1800554695 tempest-FloatingIPDetailsTestJSON-1800554695-project] Calling method '.version_select at 0x7fb345dfdf70>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:57:15.667404 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-09ed9810-357b-4ad1-87f6-7f02879c1ecb tempest-FloatingIPDetailsTestJSON-1800554695 tempest-FloatingIPDetailsTestJSON-1800554695-project] 10.222.0.50 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.652768 Aug 10 17:57:15.670653 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 818/1610] 10.222.0.50 () {58 vars in 1164 bytes} [Wed Aug 10 17:57:15 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 17:57:15.679344 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-42cca818-08cf-4187-8a31-bcd3c86f18c8 tempest-FloatingIPDetailsTestJSON-1800554695 tempest-FloatingIPDetailsTestJSON-1800554695-project] Calling method '.version_select at 0x7fb3459e9430>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:57:15.753128 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-118d31ff-f9b9-4e8b-abec-2c232adfe66f tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '.version_select at 0x7fb345dfd0d0>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:57:15.835975 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-118d31ff-f9b9-4e8b-abec-2c232adfe66f tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/images/23574b56-3268-4f53-afb9-8d4a9946cf3c" status: 200 len: 1454 microversion: 2.1 time: 0.087585 Aug 10 17:57:15.838287 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 819/1611] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:57:15 2022] GET /compute/v2.1/images/23574b56-3268-4f53-afb9-8d4a9946cf3c => generated 1454 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:57:16.853275 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-7406f8bc-676e-4478-9443-cea46c846304 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '.version_select at 0x7fb345e67280>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:57:16.963362 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-7406f8bc-676e-4478-9443-cea46c846304 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/images/23574b56-3268-4f53-afb9-8d4a9946cf3c" status: 200 len: 1454 microversion: 2.1 time: 0.114101 Aug 10 17:57:16.971299 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 820/1612] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:57:16 2022] GET /compute/v2.1/images/23574b56-3268-4f53-afb9-8d4a9946cf3c => generated 1454 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:57:17.008674 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-42cca818-08cf-4187-8a31-bcd3c86f18c8 tempest-FloatingIPDetailsTestJSON-1800554695 tempest-FloatingIPDetailsTestJSON-1800554695-project] 10.222.0.50 "GET /compute/v2.1/os-floating-ips" status: 200 len: 398 microversion: 2.1 time: 1.333805 Aug 10 17:57:17.009567 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 793/1613] 10.222.0.50 () {58 vars in 1149 bytes} [Wed Aug 10 17:57:15 2022] GET /compute/v2.1/os-floating-ips => generated 398 bytes in 1335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:57:17.024767 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-ae6e6f85-6100-474f-ac72-2a485868ae99 tempest-FloatingIPDetailsTestJSON-1800554695 tempest-FloatingIPDetailsTestJSON-1800554695-project] Calling method '.version_select at 0x7fb345dfdca0>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:57:17.980019 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-a4f56256-5492-4332-93fb-b21e349bb0eb tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '.version_select at 0x7fb345bfb700>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:57:18.029571 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-a4f56256-5492-4332-93fb-b21e349bb0eb tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/images/23574b56-3268-4f53-afb9-8d4a9946cf3c" status: 200 len: 1454 microversion: 2.1 time: 0.054303 Aug 10 17:57:18.031056 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 794/1614] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:57:17 2022] GET /compute/v2.1/images/23574b56-3268-4f53-afb9-8d4a9946cf3c => generated 1454 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:57:19.045478 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-c74e0320-3d0b-4f0d-8e72-03e278c87263 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '.version_select at 0x7fb3459e9160>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:57:19.131812 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-c74e0320-3d0b-4f0d-8e72-03e278c87263 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/images/23574b56-3268-4f53-afb9-8d4a9946cf3c" status: 200 len: 1454 microversion: 2.1 time: 0.089994 Aug 10 17:57:19.132704 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 795/1615] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:57:19 2022] GET /compute/v2.1/images/23574b56-3268-4f53-afb9-8d4a9946cf3c => generated 1454 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:57:20.038262 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-ae6e6f85-6100-474f-ac72-2a485868ae99 tempest-FloatingIPDetailsTestJSON-1800554695 tempest-FloatingIPDetailsTestJSON-1800554695-project] 10.222.0.50 "DELETE /compute/v2.1/os-floating-ips/444ab662-e1bb-4c81-863f-ae33bcb3b488" status: 202 len: 0 microversion: 2.1 time: 3.017928 Aug 10 17:57:20.039195 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 821/1616] 10.222.0.50 () {58 vars in 1263 bytes} [Wed Aug 10 17:57:17 2022] DELETE /compute/v2.1/os-floating-ips/444ab662-e1bb-4c81-863f-ae33bcb3b488 => generated 0 bytes in 3020 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 17:57:20.049894 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-41d262be-dcf8-4879-989f-0397f5fc0e8d tempest-FloatingIPDetailsTestJSON-1800554695 tempest-FloatingIPDetailsTestJSON-1800554695-project] Calling method '.version_select at 0x7fb345bfb5e0>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:57:20.150971 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-bddbcb9b-f965-4a3b-9824-f7fb3671f027 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '.version_select at 0x7fb345eba3a0>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:57:20.345269 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-bddbcb9b-f965-4a3b-9824-f7fb3671f027 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/images/23574b56-3268-4f53-afb9-8d4a9946cf3c" status: 200 len: 1454 microversion: 2.1 time: 0.197760 Aug 10 17:57:20.353162 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 822/1617] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:57:20 2022] GET /compute/v2.1/images/23574b56-3268-4f53-afb9-8d4a9946cf3c => generated 1454 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:57:21.362161 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-7fd62860-ea36-4169-824d-61a57ba4911c tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '.version_select at 0x7fb345f5e310>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:57:21.462141 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-7fd62860-ea36-4169-824d-61a57ba4911c tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/images/23574b56-3268-4f53-afb9-8d4a9946cf3c" status: 200 len: 1463 microversion: 2.1 time: 0.104483 Aug 10 17:57:21.464481 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 823/1618] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:57:21 2022] GET /compute/v2.1/images/23574b56-3268-4f53-afb9-8d4a9946cf3c => generated 1463 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:57:21.479737 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-d0fe730e-6c2a-4094-a85f-d6dfcd5fa90a tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '.version_select at 0x7fb345ebeee0>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:57:21.537987 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-d0fe730e-6c2a-4094-a85f-d6dfcd5fa90a tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/images/23574b56-3268-4f53-afb9-8d4a9946cf3c" status: 200 len: 1463 microversion: 2.1 time: 0.064110 Aug 10 17:57:21.539813 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 824/1619] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:57:21 2022] GET /compute/v2.1/images/23574b56-3268-4f53-afb9-8d4a9946cf3c => generated 1463 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:57:21.556405 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-ce7cf4b7-2330-4925-9954-dd1664c20e80 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:57:21.557271 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-ce7cf4b7-2330-4925-9954-dd1664c20e80 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] [instance: dd4d671c-5a1f-463d-8bec-cd4f7614479f] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:57:21.569874 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-ce7cf4b7-2330-4925-9954-dd1664c20e80 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:57:21.571043 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-ce7cf4b7-2330-4925-9954-dd1664c20e80 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:57:21.571711 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-ce7cf4b7-2330-4925-9954-dd1664c20e80 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:57:21.576849 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-ce7cf4b7-2330-4925-9954-dd1664c20e80 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:57:21.578272 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-ce7cf4b7-2330-4925-9954-dd1664c20e80 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:57:21.579308 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-ce7cf4b7-2330-4925-9954-dd1664c20e80 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:57:21.738158 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-41d262be-dcf8-4879-989f-0397f5fc0e8d tempest-FloatingIPDetailsTestJSON-1800554695 tempest-FloatingIPDetailsTestJSON-1800554695-project] 10.222.0.50 "DELETE /compute/v2.1/os-floating-ips/98cc116e-2788-49f2-acfe-c572e2693649" status: 202 len: 0 microversion: 2.1 time: 1.694257 Aug 10 17:57:21.739439 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 796/1620] 10.222.0.50 () {58 vars in 1263 bytes} [Wed Aug 10 17:57:20 2022] DELETE /compute/v2.1/os-floating-ips/98cc116e-2788-49f2-acfe-c572e2693649 => generated 0 bytes in 1696 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 17:57:21.747503 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-7cb1ce7a-d27e-4b36-bcb8-220818937082 tempest-FloatingIPDetailsTestJSON-1800554695 tempest-FloatingIPDetailsTestJSON-1800554695-project] Calling method '.version_select at 0x7fb345bc4940>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:57:21.941642 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-ce7cf4b7-2330-4925-9954-dd1664c20e80 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce45e1a545b4d3b8fa2cb4b2af3f306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0285f1570fe2419c930c80d3a0711858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:57:21.952825 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-ce7cf4b7-2330-4925-9954-dd1664c20e80 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/servers/dd4d671c-5a1f-463d-8bec-cd4f7614479f" status: 200 len: 1467 microversion: 2.1 time: 0.402682 Aug 10 17:57:21.953987 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 825/1621] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:57:21 2022] GET /compute/v2.1/servers/dd4d671c-5a1f-463d-8bec-cd4f7614479f => generated 1467 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:57:21.960012 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-5afe7f9d-ea0b-4653-a6b3-3623684c7820 tempest-ServersTestFqdnHostnames-196460502 tempest-ServersTestFqdnHostnames-196460502-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "a09bb9f0-c1a2-4249-b9e7-94e66ed71bcf"}], "security_groups": [{"name": "tempest-securitygroup--1998666293"}], "key_name": "tempest-keypair-480646501", "user_data": "}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:57:22.051630 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:57:22.206669 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.network.neutron [None req-5afe7f9d-ea0b-4653-a6b3-3623684c7820 tempest-ServersTestFqdnHostnames-196460502 tempest-ServersTestFqdnHostnames-196460502-project] validate_networks() for [('a09bb9f0-c1a2-4249-b9e7-94e66ed71bcf', None, None, None, None, None)] {{(pid=129409) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 17:57:22.633224 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [None req-5afe7f9d-ea0b-4653-a6b3-3623684c7820 tempest-ServersTestFqdnHostnames-196460502 tempest-ServersTestFqdnHostnames-196460502-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-f298577b-a7e2-48cd-8a9c-a73eb1accaaf) Aug 10 17:57:22.633224 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:57:22.633224 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:57:22.633224 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:57:22.633224 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:57:22.633224 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:57:22.633224 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:57:22.633224 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:57:22.633224 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:57:22.633224 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:57:22.633224 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 17:57:22.633224 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 17:57:22.633224 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 17:57:22.633224 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 17:57:22.633224 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 17:57:22.633224 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 17:57:22.633224 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 17:57:22.633224 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 17:57:22.633224 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 17:57:22.633224 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 17:57:22.633224 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 17:57:22.633224 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 17:57:22.633224 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 17:57:22.633224 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 17:57:22.633224 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 17:57:22.633224 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 17:57:22.633224 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 17:57:22.633224 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:57:22.633224 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:57:22.633224 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 17:57:22.633224 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 17:57:22.633224 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:57:22.633224 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:57:22.633224 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:57:22.633224 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:57:22.633224 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:57:22.633224 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:57:22.633224 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:57:22.633224 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:57:22.633224 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:57:22.633224 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:57:22.633224 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 17:57:22.633224 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 17:57:22.633224 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 17:57:22.633224 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 17:57:22.633224 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 17:57:22.633224 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 17:57:22.633224 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 17:57:22.633224 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 17:57:22.633224 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 17:57:22.633224 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 17:57:22.633224 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 17:57:22.637170 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 17:57:22.637170 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 17:57:22.637170 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 17:57:22.637170 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 17:57:22.637170 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 17:57:22.637170 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 17:57:22.637170 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 17:57:22.637170 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 17:57:22.637170 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 17:57:22.637170 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 17:57:22.637170 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 17:57:22.637170 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 17:57:22.637170 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 17:57:22.637170 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 17:57:22.637170 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 17:57:22.637170 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-f298577b-a7e2-48cd-8a9c-a73eb1accaaf) Aug 10 17:57:22.637170 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:57:22.639007 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-5afe7f9d-ea0b-4653-a6b3-3623684c7820 tempest-ServersTestFqdnHostnames-196460502 tempest-ServersTestFqdnHostnames-196460502-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:57:22.639007 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:57:22.641766 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-5afe7f9d-ea0b-4653-a6b3-3623684c7820 tempest-ServersTestFqdnHostnames-196460502 tempest-ServersTestFqdnHostnames-196460502-project] Request method failure captured: Aug 10 17:57:22.641766 n-d-852296-2 devstack@n-api.service[129409]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 17:57:22.641766 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 17:57:22.641766 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 17:57:22.641766 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 17:57:22.641766 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 498 Aug 10 17:57:22.641766 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 17:57:22.641766 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 17:57:22.641766 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 17:57:22.641766 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 17:57:22.641766 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8_F4BJvf3jmE0JrdHglIUnmi5bhhl-S5JnCmlId5N9hri2lKT_QicAD8yrB54W2TVyMrDQrcErRzi9aR1HvnUPuwZn7Jy1vdd6YSLCMk58RN01uP61m52QVvkNJIo6dOnhhiwh60DR_e_Jmo0J6tU6PYNZHeTTmnj77SawT38FsBy3I Aug 10 17:57:22.641766 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 17:57:22.641766 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 17:57:22.641766 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 17:57:22.641766 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 17:57:22.641766 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 17:57:22.641766 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 17:57:22.641766 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: 177dad7c9b8647c781a48e60c9fb6001 Aug 10 17:57:22.641766 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-ServersTestFqdnHostnames-196460502 Aug 10 17:57:22.641766 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 17:57:22.641766 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 17:57:22.641766 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/177dad7c9b8647c781a48e60c9fb6001"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/177dad7c9b8647c781a48e60c9fb6001"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/177dad7c9b8647c781a48e60c9fb6001"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_177dad7c9b8647c781a48e60c9fb6001", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:57:22.641766 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-ServersTestFqdnHostnames-196460502 Aug 10 17:57:22.641766 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: 177dad7c9b8647c781a48e60c9fb6001 Aug 10 17:57:22.641766 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-196460502 Aug 10 17:57:22.641766 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-ServersTestFqdnHostnames-196460502-project Aug 10 17:57:22.641766 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 17:57:22.641766 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 17:57:22.641766 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: e20517d0eab041238e2736a9c636ca66 Aug 10 17:57:22.641766 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-ServersTestFqdnHostnames-196460502-project Aug 10 17:57:22.641766 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:57:22.641766 n-d-852296-2 devstack@n-api.service[129409]: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "adminPass": "C2+E6@PlmCl8+1P", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "a09bb9f0-c1a2-4249-b9e7-94e66ed71bcf"}], "security_groups": [{"name": "tempest-securitygroup--1998666293"}], "key_name": "tempest-keypair-480646501", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} Aug 10 17:57:22.641766 n-d-852296-2 devstack@n-api.service[129409]: method: > Aug 10 17:57:22.641766 n-d-852296-2 devstack@n-api.service[129409]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:57:22.641766 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:57:22.641766 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'body': {'server': {'name': 'guest-instance-1.domain.com', 'imageRef': 'a735ff26-463a-4ffe-a981-ab9d9baa494f', 'flavorRef': '452', 'adminPass': 'C2+E6@PlmCl8+1P', 'networks': [{'uuid': 'a09bb9f0-c1a2-4249-b9e7-94e66ed71bcf'}], 'security_groups': [{'name': 'tempest-securitygroup--1998666293'}], 'key_name': 'tempest-keypair-480646501', 'user_data': 'IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo='}}} Aug 10 17:57:22.641766 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:57:22.641766 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:57:22.641766 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:57:22.641766 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:57:22.641766 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:57:22.641766 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:57:22.641766 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:57:22.641766 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:57:22.641766 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:57:22.641766 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:57:22.641766 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 17:57:22.641766 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 17:57:22.641766 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 17:57:22.641766 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 17:57:22.641766 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 17:57:22.641766 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 17:57:22.641766 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 17:57:22.641766 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 17:57:22.641766 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 17:57:22.641766 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 17:57:22.645906 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 17:57:22.645906 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 17:57:22.645906 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 17:57:22.645906 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 17:57:22.645906 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 17:57:22.645906 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 17:57:22.645906 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 17:57:22.645906 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:57:22.645906 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:57:22.645906 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 17:57:22.645906 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 17:57:22.645906 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:57:22.645906 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:57:22.645906 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:57:22.645906 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:57:22.645906 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:57:22.645906 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:57:22.645906 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:57:22.645906 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:57:22.645906 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:57:22.645906 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:57:22.645906 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 17:57:22.645906 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 17:57:22.645906 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 17:57:22.645906 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 17:57:22.645906 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 17:57:22.645906 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 17:57:22.645906 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 17:57:22.645906 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 17:57:22.645906 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 17:57:22.645906 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 17:57:22.645906 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 17:57:22.645906 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 17:57:22.645906 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 17:57:22.645906 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 17:57:22.645906 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 17:57:22.645906 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 17:57:22.645906 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 17:57:22.645906 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 17:57:22.645906 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 17:57:22.645906 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 17:57:22.645906 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 17:57:22.645906 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 17:57:22.645906 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 17:57:22.645906 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 17:57:22.645906 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 17:57:22.645906 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 17:57:22.645906 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-f298577b-a7e2-48cd-8a9c-a73eb1accaaf) Aug 10 17:57:22.645906 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:57:22.645906 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:57:22.645906 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:57:22.645906 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:57:22.645906 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:57:22.649433 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:57:22.649433 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:57:22.649433 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:57:22.649433 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 10 17:57:22.649433 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 10 17:57:22.649433 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:57:22.649433 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:57:22.649433 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:57:22.649433 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:57:22.649433 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:57:22.649433 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:57:22.649433 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:57:22.649433 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:57:22.649433 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:57:22.649433 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:57:22.649433 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:57:22.649433 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:57:22.649433 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:57:22.649433 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-5afe7f9d-ea0b-4653-a6b3-3623684c7820 tempest-ServersTestFqdnHostnames-196460502 tempest-ServersTestFqdnHostnames-196460502-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:57:22.649433 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:57:22.649433 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-5afe7f9d-ea0b-4653-a6b3-3623684c7820 tempest-ServersTestFqdnHostnames-196460502 tempest-ServersTestFqdnHostnames-196460502-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.688766 Aug 10 17:57:22.651532 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 826/1622] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 17:57:21 2022] POST /compute/v2.1/servers => generated 214 bytes in 696 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 10 17:57:22.656754 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-970c3d49-18be-4543-b3b4-c059ee3c7c2e tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-249779992"}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:57:22.659460 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-970c3d49-18be-4543-b3b4-c059ee3c7c2e tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] [instance: 8937f92d-1764-4316-86cc-939bc9dc34b4] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:57:22.673023 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-970c3d49-18be-4543-b3b4-c059ee3c7c2e tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:57:22.673587 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-970c3d49-18be-4543-b3b4-c059ee3c7c2e tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:57:22.674177 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-970c3d49-18be-4543-b3b4-c059ee3c7c2e tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:57:22.674916 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-970c3d49-18be-4543-b3b4-c059ee3c7c2e tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:57:22.675536 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-970c3d49-18be-4543-b3b4-c059ee3c7c2e tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:57:22.676118 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-970c3d49-18be-4543-b3b4-c059ee3c7c2e tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:57:22.761300 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_cell0:SELECT=4 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:57:22.789913 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:57:23.312013 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-970c3d49-18be-4543-b3b4-c059ee3c7c2e tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "POST /compute/v2.1/servers/8937f92d-1764-4316-86cc-939bc9dc34b4/action" status: 202 len: 0 microversion: 2.1 time: 0.659221 Aug 10 17:57:23.319168 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 827/1623] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 10 17:57:22 2022] POST /compute/v2.1/servers/8937f92d-1764-4316-86cc-939bc9dc34b4/action => generated 0 bytes in 667 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 10 17:57:23.337507 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-1a13b9bc-d6a3-4b49-b3e5-b2272cb604d3 tempest-ServersTestFqdnHostnames-196460502 tempest-ServersTestFqdnHostnames-196460502-project] Calling method '.version_select at 0x7fb345ebe0d0>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:57:23.456599 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-7cb1ce7a-d27e-4b36-bcb8-220818937082 tempest-FloatingIPDetailsTestJSON-1800554695 tempest-FloatingIPDetailsTestJSON-1800554695-project] 10.222.0.50 "DELETE /compute/v2.1/os-floating-ips/1a52d2b1-e76e-4695-a063-8d7305b6456e" status: 202 len: 0 microversion: 2.1 time: 1.707224 Aug 10 17:57:23.456599 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 797/1624] 10.222.0.50 () {58 vars in 1263 bytes} [Wed Aug 10 17:57:21 2022] DELETE /compute/v2.1/os-floating-ips/1a52d2b1-e76e-4695-a063-8d7305b6456e => generated 0 bytes in 1709 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 17:57:23.457050 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-9910b60b-8db6-437d-b7f4-750c9dd7eaa3 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '.version_select at 0x7fb345a3ea60>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:57:23.494000 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-1a13b9bc-d6a3-4b49-b3e5-b2272cb604d3 tempest-ServersTestFqdnHostnames-196460502 tempest-ServersTestFqdnHostnames-196460502-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-480646501" status: 202 len: 0 microversion: 2.1 time: 0.158201 Aug 10 17:57:23.494000 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 828/1625] 10.222.0.50 () {58 vars in 1218 bytes} [Wed Aug 10 17:57:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-480646501 => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 17:57:23.520104 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-9910b60b-8db6-437d-b7f4-750c9dd7eaa3 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/images/98768699-188a-47cb-94b1-0e22f2c1e614" status: 200 len: 1454 microversion: 2.1 time: 0.067449 Aug 10 17:57:23.520749 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 798/1626] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:57:23 2022] GET /compute/v2.1/images/98768699-188a-47cb-94b1-0e22f2c1e614 => generated 1454 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:57:24.537573 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-cdd89cc8-fd6c-4748-8501-a0e041140ae1 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '.version_select at 0x7fb345dfdf70>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:57:24.616363 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-cdd89cc8-fd6c-4748-8501-a0e041140ae1 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/images/98768699-188a-47cb-94b1-0e22f2c1e614" status: 200 len: 1454 microversion: 2.1 time: 0.080875 Aug 10 17:57:24.616363 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 829/1627] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:57:24 2022] GET /compute/v2.1/images/98768699-188a-47cb-94b1-0e22f2c1e614 => generated 1454 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:57:25.637818 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-080335e0-a476-4b14-a99b-9264d5c2c2f9 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '.version_select at 0x7fb345bebdc0>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:57:25.750836 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-080335e0-a476-4b14-a99b-9264d5c2c2f9 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/images/98768699-188a-47cb-94b1-0e22f2c1e614" status: 200 len: 1454 microversion: 2.1 time: 0.124027 Aug 10 17:57:25.753337 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 799/1628] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:57:25 2022] GET /compute/v2.1/images/98768699-188a-47cb-94b1-0e22f2c1e614 => generated 1454 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:57:26.766388 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-fb501429-6ec7-438a-a6a7-0f052e7c8eab tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '.version_select at 0x7fb346207af0>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:57:26.860107 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-fb501429-6ec7-438a-a6a7-0f052e7c8eab tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/images/98768699-188a-47cb-94b1-0e22f2c1e614" status: 200 len: 1454 microversion: 2.1 time: 0.090339 Aug 10 17:57:26.863524 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 830/1629] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:57:26 2022] GET /compute/v2.1/images/98768699-188a-47cb-94b1-0e22f2c1e614 => generated 1454 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:57:26.989009 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [req-b73560ee-f7e9-4f87-bc00-124240708800 req-a66e5c53-25d0-4d90-af29-019342b8deb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd4d671c-5a1f-463d-8bec-cd4f7614479f", "name": "network-vif-unplugged", "status": "completed", "tag": "04dec7b8-0911-42c4-b8b2-bdf1fecdec04"}]} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:57:27.001593 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-b73560ee-f7e9-4f87-bc00-124240708800 req-a66e5c53-25d0-4d90-af29-019342b8deb5 service nova] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:57:27.002853 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-b73560ee-f7e9-4f87-bc00-124240708800 req-a66e5c53-25d0-4d90-af29-019342b8deb5 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:57:27.003498 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-b73560ee-f7e9-4f87-bc00-124240708800 req-a66e5c53-25d0-4d90-af29-019342b8deb5 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:57:27.018377 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.compute.server_external_events [req-b73560ee-f7e9-4f87-bc00-124240708800 req-a66e5c53-25d0-4d90-af29-019342b8deb5 service nova] Creating event network-vif-unplugged:04dec7b8-0911-42c4-b8b2-bdf1fecdec04 for instance dd4d671c-5a1f-463d-8bec-cd4f7614479f on n-h2-852296-2 Aug 10 17:57:27.023945 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [req-b73560ee-f7e9-4f87-bc00-124240708800 req-a66e5c53-25d0-4d90-af29-019342b8deb5 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039755 Aug 10 17:57:27.025184 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 800/1630] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 10 17:57:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:57:27.875757 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-2a4a4c84-c48b-460d-90fb-fa69d6ac3f4a tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '.version_select at 0x7fb345ebe160>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:57:27.942564 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-2a4a4c84-c48b-460d-90fb-fa69d6ac3f4a tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/images/98768699-188a-47cb-94b1-0e22f2c1e614" status: 200 len: 1454 microversion: 2.1 time: 0.070627 Aug 10 17:57:27.944430 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 831/1631] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:57:27 2022] GET /compute/v2.1/images/98768699-188a-47cb-94b1-0e22f2c1e614 => generated 1454 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:57:28.959278 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-c7f454ef-2a94-405f-875f-1e84ad465d84 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '.version_select at 0x7fb345beb8b0>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:57:29.039279 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-c7f454ef-2a94-405f-875f-1e84ad465d84 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/images/98768699-188a-47cb-94b1-0e22f2c1e614" status: 200 len: 1454 microversion: 2.1 time: 0.085196 Aug 10 17:57:29.043489 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 801/1632] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:57:28 2022] GET /compute/v2.1/images/98768699-188a-47cb-94b1-0e22f2c1e614 => generated 1454 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:57:29.094651 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [req-af49efc9-fd34-484f-b425-5a802f9f4ae6 req-937ae2af-7405-4730-8631-772dfaa76c1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8937f92d-1764-4316-86cc-939bc9dc34b4", "name": "network-vif-plugged", "status": "completed", "tag": "c4ddeb24-17b7-43ce-b1c2-3516523d5956"}]} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:57:29.113593 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-af49efc9-fd34-484f-b425-5a802f9f4ae6 req-937ae2af-7405-4730-8631-772dfaa76c1d service nova] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:57:29.114675 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-af49efc9-fd34-484f-b425-5a802f9f4ae6 req-937ae2af-7405-4730-8631-772dfaa76c1d service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:57:29.116347 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-af49efc9-fd34-484f-b425-5a802f9f4ae6 req-937ae2af-7405-4730-8631-772dfaa76c1d service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:57:29.135924 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.compute.server_external_events [req-af49efc9-fd34-484f-b425-5a802f9f4ae6 req-937ae2af-7405-4730-8631-772dfaa76c1d service nova] Creating event network-vif-plugged:c4ddeb24-17b7-43ce-b1c2-3516523d5956 for instance 8937f92d-1764-4316-86cc-939bc9dc34b4 on n-h2-852296-2 Aug 10 17:57:29.152818 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [req-af49efc9-fd34-484f-b425-5a802f9f4ae6 req-937ae2af-7405-4730-8631-772dfaa76c1d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062579 Aug 10 17:57:29.158251 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 832/1633] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 10 17:57:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:57:30.056213 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-b9b687f0-2f84-4f24-a253-3ecf35ee09a6 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '.version_select at 0x7fb345eba670>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:57:30.142402 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-b9b687f0-2f84-4f24-a253-3ecf35ee09a6 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/images/98768699-188a-47cb-94b1-0e22f2c1e614" status: 200 len: 1454 microversion: 2.1 time: 0.091043 Aug 10 17:57:30.152066 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 833/1634] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:57:30 2022] GET /compute/v2.1/images/98768699-188a-47cb-94b1-0e22f2c1e614 => generated 1454 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:57:30.321159 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-29201472-2718-43b2-891a-c1ae72af7225 tempest-FlavorsV2NegativeTest-213241728 tempest-FlavorsV2NegativeTest-213241728-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:57:30.332688 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-29201472-2718-43b2-891a-c1ae72af7225 tempest-FlavorsV2NegativeTest-213241728 tempest-FlavorsV2NegativeTest-213241728-project] 10.222.0.50 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.462150 Aug 10 17:57:30.333823 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 802/1635] 10.222.0.50 () {58 vars in 1137 bytes} [Wed Aug 10 17:57:29 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:57:30.901390 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-a59aa6f3-6650-4eb2-9f94-22a02165fed2 tempest-ServerActionsTestJSON-1360577128 tempest-ServerActionsTestJSON-1360577128-project] Action: 'create', calling method: .version_select at 0x7fb345ebe1f0>, body: {"keypair": {"name": "tempest-keypair-2135207287", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJlYVfq4uQp5ZiGtslLMO4Boxkmwr4PqP9kt/B4ugkCqmxF1alEpddqfeBLuPrlD1EQ1FmrMB6Q6OgrwMXDziESS4afxhbF6Yy58ROZCK1uHmCbqZhQuVgiDRpAFYl7uyQ=="}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:57:30.948517 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-a59aa6f3-6650-4eb2-9f94-22a02165fed2 tempest-ServerActionsTestJSON-1360577128 tempest-ServerActionsTestJSON-1360577128-project] Getting quotas for project 9a574613f1164c45a54f983c2a0b617f. Resources: {'key_pairs'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:57:30.975152 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-a59aa6f3-6650-4eb2-9f94-22a02165fed2 tempest-ServerActionsTestJSON-1360577128 tempest-ServerActionsTestJSON-1360577128-project] Getting quotas for user 3fc5d88706d848b5ae1f4a6f343b4e43 and project 9a574613f1164c45a54f983c2a0b617f. Resources: {'key_pairs'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:57:31.157888 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-226ea36b-6903-497f-b3fb-73644728f8ff tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '.version_select at 0x7fb345a3eca0>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:57:31.184299 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-a59aa6f3-6650-4eb2-9f94-22a02165fed2 tempest-ServerActionsTestJSON-1360577128 tempest-ServerActionsTestJSON-1360577128-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.572419 Aug 10 17:57:31.188502 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 834/1636] 10.222.0.50 () {60 vars in 1159 bytes} [Wed Aug 10 17:57:30 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:57:32.072450 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-226ea36b-6903-497f-b3fb-73644728f8ff tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/images/98768699-188a-47cb-94b1-0e22f2c1e614" status: 200 len: 1454 microversion: 2.1 time: 0.918787 Aug 10 17:57:32.075769 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 803/1637] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:57:31 2022] GET /compute/v2.1/images/98768699-188a-47cb-94b1-0e22f2c1e614 => generated 1454 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:57:32.193554 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-42b60e5c-57c9-41dd-96d8-2099715733d2 tempest-FlavorsV2NegativeTest-213241728 tempest-FlavorsV2NegativeTest-213241728-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-2063743468", "imageRef": "c3ca7b08-d4bf-45d3-9fb5-989ccb442206", "flavorRef": "452"}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:57:32.300868 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.network.neutron [None req-42b60e5c-57c9-41dd-96d8-2099715733d2 tempest-FlavorsV2NegativeTest-213241728 tempest-FlavorsV2NegativeTest-213241728-project] validate_networks() for None {{(pid=129410) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 17:57:32.604839 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-ca6d84b1-eb38-40b8-851c-997454c3ef8d tempest-PortsAdminExtendedAttrsTestJSON-771158682 tempest-PortsAdminExtendedAttrsTestJSON-771158682-project-admin] Calling method '.version_select at 0x7fb345dfdaf0>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:57:32.605852 n-d-852296-2 devstack@n-api.service[129409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:57:32.605852 n-d-852296-2 devstack@n-api.service[129409]: warnings.warn(msg) Aug 10 17:57:32.606937 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-ca6d84b1-eb38-40b8-851c-997454c3ef8d tempest-PortsAdminExtendedAttrsTestJSON-771158682 tempest-PortsAdminExtendedAttrsTestJSON-771158682-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:57:32.607588 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-ca6d84b1-eb38-40b8-851c-997454c3ef8d tempest-PortsAdminExtendedAttrsTestJSON-771158682 tempest-PortsAdminExtendedAttrsTestJSON-771158682-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:57:32.608024 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-ca6d84b1-eb38-40b8-851c-997454c3ef8d tempest-PortsAdminExtendedAttrsTestJSON-771158682 tempest-PortsAdminExtendedAttrsTestJSON-771158682-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:57:32.653978 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-ca6d84b1-eb38-40b8-851c-997454c3ef8d tempest-PortsAdminExtendedAttrsTestJSON-771158682 tempest-PortsAdminExtendedAttrsTestJSON-771158682-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:57:32.654482 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-ca6d84b1-eb38-40b8-851c-997454c3ef8d tempest-PortsAdminExtendedAttrsTestJSON-771158682 tempest-PortsAdminExtendedAttrsTestJSON-771158682-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:57:32.654926 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-ca6d84b1-eb38-40b8-851c-997454c3ef8d tempest-PortsAdminExtendedAttrsTestJSON-771158682 tempest-PortsAdminExtendedAttrsTestJSON-771158682-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:57:32.685191 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-ca6d84b1-eb38-40b8-851c-997454c3ef8d tempest-PortsAdminExtendedAttrsTestJSON-771158682 tempest-PortsAdminExtendedAttrsTestJSON-771158682-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:57:32.685680 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-ca6d84b1-eb38-40b8-851c-997454c3ef8d tempest-PortsAdminExtendedAttrsTestJSON-771158682 tempest-PortsAdminExtendedAttrsTestJSON-771158682-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:57:32.686124 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-ca6d84b1-eb38-40b8-851c-997454c3ef8d tempest-PortsAdminExtendedAttrsTestJSON-771158682 tempest-PortsAdminExtendedAttrsTestJSON-771158682-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:57:32.712752 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-ca6d84b1-eb38-40b8-851c-997454c3ef8d tempest-PortsAdminExtendedAttrsTestJSON-771158682 tempest-PortsAdminExtendedAttrsTestJSON-771158682-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.625729 Aug 10 17:57:32.721391 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 835/1638] 10.222.0.50 () {58 vars in 1146 bytes} [Wed Aug 10 17:57:32 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:57:32.881750 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-42b60e5c-57c9-41dd-96d8-2099715733d2 tempest-FlavorsV2NegativeTest-213241728 tempest-FlavorsV2NegativeTest-213241728-project] HTTP exception thrown: Flavor's memory is too small for requested image. Aug 10 17:57:32.883771 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-42b60e5c-57c9-41dd-96d8-2099715733d2 tempest-FlavorsV2NegativeTest-213241728 tempest-FlavorsV2NegativeTest-213241728-project] Request method failure captured: Aug 10 17:57:32.883771 n-d-852296-2 devstack@n-api.service[129410]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 17:57:32.883771 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 17:57:32.883771 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 17:57:32.883771 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 17:57:32.883771 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 143 Aug 10 17:57:32.883771 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 17:57:32.883771 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 17:57:32.883771 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 17:57:32.883771 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 17:57:32.883771 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8_GJAZfctodt3ndFVEUBQFLq70BRYJ239RySaBjRpiERVVRt4ipD8S7tqeSu_IN2imIu6yRHnEgJwLdNM4WH7wewkU0NNrefqGsaoJBm4w08YXKF-riIUUW3fi5HDNhXTRA7mgyDCpMRgtccrpgycxbfc0BCo0SfWYTZ3NHUW4EwjlI Aug 10 17:57:32.883771 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 17:57:32.883771 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 17:57:32.883771 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 17:57:32.883771 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 17:57:32.883771 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 17:57:32.883771 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 17:57:32.883771 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: 05da8a9d374a4fba99108c6f67cf4754 Aug 10 17:57:32.883771 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-FlavorsV2NegativeTest-213241728 Aug 10 17:57:32.883771 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 17:57:32.883771 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 17:57:32.883771 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/05da8a9d374a4fba99108c6f67cf4754"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/05da8a9d374a4fba99108c6f67cf4754"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/05da8a9d374a4fba99108c6f67cf4754"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_05da8a9d374a4fba99108c6f67cf4754", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:57:32.883771 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-FlavorsV2NegativeTest-213241728 Aug 10 17:57:32.883771 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: 05da8a9d374a4fba99108c6f67cf4754 Aug 10 17:57:32.883771 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-213241728 Aug 10 17:57:32.883771 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-FlavorsV2NegativeTest-213241728-project Aug 10 17:57:32.883771 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 17:57:32.883771 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 17:57:32.883771 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: 6792febbf67747a382217880f03cd70f Aug 10 17:57:32.883771 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-FlavorsV2NegativeTest-213241728-project Aug 10 17:57:32.883771 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 17:57:32.883771 n-d-852296-2 devstack@n-api.service[129410]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-2063743468", "imageRef": "c3ca7b08-d4bf-45d3-9fb5-989ccb442206", "flavorRef": "452"}} Aug 10 17:57:32.883771 n-d-852296-2 devstack@n-api.service[129410]: method: > Aug 10 17:57:32.883771 n-d-852296-2 devstack@n-api.service[129410]: exception: Flavor's memory is too small for requested image. Aug 10 17:57:32.883771 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-2063743468', 'imageRef': 'c3ca7b08-d4bf-45d3-9fb5-989ccb442206', 'flavorRef': '452'}}} Aug 10 17:57:32.883771 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:57:32.883771 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:57:32.883771 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 17:57:32.883771 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 17:57:32.883771 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 17:57:32.883771 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 17:57:32.883771 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 10 17:57:32.883771 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Aug 10 17:57:32.883771 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1007, in _checks_for_create_and_rebuild Aug 10 17:57:32.883771 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Aug 10 17:57:32.883771 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 671, in _validate_flavor_image Aug 10 17:57:32.883771 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Aug 10 17:57:32.883771 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 739, in _validate_flavor_image_nostatus Aug 10 17:57:32.883771 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Aug 10 17:57:32.883771 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Aug 10 17:57:32.883771 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:57:32.883771 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:57:32.883771 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:57:32.883771 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:57:32.883771 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:57:32.883771 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:57:32.883771 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:57:32.883771 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:57:32.883771 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:57:32.883771 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:57:32.883771 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:57:32.883771 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:57:32.883771 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:57:32.883771 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:57:32.887254 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:57:32.887254 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:57:32.887254 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 17:57:32.887254 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Aug 10 17:57:32.887254 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 10 17:57:32.887254 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Aug 10 17:57:32.887254 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:57:32.887254 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:57:32.887254 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:57:32.887254 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:57:32.887254 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:57:32.887254 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:57:32.887254 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:57:32.887254 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:57:32.887254 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Aug 10 17:57:32.887254 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:57:32.889096 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-42b60e5c-57c9-41dd-96d8-2099715733d2 tempest-FlavorsV2NegativeTest-213241728 tempest-FlavorsV2NegativeTest-213241728-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:57:32.890269 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-42b60e5c-57c9-41dd-96d8-2099715733d2 tempest-FlavorsV2NegativeTest-213241728 tempest-FlavorsV2NegativeTest-213241728-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.701796 Aug 10 17:57:32.890927 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 804/1639] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 17:57:32 2022] POST /compute/v2.1/servers => generated 93 bytes in 703 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 10 17:57:33.090406 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-61dc1e39-2ded-4090-8585-2238cf3f1012 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '.version_select at 0x7fb345dfd820>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:57:34.392819 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-61dc1e39-2ded-4090-8585-2238cf3f1012 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/images/98768699-188a-47cb-94b1-0e22f2c1e614" status: 200 len: 1454 microversion: 2.1 time: 1.309632 Aug 10 17:57:34.399937 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 836/1640] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:57:33 2022] GET /compute/v2.1/images/98768699-188a-47cb-94b1-0e22f2c1e614 => generated 1454 bytes in 1311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:57:35.407703 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-141162af-0282-478d-b013-59630acdab59 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '.version_select at 0x7fb345beb280>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:57:35.507151 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-141162af-0282-478d-b013-59630acdab59 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/images/98768699-188a-47cb-94b1-0e22f2c1e614" status: 200 len: 1454 microversion: 2.1 time: 0.102699 Aug 10 17:57:35.519454 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 805/1641] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:57:35 2022] GET /compute/v2.1/images/98768699-188a-47cb-94b1-0e22f2c1e614 => generated 1454 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:57:36.522223 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-8cd742a6-a73f-4185-9f6b-486569bad4b2 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '.version_select at 0x7fb345ebeee0>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:57:36.608454 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-8cd742a6-a73f-4185-9f6b-486569bad4b2 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/images/98768699-188a-47cb-94b1-0e22f2c1e614" status: 200 len: 1454 microversion: 2.1 time: 0.086014 Aug 10 17:57:36.609061 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 837/1642] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:57:36 2022] GET /compute/v2.1/images/98768699-188a-47cb-94b1-0e22f2c1e614 => generated 1454 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:57:37.625753 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-ec861859-34cc-46f5-8594-ba743e708ad3 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '.version_select at 0x7fb345bfbc10>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:57:37.633861 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_cell1:SELECT=2 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:57:37.686790 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-ec861859-34cc-46f5-8594-ba743e708ad3 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/images/98768699-188a-47cb-94b1-0e22f2c1e614" status: 200 len: 1454 microversion: 2.1 time: 0.065138 Aug 10 17:57:37.687826 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 806/1643] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:57:37 2022] GET /compute/v2.1/images/98768699-188a-47cb-94b1-0e22f2c1e614 => generated 1454 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:57:38.703204 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-1e9824c4-c458-4454-ae89-4c7ba9cf70a1 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '.version_select at 0x7fb345eba160>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:57:38.771914 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-1e9824c4-c458-4454-ae89-4c7ba9cf70a1 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/images/98768699-188a-47cb-94b1-0e22f2c1e614" status: 200 len: 1454 microversion: 2.1 time: 0.073631 Aug 10 17:57:38.772853 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 838/1644] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:57:38 2022] GET /compute/v2.1/images/98768699-188a-47cb-94b1-0e22f2c1e614 => generated 1454 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:57:39.180886 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-c3388788-6be9-4290-a6c8-6e9aa02d29b5 tempest-ServerActionsTestJSON-1360577128 tempest-ServerActionsTestJSON-1360577128-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2089333044", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d588d154-d066-4b33-87a9-2fe673b4181a"}], "security_groups": [{"name": "tempest-securitygroup--2055492001"}], "key_name": "tempest-keypair-2135207287", "user_data": "}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:57:39.537594 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.network.neutron [None req-c3388788-6be9-4290-a6c8-6e9aa02d29b5 tempest-ServerActionsTestJSON-1360577128 tempest-ServerActionsTestJSON-1360577128-project] validate_networks() for [('d588d154-d066-4b33-87a9-2fe673b4181a', None, None, None, None, None)] {{(pid=129410) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 17:57:39.789087 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-403ed8a3-96b7-4f3f-aecc-5f9de3ff3f9e tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '.version_select at 0x7fb345ebe3a0>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:57:39.898783 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-403ed8a3-96b7-4f3f-aecc-5f9de3ff3f9e tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/images/98768699-188a-47cb-94b1-0e22f2c1e614" status: 200 len: 1454 microversion: 2.1 time: 0.115712 Aug 10 17:57:39.902969 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 839/1645] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:57:39 2022] GET /compute/v2.1/images/98768699-188a-47cb-94b1-0e22f2c1e614 => generated 1454 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:57:40.167077 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [None req-c3388788-6be9-4290-a6c8-6e9aa02d29b5 tempest-ServerActionsTestJSON-1360577128 tempest-ServerActionsTestJSON-1360577128-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-e8c85ca6-08de-4725-83ce-69bb635befb9) Aug 10 17:57:40.167077 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:57:40.167077 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:57:40.167077 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:57:40.167077 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:57:40.167077 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:57:40.167077 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:57:40.167077 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:57:40.167077 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:57:40.167077 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:57:40.167077 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 17:57:40.167077 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 17:57:40.167077 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 17:57:40.167077 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 17:57:40.167077 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 17:57:40.167077 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 17:57:40.167077 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 17:57:40.167077 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 17:57:40.167077 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 17:57:40.167077 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 17:57:40.167077 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 17:57:40.167077 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 17:57:40.167077 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 17:57:40.167077 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 17:57:40.167077 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 17:57:40.167077 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 17:57:40.167077 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 17:57:40.167077 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:57:40.167077 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:57:40.167077 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 17:57:40.167077 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 17:57:40.167077 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:57:40.167077 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:57:40.167077 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:57:40.167077 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:57:40.167077 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:57:40.167077 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:57:40.167077 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:57:40.167077 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:57:40.167077 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:57:40.167077 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:57:40.167077 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 17:57:40.167077 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 17:57:40.167077 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 17:57:40.167077 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 17:57:40.167077 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 17:57:40.167077 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 17:57:40.167077 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 17:57:40.167077 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 17:57:40.167077 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 17:57:40.167077 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 17:57:40.167077 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 17:57:40.167077 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 17:57:40.170067 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 17:57:40.170067 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 17:57:40.170067 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 17:57:40.170067 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 17:57:40.170067 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 17:57:40.170067 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 17:57:40.170067 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 17:57:40.170067 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 17:57:40.170067 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 17:57:40.170067 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 17:57:40.170067 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 17:57:40.170067 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 17:57:40.170067 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 17:57:40.170067 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 17:57:40.170067 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-e8c85ca6-08de-4725-83ce-69bb635befb9) Aug 10 17:57:40.170067 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:57:40.172743 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-c3388788-6be9-4290-a6c8-6e9aa02d29b5 tempest-ServerActionsTestJSON-1360577128 tempest-ServerActionsTestJSON-1360577128-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:57:40.172743 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 17:57:40.175777 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-c3388788-6be9-4290-a6c8-6e9aa02d29b5 tempest-ServerActionsTestJSON-1360577128 tempest-ServerActionsTestJSON-1360577128-project] Request method failure captured: Aug 10 17:57:40.175777 n-d-852296-2 devstack@n-api.service[129410]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 17:57:40.175777 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 17:57:40.175777 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 17:57:40.175777 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 17:57:40.175777 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 494 Aug 10 17:57:40.175777 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 17:57:40.175777 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 17:57:40.175777 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 17:57:40.175777 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 17:57:40.175777 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8_GKurCjabwdz7VTxJhr1YMY_XkQSMSvzzZ11f0w9tKQ_WJ4z-NqIgm8hFcy5pUKENASdms76Z6tVfR9VDQABXkNDPD-tM_NhbZzY2STFQVxgyBl-1CYDa3bSYdpfmuGzvreowgDSLa9JV-2LriiETdN6-dXYv4Ng1jkKLDET06YHiM Aug 10 17:57:40.175777 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 17:57:40.175777 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 17:57:40.175777 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 17:57:40.175777 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 17:57:40.175777 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 17:57:40.175777 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 17:57:40.175777 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: 9a574613f1164c45a54f983c2a0b617f Aug 10 17:57:40.175777 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-ServerActionsTestJSON-1360577128 Aug 10 17:57:40.175777 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 17:57:40.175777 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 17:57:40.175777 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9a574613f1164c45a54f983c2a0b617f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9a574613f1164c45a54f983c2a0b617f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9a574613f1164c45a54f983c2a0b617f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9a574613f1164c45a54f983c2a0b617f", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:57:40.175777 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-ServerActionsTestJSON-1360577128 Aug 10 17:57:40.175777 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: 9a574613f1164c45a54f983c2a0b617f Aug 10 17:57:40.175777 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-ServerActionsTestJSON-1360577128 Aug 10 17:57:40.175777 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-ServerActionsTestJSON-1360577128-project Aug 10 17:57:40.175777 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 17:57:40.175777 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 17:57:40.175777 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: 3fc5d88706d848b5ae1f4a6f343b4e43 Aug 10 17:57:40.175777 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-ServerActionsTestJSON-1360577128-project Aug 10 17:57:40.175777 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 17:57:40.175777 n-d-852296-2 devstack@n-api.service[129410]: {"server": {"name": "tempest-ServerActionsTestJSON-server-2089333044", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "adminPass": "X6&Wu=4XiDueG%n", "networks": [{"uuid": "d588d154-d066-4b33-87a9-2fe673b4181a"}], "security_groups": [{"name": "tempest-securitygroup--2055492001"}], "key_name": "tempest-keypair-2135207287", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} Aug 10 17:57:40.175777 n-d-852296-2 devstack@n-api.service[129410]: method: > Aug 10 17:57:40.175777 n-d-852296-2 devstack@n-api.service[129410]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:57:40.175777 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 17:57:40.175777 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'body': {'server': {'name': 'tempest-ServerActionsTestJSON-server-2089333044', 'imageRef': 'a735ff26-463a-4ffe-a981-ab9d9baa494f', 'flavorRef': '452', 'adminPass': 'X6&Wu=4XiDueG%n', 'networks': [{'uuid': 'd588d154-d066-4b33-87a9-2fe673b4181a'}], 'security_groups': [{'name': 'tempest-securitygroup--2055492001'}], 'key_name': 'tempest-keypair-2135207287', 'user_data': 'IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo='}}} Aug 10 17:57:40.175777 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:57:40.175777 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:57:40.175777 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:57:40.175777 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:57:40.175777 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:57:40.175777 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:57:40.175777 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:57:40.175777 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:57:40.175777 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:57:40.175777 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:57:40.175777 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 17:57:40.175777 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 17:57:40.175777 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 17:57:40.175777 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 17:57:40.175777 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 17:57:40.175777 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 17:57:40.175777 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 17:57:40.175777 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 17:57:40.175777 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 17:57:40.175777 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 17:57:40.180848 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 17:57:40.180848 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 17:57:40.180848 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 17:57:40.180848 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 17:57:40.180848 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 17:57:40.180848 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 17:57:40.180848 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 17:57:40.180848 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:57:40.180848 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:57:40.180848 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 17:57:40.180848 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 17:57:40.180848 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:57:40.180848 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:57:40.180848 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:57:40.180848 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:57:40.180848 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:57:40.180848 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:57:40.180848 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:57:40.180848 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:57:40.180848 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:57:40.180848 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:57:40.180848 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 17:57:40.180848 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 17:57:40.180848 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 17:57:40.180848 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 17:57:40.180848 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 17:57:40.180848 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 17:57:40.180848 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 17:57:40.180848 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 17:57:40.180848 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 17:57:40.180848 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 17:57:40.180848 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 17:57:40.180848 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 17:57:40.180848 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 17:57:40.180848 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 17:57:40.180848 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 17:57:40.180848 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 17:57:40.180848 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 17:57:40.180848 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 17:57:40.180848 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 17:57:40.180848 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 17:57:40.180848 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 17:57:40.180848 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 17:57:40.180848 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 17:57:40.180848 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 17:57:40.180848 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 17:57:40.180848 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 17:57:40.180848 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-e8c85ca6-08de-4725-83ce-69bb635befb9) Aug 10 17:57:40.180848 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:57:40.180848 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:57:40.180848 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:57:40.180848 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:57:40.180848 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:57:40.184116 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:57:40.184116 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:57:40.184116 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:57:40.184116 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 10 17:57:40.184116 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 10 17:57:40.184116 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:57:40.184116 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:57:40.184116 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:57:40.184116 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:57:40.184116 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:57:40.184116 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:57:40.184116 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:57:40.184116 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:57:40.184116 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:57:40.184116 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:57:40.184116 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:57:40.184116 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:57:40.184116 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:57:40.184116 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-c3388788-6be9-4290-a6c8-6e9aa02d29b5 tempest-ServerActionsTestJSON-1360577128 tempest-ServerActionsTestJSON-1360577128-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:57:40.184116 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:57:40.184116 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-c3388788-6be9-4290-a6c8-6e9aa02d29b5 tempest-ServerActionsTestJSON-1360577128 tempest-ServerActionsTestJSON-1360577128-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.002433 Aug 10 17:57:40.192300 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 807/1646] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 17:57:39 2022] POST /compute/v2.1/servers => generated 214 bytes in 1017 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 10 17:57:40.199453 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-0c763e6d-166a-4be9-9d35-7d58db148dd8 tempest-ServerActionsTestJSON-1360577128 tempest-ServerActionsTestJSON-1360577128-project] Calling method '.version_select at 0x7fb345dfdd30>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:57:40.211170 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_api:SELECT=38,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:57:40.332045 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-0c763e6d-166a-4be9-9d35-7d58db148dd8 tempest-ServerActionsTestJSON-1360577128 tempest-ServerActionsTestJSON-1360577128-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2135207287" status: 202 len: 0 microversion: 2.1 time: 0.138646 Aug 10 17:57:40.332760 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 840/1647] 10.222.0.50 () {58 vars in 1221 bytes} [Wed Aug 10 17:57:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2135207287 => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 17:57:40.916991 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-bd765981-8240-4a6d-b080-4ab2b128ceb8 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '.version_select at 0x7fb345b614c0>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:57:41.042373 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-bd765981-8240-4a6d-b080-4ab2b128ceb8 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/images/98768699-188a-47cb-94b1-0e22f2c1e614" status: 200 len: 1454 microversion: 2.1 time: 0.124705 Aug 10 17:57:41.043360 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 808/1648] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:57:40 2022] GET /compute/v2.1/images/98768699-188a-47cb-94b1-0e22f2c1e614 => generated 1454 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:57:42.054690 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_cell0:SELECT=4 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:57:42.060933 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-546e2399-b7f8-404b-915f-2d45cad10216 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '.version_select at 0x7fb345d9b5e0>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:57:42.157004 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-546e2399-b7f8-404b-915f-2d45cad10216 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/images/98768699-188a-47cb-94b1-0e22f2c1e614" status: 200 len: 1454 microversion: 2.1 time: 0.103799 Aug 10 17:57:42.163938 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 841/1649] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:57:42 2022] GET /compute/v2.1/images/98768699-188a-47cb-94b1-0e22f2c1e614 => generated 1454 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:57:43.178944 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-19d49633-7d1f-43b8-8c85-ad96993bda58 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '.version_select at 0x7fb345f1b430>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:57:43.219466 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:57:43.358892 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-19d49633-7d1f-43b8-8c85-ad96993bda58 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/images/98768699-188a-47cb-94b1-0e22f2c1e614" status: 200 len: 1454 microversion: 2.1 time: 0.184635 Aug 10 17:57:43.367602 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 842/1650] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:57:43 2022] GET /compute/v2.1/images/98768699-188a-47cb-94b1-0e22f2c1e614 => generated 1454 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:57:43.378241 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-6f8e09ed-c694-47fb-902c-6943b33081ce tempest-ServerGroupTestJSON-752066672 tempest-ServerGroupTestJSON-752066672-project] Action: 'create', calling method: .version_select at 0x7fb3459e9160>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-1111615190", "policies": ["affinity"]}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:57:43.427481 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.quota [None req-6f8e09ed-c694-47fb-902c-6943b33081ce tempest-ServerGroupTestJSON-752066672 tempest-ServerGroupTestJSON-752066672-project] Getting quotas for project bda0e92befa442c9ba6d121bf5f53750. Resources: {'server_groups'} {{(pid=129410) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:57:43.460609 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.quota [None req-6f8e09ed-c694-47fb-902c-6943b33081ce tempest-ServerGroupTestJSON-752066672 tempest-ServerGroupTestJSON-752066672-project] Getting quotas for user 395859304e1742acb870d232bc4820a3 and project bda0e92befa442c9ba6d121bf5f53750. Resources: {'server_groups'} {{(pid=129410) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:57:43.650419 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.quota [None req-6f8e09ed-c694-47fb-902c-6943b33081ce tempest-ServerGroupTestJSON-752066672 tempest-ServerGroupTestJSON-752066672-project] Getting quotas for project bda0e92befa442c9ba6d121bf5f53750. Resources: {'server_groups'} {{(pid=129410) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:57:43.659268 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.quota [None req-6f8e09ed-c694-47fb-902c-6943b33081ce tempest-ServerGroupTestJSON-752066672 tempest-ServerGroupTestJSON-752066672-project] Getting quotas for user 395859304e1742acb870d232bc4820a3 and project bda0e92befa442c9ba6d121bf5f53750. Resources: {'server_groups'} {{(pid=129410) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:57:43.697025 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-6f8e09ed-c694-47fb-902c-6943b33081ce tempest-ServerGroupTestJSON-752066672 tempest-ServerGroupTestJSON-752066672-project] 10.222.0.50 "POST /compute/v2.1/os-server-groups" status: 200 len: 184 microversion: 2.1 time: 0.933378 Aug 10 17:57:43.698396 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 809/1651] 10.222.0.50 () {60 vars in 1174 bytes} [Wed Aug 10 17:57:42 2022] POST /compute/v2.1/os-server-groups => generated 184 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:57:43.711041 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-ad15e50c-0353-4e61-8f44-8164e79734cc tempest-ServerGroupTestJSON-752066672 tempest-ServerGroupTestJSON-752066672-project] Action: 'create', calling method: .version_select at 0x7fb345dfd280>, body: {"server_group": {"name": "tempest-server-group-1279973511", "policies": ["affinity"]}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:57:43.744944 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-ad15e50c-0353-4e61-8f44-8164e79734cc tempest-ServerGroupTestJSON-752066672 tempest-ServerGroupTestJSON-752066672-project] Getting quotas for project bda0e92befa442c9ba6d121bf5f53750. Resources: {'server_groups'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:57:43.761738 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-ad15e50c-0353-4e61-8f44-8164e79734cc tempest-ServerGroupTestJSON-752066672 tempest-ServerGroupTestJSON-752066672-project] Getting quotas for user 395859304e1742acb870d232bc4820a3 and project bda0e92befa442c9ba6d121bf5f53750. Resources: {'server_groups'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:57:44.021732 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-ad15e50c-0353-4e61-8f44-8164e79734cc tempest-ServerGroupTestJSON-752066672 tempest-ServerGroupTestJSON-752066672-project] Getting quotas for project bda0e92befa442c9ba6d121bf5f53750. Resources: {'server_groups'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:57:44.048893 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-ad15e50c-0353-4e61-8f44-8164e79734cc tempest-ServerGroupTestJSON-752066672 tempest-ServerGroupTestJSON-752066672-project] Getting quotas for user 395859304e1742acb870d232bc4820a3 and project bda0e92befa442c9ba6d121bf5f53750. Resources: {'server_groups'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:57:44.111662 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-ad15e50c-0353-4e61-8f44-8164e79734cc tempest-ServerGroupTestJSON-752066672 tempest-ServerGroupTestJSON-752066672-project] 10.222.0.50 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.400987 Aug 10 17:57:44.124842 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 843/1652] 10.222.0.50 () {60 vars in 1173 bytes} [Wed Aug 10 17:57:43 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:57:44.126725 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-a9965876-e0b5-4446-93ae-5e093ac68ff2 tempest-ServerGroupTestJSON-752066672 tempest-ServerGroupTestJSON-752066672-project] Action: 'create', calling method: .version_select at 0x7fb3459e9d30>, body: {"server_group": {"name": "tempest-server-group-1279973511", "policies": ["affinity"]}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:57:44.186030 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.quota [None req-a9965876-e0b5-4446-93ae-5e093ac68ff2 tempest-ServerGroupTestJSON-752066672 tempest-ServerGroupTestJSON-752066672-project] Getting quotas for project bda0e92befa442c9ba6d121bf5f53750. Resources: {'server_groups'} {{(pid=129410) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:57:44.213415 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.quota [None req-a9965876-e0b5-4446-93ae-5e093ac68ff2 tempest-ServerGroupTestJSON-752066672 tempest-ServerGroupTestJSON-752066672-project] Getting quotas for user 395859304e1742acb870d232bc4820a3 and project bda0e92befa442c9ba6d121bf5f53750. Resources: {'server_groups'} {{(pid=129410) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:57:44.377006 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-a917f802-dd61-46fa-8caa-8ec18becfad8 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '.version_select at 0x7fb345eba3a0>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:57:44.451290 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-a917f802-dd61-46fa-8caa-8ec18becfad8 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/images/98768699-188a-47cb-94b1-0e22f2c1e614" status: 200 len: 1454 microversion: 2.1 time: 0.080019 Aug 10 17:57:44.463415 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 844/1653] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:57:44 2022] GET /compute/v2.1/images/98768699-188a-47cb-94b1-0e22f2c1e614 => generated 1454 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:57:44.616668 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.quota [None req-a9965876-e0b5-4446-93ae-5e093ac68ff2 tempest-ServerGroupTestJSON-752066672 tempest-ServerGroupTestJSON-752066672-project] Getting quotas for project bda0e92befa442c9ba6d121bf5f53750. Resources: {'server_groups'} {{(pid=129410) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:57:44.629444 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.quota [None req-a9965876-e0b5-4446-93ae-5e093ac68ff2 tempest-ServerGroupTestJSON-752066672 tempest-ServerGroupTestJSON-752066672-project] Getting quotas for user 395859304e1742acb870d232bc4820a3 and project bda0e92befa442c9ba6d121bf5f53750. Resources: {'server_groups'} {{(pid=129410) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:57:44.662387 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-a9965876-e0b5-4446-93ae-5e093ac68ff2 tempest-ServerGroupTestJSON-752066672 tempest-ServerGroupTestJSON-752066672-project] 10.222.0.50 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.541134 Aug 10 17:57:44.676565 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 810/1654] 10.222.0.50 () {60 vars in 1173 bytes} [Wed Aug 10 17:57:44 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:57:44.677556 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-182b5f8a-3b49-4ef2-8578-f61beaa57172 tempest-ServerGroupTestJSON-752066672 tempest-ServerGroupTestJSON-752066672-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:57:44.984049 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-182b5f8a-3b49-4ef2-8578-f61beaa57172 tempest-ServerGroupTestJSON-752066672 tempest-ServerGroupTestJSON-752066672-project] 10.222.0.50 "DELETE /compute/v2.1/os-server-groups/aed0e570-9f8f-4cc8-b4e7-d84260f5d444" status: 204 len: 0 microversion: 2.1 time: 0.313495 Aug 10 17:57:44.984618 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 845/1655] 10.222.0.50 () {58 vars in 1266 bytes} [Wed Aug 10 17:57:44 2022] DELETE /compute/v2.1/os-server-groups/aed0e570-9f8f-4cc8-b4e7-d84260f5d444 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 17:57:44.992717 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-3d81c0eb-e12e-48f2-8ce9-e93a59febfc0 tempest-ServerGroupTestJSON-752066672 tempest-ServerGroupTestJSON-752066672-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:57:45.018993 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-3d81c0eb-e12e-48f2-8ce9-e93a59febfc0 tempest-ServerGroupTestJSON-752066672 tempest-ServerGroupTestJSON-752066672-project] 10.222.0.50 "GET /compute/v2.1/os-server-groups" status: 200 len: 335 microversion: 2.1 time: 0.029878 Aug 10 17:57:45.033818 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 811/1656] 10.222.0.50 () {58 vars in 1152 bytes} [Wed Aug 10 17:57:44 2022] GET /compute/v2.1/os-server-groups => generated 335 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:57:45.039673 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-7080dd50-25a4-4514-af15-4023ac9d2b68 tempest-ServerGroupTestJSON-752066672 tempest-ServerGroupTestJSON-752066672-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:57:45.211965 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-7080dd50-25a4-4514-af15-4023ac9d2b68 tempest-ServerGroupTestJSON-752066672 tempest-ServerGroupTestJSON-752066672-project] 10.222.0.50 "DELETE /compute/v2.1/os-server-groups/62cb56e0-6be6-4f39-9afe-c0a654deeaac" status: 204 len: 0 microversion: 2.1 time: 0.176219 Aug 10 17:57:45.213380 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 846/1657] 10.222.0.50 () {58 vars in 1266 bytes} [Wed Aug 10 17:57:45 2022] DELETE /compute/v2.1/os-server-groups/62cb56e0-6be6-4f39-9afe-c0a654deeaac => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 17:57:45.221378 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-efdd90bc-e501-4536-b0c2-e73aedb71a63 tempest-ServerGroupTestJSON-752066672 tempest-ServerGroupTestJSON-752066672-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:57:45.246969 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-efdd90bc-e501-4536-b0c2-e73aedb71a63 tempest-ServerGroupTestJSON-752066672 tempest-ServerGroupTestJSON-752066672-project] 10.222.0.50 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.029449 Aug 10 17:57:45.266757 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-7f0e4959-4235-4c3d-8f69-6e208e58c239 tempest-ServerGroupTestJSON-752066672 tempest-ServerGroupTestJSON-752066672-project] Action: 'create', calling method: .version_select at 0x7fb345ebaca0>, body: {"server_group": {"name": "tempest-server-group-569623618", "policies": ["affinity"]}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:57:45.282531 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 812/1658] 10.222.0.50 () {58 vars in 1152 bytes} [Wed Aug 10 17:57:45 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:57:45.328980 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-7f0e4959-4235-4c3d-8f69-6e208e58c239 tempest-ServerGroupTestJSON-752066672 tempest-ServerGroupTestJSON-752066672-project] Getting quotas for project bda0e92befa442c9ba6d121bf5f53750. Resources: {'server_groups'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:57:45.352172 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-7f0e4959-4235-4c3d-8f69-6e208e58c239 tempest-ServerGroupTestJSON-752066672 tempest-ServerGroupTestJSON-752066672-project] Getting quotas for user 395859304e1742acb870d232bc4820a3 and project bda0e92befa442c9ba6d121bf5f53750. Resources: {'server_groups'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:57:45.468792 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-9238339a-5698-4e2a-990b-d95f57b25c83 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '.version_select at 0x7fb345c3cd30>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:57:45.607394 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-9238339a-5698-4e2a-990b-d95f57b25c83 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/images/98768699-188a-47cb-94b1-0e22f2c1e614" status: 200 len: 1454 microversion: 2.1 time: 0.143703 Aug 10 17:57:45.613755 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 813/1659] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:57:45 2022] GET /compute/v2.1/images/98768699-188a-47cb-94b1-0e22f2c1e614 => generated 1454 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:57:45.631173 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-7f0e4959-4235-4c3d-8f69-6e208e58c239 tempest-ServerGroupTestJSON-752066672 tempest-ServerGroupTestJSON-752066672-project] Getting quotas for project bda0e92befa442c9ba6d121bf5f53750. Resources: {'server_groups'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:57:45.647154 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-7f0e4959-4235-4c3d-8f69-6e208e58c239 tempest-ServerGroupTestJSON-752066672 tempest-ServerGroupTestJSON-752066672-project] Getting quotas for user 395859304e1742acb870d232bc4820a3 and project bda0e92befa442c9ba6d121bf5f53750. Resources: {'server_groups'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:57:45.685871 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-7f0e4959-4235-4c3d-8f69-6e208e58c239 tempest-ServerGroupTestJSON-752066672 tempest-ServerGroupTestJSON-752066672-project] 10.222.0.50 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.428794 Aug 10 17:57:45.694648 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 847/1660] 10.222.0.50 () {60 vars in 1173 bytes} [Wed Aug 10 17:57:45 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:57:45.699501 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-5a534790-7c69-47d4-b527-ea6b861e2b6d tempest-ServerGroupTestJSON-752066672 tempest-ServerGroupTestJSON-752066672-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:57:45.914172 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-5a534790-7c69-47d4-b527-ea6b861e2b6d tempest-ServerGroupTestJSON-752066672 tempest-ServerGroupTestJSON-752066672-project] 10.222.0.50 "DELETE /compute/v2.1/os-server-groups/768abdad-031d-4dfb-b214-7f5a779f0fa6" status: 204 len: 0 microversion: 2.1 time: 0.218971 Aug 10 17:57:45.915064 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 814/1661] 10.222.0.50 () {58 vars in 1266 bytes} [Wed Aug 10 17:57:45 2022] DELETE /compute/v2.1/os-server-groups/768abdad-031d-4dfb-b214-7f5a779f0fa6 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 17:57:45.923283 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-ff99374b-2fbc-4b4d-9934-e9348e78f66e tempest-ServerGroupTestJSON-752066672 tempest-ServerGroupTestJSON-752066672-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:57:45.952953 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-ff99374b-2fbc-4b4d-9934-e9348e78f66e tempest-ServerGroupTestJSON-752066672 tempest-ServerGroupTestJSON-752066672-project] 10.222.0.50 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.032937 Aug 10 17:57:45.967914 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 848/1662] 10.222.0.50 () {58 vars in 1152 bytes} [Wed Aug 10 17:57:45 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:57:45.973181 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-894850a9-89e1-4f2c-9412-4ad537e1a831 tempest-ServerGroupTestJSON-752066672 tempest-ServerGroupTestJSON-752066672-project] Action: 'create', calling method: .version_select at 0x7fb345bfbdc0>, body: {"server_group": {"name": "tempest-server-group-1504070370", "policies": ["anti-affinity"]}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:57:46.064652 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.quota [None req-894850a9-89e1-4f2c-9412-4ad537e1a831 tempest-ServerGroupTestJSON-752066672 tempest-ServerGroupTestJSON-752066672-project] Getting quotas for project bda0e92befa442c9ba6d121bf5f53750. Resources: {'server_groups'} {{(pid=129410) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:57:46.104733 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.quota [None req-894850a9-89e1-4f2c-9412-4ad537e1a831 tempest-ServerGroupTestJSON-752066672 tempest-ServerGroupTestJSON-752066672-project] Getting quotas for user 395859304e1742acb870d232bc4820a3 and project bda0e92befa442c9ba6d121bf5f53750. Resources: {'server_groups'} {{(pid=129410) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:57:46.368694 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.quota [None req-894850a9-89e1-4f2c-9412-4ad537e1a831 tempest-ServerGroupTestJSON-752066672 tempest-ServerGroupTestJSON-752066672-project] Getting quotas for project bda0e92befa442c9ba6d121bf5f53750. Resources: {'server_groups'} {{(pid=129410) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:57:46.415676 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.quota [None req-894850a9-89e1-4f2c-9412-4ad537e1a831 tempest-ServerGroupTestJSON-752066672 tempest-ServerGroupTestJSON-752066672-project] Getting quotas for user 395859304e1742acb870d232bc4820a3 and project bda0e92befa442c9ba6d121bf5f53750. Resources: {'server_groups'} {{(pid=129410) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:57:46.428087 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:DELETE=3 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:57:46.459143 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-894850a9-89e1-4f2c-9412-4ad537e1a831 tempest-ServerGroupTestJSON-752066672 tempest-ServerGroupTestJSON-752066672-project] 10.222.0.50 "POST /compute/v2.1/os-server-groups" status: 200 len: 169 microversion: 2.1 time: 0.488840 Aug 10 17:57:46.461780 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 815/1663] 10.222.0.50 () {60 vars in 1173 bytes} [Wed Aug 10 17:57:45 2022] POST /compute/v2.1/os-server-groups => generated 169 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:57:46.471885 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-c76e78ad-6f49-404d-891d-97d6570addf0 tempest-ServerGroupTestJSON-752066672 tempest-ServerGroupTestJSON-752066672-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:57:46.622831 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-55d07ea8-c7fd-4373-a814-0bca8411213a tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '.version_select at 0x7fb345bf8430>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:57:46.697170 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-c76e78ad-6f49-404d-891d-97d6570addf0 tempest-ServerGroupTestJSON-752066672 tempest-ServerGroupTestJSON-752066672-project] 10.222.0.50 "DELETE /compute/v2.1/os-server-groups/1579ec07-2f42-4499-9518-a30e17ecb0b8" status: 204 len: 0 microversion: 2.1 time: 0.229713 Aug 10 17:57:46.697800 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 849/1664] 10.222.0.50 () {58 vars in 1266 bytes} [Wed Aug 10 17:57:46 2022] DELETE /compute/v2.1/os-server-groups/1579ec07-2f42-4499-9518-a30e17ecb0b8 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 17:57:46.707639 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-8c760bf2-4671-4d53-a7cc-83c8440fee77 tempest-ServerGroupTestJSON-752066672 tempest-ServerGroupTestJSON-752066672-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:57:46.739248 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-55d07ea8-c7fd-4373-a814-0bca8411213a tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/images/98768699-188a-47cb-94b1-0e22f2c1e614" status: 200 len: 1454 microversion: 2.1 time: 0.120053 Aug 10 17:57:46.743154 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-8c760bf2-4671-4d53-a7cc-83c8440fee77 tempest-ServerGroupTestJSON-752066672 tempest-ServerGroupTestJSON-752066672-project] 10.222.0.50 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.039760 Aug 10 17:57:46.763224 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 850/1665] 10.222.0.50 () {58 vars in 1152 bytes} [Wed Aug 10 17:57:46 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:57:46.768491 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 816/1666] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:57:46 2022] GET /compute/v2.1/images/98768699-188a-47cb-94b1-0e22f2c1e614 => generated 1454 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:57:47.041399 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-3a7ca70b-c3a9-412a-b667-f4b3bb62cdea tempest-ServerGroupTestJSON-752066672 tempest-ServerGroupTestJSON-752066672-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-877160427", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "bc7df61a-7c98-4315-96d2-97bd396fb08e"}]}, "os:scheduler_hints": {"group": "0a4c3326-8dfb-44dd-be0f-2e4c0afbe03f"}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:57:47.182910 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.network.neutron [None req-3a7ca70b-c3a9-412a-b667-f4b3bb62cdea tempest-ServerGroupTestJSON-752066672 tempest-ServerGroupTestJSON-752066672-project] validate_networks() for [('bc7df61a-7c98-4315-96d2-97bd396fb08e', None, None, None, None, None)] {{(pid=129409) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 17:57:47.576373 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [None req-3a7ca70b-c3a9-412a-b667-f4b3bb62cdea tempest-ServerGroupTestJSON-752066672 tempest-ServerGroupTestJSON-752066672-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-254cb264-9623-45fe-ba46-46aa35fcd562) Aug 10 17:57:47.576373 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:57:47.576373 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:57:47.576373 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:57:47.576373 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:57:47.576373 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:57:47.576373 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:57:47.576373 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:57:47.576373 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:57:47.576373 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:57:47.576373 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 17:57:47.576373 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 17:57:47.576373 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 17:57:47.576373 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 17:57:47.576373 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 17:57:47.576373 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 17:57:47.576373 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 17:57:47.576373 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 17:57:47.576373 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 17:57:47.576373 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 17:57:47.576373 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 17:57:47.576373 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 17:57:47.576373 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 17:57:47.576373 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 17:57:47.576373 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 17:57:47.576373 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 17:57:47.576373 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 17:57:47.576373 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:57:47.576373 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:57:47.576373 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 17:57:47.576373 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 17:57:47.576373 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:57:47.576373 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:57:47.576373 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:57:47.576373 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:57:47.576373 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:57:47.576373 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:57:47.576373 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:57:47.576373 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:57:47.576373 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:57:47.576373 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:57:47.576373 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 17:57:47.576373 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 17:57:47.576373 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 17:57:47.576373 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 17:57:47.576373 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 17:57:47.576373 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 17:57:47.576373 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 17:57:47.576373 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 17:57:47.576373 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 17:57:47.576373 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 17:57:47.576373 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 17:57:47.576373 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 17:57:47.580229 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 17:57:47.580229 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 17:57:47.580229 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 17:57:47.580229 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 17:57:47.580229 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 17:57:47.580229 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 17:57:47.580229 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 17:57:47.580229 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 17:57:47.580229 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 17:57:47.580229 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 17:57:47.580229 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 17:57:47.580229 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 17:57:47.580229 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 17:57:47.580229 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 17:57:47.580229 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-254cb264-9623-45fe-ba46-46aa35fcd562) Aug 10 17:57:47.580229 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:57:47.584771 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-3a7ca70b-c3a9-412a-b667-f4b3bb62cdea tempest-ServerGroupTestJSON-752066672 tempest-ServerGroupTestJSON-752066672-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:57:47.584771 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:57:47.588203 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-3a7ca70b-c3a9-412a-b667-f4b3bb62cdea tempest-ServerGroupTestJSON-752066672 tempest-ServerGroupTestJSON-752066672-project] Request method failure captured: Aug 10 17:57:47.588203 n-d-852296-2 devstack@n-api.service[129409]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 17:57:47.588203 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 17:57:47.588203 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 17:57:47.588203 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 17:57:47.588203 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 277 Aug 10 17:57:47.588203 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 17:57:47.588203 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 17:57:47.588203 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 17:57:47.588203 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 17:57:47.588203 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8_GWxex0ZUVYH5AUwqNFvMTwV-RDHQQa6UioMlloiADYZc9Xsn-tantAIEWapb_KnFlljIVP0PNcdgm7Y70oHqf5vONn4JgEL_2Gps-sPoaPhdyrEerfeFUJyxRdRx6ARNbSV0KUn9OxZsZEMBrf3mVzOQ0kGNlw_GtCaUprLWY7OOs Aug 10 17:57:47.588203 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 17:57:47.588203 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 17:57:47.588203 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 17:57:47.588203 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 17:57:47.588203 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 17:57:47.588203 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 17:57:47.588203 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: bda0e92befa442c9ba6d121bf5f53750 Aug 10 17:57:47.588203 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-ServerGroupTestJSON-752066672 Aug 10 17:57:47.588203 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 17:57:47.588203 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 17:57:47.588203 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/bda0e92befa442c9ba6d121bf5f53750"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/bda0e92befa442c9ba6d121bf5f53750"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/bda0e92befa442c9ba6d121bf5f53750"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_bda0e92befa442c9ba6d121bf5f53750", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:57:47.588203 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-ServerGroupTestJSON-752066672 Aug 10 17:57:47.588203 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: bda0e92befa442c9ba6d121bf5f53750 Aug 10 17:57:47.588203 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-ServerGroupTestJSON-752066672 Aug 10 17:57:47.588203 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-ServerGroupTestJSON-752066672-project Aug 10 17:57:47.588203 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 17:57:47.588203 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 17:57:47.588203 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: 395859304e1742acb870d232bc4820a3 Aug 10 17:57:47.588203 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-ServerGroupTestJSON-752066672-project Aug 10 17:57:47.588203 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:57:47.588203 n-d-852296-2 devstack@n-api.service[129409]: {"server": {"name": "tempest-ServerGroupTestJSON-server-877160427", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "bc7df61a-7c98-4315-96d2-97bd396fb08e"}]}, "os:scheduler_hints": {"group": "0a4c3326-8dfb-44dd-be0f-2e4c0afbe03f"}} Aug 10 17:57:47.588203 n-d-852296-2 devstack@n-api.service[129409]: method: > Aug 10 17:57:47.588203 n-d-852296-2 devstack@n-api.service[129409]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:57:47.588203 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:57:47.588203 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'body': {'server': {'name': 'tempest-ServerGroupTestJSON-server-877160427', 'imageRef': 'a735ff26-463a-4ffe-a981-ab9d9baa494f', 'flavorRef': '452', 'networks': [{'uuid': 'bc7df61a-7c98-4315-96d2-97bd396fb08e'}]}, 'os:scheduler_hints': {'group': '0a4c3326-8dfb-44dd-be0f-2e4c0afbe03f'}}} Aug 10 17:57:47.588203 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:57:47.588203 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:57:47.588203 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:57:47.588203 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:57:47.588203 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:57:47.588203 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:57:47.588203 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:57:47.588203 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:57:47.588203 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:57:47.588203 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:57:47.588203 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 17:57:47.588203 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 17:57:47.588203 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 17:57:47.588203 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 17:57:47.588203 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 17:57:47.588203 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 17:57:47.588203 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 17:57:47.588203 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 17:57:47.588203 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 17:57:47.588203 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 17:57:47.588203 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 17:57:47.588203 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 17:57:47.588203 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 17:57:47.588203 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 17:57:47.591588 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 17:57:47.591588 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 17:57:47.591588 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 17:57:47.591588 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:57:47.591588 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:57:47.591588 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 17:57:47.591588 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 17:57:47.591588 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:57:47.591588 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:57:47.591588 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:57:47.591588 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:57:47.591588 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:57:47.591588 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:57:47.591588 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:57:47.591588 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:57:47.591588 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:57:47.591588 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:57:47.591588 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 17:57:47.591588 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 17:57:47.591588 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 17:57:47.591588 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 17:57:47.591588 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 17:57:47.591588 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 17:57:47.591588 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 17:57:47.591588 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 17:57:47.591588 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 17:57:47.591588 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 17:57:47.591588 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 17:57:47.591588 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 17:57:47.591588 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 17:57:47.591588 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 17:57:47.591588 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 17:57:47.591588 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 17:57:47.591588 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 17:57:47.591588 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 17:57:47.591588 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 17:57:47.591588 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 17:57:47.591588 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 17:57:47.591588 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 17:57:47.591588 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 17:57:47.591588 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 17:57:47.591588 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 17:57:47.591588 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 17:57:47.591588 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-254cb264-9623-45fe-ba46-46aa35fcd562) Aug 10 17:57:47.591588 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:57:47.591588 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:57:47.591588 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:57:47.591588 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:57:47.591588 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:57:47.591588 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:57:47.591588 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:57:47.591588 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:57:47.591588 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 10 17:57:47.595249 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 10 17:57:47.595249 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:57:47.595249 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:57:47.595249 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:57:47.595249 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:57:47.595249 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:57:47.595249 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:57:47.595249 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:57:47.595249 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:57:47.595249 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:57:47.595249 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:57:47.595249 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:57:47.595249 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:57:47.595249 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:57:47.602492 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-3a7ca70b-c3a9-412a-b667-f4b3bb62cdea tempest-ServerGroupTestJSON-752066672 tempest-ServerGroupTestJSON-752066672-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:57:47.602492 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:57:47.605054 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-3a7ca70b-c3a9-412a-b667-f4b3bb62cdea tempest-ServerGroupTestJSON-752066672 tempest-ServerGroupTestJSON-752066672-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.570373 Aug 10 17:57:47.606886 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 851/1667] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 17:57:47 2022] POST /compute/v2.1/servers => generated 214 bytes in 573 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 10 17:57:47.624819 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-4019e58b-ef0e-4422-b151-46e76727a185 tempest-ServerGroupTestJSON-752066672 tempest-ServerGroupTestJSON-752066672-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:57:47.665180 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-4019e58b-ef0e-4422-b151-46e76727a185 tempest-ServerGroupTestJSON-752066672 tempest-ServerGroupTestJSON-752066672-project] 10.222.0.50 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.042953 Aug 10 17:57:47.678453 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-c40221a0-72e9-4561-9294-aff7c2cd9be3 tempest-ServerGroupTestJSON-752066672 tempest-ServerGroupTestJSON-752066672-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:57:47.687185 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 817/1668] 10.222.0.50 () {58 vars in 1152 bytes} [Wed Aug 10 17:57:47 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:57:47.692321 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-c40221a0-72e9-4561-9294-aff7c2cd9be3 tempest-ServerGroupTestJSON-752066672 tempest-ServerGroupTestJSON-752066672-project] 10.222.0.50 "GET /compute/v2.1/os-server-groups/0a4c3326-8dfb-44dd-be0f-2e4c0afbe03f" status: 200 len: 184 microversion: 2.1 time: 0.017781 Aug 10 17:57:47.708136 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-67cb728d-a8c7-4865-8d5f-259d7cca4bc6 tempest-ServerGroupTestJSON-752066672 tempest-ServerGroupTestJSON-752066672-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:57:47.716295 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 852/1669] 10.222.0.50 () {58 vars in 1263 bytes} [Wed Aug 10 17:57:47 2022] GET /compute/v2.1/os-server-groups/0a4c3326-8dfb-44dd-be0f-2e4c0afbe03f => generated 184 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:57:47.729736 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-67cb728d-a8c7-4865-8d5f-259d7cca4bc6 tempest-ServerGroupTestJSON-752066672 tempest-ServerGroupTestJSON-752066672-project] HTTP exception thrown: Instance group 1579ec07-2f42-4499-9518-a30e17ecb0b8 could not be found. Aug 10 17:57:47.752752 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-67cb728d-a8c7-4865-8d5f-259d7cca4bc6 tempest-ServerGroupTestJSON-752066672 tempest-ServerGroupTestJSON-752066672-project] Request method failure captured: Aug 10 17:57:47.752752 n-d-852296-2 devstack@n-api.service[129410]: request: DELETE /compute/v2.1/os-server-groups/1579ec07-2f42-4499-9518-a30e17ecb0b8 HTTP/1.1 Aug 10 17:57:47.752752 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 17:57:47.752752 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 17:57:47.752752 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 17:57:47.752752 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 0 Aug 10 17:57:47.752752 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 17:57:47.752752 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 17:57:47.752752 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 17:57:47.752752 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 17:57:47.752752 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8_GWxex0ZUVYH5AUwqNFvMTwV-RDHQQa6UioMlloiADYZc9Xsn-tantAIEWapb_KnFlljIVP0PNcdgm7Y70oHqf5vONn4JgEL_2Gps-sPoaPhdyrEerfeFUJyxRdRx6ARNbSV0KUn9OxZsZEMBrf3mVzOQ0kGNlw_GtCaUprLWY7OOs Aug 10 17:57:47.752752 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 17:57:47.752752 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 17:57:47.752752 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 17:57:47.752752 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 17:57:47.752752 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 17:57:47.752752 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 17:57:47.752752 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: bda0e92befa442c9ba6d121bf5f53750 Aug 10 17:57:47.752752 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-ServerGroupTestJSON-752066672 Aug 10 17:57:47.752752 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 17:57:47.752752 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 17:57:47.752752 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/bda0e92befa442c9ba6d121bf5f53750"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/bda0e92befa442c9ba6d121bf5f53750"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/bda0e92befa442c9ba6d121bf5f53750"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_bda0e92befa442c9ba6d121bf5f53750", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:57:47.752752 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-ServerGroupTestJSON-752066672 Aug 10 17:57:47.752752 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: bda0e92befa442c9ba6d121bf5f53750 Aug 10 17:57:47.752752 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-ServerGroupTestJSON-752066672 Aug 10 17:57:47.752752 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-ServerGroupTestJSON-752066672-project Aug 10 17:57:47.752752 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 17:57:47.752752 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 17:57:47.752752 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: 395859304e1742acb870d232bc4820a3 Aug 10 17:57:47.752752 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-ServerGroupTestJSON-752066672-project Aug 10 17:57:47.752752 n-d-852296-2 devstack@n-api.service[129410]: method: > Aug 10 17:57:47.752752 n-d-852296-2 devstack@n-api.service[129410]: exception: Instance group 1579ec07-2f42-4499-9518-a30e17ecb0b8 could not be found. Aug 10 17:57:47.752752 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'id': '1579ec07-2f42-4499-9518-a30e17ecb0b8'} Aug 10 17:57:47.752752 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:57:47.752752 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:57:47.752752 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 10 17:57:47.752752 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 10 17:57:47.752752 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 17:57:47.752752 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 17:57:47.752752 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 10 17:57:47.752752 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 10 17:57:47.752752 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 10 17:57:47.752752 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 10 17:57:47.752752 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 10 17:57:47.752752 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 10 17:57:47.752752 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 1579ec07-2f42-4499-9518-a30e17ecb0b8 could not be found. Aug 10 17:57:47.752752 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:57:47.752752 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:57:47.752752 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:57:47.752752 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:57:47.752752 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:57:47.752752 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:57:47.752752 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:57:47.752752 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:57:47.752752 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:57:47.752752 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:57:47.752752 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 10 17:57:47.752752 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:57:47.752752 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 1579ec07-2f42-4499-9518-a30e17ecb0b8 could not be found. Aug 10 17:57:47.752752 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:57:47.752752 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:57:47.752752 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:57:47.752752 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:57:47.758651 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:57:47.758651 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:57:47.758651 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:57:47.758651 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:57:47.758651 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 1579ec07-2f42-4499-9518-a30e17ecb0b8 could not be found. Aug 10 17:57:47.758651 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:57:47.758651 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-67cb728d-a8c7-4865-8d5f-259d7cca4bc6 tempest-ServerGroupTestJSON-752066672 tempest-ServerGroupTestJSON-752066672-project] Returning 404 to user: Instance group 1579ec07-2f42-4499-9518-a30e17ecb0b8 could not be found. {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:57:47.758651 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-67cb728d-a8c7-4865-8d5f-259d7cca4bc6 tempest-ServerGroupTestJSON-752066672 tempest-ServerGroupTestJSON-752066672-project] 10.222.0.50 "DELETE /compute/v2.1/os-server-groups/1579ec07-2f42-4499-9518-a30e17ecb0b8" status: 404 len: 117 microversion: 2.1 time: 0.050192 Aug 10 17:57:47.759747 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 818/1670] 10.222.0.50 () {58 vars in 1266 bytes} [Wed Aug 10 17:57:47 2022] DELETE /compute/v2.1/os-server-groups/1579ec07-2f42-4499-9518-a30e17ecb0b8 => generated 117 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:57:47.762272 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-f64fb0d1-ef16-43d4-93a5-b3166481e538 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '.version_select at 0x7fb345e25160>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:57:47.772660 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-90acf20e-cdf4-4f85-84a8-baf998136c27 tempest-ServerGroupTestJSON-752066672 tempest-ServerGroupTestJSON-752066672-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:57:47.796909 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-90acf20e-cdf4-4f85-84a8-baf998136c27 tempest-ServerGroupTestJSON-752066672 tempest-ServerGroupTestJSON-752066672-project] HTTP exception thrown: Instance group 768abdad-031d-4dfb-b214-7f5a779f0fa6 could not be found. Aug 10 17:57:47.798713 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-90acf20e-cdf4-4f85-84a8-baf998136c27 tempest-ServerGroupTestJSON-752066672 tempest-ServerGroupTestJSON-752066672-project] Request method failure captured: Aug 10 17:57:47.798713 n-d-852296-2 devstack@n-api.service[129410]: request: DELETE /compute/v2.1/os-server-groups/768abdad-031d-4dfb-b214-7f5a779f0fa6 HTTP/1.1 Aug 10 17:57:47.798713 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 17:57:47.798713 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 17:57:47.798713 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 17:57:47.798713 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 0 Aug 10 17:57:47.798713 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 17:57:47.798713 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 17:57:47.798713 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 17:57:47.798713 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 17:57:47.798713 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8_GWxex0ZUVYH5AUwqNFvMTwV-RDHQQa6UioMlloiADYZc9Xsn-tantAIEWapb_KnFlljIVP0PNcdgm7Y70oHqf5vONn4JgEL_2Gps-sPoaPhdyrEerfeFUJyxRdRx6ARNbSV0KUn9OxZsZEMBrf3mVzOQ0kGNlw_GtCaUprLWY7OOs Aug 10 17:57:47.798713 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 17:57:47.798713 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 17:57:47.798713 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 17:57:47.798713 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 17:57:47.798713 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 17:57:47.798713 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 17:57:47.798713 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: bda0e92befa442c9ba6d121bf5f53750 Aug 10 17:57:47.798713 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-ServerGroupTestJSON-752066672 Aug 10 17:57:47.798713 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 17:57:47.798713 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 17:57:47.798713 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/bda0e92befa442c9ba6d121bf5f53750"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/bda0e92befa442c9ba6d121bf5f53750"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/bda0e92befa442c9ba6d121bf5f53750"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_bda0e92befa442c9ba6d121bf5f53750", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:57:47.798713 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-ServerGroupTestJSON-752066672 Aug 10 17:57:47.798713 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: bda0e92befa442c9ba6d121bf5f53750 Aug 10 17:57:47.798713 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-ServerGroupTestJSON-752066672 Aug 10 17:57:47.798713 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-ServerGroupTestJSON-752066672-project Aug 10 17:57:47.798713 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 17:57:47.798713 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 17:57:47.798713 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: 395859304e1742acb870d232bc4820a3 Aug 10 17:57:47.798713 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-ServerGroupTestJSON-752066672-project Aug 10 17:57:47.798713 n-d-852296-2 devstack@n-api.service[129410]: method: > Aug 10 17:57:47.798713 n-d-852296-2 devstack@n-api.service[129410]: exception: Instance group 768abdad-031d-4dfb-b214-7f5a779f0fa6 could not be found. Aug 10 17:57:47.798713 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'id': '768abdad-031d-4dfb-b214-7f5a779f0fa6'} Aug 10 17:57:47.798713 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:57:47.798713 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:57:47.798713 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 10 17:57:47.798713 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 10 17:57:47.798713 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 17:57:47.798713 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 17:57:47.798713 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 10 17:57:47.798713 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 10 17:57:47.798713 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 10 17:57:47.798713 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 10 17:57:47.798713 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 10 17:57:47.798713 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 10 17:57:47.798713 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 768abdad-031d-4dfb-b214-7f5a779f0fa6 could not be found. Aug 10 17:57:47.798713 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:57:47.798713 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:57:47.798713 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:57:47.798713 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:57:47.798713 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:57:47.798713 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:57:47.798713 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:57:47.798713 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:57:47.798713 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:57:47.798713 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:57:47.798713 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 10 17:57:47.798713 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:57:47.798713 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 768abdad-031d-4dfb-b214-7f5a779f0fa6 could not be found. Aug 10 17:57:47.798713 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:57:47.798713 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:57:47.798713 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:57:47.798713 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:57:47.802699 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:57:47.802699 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:57:47.802699 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:57:47.802699 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:57:47.802699 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 768abdad-031d-4dfb-b214-7f5a779f0fa6 could not be found. Aug 10 17:57:47.802699 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:57:47.803945 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-90acf20e-cdf4-4f85-84a8-baf998136c27 tempest-ServerGroupTestJSON-752066672 tempest-ServerGroupTestJSON-752066672-project] Returning 404 to user: Instance group 768abdad-031d-4dfb-b214-7f5a779f0fa6 could not be found. {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:57:47.808543 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-90acf20e-cdf4-4f85-84a8-baf998136c27 tempest-ServerGroupTestJSON-752066672 tempest-ServerGroupTestJSON-752066672-project] 10.222.0.50 "DELETE /compute/v2.1/os-server-groups/768abdad-031d-4dfb-b214-7f5a779f0fa6" status: 404 len: 117 microversion: 2.1 time: 0.042329 Aug 10 17:57:47.813270 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 819/1671] 10.222.0.50 () {58 vars in 1266 bytes} [Wed Aug 10 17:57:47 2022] DELETE /compute/v2.1/os-server-groups/768abdad-031d-4dfb-b214-7f5a779f0fa6 => generated 117 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:57:47.825324 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-e4102981-6f5c-487b-866d-5e9fb21d0a11 tempest-ServerGroupTestJSON-752066672 tempest-ServerGroupTestJSON-752066672-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:57:47.852696 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-f64fb0d1-ef16-43d4-93a5-b3166481e538 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/images/98768699-188a-47cb-94b1-0e22f2c1e614" status: 200 len: 1454 microversion: 2.1 time: 0.100902 Aug 10 17:57:47.863701 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-e4102981-6f5c-487b-866d-5e9fb21d0a11 tempest-ServerGroupTestJSON-752066672 tempest-ServerGroupTestJSON-752066672-project] HTTP exception thrown: Instance group 62cb56e0-6be6-4f39-9afe-c0a654deeaac could not be found. Aug 10 17:57:47.864660 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 853/1672] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:57:47 2022] GET /compute/v2.1/images/98768699-188a-47cb-94b1-0e22f2c1e614 => generated 1454 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:57:47.868286 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-e4102981-6f5c-487b-866d-5e9fb21d0a11 tempest-ServerGroupTestJSON-752066672 tempest-ServerGroupTestJSON-752066672-project] Request method failure captured: Aug 10 17:57:47.868286 n-d-852296-2 devstack@n-api.service[129410]: request: DELETE /compute/v2.1/os-server-groups/62cb56e0-6be6-4f39-9afe-c0a654deeaac HTTP/1.1 Aug 10 17:57:47.868286 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 17:57:47.868286 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 17:57:47.868286 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 17:57:47.868286 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 0 Aug 10 17:57:47.868286 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 17:57:47.868286 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 17:57:47.868286 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 17:57:47.868286 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 17:57:47.868286 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8_GWxex0ZUVYH5AUwqNFvMTwV-RDHQQa6UioMlloiADYZc9Xsn-tantAIEWapb_KnFlljIVP0PNcdgm7Y70oHqf5vONn4JgEL_2Gps-sPoaPhdyrEerfeFUJyxRdRx6ARNbSV0KUn9OxZsZEMBrf3mVzOQ0kGNlw_GtCaUprLWY7OOs Aug 10 17:57:47.868286 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 17:57:47.868286 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 17:57:47.868286 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 17:57:47.868286 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 17:57:47.868286 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 17:57:47.868286 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 17:57:47.868286 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: bda0e92befa442c9ba6d121bf5f53750 Aug 10 17:57:47.868286 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-ServerGroupTestJSON-752066672 Aug 10 17:57:47.868286 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 17:57:47.868286 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 17:57:47.868286 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/bda0e92befa442c9ba6d121bf5f53750"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/bda0e92befa442c9ba6d121bf5f53750"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/bda0e92befa442c9ba6d121bf5f53750"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_bda0e92befa442c9ba6d121bf5f53750", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:57:47.868286 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-ServerGroupTestJSON-752066672 Aug 10 17:57:47.868286 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: bda0e92befa442c9ba6d121bf5f53750 Aug 10 17:57:47.868286 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-ServerGroupTestJSON-752066672 Aug 10 17:57:47.868286 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-ServerGroupTestJSON-752066672-project Aug 10 17:57:47.868286 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 17:57:47.868286 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 17:57:47.868286 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: 395859304e1742acb870d232bc4820a3 Aug 10 17:57:47.868286 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-ServerGroupTestJSON-752066672-project Aug 10 17:57:47.868286 n-d-852296-2 devstack@n-api.service[129410]: method: > Aug 10 17:57:47.868286 n-d-852296-2 devstack@n-api.service[129410]: exception: Instance group 62cb56e0-6be6-4f39-9afe-c0a654deeaac could not be found. Aug 10 17:57:47.868286 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'id': '62cb56e0-6be6-4f39-9afe-c0a654deeaac'} Aug 10 17:57:47.868286 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:57:47.868286 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:57:47.868286 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 10 17:57:47.868286 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 10 17:57:47.868286 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 17:57:47.868286 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 17:57:47.868286 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 10 17:57:47.868286 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 10 17:57:47.868286 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 10 17:57:47.868286 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 10 17:57:47.868286 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 10 17:57:47.868286 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 10 17:57:47.868286 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 62cb56e0-6be6-4f39-9afe-c0a654deeaac could not be found. Aug 10 17:57:47.868286 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:57:47.868286 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:57:47.868286 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:57:47.868286 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:57:47.868286 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:57:47.868286 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:57:47.868286 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:57:47.868286 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:57:47.868286 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:57:47.868286 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:57:47.868286 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 10 17:57:47.868286 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:57:47.868286 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 62cb56e0-6be6-4f39-9afe-c0a654deeaac could not be found. Aug 10 17:57:47.868286 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:57:47.868286 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:57:47.868286 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:57:47.868286 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:57:47.871821 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:57:47.871821 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:57:47.871821 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:57:47.871821 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:57:47.871821 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 62cb56e0-6be6-4f39-9afe-c0a654deeaac could not be found. Aug 10 17:57:47.871821 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:57:47.871821 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-e4102981-6f5c-487b-866d-5e9fb21d0a11 tempest-ServerGroupTestJSON-752066672 tempest-ServerGroupTestJSON-752066672-project] Returning 404 to user: Instance group 62cb56e0-6be6-4f39-9afe-c0a654deeaac could not be found. {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:57:47.871821 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-e4102981-6f5c-487b-866d-5e9fb21d0a11 tempest-ServerGroupTestJSON-752066672 tempest-ServerGroupTestJSON-752066672-project] 10.222.0.50 "DELETE /compute/v2.1/os-server-groups/62cb56e0-6be6-4f39-9afe-c0a654deeaac" status: 404 len: 117 microversion: 2.1 time: 0.055262 Aug 10 17:57:47.874698 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 820/1673] 10.222.0.50 () {58 vars in 1266 bytes} [Wed Aug 10 17:57:47 2022] DELETE /compute/v2.1/os-server-groups/62cb56e0-6be6-4f39-9afe-c0a654deeaac => generated 117 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:57:47.884053 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-ab19f0ac-1d3b-4361-90a8-a901c44c89fe tempest-ServerGroupTestJSON-752066672 tempest-ServerGroupTestJSON-752066672-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:57:47.916093 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-ab19f0ac-1d3b-4361-90a8-a901c44c89fe tempest-ServerGroupTestJSON-752066672 tempest-ServerGroupTestJSON-752066672-project] HTTP exception thrown: Instance group aed0e570-9f8f-4cc8-b4e7-d84260f5d444 could not be found. Aug 10 17:57:47.927797 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-ab19f0ac-1d3b-4361-90a8-a901c44c89fe tempest-ServerGroupTestJSON-752066672 tempest-ServerGroupTestJSON-752066672-project] Request method failure captured: Aug 10 17:57:47.927797 n-d-852296-2 devstack@n-api.service[129409]: request: DELETE /compute/v2.1/os-server-groups/aed0e570-9f8f-4cc8-b4e7-d84260f5d444 HTTP/1.1 Aug 10 17:57:47.927797 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 17:57:47.927797 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 17:57:47.927797 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 17:57:47.927797 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 0 Aug 10 17:57:47.927797 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 17:57:47.927797 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 17:57:47.927797 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 17:57:47.927797 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 17:57:47.927797 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8_GWxex0ZUVYH5AUwqNFvMTwV-RDHQQa6UioMlloiADYZc9Xsn-tantAIEWapb_KnFlljIVP0PNcdgm7Y70oHqf5vONn4JgEL_2Gps-sPoaPhdyrEerfeFUJyxRdRx6ARNbSV0KUn9OxZsZEMBrf3mVzOQ0kGNlw_GtCaUprLWY7OOs Aug 10 17:57:47.927797 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 17:57:47.927797 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 17:57:47.927797 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 17:57:47.927797 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 17:57:47.927797 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 17:57:47.927797 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 17:57:47.927797 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: bda0e92befa442c9ba6d121bf5f53750 Aug 10 17:57:47.927797 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-ServerGroupTestJSON-752066672 Aug 10 17:57:47.927797 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 17:57:47.927797 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 17:57:47.927797 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/bda0e92befa442c9ba6d121bf5f53750"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/bda0e92befa442c9ba6d121bf5f53750"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/bda0e92befa442c9ba6d121bf5f53750"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_bda0e92befa442c9ba6d121bf5f53750", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:57:47.927797 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-ServerGroupTestJSON-752066672 Aug 10 17:57:47.927797 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: bda0e92befa442c9ba6d121bf5f53750 Aug 10 17:57:47.927797 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-ServerGroupTestJSON-752066672 Aug 10 17:57:47.927797 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-ServerGroupTestJSON-752066672-project Aug 10 17:57:47.927797 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 17:57:47.927797 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 17:57:47.927797 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: 395859304e1742acb870d232bc4820a3 Aug 10 17:57:47.927797 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-ServerGroupTestJSON-752066672-project Aug 10 17:57:47.927797 n-d-852296-2 devstack@n-api.service[129409]: method: > Aug 10 17:57:47.927797 n-d-852296-2 devstack@n-api.service[129409]: exception: Instance group aed0e570-9f8f-4cc8-b4e7-d84260f5d444 could not be found. Aug 10 17:57:47.927797 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'id': 'aed0e570-9f8f-4cc8-b4e7-d84260f5d444'} Aug 10 17:57:47.927797 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:57:47.927797 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:57:47.927797 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 10 17:57:47.927797 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 10 17:57:47.927797 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 17:57:47.927797 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 17:57:47.927797 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 10 17:57:47.927797 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 10 17:57:47.927797 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 10 17:57:47.927797 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 10 17:57:47.927797 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 10 17:57:47.927797 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 10 17:57:47.927797 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group aed0e570-9f8f-4cc8-b4e7-d84260f5d444 could not be found. Aug 10 17:57:47.927797 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:57:47.927797 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:57:47.927797 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:57:47.927797 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:57:47.927797 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:57:47.927797 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:57:47.927797 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:57:47.927797 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:57:47.927797 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:57:47.927797 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:57:47.927797 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 10 17:57:47.927797 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:57:47.927797 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group aed0e570-9f8f-4cc8-b4e7-d84260f5d444 could not be found. Aug 10 17:57:47.927797 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:57:47.927797 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:57:47.927797 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:57:47.927797 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:57:47.940673 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:57:47.940673 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:57:47.940673 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:57:47.940673 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:57:47.940673 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group aed0e570-9f8f-4cc8-b4e7-d84260f5d444 could not be found. Aug 10 17:57:47.940673 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:57:47.940673 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-ab19f0ac-1d3b-4361-90a8-a901c44c89fe tempest-ServerGroupTestJSON-752066672 tempest-ServerGroupTestJSON-752066672-project] Returning 404 to user: Instance group aed0e570-9f8f-4cc8-b4e7-d84260f5d444 could not be found. {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:57:47.940673 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-ab19f0ac-1d3b-4361-90a8-a901c44c89fe tempest-ServerGroupTestJSON-752066672 tempest-ServerGroupTestJSON-752066672-project] 10.222.0.50 "DELETE /compute/v2.1/os-server-groups/aed0e570-9f8f-4cc8-b4e7-d84260f5d444" status: 404 len: 117 microversion: 2.1 time: 0.050464 Aug 10 17:57:47.940673 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 854/1674] 10.222.0.50 () {58 vars in 1266 bytes} [Wed Aug 10 17:57:47 2022] DELETE /compute/v2.1/os-server-groups/aed0e570-9f8f-4cc8-b4e7-d84260f5d444 => generated 117 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:57:47.941275 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-61e2b9e2-1682-4e18-b66b-8dfa2ebf789a tempest-ServerGroupTestJSON-752066672 tempest-ServerGroupTestJSON-752066672-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:57:48.225474 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-61e2b9e2-1682-4e18-b66b-8dfa2ebf789a tempest-ServerGroupTestJSON-752066672 tempest-ServerGroupTestJSON-752066672-project] 10.222.0.50 "DELETE /compute/v2.1/os-server-groups/0a4c3326-8dfb-44dd-be0f-2e4c0afbe03f" status: 204 len: 0 microversion: 2.1 time: 0.288980 Aug 10 17:57:48.232128 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 821/1675] 10.222.0.50 () {58 vars in 1266 bytes} [Wed Aug 10 17:57:47 2022] DELETE /compute/v2.1/os-server-groups/0a4c3326-8dfb-44dd-be0f-2e4c0afbe03f => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 17:57:48.875670 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-9fb3ea87-99c8-4e7b-9e9e-827ca73c2a7c tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '.version_select at 0x7fb345ebe940>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:57:48.944393 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-9fb3ea87-99c8-4e7b-9e9e-827ca73c2a7c tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/images/98768699-188a-47cb-94b1-0e22f2c1e614" status: 200 len: 1454 microversion: 2.1 time: 0.080857 Aug 10 17:57:48.953717 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 855/1676] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:57:48 2022] GET /compute/v2.1/images/98768699-188a-47cb-94b1-0e22f2c1e614 => generated 1454 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:57:49.961891 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-41a6f355-4c54-4fff-97b1-b2eab6156fa3 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '.version_select at 0x7fb345bfb430>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:57:50.042206 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-41a6f355-4c54-4fff-97b1-b2eab6156fa3 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/images/98768699-188a-47cb-94b1-0e22f2c1e614" status: 200 len: 1454 microversion: 2.1 time: 0.084918 Aug 10 17:57:50.050513 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 822/1677] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:57:49 2022] GET /compute/v2.1/images/98768699-188a-47cb-94b1-0e22f2c1e614 => generated 1454 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:57:51.065499 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-641f2230-363c-4cfc-a81c-135f6073c5f1 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '.version_select at 0x7fb346015280>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:57:51.188453 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-641f2230-363c-4cfc-a81c-135f6073c5f1 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/images/98768699-188a-47cb-94b1-0e22f2c1e614" status: 200 len: 1454 microversion: 2.1 time: 0.132329 Aug 10 17:57:51.190389 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 856/1678] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:57:51 2022] GET /compute/v2.1/images/98768699-188a-47cb-94b1-0e22f2c1e614 => generated 1454 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:57:52.204668 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-e3880f68-51c0-4684-a6cc-a9a758ed8768 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '.version_select at 0x7fb345b61550>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:57:52.324741 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-e3880f68-51c0-4684-a6cc-a9a758ed8768 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/images/98768699-188a-47cb-94b1-0e22f2c1e614" status: 200 len: 1454 microversion: 2.1 time: 0.125032 Aug 10 17:57:52.325579 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 823/1679] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:57:52 2022] GET /compute/v2.1/images/98768699-188a-47cb-94b1-0e22f2c1e614 => generated 1454 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:57:53.341190 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-9fdc36c0-49d4-49d6-96ac-bc3e0aa21ba8 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '.version_select at 0x7fb345e25af0>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:57:53.427715 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-9fdc36c0-49d4-49d6-96ac-bc3e0aa21ba8 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/images/98768699-188a-47cb-94b1-0e22f2c1e614" status: 200 len: 1454 microversion: 2.1 time: 0.091140 Aug 10 17:57:53.429888 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 857/1680] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:57:53 2022] GET /compute/v2.1/images/98768699-188a-47cb-94b1-0e22f2c1e614 => generated 1454 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:57:54.444196 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-031e4a1d-fe08-418e-b17e-b7cbee8260b3 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '.version_select at 0x7fb345c3c9d0>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:57:54.549565 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-031e4a1d-fe08-418e-b17e-b7cbee8260b3 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/images/98768699-188a-47cb-94b1-0e22f2c1e614" status: 200 len: 1454 microversion: 2.1 time: 0.109596 Aug 10 17:57:54.557026 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 824/1681] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:57:54 2022] GET /compute/v2.1/images/98768699-188a-47cb-94b1-0e22f2c1e614 => generated 1454 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:57:55.565609 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-c2f8a1ba-02b3-4aa5-9be6-6d17b48a2427 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '.version_select at 0x7fb345ebe4c0>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:57:55.628612 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-c2f8a1ba-02b3-4aa5-9be6-6d17b48a2427 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/images/98768699-188a-47cb-94b1-0e22f2c1e614" status: 200 len: 1454 microversion: 2.1 time: 0.067527 Aug 10 17:57:55.629922 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 858/1682] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:57:55 2022] GET /compute/v2.1/images/98768699-188a-47cb-94b1-0e22f2c1e614 => generated 1454 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:57:56.640977 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_cell0:SELECT=24 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:57:56.645301 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-2ca0c4c8-93a5-4f1f-b30d-f7376786ecaa tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '.version_select at 0x7fb3459d6700>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:57:56.772897 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-2ca0c4c8-93a5-4f1f-b30d-f7376786ecaa tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/images/98768699-188a-47cb-94b1-0e22f2c1e614" status: 200 len: 1454 microversion: 2.1 time: 0.133469 Aug 10 17:57:56.774029 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 825/1683] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:57:56 2022] GET /compute/v2.1/images/98768699-188a-47cb-94b1-0e22f2c1e614 => generated 1454 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:57:57.787288 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_cell0:SELECT=16 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:57:57.791354 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-22d1aab2-fd47-454e-a0b8-4116e778961c tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '.version_select at 0x7fb345d9b550>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:57:57.903687 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_api:SELECT=77,nova_api:DELETE=10,nova_api:INSERT=4 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:57:57.913255 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-22d1aab2-fd47-454e-a0b8-4116e778961c tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/images/98768699-188a-47cb-94b1-0e22f2c1e614" status: 200 len: 1454 microversion: 2.1 time: 0.126573 Aug 10 17:57:57.913852 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 859/1684] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:57:57 2022] GET /compute/v2.1/images/98768699-188a-47cb-94b1-0e22f2c1e614 => generated 1454 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:57:58.929563 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-81c809e3-f840-4b2a-bd5f-624f08abfa4b tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '.version_select at 0x7fb345bde430>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:57:59.025974 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-81c809e3-f840-4b2a-bd5f-624f08abfa4b tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/images/98768699-188a-47cb-94b1-0e22f2c1e614" status: 200 len: 1463 microversion: 2.1 time: 0.100559 Aug 10 17:57:59.026832 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 826/1685] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:57:58 2022] GET /compute/v2.1/images/98768699-188a-47cb-94b1-0e22f2c1e614 => generated 1463 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:57:59.045699 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-2b1ec296-b8da-43b9-9566-75ff1a3ae3c3 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '.version_select at 0x7fb345d5a160>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:57:59.130077 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-2b1ec296-b8da-43b9-9566-75ff1a3ae3c3 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/images/98768699-188a-47cb-94b1-0e22f2c1e614" status: 200 len: 1463 microversion: 2.1 time: 0.092932 Aug 10 17:57:59.132018 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 860/1686] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:57:59 2022] GET /compute/v2.1/images/98768699-188a-47cb-94b1-0e22f2c1e614 => generated 1463 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:57:59.145348 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-db88e4b3-707c-43be-b320-b7df97c69b0b tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:57:59.146346 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-db88e4b3-707c-43be-b320-b7df97c69b0b tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] [instance: 8937f92d-1764-4316-86cc-939bc9dc34b4] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:57:59.153452 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-db88e4b3-707c-43be-b320-b7df97c69b0b tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:57:59.154274 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-db88e4b3-707c-43be-b320-b7df97c69b0b tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:57:59.155892 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-db88e4b3-707c-43be-b320-b7df97c69b0b tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:57:59.156833 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-db88e4b3-707c-43be-b320-b7df97c69b0b tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:57:59.157495 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-db88e4b3-707c-43be-b320-b7df97c69b0b tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:57:59.158168 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-db88e4b3-707c-43be-b320-b7df97c69b0b tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:57:59.565385 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-db88e4b3-707c-43be-b320-b7df97c69b0b tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce45e1a545b4d3b8fa2cb4b2af3f306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0285f1570fe2419c930c80d3a0711858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:57:59.579412 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-db88e4b3-707c-43be-b320-b7df97c69b0b tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/servers/8937f92d-1764-4316-86cc-939bc9dc34b4" status: 200 len: 1467 microversion: 2.1 time: 0.438784 Aug 10 17:57:59.580014 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 827/1687] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:57:59 2022] GET /compute/v2.1/servers/8937f92d-1764-4316-86cc-939bc9dc34b4 => generated 1467 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:57:59.601414 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-17a79e72-7c08-48db-a6d1-177928e4661c tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '.version_select at 0x7fb345d9b280>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:57:59.728817 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-17a79e72-7c08-48db-a6d1-177928e4661c tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/images?changes-since=2022-08-10T17%3A55%3A30Z" status: 200 len: 1901 microversion: 2.1 time: 0.131793 Aug 10 17:57:59.729629 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 861/1688] 10.222.0.50 () {58 vars in 1199 bytes} [Wed Aug 10 17:57:59 2022] GET /compute/v2.1/images?changes-since=2022-08-10T17%3A55%3A30Z => generated 1901 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:57:59.759545 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-2822f3d6-a361-4296-8863-af3befcbd6b0 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '.version_select at 0x7fb345c3cc10>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:57:59.889644 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-2822f3d6-a361-4296-8863-af3befcbd6b0 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1366172039" status: 200 len: 485 microversion: 2.1 time: 0.140991 Aug 10 17:57:59.900973 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 828/1689] 10.222.0.50 () {58 vars in 1231 bytes} [Wed Aug 10 17:57:59 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1366172039 => generated 485 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:57:59.910010 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-cbe65b09-5ebe-4b6c-8c36-da58f76ffb73 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '.version_select at 0x7fb345e25a60>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:58:00.069947 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-cbe65b09-5ebe-4b6c-8c36-da58f76ffb73 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/images?server=8937f92d-1764-4316-86cc-939bc9dc34b4" status: 200 len: 957 microversion: 2.1 time: 0.165752 Aug 10 17:58:00.070583 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 862/1690] 10.222.0.50 () {58 vars in 1209 bytes} [Wed Aug 10 17:57:59 2022] GET /compute/v2.1/images?server=8937f92d-1764-4316-86cc-939bc9dc34b4 => generated 957 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:58:00.085620 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-3b4031a7-88e2-4f90-8cc7-d08ba200fcf3 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '.version_select at 0x7fb345bd3e50>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:58:00.159418 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-3b4031a7-88e2-4f90-8cc7-d08ba200fcf3 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.50%2Fcompute%2Fv2.1%2Fservers%2Fdd4d671c-5a1f-463d-8bec-cd4f7614479f" status: 200 len: 484 microversion: 2.1 time: 0.078995 Aug 10 17:58:00.174152 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-b1b76264-f633-4ad2-81ae-9a266cabceb6 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '.version_select at 0x7fb345f1baf0>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:58:00.180236 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 829/1691] 10.222.0.50 () {58 vars in 1317 bytes} [Wed Aug 10 17:58:00 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.50%2Fcompute%2Fv2.1%2Fservers%2Fdd4d671c-5a1f-463d-8bec-cd4f7614479f => generated 484 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:58:00.285401 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-b1b76264-f633-4ad2-81ae-9a266cabceb6 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.50%2Fcompute%2Fservers%2Fdd4d671c-5a1f-463d-8bec-cd4f7614479f" status: 200 len: 484 microversion: 2.1 time: 0.114974 Aug 10 17:58:00.287558 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 863/1692] 10.222.0.50 () {58 vars in 1303 bytes} [Wed Aug 10 17:58:00 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.50%2Fcompute%2Fservers%2Fdd4d671c-5a1f-463d-8bec-cd4f7614479f => generated 484 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:58:00.302389 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-58e76281-f0fb-4fe3-b6b1-3003dc5da665 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '.version_select at 0x7fb3459d6ee0>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:58:00.440399 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-58e76281-f0fb-4fe3-b6b1-3003dc5da665 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3280 microversion: 2.1 time: 0.143229 Aug 10 17:58:00.454640 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 830/1693] 10.222.0.50 () {58 vars in 1149 bytes} [Wed Aug 10 17:58:00 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3280 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:58:00.479569 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-33d44e0f-18de-405f-a435-ea83245cf46a tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '.version_select at 0x7fb345e25160>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:58:00.625527 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-33d44e0f-18de-405f-a435-ea83245cf46a tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1429 microversion: 2.1 time: 0.159639 Aug 10 17:58:00.628569 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 864/1694] 10.222.0.50 () {58 vars in 1149 bytes} [Wed Aug 10 17:58:00 2022] GET /compute/v2.1/images?type=snapshot => generated 1429 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:58:00.643721 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-fce10137-1d1c-450b-840c-02691e368b02 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '.version_select at 0x7fb345a3edc0>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:58:00.746487 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-fce10137-1d1c-450b-840c-02691e368b02 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/images?limit=1" status: 200 len: 621 microversion: 2.1 time: 0.107624 Aug 10 17:58:00.757137 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 831/1695] 10.222.0.50 () {58 vars in 1137 bytes} [Wed Aug 10 17:58:00 2022] GET /compute/v2.1/images?limit=1 => generated 621 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:58:00.762440 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-2ce5e2d2-54a8-4dbd-8acb-1eb921814806 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '.version_select at 0x7fb345ebe040>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:58:00.955580 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-2ce5e2d2-54a8-4dbd-8acb-1eb921814806 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/images/detail?changes-since=2022-08-10T17%3A55%3A23Z" status: 200 len: 6333 microversion: 2.1 time: 0.199235 Aug 10 17:58:00.960611 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 865/1696] 10.222.0.50 () {58 vars in 1220 bytes} [Wed Aug 10 17:58:00 2022] GET /compute/v2.1/images/detail?changes-since=2022-08-10T17%3A55%3A23Z => generated 6333 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:58:00.980869 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-461a8a17-1c05-4c46-b4c1-03150c44066f tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '.version_select at 0x7fb345c3cdc0>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:58:01.091676 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-461a8a17-1c05-4c46-b4c1-03150c44066f tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1366172039" status: 200 len: 665 microversion: 2.1 time: 0.118263 Aug 10 17:58:01.098289 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 832/1697] 10.222.0.50 () {58 vars in 1252 bytes} [Wed Aug 10 17:58:00 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1366172039 => generated 665 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:58:01.124674 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-0e4ebd25-dea6-49f3-b990-9d30e7fb49b3 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '.version_select at 0x7fb345eba700>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:58:01.221806 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-0e4ebd25-dea6-49f3-b990-9d30e7fb49b3 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.50%2Fcompute%2Fv2.1%2Fservers%2Fdd4d671c-5a1f-463d-8bec-cd4f7614479f" status: 200 len: 1466 microversion: 2.1 time: 0.105349 Aug 10 17:58:01.252211 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-4a534977-e1ea-43d3-92f4-a5e2b6e3c57e tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '.version_select at 0x7fb345bd3790>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:58:01.264079 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 866/1698] 10.222.0.50 () {58 vars in 1338 bytes} [Wed Aug 10 17:58:01 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.50%2Fcompute%2Fv2.1%2Fservers%2Fdd4d671c-5a1f-463d-8bec-cd4f7614479f => generated 1466 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:58:01.380508 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-4a534977-e1ea-43d3-92f4-a5e2b6e3c57e tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.50%2Fcompute%2Fservers%2Fdd4d671c-5a1f-463d-8bec-cd4f7614479f" status: 200 len: 1466 microversion: 2.1 time: 0.140359 Aug 10 17:58:01.400066 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-a6b30814-a78b-46e0-b1d3-4d9a8a1bf8d1 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '.version_select at 0x7fb345d9b040>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:58:01.405397 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 833/1699] 10.222.0.50 () {58 vars in 1324 bytes} [Wed Aug 10 17:58:01 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.50%2Fcompute%2Fservers%2Fdd4d671c-5a1f-463d-8bec-cd4f7614479f => generated 1466 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:58:01.613030 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-a6b30814-a78b-46e0-b1d3-4d9a8a1bf8d1 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7108 microversion: 2.1 time: 0.219407 Aug 10 17:58:01.614022 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 867/1700] 10.222.0.50 () {58 vars in 1170 bytes} [Wed Aug 10 17:58:01 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7108 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:58:01.639270 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-07895021-97e0-46cc-97a2-8c8e798a6ce4 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '.version_select at 0x7fb345bde5e0>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:58:01.757967 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-07895021-97e0-46cc-97a2-8c8e798a6ce4 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4375 microversion: 2.1 time: 0.124423 Aug 10 17:58:01.759003 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 834/1701] 10.222.0.50 () {58 vars in 1170 bytes} [Wed Aug 10 17:58:01 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4375 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:58:01.777469 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-fadec6ea-6232-4918-be3e-55a1171f1899 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '.version_select at 0x7fb345ebeaf0>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:58:01.852649 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-fadec6ea-6232-4918-be3e-55a1171f1899 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/images/a735ff26-463a-4ffe-a981-ab9d9baa494f" status: 200 len: 784 microversion: 2.1 time: 0.079561 Aug 10 17:58:01.853756 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 868/1702] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 10 17:58:01 2022] GET /compute/v2.1/images/a735ff26-463a-4ffe-a981-ab9d9baa494f => generated 784 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:58:01.877875 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-875a2228-a60f-48da-9ea1-b4dfecaef349 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '.version_select at 0x7fb345c3c430>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:58:01.994720 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-875a2228-a60f-48da-9ea1-b4dfecaef349 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1610 microversion: 2.1 time: 0.129063 Aug 10 17:58:01.996020 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 835/1703] 10.222.0.50 () {58 vars in 1158 bytes} [Wed Aug 10 17:58:01 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1610 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:58:02.011946 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-1d607e71-2cc8-4ac1-aca3-931e0133d8f1 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '.version_select at 0x7fb345e25c10>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:58:03.255669 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-a2f8f42f-b154-4f04-9409-62211849cd10 tempest-FloatingIPsAssociationTestJSON-2100788628 tempest-FloatingIPsAssociationTestJSON-2100788628-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1837484227", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "eca54895-e1af-43e7-a567-9b3a5a798bf2"}]}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:58:03.327443 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.network.neutron [None req-a2f8f42f-b154-4f04-9409-62211849cd10 tempest-FloatingIPsAssociationTestJSON-2100788628 tempest-FloatingIPsAssociationTestJSON-2100788628-project] validate_networks() for [('eca54895-e1af-43e7-a567-9b3a5a798bf2', None, None, None, None, None)] {{(pid=129410) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 17:58:04.610843 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [None req-a2f8f42f-b154-4f04-9409-62211849cd10 tempest-FloatingIPsAssociationTestJSON-2100788628 tempest-FloatingIPsAssociationTestJSON-2100788628-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-07b9c23a-102b-4346-b63c-a5da9b7848d1) Aug 10 17:58:04.610843 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:58:04.610843 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:58:04.610843 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:58:04.610843 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:58:04.610843 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:58:04.610843 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:58:04.610843 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:58:04.610843 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:58:04.610843 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:58:04.610843 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 17:58:04.610843 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 17:58:04.610843 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 17:58:04.610843 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 17:58:04.610843 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 17:58:04.610843 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 17:58:04.610843 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 17:58:04.610843 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 17:58:04.610843 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 17:58:04.610843 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 17:58:04.610843 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 17:58:04.610843 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 17:58:04.610843 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 17:58:04.610843 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 17:58:04.610843 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 17:58:04.610843 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 17:58:04.610843 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 17:58:04.610843 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:58:04.610843 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:58:04.610843 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 17:58:04.610843 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 17:58:04.610843 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:58:04.610843 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:58:04.610843 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:58:04.610843 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:58:04.610843 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:58:04.610843 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:58:04.610843 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:58:04.610843 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:58:04.610843 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:58:04.610843 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:58:04.610843 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 17:58:04.610843 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 17:58:04.610843 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 17:58:04.610843 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 17:58:04.610843 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 17:58:04.610843 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 17:58:04.610843 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 17:58:04.610843 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 17:58:04.610843 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 17:58:04.610843 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 17:58:04.610843 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 17:58:04.615195 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 17:58:04.615195 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 17:58:04.615195 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 17:58:04.615195 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 17:58:04.615195 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 17:58:04.615195 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 17:58:04.615195 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 17:58:04.615195 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 17:58:04.615195 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 17:58:04.615195 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 17:58:04.615195 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 17:58:04.615195 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 17:58:04.615195 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 17:58:04.615195 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 17:58:04.615195 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 17:58:04.615195 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-07b9c23a-102b-4346-b63c-a5da9b7848d1) Aug 10 17:58:04.615195 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:58:04.615195 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-a2f8f42f-b154-4f04-9409-62211849cd10 tempest-FloatingIPsAssociationTestJSON-2100788628 tempest-FloatingIPsAssociationTestJSON-2100788628-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:58:04.615195 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 17:58:04.617155 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-a2f8f42f-b154-4f04-9409-62211849cd10 tempest-FloatingIPsAssociationTestJSON-2100788628 tempest-FloatingIPsAssociationTestJSON-2100788628-project] Request method failure captured: Aug 10 17:58:04.617155 n-d-852296-2 devstack@n-api.service[129410]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 17:58:04.617155 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 17:58:04.617155 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 17:58:04.617155 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 17:58:04.617155 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 216 Aug 10 17:58:04.617155 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 17:58:04.617155 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 17:58:04.617155 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 17:58:04.617155 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 17:58:04.617155 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8_GqfOqpTh6DQcf9Hw4IoOuvq3gDQnd4qqFBcAdlLv4yra83ZdrQN7wkw2RKzncJOHYC_ti22xaoZYU0BNya__9_PWscO6Jx6JAQpBVdbjx4P8Yu88CxFFPsyDPg_4sWxFbQJMDbZmsbW6FJSlu3vaUiEEK0ZIeI4OyWdRegZiW_T5w Aug 10 17:58:04.617155 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 17:58:04.617155 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 17:58:04.617155 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 17:58:04.617155 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 17:58:04.617155 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 17:58:04.617155 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 17:58:04.617155 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: de5c0d70a7be4a8c9bfe6411d2177cd0 Aug 10 17:58:04.617155 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-2100788628 Aug 10 17:58:04.617155 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 17:58:04.617155 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 17:58:04.617155 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/de5c0d70a7be4a8c9bfe6411d2177cd0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/de5c0d70a7be4a8c9bfe6411d2177cd0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/de5c0d70a7be4a8c9bfe6411d2177cd0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_de5c0d70a7be4a8c9bfe6411d2177cd0", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:58:04.617155 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-2100788628 Aug 10 17:58:04.617155 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: de5c0d70a7be4a8c9bfe6411d2177cd0 Aug 10 17:58:04.617155 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-2100788628 Aug 10 17:58:04.617155 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-FloatingIPsAssociationTestJSON-2100788628-project Aug 10 17:58:04.617155 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 17:58:04.617155 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 17:58:04.617155 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: 557215355da04926a02a0897fe715169 Aug 10 17:58:04.617155 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-2100788628-project Aug 10 17:58:04.617155 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 17:58:04.617155 n-d-852296-2 devstack@n-api.service[129410]: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1837484227", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "eca54895-e1af-43e7-a567-9b3a5a798bf2"}]}} Aug 10 17:58:04.617155 n-d-852296-2 devstack@n-api.service[129410]: method: > Aug 10 17:58:04.617155 n-d-852296-2 devstack@n-api.service[129410]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:58:04.617155 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 17:58:04.617155 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'body': {'server': {'name': 'tempest-FloatingIPsAssociationTestJSON-server-1837484227', 'imageRef': 'a735ff26-463a-4ffe-a981-ab9d9baa494f', 'flavorRef': '452', 'networks': [{'uuid': 'eca54895-e1af-43e7-a567-9b3a5a798bf2'}]}}} Aug 10 17:58:04.617155 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:58:04.617155 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:58:04.617155 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:58:04.617155 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:58:04.617155 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:58:04.617155 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:58:04.617155 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:58:04.617155 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:58:04.617155 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:58:04.617155 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:58:04.617155 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 17:58:04.617155 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 17:58:04.617155 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 17:58:04.617155 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 17:58:04.617155 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 17:58:04.617155 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 17:58:04.617155 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 17:58:04.617155 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 17:58:04.617155 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 17:58:04.617155 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 17:58:04.617155 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 17:58:04.617155 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 17:58:04.617155 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 17:58:04.617155 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 17:58:04.617155 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 17:58:04.635645 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 17:58:04.635645 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 17:58:04.635645 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:58:04.635645 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:58:04.635645 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 17:58:04.635645 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 17:58:04.635645 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:58:04.635645 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:58:04.635645 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:58:04.635645 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:58:04.635645 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:58:04.635645 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:58:04.635645 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:58:04.635645 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:58:04.635645 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:58:04.635645 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:58:04.635645 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 17:58:04.635645 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 17:58:04.635645 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 17:58:04.635645 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 17:58:04.635645 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 17:58:04.635645 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 17:58:04.635645 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 17:58:04.635645 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 17:58:04.635645 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 17:58:04.635645 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 17:58:04.635645 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 17:58:04.635645 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 17:58:04.635645 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 17:58:04.635645 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 17:58:04.635645 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 17:58:04.635645 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 17:58:04.635645 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 17:58:04.635645 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 17:58:04.635645 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 17:58:04.635645 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 17:58:04.635645 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 17:58:04.635645 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 17:58:04.635645 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 17:58:04.635645 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 17:58:04.635645 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 17:58:04.635645 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 17:58:04.635645 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-07b9c23a-102b-4346-b63c-a5da9b7848d1) Aug 10 17:58:04.635645 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:58:04.635645 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:58:04.635645 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:58:04.635645 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:58:04.635645 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:58:04.635645 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:58:04.635645 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:58:04.635645 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:58:04.635645 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 10 17:58:04.635645 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 10 17:58:04.640808 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:58:04.640808 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:58:04.640808 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:58:04.640808 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:58:04.640808 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:58:04.640808 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:58:04.640808 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:58:04.640808 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:58:04.640808 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:58:04.640808 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:58:04.640808 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:58:04.640808 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:58:04.640808 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:58:04.640808 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-a2f8f42f-b154-4f04-9409-62211849cd10 tempest-FloatingIPsAssociationTestJSON-2100788628 tempest-FloatingIPsAssociationTestJSON-2100788628-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:58:04.640808 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:58:04.640808 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-a2f8f42f-b154-4f04-9409-62211849cd10 tempest-FloatingIPsAssociationTestJSON-2100788628 tempest-FloatingIPsAssociationTestJSON-2100788628-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 2.022884 Aug 10 17:58:04.640808 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 836/1704] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 17:58:02 2022] POST /compute/v2.1/servers => generated 214 bytes in 2025 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 10 17:58:04.648159 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [req-49996c04-230f-497d-92c5-26cd8fb606f9 req-741cd089-cfee-437d-a001-87d75367d419 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8937f92d-1764-4316-86cc-939bc9dc34b4", "name": "network-vif-unplugged", "status": "completed", "tag": "c4ddeb24-17b7-43ce-b1c2-3516523d5956"}]} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:58:04.687223 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-49996c04-230f-497d-92c5-26cd8fb606f9 req-741cd089-cfee-437d-a001-87d75367d419 service nova] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:58:04.695148 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-49996c04-230f-497d-92c5-26cd8fb606f9 req-741cd089-cfee-437d-a001-87d75367d419 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:58:04.695608 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-49996c04-230f-497d-92c5-26cd8fb606f9 req-741cd089-cfee-437d-a001-87d75367d419 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:58:04.728071 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.compute.server_external_events [req-49996c04-230f-497d-92c5-26cd8fb606f9 req-741cd089-cfee-437d-a001-87d75367d419 service nova] Creating event network-vif-unplugged:c4ddeb24-17b7-43ce-b1c2-3516523d5956 for instance 8937f92d-1764-4316-86cc-939bc9dc34b4 on n-h2-852296-2 Aug 10 17:58:04.748089 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [req-49996c04-230f-497d-92c5-26cd8fb606f9 req-741cd089-cfee-437d-a001-87d75367d419 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.125831 Aug 10 17:58:04.749994 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 837/1705] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 10 17:58:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:58:04.792238 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-1d607e71-2cc8-4ac1-aca3-931e0133d8f1 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "DELETE /compute/v2.1/images/98768699-188a-47cb-94b1-0e22f2c1e614" status: 204 len: 0 microversion: 2.1 time: 2.784904 Aug 10 17:58:04.798342 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 869/1706] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:58:02 2022] DELETE /compute/v2.1/images/98768699-188a-47cb-94b1-0e22f2c1e614 => generated 0 bytes in 2786 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 17:58:04.804417 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-786e4219-d685-4a03-81ec-0befc0b543b8 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '.version_select at 0x7fb345bf8430>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:58:08.186486 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-786e4219-d685-4a03-81ec-0befc0b543b8 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "DELETE /compute/v2.1/images/23574b56-3268-4f53-afb9-8d4a9946cf3c" status: 204 len: 0 microversion: 2.1 time: 3.383812 Aug 10 17:58:08.191737 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 838/1707] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:58:04 2022] DELETE /compute/v2.1/images/23574b56-3268-4f53-afb9-8d4a9946cf3c => generated 0 bytes in 3391 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 17:58:08.197028 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-900e1835-d01e-4733-a5d1-a39f53f14485 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '.version_select at 0x7fb345e25160>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:58:11.241615 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-900e1835-d01e-4733-a5d1-a39f53f14485 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "DELETE /compute/v2.1/images/8dfbef1d-2e17-4e08-b909-b8e888a31709" status: 204 len: 0 microversion: 2.1 time: 3.044803 Aug 10 17:58:11.245677 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 870/1708] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:58:08 2022] DELETE /compute/v2.1/images/8dfbef1d-2e17-4e08-b909-b8e888a31709 => generated 0 bytes in 3050 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 17:58:11.252279 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-bf01ffc0-148a-4e5c-890d-f37a213f1394 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:58:11.253122 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-bf01ffc0-148a-4e5c-890d-f37a213f1394 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] [instance: dd4d671c-5a1f-463d-8bec-cd4f7614479f] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:58:11.269293 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-bf01ffc0-148a-4e5c-890d-f37a213f1394 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:58:11.270246 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-bf01ffc0-148a-4e5c-890d-f37a213f1394 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:58:11.270918 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-bf01ffc0-148a-4e5c-890d-f37a213f1394 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:58:11.273211 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-bf01ffc0-148a-4e5c-890d-f37a213f1394 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:58:11.273922 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-bf01ffc0-148a-4e5c-890d-f37a213f1394 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:58:11.275978 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-bf01ffc0-148a-4e5c-890d-f37a213f1394 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:58:11.325941 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-bf01ffc0-148a-4e5c-890d-f37a213f1394 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] [instance: dd4d671c-5a1f-463d-8bec-cd4f7614479f] Going to try to terminate instance {{(pid=129410) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 17:58:11.833101 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-bf01ffc0-148a-4e5c-890d-f37a213f1394 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "DELETE /compute/v2.1/servers/dd4d671c-5a1f-463d-8bec-cd4f7614479f" status: 204 len: 0 microversion: 2.1 time: 0.586054 Aug 10 17:58:11.833711 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 839/1709] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 10 17:58:11 2022] DELETE /compute/v2.1/servers/dd4d671c-5a1f-463d-8bec-cd4f7614479f => generated 0 bytes in 588 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 10 17:58:11.844517 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-c18d861a-b844-464c-843d-5de87f7f9edb tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:58:11.845498 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-c18d861a-b844-464c-843d-5de87f7f9edb tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] [instance: dd4d671c-5a1f-463d-8bec-cd4f7614479f] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:58:11.858519 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c18d861a-b844-464c-843d-5de87f7f9edb tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:58:11.863519 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c18d861a-b844-464c-843d-5de87f7f9edb tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:58:11.864148 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c18d861a-b844-464c-843d-5de87f7f9edb tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:58:11.865738 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c18d861a-b844-464c-843d-5de87f7f9edb tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:58:11.868041 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c18d861a-b844-464c-843d-5de87f7f9edb tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:58:11.868780 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c18d861a-b844-464c-843d-5de87f7f9edb tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:58:12.687696 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-c18d861a-b844-464c-843d-5de87f7f9edb tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce45e1a545b4d3b8fa2cb4b2af3f306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0285f1570fe2419c930c80d3a0711858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:58:12.705674 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-c18d861a-b844-464c-843d-5de87f7f9edb tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/servers/dd4d671c-5a1f-463d-8bec-cd4f7614479f" status: 200 len: 1473 microversion: 2.1 time: 0.867375 Aug 10 17:58:12.706383 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 871/1710] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:58:11 2022] GET /compute/v2.1/servers/dd4d671c-5a1f-463d-8bec-cd4f7614479f => generated 1473 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:58:13.728924 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-cad52d93-0071-47d5-a920-a37ccb3a346b tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:58:13.730229 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-cad52d93-0071-47d5-a920-a37ccb3a346b tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] [instance: dd4d671c-5a1f-463d-8bec-cd4f7614479f] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:58:13.760946 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-cad52d93-0071-47d5-a920-a37ccb3a346b tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:58:13.761468 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-cad52d93-0071-47d5-a920-a37ccb3a346b tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:58:13.767250 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-cad52d93-0071-47d5-a920-a37ccb3a346b tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:58:13.768810 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-cad52d93-0071-47d5-a920-a37ccb3a346b tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:58:13.771464 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-cad52d93-0071-47d5-a920-a37ccb3a346b tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:58:13.772158 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-cad52d93-0071-47d5-a920-a37ccb3a346b tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:58:14.189248 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-cad52d93-0071-47d5-a920-a37ccb3a346b tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce45e1a545b4d3b8fa2cb4b2af3f306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0285f1570fe2419c930c80d3a0711858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:58:14.202122 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-cad52d93-0071-47d5-a920-a37ccb3a346b tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/servers/dd4d671c-5a1f-463d-8bec-cd4f7614479f" status: 200 len: 1473 microversion: 2.1 time: 0.478382 Aug 10 17:58:14.204967 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 840/1711] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:58:13 2022] GET /compute/v2.1/servers/dd4d671c-5a1f-463d-8bec-cd4f7614479f => generated 1473 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:58:15.229159 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-e7ff2512-6dfb-4b0f-8e6c-d61d1b9f4699 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:58:15.229159 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-e7ff2512-6dfb-4b0f-8e6c-d61d1b9f4699 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] [instance: dd4d671c-5a1f-463d-8bec-cd4f7614479f] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:58:15.239158 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e7ff2512-6dfb-4b0f-8e6c-d61d1b9f4699 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:58:15.239657 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e7ff2512-6dfb-4b0f-8e6c-d61d1b9f4699 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:58:15.240086 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e7ff2512-6dfb-4b0f-8e6c-d61d1b9f4699 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:58:15.243943 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e7ff2512-6dfb-4b0f-8e6c-d61d1b9f4699 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:58:15.252348 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e7ff2512-6dfb-4b0f-8e6c-d61d1b9f4699 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:58:15.262829 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e7ff2512-6dfb-4b0f-8e6c-d61d1b9f4699 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:58:15.808710 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-d8a9a030-1288-42ae-8ad9-f70f62b13738 tempest-DeleteServersTestJSON-1516492854 tempest-DeleteServersTestJSON-1516492854-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1474958784", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "2c1593a8-a60b-4d6d-88ed-d9f31cee07cd"}]}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:58:15.946290 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.network.neutron [None req-d8a9a030-1288-42ae-8ad9-f70f62b13738 tempest-DeleteServersTestJSON-1516492854 tempest-DeleteServersTestJSON-1516492854-project] validate_networks() for [('2c1593a8-a60b-4d6d-88ed-d9f31cee07cd', None, None, None, None, None)] {{(pid=129410) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 17:58:16.032839 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-e7ff2512-6dfb-4b0f-8e6c-d61d1b9f4699 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce45e1a545b4d3b8fa2cb4b2af3f306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0285f1570fe2419c930c80d3a0711858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:58:16.045742 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-e7ff2512-6dfb-4b0f-8e6c-d61d1b9f4699 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/servers/dd4d671c-5a1f-463d-8bec-cd4f7614479f" status: 200 len: 1473 microversion: 2.1 time: 0.823792 Aug 10 17:58:16.048936 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 872/1712] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:58:15 2022] GET /compute/v2.1/servers/dd4d671c-5a1f-463d-8bec-cd4f7614479f => generated 1473 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:58:17.054467 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-180fe322-05ea-4beb-91a7-1eea9bb0bd36 tempest-ServerTagsTestJSON-796325299 tempest-ServerTagsTestJSON-796325299-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-1123566083", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "be8fe8cf-dc0f-4cdd-b72c-f0ce715c12ac"}]}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:58:17.179821 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.network.neutron [None req-180fe322-05ea-4beb-91a7-1eea9bb0bd36 tempest-ServerTagsTestJSON-796325299 tempest-ServerTagsTestJSON-796325299-project] validate_networks() for [('be8fe8cf-dc0f-4cdd-b72c-f0ce715c12ac', None, None, None, None, None)] {{(pid=129409) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 17:58:17.652635 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [None req-180fe322-05ea-4beb-91a7-1eea9bb0bd36 tempest-ServerTagsTestJSON-796325299 tempest-ServerTagsTestJSON-796325299-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-ac4d3a76-23a6-48e0-901d-65144c50362d) Aug 10 17:58:17.652635 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:58:17.652635 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:58:17.652635 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:58:17.652635 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:58:17.652635 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:58:17.652635 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:58:17.652635 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:58:17.652635 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:58:17.652635 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:58:17.652635 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 17:58:17.652635 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 17:58:17.652635 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 17:58:17.652635 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 17:58:17.652635 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 17:58:17.652635 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 17:58:17.652635 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 17:58:17.652635 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 17:58:17.652635 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 17:58:17.652635 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 17:58:17.652635 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 17:58:17.652635 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 17:58:17.652635 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 17:58:17.652635 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 17:58:17.652635 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 17:58:17.652635 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 17:58:17.652635 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 17:58:17.652635 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:58:17.652635 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:58:17.652635 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 17:58:17.652635 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 17:58:17.652635 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:58:17.652635 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:58:17.652635 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:58:17.652635 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:58:17.652635 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:58:17.652635 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:58:17.652635 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:58:17.652635 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:58:17.652635 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:58:17.652635 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:58:17.652635 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 17:58:17.652635 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 17:58:17.652635 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 17:58:17.652635 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 17:58:17.652635 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 17:58:17.652635 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 17:58:17.652635 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 17:58:17.652635 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 17:58:17.652635 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 17:58:17.652635 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 17:58:17.652635 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 17:58:17.652635 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 17:58:17.656233 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 17:58:17.656233 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 17:58:17.656233 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 17:58:17.656233 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 17:58:17.656233 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 17:58:17.656233 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 17:58:17.656233 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 17:58:17.656233 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 17:58:17.656233 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 17:58:17.656233 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 17:58:17.656233 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 17:58:17.656233 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 17:58:17.656233 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 17:58:17.656233 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 17:58:17.656233 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-ac4d3a76-23a6-48e0-901d-65144c50362d) Aug 10 17:58:17.656233 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:58:17.656233 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-180fe322-05ea-4beb-91a7-1eea9bb0bd36 tempest-ServerTagsTestJSON-796325299 tempest-ServerTagsTestJSON-796325299-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:58:17.656233 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:58:17.657274 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-180fe322-05ea-4beb-91a7-1eea9bb0bd36 tempest-ServerTagsTestJSON-796325299 tempest-ServerTagsTestJSON-796325299-project] Request method failure captured: Aug 10 17:58:17.657274 n-d-852296-2 devstack@n-api.service[129409]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 17:58:17.657274 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 17:58:17.657274 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 17:58:17.657274 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 17:58:17.657274 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 204 Aug 10 17:58:17.657274 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 17:58:17.657274 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 17:58:17.657274 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 17:58:17.657274 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 17:58:17.657274 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8_G4Cb8e6WqGlsPgFiA5jI1IN98GO7cXiZcNUIh_9N0QVo3Vbbl2ISNuiyZSBFq-2nUjSg902PcIfzAOdHKlKBdB4DJoESXSg46md_TYXGjOP_Zw3Hz6OXGtc7AYJug7YJkZQbNE6YQV-kb0BRV8I3-iuanLJmWFRf36NjcouEbiCXI Aug 10 17:58:17.657274 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 17:58:17.657274 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 17:58:17.657274 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 17:58:17.657274 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 17:58:17.657274 n-d-852296-2 devstack@n-api.service[129409]: X-Openstack-Nova-Api-Version: 2.26 Aug 10 17:58:17.657274 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 17:58:17.657274 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 17:58:17.657274 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: af141fe255e84b19b6e239d98942037f Aug 10 17:58:17.657274 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-ServerTagsTestJSON-796325299 Aug 10 17:58:17.657274 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 17:58:17.657274 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 17:58:17.657274 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/af141fe255e84b19b6e239d98942037f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/af141fe255e84b19b6e239d98942037f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/af141fe255e84b19b6e239d98942037f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_af141fe255e84b19b6e239d98942037f", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:58:17.657274 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-ServerTagsTestJSON-796325299 Aug 10 17:58:17.657274 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: af141fe255e84b19b6e239d98942037f Aug 10 17:58:17.657274 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-ServerTagsTestJSON-796325299 Aug 10 17:58:17.657274 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-ServerTagsTestJSON-796325299-project Aug 10 17:58:17.657274 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 17:58:17.657274 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 17:58:17.657274 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: e262bab22ad147bb8158ff150b252285 Aug 10 17:58:17.657274 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-ServerTagsTestJSON-796325299-project Aug 10 17:58:17.657274 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:58:17.657274 n-d-852296-2 devstack@n-api.service[129409]: {"server": {"name": "tempest-ServerTagsTestJSON-server-1123566083", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "be8fe8cf-dc0f-4cdd-b72c-f0ce715c12ac"}]}} Aug 10 17:58:17.657274 n-d-852296-2 devstack@n-api.service[129409]: method: > Aug 10 17:58:17.657274 n-d-852296-2 devstack@n-api.service[129409]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:58:17.657274 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:58:17.657274 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'body': {'server': {'name': 'tempest-ServerTagsTestJSON-server-1123566083', 'imageRef': 'a735ff26-463a-4ffe-a981-ab9d9baa494f', 'flavorRef': '452', 'networks': [{'uuid': 'be8fe8cf-dc0f-4cdd-b72c-f0ce715c12ac'}]}}} Aug 10 17:58:17.657274 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:58:17.657274 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:58:17.657274 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:58:17.657274 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:58:17.657274 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:58:17.657274 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:58:17.657274 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:58:17.657274 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:58:17.657274 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:58:17.657274 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:58:17.657274 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 17:58:17.657274 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 17:58:17.657274 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 17:58:17.657274 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 17:58:17.657274 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 17:58:17.657274 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 17:58:17.657274 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 17:58:17.657274 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 17:58:17.657274 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 17:58:17.657274 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 17:58:17.657274 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 17:58:17.657274 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 17:58:17.657274 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 17:58:17.657274 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 17:58:17.657274 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 17:58:17.662003 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 17:58:17.662003 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 17:58:17.662003 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:58:17.662003 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:58:17.662003 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 17:58:17.662003 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 17:58:17.662003 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:58:17.662003 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:58:17.662003 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:58:17.662003 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:58:17.662003 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:58:17.662003 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:58:17.662003 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:58:17.662003 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:58:17.662003 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:58:17.662003 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:58:17.662003 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 17:58:17.662003 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 17:58:17.662003 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 17:58:17.662003 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 17:58:17.662003 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 17:58:17.662003 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 17:58:17.662003 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 17:58:17.662003 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 17:58:17.662003 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 17:58:17.662003 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 17:58:17.662003 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 17:58:17.662003 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 17:58:17.662003 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 17:58:17.662003 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 17:58:17.662003 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 17:58:17.662003 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 17:58:17.662003 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 17:58:17.662003 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 17:58:17.662003 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 17:58:17.662003 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 17:58:17.662003 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 17:58:17.662003 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 17:58:17.662003 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 17:58:17.662003 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 17:58:17.662003 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 17:58:17.662003 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 17:58:17.662003 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-ac4d3a76-23a6-48e0-901d-65144c50362d) Aug 10 17:58:17.662003 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:58:17.662003 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:58:17.662003 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:58:17.662003 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:58:17.662003 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:58:17.662003 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:58:17.662003 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:58:17.662003 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:58:17.662003 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 10 17:58:17.662003 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 10 17:58:17.671655 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:58:17.671655 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:58:17.671655 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:58:17.671655 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:58:17.671655 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:58:17.671655 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:58:17.671655 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:58:17.671655 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:58:17.671655 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:58:17.671655 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:58:17.671655 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:58:17.671655 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:58:17.671655 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:58:17.671655 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-180fe322-05ea-4beb-91a7-1eea9bb0bd36 tempest-ServerTagsTestJSON-796325299 tempest-ServerTagsTestJSON-796325299-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:58:17.671655 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:58:17.671655 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-180fe322-05ea-4beb-91a7-1eea9bb0bd36 tempest-ServerTagsTestJSON-796325299 tempest-ServerTagsTestJSON-796325299-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.26 time: 0.906232 Aug 10 17:58:17.671655 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 873/1713] 10.222.0.50 () {62 vars in 1188 bytes} [Wed Aug 10 17:58:16 2022] POST /compute/v2.1/servers => generated 214 bytes in 908 msecs (HTTP/1.1 500) 9 headers in 393 bytes (1 switches on core 0) Aug 10 17:58:17.687546 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [req-087187c9-c800-4dec-bcad-6b1d8f3f620d req-8096941a-2c7c-4079-852e-e92a40b29225 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd4d671c-5a1f-463d-8bec-cd4f7614479f", "name": "network-vif-deleted", "tag": "04dec7b8-0911-42c4-b8b2-bdf1fecdec04"}]} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:58:17.698745 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [None req-d8a9a030-1288-42ae-8ad9-f70f62b13738 tempest-DeleteServersTestJSON-1516492854 tempest-DeleteServersTestJSON-1516492854-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-e991a04a-4aa5-4ab0-a593-5c54d05d65ac) Aug 10 17:58:17.698745 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:58:17.698745 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:58:17.698745 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:58:17.698745 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:58:17.698745 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:58:17.698745 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:58:17.698745 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:58:17.698745 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:58:17.698745 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:58:17.698745 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 17:58:17.698745 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 17:58:17.698745 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 17:58:17.698745 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 17:58:17.698745 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 17:58:17.698745 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 17:58:17.698745 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 17:58:17.698745 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 17:58:17.698745 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 17:58:17.698745 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 17:58:17.698745 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 17:58:17.698745 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 17:58:17.698745 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 17:58:17.698745 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 17:58:17.698745 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 17:58:17.698745 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 17:58:17.698745 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 17:58:17.698745 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:58:17.698745 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:58:17.698745 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 17:58:17.698745 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 17:58:17.698745 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:58:17.698745 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:58:17.698745 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:58:17.698745 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:58:17.698745 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:58:17.698745 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:58:17.698745 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:58:17.698745 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:58:17.698745 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:58:17.698745 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:58:17.698745 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 17:58:17.698745 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 17:58:17.698745 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 17:58:17.698745 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 17:58:17.698745 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 17:58:17.698745 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 17:58:17.698745 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 17:58:17.698745 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 17:58:17.698745 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 17:58:17.698745 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 17:58:17.698745 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 17:58:17.698745 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 17:58:17.702991 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 17:58:17.702991 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 17:58:17.702991 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 17:58:17.702991 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 17:58:17.702991 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 17:58:17.702991 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 17:58:17.702991 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 17:58:17.702991 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 17:58:17.702991 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 17:58:17.702991 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 17:58:17.702991 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 17:58:17.702991 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 17:58:17.702991 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 17:58:17.702991 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 17:58:17.702991 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-e991a04a-4aa5-4ab0-a593-5c54d05d65ac) Aug 10 17:58:17.702991 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:58:17.702991 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-d8a9a030-1288-42ae-8ad9-f70f62b13738 tempest-DeleteServersTestJSON-1516492854 tempest-DeleteServersTestJSON-1516492854-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:58:17.702991 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 17:58:17.702991 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-d8a9a030-1288-42ae-8ad9-f70f62b13738 tempest-DeleteServersTestJSON-1516492854 tempest-DeleteServersTestJSON-1516492854-project] Request method failure captured: Aug 10 17:58:17.702991 n-d-852296-2 devstack@n-api.service[129410]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 17:58:17.702991 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 17:58:17.702991 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 17:58:17.702991 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 17:58:17.702991 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 207 Aug 10 17:58:17.702991 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 17:58:17.702991 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 17:58:17.702991 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 17:58:17.702991 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 17:58:17.702991 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8_G3aY3tDzIjHFP3FMPgi06ViF1z3c5GeWwBdJNRA-dnRGOCID253_N0atoxCBPKnyzmhvURj-CDAZfA0RzvILr0FTLqJnh-tJMC4Y6E5VzPXsvtMjz2j15kAWbqhk6TKQ4lkBbfmwHJniyiWC1ct5gD_cDnwPB5PltqFlZDjSm4M68 Aug 10 17:58:17.702991 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 17:58:17.702991 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 17:58:17.702991 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 17:58:17.702991 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 17:58:17.702991 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 17:58:17.702991 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 17:58:17.702991 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: e33fb30880dd4ff494c3eb1038db2e24 Aug 10 17:58:17.702991 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-DeleteServersTestJSON-1516492854 Aug 10 17:58:17.702991 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 17:58:17.702991 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 17:58:17.702991 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e33fb30880dd4ff494c3eb1038db2e24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/e33fb30880dd4ff494c3eb1038db2e24"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e33fb30880dd4ff494c3eb1038db2e24"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_e33fb30880dd4ff494c3eb1038db2e24", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:58:17.702991 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-DeleteServersTestJSON-1516492854 Aug 10 17:58:17.702991 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: e33fb30880dd4ff494c3eb1038db2e24 Aug 10 17:58:17.702991 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-DeleteServersTestJSON-1516492854 Aug 10 17:58:17.702991 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-DeleteServersTestJSON-1516492854-project Aug 10 17:58:17.702991 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 17:58:17.702991 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 17:58:17.702991 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: ec603eba5a764d489ad50622af3cd529 Aug 10 17:58:17.702991 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-DeleteServersTestJSON-1516492854-project Aug 10 17:58:17.702991 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 17:58:17.702991 n-d-852296-2 devstack@n-api.service[129410]: {"server": {"name": "tempest-DeleteServersTestJSON-server-1474958784", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "2c1593a8-a60b-4d6d-88ed-d9f31cee07cd"}]}} Aug 10 17:58:17.702991 n-d-852296-2 devstack@n-api.service[129410]: method: > Aug 10 17:58:17.702991 n-d-852296-2 devstack@n-api.service[129410]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:58:17.702991 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 17:58:17.702991 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'body': {'server': {'name': 'tempest-DeleteServersTestJSON-server-1474958784', 'imageRef': 'a735ff26-463a-4ffe-a981-ab9d9baa494f', 'flavorRef': '452', 'networks': [{'uuid': '2c1593a8-a60b-4d6d-88ed-d9f31cee07cd'}]}}} Aug 10 17:58:17.702991 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:58:17.708958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:58:17.708958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:58:17.708958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:58:17.708958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:58:17.708958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:58:17.708958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:58:17.708958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:58:17.708958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:58:17.708958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:58:17.708958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 17:58:17.708958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 17:58:17.708958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 17:58:17.708958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 17:58:17.708958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 17:58:17.708958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 17:58:17.708958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 17:58:17.708958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 17:58:17.708958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 17:58:17.708958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 17:58:17.708958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 17:58:17.708958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 17:58:17.708958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 17:58:17.708958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 17:58:17.708958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 17:58:17.708958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 17:58:17.708958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 17:58:17.708958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:58:17.708958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:58:17.708958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 17:58:17.708958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 17:58:17.708958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:58:17.708958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:58:17.708958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:58:17.708958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:58:17.708958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:58:17.708958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:58:17.708958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:58:17.708958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:58:17.708958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:58:17.708958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:58:17.708958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 17:58:17.708958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 17:58:17.708958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 17:58:17.708958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 17:58:17.708958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 17:58:17.708958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 17:58:17.708958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 17:58:17.708958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 17:58:17.708958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 17:58:17.708958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 17:58:17.708958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 17:58:17.708958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 17:58:17.708958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 17:58:17.708958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 17:58:17.708958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 17:58:17.708958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 17:58:17.722358 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 17:58:17.722358 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 17:58:17.722358 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 17:58:17.722358 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 17:58:17.722358 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 17:58:17.722358 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 17:58:17.722358 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 17:58:17.722358 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 17:58:17.722358 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 17:58:17.722358 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 17:58:17.722358 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-e991a04a-4aa5-4ab0-a593-5c54d05d65ac) Aug 10 17:58:17.722358 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:58:17.722358 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:58:17.722358 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:58:17.722358 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:58:17.722358 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:58:17.722358 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:58:17.722358 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:58:17.722358 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:58:17.722358 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 10 17:58:17.722358 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 10 17:58:17.722358 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:58:17.722358 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:58:17.722358 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:58:17.722358 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:58:17.722358 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:58:17.722358 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:58:17.722358 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:58:17.722358 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:58:17.722358 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:58:17.722358 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:58:17.722358 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:58:17.722358 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:58:17.722358 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:58:17.722358 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-d8a9a030-1288-42ae-8ad9-f70f62b13738 tempest-DeleteServersTestJSON-1516492854 tempest-DeleteServersTestJSON-1516492854-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:58:17.722358 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:58:17.722358 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-d8a9a030-1288-42ae-8ad9-f70f62b13738 tempest-DeleteServersTestJSON-1516492854 tempest-DeleteServersTestJSON-1516492854-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 2.202746 Aug 10 17:58:17.722358 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 841/1714] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 17:58:15 2022] POST /compute/v2.1/servers => generated 214 bytes in 2207 msecs (HTTP/1.1 500) 9 headers in 391 bytes (2 switches on core 0) Aug 10 17:58:17.735854 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-087187c9-c800-4dec-bcad-6b1d8f3f620d req-8096941a-2c7c-4079-852e-e92a40b29225 service nova] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:58:17.737922 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-cdbb932d-6cfd-45c4-960a-03eeb09d2e00 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:58:17.738096 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-087187c9-c800-4dec-bcad-6b1d8f3f620d req-8096941a-2c7c-4079-852e-e92a40b29225 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:58:17.738695 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-087187c9-c800-4dec-bcad-6b1d8f3f620d req-8096941a-2c7c-4079-852e-e92a40b29225 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:58:17.740765 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-cdbb932d-6cfd-45c4-960a-03eeb09d2e00 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] [instance: dd4d671c-5a1f-463d-8bec-cd4f7614479f] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:58:17.765219 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.compute.server_external_events [req-087187c9-c800-4dec-bcad-6b1d8f3f620d req-8096941a-2c7c-4079-852e-e92a40b29225 service nova] Creating event network-vif-deleted:04dec7b8-0911-42c4-b8b2-bdf1fecdec04 for instance dd4d671c-5a1f-463d-8bec-cd4f7614479f on n-h2-852296-2 Aug 10 17:58:17.784007 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [req-087187c9-c800-4dec-bcad-6b1d8f3f620d req-8096941a-2c7c-4079-852e-e92a40b29225 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110233 Aug 10 17:58:17.788760 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-cdbb932d-6cfd-45c4-960a-03eeb09d2e00 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:58:17.789299 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-cdbb932d-6cfd-45c4-960a-03eeb09d2e00 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:58:17.789511 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 874/1715] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 10 17:58:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:58:17.791944 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-cdbb932d-6cfd-45c4-960a-03eeb09d2e00 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:58:17.792750 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-cdbb932d-6cfd-45c4-960a-03eeb09d2e00 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:58:17.793226 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-cdbb932d-6cfd-45c4-960a-03eeb09d2e00 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:58:17.793694 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-cdbb932d-6cfd-45c4-960a-03eeb09d2e00 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:58:17.895717 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-cdbb932d-6cfd-45c4-960a-03eeb09d2e00 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:58:17.896215 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-cdbb932d-6cfd-45c4-960a-03eeb09d2e00 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:58:17.896681 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-cdbb932d-6cfd-45c4-960a-03eeb09d2e00 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:58:17.897142 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.objects.instance [None req-cdbb932d-6cfd-45c4-960a-03eeb09d2e00 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lazy-loading 'fault' on Instance uuid dd4d671c-5a1f-463d-8bec-cd4f7614479f {{(pid=129410) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:58:17.952931 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-0147d182-702b-498f-bb5d-698809802dc2 tempest-DeleteServersTestJSON-1516492854 tempest-DeleteServersTestJSON-1516492854-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1358482294", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "2c1593a8-a60b-4d6d-88ed-d9f31cee07cd"}]}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:58:18.053230 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.network.neutron [None req-0147d182-702b-498f-bb5d-698809802dc2 tempest-DeleteServersTestJSON-1516492854 tempest-DeleteServersTestJSON-1516492854-project] validate_networks() for [('2c1593a8-a60b-4d6d-88ed-d9f31cee07cd', None, None, None, None, None)] {{(pid=129409) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 17:58:18.139555 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-cdbb932d-6cfd-45c4-960a-03eeb09d2e00 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce45e1a545b4d3b8fa2cb4b2af3f306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0285f1570fe2419c930c80d3a0711858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:58:18.149842 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-cdbb932d-6cfd-45c4-960a-03eeb09d2e00 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/servers/dd4d671c-5a1f-463d-8bec-cd4f7614479f" status: 200 len: 1308 microversion: 2.1 time: 0.438932 Aug 10 17:58:18.164875 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 842/1716] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:58:17 2022] GET /compute/v2.1/servers/dd4d671c-5a1f-463d-8bec-cd4f7614479f => generated 1308 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:58:19.175587 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-6886f787-550c-487e-8659-be0372a159bb tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:58:19.176228 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-6886f787-550c-487e-8659-be0372a159bb tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] [instance: dd4d671c-5a1f-463d-8bec-cd4f7614479f] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:58:19.189362 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-6886f787-550c-487e-8659-be0372a159bb tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:58:19.189890 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-6886f787-550c-487e-8659-be0372a159bb tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:58:19.190402 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-6886f787-550c-487e-8659-be0372a159bb tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:58:19.191192 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-6886f787-550c-487e-8659-be0372a159bb tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:58:19.192898 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-6886f787-550c-487e-8659-be0372a159bb tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:58:19.198167 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-6886f787-550c-487e-8659-be0372a159bb tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:58:19.218171 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-6886f787-550c-487e-8659-be0372a159bb tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] HTTP exception thrown: Instance dd4d671c-5a1f-463d-8bec-cd4f7614479f could not be found. Aug 10 17:58:19.220862 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-6886f787-550c-487e-8659-be0372a159bb tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Request method failure captured: Aug 10 17:58:19.220862 n-d-852296-2 devstack@n-api.service[129410]: request: GET /compute/v2.1/servers/dd4d671c-5a1f-463d-8bec-cd4f7614479f HTTP/1.1 Aug 10 17:58:19.220862 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 17:58:19.220862 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 17:58:19.220862 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 17:58:19.220862 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 0 Aug 10 17:58:19.220862 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 17:58:19.220862 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 17:58:19.220862 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 17:58:19.220862 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 17:58:19.220862 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8_EK-tiFwvBLcISUs5SXRTHSTdvHxBTuXdzdDY_BxPBhJr2KVJC2vzEymot7KzffEXQy3fs1qAhAOGvbQQ-pzc1eE5ucXZG9y3q4ZpaA39g7T4xG3j_FBrkSo_gFdgFhpq3VRXU74fRQyH8yzAkH5WdhQneXDZcXp2iC53XBMhMyhOk Aug 10 17:58:19.220862 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 17:58:19.220862 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 17:58:19.220862 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 17:58:19.220862 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 17:58:19.220862 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 17:58:19.220862 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 17:58:19.220862 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: 0285f1570fe2419c930c80d3a0711858 Aug 10 17:58:19.220862 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-ListImageFiltersTestJSON-1950276764 Aug 10 17:58:19.220862 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 17:58:19.220862 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 17:58:19.220862 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0285f1570fe2419c930c80d3a0711858"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/0285f1570fe2419c930c80d3a0711858"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0285f1570fe2419c930c80d3a0711858"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_0285f1570fe2419c930c80d3a0711858", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:58:19.220862 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-ListImageFiltersTestJSON-1950276764 Aug 10 17:58:19.220862 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: 0285f1570fe2419c930c80d3a0711858 Aug 10 17:58:19.220862 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1950276764 Aug 10 17:58:19.220862 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-ListImageFiltersTestJSON-1950276764-project Aug 10 17:58:19.220862 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 17:58:19.220862 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 17:58:19.220862 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: dce45e1a545b4d3b8fa2cb4b2af3f306 Aug 10 17:58:19.220862 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-ListImageFiltersTestJSON-1950276764-project Aug 10 17:58:19.220862 n-d-852296-2 devstack@n-api.service[129410]: method: > Aug 10 17:58:19.220862 n-d-852296-2 devstack@n-api.service[129410]: exception: Instance dd4d671c-5a1f-463d-8bec-cd4f7614479f could not be found. Aug 10 17:58:19.220862 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'id': 'dd4d671c-5a1f-463d-8bec-cd4f7614479f'} Aug 10 17:58:19.220862 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:58:19.220862 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:58:19.220862 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 17:58:19.220862 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 17:58:19.220862 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 17:58:19.220862 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 17:58:19.220862 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 17:58:19.220862 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 17:58:19.220862 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 17:58:19.220862 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 17:58:19.220862 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd4d671c-5a1f-463d-8bec-cd4f7614479f could not be found. Aug 10 17:58:19.220862 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:58:19.220862 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:58:19.220862 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:58:19.220862 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:58:19.220862 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:58:19.220862 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:58:19.220862 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:58:19.220862 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:58:19.220862 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:58:19.220862 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:58:19.220862 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 17:58:19.220862 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 17:58:19.220862 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 17:58:19.220862 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 17:58:19.220862 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 17:58:19.220862 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:58:19.220862 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd4d671c-5a1f-463d-8bec-cd4f7614479f could not be found. Aug 10 17:58:19.220862 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:58:19.220862 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:58:19.220862 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:58:19.247042 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:58:19.247042 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:58:19.247042 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:58:19.247042 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:58:19.247042 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:58:19.247042 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd4d671c-5a1f-463d-8bec-cd4f7614479f could not be found. Aug 10 17:58:19.247042 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:58:19.247042 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-6886f787-550c-487e-8659-be0372a159bb tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Returning 404 to user: Instance dd4d671c-5a1f-463d-8bec-cd4f7614479f could not be found. {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:58:19.247042 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-6886f787-550c-487e-8659-be0372a159bb tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/servers/dd4d671c-5a1f-463d-8bec-cd4f7614479f" status: 404 len: 111 microversion: 2.1 time: 0.051144 Aug 10 17:58:19.247042 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 843/1717] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:58:19 2022] GET /compute/v2.1/servers/dd4d671c-5a1f-463d-8bec-cd4f7614479f => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:58:19.247042 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-35ecc59d-1047-4e9e-8839-75159b98c7ad tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:58:19.247042 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-35ecc59d-1047-4e9e-8839-75159b98c7ad tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] [instance: 8937f92d-1764-4316-86cc-939bc9dc34b4] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:58:19.256579 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-35ecc59d-1047-4e9e-8839-75159b98c7ad tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:58:19.257854 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-35ecc59d-1047-4e9e-8839-75159b98c7ad tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:58:19.258649 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-35ecc59d-1047-4e9e-8839-75159b98c7ad tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:58:19.260222 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-35ecc59d-1047-4e9e-8839-75159b98c7ad tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:58:19.260733 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-35ecc59d-1047-4e9e-8839-75159b98c7ad tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:58:19.261321 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-35ecc59d-1047-4e9e-8839-75159b98c7ad tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:58:19.299958 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-35ecc59d-1047-4e9e-8839-75159b98c7ad tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] [instance: 8937f92d-1764-4316-86cc-939bc9dc34b4] Going to try to terminate instance {{(pid=129410) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 17:58:19.588105 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [None req-0147d182-702b-498f-bb5d-698809802dc2 tempest-DeleteServersTestJSON-1516492854 tempest-DeleteServersTestJSON-1516492854-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-8661927b-97e3-4949-bf06-95cb9cf41fa4) Aug 10 17:58:19.588105 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:58:19.588105 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:58:19.588105 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:58:19.588105 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:58:19.588105 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:58:19.588105 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:58:19.588105 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:58:19.588105 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:58:19.588105 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:58:19.588105 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 17:58:19.588105 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 17:58:19.588105 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 17:58:19.588105 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 17:58:19.588105 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 17:58:19.588105 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 17:58:19.588105 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 17:58:19.588105 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 17:58:19.588105 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 17:58:19.588105 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 17:58:19.588105 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 17:58:19.588105 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 17:58:19.588105 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 17:58:19.588105 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 17:58:19.588105 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 17:58:19.588105 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 17:58:19.588105 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 17:58:19.588105 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:58:19.588105 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:58:19.588105 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 17:58:19.588105 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 17:58:19.588105 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:58:19.588105 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:58:19.588105 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:58:19.588105 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:58:19.588105 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:58:19.588105 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:58:19.588105 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:58:19.588105 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:58:19.588105 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:58:19.588105 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:58:19.588105 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 17:58:19.588105 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 17:58:19.588105 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 17:58:19.588105 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 17:58:19.588105 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 17:58:19.588105 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 17:58:19.588105 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 17:58:19.588105 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 17:58:19.588105 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 17:58:19.588105 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 17:58:19.588105 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 17:58:19.588105 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 17:58:19.594057 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 17:58:19.594057 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 17:58:19.594057 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 17:58:19.594057 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 17:58:19.594057 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 17:58:19.594057 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 17:58:19.594057 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 17:58:19.594057 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 17:58:19.594057 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 17:58:19.594057 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 17:58:19.594057 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 17:58:19.594057 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 17:58:19.594057 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 17:58:19.594057 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 17:58:19.594057 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-8661927b-97e3-4949-bf06-95cb9cf41fa4) Aug 10 17:58:19.594057 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:58:19.594057 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-0147d182-702b-498f-bb5d-698809802dc2 tempest-DeleteServersTestJSON-1516492854 tempest-DeleteServersTestJSON-1516492854-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:58:19.594057 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:58:19.594057 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-0147d182-702b-498f-bb5d-698809802dc2 tempest-DeleteServersTestJSON-1516492854 tempest-DeleteServersTestJSON-1516492854-project] Request method failure captured: Aug 10 17:58:19.594057 n-d-852296-2 devstack@n-api.service[129409]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 17:58:19.594057 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 17:58:19.594057 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 17:58:19.594057 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 17:58:19.594057 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 207 Aug 10 17:58:19.594057 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 17:58:19.594057 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 17:58:19.594057 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 17:58:19.594057 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 17:58:19.594057 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8_G3aY3tDzIjHFP3FMPgi06ViF1z3c5GeWwBdJNRA-dnRGOCID253_N0atoxCBPKnyzmhvURj-CDAZfA0RzvILr0FTLqJnh-tJMC4Y6E5VzPXsvtMjz2j15kAWbqhk6TKQ4lkBbfmwHJniyiWC1ct5gD_cDnwPB5PltqFlZDjSm4M68 Aug 10 17:58:19.594057 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 17:58:19.594057 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 17:58:19.594057 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 17:58:19.594057 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 17:58:19.594057 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 17:58:19.594057 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 17:58:19.594057 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: e33fb30880dd4ff494c3eb1038db2e24 Aug 10 17:58:19.594057 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-DeleteServersTestJSON-1516492854 Aug 10 17:58:19.594057 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 17:58:19.594057 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 17:58:19.594057 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e33fb30880dd4ff494c3eb1038db2e24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/e33fb30880dd4ff494c3eb1038db2e24"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e33fb30880dd4ff494c3eb1038db2e24"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_e33fb30880dd4ff494c3eb1038db2e24", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:58:19.594057 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-DeleteServersTestJSON-1516492854 Aug 10 17:58:19.594057 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: e33fb30880dd4ff494c3eb1038db2e24 Aug 10 17:58:19.594057 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-DeleteServersTestJSON-1516492854 Aug 10 17:58:19.594057 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-DeleteServersTestJSON-1516492854-project Aug 10 17:58:19.594057 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 17:58:19.594057 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 17:58:19.594057 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: ec603eba5a764d489ad50622af3cd529 Aug 10 17:58:19.594057 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-DeleteServersTestJSON-1516492854-project Aug 10 17:58:19.594057 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:58:19.594057 n-d-852296-2 devstack@n-api.service[129409]: {"server": {"name": "tempest-DeleteServersTestJSON-server-1358482294", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "2c1593a8-a60b-4d6d-88ed-d9f31cee07cd"}]}} Aug 10 17:58:19.594057 n-d-852296-2 devstack@n-api.service[129409]: method: > Aug 10 17:58:19.594057 n-d-852296-2 devstack@n-api.service[129409]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:58:19.594057 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:58:19.594057 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'body': {'server': {'name': 'tempest-DeleteServersTestJSON-server-1358482294', 'imageRef': 'a735ff26-463a-4ffe-a981-ab9d9baa494f', 'flavorRef': '452', 'networks': [{'uuid': '2c1593a8-a60b-4d6d-88ed-d9f31cee07cd'}]}}} Aug 10 17:58:19.594057 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:58:19.599837 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:58:19.599837 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:58:19.599837 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:58:19.599837 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:58:19.599837 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:58:19.599837 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:58:19.599837 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:58:19.599837 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:58:19.599837 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:58:19.599837 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 17:58:19.599837 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 17:58:19.599837 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 17:58:19.599837 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 17:58:19.599837 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 17:58:19.599837 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 17:58:19.599837 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 17:58:19.599837 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 17:58:19.599837 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 17:58:19.599837 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 17:58:19.599837 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 17:58:19.599837 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 17:58:19.599837 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 17:58:19.599837 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 17:58:19.599837 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 17:58:19.599837 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 17:58:19.599837 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 17:58:19.599837 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:58:19.599837 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:58:19.599837 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 17:58:19.599837 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 17:58:19.599837 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:58:19.599837 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:58:19.599837 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:58:19.599837 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:58:19.599837 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:58:19.599837 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:58:19.599837 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:58:19.599837 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:58:19.599837 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:58:19.599837 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:58:19.599837 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 17:58:19.599837 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 17:58:19.599837 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 17:58:19.599837 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 17:58:19.599837 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 17:58:19.599837 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 17:58:19.599837 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 17:58:19.599837 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 17:58:19.599837 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 17:58:19.599837 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 17:58:19.599837 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 17:58:19.599837 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 17:58:19.599837 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 17:58:19.599837 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 17:58:19.599837 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 17:58:19.599837 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 17:58:19.611548 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 17:58:19.611548 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 17:58:19.611548 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 17:58:19.611548 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 17:58:19.611548 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 17:58:19.611548 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 17:58:19.611548 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 17:58:19.611548 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 17:58:19.611548 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 17:58:19.611548 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 17:58:19.611548 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-8661927b-97e3-4949-bf06-95cb9cf41fa4) Aug 10 17:58:19.611548 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:58:19.611548 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:58:19.611548 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:58:19.611548 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:58:19.611548 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:58:19.611548 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:58:19.611548 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:58:19.611548 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:58:19.611548 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 10 17:58:19.611548 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 10 17:58:19.611548 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:58:19.611548 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:58:19.611548 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:58:19.611548 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:58:19.611548 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:58:19.611548 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:58:19.611548 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:58:19.611548 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:58:19.611548 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:58:19.611548 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:58:19.611548 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:58:19.611548 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:58:19.611548 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:58:19.611548 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-0147d182-702b-498f-bb5d-698809802dc2 tempest-DeleteServersTestJSON-1516492854 tempest-DeleteServersTestJSON-1516492854-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:58:19.611548 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:58:19.611548 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-0147d182-702b-498f-bb5d-698809802dc2 tempest-DeleteServersTestJSON-1516492854 tempest-DeleteServersTestJSON-1516492854-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.646374 Aug 10 17:58:19.611548 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 875/1718] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 17:58:17 2022] POST /compute/v2.1/servers => generated 214 bytes in 1648 msecs (HTTP/1.1 500) 9 headers in 391 bytes (2 switches on core 0) Aug 10 17:58:19.864940 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-287bd5b5-1323-4028-b620-5b2d36ff6878 tempest-DeleteServersTestJSON-1516492854 tempest-DeleteServersTestJSON-1516492854-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1228353963", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "2c1593a8-a60b-4d6d-88ed-d9f31cee07cd"}]}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:58:19.957051 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.network.neutron [None req-287bd5b5-1323-4028-b620-5b2d36ff6878 tempest-DeleteServersTestJSON-1516492854 tempest-DeleteServersTestJSON-1516492854-project] validate_networks() for [('2c1593a8-a60b-4d6d-88ed-d9f31cee07cd', None, None, None, None, None)] {{(pid=129409) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 17:58:20.301574 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-35ecc59d-1047-4e9e-8839-75159b98c7ad tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "DELETE /compute/v2.1/servers/8937f92d-1764-4316-86cc-939bc9dc34b4" status: 204 len: 0 microversion: 2.1 time: 1.073694 Aug 10 17:58:20.304994 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 844/1719] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 10 17:58:19 2022] DELETE /compute/v2.1/servers/8937f92d-1764-4316-86cc-939bc9dc34b4 => generated 0 bytes in 1077 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 17:58:20.315776 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-976ffc18-44d1-4c5d-ad56-2f1d6a1b17cc tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:58:20.316805 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-976ffc18-44d1-4c5d-ad56-2f1d6a1b17cc tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] [instance: 8937f92d-1764-4316-86cc-939bc9dc34b4] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:58:20.325294 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-976ffc18-44d1-4c5d-ad56-2f1d6a1b17cc tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:58:20.326620 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-976ffc18-44d1-4c5d-ad56-2f1d6a1b17cc tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:58:20.327036 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-976ffc18-44d1-4c5d-ad56-2f1d6a1b17cc tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:58:20.327825 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-976ffc18-44d1-4c5d-ad56-2f1d6a1b17cc tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:58:20.328336 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-976ffc18-44d1-4c5d-ad56-2f1d6a1b17cc tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:58:20.328825 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-976ffc18-44d1-4c5d-ad56-2f1d6a1b17cc tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:58:20.335419 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:58:20.518224 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-976ffc18-44d1-4c5d-ad56-2f1d6a1b17cc tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce45e1a545b4d3b8fa2cb4b2af3f306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0285f1570fe2419c930c80d3a0711858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:58:20.526406 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-976ffc18-44d1-4c5d-ad56-2f1d6a1b17cc tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/servers/8937f92d-1764-4316-86cc-939bc9dc34b4" status: 200 len: 1473 microversion: 2.1 time: 0.218124 Aug 10 17:58:20.543586 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 845/1720] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:58:20 2022] GET /compute/v2.1/servers/8937f92d-1764-4316-86cc-939bc9dc34b4 => generated 1473 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:58:20.827549 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [None req-287bd5b5-1323-4028-b620-5b2d36ff6878 tempest-DeleteServersTestJSON-1516492854 tempest-DeleteServersTestJSON-1516492854-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-8acbc843-0975-4ea3-a789-ffa2ac675948) Aug 10 17:58:20.827549 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:58:20.827549 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:58:20.827549 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:58:20.827549 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:58:20.827549 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:58:20.827549 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:58:20.827549 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:58:20.827549 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:58:20.827549 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:58:20.827549 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 17:58:20.827549 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 17:58:20.827549 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 17:58:20.827549 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 17:58:20.827549 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 17:58:20.827549 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 17:58:20.827549 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 17:58:20.827549 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 17:58:20.827549 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 17:58:20.827549 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 17:58:20.827549 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 17:58:20.827549 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 17:58:20.827549 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 17:58:20.827549 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 17:58:20.827549 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 17:58:20.827549 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 17:58:20.827549 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 17:58:20.827549 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:58:20.827549 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:58:20.827549 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 17:58:20.827549 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 17:58:20.827549 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:58:20.827549 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:58:20.827549 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:58:20.827549 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:58:20.827549 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:58:20.827549 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:58:20.827549 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:58:20.827549 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:58:20.827549 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:58:20.827549 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:58:20.827549 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 17:58:20.827549 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 17:58:20.827549 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 17:58:20.827549 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 17:58:20.827549 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 17:58:20.827549 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 17:58:20.827549 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 17:58:20.827549 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 17:58:20.827549 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 17:58:20.827549 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 17:58:20.827549 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 17:58:20.827549 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 17:58:20.831412 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 17:58:20.831412 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 17:58:20.831412 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 17:58:20.831412 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 17:58:20.831412 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 17:58:20.831412 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 17:58:20.831412 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 17:58:20.831412 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 17:58:20.831412 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 17:58:20.831412 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 17:58:20.831412 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 17:58:20.831412 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 17:58:20.831412 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 17:58:20.831412 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 17:58:20.831412 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-8acbc843-0975-4ea3-a789-ffa2ac675948) Aug 10 17:58:20.831412 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:58:20.831412 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-287bd5b5-1323-4028-b620-5b2d36ff6878 tempest-DeleteServersTestJSON-1516492854 tempest-DeleteServersTestJSON-1516492854-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:58:20.831412 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:58:20.831412 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-287bd5b5-1323-4028-b620-5b2d36ff6878 tempest-DeleteServersTestJSON-1516492854 tempest-DeleteServersTestJSON-1516492854-project] Request method failure captured: Aug 10 17:58:20.831412 n-d-852296-2 devstack@n-api.service[129409]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 17:58:20.831412 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 17:58:20.831412 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 17:58:20.831412 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 17:58:20.831412 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 207 Aug 10 17:58:20.831412 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 17:58:20.831412 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 17:58:20.831412 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 17:58:20.831412 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 17:58:20.831412 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8_G3aY3tDzIjHFP3FMPgi06ViF1z3c5GeWwBdJNRA-dnRGOCID253_N0atoxCBPKnyzmhvURj-CDAZfA0RzvILr0FTLqJnh-tJMC4Y6E5VzPXsvtMjz2j15kAWbqhk6TKQ4lkBbfmwHJniyiWC1ct5gD_cDnwPB5PltqFlZDjSm4M68 Aug 10 17:58:20.831412 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 17:58:20.831412 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 17:58:20.831412 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 17:58:20.831412 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 17:58:20.831412 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 17:58:20.831412 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 17:58:20.831412 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: e33fb30880dd4ff494c3eb1038db2e24 Aug 10 17:58:20.831412 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-DeleteServersTestJSON-1516492854 Aug 10 17:58:20.831412 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 17:58:20.831412 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 17:58:20.831412 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e33fb30880dd4ff494c3eb1038db2e24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/e33fb30880dd4ff494c3eb1038db2e24"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e33fb30880dd4ff494c3eb1038db2e24"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_e33fb30880dd4ff494c3eb1038db2e24", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:58:20.831412 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-DeleteServersTestJSON-1516492854 Aug 10 17:58:20.831412 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: e33fb30880dd4ff494c3eb1038db2e24 Aug 10 17:58:20.831412 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-DeleteServersTestJSON-1516492854 Aug 10 17:58:20.831412 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-DeleteServersTestJSON-1516492854-project Aug 10 17:58:20.831412 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 17:58:20.831412 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 17:58:20.831412 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: ec603eba5a764d489ad50622af3cd529 Aug 10 17:58:20.831412 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-DeleteServersTestJSON-1516492854-project Aug 10 17:58:20.831412 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:58:20.831412 n-d-852296-2 devstack@n-api.service[129409]: {"server": {"name": "tempest-DeleteServersTestJSON-server-1228353963", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "2c1593a8-a60b-4d6d-88ed-d9f31cee07cd"}]}} Aug 10 17:58:20.831412 n-d-852296-2 devstack@n-api.service[129409]: method: > Aug 10 17:58:20.831412 n-d-852296-2 devstack@n-api.service[129409]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:58:20.831412 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:58:20.831412 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'body': {'server': {'name': 'tempest-DeleteServersTestJSON-server-1228353963', 'imageRef': 'a735ff26-463a-4ffe-a981-ab9d9baa494f', 'flavorRef': '452', 'networks': [{'uuid': '2c1593a8-a60b-4d6d-88ed-d9f31cee07cd'}]}}} Aug 10 17:58:20.831412 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:58:20.837211 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:58:20.837211 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:58:20.837211 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:58:20.837211 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:58:20.837211 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:58:20.837211 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:58:20.837211 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:58:20.837211 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:58:20.837211 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:58:20.837211 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 17:58:20.837211 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 17:58:20.837211 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 17:58:20.837211 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 17:58:20.837211 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 17:58:20.837211 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 17:58:20.837211 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 17:58:20.837211 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 17:58:20.837211 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 17:58:20.837211 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 17:58:20.837211 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 17:58:20.837211 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 17:58:20.837211 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 17:58:20.837211 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 17:58:20.837211 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 17:58:20.837211 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 17:58:20.837211 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 17:58:20.837211 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:58:20.837211 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:58:20.837211 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 17:58:20.837211 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 17:58:20.837211 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:58:20.837211 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:58:20.837211 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:58:20.837211 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:58:20.837211 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:58:20.837211 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:58:20.837211 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:58:20.837211 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:58:20.837211 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:58:20.837211 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:58:20.837211 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 17:58:20.837211 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 17:58:20.837211 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 17:58:20.837211 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 17:58:20.837211 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 17:58:20.837211 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 17:58:20.837211 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 17:58:20.837211 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 17:58:20.837211 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 17:58:20.837211 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 17:58:20.837211 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 17:58:20.837211 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 17:58:20.837211 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 17:58:20.837211 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 17:58:20.837211 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 17:58:20.837211 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 17:58:20.847596 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 17:58:20.847596 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 17:58:20.847596 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 17:58:20.847596 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 17:58:20.847596 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 17:58:20.847596 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 17:58:20.847596 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 17:58:20.847596 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 17:58:20.847596 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 17:58:20.847596 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 17:58:20.847596 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-8acbc843-0975-4ea3-a789-ffa2ac675948) Aug 10 17:58:20.847596 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:58:20.847596 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:58:20.847596 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:58:20.847596 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:58:20.847596 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:58:20.847596 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:58:20.847596 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:58:20.847596 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:58:20.847596 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 10 17:58:20.847596 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 10 17:58:20.847596 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:58:20.847596 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:58:20.847596 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:58:20.847596 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:58:20.847596 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:58:20.847596 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:58:20.847596 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:58:20.847596 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:58:20.847596 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:58:20.847596 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:58:20.847596 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:58:20.847596 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:58:20.847596 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:58:20.847596 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-287bd5b5-1323-4028-b620-5b2d36ff6878 tempest-DeleteServersTestJSON-1516492854 tempest-DeleteServersTestJSON-1516492854-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:58:20.847596 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:58:20.847596 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-287bd5b5-1323-4028-b620-5b2d36ff6878 tempest-DeleteServersTestJSON-1516492854 tempest-DeleteServersTestJSON-1516492854-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.975002 Aug 10 17:58:20.853998 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 876/1721] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 17:58:19 2022] POST /compute/v2.1/servers => generated 214 bytes in 996 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 10 17:58:21.154591 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-df8d0297-45d6-479d-aac2-7e90ca96b1f4 tempest-DeleteServersTestJSON-1516492854 tempest-DeleteServersTestJSON-1516492854-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-379226109", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "2c1593a8-a60b-4d6d-88ed-d9f31cee07cd"}]}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:58:21.264420 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.network.neutron [None req-df8d0297-45d6-479d-aac2-7e90ca96b1f4 tempest-DeleteServersTestJSON-1516492854 tempest-DeleteServersTestJSON-1516492854-project] validate_networks() for [('2c1593a8-a60b-4d6d-88ed-d9f31cee07cd', None, None, None, None, None)] {{(pid=129410) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 17:58:21.550191 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-73e42913-d1a1-4629-8738-77082110aaa0 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:58:21.553954 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-73e42913-d1a1-4629-8738-77082110aaa0 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] [instance: 8937f92d-1764-4316-86cc-939bc9dc34b4] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:58:21.580732 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-73e42913-d1a1-4629-8738-77082110aaa0 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:58:21.581235 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-73e42913-d1a1-4629-8738-77082110aaa0 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:58:21.586052 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-73e42913-d1a1-4629-8738-77082110aaa0 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:58:21.592170 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-73e42913-d1a1-4629-8738-77082110aaa0 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:58:21.592734 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-73e42913-d1a1-4629-8738-77082110aaa0 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:58:21.593388 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-73e42913-d1a1-4629-8738-77082110aaa0 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:58:22.008889 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-73e42913-d1a1-4629-8738-77082110aaa0 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce45e1a545b4d3b8fa2cb4b2af3f306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0285f1570fe2419c930c80d3a0711858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:58:22.019296 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-73e42913-d1a1-4629-8738-77082110aaa0 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/servers/8937f92d-1764-4316-86cc-939bc9dc34b4" status: 200 len: 1473 microversion: 2.1 time: 0.475489 Aug 10 17:58:22.021241 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 877/1722] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:58:21 2022] GET /compute/v2.1/servers/8937f92d-1764-4316-86cc-939bc9dc34b4 => generated 1473 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:58:22.107189 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [None req-df8d0297-45d6-479d-aac2-7e90ca96b1f4 tempest-DeleteServersTestJSON-1516492854 tempest-DeleteServersTestJSON-1516492854-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-1f2e185a-4589-4294-a232-0a9e6a286a9f) Aug 10 17:58:22.107189 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:58:22.107189 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:58:22.107189 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:58:22.107189 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:58:22.107189 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:58:22.107189 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:58:22.107189 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:58:22.107189 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:58:22.107189 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:58:22.107189 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 17:58:22.107189 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 17:58:22.107189 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 17:58:22.107189 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 17:58:22.107189 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 17:58:22.107189 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 17:58:22.107189 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 17:58:22.107189 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 17:58:22.107189 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 17:58:22.107189 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 17:58:22.107189 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 17:58:22.107189 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 17:58:22.107189 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 17:58:22.107189 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 17:58:22.107189 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 17:58:22.107189 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 17:58:22.107189 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 17:58:22.107189 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:58:22.107189 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:58:22.107189 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 17:58:22.107189 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 17:58:22.107189 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:58:22.107189 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:58:22.107189 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:58:22.107189 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:58:22.107189 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:58:22.107189 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:58:22.107189 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:58:22.107189 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:58:22.107189 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:58:22.107189 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:58:22.107189 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 17:58:22.107189 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 17:58:22.107189 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 17:58:22.107189 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 17:58:22.107189 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 17:58:22.107189 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 17:58:22.107189 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 17:58:22.107189 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 17:58:22.107189 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 17:58:22.107189 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 17:58:22.107189 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 17:58:22.107189 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 17:58:22.111164 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 17:58:22.111164 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 17:58:22.111164 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 17:58:22.111164 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 17:58:22.111164 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 17:58:22.111164 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 17:58:22.111164 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 17:58:22.111164 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 17:58:22.111164 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 17:58:22.111164 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 17:58:22.111164 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 17:58:22.111164 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 17:58:22.111164 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 17:58:22.111164 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 17:58:22.111164 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-1f2e185a-4589-4294-a232-0a9e6a286a9f) Aug 10 17:58:22.111164 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:58:22.111164 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-df8d0297-45d6-479d-aac2-7e90ca96b1f4 tempest-DeleteServersTestJSON-1516492854 tempest-DeleteServersTestJSON-1516492854-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:58:22.111164 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 17:58:22.114751 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-df8d0297-45d6-479d-aac2-7e90ca96b1f4 tempest-DeleteServersTestJSON-1516492854 tempest-DeleteServersTestJSON-1516492854-project] Request method failure captured: Aug 10 17:58:22.114751 n-d-852296-2 devstack@n-api.service[129410]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 17:58:22.114751 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 17:58:22.114751 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 17:58:22.114751 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 17:58:22.114751 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 206 Aug 10 17:58:22.114751 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 17:58:22.114751 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 17:58:22.114751 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 17:58:22.114751 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 17:58:22.114751 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8_G3aY3tDzIjHFP3FMPgi06ViF1z3c5GeWwBdJNRA-dnRGOCID253_N0atoxCBPKnyzmhvURj-CDAZfA0RzvILr0FTLqJnh-tJMC4Y6E5VzPXsvtMjz2j15kAWbqhk6TKQ4lkBbfmwHJniyiWC1ct5gD_cDnwPB5PltqFlZDjSm4M68 Aug 10 17:58:22.114751 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 17:58:22.114751 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 17:58:22.114751 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 17:58:22.114751 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 17:58:22.114751 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 17:58:22.114751 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 17:58:22.114751 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: e33fb30880dd4ff494c3eb1038db2e24 Aug 10 17:58:22.114751 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-DeleteServersTestJSON-1516492854 Aug 10 17:58:22.114751 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 17:58:22.114751 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 17:58:22.114751 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e33fb30880dd4ff494c3eb1038db2e24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/e33fb30880dd4ff494c3eb1038db2e24"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e33fb30880dd4ff494c3eb1038db2e24"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_e33fb30880dd4ff494c3eb1038db2e24", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:58:22.114751 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-DeleteServersTestJSON-1516492854 Aug 10 17:58:22.114751 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: e33fb30880dd4ff494c3eb1038db2e24 Aug 10 17:58:22.114751 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-DeleteServersTestJSON-1516492854 Aug 10 17:58:22.114751 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-DeleteServersTestJSON-1516492854-project Aug 10 17:58:22.114751 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 17:58:22.114751 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 17:58:22.114751 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: ec603eba5a764d489ad50622af3cd529 Aug 10 17:58:22.114751 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-DeleteServersTestJSON-1516492854-project Aug 10 17:58:22.114751 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 17:58:22.114751 n-d-852296-2 devstack@n-api.service[129410]: {"server": {"name": "tempest-DeleteServersTestJSON-server-379226109", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "2c1593a8-a60b-4d6d-88ed-d9f31cee07cd"}]}} Aug 10 17:58:22.114751 n-d-852296-2 devstack@n-api.service[129410]: method: > Aug 10 17:58:22.114751 n-d-852296-2 devstack@n-api.service[129410]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:58:22.114751 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 17:58:22.114751 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'body': {'server': {'name': 'tempest-DeleteServersTestJSON-server-379226109', 'imageRef': 'a735ff26-463a-4ffe-a981-ab9d9baa494f', 'flavorRef': '452', 'networks': [{'uuid': '2c1593a8-a60b-4d6d-88ed-d9f31cee07cd'}]}}} Aug 10 17:58:22.114751 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:58:22.114751 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:58:22.114751 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:58:22.114751 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:58:22.114751 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:58:22.114751 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:58:22.114751 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:58:22.114751 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:58:22.114751 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:58:22.114751 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:58:22.114751 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 17:58:22.114751 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 17:58:22.114751 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 17:58:22.114751 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 17:58:22.114751 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 17:58:22.114751 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 17:58:22.114751 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 17:58:22.114751 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 17:58:22.114751 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 17:58:22.114751 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 17:58:22.114751 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 17:58:22.114751 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 17:58:22.114751 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 17:58:22.114751 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 17:58:22.114751 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 17:58:22.120193 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 17:58:22.120193 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 17:58:22.120193 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:58:22.120193 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:58:22.120193 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 17:58:22.120193 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 17:58:22.120193 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:58:22.120193 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:58:22.120193 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:58:22.120193 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:58:22.120193 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:58:22.120193 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:58:22.120193 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:58:22.120193 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:58:22.120193 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:58:22.120193 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:58:22.120193 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 17:58:22.120193 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 17:58:22.120193 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 17:58:22.120193 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 17:58:22.120193 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 17:58:22.120193 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 17:58:22.120193 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 17:58:22.120193 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 17:58:22.120193 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 17:58:22.120193 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 17:58:22.120193 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 17:58:22.120193 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 17:58:22.120193 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 17:58:22.120193 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 17:58:22.120193 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 17:58:22.120193 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 17:58:22.120193 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 17:58:22.120193 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 17:58:22.120193 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 17:58:22.120193 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 17:58:22.120193 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 17:58:22.120193 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 17:58:22.120193 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 17:58:22.120193 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 17:58:22.120193 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 17:58:22.120193 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 17:58:22.120193 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-1f2e185a-4589-4294-a232-0a9e6a286a9f) Aug 10 17:58:22.120193 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:58:22.120193 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:58:22.120193 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:58:22.120193 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:58:22.120193 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:58:22.120193 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:58:22.120193 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:58:22.120193 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:58:22.120193 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 10 17:58:22.120193 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 10 17:58:22.124141 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:58:22.124141 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:58:22.124141 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:58:22.124141 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:58:22.124141 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:58:22.124141 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:58:22.124141 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:58:22.124141 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:58:22.124141 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:58:22.124141 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:58:22.124141 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:58:22.124141 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:58:22.124141 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:58:22.124141 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-df8d0297-45d6-479d-aac2-7e90ca96b1f4 tempest-DeleteServersTestJSON-1516492854 tempest-DeleteServersTestJSON-1516492854-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:58:22.124141 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:58:22.124141 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-df8d0297-45d6-479d-aac2-7e90ca96b1f4 tempest-DeleteServersTestJSON-1516492854 tempest-DeleteServersTestJSON-1516492854-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.968886 Aug 10 17:58:22.136192 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 846/1723] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 17:58:21 2022] POST /compute/v2.1/servers => generated 214 bytes in 988 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 10 17:58:22.372290 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-2d5494eb-fbe3-44de-8499-7eb7587d8734 tempest-DeleteServersTestJSON-1516492854 tempest-DeleteServersTestJSON-1516492854-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1664379571", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "2c1593a8-a60b-4d6d-88ed-d9f31cee07cd"}]}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:58:22.492517 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.network.neutron [None req-2d5494eb-fbe3-44de-8499-7eb7587d8734 tempest-DeleteServersTestJSON-1516492854 tempest-DeleteServersTestJSON-1516492854-project] validate_networks() for [('2c1593a8-a60b-4d6d-88ed-d9f31cee07cd', None, None, None, None, None)] {{(pid=129409) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 17:58:23.059689 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-1fb13df9-9612-4cf2-a258-1aedc5189f55 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:58:23.062077 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-1fb13df9-9612-4cf2-a258-1aedc5189f55 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] [instance: 8937f92d-1764-4316-86cc-939bc9dc34b4] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:58:23.064824 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_api:SELECT=51,nova_api:DELETE=3,nova_api:UPDATE=2 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:58:23.074402 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-1fb13df9-9612-4cf2-a258-1aedc5189f55 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:58:23.075973 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-1fb13df9-9612-4cf2-a258-1aedc5189f55 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:58:23.077740 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-1fb13df9-9612-4cf2-a258-1aedc5189f55 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:58:23.078741 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-1fb13df9-9612-4cf2-a258-1aedc5189f55 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:58:23.080446 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-1fb13df9-9612-4cf2-a258-1aedc5189f55 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:58:23.081514 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-1fb13df9-9612-4cf2-a258-1aedc5189f55 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:58:23.774002 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-1fb13df9-9612-4cf2-a258-1aedc5189f55 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce45e1a545b4d3b8fa2cb4b2af3f306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0285f1570fe2419c930c80d3a0711858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:58:23.785799 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-1fb13df9-9612-4cf2-a258-1aedc5189f55 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/servers/8937f92d-1764-4316-86cc-939bc9dc34b4" status: 200 len: 1473 microversion: 2.1 time: 0.747798 Aug 10 17:58:23.787046 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 847/1724] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:58:23 2022] GET /compute/v2.1/servers/8937f92d-1764-4316-86cc-939bc9dc34b4 => generated 1473 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:58:23.954683 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [None req-2d5494eb-fbe3-44de-8499-7eb7587d8734 tempest-DeleteServersTestJSON-1516492854 tempest-DeleteServersTestJSON-1516492854-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-b4996bf8-f94c-4d10-984a-392ad1901a7a) Aug 10 17:58:23.954683 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:58:23.954683 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:58:23.954683 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:58:23.954683 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:58:23.954683 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:58:23.954683 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:58:23.954683 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:58:23.954683 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:58:23.954683 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:58:23.954683 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 17:58:23.954683 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 17:58:23.954683 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 17:58:23.954683 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 17:58:23.954683 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 17:58:23.954683 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 17:58:23.954683 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 17:58:23.954683 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 17:58:23.954683 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 17:58:23.954683 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 17:58:23.954683 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 17:58:23.954683 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 17:58:23.954683 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 17:58:23.954683 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 17:58:23.954683 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 17:58:23.954683 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 17:58:23.954683 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 17:58:23.954683 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:58:23.954683 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:58:23.954683 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 17:58:23.954683 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 17:58:23.954683 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:58:23.954683 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:58:23.954683 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:58:23.954683 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:58:23.954683 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:58:23.954683 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:58:23.954683 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:58:23.954683 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:58:23.954683 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:58:23.954683 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:58:23.954683 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 17:58:23.954683 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 17:58:23.954683 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 17:58:23.954683 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 17:58:23.954683 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 17:58:23.954683 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 17:58:23.954683 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 17:58:23.954683 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 17:58:23.954683 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 17:58:23.954683 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 17:58:23.954683 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 17:58:23.954683 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 17:58:23.959352 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 17:58:23.959352 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 17:58:23.959352 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 17:58:23.959352 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 17:58:23.959352 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 17:58:23.959352 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 17:58:23.959352 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 17:58:23.959352 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 17:58:23.959352 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 17:58:23.959352 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 17:58:23.959352 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 17:58:23.959352 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 17:58:23.959352 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 17:58:23.959352 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 17:58:23.959352 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-b4996bf8-f94c-4d10-984a-392ad1901a7a) Aug 10 17:58:23.959352 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:58:23.959352 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-2d5494eb-fbe3-44de-8499-7eb7587d8734 tempest-DeleteServersTestJSON-1516492854 tempest-DeleteServersTestJSON-1516492854-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:58:23.959352 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:58:23.961671 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-2d5494eb-fbe3-44de-8499-7eb7587d8734 tempest-DeleteServersTestJSON-1516492854 tempest-DeleteServersTestJSON-1516492854-project] Request method failure captured: Aug 10 17:58:23.961671 n-d-852296-2 devstack@n-api.service[129409]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 17:58:23.961671 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 17:58:23.961671 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 17:58:23.961671 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 17:58:23.961671 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 207 Aug 10 17:58:23.961671 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 17:58:23.961671 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 17:58:23.961671 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 17:58:23.961671 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 17:58:23.961671 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8_G3aY3tDzIjHFP3FMPgi06ViF1z3c5GeWwBdJNRA-dnRGOCID253_N0atoxCBPKnyzmhvURj-CDAZfA0RzvILr0FTLqJnh-tJMC4Y6E5VzPXsvtMjz2j15kAWbqhk6TKQ4lkBbfmwHJniyiWC1ct5gD_cDnwPB5PltqFlZDjSm4M68 Aug 10 17:58:23.961671 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 17:58:23.961671 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 17:58:23.961671 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 17:58:23.961671 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 17:58:23.961671 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 17:58:23.961671 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 17:58:23.961671 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: e33fb30880dd4ff494c3eb1038db2e24 Aug 10 17:58:23.961671 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-DeleteServersTestJSON-1516492854 Aug 10 17:58:23.961671 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 17:58:23.961671 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 17:58:23.961671 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e33fb30880dd4ff494c3eb1038db2e24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/e33fb30880dd4ff494c3eb1038db2e24"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e33fb30880dd4ff494c3eb1038db2e24"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_e33fb30880dd4ff494c3eb1038db2e24", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:58:23.961671 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-DeleteServersTestJSON-1516492854 Aug 10 17:58:23.961671 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: e33fb30880dd4ff494c3eb1038db2e24 Aug 10 17:58:23.961671 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-DeleteServersTestJSON-1516492854 Aug 10 17:58:23.961671 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-DeleteServersTestJSON-1516492854-project Aug 10 17:58:23.961671 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 17:58:23.961671 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 17:58:23.961671 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: ec603eba5a764d489ad50622af3cd529 Aug 10 17:58:23.961671 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-DeleteServersTestJSON-1516492854-project Aug 10 17:58:23.961671 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:58:23.961671 n-d-852296-2 devstack@n-api.service[129409]: {"server": {"name": "tempest-DeleteServersTestJSON-server-1664379571", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "2c1593a8-a60b-4d6d-88ed-d9f31cee07cd"}]}} Aug 10 17:58:23.961671 n-d-852296-2 devstack@n-api.service[129409]: method: > Aug 10 17:58:23.961671 n-d-852296-2 devstack@n-api.service[129409]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:58:23.961671 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:58:23.961671 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'body': {'server': {'name': 'tempest-DeleteServersTestJSON-server-1664379571', 'imageRef': 'a735ff26-463a-4ffe-a981-ab9d9baa494f', 'flavorRef': '452', 'networks': [{'uuid': '2c1593a8-a60b-4d6d-88ed-d9f31cee07cd'}]}}} Aug 10 17:58:23.961671 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:58:23.961671 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:58:23.961671 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:58:23.961671 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:58:23.961671 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:58:23.961671 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:58:23.961671 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:58:23.961671 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:58:23.961671 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:58:23.961671 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:58:23.961671 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 17:58:23.961671 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 17:58:23.961671 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 17:58:23.961671 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 17:58:23.961671 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 17:58:23.961671 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 17:58:23.961671 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 17:58:23.961671 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 17:58:23.961671 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 17:58:23.961671 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 17:58:23.961671 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 17:58:23.961671 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 17:58:23.961671 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 17:58:23.961671 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 17:58:23.961671 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 17:58:23.966405 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 17:58:23.966405 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 17:58:23.966405 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:58:23.966405 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:58:23.966405 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 17:58:23.966405 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 17:58:23.966405 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:58:23.966405 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:58:23.966405 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:58:23.966405 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:58:23.966405 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:58:23.966405 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:58:23.966405 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:58:23.966405 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:58:23.966405 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:58:23.966405 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:58:23.966405 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 17:58:23.966405 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 17:58:23.966405 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 17:58:23.966405 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 17:58:23.966405 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 17:58:23.966405 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 17:58:23.966405 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 17:58:23.966405 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 17:58:23.966405 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 17:58:23.966405 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 17:58:23.966405 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 17:58:23.966405 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 17:58:23.966405 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 17:58:23.966405 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 17:58:23.966405 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 17:58:23.966405 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 17:58:23.966405 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 17:58:23.966405 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 17:58:23.966405 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 17:58:23.966405 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 17:58:23.966405 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 17:58:23.966405 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 17:58:23.966405 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 17:58:23.966405 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 17:58:23.966405 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 17:58:23.966405 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 17:58:23.966405 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-b4996bf8-f94c-4d10-984a-392ad1901a7a) Aug 10 17:58:23.966405 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:58:23.966405 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:58:23.966405 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:58:23.966405 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:58:23.966405 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:58:23.966405 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:58:23.966405 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:58:23.966405 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:58:23.966405 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 10 17:58:23.966405 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 10 17:58:23.973848 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:58:23.973848 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:58:23.973848 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:58:23.973848 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:58:23.973848 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:58:23.973848 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:58:23.973848 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:58:23.973848 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:58:23.973848 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:58:23.973848 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:58:23.973848 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:58:23.973848 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:58:23.973848 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:58:23.973848 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-2d5494eb-fbe3-44de-8499-7eb7587d8734 tempest-DeleteServersTestJSON-1516492854 tempest-DeleteServersTestJSON-1516492854-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:58:23.973848 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:58:23.976678 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-2d5494eb-fbe3-44de-8499-7eb7587d8734 tempest-DeleteServersTestJSON-1516492854 tempest-DeleteServersTestJSON-1516492854-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.608995 Aug 10 17:58:23.986580 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 878/1725] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 17:58:22 2022] POST /compute/v2.1/servers => generated 214 bytes in 1615 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 10 17:58:24.022127 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [req-be3570bf-7308-4375-9e27-88dd7005bbb5 req-e2703e00-57f7-482c-999e-6790e7f84d3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8937f92d-1764-4316-86cc-939bc9dc34b4", "name": "network-vif-deleted", "tag": "c4ddeb24-17b7-43ce-b1c2-3516523d5956"}]} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:58:24.037115 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-be3570bf-7308-4375-9e27-88dd7005bbb5 req-e2703e00-57f7-482c-999e-6790e7f84d3a service nova] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:58:24.037930 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-be3570bf-7308-4375-9e27-88dd7005bbb5 req-e2703e00-57f7-482c-999e-6790e7f84d3a service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:58:24.038591 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-be3570bf-7308-4375-9e27-88dd7005bbb5 req-e2703e00-57f7-482c-999e-6790e7f84d3a service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:58:24.067583 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.compute.server_external_events [req-be3570bf-7308-4375-9e27-88dd7005bbb5 req-e2703e00-57f7-482c-999e-6790e7f84d3a service nova] Creating event network-vif-deleted:c4ddeb24-17b7-43ce-b1c2-3516523d5956 for instance 8937f92d-1764-4316-86cc-939bc9dc34b4 on n-h2-852296-2 Aug 10 17:58:24.086702 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [req-be3570bf-7308-4375-9e27-88dd7005bbb5 req-e2703e00-57f7-482c-999e-6790e7f84d3a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070755 Aug 10 17:58:24.088830 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 848/1726] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 10 17:58:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:58:24.439171 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-11ab37f1-f9dd-40f0-839f-c5bc4bbc3032 tempest-DeleteServersTestJSON-1516492854 tempest-DeleteServersTestJSON-1516492854-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1100152324", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "2c1593a8-a60b-4d6d-88ed-d9f31cee07cd"}]}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:58:24.561983 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.network.neutron [None req-11ab37f1-f9dd-40f0-839f-c5bc4bbc3032 tempest-DeleteServersTestJSON-1516492854 tempest-DeleteServersTestJSON-1516492854-project] validate_networks() for [('2c1593a8-a60b-4d6d-88ed-d9f31cee07cd', None, None, None, None, None)] {{(pid=129409) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 17:58:24.809355 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-0fe910f7-26a7-4d40-ab50-4ec2746f566a tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:58:24.810136 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-0fe910f7-26a7-4d40-ab50-4ec2746f566a tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] [instance: 8937f92d-1764-4316-86cc-939bc9dc34b4] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:58:24.830004 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-0fe910f7-26a7-4d40-ab50-4ec2746f566a tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:58:24.830508 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-0fe910f7-26a7-4d40-ab50-4ec2746f566a tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:58:24.830950 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-0fe910f7-26a7-4d40-ab50-4ec2746f566a tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:58:24.844158 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-0fe910f7-26a7-4d40-ab50-4ec2746f566a tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:58:24.848153 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-0fe910f7-26a7-4d40-ab50-4ec2746f566a tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:58:24.854231 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-0fe910f7-26a7-4d40-ab50-4ec2746f566a tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:58:24.965126 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-0fe910f7-26a7-4d40-ab50-4ec2746f566a tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:58:24.965819 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-0fe910f7-26a7-4d40-ab50-4ec2746f566a tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:58:24.967609 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-0fe910f7-26a7-4d40-ab50-4ec2746f566a tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:58:24.968196 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.objects.instance [None req-0fe910f7-26a7-4d40-ab50-4ec2746f566a tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lazy-loading 'fault' on Instance uuid 8937f92d-1764-4316-86cc-939bc9dc34b4 {{(pid=129410) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:58:25.101799 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-0fe910f7-26a7-4d40-ab50-4ec2746f566a tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce45e1a545b4d3b8fa2cb4b2af3f306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0285f1570fe2419c930c80d3a0711858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:58:25.114800 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-0fe910f7-26a7-4d40-ab50-4ec2746f566a tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/servers/8937f92d-1764-4316-86cc-939bc9dc34b4" status: 200 len: 1308 microversion: 2.1 time: 0.309876 Aug 10 17:58:25.116142 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 849/1727] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:58:24 2022] GET /compute/v2.1/servers/8937f92d-1764-4316-86cc-939bc9dc34b4 => generated 1308 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:58:25.392024 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [None req-11ab37f1-f9dd-40f0-839f-c5bc4bbc3032 tempest-DeleteServersTestJSON-1516492854 tempest-DeleteServersTestJSON-1516492854-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-9427e880-7a4c-420d-8a9e-ea2045bf278e) Aug 10 17:58:25.392024 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:58:25.392024 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:58:25.392024 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:58:25.392024 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:58:25.392024 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:58:25.392024 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:58:25.392024 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:58:25.392024 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:58:25.392024 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:58:25.392024 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 17:58:25.392024 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 17:58:25.392024 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 17:58:25.392024 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 17:58:25.392024 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 17:58:25.392024 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 17:58:25.392024 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 17:58:25.392024 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 17:58:25.392024 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 17:58:25.392024 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 17:58:25.392024 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 17:58:25.392024 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 17:58:25.392024 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 17:58:25.392024 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 17:58:25.392024 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 17:58:25.392024 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 17:58:25.392024 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 17:58:25.392024 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:58:25.392024 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:58:25.392024 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 17:58:25.392024 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 17:58:25.392024 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:58:25.392024 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:58:25.392024 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:58:25.392024 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:58:25.392024 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:58:25.392024 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:58:25.392024 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:58:25.392024 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:58:25.392024 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:58:25.392024 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:58:25.392024 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 17:58:25.392024 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 17:58:25.392024 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 17:58:25.392024 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 17:58:25.392024 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 17:58:25.392024 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 17:58:25.392024 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 17:58:25.392024 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 17:58:25.392024 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 17:58:25.392024 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 17:58:25.392024 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 17:58:25.392024 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 17:58:25.395407 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 17:58:25.395407 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 17:58:25.395407 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 17:58:25.395407 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 17:58:25.395407 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 17:58:25.395407 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 17:58:25.395407 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 17:58:25.395407 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 17:58:25.395407 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 17:58:25.395407 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 17:58:25.395407 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 17:58:25.395407 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 17:58:25.395407 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 17:58:25.395407 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 17:58:25.395407 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-9427e880-7a4c-420d-8a9e-ea2045bf278e) Aug 10 17:58:25.395407 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:58:25.395407 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-11ab37f1-f9dd-40f0-839f-c5bc4bbc3032 tempest-DeleteServersTestJSON-1516492854 tempest-DeleteServersTestJSON-1516492854-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:58:25.395407 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:58:25.395407 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-11ab37f1-f9dd-40f0-839f-c5bc4bbc3032 tempest-DeleteServersTestJSON-1516492854 tempest-DeleteServersTestJSON-1516492854-project] Request method failure captured: Aug 10 17:58:25.395407 n-d-852296-2 devstack@n-api.service[129409]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 17:58:25.395407 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 17:58:25.395407 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 17:58:25.395407 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 17:58:25.395407 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 207 Aug 10 17:58:25.395407 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 17:58:25.395407 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 17:58:25.395407 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 17:58:25.395407 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 17:58:25.395407 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8_G3aY3tDzIjHFP3FMPgi06ViF1z3c5GeWwBdJNRA-dnRGOCID253_N0atoxCBPKnyzmhvURj-CDAZfA0RzvILr0FTLqJnh-tJMC4Y6E5VzPXsvtMjz2j15kAWbqhk6TKQ4lkBbfmwHJniyiWC1ct5gD_cDnwPB5PltqFlZDjSm4M68 Aug 10 17:58:25.395407 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 17:58:25.395407 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 17:58:25.395407 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 17:58:25.395407 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 17:58:25.395407 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 17:58:25.395407 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 17:58:25.395407 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: e33fb30880dd4ff494c3eb1038db2e24 Aug 10 17:58:25.395407 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-DeleteServersTestJSON-1516492854 Aug 10 17:58:25.395407 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 17:58:25.395407 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 17:58:25.395407 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e33fb30880dd4ff494c3eb1038db2e24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/e33fb30880dd4ff494c3eb1038db2e24"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e33fb30880dd4ff494c3eb1038db2e24"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_e33fb30880dd4ff494c3eb1038db2e24", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:58:25.395407 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-DeleteServersTestJSON-1516492854 Aug 10 17:58:25.395407 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: e33fb30880dd4ff494c3eb1038db2e24 Aug 10 17:58:25.395407 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-DeleteServersTestJSON-1516492854 Aug 10 17:58:25.395407 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-DeleteServersTestJSON-1516492854-project Aug 10 17:58:25.395407 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 17:58:25.395407 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 17:58:25.395407 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: ec603eba5a764d489ad50622af3cd529 Aug 10 17:58:25.395407 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-DeleteServersTestJSON-1516492854-project Aug 10 17:58:25.395407 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:58:25.395407 n-d-852296-2 devstack@n-api.service[129409]: {"server": {"name": "tempest-DeleteServersTestJSON-server-1100152324", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "2c1593a8-a60b-4d6d-88ed-d9f31cee07cd"}]}} Aug 10 17:58:25.395407 n-d-852296-2 devstack@n-api.service[129409]: method: > Aug 10 17:58:25.395407 n-d-852296-2 devstack@n-api.service[129409]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:58:25.395407 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:58:25.395407 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'body': {'server': {'name': 'tempest-DeleteServersTestJSON-server-1100152324', 'imageRef': 'a735ff26-463a-4ffe-a981-ab9d9baa494f', 'flavorRef': '452', 'networks': [{'uuid': '2c1593a8-a60b-4d6d-88ed-d9f31cee07cd'}]}}} Aug 10 17:58:25.395407 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:58:25.411664 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:58:25.411664 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:58:25.411664 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:58:25.411664 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:58:25.411664 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:58:25.411664 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:58:25.411664 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:58:25.411664 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:58:25.411664 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:58:25.411664 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 17:58:25.411664 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 17:58:25.411664 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 17:58:25.411664 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 17:58:25.411664 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 17:58:25.411664 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 17:58:25.411664 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 17:58:25.411664 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 17:58:25.411664 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 17:58:25.411664 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 17:58:25.411664 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 17:58:25.411664 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 17:58:25.411664 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 17:58:25.411664 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 17:58:25.411664 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 17:58:25.411664 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 17:58:25.411664 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 17:58:25.411664 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:58:25.411664 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:58:25.411664 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 17:58:25.411664 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 17:58:25.411664 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:58:25.411664 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:58:25.411664 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:58:25.411664 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:58:25.411664 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:58:25.411664 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:58:25.411664 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:58:25.411664 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:58:25.411664 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:58:25.411664 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:58:25.411664 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 17:58:25.411664 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 17:58:25.411664 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 17:58:25.411664 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 17:58:25.411664 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 17:58:25.411664 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 17:58:25.411664 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 17:58:25.411664 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 17:58:25.411664 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 17:58:25.411664 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 17:58:25.411664 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 17:58:25.411664 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 17:58:25.411664 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 17:58:25.411664 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 17:58:25.411664 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 17:58:25.411664 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 17:58:25.420442 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 17:58:25.420442 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 17:58:25.420442 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 17:58:25.420442 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 17:58:25.420442 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 17:58:25.420442 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 17:58:25.420442 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 17:58:25.420442 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 17:58:25.420442 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 17:58:25.420442 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 17:58:25.420442 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-9427e880-7a4c-420d-8a9e-ea2045bf278e) Aug 10 17:58:25.420442 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:58:25.420442 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:58:25.420442 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:58:25.420442 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:58:25.420442 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:58:25.420442 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:58:25.420442 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:58:25.420442 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:58:25.420442 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 10 17:58:25.420442 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 10 17:58:25.420442 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:58:25.420442 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:58:25.420442 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:58:25.420442 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:58:25.420442 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:58:25.420442 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:58:25.420442 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:58:25.420442 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:58:25.420442 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:58:25.420442 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:58:25.420442 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:58:25.420442 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:58:25.420442 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:58:25.420442 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-11ab37f1-f9dd-40f0-839f-c5bc4bbc3032 tempest-DeleteServersTestJSON-1516492854 tempest-DeleteServersTestJSON-1516492854-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:58:25.420442 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:58:25.420442 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-11ab37f1-f9dd-40f0-839f-c5bc4bbc3032 tempest-DeleteServersTestJSON-1516492854 tempest-DeleteServersTestJSON-1516492854-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.962653 Aug 10 17:58:25.420442 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 879/1728] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 17:58:24 2022] POST /compute/v2.1/servers => generated 214 bytes in 964 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 10 17:58:25.661880 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-1c9cf7d5-5a72-4a09-ac04-38f73c46d6fc tempest-DeleteServersTestJSON-1516492854 tempest-DeleteServersTestJSON-1516492854-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1946350718", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "2c1593a8-a60b-4d6d-88ed-d9f31cee07cd"}]}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:58:25.787781 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.network.neutron [None req-1c9cf7d5-5a72-4a09-ac04-38f73c46d6fc tempest-DeleteServersTestJSON-1516492854 tempest-DeleteServersTestJSON-1516492854-project] validate_networks() for [('2c1593a8-a60b-4d6d-88ed-d9f31cee07cd', None, None, None, None, None)] {{(pid=129410) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 17:58:26.144938 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-b7298bbd-cf3b-4157-8e5e-25b01b09cc5b tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:58:26.145668 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-b7298bbd-cf3b-4157-8e5e-25b01b09cc5b tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] [instance: 8937f92d-1764-4316-86cc-939bc9dc34b4] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:58:26.157866 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-b7298bbd-cf3b-4157-8e5e-25b01b09cc5b tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:58:26.157866 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-b7298bbd-cf3b-4157-8e5e-25b01b09cc5b tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:58:26.157866 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-b7298bbd-cf3b-4157-8e5e-25b01b09cc5b tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:58:26.157866 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-b7298bbd-cf3b-4157-8e5e-25b01b09cc5b tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:58:26.157866 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-b7298bbd-cf3b-4157-8e5e-25b01b09cc5b tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:58:26.157866 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-b7298bbd-cf3b-4157-8e5e-25b01b09cc5b tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:58:26.180681 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-b7298bbd-cf3b-4157-8e5e-25b01b09cc5b tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] HTTP exception thrown: Instance 8937f92d-1764-4316-86cc-939bc9dc34b4 could not be found. Aug 10 17:58:26.188046 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-b7298bbd-cf3b-4157-8e5e-25b01b09cc5b tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Request method failure captured: Aug 10 17:58:26.188046 n-d-852296-2 devstack@n-api.service[129409]: request: GET /compute/v2.1/servers/8937f92d-1764-4316-86cc-939bc9dc34b4 HTTP/1.1 Aug 10 17:58:26.188046 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 17:58:26.188046 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 17:58:26.188046 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 17:58:26.188046 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 0 Aug 10 17:58:26.188046 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 17:58:26.188046 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 17:58:26.188046 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 17:58:26.188046 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 17:58:26.188046 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8_EK-tiFwvBLcISUs5SXRTHSTdvHxBTuXdzdDY_BxPBhJr2KVJC2vzEymot7KzffEXQy3fs1qAhAOGvbQQ-pzc1eE5ucXZG9y3q4ZpaA39g7T4xG3j_FBrkSo_gFdgFhpq3VRXU74fRQyH8yzAkH5WdhQneXDZcXp2iC53XBMhMyhOk Aug 10 17:58:26.188046 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 17:58:26.188046 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 17:58:26.188046 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 17:58:26.188046 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 17:58:26.188046 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 17:58:26.188046 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 17:58:26.188046 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: 0285f1570fe2419c930c80d3a0711858 Aug 10 17:58:26.188046 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-ListImageFiltersTestJSON-1950276764 Aug 10 17:58:26.188046 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 17:58:26.188046 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 17:58:26.188046 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0285f1570fe2419c930c80d3a0711858"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/0285f1570fe2419c930c80d3a0711858"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0285f1570fe2419c930c80d3a0711858"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_0285f1570fe2419c930c80d3a0711858", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:58:26.188046 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-ListImageFiltersTestJSON-1950276764 Aug 10 17:58:26.188046 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: 0285f1570fe2419c930c80d3a0711858 Aug 10 17:58:26.188046 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1950276764 Aug 10 17:58:26.188046 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-ListImageFiltersTestJSON-1950276764-project Aug 10 17:58:26.188046 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 17:58:26.188046 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 17:58:26.188046 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: dce45e1a545b4d3b8fa2cb4b2af3f306 Aug 10 17:58:26.188046 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-ListImageFiltersTestJSON-1950276764-project Aug 10 17:58:26.188046 n-d-852296-2 devstack@n-api.service[129409]: method: > Aug 10 17:58:26.188046 n-d-852296-2 devstack@n-api.service[129409]: exception: Instance 8937f92d-1764-4316-86cc-939bc9dc34b4 could not be found. Aug 10 17:58:26.188046 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'id': '8937f92d-1764-4316-86cc-939bc9dc34b4'} Aug 10 17:58:26.188046 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:58:26.188046 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:58:26.188046 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 17:58:26.188046 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 17:58:26.188046 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 17:58:26.188046 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 17:58:26.188046 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 17:58:26.188046 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 17:58:26.188046 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 17:58:26.188046 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 17:58:26.188046 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8937f92d-1764-4316-86cc-939bc9dc34b4 could not be found. Aug 10 17:58:26.188046 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:58:26.188046 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:58:26.188046 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:58:26.188046 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:58:26.188046 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:58:26.188046 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:58:26.188046 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:58:26.188046 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:58:26.188046 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:58:26.188046 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:58:26.188046 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 17:58:26.188046 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 17:58:26.188046 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 17:58:26.188046 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 17:58:26.188046 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 17:58:26.188046 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:58:26.188046 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8937f92d-1764-4316-86cc-939bc9dc34b4 could not be found. Aug 10 17:58:26.188046 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:58:26.188046 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:58:26.188046 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:58:26.193074 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:58:26.193074 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:58:26.193074 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:58:26.193074 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:58:26.193074 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:58:26.193074 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8937f92d-1764-4316-86cc-939bc9dc34b4 could not be found. Aug 10 17:58:26.193074 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:58:26.193074 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-b7298bbd-cf3b-4157-8e5e-25b01b09cc5b tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Returning 404 to user: Instance 8937f92d-1764-4316-86cc-939bc9dc34b4 could not be found. {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:58:26.193074 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-b7298bbd-cf3b-4157-8e5e-25b01b09cc5b tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "GET /compute/v2.1/servers/8937f92d-1764-4316-86cc-939bc9dc34b4" status: 404 len: 111 microversion: 2.1 time: 0.048352 Aug 10 17:58:26.195021 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 880/1729] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:58:26 2022] GET /compute/v2.1/servers/8937f92d-1764-4316-86cc-939bc9dc34b4 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:58:26.209988 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-0137a47b-5122-4049-993b-2757503bdaae tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '.version_select at 0x7fb345e25af0>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:58:26.877343 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [None req-1c9cf7d5-5a72-4a09-ac04-38f73c46d6fc tempest-DeleteServersTestJSON-1516492854 tempest-DeleteServersTestJSON-1516492854-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-15b308f0-f041-4da3-8a6e-cd9dc28a90e4) Aug 10 17:58:26.877343 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:58:26.877343 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:58:26.877343 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:58:26.877343 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:58:26.877343 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:58:26.877343 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:58:26.877343 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:58:26.877343 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:58:26.877343 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:58:26.877343 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 17:58:26.877343 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 17:58:26.877343 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 17:58:26.877343 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 17:58:26.877343 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 17:58:26.877343 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 17:58:26.877343 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 17:58:26.877343 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 17:58:26.877343 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 17:58:26.877343 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 17:58:26.877343 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 17:58:26.877343 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 17:58:26.877343 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 17:58:26.877343 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 17:58:26.877343 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 17:58:26.877343 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 17:58:26.877343 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 17:58:26.877343 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:58:26.877343 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:58:26.877343 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 17:58:26.877343 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 17:58:26.877343 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:58:26.877343 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:58:26.877343 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:58:26.877343 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:58:26.877343 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:58:26.877343 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:58:26.877343 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:58:26.877343 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:58:26.877343 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:58:26.877343 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:58:26.877343 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 17:58:26.877343 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 17:58:26.877343 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 17:58:26.877343 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 17:58:26.877343 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 17:58:26.877343 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 17:58:26.877343 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 17:58:26.877343 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 17:58:26.877343 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 17:58:26.877343 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 17:58:26.877343 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 17:58:26.877343 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 17:58:26.882248 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 17:58:26.882248 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 17:58:26.882248 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 17:58:26.882248 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 17:58:26.882248 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 17:58:26.882248 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 17:58:26.882248 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 17:58:26.882248 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 17:58:26.882248 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 17:58:26.882248 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 17:58:26.882248 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 17:58:26.882248 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 17:58:26.882248 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 17:58:26.882248 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 17:58:26.882248 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-15b308f0-f041-4da3-8a6e-cd9dc28a90e4) Aug 10 17:58:26.882248 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:58:26.888155 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-1c9cf7d5-5a72-4a09-ac04-38f73c46d6fc tempest-DeleteServersTestJSON-1516492854 tempest-DeleteServersTestJSON-1516492854-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:58:26.888155 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 17:58:26.896377 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-1c9cf7d5-5a72-4a09-ac04-38f73c46d6fc tempest-DeleteServersTestJSON-1516492854 tempest-DeleteServersTestJSON-1516492854-project] Request method failure captured: Aug 10 17:58:26.896377 n-d-852296-2 devstack@n-api.service[129410]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 17:58:26.896377 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 17:58:26.896377 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 17:58:26.896377 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 17:58:26.896377 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 207 Aug 10 17:58:26.896377 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 17:58:26.896377 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 17:58:26.896377 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 17:58:26.896377 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 17:58:26.896377 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8_G3aY3tDzIjHFP3FMPgi06ViF1z3c5GeWwBdJNRA-dnRGOCID253_N0atoxCBPKnyzmhvURj-CDAZfA0RzvILr0FTLqJnh-tJMC4Y6E5VzPXsvtMjz2j15kAWbqhk6TKQ4lkBbfmwHJniyiWC1ct5gD_cDnwPB5PltqFlZDjSm4M68 Aug 10 17:58:26.896377 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 17:58:26.896377 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 17:58:26.896377 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 17:58:26.896377 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 17:58:26.896377 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 17:58:26.896377 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 17:58:26.896377 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: e33fb30880dd4ff494c3eb1038db2e24 Aug 10 17:58:26.896377 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-DeleteServersTestJSON-1516492854 Aug 10 17:58:26.896377 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 17:58:26.896377 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 17:58:26.896377 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e33fb30880dd4ff494c3eb1038db2e24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/e33fb30880dd4ff494c3eb1038db2e24"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e33fb30880dd4ff494c3eb1038db2e24"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_e33fb30880dd4ff494c3eb1038db2e24", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:58:26.896377 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-DeleteServersTestJSON-1516492854 Aug 10 17:58:26.896377 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: e33fb30880dd4ff494c3eb1038db2e24 Aug 10 17:58:26.896377 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-DeleteServersTestJSON-1516492854 Aug 10 17:58:26.896377 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-DeleteServersTestJSON-1516492854-project Aug 10 17:58:26.896377 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 17:58:26.896377 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 17:58:26.896377 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: ec603eba5a764d489ad50622af3cd529 Aug 10 17:58:26.896377 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-DeleteServersTestJSON-1516492854-project Aug 10 17:58:26.896377 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 17:58:26.896377 n-d-852296-2 devstack@n-api.service[129410]: {"server": {"name": "tempest-DeleteServersTestJSON-server-1946350718", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "2c1593a8-a60b-4d6d-88ed-d9f31cee07cd"}]}} Aug 10 17:58:26.896377 n-d-852296-2 devstack@n-api.service[129410]: method: > Aug 10 17:58:26.896377 n-d-852296-2 devstack@n-api.service[129410]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:58:26.896377 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 17:58:26.896377 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'body': {'server': {'name': 'tempest-DeleteServersTestJSON-server-1946350718', 'imageRef': 'a735ff26-463a-4ffe-a981-ab9d9baa494f', 'flavorRef': '452', 'networks': [{'uuid': '2c1593a8-a60b-4d6d-88ed-d9f31cee07cd'}]}}} Aug 10 17:58:26.896377 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:58:26.896377 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:58:26.896377 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:58:26.896377 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:58:26.896377 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:58:26.896377 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:58:26.896377 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:58:26.896377 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:58:26.896377 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:58:26.896377 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:58:26.896377 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 17:58:26.896377 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 17:58:26.896377 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 17:58:26.896377 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 17:58:26.896377 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 17:58:26.896377 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 17:58:26.896377 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 17:58:26.896377 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 17:58:26.896377 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 17:58:26.896377 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 17:58:26.896377 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 17:58:26.896377 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 17:58:26.896377 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 17:58:26.896377 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 17:58:26.896377 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 17:58:26.918976 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 17:58:26.918976 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 17:58:26.918976 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:58:26.918976 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:58:26.918976 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 17:58:26.918976 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 17:58:26.918976 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:58:26.918976 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:58:26.918976 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:58:26.918976 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:58:26.918976 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:58:26.918976 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:58:26.918976 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:58:26.918976 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:58:26.918976 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:58:26.918976 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:58:26.918976 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 17:58:26.918976 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 17:58:26.918976 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 17:58:26.918976 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 17:58:26.918976 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 17:58:26.918976 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 17:58:26.918976 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 17:58:26.918976 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 17:58:26.918976 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 17:58:26.918976 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 17:58:26.918976 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 17:58:26.918976 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 17:58:26.918976 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 17:58:26.918976 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 17:58:26.918976 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 17:58:26.918976 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 17:58:26.918976 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 17:58:26.918976 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 17:58:26.918976 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 17:58:26.918976 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 17:58:26.918976 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 17:58:26.918976 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 17:58:26.918976 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 17:58:26.918976 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 17:58:26.918976 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 17:58:26.918976 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 17:58:26.918976 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-15b308f0-f041-4da3-8a6e-cd9dc28a90e4) Aug 10 17:58:26.918976 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:58:26.918976 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:58:26.918976 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:58:26.918976 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:58:26.918976 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:58:26.918976 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:58:26.918976 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:58:26.918976 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:58:26.918976 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 10 17:58:26.918976 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 10 17:58:26.927357 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:58:26.927357 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:58:26.927357 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:58:26.927357 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:58:26.927357 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:58:26.927357 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:58:26.927357 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:58:26.927357 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:58:26.927357 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:58:26.927357 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:58:26.927357 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:58:26.927357 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:58:26.927357 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:58:26.927357 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-1c9cf7d5-5a72-4a09-ac04-38f73c46d6fc tempest-DeleteServersTestJSON-1516492854 tempest-DeleteServersTestJSON-1516492854-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:58:26.927357 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:58:26.927357 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-1c9cf7d5-5a72-4a09-ac04-38f73c46d6fc tempest-DeleteServersTestJSON-1516492854 tempest-DeleteServersTestJSON-1516492854-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.236122 Aug 10 17:58:26.927357 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 850/1730] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 17:58:25 2022] POST /compute/v2.1/servers => generated 214 bytes in 1242 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 10 17:58:27.979919 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-0137a47b-5122-4049-993b-2757503bdaae tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "DELETE /compute/v2.1/images/c3a967f0-5ce6-4ab7-b44d-8ff730582778" status: 204 len: 0 microversion: 2.1 time: 1.782982 Aug 10 17:58:27.985035 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 881/1731] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:58:26 2022] DELETE /compute/v2.1/images/c3a967f0-5ce6-4ab7-b44d-8ff730582778 => generated 0 bytes in 1785 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 17:58:27.991198 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-aadb50e2-11e6-462a-a387-fb8918b2323d tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '.version_select at 0x7fb345bc48b0>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:58:29.272627 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-aadb50e2-11e6-462a-a387-fb8918b2323d tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "DELETE /compute/v2.1/images/1a094668-2d91-4302-b3ee-8c4acd8e586b" status: 204 len: 0 microversion: 2.1 time: 1.276589 Aug 10 17:58:29.272627 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 851/1732] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:58:27 2022] DELETE /compute/v2.1/images/1a094668-2d91-4302-b3ee-8c4acd8e586b => generated 0 bytes in 1279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 10 17:58:29.279655 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-c873aa94-844c-42b2-8684-b04b472b5ef8 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] Calling method '.version_select at 0x7fb345e25dc0>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:58:30.608107 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-c873aa94-844c-42b2-8684-b04b472b5ef8 tempest-ListImageFiltersTestJSON-1950276764 tempest-ListImageFiltersTestJSON-1950276764-project] 10.222.0.50 "DELETE /compute/v2.1/images/15fe9892-b542-4067-b0b7-43732e4553b1" status: 204 len: 0 microversion: 2.1 time: 1.321343 Aug 10 17:58:30.608107 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 882/1733] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 17:58:29 2022] DELETE /compute/v2.1/images/15fe9892-b542-4067-b0b7-43732e4553b1 => generated 0 bytes in 1325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 17:58:35.106951 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_cell1:SELECT=21 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:58:35.380231 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-04bca170-af26-4b50-a7ac-e25df24efb27 tempest-ServerPasswordTestJSON-310808997 tempest-ServerPasswordTestJSON-310808997-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-1326438457", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "a6f86742-be07-42df-a622-fd553fbf6f52"}]}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:58:35.484392 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.network.neutron [None req-04bca170-af26-4b50-a7ac-e25df24efb27 tempest-ServerPasswordTestJSON-310808997 tempest-ServerPasswordTestJSON-310808997-project] validate_networks() for [('a6f86742-be07-42df-a622-fd553fbf6f52', None, None, None, None, None)] {{(pid=129410) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 17:58:35.772209 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [None req-04bca170-af26-4b50-a7ac-e25df24efb27 tempest-ServerPasswordTestJSON-310808997 tempest-ServerPasswordTestJSON-310808997-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-69b1ac04-de8d-41fa-b8ff-21a0db35089d) Aug 10 17:58:35.772209 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:58:35.772209 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:58:35.772209 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:58:35.772209 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:58:35.772209 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:58:35.772209 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:58:35.772209 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:58:35.772209 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:58:35.772209 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:58:35.772209 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 17:58:35.772209 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 17:58:35.772209 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 17:58:35.772209 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 17:58:35.772209 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 17:58:35.772209 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 17:58:35.772209 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 17:58:35.772209 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 17:58:35.772209 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 17:58:35.772209 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 17:58:35.772209 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 17:58:35.772209 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 17:58:35.772209 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 17:58:35.772209 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 17:58:35.772209 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 17:58:35.772209 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 17:58:35.772209 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 17:58:35.772209 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:58:35.772209 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:58:35.772209 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 17:58:35.772209 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 17:58:35.772209 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:58:35.772209 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:58:35.772209 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:58:35.772209 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:58:35.772209 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:58:35.772209 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:58:35.772209 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:58:35.772209 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:58:35.772209 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:58:35.772209 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:58:35.772209 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 17:58:35.772209 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 17:58:35.772209 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 17:58:35.772209 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 17:58:35.772209 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 17:58:35.772209 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 17:58:35.772209 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 17:58:35.772209 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 17:58:35.772209 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 17:58:35.772209 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 17:58:35.772209 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 17:58:35.772209 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 17:58:35.775695 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 17:58:35.775695 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 17:58:35.775695 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 17:58:35.775695 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 17:58:35.775695 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 17:58:35.775695 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 17:58:35.775695 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 17:58:35.775695 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 17:58:35.775695 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 17:58:35.775695 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 17:58:35.775695 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 17:58:35.775695 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 17:58:35.775695 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 17:58:35.775695 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 17:58:35.775695 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-69b1ac04-de8d-41fa-b8ff-21a0db35089d) Aug 10 17:58:35.775695 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:58:35.775695 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-04bca170-af26-4b50-a7ac-e25df24efb27 tempest-ServerPasswordTestJSON-310808997 tempest-ServerPasswordTestJSON-310808997-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:58:35.775695 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 17:58:35.776903 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-04bca170-af26-4b50-a7ac-e25df24efb27 tempest-ServerPasswordTestJSON-310808997 tempest-ServerPasswordTestJSON-310808997-project] Request method failure captured: Aug 10 17:58:35.776903 n-d-852296-2 devstack@n-api.service[129410]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 17:58:35.776903 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 17:58:35.776903 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 17:58:35.776903 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 17:58:35.776903 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 208 Aug 10 17:58:35.776903 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 17:58:35.776903 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 17:58:35.776903 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 17:58:35.776903 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 17:58:35.776903 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8_HKW9qg2uMl-aFAPFleRsruMtevCBJjrJXmAraim7jl5gSwyqo_f8iEeUqxRcyA-yiab33NUfeQMqOI9s2PFTz4TPmANxv8_wzP5i9JuziHpLqVwEtoKeXaRwTEJbekhgcp2RaC2Af0KdlWHDVhaqj49pEathu11BocvjJcf6FhycY Aug 10 17:58:35.776903 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 17:58:35.776903 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 17:58:35.776903 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 17:58:35.776903 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 17:58:35.776903 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 17:58:35.776903 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 17:58:35.776903 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: 2843b08bc70b410c8b8adad609aa3eda Aug 10 17:58:35.776903 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-ServerPasswordTestJSON-310808997 Aug 10 17:58:35.776903 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 17:58:35.776903 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 17:58:35.776903 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2843b08bc70b410c8b8adad609aa3eda"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/2843b08bc70b410c8b8adad609aa3eda"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2843b08bc70b410c8b8adad609aa3eda"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_2843b08bc70b410c8b8adad609aa3eda", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:58:35.776903 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-ServerPasswordTestJSON-310808997 Aug 10 17:58:35.776903 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: 2843b08bc70b410c8b8adad609aa3eda Aug 10 17:58:35.776903 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-ServerPasswordTestJSON-310808997 Aug 10 17:58:35.776903 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-ServerPasswordTestJSON-310808997-project Aug 10 17:58:35.776903 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 17:58:35.776903 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 17:58:35.776903 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: b84f087097534255a5812270f07b6300 Aug 10 17:58:35.776903 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-ServerPasswordTestJSON-310808997-project Aug 10 17:58:35.776903 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 17:58:35.776903 n-d-852296-2 devstack@n-api.service[129410]: {"server": {"name": "tempest-ServerPasswordTestJSON-server-1326438457", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "a6f86742-be07-42df-a622-fd553fbf6f52"}]}} Aug 10 17:58:35.776903 n-d-852296-2 devstack@n-api.service[129410]: method: > Aug 10 17:58:35.776903 n-d-852296-2 devstack@n-api.service[129410]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:58:35.776903 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 17:58:35.776903 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'body': {'server': {'name': 'tempest-ServerPasswordTestJSON-server-1326438457', 'imageRef': 'a735ff26-463a-4ffe-a981-ab9d9baa494f', 'flavorRef': '452', 'networks': [{'uuid': 'a6f86742-be07-42df-a622-fd553fbf6f52'}]}}} Aug 10 17:58:35.776903 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:58:35.776903 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:58:35.776903 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:58:35.776903 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:58:35.776903 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:58:35.776903 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:58:35.776903 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:58:35.776903 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:58:35.776903 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:58:35.776903 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:58:35.776903 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 17:58:35.776903 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 17:58:35.776903 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 17:58:35.776903 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 17:58:35.776903 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 17:58:35.776903 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 17:58:35.776903 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 17:58:35.776903 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 17:58:35.776903 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 17:58:35.776903 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 17:58:35.776903 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 17:58:35.776903 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 17:58:35.776903 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 17:58:35.776903 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 17:58:35.776903 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 17:58:35.781661 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 17:58:35.781661 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 17:58:35.781661 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:58:35.781661 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:58:35.781661 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 17:58:35.781661 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 17:58:35.781661 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:58:35.781661 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:58:35.781661 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:58:35.781661 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:58:35.781661 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:58:35.781661 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:58:35.781661 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:58:35.781661 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:58:35.781661 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:58:35.781661 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:58:35.781661 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 17:58:35.781661 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 17:58:35.781661 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 17:58:35.781661 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 17:58:35.781661 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 17:58:35.781661 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 17:58:35.781661 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 17:58:35.781661 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 17:58:35.781661 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 17:58:35.781661 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 17:58:35.781661 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 17:58:35.781661 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 17:58:35.781661 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 17:58:35.781661 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 17:58:35.781661 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 17:58:35.781661 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 17:58:35.781661 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 17:58:35.781661 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 17:58:35.781661 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 17:58:35.781661 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 17:58:35.781661 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 17:58:35.781661 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 17:58:35.781661 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 17:58:35.781661 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 17:58:35.781661 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 17:58:35.781661 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 17:58:35.781661 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-69b1ac04-de8d-41fa-b8ff-21a0db35089d) Aug 10 17:58:35.781661 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:58:35.781661 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:58:35.781661 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:58:35.781661 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:58:35.781661 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:58:35.781661 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:58:35.781661 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:58:35.781661 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:58:35.781661 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 10 17:58:35.781661 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 10 17:58:35.788463 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:58:35.788463 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:58:35.788463 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:58:35.788463 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:58:35.788463 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:58:35.788463 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:58:35.788463 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:58:35.788463 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:58:35.788463 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:58:35.788463 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:58:35.788463 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:58:35.788463 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:58:35.788463 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:58:35.788463 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-04bca170-af26-4b50-a7ac-e25df24efb27 tempest-ServerPasswordTestJSON-310808997 tempest-ServerPasswordTestJSON-310808997-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:58:35.788463 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:58:35.788463 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-04bca170-af26-4b50-a7ac-e25df24efb27 tempest-ServerPasswordTestJSON-310808997 tempest-ServerPasswordTestJSON-310808997-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.149587 Aug 10 17:58:35.788463 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 852/1734] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 17:58:34 2022] POST /compute/v2.1/servers => generated 214 bytes in 1156 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 10 17:58:37.597519 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_api:SELECT=20 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:58:37.598145 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_cell1:SELECT=22 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:58:37.862702 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-53f122cf-861f-4fd8-bd79-5482d7ab6459 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-1973885615", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": "none"}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:58:37.959889 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.virt.hardware [None req-53f122cf-861f-4fd8-bd79-5482d7ab6459 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Flavor limits 0:0:0 {{(pid=129409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 17:58:37.960586 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.virt.hardware [None req-53f122cf-861f-4fd8-bd79-5482d7ab6459 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Image limits 0:0:0 {{(pid=129409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 17:58:37.961293 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.virt.hardware [None req-53f122cf-861f-4fd8-bd79-5482d7ab6459 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Flavor pref 0:0:0 {{(pid=129409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 17:58:37.961868 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.virt.hardware [None req-53f122cf-861f-4fd8-bd79-5482d7ab6459 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Image pref 0:0:0 {{(pid=129409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 17:58:37.962445 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.virt.hardware [None req-53f122cf-861f-4fd8-bd79-5482d7ab6459 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 17:58:37.972972 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-53f122cf-861f-4fd8-bd79-5482d7ab6459 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:58:37.973771 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-53f122cf-861f-4fd8-bd79-5482d7ab6459 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:58:37.974370 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-53f122cf-861f-4fd8-bd79-5482d7ab6459 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:58:37.975570 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-53f122cf-861f-4fd8-bd79-5482d7ab6459 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:58:37.976203 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-53f122cf-861f-4fd8-bd79-5482d7ab6459 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:58:37.976712 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-53f122cf-861f-4fd8-bd79-5482d7ab6459 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:58:37.999240 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-53f122cf-861f-4fd8-bd79-5482d7ab6459 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Getting quotas for project da4f95a4b9a4417da0b00d881dee9481. Resources: {'instances', 'ram', 'cores'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:58:38.005100 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-53f122cf-861f-4fd8-bd79-5482d7ab6459 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Getting quotas for user a99171d2ccde4a108b820c7ce2aa3ee5 and project da4f95a4b9a4417da0b00d881dee9481. Resources: {'instances', 'ram', 'cores'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:58:38.019170 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-53f122cf-861f-4fd8-bd79-5482d7ab6459 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Going to run 1 instances... {{(pid=129409) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 17:58:38.021507 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-53f122cf-861f-4fd8-bd79-5482d7ab6459 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] [instance: 753bb23d-ad3b-4fc0-be8f-fed753940dde] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a735ff26-463a-4ffe-a981-ab9d9baa494f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 17:58:38.340389 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-53f122cf-861f-4fd8-bd79-5482d7ab6459 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.748251 Aug 10 17:58:38.345544 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 883/1735] 10.222.0.50 () {62 vars in 1188 bytes} [Wed Aug 10 17:58:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 754 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 10 17:58:38.355976 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-1a24b1cb-bce8-480d-8efc-e14a61a6176a tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:58:38.356895 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-1a24b1cb-bce8-480d-8efc-e14a61a6176a tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] [instance: 753bb23d-ad3b-4fc0-be8f-fed753940dde] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:58:38.498953 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-1a24b1cb-bce8-480d-8efc-e14a61a6176a tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99171d2ccde4a108b820c7ce2aa3ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4f95a4b9a4417da0b00d881dee9481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:58:38.513611 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-1a24b1cb-bce8-480d-8efc-e14a61a6176a tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a99171d2ccde4a108b820c7ce2aa3ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4f95a4b9a4417da0b00d881dee9481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:58:38.513611 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-1a24b1cb-bce8-480d-8efc-e14a61a6176a tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a99171d2ccde4a108b820c7ce2aa3ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4f95a4b9a4417da0b00d881dee9481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:58:38.515261 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-1a24b1cb-bce8-480d-8efc-e14a61a6176a tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] 10.222.0.50 "GET /compute/v2.1/servers/753bb23d-ad3b-4fc0-be8f-fed753940dde" status: 200 len: 1278 microversion: 2.54 time: 0.164421 Aug 10 17:58:38.515821 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 853/1736] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:58:38 2022] GET /compute/v2.1/servers/753bb23d-ad3b-4fc0-be8f-fed753940dde => generated 1278 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:58:39.540836 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-97df55fe-b1cc-4139-bb38-c76f1eaaaa70 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:58:39.542184 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-97df55fe-b1cc-4139-bb38-c76f1eaaaa70 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] [instance: 753bb23d-ad3b-4fc0-be8f-fed753940dde] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:58:39.776231 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-93ea0d8f-7b96-4a41-a27e-8898f8eae389 tempest-KeyPairsV22TestJSON-61843180 tempest-KeyPairsV22TestJSON-61843180-project] Action: 'create', calling method: .version_select at 0x7fb345ebeee0>, body: {"keypair": {"name": "tempest-keypair-1334842903", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC7xzhHSjkZeJqdaZnjBYtjmxSiJBGIFmbZhiRUkdrsOH+UYo54aJv2hLtKCjEIguW0cqEvLlXHSrXHEbCwEcQ/PGj2h61k9PsgoXLVmaNQIHAML1LzeNAldYRKoDty5BA=="}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:58:39.851433 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-93ea0d8f-7b96-4a41-a27e-8898f8eae389 tempest-KeyPairsV22TestJSON-61843180 tempest-KeyPairsV22TestJSON-61843180-project] Getting quotas for project 370437d23cdf45aeac33f75e5ab2895b. Resources: {'key_pairs'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:58:39.875755 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-93ea0d8f-7b96-4a41-a27e-8898f8eae389 tempest-KeyPairsV22TestJSON-61843180 tempest-KeyPairsV22TestJSON-61843180-project] Getting quotas for user 9f1707f3b4d14884b91ed555d0fbe4dd and project 370437d23cdf45aeac33f75e5ab2895b. Resources: {'key_pairs'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:58:39.880893 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-97df55fe-b1cc-4139-bb38-c76f1eaaaa70 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99171d2ccde4a108b820c7ce2aa3ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4f95a4b9a4417da0b00d881dee9481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:58:39.897703 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-97df55fe-b1cc-4139-bb38-c76f1eaaaa70 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a99171d2ccde4a108b820c7ce2aa3ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4f95a4b9a4417da0b00d881dee9481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:58:39.904034 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-97df55fe-b1cc-4139-bb38-c76f1eaaaa70 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a99171d2ccde4a108b820c7ce2aa3ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4f95a4b9a4417da0b00d881dee9481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:58:39.908440 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-97df55fe-b1cc-4139-bb38-c76f1eaaaa70 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] 10.222.0.50 "GET /compute/v2.1/servers/753bb23d-ad3b-4fc0-be8f-fed753940dde" status: 200 len: 1278 microversion: 2.54 time: 0.373965 Aug 10 17:58:39.913836 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 854/1737] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:58:39 2022] GET /compute/v2.1/servers/753bb23d-ad3b-4fc0-be8f-fed753940dde => generated 1278 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:58:40.080649 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-93ea0d8f-7b96-4a41-a27e-8898f8eae389 tempest-KeyPairsV22TestJSON-61843180 tempest-KeyPairsV22TestJSON-61843180-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.588882 Aug 10 17:58:40.081897 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 884/1738] 10.222.0.50 () {62 vars in 1199 bytes} [Wed Aug 10 17:58:39 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 591 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 10 17:58:40.096377 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-bea0acf9-acef-4c78-b775-5e002797e720 tempest-KeyPairsV22TestJSON-61843180 tempest-KeyPairsV22TestJSON-61843180-project] Calling method '.version_select at 0x7fb345cfac10>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:58:40.131169 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-bea0acf9-acef-4c78-b775-5e002797e720 tempest-KeyPairsV22TestJSON-61843180 tempest-KeyPairsV22TestJSON-61843180-project] 10.222.0.50 "GET /compute/v2.1/os-keypairs/tempest-keypair-1334842903" status: 200 len: 513 microversion: 2.2 time: 0.042489 Aug 10 17:58:40.140465 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 855/1739] 10.222.0.50 () {60 vars in 1258 bytes} [Wed Aug 10 17:58:40 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1334842903 => generated 513 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:58:40.148229 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-60252560-374b-48f4-9e05-6319ec7937d5 tempest-KeyPairsV22TestJSON-61843180 tempest-KeyPairsV22TestJSON-61843180-project] Calling method '.version_select at 0x7fb346015ca0>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:58:40.315618 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-60252560-374b-48f4-9e05-6319ec7937d5 tempest-KeyPairsV22TestJSON-61843180 tempest-KeyPairsV22TestJSON-61843180-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1334842903" status: 204 len: 0 microversion: 2.2 time: 0.173647 Aug 10 17:58:40.316582 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 885/1740] 10.222.0.50 () {60 vars in 1261 bytes} [Wed Aug 10 17:58:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1334842903 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 10 17:58:40.334973 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-a6a8e3b6-1bd8-47e1-8979-147e0a35c24d tempest-KeyPairsV22TestJSON-61843180 tempest-KeyPairsV22TestJSON-61843180-project] Action: 'create', calling method: .version_select at 0x7fb345cfa8b0>, body: {"keypair": {"name": "tempest-keypair-1279592699", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLf0uUjNkQNzDOUyZjc76yl0V2ybfx9BBoP8Gcl1fvvi9BysDISTppSpbPsqsSqur1u/yaaNvvfAbfV6uWGpIxpQZcypinB1WkF6NO0WRRfTcXjW1P/qbCr/e6EsPPsqRQ=="}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:58:40.378637 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.quota [None req-a6a8e3b6-1bd8-47e1-8979-147e0a35c24d tempest-KeyPairsV22TestJSON-61843180 tempest-KeyPairsV22TestJSON-61843180-project] Getting quotas for project 370437d23cdf45aeac33f75e5ab2895b. Resources: {'key_pairs'} {{(pid=129410) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:58:40.394630 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.quota [None req-a6a8e3b6-1bd8-47e1-8979-147e0a35c24d tempest-KeyPairsV22TestJSON-61843180 tempest-KeyPairsV22TestJSON-61843180-project] Getting quotas for user 9f1707f3b4d14884b91ed555d0fbe4dd and project 370437d23cdf45aeac33f75e5ab2895b. Resources: {'key_pairs'} {{(pid=129410) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:58:40.606763 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-a6a8e3b6-1bd8-47e1-8979-147e0a35c24d tempest-KeyPairsV22TestJSON-61843180 tempest-KeyPairsV22TestJSON-61843180-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.275455 Aug 10 17:58:40.609137 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 856/1741] 10.222.0.50 () {62 vars in 1199 bytes} [Wed Aug 10 17:58:40 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 279 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 10 17:58:40.623746 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-96de4286-60dd-40f0-be2e-ed0d69db43de tempest-KeyPairsV22TestJSON-61843180 tempest-KeyPairsV22TestJSON-61843180-project] Calling method '.version_select at 0x7fb345ebe3a0>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:58:40.813253 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-96de4286-60dd-40f0-be2e-ed0d69db43de tempest-KeyPairsV22TestJSON-61843180 tempest-KeyPairsV22TestJSON-61843180-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1279592699" status: 204 len: 0 microversion: 2.2 time: 0.197633 Aug 10 17:58:40.814625 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 886/1742] 10.222.0.50 () {60 vars in 1261 bytes} [Wed Aug 10 17:58:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1279592699 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 10 17:58:40.835196 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-28acf447-86b8-4453-a225-04ade17a066e tempest-KeyPairsV22TestJSON-61843180 tempest-KeyPairsV22TestJSON-61843180-project] Action: 'create', calling method: .version_select at 0x7fb345c73040>, body: {"keypair": {"name": "tempest-keypair-1685876140", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:58:40.881704 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.quota [None req-28acf447-86b8-4453-a225-04ade17a066e tempest-KeyPairsV22TestJSON-61843180 tempest-KeyPairsV22TestJSON-61843180-project] Getting quotas for project 370437d23cdf45aeac33f75e5ab2895b. Resources: {'key_pairs'} {{(pid=129410) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:58:40.938414 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-8fdd223e-2225-4c0e-85fb-7e2815ce13d9 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:58:40.939307 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-8fdd223e-2225-4c0e-85fb-7e2815ce13d9 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] [instance: 753bb23d-ad3b-4fc0-be8f-fed753940dde] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:58:40.955405 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.quota [None req-28acf447-86b8-4453-a225-04ade17a066e tempest-KeyPairsV22TestJSON-61843180 tempest-KeyPairsV22TestJSON-61843180-project] Getting quotas for user 9f1707f3b4d14884b91ed555d0fbe4dd and project 370437d23cdf45aeac33f75e5ab2895b. Resources: {'key_pairs'} {{(pid=129410) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:58:40.966324 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-8fdd223e-2225-4c0e-85fb-7e2815ce13d9 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:58:40.966324 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-8fdd223e-2225-4c0e-85fb-7e2815ce13d9 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:58:40.966324 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-8fdd223e-2225-4c0e-85fb-7e2815ce13d9 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:58:40.973445 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-8fdd223e-2225-4c0e-85fb-7e2815ce13d9 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:58:40.974041 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-8fdd223e-2225-4c0e-85fb-7e2815ce13d9 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:58:40.974494 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-8fdd223e-2225-4c0e-85fb-7e2815ce13d9 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:58:41.170964 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-28acf447-86b8-4453-a225-04ade17a066e tempest-KeyPairsV22TestJSON-61843180 tempest-KeyPairsV22TestJSON-61843180-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 201 len: 589 microversion: 2.2 time: 0.339901 Aug 10 17:58:41.171951 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 857/1743] 10.222.0.50 () {62 vars in 1199 bytes} [Wed Aug 10 17:58:40 2022] POST /compute/v2.1/os-keypairs => generated 589 bytes in 341 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 10 17:58:41.181469 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-8fdd223e-2225-4c0e-85fb-7e2815ce13d9 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99171d2ccde4a108b820c7ce2aa3ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4f95a4b9a4417da0b00d881dee9481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:58:41.196236 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-6ccc1cdf-72c0-4330-a65d-289c115774ff tempest-KeyPairsV22TestJSON-61843180 tempest-KeyPairsV22TestJSON-61843180-project] Calling method '.version_select at 0x7fb345dbf5e0>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:58:41.221346 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-8fdd223e-2225-4c0e-85fb-7e2815ce13d9 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a99171d2ccde4a108b820c7ce2aa3ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4f95a4b9a4417da0b00d881dee9481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:58:41.221346 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-8fdd223e-2225-4c0e-85fb-7e2815ce13d9 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a99171d2ccde4a108b820c7ce2aa3ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4f95a4b9a4417da0b00d881dee9481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:58:41.236838 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-8fdd223e-2225-4c0e-85fb-7e2815ce13d9 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] 10.222.0.50 "GET /compute/v2.1/servers/753bb23d-ad3b-4fc0-be8f-fed753940dde" status: 200 len: 1282 microversion: 2.54 time: 0.304247 Aug 10 17:58:41.244285 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 887/1744] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:58:40 2022] GET /compute/v2.1/servers/753bb23d-ad3b-4fc0-be8f-fed753940dde => generated 1282 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:58:41.360369 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-6ccc1cdf-72c0-4330-a65d-289c115774ff tempest-KeyPairsV22TestJSON-61843180 tempest-KeyPairsV22TestJSON-61843180-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1685876140" status: 204 len: 0 microversion: 2.2 time: 0.172208 Aug 10 17:58:41.361122 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 858/1745] 10.222.0.50 () {60 vars in 1261 bytes} [Wed Aug 10 17:58:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1685876140 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 10 17:58:41.377501 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-d1f12e1b-4a14-4072-aaec-742594dfa86a tempest-KeyPairsV22TestJSON-61843180 tempest-KeyPairsV22TestJSON-61843180-project] Action: 'create', calling method: .version_select at 0x7fb345d68040>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-272514158", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKflQ5Wve1cunsBpl/Ec6fR+qWmiyzV8EGTtTPyUfcpFG1ZIjQuq3l76kA+joWSFTfIETGguAZR7NIzoLEi/rHWAv6Gff9xpVLzCNSimgeZUDoz0iRCQNQLAgCWtu/jDoQ=="}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:58:41.417804 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-d1f12e1b-4a14-4072-aaec-742594dfa86a tempest-KeyPairsV22TestJSON-61843180 tempest-KeyPairsV22TestJSON-61843180-project] Getting quotas for project 370437d23cdf45aeac33f75e5ab2895b. Resources: {'key_pairs'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:58:41.427012 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-d1f12e1b-4a14-4072-aaec-742594dfa86a tempest-KeyPairsV22TestJSON-61843180 tempest-KeyPairsV22TestJSON-61843180-project] Getting quotas for user 9f1707f3b4d14884b91ed555d0fbe4dd and project 370437d23cdf45aeac33f75e5ab2895b. Resources: {'key_pairs'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:58:41.588621 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-d1f12e1b-4a14-4072-aaec-742594dfa86a tempest-KeyPairsV22TestJSON-61843180 tempest-KeyPairsV22TestJSON-61843180-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.215454 Aug 10 17:58:41.590494 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 888/1746] 10.222.0.50 () {62 vars in 1199 bytes} [Wed Aug 10 17:58:41 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 218 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Aug 10 17:58:41.606357 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-1bcf45f6-769a-4fe2-98df-00b97cad3074 tempest-KeyPairsV22TestJSON-61843180 tempest-KeyPairsV22TestJSON-61843180-project] Action: 'create', calling method: .version_select at 0x7fb345cfa160>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1821518369", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN1EggWnPChelybnlW+EbhQ0fVd9xbCCBDOBrtZmZ6zq/VpGmTRlBZbMgL3A270DRXo1uCvDVk7II6ZEId8F4upuPDvMYUM0rIhhILkqBAF6f8yEFPNpoWSoU/Ir9uEu/A=="}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:58:41.680781 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.quota [None req-1bcf45f6-769a-4fe2-98df-00b97cad3074 tempest-KeyPairsV22TestJSON-61843180 tempest-KeyPairsV22TestJSON-61843180-project] Getting quotas for project 370437d23cdf45aeac33f75e5ab2895b. Resources: {'key_pairs'} {{(pid=129410) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:58:41.698480 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.quota [None req-1bcf45f6-769a-4fe2-98df-00b97cad3074 tempest-KeyPairsV22TestJSON-61843180 tempest-KeyPairsV22TestJSON-61843180-project] Getting quotas for user 9f1707f3b4d14884b91ed555d0fbe4dd and project 370437d23cdf45aeac33f75e5ab2895b. Resources: {'key_pairs'} {{(pid=129410) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:58:41.927400 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-1bcf45f6-769a-4fe2-98df-00b97cad3074 tempest-KeyPairsV22TestJSON-61843180 tempest-KeyPairsV22TestJSON-61843180-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.326283 Aug 10 17:58:41.928441 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 859/1747] 10.222.0.50 () {62 vars in 1199 bytes} [Wed Aug 10 17:58:41 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 329 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Aug 10 17:58:41.956148 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-2c3c78bb-4526-4e92-b157-50af195805f5 tempest-KeyPairsV22TestJSON-61843180 tempest-KeyPairsV22TestJSON-61843180-project] Action: 'create', calling method: .version_select at 0x7fb345ebeaf0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-2040208452", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDIjCE+KHJcK3rPLGwLA4GWG+avRt9Uy424PHw8ihdMrpAjpL77DgKW/u60AyA33Fyv7jRqcco9U5fP+p6Pm5iGquKuZ6smqt9Oo+7rQc7iZ2HO9uHK6uo3rLm74x1j4QA=="}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:58:42.001731 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-2c3c78bb-4526-4e92-b157-50af195805f5 tempest-KeyPairsV22TestJSON-61843180 tempest-KeyPairsV22TestJSON-61843180-project] Getting quotas for project 370437d23cdf45aeac33f75e5ab2895b. Resources: {'key_pairs'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:58:42.016993 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-2c3c78bb-4526-4e92-b157-50af195805f5 tempest-KeyPairsV22TestJSON-61843180 tempest-KeyPairsV22TestJSON-61843180-project] Getting quotas for user 9f1707f3b4d14884b91ed555d0fbe4dd and project 370437d23cdf45aeac33f75e5ab2895b. Resources: {'key_pairs'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:58:42.138502 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-2c3c78bb-4526-4e92-b157-50af195805f5 tempest-KeyPairsV22TestJSON-61843180 tempest-KeyPairsV22TestJSON-61843180-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.194823 Aug 10 17:58:42.141498 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 889/1748] 10.222.0.50 () {62 vars in 1199 bytes} [Wed Aug 10 17:58:41 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 199 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 10 17:58:42.156940 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-5d3a592b-21bf-4091-9369-b7f1b8bf08af tempest-KeyPairsV22TestJSON-61843180 tempest-KeyPairsV22TestJSON-61843180-project] Calling method '.version_select at 0x7fb345d77dc0>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:58:42.185075 n-d-852296-2 devstack@n-api.service[129410]: WARNING oslo_db.sqlalchemy.utils [None req-5d3a592b-21bf-4091-9369-b7f1b8bf08af tempest-KeyPairsV22TestJSON-61843180 tempest-KeyPairsV22TestJSON-61843180-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 10 17:58:42.195347 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-5d3a592b-21bf-4091-9369-b7f1b8bf08af tempest-KeyPairsV22TestJSON-61843180 tempest-KeyPairsV22TestJSON-61843180-project] 10.222.0.50 "GET /compute/v2.1/os-keypairs" status: 200 len: 1141 microversion: 2.2 time: 0.046036 Aug 10 17:58:42.196947 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 860/1749] 10.222.0.50 () {60 vars in 1177 bytes} [Wed Aug 10 17:58:42 2022] GET /compute/v2.1/os-keypairs => generated 1141 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:58:42.209944 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-1c4ea29f-60f8-48b2-a0fd-f9efdbd12e19 tempest-KeyPairsV22TestJSON-61843180 tempest-KeyPairsV22TestJSON-61843180-project] Calling method '.version_select at 0x7fb345f1b430>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:58:42.297620 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-43ea4458-73a1-47aa-aa75-ea10583d6b41 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:58:42.298530 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-43ea4458-73a1-47aa-aa75-ea10583d6b41 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] [instance: 753bb23d-ad3b-4fc0-be8f-fed753940dde] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:58:42.312050 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-43ea4458-73a1-47aa-aa75-ea10583d6b41 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:58:42.315711 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-43ea4458-73a1-47aa-aa75-ea10583d6b41 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:58:42.315711 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-43ea4458-73a1-47aa-aa75-ea10583d6b41 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:58:42.315711 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-43ea4458-73a1-47aa-aa75-ea10583d6b41 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:58:42.316580 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-43ea4458-73a1-47aa-aa75-ea10583d6b41 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:58:42.317346 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-43ea4458-73a1-47aa-aa75-ea10583d6b41 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:58:42.336897 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-1c4ea29f-60f8-48b2-a0fd-f9efdbd12e19 tempest-KeyPairsV22TestJSON-61843180 tempest-KeyPairsV22TestJSON-61843180-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-2040208452" status: 204 len: 0 microversion: 2.2 time: 0.132180 Aug 10 17:58:42.339641 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 890/1750] 10.222.0.50 () {60 vars in 1321 bytes} [Wed Aug 10 17:58:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-2040208452 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 17:58:42.354366 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-4871e6e0-8f53-403e-b6b5-04310b3c5d6d tempest-KeyPairsV22TestJSON-61843180 tempest-KeyPairsV22TestJSON-61843180-project] Calling method '.version_select at 0x7fb345d9bd30>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:58:42.482680 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-4871e6e0-8f53-403e-b6b5-04310b3c5d6d tempest-KeyPairsV22TestJSON-61843180 tempest-KeyPairsV22TestJSON-61843180-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1821518369" status: 204 len: 0 microversion: 2.2 time: 0.137039 Aug 10 17:58:42.483988 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 891/1751] 10.222.0.50 () {60 vars in 1321 bytes} [Wed Aug 10 17:58:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1821518369 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 10 17:58:42.493625 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-782bef04-da7b-435f-b6f7-7baa49a76cc2 tempest-KeyPairsV22TestJSON-61843180 tempest-KeyPairsV22TestJSON-61843180-project] Calling method '.version_select at 0x7fb345e25430>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:58:42.606348 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-782bef04-da7b-435f-b6f7-7baa49a76cc2 tempest-KeyPairsV22TestJSON-61843180 tempest-KeyPairsV22TestJSON-61843180-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-272514158" status: 204 len: 0 microversion: 2.2 time: 0.117750 Aug 10 17:58:42.606947 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 892/1752] 10.222.0.50 () {60 vars in 1318 bytes} [Wed Aug 10 17:58:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-272514158 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 10 17:58:42.616089 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-43ea4458-73a1-47aa-aa75-ea10583d6b41 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99171d2ccde4a108b820c7ce2aa3ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4f95a4b9a4417da0b00d881dee9481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:58:42.622047 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-ab4033d8-5468-4901-8ca8-a865e99e5a1f tempest-KeyPairsV22TestJSON-61843180 tempest-KeyPairsV22TestJSON-61843180-project] Action: 'create', calling method: .version_select at 0x7fb345d56700>, body: {"keypair": {"name": "tempest-keypair-157219825", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMnKhuPGXYlTTqleXCRzq5a0knXr+IAGxl20pw/8yUXKI0U1mROiU6ayUsEJCnbAC6E/w3SPwtcfU24P6NgLvnLR5/W2jKllkPR5NhMS3dBGx57tO2U4r8ifszgQdMQoxA=="}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:58:42.629753 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-43ea4458-73a1-47aa-aa75-ea10583d6b41 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a99171d2ccde4a108b820c7ce2aa3ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4f95a4b9a4417da0b00d881dee9481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:58:42.632054 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-43ea4458-73a1-47aa-aa75-ea10583d6b41 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a99171d2ccde4a108b820c7ce2aa3ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4f95a4b9a4417da0b00d881dee9481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:58:42.638980 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-43ea4458-73a1-47aa-aa75-ea10583d6b41 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] 10.222.0.50 "GET /compute/v2.1/servers/753bb23d-ad3b-4fc0-be8f-fed753940dde" status: 200 len: 1330 microversion: 2.54 time: 0.345491 Aug 10 17:58:42.648525 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 861/1753] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:58:42 2022] GET /compute/v2.1/servers/753bb23d-ad3b-4fc0-be8f-fed753940dde => generated 1330 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:58:42.690497 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-ab4033d8-5468-4901-8ca8-a865e99e5a1f tempest-KeyPairsV22TestJSON-61843180 tempest-KeyPairsV22TestJSON-61843180-project] Getting quotas for project 370437d23cdf45aeac33f75e5ab2895b. Resources: {'key_pairs'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:58:42.730223 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-ab4033d8-5468-4901-8ca8-a865e99e5a1f tempest-KeyPairsV22TestJSON-61843180 tempest-KeyPairsV22TestJSON-61843180-project] Getting quotas for user 9f1707f3b4d14884b91ed555d0fbe4dd and project 370437d23cdf45aeac33f75e5ab2895b. Resources: {'key_pairs'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:58:43.022917 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-ab4033d8-5468-4901-8ca8-a865e99e5a1f tempest-KeyPairsV22TestJSON-61843180 tempest-KeyPairsV22TestJSON-61843180-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.405994 Aug 10 17:58:43.030772 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 893/1754] 10.222.0.50 () {62 vars in 1199 bytes} [Wed Aug 10 17:58:42 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 408 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Aug 10 17:58:43.036647 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-091632b0-a755-4152-b672-aae46461a406 tempest-KeyPairsV22TestJSON-61843180 tempest-KeyPairsV22TestJSON-61843180-project] Calling method '.version_select at 0x7fb345dbf310>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:58:43.059687 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-091632b0-a755-4152-b672-aae46461a406 tempest-KeyPairsV22TestJSON-61843180 tempest-KeyPairsV22TestJSON-61843180-project] 10.222.0.50 "GET /compute/v2.1/os-keypairs/tempest-keypair-157219825" status: 200 len: 512 microversion: 2.2 time: 0.028341 Aug 10 17:58:43.073919 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 862/1755] 10.222.0.50 () {60 vars in 1255 bytes} [Wed Aug 10 17:58:43 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-157219825 => generated 512 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:58:43.080655 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-d5300b63-18dd-48d3-8ed0-20fa2542fc3b tempest-KeyPairsV22TestJSON-61843180 tempest-KeyPairsV22TestJSON-61843180-project] Calling method '.version_select at 0x7fb345d68ee0>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:58:43.091018 n-d-852296-2 devstack@n-api.service[129409]: WARNING oslo_db.sqlalchemy.utils [None req-d5300b63-18dd-48d3-8ed0-20fa2542fc3b tempest-KeyPairsV22TestJSON-61843180 tempest-KeyPairsV22TestJSON-61843180-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 10 17:58:43.124393 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-d5300b63-18dd-48d3-8ed0-20fa2542fc3b tempest-KeyPairsV22TestJSON-61843180 tempest-KeyPairsV22TestJSON-61843180-project] 10.222.0.50 "GET /compute/v2.1/os-keypairs" status: 200 len: 369 microversion: 2.2 time: 0.050478 Aug 10 17:58:43.128792 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 894/1756] 10.222.0.50 () {60 vars in 1177 bytes} [Wed Aug 10 17:58:43 2022] GET /compute/v2.1/os-keypairs => generated 369 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:58:43.141301 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-08fbd6d5-2821-4c63-bf7a-e4a369d262c0 tempest-KeyPairsV22TestJSON-61843180 tempest-KeyPairsV22TestJSON-61843180-project] Calling method '.version_select at 0x7fb345d9d820>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:58:43.325992 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-08fbd6d5-2821-4c63-bf7a-e4a369d262c0 tempest-KeyPairsV22TestJSON-61843180 tempest-KeyPairsV22TestJSON-61843180-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-157219825" status: 204 len: 0 microversion: 2.2 time: 0.191496 Aug 10 17:58:43.326932 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 863/1757] 10.222.0.50 () {60 vars in 1258 bytes} [Wed Aug 10 17:58:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-157219825 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 17:58:43.357681 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-b269b684-f966-4922-8790-7b39fa576a52 tempest-KeyPairsV22TestJSON-61843180 tempest-KeyPairsV22TestJSON-61843180-project] Action: 'create', calling method: .version_select at 0x7fb345d9b1f0>, body: {"keypair": {"name": "tempest-keypair-201696352", "type": "x509"}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:58:43.446827 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-b269b684-f966-4922-8790-7b39fa576a52 tempest-KeyPairsV22TestJSON-61843180 tempest-KeyPairsV22TestJSON-61843180-project] Getting quotas for project 370437d23cdf45aeac33f75e5ab2895b. Resources: {'key_pairs'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:58:43.478457 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-b269b684-f966-4922-8790-7b39fa576a52 tempest-KeyPairsV22TestJSON-61843180 tempest-KeyPairsV22TestJSON-61843180-project] Getting quotas for user 9f1707f3b4d14884b91ed555d0fbe4dd and project 370437d23cdf45aeac33f75e5ab2895b. Resources: {'key_pairs'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:58:43.554156 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.processutils [None req-b269b684-f966-4922-8790-7b39fa576a52 tempest-KeyPairsV22TestJSON-61843180 tempest-KeyPairsV22TestJSON-61843180-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmpntisdp5x/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpntisdp5x/temp.key -subj /CN=9f1707f3b4d14884b91ed555d0fbe4dd -extensions v3_req_client {{(pid=129409) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Aug 10 17:58:43.676952 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-2d9f638a-9aa9-44c0-b700-ce786737b5de tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:58:43.679014 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-2d9f638a-9aa9-44c0-b700-ce786737b5de tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] [instance: 753bb23d-ad3b-4fc0-be8f-fed753940dde] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:58:43.721467 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2d9f638a-9aa9-44c0-b700-ce786737b5de tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:58:43.722873 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2d9f638a-9aa9-44c0-b700-ce786737b5de tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:58:43.725051 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2d9f638a-9aa9-44c0-b700-ce786737b5de tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:58:43.725051 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2d9f638a-9aa9-44c0-b700-ce786737b5de tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:58:43.725051 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2d9f638a-9aa9-44c0-b700-ce786737b5de tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:58:43.727705 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2d9f638a-9aa9-44c0-b700-ce786737b5de tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:58:43.873979 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-2d9f638a-9aa9-44c0-b700-ce786737b5de tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99171d2ccde4a108b820c7ce2aa3ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4f95a4b9a4417da0b00d881dee9481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:58:43.885813 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-2d9f638a-9aa9-44c0-b700-ce786737b5de tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a99171d2ccde4a108b820c7ce2aa3ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4f95a4b9a4417da0b00d881dee9481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:58:43.891980 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-2d9f638a-9aa9-44c0-b700-ce786737b5de tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a99171d2ccde4a108b820c7ce2aa3ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4f95a4b9a4417da0b00d881dee9481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:58:43.894895 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-2d9f638a-9aa9-44c0-b700-ce786737b5de tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] 10.222.0.50 "GET /compute/v2.1/servers/753bb23d-ad3b-4fc0-be8f-fed753940dde" status: 200 len: 1336 microversion: 2.54 time: 0.222923 Aug 10 17:58:43.896238 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 864/1758] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:58:43 2022] GET /compute/v2.1/servers/753bb23d-ad3b-4fc0-be8f-fed753940dde => generated 1336 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 17:58:44.121025 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.processutils [None req-b269b684-f966-4922-8790-7b39fa576a52 tempest-KeyPairsV22TestJSON-61843180 tempest-KeyPairsV22TestJSON-61843180-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmpntisdp5x/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpntisdp5x/temp.key -subj /CN=9f1707f3b4d14884b91ed555d0fbe4dd -extensions v3_req_client" returned: 0 in 0.566s {{(pid=129409) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Aug 10 17:58:44.123222 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.processutils [None req-b269b684-f966-4922-8790-7b39fa576a52 tempest-KeyPairsV22TestJSON-61843180 tempest-KeyPairsV22TestJSON-61843180-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmpntisdp5x/temp.key -password pass: {{(pid=129409) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Aug 10 17:58:44.209501 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.processutils [None req-b269b684-f966-4922-8790-7b39fa576a52 tempest-KeyPairsV22TestJSON-61843180 tempest-KeyPairsV22TestJSON-61843180-project] CMD "openssl pkcs12 -export -inkey /tmp/tmpntisdp5x/temp.key -password pass:" returned: 0 in 0.085s {{(pid=129409) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Aug 10 17:58:44.266955 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=8,nova_api:DELETE=5 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:58:44.412889 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-b269b684-f966-4922-8790-7b39fa576a52 tempest-KeyPairsV22TestJSON-61843180 tempest-KeyPairsV22TestJSON-61843180-project] Getting quotas for project 370437d23cdf45aeac33f75e5ab2895b. Resources: {'key_pairs'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:58:44.432227 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-b269b684-f966-4922-8790-7b39fa576a52 tempest-KeyPairsV22TestJSON-61843180 tempest-KeyPairsV22TestJSON-61843180-project] Getting quotas for user 9f1707f3b4d14884b91ed555d0fbe4dd and project 370437d23cdf45aeac33f75e5ab2895b. Resources: {'key_pairs'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:58:44.453223 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-b269b684-f966-4922-8790-7b39fa576a52 tempest-KeyPairsV22TestJSON-61843180 tempest-KeyPairsV22TestJSON-61843180-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 201 len: 4692 microversion: 2.2 time: 1.116066 Aug 10 17:58:44.455093 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 895/1759] 10.222.0.50 () {62 vars in 1198 bytes} [Wed Aug 10 17:58:43 2022] POST /compute/v2.1/os-keypairs => generated 4692 bytes in 1119 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Aug 10 17:58:44.467015 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-32c72075-0614-4280-abf2-c59776bd295d tempest-KeyPairsV22TestJSON-61843180 tempest-KeyPairsV22TestJSON-61843180-project] Calling method '.version_select at 0x7fb345bd3d30>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:58:44.480199 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-32c72075-0614-4280-abf2-c59776bd295d tempest-KeyPairsV22TestJSON-61843180 tempest-KeyPairsV22TestJSON-61843180-project] 10.222.0.50 "GET /compute/v2.1/os-keypairs/tempest-keypair-201696352" status: 200 len: 1533 microversion: 2.2 time: 0.016283 Aug 10 17:58:44.494273 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 865/1760] 10.222.0.50 () {60 vars in 1255 bytes} [Wed Aug 10 17:58:44 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-201696352 => generated 1533 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:58:44.496185 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-ca7e76bd-4f5c-4440-9b0b-5fbe663ad781 tempest-KeyPairsV22TestJSON-61843180 tempest-KeyPairsV22TestJSON-61843180-project] Calling method '.version_select at 0x7fb345ebaca0>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:58:44.501312 n-d-852296-2 devstack@n-api.service[129409]: WARNING oslo_db.sqlalchemy.utils [None req-ca7e76bd-4f5c-4440-9b0b-5fbe663ad781 tempest-KeyPairsV22TestJSON-61843180 tempest-KeyPairsV22TestJSON-61843180-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 10 17:58:44.513610 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-ca7e76bd-4f5c-4440-9b0b-5fbe663ad781 tempest-KeyPairsV22TestJSON-61843180 tempest-KeyPairsV22TestJSON-61843180-project] 10.222.0.50 "GET /compute/v2.1/os-keypairs" status: 200 len: 1390 microversion: 2.2 time: 0.026013 Aug 10 17:58:44.526155 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 896/1761] 10.222.0.50 () {60 vars in 1177 bytes} [Wed Aug 10 17:58:44 2022] GET /compute/v2.1/os-keypairs => generated 1390 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:58:44.537021 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-82d040ca-099d-4cd0-b7cd-16e5361c02b1 tempest-KeyPairsV22TestJSON-61843180 tempest-KeyPairsV22TestJSON-61843180-project] Calling method '.version_select at 0x7fb345d771f0>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:58:44.766399 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-82d040ca-099d-4cd0-b7cd-16e5361c02b1 tempest-KeyPairsV22TestJSON-61843180 tempest-KeyPairsV22TestJSON-61843180-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-201696352" status: 204 len: 0 microversion: 2.2 time: 0.234133 Aug 10 17:58:44.767353 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 866/1762] 10.222.0.50 () {60 vars in 1258 bytes} [Wed Aug 10 17:58:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-201696352 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 17:58:44.950629 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-f8f8f92c-1779-4df8-b2dc-7c98aeff2eb9 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:58:44.954321 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-f8f8f92c-1779-4df8-b2dc-7c98aeff2eb9 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] [instance: 753bb23d-ad3b-4fc0-be8f-fed753940dde] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:58:44.970154 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-f8f8f92c-1779-4df8-b2dc-7c98aeff2eb9 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:58:44.970946 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-f8f8f92c-1779-4df8-b2dc-7c98aeff2eb9 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:58:44.971576 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-f8f8f92c-1779-4df8-b2dc-7c98aeff2eb9 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:58:44.973306 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-f8f8f92c-1779-4df8-b2dc-7c98aeff2eb9 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:58:44.973971 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-f8f8f92c-1779-4df8-b2dc-7c98aeff2eb9 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:58:44.976060 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-f8f8f92c-1779-4df8-b2dc-7c98aeff2eb9 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:58:45.189873 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-f8f8f92c-1779-4df8-b2dc-7c98aeff2eb9 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99171d2ccde4a108b820c7ce2aa3ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4f95a4b9a4417da0b00d881dee9481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:58:45.209507 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-f8f8f92c-1779-4df8-b2dc-7c98aeff2eb9 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a99171d2ccde4a108b820c7ce2aa3ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4f95a4b9a4417da0b00d881dee9481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:58:45.215709 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-f8f8f92c-1779-4df8-b2dc-7c98aeff2eb9 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a99171d2ccde4a108b820c7ce2aa3ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4f95a4b9a4417da0b00d881dee9481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:58:45.218827 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-f8f8f92c-1779-4df8-b2dc-7c98aeff2eb9 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] 10.222.0.50 "GET /compute/v2.1/servers/753bb23d-ad3b-4fc0-be8f-fed753940dde" status: 200 len: 1336 microversion: 2.54 time: 0.273926 Aug 10 17:58:45.222094 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 897/1763] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:58:44 2022] GET /compute/v2.1/servers/753bb23d-ad3b-4fc0-be8f-fed753940dde => generated 1336 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:58:46.257172 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-5e4eef9e-f5a0-49b0-aa5a-b00dc6308465 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:58:46.258668 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-5e4eef9e-f5a0-49b0-aa5a-b00dc6308465 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] [instance: 753bb23d-ad3b-4fc0-be8f-fed753940dde] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:58:46.281806 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-5e4eef9e-f5a0-49b0-aa5a-b00dc6308465 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:58:46.284446 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-5e4eef9e-f5a0-49b0-aa5a-b00dc6308465 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:58:46.287379 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-5e4eef9e-f5a0-49b0-aa5a-b00dc6308465 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:58:46.288957 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-5e4eef9e-f5a0-49b0-aa5a-b00dc6308465 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:58:46.290829 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-5e4eef9e-f5a0-49b0-aa5a-b00dc6308465 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:58:46.295089 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-5e4eef9e-f5a0-49b0-aa5a-b00dc6308465 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:58:46.738446 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-5e4eef9e-f5a0-49b0-aa5a-b00dc6308465 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99171d2ccde4a108b820c7ce2aa3ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4f95a4b9a4417da0b00d881dee9481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:58:46.749521 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-5e4eef9e-f5a0-49b0-aa5a-b00dc6308465 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a99171d2ccde4a108b820c7ce2aa3ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4f95a4b9a4417da0b00d881dee9481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:58:46.751515 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-5e4eef9e-f5a0-49b0-aa5a-b00dc6308465 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a99171d2ccde4a108b820c7ce2aa3ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4f95a4b9a4417da0b00d881dee9481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:58:46.755500 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-5e4eef9e-f5a0-49b0-aa5a-b00dc6308465 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] 10.222.0.50 "GET /compute/v2.1/servers/753bb23d-ad3b-4fc0-be8f-fed753940dde" status: 200 len: 1336 microversion: 2.54 time: 0.510962 Aug 10 17:58:46.756819 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 867/1764] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:58:46 2022] GET /compute/v2.1/servers/753bb23d-ad3b-4fc0-be8f-fed753940dde => generated 1336 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 17:58:47.024411 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-a8cf1422-f1d0-41ec-b252-d0090b555bc1 tempest-ImagesNegativeTestJSON-1364275812 tempest-ImagesNegativeTestJSON-1364275812-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-1887084447", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "60ec4a62-7d19-4c6b-bb21-e63eed82e1b2"}]}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:58:47.111764 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.network.neutron [None req-a8cf1422-f1d0-41ec-b252-d0090b555bc1 tempest-ImagesNegativeTestJSON-1364275812 tempest-ImagesNegativeTestJSON-1364275812-project] validate_networks() for [('60ec4a62-7d19-4c6b-bb21-e63eed82e1b2', None, None, None, None, None)] {{(pid=129409) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 17:58:47.689042 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-6417a088-c481-4c8d-ae39-955d9a0de7bc tempest-ComputeTenantNetworksTest-607107996 tempest-ComputeTenantNetworksTest-607107996-project] Calling method '.version_select at 0x7fb345dbf280>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:58:47.703713 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [None req-a8cf1422-f1d0-41ec-b252-d0090b555bc1 tempest-ImagesNegativeTestJSON-1364275812 tempest-ImagesNegativeTestJSON-1364275812-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-54daa55f-a52c-4f63-b8c5-62baebfdc7b4) Aug 10 17:58:47.703713 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:58:47.703713 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:58:47.703713 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:58:47.703713 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:58:47.703713 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:58:47.703713 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:58:47.703713 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:58:47.703713 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:58:47.703713 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:58:47.703713 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 17:58:47.703713 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 17:58:47.703713 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 17:58:47.703713 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 17:58:47.703713 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 17:58:47.703713 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 17:58:47.703713 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 17:58:47.703713 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 17:58:47.703713 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 17:58:47.703713 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 17:58:47.703713 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 17:58:47.703713 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 17:58:47.703713 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 17:58:47.703713 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 17:58:47.703713 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 17:58:47.703713 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 17:58:47.703713 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 17:58:47.703713 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:58:47.703713 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:58:47.703713 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 17:58:47.703713 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 17:58:47.703713 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:58:47.703713 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:58:47.703713 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:58:47.703713 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:58:47.703713 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:58:47.703713 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:58:47.703713 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:58:47.703713 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:58:47.703713 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:58:47.703713 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:58:47.703713 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 17:58:47.703713 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 17:58:47.703713 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 17:58:47.703713 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 17:58:47.703713 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 17:58:47.703713 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 17:58:47.703713 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 17:58:47.703713 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 17:58:47.703713 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 17:58:47.703713 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 17:58:47.703713 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 17:58:47.703713 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 17:58:47.707185 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 17:58:47.707185 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 17:58:47.707185 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 17:58:47.707185 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 17:58:47.707185 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 17:58:47.707185 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 17:58:47.707185 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 17:58:47.707185 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 17:58:47.707185 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 17:58:47.707185 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 17:58:47.707185 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 17:58:47.707185 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 17:58:47.707185 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 17:58:47.707185 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 17:58:47.707185 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-54daa55f-a52c-4f63-b8c5-62baebfdc7b4) Aug 10 17:58:47.707185 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:58:47.707185 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-a8cf1422-f1d0-41ec-b252-d0090b555bc1 tempest-ImagesNegativeTestJSON-1364275812 tempest-ImagesNegativeTestJSON-1364275812-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:58:47.707185 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:58:47.708350 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-a8cf1422-f1d0-41ec-b252-d0090b555bc1 tempest-ImagesNegativeTestJSON-1364275812 tempest-ImagesNegativeTestJSON-1364275812-project] Request method failure captured: Aug 10 17:58:47.708350 n-d-852296-2 devstack@n-api.service[129409]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 17:58:47.708350 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 17:58:47.708350 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 17:58:47.708350 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 17:58:47.708350 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 208 Aug 10 17:58:47.708350 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 17:58:47.708350 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 17:58:47.708350 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 17:58:47.708350 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 17:58:47.708350 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8_HVF1tVNATOhTD5b2DgmdlQH4mbBDEMSxezUiF0T-ux5lW4EHxndZd7AeGQHSj1c6BeMyuXbwHMool4LHzqtr7HS1f5nVXYXssDeVqPtUPwRcl1Bkj7i77N8fwfPsSh2LmHYmeuAUEnrniDlHJY1q1FOCOZp75LbbYQdfR1byqApJo Aug 10 17:58:47.708350 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 17:58:47.708350 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 17:58:47.708350 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 17:58:47.708350 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 17:58:47.708350 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 17:58:47.708350 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 17:58:47.708350 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: 4204ea2d4353411d871c1de3f5ef05ec Aug 10 17:58:47.708350 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-ImagesNegativeTestJSON-1364275812 Aug 10 17:58:47.708350 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 17:58:47.708350 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 17:58:47.708350 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4204ea2d4353411d871c1de3f5ef05ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4204ea2d4353411d871c1de3f5ef05ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4204ea2d4353411d871c1de3f5ef05ec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4204ea2d4353411d871c1de3f5ef05ec", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:58:47.708350 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-ImagesNegativeTestJSON-1364275812 Aug 10 17:58:47.708350 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: 4204ea2d4353411d871c1de3f5ef05ec Aug 10 17:58:47.708350 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1364275812 Aug 10 17:58:47.708350 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-ImagesNegativeTestJSON-1364275812-project Aug 10 17:58:47.708350 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 17:58:47.708350 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 17:58:47.708350 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: 4aeaa337bba14b838cf4e518c673509c Aug 10 17:58:47.708350 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-ImagesNegativeTestJSON-1364275812-project Aug 10 17:58:47.708350 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:58:47.708350 n-d-852296-2 devstack@n-api.service[129409]: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-1887084447", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "60ec4a62-7d19-4c6b-bb21-e63eed82e1b2"}]}} Aug 10 17:58:47.708350 n-d-852296-2 devstack@n-api.service[129409]: method: > Aug 10 17:58:47.708350 n-d-852296-2 devstack@n-api.service[129409]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:58:47.708350 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:58:47.708350 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'body': {'server': {'name': 'tempest-ImagesNegativeTestJSON-server-1887084447', 'imageRef': 'a735ff26-463a-4ffe-a981-ab9d9baa494f', 'flavorRef': '452', 'networks': [{'uuid': '60ec4a62-7d19-4c6b-bb21-e63eed82e1b2'}]}}} Aug 10 17:58:47.708350 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:58:47.708350 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:58:47.708350 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:58:47.708350 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:58:47.708350 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:58:47.708350 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:58:47.708350 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:58:47.708350 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:58:47.708350 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:58:47.708350 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:58:47.708350 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 17:58:47.708350 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 17:58:47.708350 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 17:58:47.708350 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 17:58:47.708350 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 17:58:47.708350 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 17:58:47.708350 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 17:58:47.708350 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 17:58:47.708350 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 17:58:47.708350 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 17:58:47.708350 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 17:58:47.708350 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 17:58:47.708350 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 17:58:47.708350 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 17:58:47.708350 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 17:58:47.724375 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 17:58:47.724375 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 17:58:47.724375 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:58:47.724375 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:58:47.724375 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 17:58:47.724375 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 17:58:47.724375 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:58:47.724375 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:58:47.724375 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:58:47.724375 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:58:47.724375 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:58:47.724375 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:58:47.724375 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:58:47.724375 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:58:47.724375 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:58:47.724375 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:58:47.724375 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 17:58:47.724375 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 17:58:47.724375 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 17:58:47.724375 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 17:58:47.724375 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 17:58:47.724375 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 17:58:47.724375 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 17:58:47.724375 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 17:58:47.724375 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 17:58:47.724375 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 17:58:47.724375 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 17:58:47.724375 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 17:58:47.724375 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 17:58:47.724375 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 17:58:47.724375 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 17:58:47.724375 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 17:58:47.724375 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 17:58:47.724375 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 17:58:47.724375 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 17:58:47.724375 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 17:58:47.724375 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 17:58:47.724375 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 17:58:47.724375 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 17:58:47.724375 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 17:58:47.724375 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 17:58:47.724375 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 17:58:47.724375 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-54daa55f-a52c-4f63-b8c5-62baebfdc7b4) Aug 10 17:58:47.724375 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:58:47.724375 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:58:47.724375 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:58:47.724375 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:58:47.724375 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:58:47.724375 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:58:47.724375 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:58:47.724375 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:58:47.724375 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 10 17:58:47.724375 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 10 17:58:47.727488 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:58:47.727488 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:58:47.727488 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:58:47.727488 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:58:47.727488 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:58:47.727488 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:58:47.727488 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:58:47.727488 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:58:47.727488 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:58:47.727488 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:58:47.727488 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:58:47.727488 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:58:47.727488 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:58:47.727488 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-a8cf1422-f1d0-41ec-b252-d0090b555bc1 tempest-ImagesNegativeTestJSON-1364275812 tempest-ImagesNegativeTestJSON-1364275812-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:58:47.727488 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:58:47.727488 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-a8cf1422-f1d0-41ec-b252-d0090b555bc1 tempest-ImagesNegativeTestJSON-1364275812 tempest-ImagesNegativeTestJSON-1364275812-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.076556 Aug 10 17:58:47.727488 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 898/1765] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 17:58:46 2022] POST /compute/v2.1/servers => generated 214 bytes in 1086 msecs (HTTP/1.1 500) 9 headers in 391 bytes (2 switches on core 0) Aug 10 17:58:47.750327 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-c981faed-bee4-4c75-a205-88e26aca7976 tempest-ImagesNegativeTestJSON-1364275812 tempest-ImagesNegativeTestJSON-1364275812-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1034764530", "metadata": {"image_type": "test"}}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:58:47.753795 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-c981faed-bee4-4c75-a205-88e26aca7976 tempest-ImagesNegativeTestJSON-1364275812 tempest-ImagesNegativeTestJSON-1364275812-project] Failed to fetch instance by id tempest-invalid-657145046 {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2928}} Aug 10 17:58:47.754734 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-c981faed-bee4-4c75-a205-88e26aca7976 tempest-ImagesNegativeTestJSON-1364275812 tempest-ImagesNegativeTestJSON-1364275812-project] HTTP exception thrown: Instance tempest-invalid-657145046 could not be found. Aug 10 17:58:47.756430 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-c981faed-bee4-4c75-a205-88e26aca7976 tempest-ImagesNegativeTestJSON-1364275812 tempest-ImagesNegativeTestJSON-1364275812-project] Request method failure captured: Aug 10 17:58:47.756430 n-d-852296-2 devstack@n-api.service[129409]: request: POST /compute/v2.1/servers/tempest-invalid-657145046/action HTTP/1.1 Aug 10 17:58:47.756430 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 17:58:47.756430 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 17:58:47.756430 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 17:58:47.756430 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 112 Aug 10 17:58:47.756430 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 17:58:47.756430 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 17:58:47.756430 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 17:58:47.756430 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 17:58:47.756430 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8_HVF1tVNATOhTD5b2DgmdlQH4mbBDEMSxezUiF0T-ux5lW4EHxndZd7AeGQHSj1c6BeMyuXbwHMool4LHzqtr7HS1f5nVXYXssDeVqPtUPwRcl1Bkj7i77N8fwfPsSh2LmHYmeuAUEnrniDlHJY1q1FOCOZp75LbbYQdfR1byqApJo Aug 10 17:58:47.756430 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 17:58:47.756430 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 17:58:47.756430 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 17:58:47.756430 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 17:58:47.756430 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 17:58:47.756430 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 17:58:47.756430 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: 4204ea2d4353411d871c1de3f5ef05ec Aug 10 17:58:47.756430 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-ImagesNegativeTestJSON-1364275812 Aug 10 17:58:47.756430 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 17:58:47.756430 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 17:58:47.756430 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4204ea2d4353411d871c1de3f5ef05ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4204ea2d4353411d871c1de3f5ef05ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4204ea2d4353411d871c1de3f5ef05ec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4204ea2d4353411d871c1de3f5ef05ec", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:58:47.756430 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-ImagesNegativeTestJSON-1364275812 Aug 10 17:58:47.756430 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: 4204ea2d4353411d871c1de3f5ef05ec Aug 10 17:58:47.756430 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1364275812 Aug 10 17:58:47.756430 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-ImagesNegativeTestJSON-1364275812-project Aug 10 17:58:47.756430 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 17:58:47.756430 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 17:58:47.756430 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: 4aeaa337bba14b838cf4e518c673509c Aug 10 17:58:47.756430 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-ImagesNegativeTestJSON-1364275812-project Aug 10 17:58:47.756430 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:58:47.756430 n-d-852296-2 devstack@n-api.service[129409]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1034764530", "metadata": {"image_type": "test"}}} Aug 10 17:58:47.756430 n-d-852296-2 devstack@n-api.service[129409]: method: > Aug 10 17:58:47.756430 n-d-852296-2 devstack@n-api.service[129409]: exception: Instance tempest-invalid-657145046 could not be found. Aug 10 17:58:47.756430 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'id': 'tempest-invalid-657145046', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1034764530', 'metadata': {'image_type': 'test'}}}} Aug 10 17:58:47.756430 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:58:47.756430 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:58:47.756430 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 17:58:47.756430 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 17:58:47.756430 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2929, in get Aug 10 17:58:47.756430 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 10 17:58:47.756430 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-657145046 could not be found. Aug 10 17:58:47.756430 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:58:47.756430 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:58:47.756430 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:58:47.756430 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:58:47.756430 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:58:47.756430 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:58:47.756430 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:58:47.756430 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:58:47.756430 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:58:47.756430 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:58:47.756430 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:58:47.756430 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:58:47.756430 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:58:47.756430 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:58:47.756430 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 10 17:58:47.756430 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 10 17:58:47.756430 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 17:58:47.756430 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 17:58:47.756430 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 17:58:47.756430 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:58:47.756430 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-657145046 could not be found. Aug 10 17:58:47.760421 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:58:47.760421 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:58:47.760421 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:58:47.760421 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:58:47.760421 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:58:47.760421 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:58:47.760421 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:58:47.760421 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:58:47.760421 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-657145046 could not be found. Aug 10 17:58:47.760421 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:58:47.760421 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-c981faed-bee4-4c75-a205-88e26aca7976 tempest-ImagesNegativeTestJSON-1364275812 tempest-ImagesNegativeTestJSON-1364275812-project] Returning 404 to user: Instance tempest-invalid-657145046 could not be found. {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:58:47.760421 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-c981faed-bee4-4c75-a205-88e26aca7976 tempest-ImagesNegativeTestJSON-1364275812 tempest-ImagesNegativeTestJSON-1364275812-project] 10.222.0.50 "POST /compute/v2.1/servers/tempest-invalid-657145046/action" status: 404 len: 100 microversion: 2.1 time: 0.030063 Aug 10 17:58:47.760421 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 899/1766] 10.222.0.50 () {60 vars in 1246 bytes} [Wed Aug 10 17:58:47 2022] POST /compute/v2.1/servers/tempest-invalid-657145046/action => generated 100 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:58:47.770348 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-0c52b99c-cccc-440d-a583-4ee65016dcec tempest-ImagesNegativeTestJSON-1364275812 tempest-ImagesNegativeTestJSON-1364275812-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1180203307"}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:58:47.776458 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-0c52b99c-cccc-440d-a583-4ee65016dcec tempest-ImagesNegativeTestJSON-1364275812 tempest-ImagesNegativeTestJSON-1364275812-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2928}} Aug 10 17:58:47.776981 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-0c52b99c-cccc-440d-a583-4ee65016dcec tempest-ImagesNegativeTestJSON-1364275812 tempest-ImagesNegativeTestJSON-1364275812-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 10 17:58:47.779027 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-0c52b99c-cccc-440d-a583-4ee65016dcec tempest-ImagesNegativeTestJSON-1364275812 tempest-ImagesNegativeTestJSON-1364275812-project] Request method failure captured: Aug 10 17:58:47.779027 n-d-852296-2 devstack@n-api.service[129409]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Aug 10 17:58:47.779027 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 17:58:47.779027 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 17:58:47.779027 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 17:58:47.779027 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 57 Aug 10 17:58:47.779027 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 17:58:47.779027 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 17:58:47.779027 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 17:58:47.779027 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 17:58:47.779027 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8_HVF1tVNATOhTD5b2DgmdlQH4mbBDEMSxezUiF0T-ux5lW4EHxndZd7AeGQHSj1c6BeMyuXbwHMool4LHzqtr7HS1f5nVXYXssDeVqPtUPwRcl1Bkj7i77N8fwfPsSh2LmHYmeuAUEnrniDlHJY1q1FOCOZp75LbbYQdfR1byqApJo Aug 10 17:58:47.779027 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 17:58:47.779027 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 17:58:47.779027 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 17:58:47.779027 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 17:58:47.779027 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 17:58:47.779027 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 17:58:47.779027 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: 4204ea2d4353411d871c1de3f5ef05ec Aug 10 17:58:47.779027 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-ImagesNegativeTestJSON-1364275812 Aug 10 17:58:47.779027 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 17:58:47.779027 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 17:58:47.779027 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4204ea2d4353411d871c1de3f5ef05ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4204ea2d4353411d871c1de3f5ef05ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4204ea2d4353411d871c1de3f5ef05ec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4204ea2d4353411d871c1de3f5ef05ec", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:58:47.779027 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-ImagesNegativeTestJSON-1364275812 Aug 10 17:58:47.779027 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: 4204ea2d4353411d871c1de3f5ef05ec Aug 10 17:58:47.779027 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1364275812 Aug 10 17:58:47.779027 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-ImagesNegativeTestJSON-1364275812-project Aug 10 17:58:47.779027 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 17:58:47.779027 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 17:58:47.779027 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: 4aeaa337bba14b838cf4e518c673509c Aug 10 17:58:47.779027 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-ImagesNegativeTestJSON-1364275812-project Aug 10 17:58:47.779027 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:58:47.779027 n-d-852296-2 devstack@n-api.service[129409]: {"createImage": {"name": "tempest-test-snap-1180203307"}} Aug 10 17:58:47.779027 n-d-852296-2 devstack@n-api.service[129409]: method: > Aug 10 17:58:47.779027 n-d-852296-2 devstack@n-api.service[129409]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 10 17:58:47.779027 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1180203307'}}} Aug 10 17:58:47.779027 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:58:47.779027 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:58:47.779027 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 17:58:47.779027 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 17:58:47.779027 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2929, in get Aug 10 17:58:47.779027 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 10 17:58:47.779027 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 10 17:58:47.779027 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:58:47.779027 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:58:47.779027 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:58:47.779027 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:58:47.779027 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:58:47.779027 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:58:47.779027 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:58:47.779027 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:58:47.779027 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:58:47.779027 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:58:47.779027 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:58:47.779027 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:58:47.779027 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:58:47.779027 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:58:47.779027 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 10 17:58:47.779027 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 10 17:58:47.779027 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 17:58:47.779027 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 17:58:47.779027 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 17:58:47.779027 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:58:47.779027 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 10 17:58:47.779027 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:58:47.788414 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:58:47.788414 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:58:47.788414 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:58:47.788414 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:58:47.788414 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:58:47.788414 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:58:47.788414 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:58:47.788414 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 10 17:58:47.788414 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:58:47.788414 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-0c52b99c-cccc-440d-a583-4ee65016dcec tempest-ImagesNegativeTestJSON-1364275812 tempest-ImagesNegativeTestJSON-1364275812-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:58:47.788414 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-0c52b99c-cccc-440d-a583-4ee65016dcec tempest-ImagesNegativeTestJSON-1364275812 tempest-ImagesNegativeTestJSON-1364275812-project] 10.222.0.50 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.016225 Aug 10 17:58:47.788414 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 900/1767] 10.222.0.50 () {60 vars in 1275 bytes} [Wed Aug 10 17:58:47 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 17:58:47.792454 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-c7450501-b3fc-469f-81fd-d54aefd03385 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:58:47.793068 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-c7450501-b3fc-469f-81fd-d54aefd03385 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] [instance: 753bb23d-ad3b-4fc0-be8f-fed753940dde] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:58:47.799571 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c7450501-b3fc-469f-81fd-d54aefd03385 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:58:47.800075 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c7450501-b3fc-469f-81fd-d54aefd03385 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:58:47.800537 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c7450501-b3fc-469f-81fd-d54aefd03385 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:58:47.801236 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c7450501-b3fc-469f-81fd-d54aefd03385 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:58:47.801687 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c7450501-b3fc-469f-81fd-d54aefd03385 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:58:47.802143 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c7450501-b3fc-469f-81fd-d54aefd03385 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:58:47.948383 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-c7450501-b3fc-469f-81fd-d54aefd03385 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99171d2ccde4a108b820c7ce2aa3ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4f95a4b9a4417da0b00d881dee9481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:58:47.992382 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-c7450501-b3fc-469f-81fd-d54aefd03385 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a99171d2ccde4a108b820c7ce2aa3ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4f95a4b9a4417da0b00d881dee9481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:58:47.997777 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-c7450501-b3fc-469f-81fd-d54aefd03385 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a99171d2ccde4a108b820c7ce2aa3ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4f95a4b9a4417da0b00d881dee9481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:58:48.003751 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-c7450501-b3fc-469f-81fd-d54aefd03385 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] 10.222.0.50 "GET /compute/v2.1/servers/753bb23d-ad3b-4fc0-be8f-fed753940dde" status: 200 len: 1336 microversion: 2.54 time: 0.219681 Aug 10 17:58:48.004718 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 901/1768] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:58:47 2022] GET /compute/v2.1/servers/753bb23d-ad3b-4fc0-be8f-fed753940dde => generated 1336 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:58:48.026930 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-6417a088-c481-4c8d-ae39-955d9a0de7bc tempest-ComputeTenantNetworksTest-607107996 tempest-ComputeTenantNetworksTest-607107996-project] 10.222.0.50 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 309 microversion: 2.1 time: 0.423724 Aug 10 17:58:48.034003 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 868/1769] 10.222.0.50 () {58 vars in 1158 bytes} [Wed Aug 10 17:58:47 2022] GET /compute/v2.1/os-tenant-networks => generated 309 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:58:48.034095 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-7b8fa349-3ff7-48b1-b17e-c3f8b2e58311 tempest-ImagesNegativeTestJSON-1364275812 tempest-ImagesNegativeTestJSON-1364275812-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-2046032095"}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:58:48.035813 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-7b8fa349-3ff7-48b1-b17e-c3f8b2e58311 tempest-ImagesNegativeTestJSON-1364275812 tempest-ImagesNegativeTestJSON-1364275812-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2928}} Aug 10 17:58:48.036701 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-7b8fa349-3ff7-48b1-b17e-c3f8b2e58311 tempest-ImagesNegativeTestJSON-1364275812 tempest-ImagesNegativeTestJSON-1364275812-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 10 17:58:48.038368 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-7b8fa349-3ff7-48b1-b17e-c3f8b2e58311 tempest-ImagesNegativeTestJSON-1364275812 tempest-ImagesNegativeTestJSON-1364275812-project] Request method failure captured: Aug 10 17:58:48.038368 n-d-852296-2 devstack@n-api.service[129409]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Aug 10 17:58:48.038368 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 17:58:48.038368 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 17:58:48.038368 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 17:58:48.038368 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 57 Aug 10 17:58:48.038368 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 17:58:48.038368 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 17:58:48.038368 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 17:58:48.038368 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 17:58:48.038368 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8_HVF1tVNATOhTD5b2DgmdlQH4mbBDEMSxezUiF0T-ux5lW4EHxndZd7AeGQHSj1c6BeMyuXbwHMool4LHzqtr7HS1f5nVXYXssDeVqPtUPwRcl1Bkj7i77N8fwfPsSh2LmHYmeuAUEnrniDlHJY1q1FOCOZp75LbbYQdfR1byqApJo Aug 10 17:58:48.038368 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 17:58:48.038368 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 17:58:48.038368 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 17:58:48.038368 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 17:58:48.038368 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 17:58:48.038368 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 17:58:48.038368 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: 4204ea2d4353411d871c1de3f5ef05ec Aug 10 17:58:48.038368 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-ImagesNegativeTestJSON-1364275812 Aug 10 17:58:48.038368 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 17:58:48.038368 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 17:58:48.038368 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4204ea2d4353411d871c1de3f5ef05ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4204ea2d4353411d871c1de3f5ef05ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4204ea2d4353411d871c1de3f5ef05ec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4204ea2d4353411d871c1de3f5ef05ec", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:58:48.038368 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-ImagesNegativeTestJSON-1364275812 Aug 10 17:58:48.038368 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: 4204ea2d4353411d871c1de3f5ef05ec Aug 10 17:58:48.038368 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1364275812 Aug 10 17:58:48.038368 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-ImagesNegativeTestJSON-1364275812-project Aug 10 17:58:48.038368 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 17:58:48.038368 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 17:58:48.038368 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: 4aeaa337bba14b838cf4e518c673509c Aug 10 17:58:48.038368 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-ImagesNegativeTestJSON-1364275812-project Aug 10 17:58:48.038368 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:58:48.038368 n-d-852296-2 devstack@n-api.service[129409]: {"createImage": {"name": "tempest-test-snap-2046032095"}} Aug 10 17:58:48.038368 n-d-852296-2 devstack@n-api.service[129409]: method: > Aug 10 17:58:48.038368 n-d-852296-2 devstack@n-api.service[129409]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 10 17:58:48.038368 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-2046032095'}}} Aug 10 17:58:48.038368 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:58:48.038368 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:58:48.038368 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 17:58:48.038368 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 17:58:48.038368 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2929, in get Aug 10 17:58:48.038368 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 10 17:58:48.038368 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 10 17:58:48.038368 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:58:48.038368 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:58:48.038368 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:58:48.038368 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:58:48.038368 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:58:48.038368 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:58:48.038368 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:58:48.038368 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:58:48.038368 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:58:48.038368 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:58:48.038368 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:58:48.038368 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:58:48.038368 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:58:48.038368 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:58:48.038368 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 10 17:58:48.038368 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 10 17:58:48.038368 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 17:58:48.038368 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 17:58:48.038368 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 17:58:48.038368 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:58:48.038368 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 10 17:58:48.038368 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:58:48.045138 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:58:48.045138 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:58:48.045138 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:58:48.045138 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:58:48.045138 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:58:48.045138 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:58:48.045138 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:58:48.045138 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 10 17:58:48.045138 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:58:48.045138 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-7b8fa349-3ff7-48b1-b17e-c3f8b2e58311 tempest-ImagesNegativeTestJSON-1364275812 tempest-ImagesNegativeTestJSON-1364275812-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:58:48.045138 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-7b8fa349-3ff7-48b1-b17e-c3f8b2e58311 tempest-ImagesNegativeTestJSON-1364275812 tempest-ImagesNegativeTestJSON-1364275812-project] 10.222.0.50 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.029315 Aug 10 17:58:48.045138 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 902/1770] 10.222.0.50 () {60 vars in 1281 bytes} [Wed Aug 10 17:58:48 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:58:48.069339 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-574aa37d-319c-40db-b94c-53f62011882b tempest-ComputeTenantNetworksTest-607107996 tempest-ComputeTenantNetworksTest-607107996-project] Calling method '.version_select at 0x7fb345c73820>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:58:48.298735 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-574aa37d-319c-40db-b94c-53f62011882b tempest-ComputeTenantNetworksTest-607107996 tempest-ComputeTenantNetworksTest-607107996-project] 10.222.0.50 "GET /compute/v2.1/os-tenant-networks/a2e37720-a406-43c6-a3a3-a225712ef6dc" status: 200 len: 140 microversion: 2.1 time: 0.262222 Aug 10 17:58:48.299622 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 869/1771] 10.222.0.50 () {58 vars in 1269 bytes} [Wed Aug 10 17:58:48 2022] GET /compute/v2.1/os-tenant-networks/a2e37720-a406-43c6-a3a3-a225712ef6dc => generated 140 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:58:49.034486 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-10eb604f-40bc-4209-a729-8d2516f7654d tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:58:49.036062 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-10eb604f-40bc-4209-a729-8d2516f7654d tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] [instance: 753bb23d-ad3b-4fc0-be8f-fed753940dde] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:58:49.053257 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_cell0:SELECT=2 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:58:49.056402 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-10eb604f-40bc-4209-a729-8d2516f7654d tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:58:49.057109 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-10eb604f-40bc-4209-a729-8d2516f7654d tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:58:49.058915 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-10eb604f-40bc-4209-a729-8d2516f7654d tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:58:49.058915 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-10eb604f-40bc-4209-a729-8d2516f7654d tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:58:49.059248 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-10eb604f-40bc-4209-a729-8d2516f7654d tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:58:49.059413 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-10eb604f-40bc-4209-a729-8d2516f7654d tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:58:49.216675 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-10eb604f-40bc-4209-a729-8d2516f7654d tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99171d2ccde4a108b820c7ce2aa3ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4f95a4b9a4417da0b00d881dee9481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:58:49.236338 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-10eb604f-40bc-4209-a729-8d2516f7654d tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a99171d2ccde4a108b820c7ce2aa3ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4f95a4b9a4417da0b00d881dee9481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:58:49.237862 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-10eb604f-40bc-4209-a729-8d2516f7654d tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a99171d2ccde4a108b820c7ce2aa3ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4f95a4b9a4417da0b00d881dee9481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:58:49.239068 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-10eb604f-40bc-4209-a729-8d2516f7654d tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] 10.222.0.50 "GET /compute/v2.1/servers/753bb23d-ad3b-4fc0-be8f-fed753940dde" status: 200 len: 1357 microversion: 2.54 time: 0.208969 Aug 10 17:58:49.239626 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 903/1772] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:58:49 2022] GET /compute/v2.1/servers/753bb23d-ad3b-4fc0-be8f-fed753940dde => generated 1357 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:58:49.274507 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-879d2906-316b-4333-928b-8dbd0b9bbbe3 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Action: 'create', calling method: .version_select at 0x7fb345bd3040>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-1987096964", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC9DVkMYcJXuw3POIwui5GTDNOUKIGVshL/VSxJHenplsVVVRFsYKsmZOuTpfpssSaLYlUCfmZX7vlqk/mRU2BRpfJosIZzFtuvySn9Nt6JKtLUoVq7f0pRa2NfOdPysTQ=="}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:58:49.323932 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.quota [None req-879d2906-316b-4333-928b-8dbd0b9bbbe3 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Getting quotas for project da4f95a4b9a4417da0b00d881dee9481. Resources: {'key_pairs'} {{(pid=129410) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:58:49.349870 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.quota [None req-879d2906-316b-4333-928b-8dbd0b9bbbe3 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Getting quotas for user a99171d2ccde4a108b820c7ce2aa3ee5 and project da4f95a4b9a4417da0b00d881dee9481. Resources: {'key_pairs'} {{(pid=129410) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:58:49.533995 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-879d2906-316b-4333-928b-8dbd0b9bbbe3 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.54 time: 0.265743 Aug 10 17:58:49.535672 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 870/1773] 10.222.0.50 () {62 vars in 1200 bytes} [Wed Aug 10 17:58:49 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 269 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 10 17:58:49.549629 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-5f6fc5a3-3290-4491-996d-43dbeff0b9b1 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-1987096964", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f"}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:58:49.555126 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-5f6fc5a3-3290-4491-996d-43dbeff0b9b1 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] [instance: 753bb23d-ad3b-4fc0-be8f-fed753940dde] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:58:49.577556 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-5f6fc5a3-3290-4491-996d-43dbeff0b9b1 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:58:49.578059 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-5f6fc5a3-3290-4491-996d-43dbeff0b9b1 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:58:49.578500 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-5f6fc5a3-3290-4491-996d-43dbeff0b9b1 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:58:49.586556 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-5f6fc5a3-3290-4491-996d-43dbeff0b9b1 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:58:49.587064 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-5f6fc5a3-3290-4491-996d-43dbeff0b9b1 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:58:49.587512 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-5f6fc5a3-3290-4491-996d-43dbeff0b9b1 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:58:49.737545 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.virt.hardware [None req-5f6fc5a3-3290-4491-996d-43dbeff0b9b1 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Flavor limits 0:0:0 {{(pid=129409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 17:58:49.740046 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.virt.hardware [None req-5f6fc5a3-3290-4491-996d-43dbeff0b9b1 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Image limits 0:0:0 {{(pid=129409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 17:58:49.741453 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.virt.hardware [None req-5f6fc5a3-3290-4491-996d-43dbeff0b9b1 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Flavor pref 0:0:0 {{(pid=129409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 17:58:49.752981 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.virt.hardware [None req-5f6fc5a3-3290-4491-996d-43dbeff0b9b1 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Image pref 0:0:0 {{(pid=129409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 17:58:49.754420 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.virt.hardware [None req-5f6fc5a3-3290-4491-996d-43dbeff0b9b1 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 17:58:50.374908 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-5f6fc5a3-3290-4491-996d-43dbeff0b9b1 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] [instance: 753bb23d-ad3b-4fc0-be8f-fed753940dde] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:58:50.388963 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-5f6fc5a3-3290-4491-996d-43dbeff0b9b1 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:58:50.389468 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-5f6fc5a3-3290-4491-996d-43dbeff0b9b1 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:58:50.389919 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-5f6fc5a3-3290-4491-996d-43dbeff0b9b1 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:58:50.390676 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-5f6fc5a3-3290-4491-996d-43dbeff0b9b1 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:58:50.400169 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-5f6fc5a3-3290-4491-996d-43dbeff0b9b1 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:58:50.400169 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-5f6fc5a3-3290-4491-996d-43dbeff0b9b1 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:58:50.484735 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-5f6fc5a3-3290-4491-996d-43dbeff0b9b1 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] 10.222.0.50 "POST /compute/v2.1/servers/753bb23d-ad3b-4fc0-be8f-fed753940dde/action" status: 202 len: 1140 microversion: 2.54 time: 0.938231 Aug 10 17:58:50.486305 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 904/1774] 10.222.0.50 () {62 vars in 1320 bytes} [Wed Aug 10 17:58:49 2022] POST /compute/v2.1/servers/753bb23d-ad3b-4fc0-be8f-fed753940dde/action => generated 1140 bytes in 944 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 10 17:58:50.505723 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-01b03e52-ce94-4142-8cc5-532e3329cac4 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:58:50.506355 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-01b03e52-ce94-4142-8cc5-532e3329cac4 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] [instance: 753bb23d-ad3b-4fc0-be8f-fed753940dde] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:58:50.515529 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-01b03e52-ce94-4142-8cc5-532e3329cac4 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:58:50.516487 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-01b03e52-ce94-4142-8cc5-532e3329cac4 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:58:50.517123 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-01b03e52-ce94-4142-8cc5-532e3329cac4 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:58:50.518120 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-01b03e52-ce94-4142-8cc5-532e3329cac4 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:58:50.519077 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-01b03e52-ce94-4142-8cc5-532e3329cac4 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:58:50.519707 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-01b03e52-ce94-4142-8cc5-532e3329cac4 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:58:50.735498 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-01b03e52-ce94-4142-8cc5-532e3329cac4 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99171d2ccde4a108b820c7ce2aa3ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4f95a4b9a4417da0b00d881dee9481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:58:50.749455 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-01b03e52-ce94-4142-8cc5-532e3329cac4 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a99171d2ccde4a108b820c7ce2aa3ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4f95a4b9a4417da0b00d881dee9481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:58:50.751717 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-01b03e52-ce94-4142-8cc5-532e3329cac4 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a99171d2ccde4a108b820c7ce2aa3ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4f95a4b9a4417da0b00d881dee9481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:58:50.755941 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-01b03e52-ce94-4142-8cc5-532e3329cac4 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] 10.222.0.50 "GET /compute/v2.1/servers/753bb23d-ad3b-4fc0-be8f-fed753940dde" status: 200 len: 1409 microversion: 2.54 time: 0.254844 Aug 10 17:58:50.769705 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 871/1775] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:58:50 2022] GET /compute/v2.1/servers/753bb23d-ad3b-4fc0-be8f-fed753940dde => generated 1409 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:58:51.785815 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-38d11108-1221-4263-8c2a-55149a49249b tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:58:51.788928 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-38d11108-1221-4263-8c2a-55149a49249b tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] [instance: 753bb23d-ad3b-4fc0-be8f-fed753940dde] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:58:51.806637 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-38d11108-1221-4263-8c2a-55149a49249b tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:58:51.808206 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-38d11108-1221-4263-8c2a-55149a49249b tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:58:51.809040 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-38d11108-1221-4263-8c2a-55149a49249b tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:58:51.810195 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-38d11108-1221-4263-8c2a-55149a49249b tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:58:51.816670 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-38d11108-1221-4263-8c2a-55149a49249b tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:58:51.816670 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-38d11108-1221-4263-8c2a-55149a49249b tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:58:52.493164 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-38d11108-1221-4263-8c2a-55149a49249b tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99171d2ccde4a108b820c7ce2aa3ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4f95a4b9a4417da0b00d881dee9481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:58:52.502674 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-38d11108-1221-4263-8c2a-55149a49249b tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a99171d2ccde4a108b820c7ce2aa3ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4f95a4b9a4417da0b00d881dee9481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:58:52.504200 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-38d11108-1221-4263-8c2a-55149a49249b tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a99171d2ccde4a108b820c7ce2aa3ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4f95a4b9a4417da0b00d881dee9481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:58:52.513434 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-38d11108-1221-4263-8c2a-55149a49249b tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] 10.222.0.50 "GET /compute/v2.1/servers/753bb23d-ad3b-4fc0-be8f-fed753940dde" status: 200 len: 1409 microversion: 2.54 time: 0.734428 Aug 10 17:58:52.514341 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 905/1776] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:58:51 2022] GET /compute/v2.1/servers/753bb23d-ad3b-4fc0-be8f-fed753940dde => generated 1409 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:58:53.561112 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-c0b96d4d-32ef-403f-8c58-f4a0fbb29fd9 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:58:53.563032 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-c0b96d4d-32ef-403f-8c58-f4a0fbb29fd9 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] [instance: 753bb23d-ad3b-4fc0-be8f-fed753940dde] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:58:53.585952 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-c0b96d4d-32ef-403f-8c58-f4a0fbb29fd9 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:58:53.588316 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-c0b96d4d-32ef-403f-8c58-f4a0fbb29fd9 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:58:53.589092 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-c0b96d4d-32ef-403f-8c58-f4a0fbb29fd9 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:58:53.590057 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-c0b96d4d-32ef-403f-8c58-f4a0fbb29fd9 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:58:53.594901 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-c0b96d4d-32ef-403f-8c58-f4a0fbb29fd9 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:58:53.594901 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-c0b96d4d-32ef-403f-8c58-f4a0fbb29fd9 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:58:53.899387 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-c0b96d4d-32ef-403f-8c58-f4a0fbb29fd9 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99171d2ccde4a108b820c7ce2aa3ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4f95a4b9a4417da0b00d881dee9481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:58:53.912778 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-c0b96d4d-32ef-403f-8c58-f4a0fbb29fd9 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a99171d2ccde4a108b820c7ce2aa3ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4f95a4b9a4417da0b00d881dee9481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:58:53.915934 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-c0b96d4d-32ef-403f-8c58-f4a0fbb29fd9 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a99171d2ccde4a108b820c7ce2aa3ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4f95a4b9a4417da0b00d881dee9481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:58:53.919495 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-c0b96d4d-32ef-403f-8c58-f4a0fbb29fd9 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] 10.222.0.50 "GET /compute/v2.1/servers/753bb23d-ad3b-4fc0-be8f-fed753940dde" status: 200 len: 1409 microversion: 2.54 time: 0.367406 Aug 10 17:58:53.925189 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 872/1777] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:58:53 2022] GET /compute/v2.1/servers/753bb23d-ad3b-4fc0-be8f-fed753940dde => generated 1409 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:58:54.944767 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-f2eeca14-f74d-41c2-8ad3-387d1524e095 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:58:54.945391 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-f2eeca14-f74d-41c2-8ad3-387d1524e095 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] [instance: 753bb23d-ad3b-4fc0-be8f-fed753940dde] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:58:54.948385 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_cell0:SELECT=30 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:58:54.953025 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-f2eeca14-f74d-41c2-8ad3-387d1524e095 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:58:54.953513 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-f2eeca14-f74d-41c2-8ad3-387d1524e095 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:58:54.953949 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-f2eeca14-f74d-41c2-8ad3-387d1524e095 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:58:54.954649 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-f2eeca14-f74d-41c2-8ad3-387d1524e095 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:58:54.955110 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-f2eeca14-f74d-41c2-8ad3-387d1524e095 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:58:54.955527 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-f2eeca14-f74d-41c2-8ad3-387d1524e095 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:58:55.104229 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-f2eeca14-f74d-41c2-8ad3-387d1524e095 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99171d2ccde4a108b820c7ce2aa3ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4f95a4b9a4417da0b00d881dee9481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:58:55.119956 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-f2eeca14-f74d-41c2-8ad3-387d1524e095 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a99171d2ccde4a108b820c7ce2aa3ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4f95a4b9a4417da0b00d881dee9481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:58:55.134913 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-f2eeca14-f74d-41c2-8ad3-387d1524e095 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a99171d2ccde4a108b820c7ce2aa3ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4f95a4b9a4417da0b00d881dee9481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:58:55.155268 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-f2eeca14-f74d-41c2-8ad3-387d1524e095 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] 10.222.0.50 "GET /compute/v2.1/servers/753bb23d-ad3b-4fc0-be8f-fed753940dde" status: 200 len: 1409 microversion: 2.54 time: 0.199824 Aug 10 17:58:55.156079 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 906/1778] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:58:54 2022] GET /compute/v2.1/servers/753bb23d-ad3b-4fc0-be8f-fed753940dde => generated 1409 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:58:55.211326 n-d-852296-2 devstack@n-api.service[129410]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 17:58:55.211988 n-d-852296-2 devstack@n-api.service[129410]: Wed Aug 10 17:58:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 17:58:56.180398 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-6c8bdb0a-a03d-4cdb-9bc1-1184e4f3bd6d tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:58:56.182692 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-6c8bdb0a-a03d-4cdb-9bc1-1184e4f3bd6d tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] [instance: 753bb23d-ad3b-4fc0-be8f-fed753940dde] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:58:56.196475 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-6c8bdb0a-a03d-4cdb-9bc1-1184e4f3bd6d tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:58:56.197752 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-6c8bdb0a-a03d-4cdb-9bc1-1184e4f3bd6d tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:58:56.199383 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-6c8bdb0a-a03d-4cdb-9bc1-1184e4f3bd6d tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:58:56.201766 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-6c8bdb0a-a03d-4cdb-9bc1-1184e4f3bd6d tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:58:56.202291 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-6c8bdb0a-a03d-4cdb-9bc1-1184e4f3bd6d tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:58:56.202865 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-6c8bdb0a-a03d-4cdb-9bc1-1184e4f3bd6d tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:58:56.289384 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-6c8bdb0a-a03d-4cdb-9bc1-1184e4f3bd6d tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99171d2ccde4a108b820c7ce2aa3ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4f95a4b9a4417da0b00d881dee9481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:58:56.300678 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-6c8bdb0a-a03d-4cdb-9bc1-1184e4f3bd6d tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a99171d2ccde4a108b820c7ce2aa3ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4f95a4b9a4417da0b00d881dee9481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:58:56.302563 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-6c8bdb0a-a03d-4cdb-9bc1-1184e4f3bd6d tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a99171d2ccde4a108b820c7ce2aa3ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4f95a4b9a4417da0b00d881dee9481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:58:56.303939 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-6c8bdb0a-a03d-4cdb-9bc1-1184e4f3bd6d tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] 10.222.0.50 "GET /compute/v2.1/servers/753bb23d-ad3b-4fc0-be8f-fed753940dde" status: 200 len: 1409 microversion: 2.54 time: 0.128762 Aug 10 17:58:56.304854 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 873/1779] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:58:56 2022] GET /compute/v2.1/servers/753bb23d-ad3b-4fc0-be8f-fed753940dde => generated 1409 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:58:57.337151 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-738ac1ea-53ca-49b5-b792-9fb0d396923c tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:58:57.337810 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-738ac1ea-53ca-49b5-b792-9fb0d396923c tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] [instance: 753bb23d-ad3b-4fc0-be8f-fed753940dde] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:58:57.355665 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-738ac1ea-53ca-49b5-b792-9fb0d396923c tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:58:57.356627 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-738ac1ea-53ca-49b5-b792-9fb0d396923c tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:58:57.358970 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-738ac1ea-53ca-49b5-b792-9fb0d396923c tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:58:57.362498 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-738ac1ea-53ca-49b5-b792-9fb0d396923c tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:58:57.363200 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-738ac1ea-53ca-49b5-b792-9fb0d396923c tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:58:57.363650 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-738ac1ea-53ca-49b5-b792-9fb0d396923c tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:58:57.512041 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-738ac1ea-53ca-49b5-b792-9fb0d396923c tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99171d2ccde4a108b820c7ce2aa3ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4f95a4b9a4417da0b00d881dee9481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:58:57.540302 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-738ac1ea-53ca-49b5-b792-9fb0d396923c tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a99171d2ccde4a108b820c7ce2aa3ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4f95a4b9a4417da0b00d881dee9481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:58:57.542365 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-738ac1ea-53ca-49b5-b792-9fb0d396923c tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a99171d2ccde4a108b820c7ce2aa3ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4f95a4b9a4417da0b00d881dee9481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:58:57.545238 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-738ac1ea-53ca-49b5-b792-9fb0d396923c tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] 10.222.0.50 "GET /compute/v2.1/servers/753bb23d-ad3b-4fc0-be8f-fed753940dde" status: 200 len: 1409 microversion: 2.54 time: 0.215453 Aug 10 17:58:57.546083 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 907/1780] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:58:57 2022] GET /compute/v2.1/servers/753bb23d-ad3b-4fc0-be8f-fed753940dde => generated 1409 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:58:58.571427 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-b2569f31-390c-49f2-9303-b992de144226 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:58:58.571427 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-b2569f31-390c-49f2-9303-b992de144226 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] [instance: 753bb23d-ad3b-4fc0-be8f-fed753940dde] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:58:58.573048 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:58:58.584707 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b2569f31-390c-49f2-9303-b992de144226 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:58:58.585639 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b2569f31-390c-49f2-9303-b992de144226 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:58:58.586254 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b2569f31-390c-49f2-9303-b992de144226 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:58:58.592324 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b2569f31-390c-49f2-9303-b992de144226 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:58:58.593173 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b2569f31-390c-49f2-9303-b992de144226 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:58:58.593783 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b2569f31-390c-49f2-9303-b992de144226 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:58:58.826601 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-b2569f31-390c-49f2-9303-b992de144226 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99171d2ccde4a108b820c7ce2aa3ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4f95a4b9a4417da0b00d881dee9481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:58:58.841712 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-b2569f31-390c-49f2-9303-b992de144226 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a99171d2ccde4a108b820c7ce2aa3ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4f95a4b9a4417da0b00d881dee9481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:58:58.843797 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-b2569f31-390c-49f2-9303-b992de144226 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a99171d2ccde4a108b820c7ce2aa3ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4f95a4b9a4417da0b00d881dee9481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:58:58.848057 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-b2569f31-390c-49f2-9303-b992de144226 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] 10.222.0.50 "GET /compute/v2.1/servers/753bb23d-ad3b-4fc0-be8f-fed753940dde" status: 200 len: 1409 microversion: 2.54 time: 0.283589 Aug 10 17:58:58.854362 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 874/1781] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:58:58 2022] GET /compute/v2.1/servers/753bb23d-ad3b-4fc0-be8f-fed753940dde => generated 1409 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:58:59.875801 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-431c93af-7299-4509-b633-296d2b78c5ca tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:58:59.877081 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-431c93af-7299-4509-b633-296d2b78c5ca tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] [instance: 753bb23d-ad3b-4fc0-be8f-fed753940dde] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:58:59.897578 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-431c93af-7299-4509-b633-296d2b78c5ca tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:58:59.898079 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-431c93af-7299-4509-b633-296d2b78c5ca tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:58:59.898660 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-431c93af-7299-4509-b633-296d2b78c5ca tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:58:59.899379 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-431c93af-7299-4509-b633-296d2b78c5ca tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:58:59.899850 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-431c93af-7299-4509-b633-296d2b78c5ca tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:58:59.900427 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-431c93af-7299-4509-b633-296d2b78c5ca tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:59:00.054091 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-431c93af-7299-4509-b633-296d2b78c5ca tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99171d2ccde4a108b820c7ce2aa3ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4f95a4b9a4417da0b00d881dee9481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:00.059697 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-431c93af-7299-4509-b633-296d2b78c5ca tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a99171d2ccde4a108b820c7ce2aa3ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4f95a4b9a4417da0b00d881dee9481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:00.062551 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-431c93af-7299-4509-b633-296d2b78c5ca tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a99171d2ccde4a108b820c7ce2aa3ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4f95a4b9a4417da0b00d881dee9481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:00.064126 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-431c93af-7299-4509-b633-296d2b78c5ca tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] 10.222.0.50 "GET /compute/v2.1/servers/753bb23d-ad3b-4fc0-be8f-fed753940dde" status: 200 len: 1409 microversion: 2.54 time: 0.193891 Aug 10 17:59:00.065366 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 908/1782] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:58:59 2022] GET /compute/v2.1/servers/753bb23d-ad3b-4fc0-be8f-fed753940dde => generated 1409 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:59:01.089955 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-a2004c0c-061c-4c4c-943e-7322c75a5483 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:59:01.090724 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-a2004c0c-061c-4c4c-943e-7322c75a5483 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] [instance: 753bb23d-ad3b-4fc0-be8f-fed753940dde] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:59:01.100751 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_cell0:SELECT=20 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:59:01.103249 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a2004c0c-061c-4c4c-943e-7322c75a5483 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:59:01.103746 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a2004c0c-061c-4c4c-943e-7322c75a5483 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:59:01.104230 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a2004c0c-061c-4c4c-943e-7322c75a5483 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:59:01.105147 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a2004c0c-061c-4c4c-943e-7322c75a5483 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:59:01.106009 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a2004c0c-061c-4c4c-943e-7322c75a5483 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:59:01.109289 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a2004c0c-061c-4c4c-943e-7322c75a5483 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:59:01.410507 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-a2004c0c-061c-4c4c-943e-7322c75a5483 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99171d2ccde4a108b820c7ce2aa3ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4f95a4b9a4417da0b00d881dee9481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:01.430390 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-a2004c0c-061c-4c4c-943e-7322c75a5483 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a99171d2ccde4a108b820c7ce2aa3ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4f95a4b9a4417da0b00d881dee9481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:01.432265 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-a2004c0c-061c-4c4c-943e-7322c75a5483 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a99171d2ccde4a108b820c7ce2aa3ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4f95a4b9a4417da0b00d881dee9481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:01.441731 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-a2004c0c-061c-4c4c-943e-7322c75a5483 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] 10.222.0.50 "GET /compute/v2.1/servers/753bb23d-ad3b-4fc0-be8f-fed753940dde" status: 200 len: 1409 microversion: 2.54 time: 0.358063 Aug 10 17:59:01.442888 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 875/1783] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:59:01 2022] GET /compute/v2.1/servers/753bb23d-ad3b-4fc0-be8f-fed753940dde => generated 1409 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:59:02.469668 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-939e68db-5a6c-4f3f-b866-54788909e6f5 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:59:02.471384 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-939e68db-5a6c-4f3f-b866-54788909e6f5 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] [instance: 753bb23d-ad3b-4fc0-be8f-fed753940dde] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:59:02.488159 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-939e68db-5a6c-4f3f-b866-54788909e6f5 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:59:02.489401 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-939e68db-5a6c-4f3f-b866-54788909e6f5 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:59:02.492424 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-939e68db-5a6c-4f3f-b866-54788909e6f5 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:59:02.495657 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-939e68db-5a6c-4f3f-b866-54788909e6f5 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:59:02.495874 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-939e68db-5a6c-4f3f-b866-54788909e6f5 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:59:02.496416 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-939e68db-5a6c-4f3f-b866-54788909e6f5 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:59:02.658303 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-939e68db-5a6c-4f3f-b866-54788909e6f5 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99171d2ccde4a108b820c7ce2aa3ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4f95a4b9a4417da0b00d881dee9481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:02.670006 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-939e68db-5a6c-4f3f-b866-54788909e6f5 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a99171d2ccde4a108b820c7ce2aa3ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4f95a4b9a4417da0b00d881dee9481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:02.686248 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-939e68db-5a6c-4f3f-b866-54788909e6f5 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a99171d2ccde4a108b820c7ce2aa3ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4f95a4b9a4417da0b00d881dee9481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:02.687498 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-939e68db-5a6c-4f3f-b866-54788909e6f5 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] 10.222.0.50 "GET /compute/v2.1/servers/753bb23d-ad3b-4fc0-be8f-fed753940dde" status: 200 len: 1409 microversion: 2.54 time: 0.222114 Aug 10 17:59:02.690861 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 909/1784] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:59:02 2022] GET /compute/v2.1/servers/753bb23d-ad3b-4fc0-be8f-fed753940dde => generated 1409 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:59:03.722889 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-28fbfa69-d949-4c39-b55f-5211f4af4466 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:59:03.725228 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-28fbfa69-d949-4c39-b55f-5211f4af4466 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] [instance: 753bb23d-ad3b-4fc0-be8f-fed753940dde] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:59:03.742696 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-28fbfa69-d949-4c39-b55f-5211f4af4466 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:59:03.744888 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-28fbfa69-d949-4c39-b55f-5211f4af4466 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:59:03.745579 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-28fbfa69-d949-4c39-b55f-5211f4af4466 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:59:03.746838 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-28fbfa69-d949-4c39-b55f-5211f4af4466 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:59:03.748836 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-28fbfa69-d949-4c39-b55f-5211f4af4466 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:59:03.750373 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-28fbfa69-d949-4c39-b55f-5211f4af4466 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:59:04.919781 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-28fbfa69-d949-4c39-b55f-5211f4af4466 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99171d2ccde4a108b820c7ce2aa3ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4f95a4b9a4417da0b00d881dee9481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:04.928686 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-28fbfa69-d949-4c39-b55f-5211f4af4466 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a99171d2ccde4a108b820c7ce2aa3ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4f95a4b9a4417da0b00d881dee9481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:04.945096 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-28fbfa69-d949-4c39-b55f-5211f4af4466 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a99171d2ccde4a108b820c7ce2aa3ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4f95a4b9a4417da0b00d881dee9481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:04.946371 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-28fbfa69-d949-4c39-b55f-5211f4af4466 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] 10.222.0.50 "GET /compute/v2.1/servers/753bb23d-ad3b-4fc0-be8f-fed753940dde" status: 200 len: 1409 microversion: 2.54 time: 1.229738 Aug 10 17:59:04.950901 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 876/1785] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:59:03 2022] GET /compute/v2.1/servers/753bb23d-ad3b-4fc0-be8f-fed753940dde => generated 1409 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:59:05.973760 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-8f97cd47-0d6d-4c21-abff-a2228f09b869 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:59:05.974372 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-8f97cd47-0d6d-4c21-abff-a2228f09b869 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] [instance: 753bb23d-ad3b-4fc0-be8f-fed753940dde] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:59:05.985742 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-8f97cd47-0d6d-4c21-abff-a2228f09b869 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:59:05.990433 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-8f97cd47-0d6d-4c21-abff-a2228f09b869 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:59:05.990433 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-8f97cd47-0d6d-4c21-abff-a2228f09b869 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:59:05.990433 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-8f97cd47-0d6d-4c21-abff-a2228f09b869 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:59:05.990433 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-8f97cd47-0d6d-4c21-abff-a2228f09b869 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:59:05.990765 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-8f97cd47-0d6d-4c21-abff-a2228f09b869 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:59:06.888803 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-8f97cd47-0d6d-4c21-abff-a2228f09b869 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99171d2ccde4a108b820c7ce2aa3ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4f95a4b9a4417da0b00d881dee9481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:06.897114 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-8f97cd47-0d6d-4c21-abff-a2228f09b869 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a99171d2ccde4a108b820c7ce2aa3ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4f95a4b9a4417da0b00d881dee9481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:06.910433 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-8f97cd47-0d6d-4c21-abff-a2228f09b869 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a99171d2ccde4a108b820c7ce2aa3ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4f95a4b9a4417da0b00d881dee9481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:06.914400 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-8f97cd47-0d6d-4c21-abff-a2228f09b869 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] 10.222.0.50 "GET /compute/v2.1/servers/753bb23d-ad3b-4fc0-be8f-fed753940dde" status: 200 len: 1409 microversion: 2.54 time: 0.944507 Aug 10 17:59:06.916688 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 910/1786] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:59:05 2022] GET /compute/v2.1/servers/753bb23d-ad3b-4fc0-be8f-fed753940dde => generated 1409 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:59:07.945845 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-b6105d5d-0074-45d5-bc45-94bd4d6571ae tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:59:07.947017 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-b6105d5d-0074-45d5-bc45-94bd4d6571ae tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] [instance: 753bb23d-ad3b-4fc0-be8f-fed753940dde] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:59:07.962821 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b6105d5d-0074-45d5-bc45-94bd4d6571ae tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:59:07.964452 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b6105d5d-0074-45d5-bc45-94bd4d6571ae tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:59:07.967974 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b6105d5d-0074-45d5-bc45-94bd4d6571ae tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:59:07.972443 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b6105d5d-0074-45d5-bc45-94bd4d6571ae tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:59:07.972443 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b6105d5d-0074-45d5-bc45-94bd4d6571ae tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:59:07.972443 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b6105d5d-0074-45d5-bc45-94bd4d6571ae tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:59:08.098232 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-b6105d5d-0074-45d5-bc45-94bd4d6571ae tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99171d2ccde4a108b820c7ce2aa3ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4f95a4b9a4417da0b00d881dee9481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:08.109250 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-b6105d5d-0074-45d5-bc45-94bd4d6571ae tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a99171d2ccde4a108b820c7ce2aa3ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4f95a4b9a4417da0b00d881dee9481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:08.110716 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-b6105d5d-0074-45d5-bc45-94bd4d6571ae tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a99171d2ccde4a108b820c7ce2aa3ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4f95a4b9a4417da0b00d881dee9481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:08.112001 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-b6105d5d-0074-45d5-bc45-94bd4d6571ae tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] 10.222.0.50 "GET /compute/v2.1/servers/753bb23d-ad3b-4fc0-be8f-fed753940dde" status: 200 len: 1409 microversion: 2.54 time: 0.170301 Aug 10 17:59:08.112647 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 877/1787] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:59:07 2022] GET /compute/v2.1/servers/753bb23d-ad3b-4fc0-be8f-fed753940dde => generated 1409 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:59:08.409840 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-f40de915-8a5f-41a6-8a09-d8b954439935 tempest-ServersTestManualDisk-348092951 tempest-ServersTestManualDisk-348092951-project] Action: 'create', calling method: .version_select at 0x7fb345d9bca0>, body: {"keypair": {"name": "tempest-keypair-179470627", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLg+XjqmMZt+oCGa2++G6/Gge9jmpZQDyVNmRHL/4eYaAGD3bk7QOp+47k66eaCw0h5mPcevQmIpXYea4elUp6TU/AQWkvaZ5BWhrlFRUVYO60aF/3+sjCMRdfk40gJSWA=="}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:59:08.432050 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-f40de915-8a5f-41a6-8a09-d8b954439935 tempest-ServersTestManualDisk-348092951 tempest-ServersTestManualDisk-348092951-project] Getting quotas for project 96a652e7ee9d4bf3b067ebfb7f75a665. Resources: {'key_pairs'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:59:08.439522 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-f40de915-8a5f-41a6-8a09-d8b954439935 tempest-ServersTestManualDisk-348092951 tempest-ServersTestManualDisk-348092951-project] Getting quotas for user 3db25b302b814545af32ae984cae4804 and project 96a652e7ee9d4bf3b067ebfb7f75a665. Resources: {'key_pairs'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:59:08.634086 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-f40de915-8a5f-41a6-8a09-d8b954439935 tempest-ServersTestManualDisk-348092951 tempest-ServersTestManualDisk-348092951-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.416548 Aug 10 17:59:08.634302 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 911/1788] 10.222.0.50 () {60 vars in 1159 bytes} [Wed Aug 10 17:59:08 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:59:09.136524 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-ae79d157-c600-4fa3-93f1-642b4ca0af43 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:59:09.138348 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-ae79d157-c600-4fa3-93f1-642b4ca0af43 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] [instance: 753bb23d-ad3b-4fc0-be8f-fed753940dde] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:59:09.167536 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-ae79d157-c600-4fa3-93f1-642b4ca0af43 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:59:09.167536 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-ae79d157-c600-4fa3-93f1-642b4ca0af43 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:59:09.167536 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-ae79d157-c600-4fa3-93f1-642b4ca0af43 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:59:09.167536 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-ae79d157-c600-4fa3-93f1-642b4ca0af43 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:59:09.167536 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-ae79d157-c600-4fa3-93f1-642b4ca0af43 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:59:09.167536 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-ae79d157-c600-4fa3-93f1-642b4ca0af43 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:59:09.167536 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_cell1:SELECT=61 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:59:09.289190 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-ae79d157-c600-4fa3-93f1-642b4ca0af43 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99171d2ccde4a108b820c7ce2aa3ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4f95a4b9a4417da0b00d881dee9481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:09.304003 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-ae79d157-c600-4fa3-93f1-642b4ca0af43 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a99171d2ccde4a108b820c7ce2aa3ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4f95a4b9a4417da0b00d881dee9481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:09.305977 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-ae79d157-c600-4fa3-93f1-642b4ca0af43 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a99171d2ccde4a108b820c7ce2aa3ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4f95a4b9a4417da0b00d881dee9481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:09.310776 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-ae79d157-c600-4fa3-93f1-642b4ca0af43 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] 10.222.0.50 "GET /compute/v2.1/servers/753bb23d-ad3b-4fc0-be8f-fed753940dde" status: 200 len: 1409 microversion: 2.54 time: 0.179042 Aug 10 17:59:09.337613 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 878/1789] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:59:09 2022] GET /compute/v2.1/servers/753bb23d-ad3b-4fc0-be8f-fed753940dde => generated 1409 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:59:10.342174 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-3966402b-8f8b-4683-af03-615f83b5047a tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:59:10.342804 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-3966402b-8f8b-4683-af03-615f83b5047a tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] [instance: 753bb23d-ad3b-4fc0-be8f-fed753940dde] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:59:10.352549 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-3966402b-8f8b-4683-af03-615f83b5047a tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:59:10.353065 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-3966402b-8f8b-4683-af03-615f83b5047a tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:59:10.353511 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-3966402b-8f8b-4683-af03-615f83b5047a tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:59:10.354239 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-3966402b-8f8b-4683-af03-615f83b5047a tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:59:10.363946 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-3966402b-8f8b-4683-af03-615f83b5047a tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:59:10.365769 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-3966402b-8f8b-4683-af03-615f83b5047a tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:59:10.374171 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:59:10.848469 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-3966402b-8f8b-4683-af03-615f83b5047a tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99171d2ccde4a108b820c7ce2aa3ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4f95a4b9a4417da0b00d881dee9481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:10.857559 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-3966402b-8f8b-4683-af03-615f83b5047a tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a99171d2ccde4a108b820c7ce2aa3ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4f95a4b9a4417da0b00d881dee9481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:10.865533 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-3966402b-8f8b-4683-af03-615f83b5047a tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a99171d2ccde4a108b820c7ce2aa3ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4f95a4b9a4417da0b00d881dee9481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:10.874074 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-3966402b-8f8b-4683-af03-615f83b5047a tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] 10.222.0.50 "GET /compute/v2.1/servers/753bb23d-ad3b-4fc0-be8f-fed753940dde" status: 200 len: 1409 microversion: 2.54 time: 0.536108 Aug 10 17:59:10.879477 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 912/1790] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:59:10 2022] GET /compute/v2.1/servers/753bb23d-ad3b-4fc0-be8f-fed753940dde => generated 1409 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:59:11.254882 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-b7ebc6ae-f030-4ed9-a073-3fc7d1e942a7 tempest-ServerRescueNegativeTestJSON-2100754559 tempest-ServerRescueNegativeTestJSON-2100754559-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1816187442", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:59:11.408404 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.network.neutron [None req-b7ebc6ae-f030-4ed9-a073-3fc7d1e942a7 tempest-ServerRescueNegativeTestJSON-2100754559 tempest-ServerRescueNegativeTestJSON-2100754559-project] validate_networks() for [('0413a975-aa68-4ca2-9b3b-a5ebb79619ab', None, None, None, None, None)] {{(pid=129410) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 17:59:11.835684 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [None req-b7ebc6ae-f030-4ed9-a073-3fc7d1e942a7 tempest-ServerRescueNegativeTestJSON-2100754559 tempest-ServerRescueNegativeTestJSON-2100754559-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-9f51aae2-4074-4501-815f-3eedad437aba) Aug 10 17:59:11.835684 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:59:11.835684 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:59:11.835684 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:59:11.835684 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:59:11.835684 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:59:11.835684 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:59:11.835684 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:59:11.835684 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:59:11.835684 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:59:11.835684 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 17:59:11.835684 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 17:59:11.835684 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 17:59:11.835684 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 17:59:11.835684 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 17:59:11.835684 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 17:59:11.835684 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 17:59:11.835684 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 17:59:11.835684 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 17:59:11.835684 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 17:59:11.835684 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 17:59:11.835684 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 17:59:11.835684 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 17:59:11.835684 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 17:59:11.835684 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 17:59:11.835684 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 17:59:11.835684 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 17:59:11.835684 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:59:11.835684 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:59:11.835684 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 17:59:11.835684 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 17:59:11.835684 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:59:11.835684 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:59:11.835684 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:59:11.835684 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:59:11.835684 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:59:11.835684 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:59:11.835684 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:59:11.835684 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:59:11.835684 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:59:11.835684 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:59:11.835684 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 17:59:11.835684 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 17:59:11.835684 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 17:59:11.835684 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 17:59:11.835684 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 17:59:11.835684 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 17:59:11.835684 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 17:59:11.835684 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 17:59:11.835684 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 17:59:11.835684 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 17:59:11.835684 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 17:59:11.840287 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 17:59:11.840287 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 17:59:11.840287 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 17:59:11.840287 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 17:59:11.840287 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 17:59:11.840287 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 17:59:11.840287 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 17:59:11.840287 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 17:59:11.840287 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 17:59:11.840287 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 17:59:11.840287 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 17:59:11.840287 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 17:59:11.840287 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 17:59:11.840287 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 17:59:11.840287 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 17:59:11.840287 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-9f51aae2-4074-4501-815f-3eedad437aba) Aug 10 17:59:11.840287 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:59:11.840287 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-b7ebc6ae-f030-4ed9-a073-3fc7d1e942a7 tempest-ServerRescueNegativeTestJSON-2100754559 tempest-ServerRescueNegativeTestJSON-2100754559-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:59:11.840287 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 17:59:11.840287 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-b7ebc6ae-f030-4ed9-a073-3fc7d1e942a7 tempest-ServerRescueNegativeTestJSON-2100754559 tempest-ServerRescueNegativeTestJSON-2100754559-project] Request method failure captured: Aug 10 17:59:11.840287 n-d-852296-2 devstack@n-api.service[129410]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 17:59:11.840287 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 17:59:11.840287 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 17:59:11.840287 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 17:59:11.840287 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 246 Aug 10 17:59:11.840287 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 17:59:11.840287 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 17:59:11.840287 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 17:59:11.840287 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 17:59:11.840287 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8_HueQbPhAD-LHc_8000IB8LdpxEas2U0NAsO0N4jgd75i4zaMgQABN4W6aft0eb_IVP7MnowNgM1atgeTiwu5mZRMD86R2bOMFmXZpti8Ukto7QRVeyyobc3DcZEEHtweN7DX4dw3Ab-kaHs5LhLe4BHWx-opcVr8BWE4YGfp5CI64 Aug 10 17:59:11.840287 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 17:59:11.840287 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 17:59:11.840287 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 17:59:11.840287 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 17:59:11.840287 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 17:59:11.840287 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 17:59:11.840287 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: 5b6c53d24bf9404b84a64201707905cc Aug 10 17:59:11.840287 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2100754559 Aug 10 17:59:11.840287 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 17:59:11.840287 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 17:59:11.840287 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5b6c53d24bf9404b84a64201707905cc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/5b6c53d24bf9404b84a64201707905cc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5b6c53d24bf9404b84a64201707905cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_5b6c53d24bf9404b84a64201707905cc", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:59:11.840287 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2100754559 Aug 10 17:59:11.840287 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: 5b6c53d24bf9404b84a64201707905cc Aug 10 17:59:11.840287 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2100754559 Aug 10 17:59:11.840287 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-ServerRescueNegativeTestJSON-2100754559-project Aug 10 17:59:11.840287 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 17:59:11.840287 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 17:59:11.840287 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: c6235c29958a4626b8e822220f96c1c7 Aug 10 17:59:11.840287 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2100754559-project Aug 10 17:59:11.840287 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 17:59:11.840287 n-d-852296-2 devstack@n-api.service[129410]: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1816187442", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "adminPass": "N7!N!3cRU7n4qLS", "networks": [{"uuid": "0413a975-aa68-4ca2-9b3b-a5ebb79619ab"}]}} Aug 10 17:59:11.840287 n-d-852296-2 devstack@n-api.service[129410]: method: > Aug 10 17:59:11.840287 n-d-852296-2 devstack@n-api.service[129410]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:59:11.840287 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 17:59:11.845594 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'body': {'server': {'name': 'tempest-ServerRescueNegativeTestJSON-server-1816187442', 'imageRef': 'a735ff26-463a-4ffe-a981-ab9d9baa494f', 'flavorRef': '452', 'adminPass': 'N7!N!3cRU7n4qLS', 'networks': [{'uuid': '0413a975-aa68-4ca2-9b3b-a5ebb79619ab'}]}}} Aug 10 17:59:11.845594 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:59:11.845594 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:59:11.845594 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:59:11.845594 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:59:11.845594 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:59:11.845594 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:59:11.845594 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:59:11.845594 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:59:11.845594 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:59:11.845594 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:59:11.845594 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 17:59:11.845594 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 17:59:11.845594 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 17:59:11.845594 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 17:59:11.845594 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 17:59:11.845594 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 17:59:11.845594 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 17:59:11.845594 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 17:59:11.845594 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 17:59:11.845594 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 17:59:11.845594 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 17:59:11.845594 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 17:59:11.845594 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 17:59:11.845594 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 17:59:11.845594 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 17:59:11.845594 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 17:59:11.845594 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 17:59:11.845594 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:59:11.845594 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:59:11.845594 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 17:59:11.845594 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 17:59:11.845594 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:59:11.845594 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:59:11.845594 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:59:11.845594 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:59:11.845594 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:59:11.845594 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:59:11.845594 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:59:11.845594 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:59:11.845594 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:59:11.845594 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:59:11.845594 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 17:59:11.845594 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 17:59:11.845594 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 17:59:11.845594 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 17:59:11.845594 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 17:59:11.845594 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 17:59:11.845594 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 17:59:11.845594 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 17:59:11.845594 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 17:59:11.845594 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 17:59:11.845594 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 17:59:11.845594 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 17:59:11.845594 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 17:59:11.858498 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 17:59:11.858498 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 17:59:11.858498 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 17:59:11.858498 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 17:59:11.858498 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 17:59:11.858498 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 17:59:11.858498 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 17:59:11.858498 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 17:59:11.858498 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 17:59:11.858498 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 17:59:11.858498 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 17:59:11.858498 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 17:59:11.858498 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 17:59:11.858498 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-9f51aae2-4074-4501-815f-3eedad437aba) Aug 10 17:59:11.858498 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:59:11.858498 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:59:11.858498 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:59:11.858498 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:59:11.858498 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:59:11.858498 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:59:11.858498 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:59:11.858498 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:59:11.858498 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 10 17:59:11.858498 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 10 17:59:11.858498 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:59:11.858498 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:59:11.858498 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:59:11.858498 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:59:11.858498 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:59:11.858498 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:59:11.858498 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:59:11.858498 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:59:11.858498 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:59:11.858498 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:59:11.858498 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:59:11.858498 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:59:11.858498 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:59:11.858498 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-b7ebc6ae-f030-4ed9-a073-3fc7d1e942a7 tempest-ServerRescueNegativeTestJSON-2100754559 tempest-ServerRescueNegativeTestJSON-2100754559-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:59:11.858498 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:59:11.858498 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-b7ebc6ae-f030-4ed9-a073-3fc7d1e942a7 tempest-ServerRescueNegativeTestJSON-2100754559 tempest-ServerRescueNegativeTestJSON-2100754559-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.757871 Aug 10 17:59:11.858498 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 879/1791] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 17:59:11 2022] POST /compute/v2.1/servers => generated 214 bytes in 759 msecs (HTTP/1.1 500) 9 headers in 391 bytes (2 switches on core 0) Aug 10 17:59:11.905030 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-dd2d691c-87e7-4b96-9d11-ae14f8b234a7 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:59:11.905693 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-dd2d691c-87e7-4b96-9d11-ae14f8b234a7 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] [instance: 753bb23d-ad3b-4fc0-be8f-fed753940dde] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:59:11.921372 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-dd2d691c-87e7-4b96-9d11-ae14f8b234a7 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:59:11.921885 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-dd2d691c-87e7-4b96-9d11-ae14f8b234a7 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:59:11.922335 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-dd2d691c-87e7-4b96-9d11-ae14f8b234a7 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:59:11.924727 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-dd2d691c-87e7-4b96-9d11-ae14f8b234a7 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:59:11.924727 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-dd2d691c-87e7-4b96-9d11-ae14f8b234a7 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:59:11.924727 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-dd2d691c-87e7-4b96-9d11-ae14f8b234a7 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:59:12.196439 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-dd2d691c-87e7-4b96-9d11-ae14f8b234a7 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99171d2ccde4a108b820c7ce2aa3ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4f95a4b9a4417da0b00d881dee9481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:12.212030 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-dd2d691c-87e7-4b96-9d11-ae14f8b234a7 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a99171d2ccde4a108b820c7ce2aa3ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4f95a4b9a4417da0b00d881dee9481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:12.221682 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-dd2d691c-87e7-4b96-9d11-ae14f8b234a7 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a99171d2ccde4a108b820c7ce2aa3ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4f95a4b9a4417da0b00d881dee9481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:12.223210 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-dd2d691c-87e7-4b96-9d11-ae14f8b234a7 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] 10.222.0.50 "GET /compute/v2.1/servers/753bb23d-ad3b-4fc0-be8f-fed753940dde" status: 200 len: 1409 microversion: 2.54 time: 0.323917 Aug 10 17:59:12.228541 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 913/1792] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:59:11 2022] GET /compute/v2.1/servers/753bb23d-ad3b-4fc0-be8f-fed753940dde => generated 1409 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:59:13.248771 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-3e57a374-02ac-45ad-baee-813d5126f403 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:59:13.249997 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-3e57a374-02ac-45ad-baee-813d5126f403 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] [instance: 753bb23d-ad3b-4fc0-be8f-fed753940dde] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:59:13.270231 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-3e57a374-02ac-45ad-baee-813d5126f403 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:59:13.270741 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-3e57a374-02ac-45ad-baee-813d5126f403 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:59:13.271193 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-3e57a374-02ac-45ad-baee-813d5126f403 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:59:13.271922 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-3e57a374-02ac-45ad-baee-813d5126f403 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:59:13.272423 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-3e57a374-02ac-45ad-baee-813d5126f403 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:59:13.272861 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-3e57a374-02ac-45ad-baee-813d5126f403 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:59:13.541143 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-3e57a374-02ac-45ad-baee-813d5126f403 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99171d2ccde4a108b820c7ce2aa3ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4f95a4b9a4417da0b00d881dee9481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:13.555685 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-3e57a374-02ac-45ad-baee-813d5126f403 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a99171d2ccde4a108b820c7ce2aa3ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4f95a4b9a4417da0b00d881dee9481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:13.557541 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-3e57a374-02ac-45ad-baee-813d5126f403 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a99171d2ccde4a108b820c7ce2aa3ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4f95a4b9a4417da0b00d881dee9481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:13.565026 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-3e57a374-02ac-45ad-baee-813d5126f403 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] 10.222.0.50 "GET /compute/v2.1/servers/753bb23d-ad3b-4fc0-be8f-fed753940dde" status: 200 len: 1409 microversion: 2.54 time: 0.321064 Aug 10 17:59:13.566040 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 880/1793] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:59:13 2022] GET /compute/v2.1/servers/753bb23d-ad3b-4fc0-be8f-fed753940dde => generated 1409 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:59:13.713374 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-eda2568c-3cfe-45e8-813d-239e2b9a32fe tempest-AttachVolumeTestJSON-828505371 tempest-AttachVolumeTestJSON-828505371-project] Action: 'create', calling method: .version_select at 0x7fb345d9b040>, body: {"keypair": {"name": "tempest-keypair-1947327259", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPiiuY5glfPFmtKaeM5BnqAsXCZkCDHXE52iAmrTIOEJWGnlo+3DJnVyS1tA/qC9VuwQmfzqeBIsar7mOWKL4uOlTEIJl6ADtEE59VUTxahBz+znx05DnfVf/6tV1heAQA=="}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:59:13.760165 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-eda2568c-3cfe-45e8-813d-239e2b9a32fe tempest-AttachVolumeTestJSON-828505371 tempest-AttachVolumeTestJSON-828505371-project] Getting quotas for project 2e2dbac423fc4f6296b1d5bca148dd22. Resources: {'key_pairs'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:59:13.780341 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-eda2568c-3cfe-45e8-813d-239e2b9a32fe tempest-AttachVolumeTestJSON-828505371 tempest-AttachVolumeTestJSON-828505371-project] Getting quotas for user ecf05b05d0e948e3867f0e9b479dd0f4 and project 2e2dbac423fc4f6296b1d5bca148dd22. Resources: {'key_pairs'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:59:13.948232 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-eda2568c-3cfe-45e8-813d-239e2b9a32fe tempest-AttachVolumeTestJSON-828505371 tempest-AttachVolumeTestJSON-828505371-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.375831 Aug 10 17:59:13.949221 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 914/1794] 10.222.0.50 () {60 vars in 1159 bytes} [Wed Aug 10 17:59:13 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:59:14.593904 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-b7ab3dd4-d0b4-4207-b6c9-d2c6733ab70d tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:59:14.595205 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-b7ab3dd4-d0b4-4207-b6c9-d2c6733ab70d tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] [instance: 753bb23d-ad3b-4fc0-be8f-fed753940dde] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:59:14.606035 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b7ab3dd4-d0b4-4207-b6c9-d2c6733ab70d tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:59:14.606637 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b7ab3dd4-d0b4-4207-b6c9-d2c6733ab70d tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:59:14.607106 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b7ab3dd4-d0b4-4207-b6c9-d2c6733ab70d tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:59:14.607830 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b7ab3dd4-d0b4-4207-b6c9-d2c6733ab70d tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:59:14.614008 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b7ab3dd4-d0b4-4207-b6c9-d2c6733ab70d tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:59:14.617994 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b7ab3dd4-d0b4-4207-b6c9-d2c6733ab70d tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:59:15.170529 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-b7ab3dd4-d0b4-4207-b6c9-d2c6733ab70d tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99171d2ccde4a108b820c7ce2aa3ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4f95a4b9a4417da0b00d881dee9481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:15.186545 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-b7ab3dd4-d0b4-4207-b6c9-d2c6733ab70d tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a99171d2ccde4a108b820c7ce2aa3ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4f95a4b9a4417da0b00d881dee9481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:15.189901 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-b7ab3dd4-d0b4-4207-b6c9-d2c6733ab70d tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a99171d2ccde4a108b820c7ce2aa3ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4f95a4b9a4417da0b00d881dee9481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:15.194409 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-b7ab3dd4-d0b4-4207-b6c9-d2c6733ab70d tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] 10.222.0.50 "GET /compute/v2.1/servers/753bb23d-ad3b-4fc0-be8f-fed753940dde" status: 200 len: 1409 microversion: 2.54 time: 0.604838 Aug 10 17:59:15.202417 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 881/1795] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:59:14 2022] GET /compute/v2.1/servers/753bb23d-ad3b-4fc0-be8f-fed753940dde => generated 1409 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:59:16.228520 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-6b68500e-5d53-4297-b47e-8c3891985e34 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:59:16.229777 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-6b68500e-5d53-4297-b47e-8c3891985e34 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] [instance: 753bb23d-ad3b-4fc0-be8f-fed753940dde] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:59:16.245537 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-6b68500e-5d53-4297-b47e-8c3891985e34 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:59:16.248068 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-6b68500e-5d53-4297-b47e-8c3891985e34 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:59:16.248068 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-6b68500e-5d53-4297-b47e-8c3891985e34 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:59:16.248068 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-6b68500e-5d53-4297-b47e-8c3891985e34 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:59:16.248068 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-6b68500e-5d53-4297-b47e-8c3891985e34 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:59:16.248068 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-6b68500e-5d53-4297-b47e-8c3891985e34 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:59:16.470142 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-6b68500e-5d53-4297-b47e-8c3891985e34 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99171d2ccde4a108b820c7ce2aa3ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4f95a4b9a4417da0b00d881dee9481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:16.479520 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-6b68500e-5d53-4297-b47e-8c3891985e34 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a99171d2ccde4a108b820c7ce2aa3ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4f95a4b9a4417da0b00d881dee9481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:16.481839 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-6b68500e-5d53-4297-b47e-8c3891985e34 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a99171d2ccde4a108b820c7ce2aa3ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4f95a4b9a4417da0b00d881dee9481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:16.483057 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-6b68500e-5d53-4297-b47e-8c3891985e34 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] 10.222.0.50 "GET /compute/v2.1/servers/753bb23d-ad3b-4fc0-be8f-fed753940dde" status: 200 len: 1409 microversion: 2.54 time: 0.258620 Aug 10 17:59:16.510562 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 915/1796] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:59:16 2022] GET /compute/v2.1/servers/753bb23d-ad3b-4fc0-be8f-fed753940dde => generated 1409 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:59:17.516542 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-d631dde8-20a6-4fc0-b06a-d4ead6a69628 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:59:17.517417 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-d631dde8-20a6-4fc0-b06a-d4ead6a69628 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] [instance: 753bb23d-ad3b-4fc0-be8f-fed753940dde] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:59:17.535780 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d631dde8-20a6-4fc0-b06a-d4ead6a69628 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:59:17.538744 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d631dde8-20a6-4fc0-b06a-d4ead6a69628 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:59:17.539345 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d631dde8-20a6-4fc0-b06a-d4ead6a69628 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:59:17.540217 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d631dde8-20a6-4fc0-b06a-d4ead6a69628 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:59:17.541962 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d631dde8-20a6-4fc0-b06a-d4ead6a69628 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:59:17.544545 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d631dde8-20a6-4fc0-b06a-d4ead6a69628 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:59:17.652996 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-0870bb6b-8bac-45ff-bce8-c427a42d2079 tempest-ServersTestManualDisk-348092951 tempest-ServersTestManualDisk-348092951-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-1148963335", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "a2155fd7-1549-46f8-9282-c749a67dfbdf"}], "security_groups": [{"name": "tempest-securitygroup--1397640130"}], "key_name": "tempest-keypair-179470627", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:59:17.738599 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-d631dde8-20a6-4fc0-b06a-d4ead6a69628 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99171d2ccde4a108b820c7ce2aa3ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4f95a4b9a4417da0b00d881dee9481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:17.752070 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-d631dde8-20a6-4fc0-b06a-d4ead6a69628 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a99171d2ccde4a108b820c7ce2aa3ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4f95a4b9a4417da0b00d881dee9481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:17.764606 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-d631dde8-20a6-4fc0-b06a-d4ead6a69628 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a99171d2ccde4a108b820c7ce2aa3ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4f95a4b9a4417da0b00d881dee9481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:17.768769 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-d631dde8-20a6-4fc0-b06a-d4ead6a69628 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] 10.222.0.50 "GET /compute/v2.1/servers/753bb23d-ad3b-4fc0-be8f-fed753940dde" status: 200 len: 1409 microversion: 2.54 time: 0.258268 Aug 10 17:59:17.772442 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 882/1797] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:59:17 2022] GET /compute/v2.1/servers/753bb23d-ad3b-4fc0-be8f-fed753940dde => generated 1409 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:59:17.956829 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.network.neutron [None req-0870bb6b-8bac-45ff-bce8-c427a42d2079 tempest-ServersTestManualDisk-348092951 tempest-ServersTestManualDisk-348092951-project] validate_networks() for [('a2155fd7-1549-46f8-9282-c749a67dfbdf', None, None, None, None, None)] {{(pid=129409) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 17:59:18.434935 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [None req-0870bb6b-8bac-45ff-bce8-c427a42d2079 tempest-ServersTestManualDisk-348092951 tempest-ServersTestManualDisk-348092951-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-ee7a14ad-c9bf-4b65-bc64-54d4d6668604) Aug 10 17:59:18.434935 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:59:18.434935 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:59:18.434935 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:59:18.434935 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:59:18.434935 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:59:18.434935 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:59:18.434935 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:59:18.434935 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:59:18.434935 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:59:18.434935 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 17:59:18.434935 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 17:59:18.434935 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 17:59:18.434935 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 17:59:18.434935 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 17:59:18.434935 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 17:59:18.434935 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 17:59:18.434935 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 17:59:18.434935 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 17:59:18.434935 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 17:59:18.434935 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 17:59:18.434935 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 17:59:18.434935 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 17:59:18.434935 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 17:59:18.434935 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 17:59:18.434935 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 17:59:18.434935 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 17:59:18.434935 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:59:18.434935 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:59:18.434935 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 17:59:18.434935 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 17:59:18.434935 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:59:18.434935 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:59:18.434935 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:59:18.434935 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:59:18.434935 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:59:18.434935 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:59:18.434935 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:59:18.434935 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:59:18.434935 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:59:18.434935 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:59:18.434935 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 17:59:18.434935 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 17:59:18.434935 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 17:59:18.434935 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 17:59:18.434935 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 17:59:18.434935 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 17:59:18.434935 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 17:59:18.434935 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 17:59:18.434935 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 17:59:18.434935 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 17:59:18.434935 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 17:59:18.434935 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 17:59:18.438918 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 17:59:18.438918 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 17:59:18.438918 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 17:59:18.438918 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 17:59:18.438918 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 17:59:18.438918 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 17:59:18.438918 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 17:59:18.438918 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 17:59:18.438918 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 17:59:18.438918 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 17:59:18.438918 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 17:59:18.438918 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 17:59:18.438918 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 17:59:18.438918 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 17:59:18.438918 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-ee7a14ad-c9bf-4b65-bc64-54d4d6668604) Aug 10 17:59:18.438918 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:59:18.438918 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-0870bb6b-8bac-45ff-bce8-c427a42d2079 tempest-ServersTestManualDisk-348092951 tempest-ServersTestManualDisk-348092951-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:59:18.438918 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:59:18.438918 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-0870bb6b-8bac-45ff-bce8-c427a42d2079 tempest-ServersTestManualDisk-348092951 tempest-ServersTestManualDisk-348092951-project] Request method failure captured: Aug 10 17:59:18.438918 n-d-852296-2 devstack@n-api.service[129409]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 17:59:18.438918 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 17:59:18.438918 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 17:59:18.438918 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 17:59:18.438918 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 640 Aug 10 17:59:18.438918 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 17:59:18.438918 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 17:59:18.438918 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 17:59:18.438918 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 17:59:18.438918 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8_Hsn0hyTR3qUR00DT8WEgv9GvgnfLAC9O9wC07oTQ6-xRo84BhI59o5m1-6xpHhQVfagLNTebAAyE0ShJ8Ejk2dF3sDz6w8l1hsJlrZbgrUx3I3Q6tygxuRfh6y8vfuiXmqJ7cjv9bjAy3dY_z_lt6LepSnDzmupxM_ycXWsqcid7c Aug 10 17:59:18.438918 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 17:59:18.438918 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 17:59:18.438918 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 17:59:18.438918 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 17:59:18.438918 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 17:59:18.438918 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 17:59:18.438918 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: 96a652e7ee9d4bf3b067ebfb7f75a665 Aug 10 17:59:18.438918 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-ServersTestManualDisk-348092951 Aug 10 17:59:18.438918 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 17:59:18.438918 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 17:59:18.438918 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/96a652e7ee9d4bf3b067ebfb7f75a665"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/96a652e7ee9d4bf3b067ebfb7f75a665"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/96a652e7ee9d4bf3b067ebfb7f75a665"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_96a652e7ee9d4bf3b067ebfb7f75a665", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:59:18.438918 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-ServersTestManualDisk-348092951 Aug 10 17:59:18.438918 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: 96a652e7ee9d4bf3b067ebfb7f75a665 Aug 10 17:59:18.438918 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-ServersTestManualDisk-348092951 Aug 10 17:59:18.438918 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-ServersTestManualDisk-348092951-project Aug 10 17:59:18.438918 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 17:59:18.438918 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 17:59:18.438918 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: 3db25b302b814545af32ae984cae4804 Aug 10 17:59:18.438918 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-ServersTestManualDisk-348092951-project Aug 10 17:59:18.438918 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:59:18.438918 n-d-852296-2 devstack@n-api.service[129409]: {"server": {"name": "tempest-ServersTestManualDisk-server-1148963335", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "W5~fOtfzS%^8pqE", "networks": [{"uuid": "a2155fd7-1549-46f8-9282-c749a67dfbdf"}], "security_groups": [{"name": "tempest-securitygroup--1397640130"}], "key_name": "tempest-keypair-179470627", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "MANUAL"}} Aug 10 17:59:18.438918 n-d-852296-2 devstack@n-api.service[129409]: method: > Aug 10 17:59:18.438918 n-d-852296-2 devstack@n-api.service[129409]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:59:18.442675 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:59:18.442675 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'body': {'server': {'name': 'tempest-ServersTestManualDisk-server-1148963335', 'imageRef': 'a735ff26-463a-4ffe-a981-ab9d9baa494f', 'flavorRef': '452', 'metadata': {'hello': 'world'}, 'adminPass': 'W5~fOtfzS%^8pqE', 'networks': [{'uuid': 'a2155fd7-1549-46f8-9282-c749a67dfbdf'}], 'security_groups': [{'name': 'tempest-securitygroup--1397640130'}], 'key_name': 'tempest-keypair-179470627', 'user_data': 'IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo='}}} Aug 10 17:59:18.442675 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:59:18.442675 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:59:18.442675 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:59:18.442675 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:59:18.442675 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:59:18.442675 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:59:18.442675 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:59:18.442675 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:59:18.442675 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:59:18.442675 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:59:18.442675 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 17:59:18.442675 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 17:59:18.442675 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 17:59:18.442675 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 17:59:18.442675 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 17:59:18.442675 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 17:59:18.442675 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 17:59:18.442675 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 17:59:18.442675 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 17:59:18.442675 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 17:59:18.442675 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 17:59:18.442675 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 17:59:18.442675 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 17:59:18.442675 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 17:59:18.442675 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 17:59:18.442675 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 17:59:18.442675 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 17:59:18.442675 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:59:18.442675 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:59:18.442675 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 17:59:18.442675 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 17:59:18.442675 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:59:18.442675 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:59:18.442675 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:59:18.442675 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:59:18.442675 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:59:18.442675 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:59:18.442675 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:59:18.442675 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:59:18.442675 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:59:18.442675 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:59:18.442675 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 17:59:18.442675 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 17:59:18.442675 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 17:59:18.442675 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 17:59:18.442675 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 17:59:18.442675 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 17:59:18.442675 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 17:59:18.442675 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 17:59:18.442675 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 17:59:18.442675 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 17:59:18.449627 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 17:59:18.449627 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 17:59:18.449627 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 17:59:18.449627 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 17:59:18.449627 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 17:59:18.449627 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 17:59:18.449627 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 17:59:18.449627 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 17:59:18.449627 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 17:59:18.449627 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 17:59:18.449627 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 17:59:18.449627 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 17:59:18.449627 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 17:59:18.449627 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 17:59:18.449627 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 17:59:18.449627 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 17:59:18.449627 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-ee7a14ad-c9bf-4b65-bc64-54d4d6668604) Aug 10 17:59:18.449627 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:59:18.449627 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:59:18.449627 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:59:18.449627 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:59:18.449627 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:59:18.449627 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:59:18.449627 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:59:18.449627 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:59:18.449627 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 10 17:59:18.449627 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 10 17:59:18.449627 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:59:18.449627 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:59:18.449627 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:59:18.449627 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:59:18.449627 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:59:18.449627 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:59:18.449627 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:59:18.449627 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:59:18.449627 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:59:18.449627 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:59:18.449627 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:59:18.449627 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:59:18.449627 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:59:18.449627 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-0870bb6b-8bac-45ff-bce8-c427a42d2079 tempest-ServersTestManualDisk-348092951 tempest-ServersTestManualDisk-348092951-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:59:18.449627 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:59:18.449627 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-0870bb6b-8bac-45ff-bce8-c427a42d2079 tempest-ServersTestManualDisk-348092951 tempest-ServersTestManualDisk-348092951-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.792238 Aug 10 17:59:18.449627 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 916/1798] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 17:59:17 2022] POST /compute/v2.1/servers => generated 214 bytes in 797 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 10 17:59:18.452805 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-7a9aa717-1ef4-4c29-8dd4-3462e16e89eb tempest-ServersTestManualDisk-348092951 tempest-ServersTestManualDisk-348092951-project] Calling method '.version_select at 0x7fb345bd38b0>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:59:18.675015 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-7a9aa717-1ef4-4c29-8dd4-3462e16e89eb tempest-ServersTestManualDisk-348092951 tempest-ServersTestManualDisk-348092951-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-179470627" status: 202 len: 0 microversion: 2.1 time: 0.230363 Aug 10 17:59:18.676643 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 883/1799] 10.222.0.50 () {58 vars in 1218 bytes} [Wed Aug 10 17:59:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-179470627 => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 17:59:18.811229 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-8db13e67-fcca-482d-a560-3a431fa9d409 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:59:18.811229 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-8db13e67-fcca-482d-a560-3a431fa9d409 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] [instance: 753bb23d-ad3b-4fc0-be8f-fed753940dde] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:59:18.819818 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-8db13e67-fcca-482d-a560-3a431fa9d409 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:59:18.832476 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-8db13e67-fcca-482d-a560-3a431fa9d409 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:59:18.833420 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-8db13e67-fcca-482d-a560-3a431fa9d409 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:59:18.835218 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-8db13e67-fcca-482d-a560-3a431fa9d409 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:59:18.835928 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-8db13e67-fcca-482d-a560-3a431fa9d409 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:59:18.839048 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-8db13e67-fcca-482d-a560-3a431fa9d409 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:59:19.209554 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-8db13e67-fcca-482d-a560-3a431fa9d409 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99171d2ccde4a108b820c7ce2aa3ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4f95a4b9a4417da0b00d881dee9481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:19.223410 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-8db13e67-fcca-482d-a560-3a431fa9d409 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a99171d2ccde4a108b820c7ce2aa3ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4f95a4b9a4417da0b00d881dee9481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:19.225374 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-8db13e67-fcca-482d-a560-3a431fa9d409 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a99171d2ccde4a108b820c7ce2aa3ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4f95a4b9a4417da0b00d881dee9481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:19.228169 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-8db13e67-fcca-482d-a560-3a431fa9d409 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] 10.222.0.50 "GET /compute/v2.1/servers/753bb23d-ad3b-4fc0-be8f-fed753940dde" status: 200 len: 1415 microversion: 2.54 time: 0.426751 Aug 10 17:59:19.230047 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 917/1800] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:59:18 2022] GET /compute/v2.1/servers/753bb23d-ad3b-4fc0-be8f-fed753940dde => generated 1415 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:59:20.257703 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-08bee5ca-55f9-4d35-95c4-ec317efbd944 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:59:20.261761 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-08bee5ca-55f9-4d35-95c4-ec317efbd944 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] [instance: 753bb23d-ad3b-4fc0-be8f-fed753940dde] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:59:20.275753 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=2 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:59:20.280469 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-08bee5ca-55f9-4d35-95c4-ec317efbd944 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:59:20.282658 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-08bee5ca-55f9-4d35-95c4-ec317efbd944 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:59:20.284689 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-08bee5ca-55f9-4d35-95c4-ec317efbd944 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:59:20.285442 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-08bee5ca-55f9-4d35-95c4-ec317efbd944 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:59:20.287148 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-08bee5ca-55f9-4d35-95c4-ec317efbd944 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:59:20.288810 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-08bee5ca-55f9-4d35-95c4-ec317efbd944 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:59:20.357284 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-1eeef045-940b-4ace-93b6-e79b7a816f74 tempest-SecurityGroupsTestJSON-1015574949 tempest-SecurityGroupsTestJSON-1015574949-project] Action: 'create', calling method: .version_select at 0x7fb3459d6d30>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2037192411", "description": "tempest-description-880860802"}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:59:20.459137 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-08bee5ca-55f9-4d35-95c4-ec317efbd944 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99171d2ccde4a108b820c7ce2aa3ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4f95a4b9a4417da0b00d881dee9481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:20.478004 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-08bee5ca-55f9-4d35-95c4-ec317efbd944 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a99171d2ccde4a108b820c7ce2aa3ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4f95a4b9a4417da0b00d881dee9481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:20.481250 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-08bee5ca-55f9-4d35-95c4-ec317efbd944 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a99171d2ccde4a108b820c7ce2aa3ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4f95a4b9a4417da0b00d881dee9481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:20.482809 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-08bee5ca-55f9-4d35-95c4-ec317efbd944 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] 10.222.0.50 "GET /compute/v2.1/servers/753bb23d-ad3b-4fc0-be8f-fed753940dde" status: 200 len: 1415 microversion: 2.54 time: 0.229186 Aug 10 17:59:20.483558 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 918/1801] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:59:20 2022] GET /compute/v2.1/servers/753bb23d-ad3b-4fc0-be8f-fed753940dde => generated 1415 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 17:59:21.419062 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-1eeef045-940b-4ace-93b6-e79b7a816f74 tempest-SecurityGroupsTestJSON-1015574949 tempest-SecurityGroupsTestJSON-1015574949-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.216914 Aug 10 17:59:21.428789 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 884/1802] 10.222.0.50 () {60 vars in 1180 bytes} [Wed Aug 10 17:59:20 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:59:21.434819 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-76b0d00c-8cab-4b70-a553-73516321c4c1 tempest-SecurityGroupsTestJSON-1015574949 tempest-SecurityGroupsTestJSON-1015574949-project] Action: 'create', calling method: .version_select at 0x7fb345d1dee0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1202193132", "description": "tempest-description-1488603427"}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:59:21.517499 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-b1163c9a-0a09-4626-88bc-44f9e7827fc5 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:59:21.518519 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-b1163c9a-0a09-4626-88bc-44f9e7827fc5 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] [instance: 753bb23d-ad3b-4fc0-be8f-fed753940dde] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:59:21.527118 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b1163c9a-0a09-4626-88bc-44f9e7827fc5 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:59:21.527935 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b1163c9a-0a09-4626-88bc-44f9e7827fc5 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:59:21.528631 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b1163c9a-0a09-4626-88bc-44f9e7827fc5 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:59:21.529570 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b1163c9a-0a09-4626-88bc-44f9e7827fc5 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:59:21.530234 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b1163c9a-0a09-4626-88bc-44f9e7827fc5 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:59:21.530869 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b1163c9a-0a09-4626-88bc-44f9e7827fc5 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:59:21.866206 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-b1163c9a-0a09-4626-88bc-44f9e7827fc5 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99171d2ccde4a108b820c7ce2aa3ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4f95a4b9a4417da0b00d881dee9481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:21.882266 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-b1163c9a-0a09-4626-88bc-44f9e7827fc5 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a99171d2ccde4a108b820c7ce2aa3ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4f95a4b9a4417da0b00d881dee9481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:21.887551 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-b1163c9a-0a09-4626-88bc-44f9e7827fc5 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a99171d2ccde4a108b820c7ce2aa3ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4f95a4b9a4417da0b00d881dee9481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:21.888971 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-b1163c9a-0a09-4626-88bc-44f9e7827fc5 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] 10.222.0.50 "GET /compute/v2.1/servers/753bb23d-ad3b-4fc0-be8f-fed753940dde" status: 200 len: 1415 microversion: 2.54 time: 0.381153 Aug 10 17:59:21.905977 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 885/1803] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:59:21 2022] GET /compute/v2.1/servers/753bb23d-ad3b-4fc0-be8f-fed753940dde => generated 1415 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:59:22.869096 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-76b0d00c-8cab-4b70-a553-73516321c4c1 tempest-SecurityGroupsTestJSON-1015574949 tempest-SecurityGroupsTestJSON-1015574949-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 1.440004 Aug 10 17:59:22.882672 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 919/1804] 10.222.0.50 () {60 vars in 1180 bytes} [Wed Aug 10 17:59:21 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 1442 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:59:22.919188 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-4c1affea-3e9d-4266-b2f2-57de1494331a tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:59:22.919982 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-4c1affea-3e9d-4266-b2f2-57de1494331a tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] [instance: 753bb23d-ad3b-4fc0-be8f-fed753940dde] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:59:22.936153 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-4c1affea-3e9d-4266-b2f2-57de1494331a tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:59:22.936718 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-4c1affea-3e9d-4266-b2f2-57de1494331a tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:59:22.937137 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-4c1affea-3e9d-4266-b2f2-57de1494331a tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:59:22.937857 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-4c1affea-3e9d-4266-b2f2-57de1494331a tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:59:22.938460 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-4c1affea-3e9d-4266-b2f2-57de1494331a tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:59:22.938740 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-4c1affea-3e9d-4266-b2f2-57de1494331a tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:59:22.950576 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-f2074b45-a98d-4c56-be91-cc27f4413cb1 tempest-SecurityGroupsTestJSON-1015574949 tempest-SecurityGroupsTestJSON-1015574949-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1805882898", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "3e5deeb2-598f-46b2-82c7-15e5b5515127"}]}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:59:23.068862 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.network.neutron [None req-f2074b45-a98d-4c56-be91-cc27f4413cb1 tempest-SecurityGroupsTestJSON-1015574949 tempest-SecurityGroupsTestJSON-1015574949-project] validate_networks() for [('3e5deeb2-598f-46b2-82c7-15e5b5515127', None, None, None, None, None)] {{(pid=129409) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 17:59:23.087090 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-4c1affea-3e9d-4266-b2f2-57de1494331a tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99171d2ccde4a108b820c7ce2aa3ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4f95a4b9a4417da0b00d881dee9481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:23.099791 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-4c1affea-3e9d-4266-b2f2-57de1494331a tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a99171d2ccde4a108b820c7ce2aa3ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4f95a4b9a4417da0b00d881dee9481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:23.106576 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-4c1affea-3e9d-4266-b2f2-57de1494331a tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a99171d2ccde4a108b820c7ce2aa3ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4f95a4b9a4417da0b00d881dee9481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:23.107809 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-4c1affea-3e9d-4266-b2f2-57de1494331a tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] 10.222.0.50 "GET /compute/v2.1/servers/753bb23d-ad3b-4fc0-be8f-fed753940dde" status: 200 len: 1415 microversion: 2.54 time: 0.193557 Aug 10 17:59:23.111412 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 886/1805] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:59:22 2022] GET /compute/v2.1/servers/753bb23d-ad3b-4fc0-be8f-fed753940dde => generated 1415 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:59:23.571661 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-f276cf72-a69c-4122-b99e-872541bb18bc tempest-AttachVolumeTestJSON-828505371 tempest-AttachVolumeTestJSON-828505371-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-364819271", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "11229dd6-3fd8-4235-a564-1d5a149b3b7b"}], "security_groups": [{"name": "tempest-securitygroup--714230459"}], "key_name": "tempest-keypair-1947327259", "user_data": "}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:59:23.802356 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_cell0:SELECT=8 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:59:23.828840 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.network.neutron [None req-f276cf72-a69c-4122-b99e-872541bb18bc tempest-AttachVolumeTestJSON-828505371 tempest-AttachVolumeTestJSON-828505371-project] validate_networks() for [('11229dd6-3fd8-4235-a564-1d5a149b3b7b', None, None, None, None, None)] {{(pid=129410) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 17:59:24.146025 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [None req-f276cf72-a69c-4122-b99e-872541bb18bc tempest-AttachVolumeTestJSON-828505371 tempest-AttachVolumeTestJSON-828505371-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-3bdb2d1c-cd6c-4dd6-8598-bdfaeb39c928) Aug 10 17:59:24.146025 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:59:24.146025 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:59:24.146025 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:59:24.146025 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:59:24.146025 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:59:24.146025 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:59:24.146025 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:59:24.146025 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:59:24.146025 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:59:24.146025 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 17:59:24.146025 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 17:59:24.146025 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 17:59:24.146025 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 17:59:24.146025 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 17:59:24.146025 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 17:59:24.146025 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 17:59:24.146025 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 17:59:24.146025 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 17:59:24.146025 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 17:59:24.146025 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 17:59:24.146025 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 17:59:24.146025 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 17:59:24.146025 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 17:59:24.146025 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 17:59:24.146025 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 17:59:24.146025 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 17:59:24.146025 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:59:24.146025 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:59:24.146025 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 17:59:24.146025 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 17:59:24.146025 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:59:24.146025 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:59:24.146025 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:59:24.146025 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:59:24.146025 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:59:24.146025 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:59:24.146025 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:59:24.146025 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:59:24.146025 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:59:24.146025 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:59:24.146025 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 17:59:24.146025 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 17:59:24.146025 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 17:59:24.146025 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 17:59:24.146025 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 17:59:24.146025 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 17:59:24.146025 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 17:59:24.146025 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 17:59:24.146025 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 17:59:24.146025 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 17:59:24.146025 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 17:59:24.146025 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 17:59:24.149847 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 17:59:24.149847 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 17:59:24.149847 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 17:59:24.149847 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 17:59:24.149847 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 17:59:24.149847 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 17:59:24.149847 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 17:59:24.149847 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 17:59:24.149847 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 17:59:24.149847 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 17:59:24.149847 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 17:59:24.149847 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 17:59:24.149847 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 17:59:24.149847 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 17:59:24.149847 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-3bdb2d1c-cd6c-4dd6-8598-bdfaeb39c928) Aug 10 17:59:24.149847 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:59:24.149847 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-f276cf72-a69c-4122-b99e-872541bb18bc tempest-AttachVolumeTestJSON-828505371 tempest-AttachVolumeTestJSON-828505371-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:59:24.149847 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 17:59:24.158251 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-f276cf72-a69c-4122-b99e-872541bb18bc tempest-AttachVolumeTestJSON-828505371 tempest-AttachVolumeTestJSON-828505371-project] Request method failure captured: Aug 10 17:59:24.158251 n-d-852296-2 devstack@n-api.service[129410]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 17:59:24.158251 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 17:59:24.158251 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 17:59:24.158251 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 17:59:24.158251 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 484 Aug 10 17:59:24.158251 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 17:59:24.158251 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 17:59:24.158251 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 17:59:24.158251 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 17:59:24.158251 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8_HxSijsLEChzSy6WrMRSnFF2QUUxvZLUD6QC7jRJZ9eqs9tOtQWZT4eACv0TSu7-d36446JHP0Cqz_1_s5SR21b-pUmbRR-RD3OHMZlFWDVM1lfQEfPjIBU6u7Sf5OC8KNFV0_wiytAc7u_7T_m4m0UIzC8kHL9mjrhSh8kAtBhqkw Aug 10 17:59:24.158251 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 17:59:24.158251 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 17:59:24.158251 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 17:59:24.158251 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 17:59:24.158251 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 17:59:24.158251 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 17:59:24.158251 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: 2e2dbac423fc4f6296b1d5bca148dd22 Aug 10 17:59:24.158251 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-AttachVolumeTestJSON-828505371 Aug 10 17:59:24.158251 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 17:59:24.158251 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 17:59:24.158251 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2e2dbac423fc4f6296b1d5bca148dd22"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/2e2dbac423fc4f6296b1d5bca148dd22"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2e2dbac423fc4f6296b1d5bca148dd22"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_2e2dbac423fc4f6296b1d5bca148dd22", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:59:24.158251 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-AttachVolumeTestJSON-828505371 Aug 10 17:59:24.158251 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: 2e2dbac423fc4f6296b1d5bca148dd22 Aug 10 17:59:24.158251 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-AttachVolumeTestJSON-828505371 Aug 10 17:59:24.158251 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-AttachVolumeTestJSON-828505371-project Aug 10 17:59:24.158251 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 17:59:24.158251 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 17:59:24.158251 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: ecf05b05d0e948e3867f0e9b479dd0f4 Aug 10 17:59:24.158251 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-AttachVolumeTestJSON-828505371-project Aug 10 17:59:24.158251 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 17:59:24.158251 n-d-852296-2 devstack@n-api.service[129410]: {"server": {"name": "tempest-AttachVolumeTestJSON-server-364819271", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "adminPass": "password", "networks": [{"uuid": "11229dd6-3fd8-4235-a564-1d5a149b3b7b"}], "security_groups": [{"name": "tempest-securitygroup--714230459"}], "key_name": "tempest-keypair-1947327259", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} Aug 10 17:59:24.158251 n-d-852296-2 devstack@n-api.service[129410]: method: > Aug 10 17:59:24.158251 n-d-852296-2 devstack@n-api.service[129410]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:59:24.158251 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 17:59:24.158251 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'body': {'server': {'name': 'tempest-AttachVolumeTestJSON-server-364819271', 'imageRef': 'a735ff26-463a-4ffe-a981-ab9d9baa494f', 'flavorRef': '452', 'adminPass': 'password', 'networks': [{'uuid': '11229dd6-3fd8-4235-a564-1d5a149b3b7b'}], 'security_groups': [{'name': 'tempest-securitygroup--714230459'}], 'key_name': 'tempest-keypair-1947327259', 'user_data': 'IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo='}}} Aug 10 17:59:24.158251 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:59:24.158251 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:59:24.158251 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:59:24.158251 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:59:24.158251 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:59:24.158251 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:59:24.158251 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:59:24.158251 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:59:24.158251 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:59:24.158251 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:59:24.158251 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 17:59:24.158251 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 17:59:24.158251 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 17:59:24.158251 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 17:59:24.158251 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 17:59:24.158251 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 17:59:24.158251 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 17:59:24.158251 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 17:59:24.158251 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 17:59:24.158251 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 17:59:24.169508 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 17:59:24.169508 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 17:59:24.169508 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 17:59:24.169508 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 17:59:24.169508 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 17:59:24.169508 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 17:59:24.169508 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 17:59:24.169508 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:59:24.169508 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:59:24.169508 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 17:59:24.169508 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 17:59:24.169508 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:59:24.169508 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:59:24.169508 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:59:24.169508 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:59:24.169508 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:59:24.169508 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:59:24.169508 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:59:24.169508 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:59:24.169508 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:59:24.169508 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:59:24.169508 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 17:59:24.169508 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 17:59:24.169508 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 17:59:24.169508 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 17:59:24.169508 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 17:59:24.169508 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 17:59:24.169508 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 17:59:24.169508 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 17:59:24.169508 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 17:59:24.169508 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 17:59:24.169508 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 17:59:24.169508 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 17:59:24.169508 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 17:59:24.169508 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 17:59:24.169508 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 17:59:24.169508 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 17:59:24.169508 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 17:59:24.169508 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 17:59:24.169508 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 17:59:24.169508 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 17:59:24.169508 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 17:59:24.169508 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 17:59:24.169508 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 17:59:24.169508 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 17:59:24.169508 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 17:59:24.169508 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 17:59:24.169508 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-3bdb2d1c-cd6c-4dd6-8598-bdfaeb39c928) Aug 10 17:59:24.169508 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:59:24.169508 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:59:24.169508 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:59:24.169508 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:59:24.169508 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:59:24.181501 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:59:24.181501 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:59:24.181501 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:59:24.181501 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 10 17:59:24.181501 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 10 17:59:24.181501 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:59:24.181501 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:59:24.181501 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:59:24.181501 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:59:24.181501 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:59:24.181501 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:59:24.181501 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:59:24.181501 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:59:24.181501 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:59:24.181501 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:59:24.181501 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:59:24.181501 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:59:24.181501 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:59:24.181501 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-f276cf72-a69c-4122-b99e-872541bb18bc tempest-AttachVolumeTestJSON-828505371 tempest-AttachVolumeTestJSON-828505371-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:59:24.181501 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:59:24.181501 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-f276cf72-a69c-4122-b99e-872541bb18bc tempest-AttachVolumeTestJSON-828505371 tempest-AttachVolumeTestJSON-828505371-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.585126 Aug 10 17:59:24.181501 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 887/1806] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 17:59:23 2022] POST /compute/v2.1/servers => generated 214 bytes in 587 msecs (HTTP/1.1 500) 9 headers in 391 bytes (2 switches on core 0) Aug 10 17:59:24.181501 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-5661c66d-451f-4cec-89fe-b8bcd1a2eb5c tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:59:24.181501 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-5661c66d-451f-4cec-89fe-b8bcd1a2eb5c tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] [instance: 753bb23d-ad3b-4fc0-be8f-fed753940dde] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:59:24.181501 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-5661c66d-451f-4cec-89fe-b8bcd1a2eb5c tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:59:24.181501 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-5661c66d-451f-4cec-89fe-b8bcd1a2eb5c tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:59:24.181501 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-5661c66d-451f-4cec-89fe-b8bcd1a2eb5c tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:59:24.181501 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-5661c66d-451f-4cec-89fe-b8bcd1a2eb5c tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:59:24.181501 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-5661c66d-451f-4cec-89fe-b8bcd1a2eb5c tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:59:24.189318 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-5661c66d-451f-4cec-89fe-b8bcd1a2eb5c tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:59:24.215141 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [None req-f2074b45-a98d-4c56-be91-cc27f4413cb1 tempest-SecurityGroupsTestJSON-1015574949 tempest-SecurityGroupsTestJSON-1015574949-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-e43937ce-974d-4762-8502-398ee79d10af) Aug 10 17:59:24.215141 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:59:24.215141 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:59:24.215141 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:59:24.215141 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:59:24.215141 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:59:24.215141 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:59:24.215141 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:59:24.215141 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:59:24.215141 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:59:24.215141 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 17:59:24.215141 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 17:59:24.215141 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 17:59:24.215141 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 17:59:24.215141 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 17:59:24.215141 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 17:59:24.215141 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 17:59:24.215141 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 17:59:24.215141 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 17:59:24.215141 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 17:59:24.215141 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 17:59:24.215141 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 17:59:24.215141 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 17:59:24.215141 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 17:59:24.215141 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 17:59:24.215141 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 17:59:24.215141 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 17:59:24.215141 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:59:24.215141 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:59:24.215141 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 17:59:24.215141 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 17:59:24.215141 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:59:24.215141 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:59:24.215141 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:59:24.215141 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:59:24.215141 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:59:24.215141 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:59:24.215141 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:59:24.215141 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:59:24.215141 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:59:24.215141 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:59:24.215141 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 17:59:24.215141 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 17:59:24.215141 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 17:59:24.215141 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 17:59:24.215141 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 17:59:24.215141 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 17:59:24.215141 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 17:59:24.215141 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 17:59:24.215141 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 17:59:24.215141 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 17:59:24.215141 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 17:59:24.215141 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 17:59:24.219125 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 17:59:24.219125 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 17:59:24.219125 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 17:59:24.219125 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 17:59:24.219125 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 17:59:24.219125 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 17:59:24.219125 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 17:59:24.219125 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 17:59:24.219125 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 17:59:24.219125 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 17:59:24.219125 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 17:59:24.219125 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 17:59:24.219125 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 17:59:24.219125 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 17:59:24.219125 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-e43937ce-974d-4762-8502-398ee79d10af) Aug 10 17:59:24.219125 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:59:24.219125 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-f2074b45-a98d-4c56-be91-cc27f4413cb1 tempest-SecurityGroupsTestJSON-1015574949 tempest-SecurityGroupsTestJSON-1015574949-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:59:24.219125 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:59:24.219125 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-f2074b45-a98d-4c56-be91-cc27f4413cb1 tempest-SecurityGroupsTestJSON-1015574949 tempest-SecurityGroupsTestJSON-1015574949-project] Request method failure captured: Aug 10 17:59:24.219125 n-d-852296-2 devstack@n-api.service[129409]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 17:59:24.219125 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 17:59:24.219125 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 17:59:24.219125 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 17:59:24.219125 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 208 Aug 10 17:59:24.219125 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 17:59:24.219125 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 17:59:24.219125 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 17:59:24.219125 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 17:59:24.219125 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8_H41UWn8v8K3fsyKPT7OaQXoGJFLNxnh1ePGOtxVbMhdLgXNCNN0NrnCNtgHBi1CtlCNKZmx4uk6tgFgQhh5Xq_p7l3GA2mS-R_B8G_Y5ArxD2_QwnJBi-rWbEr_yOa6UfCPZWrf4NXKgoQqB992TY45ipTMzvSaJJ4v-Zc1ug8MJY Aug 10 17:59:24.219125 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 17:59:24.219125 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 17:59:24.219125 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 17:59:24.219125 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 17:59:24.219125 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 17:59:24.219125 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 17:59:24.219125 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: d463f2ef16c940a3bd99d9f79ae3e60d Aug 10 17:59:24.219125 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-SecurityGroupsTestJSON-1015574949 Aug 10 17:59:24.219125 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 17:59:24.219125 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 17:59:24.219125 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d463f2ef16c940a3bd99d9f79ae3e60d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d463f2ef16c940a3bd99d9f79ae3e60d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d463f2ef16c940a3bd99d9f79ae3e60d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d463f2ef16c940a3bd99d9f79ae3e60d", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:59:24.219125 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-SecurityGroupsTestJSON-1015574949 Aug 10 17:59:24.219125 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: d463f2ef16c940a3bd99d9f79ae3e60d Aug 10 17:59:24.219125 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1015574949 Aug 10 17:59:24.219125 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-SecurityGroupsTestJSON-1015574949-project Aug 10 17:59:24.219125 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 17:59:24.219125 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 17:59:24.219125 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: d38b40d915604752967356b497aee153 Aug 10 17:59:24.219125 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-SecurityGroupsTestJSON-1015574949-project Aug 10 17:59:24.219125 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:59:24.219125 n-d-852296-2 devstack@n-api.service[129409]: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1805882898", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "3e5deeb2-598f-46b2-82c7-15e5b5515127"}]}} Aug 10 17:59:24.219125 n-d-852296-2 devstack@n-api.service[129409]: method: > Aug 10 17:59:24.219125 n-d-852296-2 devstack@n-api.service[129409]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:59:24.219125 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:59:24.219125 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'body': {'server': {'name': 'tempest-SecurityGroupsTestJSON-server-1805882898', 'imageRef': 'a735ff26-463a-4ffe-a981-ab9d9baa494f', 'flavorRef': '452', 'networks': [{'uuid': '3e5deeb2-598f-46b2-82c7-15e5b5515127'}]}}} Aug 10 17:59:24.219125 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:59:24.224476 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:59:24.224476 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:59:24.224476 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:59:24.224476 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:59:24.224476 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:59:24.224476 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:59:24.224476 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:59:24.224476 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:59:24.224476 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:59:24.224476 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 17:59:24.224476 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 17:59:24.224476 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 17:59:24.224476 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 17:59:24.224476 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 17:59:24.224476 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 17:59:24.224476 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 17:59:24.224476 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 17:59:24.224476 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 17:59:24.224476 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 17:59:24.224476 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 17:59:24.224476 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 17:59:24.224476 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 17:59:24.224476 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 17:59:24.224476 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 17:59:24.224476 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 17:59:24.224476 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 17:59:24.224476 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:59:24.224476 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:59:24.224476 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 17:59:24.224476 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 17:59:24.224476 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:59:24.224476 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:59:24.224476 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:59:24.224476 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:59:24.224476 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:59:24.224476 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:59:24.224476 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:59:24.224476 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:59:24.224476 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:59:24.224476 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:59:24.224476 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 17:59:24.224476 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 17:59:24.224476 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 17:59:24.224476 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 17:59:24.224476 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 17:59:24.224476 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 17:59:24.224476 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 17:59:24.224476 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 17:59:24.224476 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 17:59:24.224476 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 17:59:24.224476 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 17:59:24.224476 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 17:59:24.224476 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 17:59:24.224476 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 17:59:24.224476 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 17:59:24.224476 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 17:59:24.238082 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 17:59:24.238082 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 17:59:24.238082 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 17:59:24.238082 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 17:59:24.238082 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 17:59:24.238082 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 17:59:24.238082 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 17:59:24.238082 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 17:59:24.238082 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 17:59:24.238082 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 17:59:24.238082 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-e43937ce-974d-4762-8502-398ee79d10af) Aug 10 17:59:24.238082 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:59:24.238082 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:59:24.238082 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:59:24.238082 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:59:24.238082 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:59:24.238082 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:59:24.238082 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:59:24.238082 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:59:24.238082 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 10 17:59:24.238082 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 10 17:59:24.238082 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:59:24.238082 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:59:24.238082 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:59:24.238082 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:59:24.238082 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:59:24.238082 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:59:24.238082 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:59:24.238082 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:59:24.238082 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:59:24.238082 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:59:24.238082 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:59:24.238082 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:59:24.238082 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:59:24.238082 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-f2074b45-a98d-4c56-be91-cc27f4413cb1 tempest-SecurityGroupsTestJSON-1015574949 tempest-SecurityGroupsTestJSON-1015574949-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:59:24.238082 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:59:24.238082 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-f2074b45-a98d-4c56-be91-cc27f4413cb1 tempest-SecurityGroupsTestJSON-1015574949 tempest-SecurityGroupsTestJSON-1015574949-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.274487 Aug 10 17:59:24.238082 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 920/1807] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 17:59:22 2022] POST /compute/v2.1/servers => generated 214 bytes in 1276 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 10 17:59:24.238082 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-94c611c8-1f39-4215-9a76-1d9734918372 tempest-AttachVolumeTestJSON-828505371 tempest-AttachVolumeTestJSON-828505371-project] Calling method '.version_select at 0x7fb345dfde50>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:59:24.287984 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-5661c66d-451f-4cec-89fe-b8bcd1a2eb5c tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99171d2ccde4a108b820c7ce2aa3ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4f95a4b9a4417da0b00d881dee9481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:24.307633 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-5661c66d-451f-4cec-89fe-b8bcd1a2eb5c tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a99171d2ccde4a108b820c7ce2aa3ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4f95a4b9a4417da0b00d881dee9481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:24.323773 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-5661c66d-451f-4cec-89fe-b8bcd1a2eb5c tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a99171d2ccde4a108b820c7ce2aa3ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4f95a4b9a4417da0b00d881dee9481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:24.325048 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-5661c66d-451f-4cec-89fe-b8bcd1a2eb5c tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] 10.222.0.50 "GET /compute/v2.1/servers/753bb23d-ad3b-4fc0-be8f-fed753940dde" status: 200 len: 1400 microversion: 2.54 time: 0.171109 Aug 10 17:59:24.345600 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 888/1808] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:59:24 2022] GET /compute/v2.1/servers/753bb23d-ad3b-4fc0-be8f-fed753940dde => generated 1400 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:59:24.351766 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-94734d0e-61a6-40ad-a4b2-96e773e17225 tempest-SecurityGroupsTestJSON-1015574949 tempest-SecurityGroupsTestJSON-1015574949-project] Action: 'create', calling method: .version_select at 0x7fb345c3c430>, body: {"security_group": {"name": " tempest-securitygroup -1344649629 ", "description": "tempest-description-1029225535"}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:59:24.509031 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-94c611c8-1f39-4215-9a76-1d9734918372 tempest-AttachVolumeTestJSON-828505371 tempest-AttachVolumeTestJSON-828505371-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1947327259" status: 202 len: 0 microversion: 2.1 time: 0.285479 Aug 10 17:59:24.509967 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 921/1809] 10.222.0.50 () {58 vars in 1221 bytes} [Wed Aug 10 17:59:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1947327259 => generated 0 bytes in 287 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 17:59:24.516943 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-6c6999bc-f989-43a1-8c97-1fd3b5bb1648 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Calling method '.version_select at 0x7fb345f1b430>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:59:24.685714 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-6c6999bc-f989-43a1-8c97-1fd3b5bb1648 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1987096964" status: 204 len: 0 microversion: 2.54 time: 0.174367 Aug 10 17:59:24.686972 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 922/1810] 10.222.0.50 () {60 vars in 1319 bytes} [Wed Aug 10 17:59:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1987096964 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 10 17:59:24.706158 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-7f12f0ce-e001-44b4-ba96-362d48c3034c tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:59:24.707162 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-7f12f0ce-e001-44b4-ba96-362d48c3034c tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] [instance: 753bb23d-ad3b-4fc0-be8f-fed753940dde] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:59:24.720799 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7f12f0ce-e001-44b4-ba96-362d48c3034c tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:59:24.723650 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7f12f0ce-e001-44b4-ba96-362d48c3034c tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:59:24.724407 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7f12f0ce-e001-44b4-ba96-362d48c3034c tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:59:24.726973 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7f12f0ce-e001-44b4-ba96-362d48c3034c tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:59:24.728275 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7f12f0ce-e001-44b4-ba96-362d48c3034c tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:59:24.732150 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-7f12f0ce-e001-44b4-ba96-362d48c3034c tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:59:24.795062 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-7f12f0ce-e001-44b4-ba96-362d48c3034c tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] [instance: 753bb23d-ad3b-4fc0-be8f-fed753940dde] Going to try to terminate instance {{(pid=129409) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 17:59:25.245099 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-94734d0e-61a6-40ad-a4b2-96e773e17225 tempest-SecurityGroupsTestJSON-1015574949 tempest-SecurityGroupsTestJSON-1015574949-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 224 microversion: 2.1 time: 0.897570 Aug 10 17:59:25.246579 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 889/1811] 10.222.0.50 () {60 vars in 1180 bytes} [Wed Aug 10 17:59:24 2022] POST /compute/v2.1/os-security-groups => generated 224 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:59:25.259123 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-68a70304-6e1f-41bd-9b94-2bae388bfd5f tempest-SecurityGroupsTestJSON-1015574949 tempest-SecurityGroupsTestJSON-1015574949-project] Calling method '.version_select at 0x7fb345bd3e50>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:59:25.371256 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-68a70304-6e1f-41bd-9b94-2bae388bfd5f tempest-SecurityGroupsTestJSON-1015574949 tempest-SecurityGroupsTestJSON-1015574949-project] 10.222.0.50 "GET /compute/v2.1/os-security-groups/c9a9a4fc-33da-44f1-a191-b6f13686ef78" status: 200 len: 224 microversion: 2.1 time: 0.115598 Aug 10 17:59:25.379374 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 890/1812] 10.222.0.50 () {58 vars in 1269 bytes} [Wed Aug 10 17:59:25 2022] GET /compute/v2.1/os-security-groups/c9a9a4fc-33da-44f1-a191-b6f13686ef78 => generated 224 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:59:25.384694 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-6d36dace-cc09-4317-a267-62f05db9422b tempest-SecurityGroupsTestJSON-1015574949 tempest-SecurityGroupsTestJSON-1015574949-project] Calling method '.version_select at 0x7fb345d9d160>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:59:25.431689 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-7f12f0ce-e001-44b4-ba96-362d48c3034c tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] 10.222.0.50 "DELETE /compute/v2.1/servers/753bb23d-ad3b-4fc0-be8f-fed753940dde" status: 204 len: 0 microversion: 2.54 time: 0.729340 Aug 10 17:59:25.432545 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 923/1813] 10.222.0.50 () {60 vars in 1280 bytes} [Wed Aug 10 17:59:24 2022] DELETE /compute/v2.1/servers/753bb23d-ad3b-4fc0-be8f-fed753940dde => generated 0 bytes in 731 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 10 17:59:25.443593 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-f6fcdbf1-3d57-464a-8e34-b25fd8a5b8d5 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:59:25.444337 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-f6fcdbf1-3d57-464a-8e34-b25fd8a5b8d5 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] [instance: 753bb23d-ad3b-4fc0-be8f-fed753940dde] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:59:25.470298 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-f6fcdbf1-3d57-464a-8e34-b25fd8a5b8d5 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:59:25.470797 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-f6fcdbf1-3d57-464a-8e34-b25fd8a5b8d5 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:59:25.471294 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-f6fcdbf1-3d57-464a-8e34-b25fd8a5b8d5 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:59:25.472019 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-f6fcdbf1-3d57-464a-8e34-b25fd8a5b8d5 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:59:25.492192 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-f6fcdbf1-3d57-464a-8e34-b25fd8a5b8d5 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:59:25.492192 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-f6fcdbf1-3d57-464a-8e34-b25fd8a5b8d5 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:59:25.695333 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-f6fcdbf1-3d57-464a-8e34-b25fd8a5b8d5 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99171d2ccde4a108b820c7ce2aa3ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4f95a4b9a4417da0b00d881dee9481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:25.727183 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-f6fcdbf1-3d57-464a-8e34-b25fd8a5b8d5 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a99171d2ccde4a108b820c7ce2aa3ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4f95a4b9a4417da0b00d881dee9481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:25.737454 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-f6fcdbf1-3d57-464a-8e34-b25fd8a5b8d5 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a99171d2ccde4a108b820c7ce2aa3ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4f95a4b9a4417da0b00d881dee9481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:25.739165 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-f6fcdbf1-3d57-464a-8e34-b25fd8a5b8d5 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] 10.222.0.50 "GET /compute/v2.1/servers/753bb23d-ad3b-4fc0-be8f-fed753940dde" status: 200 len: 1406 microversion: 2.54 time: 0.301519 Aug 10 17:59:25.740416 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 924/1814] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:59:25 2022] GET /compute/v2.1/servers/753bb23d-ad3b-4fc0-be8f-fed753940dde => generated 1406 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 17:59:26.122806 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-6d36dace-cc09-4317-a267-62f05db9422b tempest-SecurityGroupsTestJSON-1015574949 tempest-SecurityGroupsTestJSON-1015574949-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/c9a9a4fc-33da-44f1-a191-b6f13686ef78" status: 202 len: 0 microversion: 2.1 time: 0.741940 Aug 10 17:59:26.126782 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 891/1815] 10.222.0.50 () {58 vars in 1272 bytes} [Wed Aug 10 17:59:25 2022] DELETE /compute/v2.1/os-security-groups/c9a9a4fc-33da-44f1-a191-b6f13686ef78 => generated 0 bytes in 747 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 17:59:26.132838 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-565af235-0e68-46f6-b595-27d1e55395bb tempest-SecurityGroupsTestJSON-1015574949 tempest-SecurityGroupsTestJSON-1015574949-project] Calling method '.version_select at 0x7fb345dfdaf0>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:59:26.274412 n-d-852296-2 devstack@n-api.service[129409]: DEBUG neutronclient.v2_0.client [None req-565af235-0e68-46f6-b595-27d1e55395bb tempest-SecurityGroupsTestJSON-1015574949 tempest-SecurityGroupsTestJSON-1015574949-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c9a9a4fc-33da-44f1-a191-b6f13686ef78 does not exist", "detail": ""}} {{(pid=129409) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 10 17:59:26.275289 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.network.security_group_api [None req-565af235-0e68-46f6-b595-27d1e55395bb tempest-SecurityGroupsTestJSON-1015574949 tempest-SecurityGroupsTestJSON-1015574949-project] Neutron security group c9a9a4fc-33da-44f1-a191-b6f13686ef78 not found {{(pid=129409) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 10 17:59:26.278559 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-565af235-0e68-46f6-b595-27d1e55395bb tempest-SecurityGroupsTestJSON-1015574949 tempest-SecurityGroupsTestJSON-1015574949-project] HTTP exception thrown: Security group c9a9a4fc-33da-44f1-a191-b6f13686ef78 does not exist Aug 10 17:59:26.278559 n-d-852296-2 devstack@n-api.service[129409]: Neutron server returns request_ids: ['req-6019f97a-3e73-4f51-8bc6-892e961b4ead'] Aug 10 17:59:26.282836 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-565af235-0e68-46f6-b595-27d1e55395bb tempest-SecurityGroupsTestJSON-1015574949 tempest-SecurityGroupsTestJSON-1015574949-project] Request method failure captured: Aug 10 17:59:26.282836 n-d-852296-2 devstack@n-api.service[129409]: request: GET /compute/v2.1/os-security-groups/c9a9a4fc-33da-44f1-a191-b6f13686ef78 HTTP/1.1 Aug 10 17:59:26.282836 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 17:59:26.282836 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 17:59:26.282836 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 17:59:26.282836 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 0 Aug 10 17:59:26.282836 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 17:59:26.282836 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 17:59:26.282836 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 17:59:26.282836 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 17:59:26.282836 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8_H41UWn8v8K3fsyKPT7OaQXoGJFLNxnh1ePGOtxVbMhdLgXNCNN0NrnCNtgHBi1CtlCNKZmx4uk6tgFgQhh5Xq_p7l3GA2mS-R_B8G_Y5ArxD2_QwnJBi-rWbEr_yOa6UfCPZWrf4NXKgoQqB992TY45ipTMzvSaJJ4v-Zc1ug8MJY Aug 10 17:59:26.282836 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 17:59:26.282836 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 17:59:26.282836 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 17:59:26.282836 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 17:59:26.282836 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 17:59:26.282836 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 17:59:26.282836 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: d463f2ef16c940a3bd99d9f79ae3e60d Aug 10 17:59:26.282836 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-SecurityGroupsTestJSON-1015574949 Aug 10 17:59:26.282836 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 17:59:26.282836 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 17:59:26.282836 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d463f2ef16c940a3bd99d9f79ae3e60d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d463f2ef16c940a3bd99d9f79ae3e60d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d463f2ef16c940a3bd99d9f79ae3e60d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d463f2ef16c940a3bd99d9f79ae3e60d", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:59:26.282836 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-SecurityGroupsTestJSON-1015574949 Aug 10 17:59:26.282836 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: d463f2ef16c940a3bd99d9f79ae3e60d Aug 10 17:59:26.282836 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1015574949 Aug 10 17:59:26.282836 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-SecurityGroupsTestJSON-1015574949-project Aug 10 17:59:26.282836 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 17:59:26.282836 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 17:59:26.282836 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: d38b40d915604752967356b497aee153 Aug 10 17:59:26.282836 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-SecurityGroupsTestJSON-1015574949-project Aug 10 17:59:26.282836 n-d-852296-2 devstack@n-api.service[129409]: method: Aug 10 17:59:26.282836 n-d-852296-2 devstack@n-api.service[129409]: exception: Security group c9a9a4fc-33da-44f1-a191-b6f13686ef78 does not exist Aug 10 17:59:26.282836 n-d-852296-2 devstack@n-api.service[129409]: Neutron server returns request_ids: ['req-6019f97a-3e73-4f51-8bc6-892e961b4ead'] Aug 10 17:59:26.282836 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'id': 'c9a9a4fc-33da-44f1-a191-b6f13686ef78'} Aug 10 17:59:26.282836 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:59:26.282836 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:59:26.282836 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 10 17:59:26.282836 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 10 17:59:26.282836 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:59:26.282836 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:59:26.282836 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 10 17:59:26.282836 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 10 17:59:26.282836 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:59:26.282836 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:59:26.282836 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:59:26.282836 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:59:26.282836 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:59:26.282836 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:59:26.282836 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:59:26.282836 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:59:26.282836 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:59:26.282836 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:59:26.282836 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 10 17:59:26.282836 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 10 17:59:26.282836 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:59:26.282836 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:59:26.282836 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 10 17:59:26.282836 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 10 17:59:26.282836 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 10 17:59:26.282836 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 10 17:59:26.282836 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c9a9a4fc-33da-44f1-a191-b6f13686ef78 does not exist Aug 10 17:59:26.288552 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6019f97a-3e73-4f51-8bc6-892e961b4ead'] Aug 10 17:59:26.288552 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:59:26.288552 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:59:26.288552 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:59:26.288552 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:59:26.288552 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 10 17:59:26.288552 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 10 17:59:26.288552 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 10 17:59:26.288552 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 10 17:59:26.288552 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c9a9a4fc-33da-44f1-a191-b6f13686ef78 does not exist Aug 10 17:59:26.288552 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6019f97a-3e73-4f51-8bc6-892e961b4ead'] Aug 10 17:59:26.288552 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:59:26.288552 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:59:26.288552 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:59:26.288552 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:59:26.288552 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:59:26.288552 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:59:26.288552 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:59:26.288552 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:59:26.288552 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 17:59:26.288552 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 17:59:26.288552 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:59:26.288552 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:59:26.288552 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 10 17:59:26.288552 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 10 17:59:26.288552 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c9a9a4fc-33da-44f1-a191-b6f13686ef78 does not exist Aug 10 17:59:26.288552 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6019f97a-3e73-4f51-8bc6-892e961b4ead'] Aug 10 17:59:26.288552 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:59:26.288552 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:59:26.288552 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:59:26.288552 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:59:26.288552 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:59:26.288552 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:59:26.288552 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:59:26.288552 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:59:26.288552 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c9a9a4fc-33da-44f1-a191-b6f13686ef78 does not exist Aug 10 17:59:26.288552 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6019f97a-3e73-4f51-8bc6-892e961b4ead'] Aug 10 17:59:26.288552 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:59:26.297360 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-565af235-0e68-46f6-b595-27d1e55395bb tempest-SecurityGroupsTestJSON-1015574949 tempest-SecurityGroupsTestJSON-1015574949-project] Returning 404 to user: Security group c9a9a4fc-33da-44f1-a191-b6f13686ef78 does not exist Aug 10 17:59:26.297360 n-d-852296-2 devstack@n-api.service[129409]: Neutron server returns request_ids: ['req-6019f97a-3e73-4f51-8bc6-892e961b4ead'] {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:59:26.298422 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-565af235-0e68-46f6-b595-27d1e55395bb tempest-SecurityGroupsTestJSON-1015574949 tempest-SecurityGroupsTestJSON-1015574949-project] 10.222.0.50 "GET /compute/v2.1/os-security-groups/c9a9a4fc-33da-44f1-a191-b6f13686ef78" status: 404 len: 194 microversion: 2.1 time: 0.170651 Aug 10 17:59:26.309296 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 925/1816] 10.222.0.50 () {58 vars in 1269 bytes} [Wed Aug 10 17:59:26 2022] GET /compute/v2.1/os-security-groups/c9a9a4fc-33da-44f1-a191-b6f13686ef78 => generated 194 bytes in 178 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:59:26.320368 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-5c4094eb-048c-4488-83c0-c3ad086b6dc0 tempest-SecurityGroupsTestJSON-1015574949 tempest-SecurityGroupsTestJSON-1015574949-project] Action: 'create', calling method: .version_select at 0x7fb345c73670>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1771790212", "description": "tempest-description-957383855"}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:59:26.765544 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-05bd82d7-f673-4d77-9a27-64bdd2d4618c tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:59:26.766244 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-05bd82d7-f673-4d77-9a27-64bdd2d4618c tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] [instance: 753bb23d-ad3b-4fc0-be8f-fed753940dde] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:59:26.784087 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-05bd82d7-f673-4d77-9a27-64bdd2d4618c tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:59:26.784631 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-05bd82d7-f673-4d77-9a27-64bdd2d4618c tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:59:26.785082 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-05bd82d7-f673-4d77-9a27-64bdd2d4618c tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:59:26.785820 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-05bd82d7-f673-4d77-9a27-64bdd2d4618c tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:59:26.786323 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-05bd82d7-f673-4d77-9a27-64bdd2d4618c tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:59:26.787000 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-05bd82d7-f673-4d77-9a27-64bdd2d4618c tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:59:27.067989 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-05bd82d7-f673-4d77-9a27-64bdd2d4618c tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99171d2ccde4a108b820c7ce2aa3ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4f95a4b9a4417da0b00d881dee9481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:27.078507 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-05bd82d7-f673-4d77-9a27-64bdd2d4618c tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a99171d2ccde4a108b820c7ce2aa3ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4f95a4b9a4417da0b00d881dee9481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:27.083811 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-05bd82d7-f673-4d77-9a27-64bdd2d4618c tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a99171d2ccde4a108b820c7ce2aa3ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4f95a4b9a4417da0b00d881dee9481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:27.089023 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-05bd82d7-f673-4d77-9a27-64bdd2d4618c tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] 10.222.0.50 "GET /compute/v2.1/servers/753bb23d-ad3b-4fc0-be8f-fed753940dde" status: 200 len: 1406 microversion: 2.54 time: 0.327736 Aug 10 17:59:27.090470 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 926/1817] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:59:26 2022] GET /compute/v2.1/servers/753bb23d-ad3b-4fc0-be8f-fed753940dde => generated 1406 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:59:27.715151 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-5c4094eb-048c-4488-83c0-c3ad086b6dc0 tempest-SecurityGroupsTestJSON-1015574949 tempest-SecurityGroupsTestJSON-1015574949-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.394510 Aug 10 17:59:27.715151 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 892/1818] 10.222.0.50 () {60 vars in 1180 bytes} [Wed Aug 10 17:59:26 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1396 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:59:27.726365 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-98a98934-c853-4080-9829-d254562424ba tempest-SecurityGroupsTestJSON-1015574949 tempest-SecurityGroupsTestJSON-1015574949-project] Action: 'create', calling method: .version_select at 0x7fb345ebe040>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1296457695", "description": "tempest-description-137951374"}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:59:27.967393 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-65086a8c-1136-4f9a-9995-ac21310a5088 tempest-AttachVolumeTestJSON-828505371 tempest-AttachVolumeTestJSON-828505371-project] Action: 'create', calling method: .version_select at 0x7fb345bd3e50>, body: {"keypair": {"name": "tempest-keypair-1508889050", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBKLka9m/jJEut+emIBoc7+xa/4Hj8FLo5amKjITP0KI5bYX1rBfQLo+Kf/1LDrCZH1o5c7zB9XG/A0KsxXEF5w1QPbG3o6MKPJIU+N+QoRl8jclD920xo0nNDTOFB/nig=="}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:59:28.017285 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.quota [None req-65086a8c-1136-4f9a-9995-ac21310a5088 tempest-AttachVolumeTestJSON-828505371 tempest-AttachVolumeTestJSON-828505371-project] Getting quotas for project 2e2dbac423fc4f6296b1d5bca148dd22. Resources: {'key_pairs'} {{(pid=129410) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:59:28.032276 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.quota [None req-65086a8c-1136-4f9a-9995-ac21310a5088 tempest-AttachVolumeTestJSON-828505371 tempest-AttachVolumeTestJSON-828505371-project] Getting quotas for user ecf05b05d0e948e3867f0e9b479dd0f4 and project 2e2dbac423fc4f6296b1d5bca148dd22. Resources: {'key_pairs'} {{(pid=129410) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:59:28.195354 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-65086a8c-1136-4f9a-9995-ac21310a5088 tempest-AttachVolumeTestJSON-828505371 tempest-AttachVolumeTestJSON-828505371-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.234159 Aug 10 17:59:28.196379 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 893/1819] 10.222.0.50 () {60 vars in 1159 bytes} [Wed Aug 10 17:59:27 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:59:28.221342 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-43e64454-7c1b-4cae-abc6-8e4604f082b3 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:59:28.241140 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-43e64454-7c1b-4cae-abc6-8e4604f082b3 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] [instance: 753bb23d-ad3b-4fc0-be8f-fed753940dde] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:59:28.261898 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-43e64454-7c1b-4cae-abc6-8e4604f082b3 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:59:28.263073 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-43e64454-7c1b-4cae-abc6-8e4604f082b3 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:59:28.263940 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-43e64454-7c1b-4cae-abc6-8e4604f082b3 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:59:28.265500 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-43e64454-7c1b-4cae-abc6-8e4604f082b3 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:59:28.266201 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-43e64454-7c1b-4cae-abc6-8e4604f082b3 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:59:28.266907 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-43e64454-7c1b-4cae-abc6-8e4604f082b3 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:59:28.308806 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-43e64454-7c1b-4cae-abc6-8e4604f082b3 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:59:28.308806 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-43e64454-7c1b-4cae-abc6-8e4604f082b3 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:59:28.309097 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-43e64454-7c1b-4cae-abc6-8e4604f082b3 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:59:28.310108 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.objects.instance [None req-43e64454-7c1b-4cae-abc6-8e4604f082b3 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lazy-loading 'fault' on Instance uuid 753bb23d-ad3b-4fc0-be8f-fed753940dde {{(pid=129410) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:59:28.365219 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-43e64454-7c1b-4cae-abc6-8e4604f082b3 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99171d2ccde4a108b820c7ce2aa3ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4f95a4b9a4417da0b00d881dee9481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:28.380571 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-43e64454-7c1b-4cae-abc6-8e4604f082b3 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a99171d2ccde4a108b820c7ce2aa3ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4f95a4b9a4417da0b00d881dee9481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:28.382115 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-43e64454-7c1b-4cae-abc6-8e4604f082b3 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a99171d2ccde4a108b820c7ce2aa3ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4f95a4b9a4417da0b00d881dee9481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:28.384183 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-43e64454-7c1b-4cae-abc6-8e4604f082b3 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] 10.222.0.50 "GET /compute/v2.1/servers/753bb23d-ad3b-4fc0-be8f-fed753940dde" status: 200 len: 1411 microversion: 2.54 time: 0.186325 Aug 10 17:59:28.384966 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 894/1820] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:59:28 2022] GET /compute/v2.1/servers/753bb23d-ad3b-4fc0-be8f-fed753940dde => generated 1411 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:59:28.964690 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-98a98934-c853-4080-9829-d254562424ba tempest-SecurityGroupsTestJSON-1015574949 tempest-SecurityGroupsTestJSON-1015574949-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.233411 Aug 10 17:59:28.964690 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 927/1821] 10.222.0.50 () {60 vars in 1180 bytes} [Wed Aug 10 17:59:27 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:59:28.973144 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-bc07e75b-cfc0-4c3d-99da-ec1b9793a268 tempest-SecurityGroupsTestJSON-1015574949 tempest-SecurityGroupsTestJSON-1015574949-project] Action: 'create', calling method: .version_select at 0x7fb345d77940>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1591400108", "description": "tempest-description-629620543"}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:59:29.597365 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-23bff2e6-2a3e-4720-87f1-c304faab32ef tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1793322686", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": "none"}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:59:29.709095 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.virt.hardware [None req-23bff2e6-2a3e-4720-87f1-c304faab32ef tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Flavor limits 0:0:0 {{(pid=129409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 17:59:29.712513 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.virt.hardware [None req-23bff2e6-2a3e-4720-87f1-c304faab32ef tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Image limits 0:0:0 {{(pid=129409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 17:59:29.713170 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.virt.hardware [None req-23bff2e6-2a3e-4720-87f1-c304faab32ef tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Flavor pref 0:0:0 {{(pid=129409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 17:59:29.713526 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.virt.hardware [None req-23bff2e6-2a3e-4720-87f1-c304faab32ef tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Image pref 0:0:0 {{(pid=129409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 17:59:29.716135 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.virt.hardware [None req-23bff2e6-2a3e-4720-87f1-c304faab32ef tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 17:59:29.733841 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-23bff2e6-2a3e-4720-87f1-c304faab32ef tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:59:29.734331 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-23bff2e6-2a3e-4720-87f1-c304faab32ef tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:59:29.734880 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-23bff2e6-2a3e-4720-87f1-c304faab32ef tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:59:29.735492 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-23bff2e6-2a3e-4720-87f1-c304faab32ef tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:59:29.735957 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-23bff2e6-2a3e-4720-87f1-c304faab32ef tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:59:29.736424 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-23bff2e6-2a3e-4720-87f1-c304faab32ef tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:59:29.790892 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-23bff2e6-2a3e-4720-87f1-c304faab32ef tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Getting quotas for project 0fde43f99a694fa5a0d746dc2ff05424. Resources: {'instances', 'ram', 'cores'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:59:29.798096 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-23bff2e6-2a3e-4720-87f1-c304faab32ef tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Getting quotas for user cd878de9fde9475ba4104e44587597c6 and project 0fde43f99a694fa5a0d746dc2ff05424. Resources: {'instances', 'ram', 'cores'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:59:29.833205 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-23bff2e6-2a3e-4720-87f1-c304faab32ef tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Going to run 1 instances... {{(pid=129409) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 17:59:29.835597 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-23bff2e6-2a3e-4720-87f1-c304faab32ef tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] [instance: bdb37605-6cb4-40e2-a17d-09d77aea7bbf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a735ff26-463a-4ffe-a981-ab9d9baa494f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 17:59:30.082598 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-23bff2e6-2a3e-4720-87f1-c304faab32ef tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.764718 Aug 10 17:59:30.089867 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 928/1822] 10.222.0.50 () {62 vars in 1188 bytes} [Wed Aug 10 17:59:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 770 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 10 17:59:30.110582 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-f4903b49-dd7a-47fe-a9e6-a75e7fa8aef9 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:59:30.113924 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-f4903b49-dd7a-47fe-a9e6-a75e7fa8aef9 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] [instance: 753bb23d-ad3b-4fc0-be8f-fed753940dde] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:59:30.137077 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-f4903b49-dd7a-47fe-a9e6-a75e7fa8aef9 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:59:30.137796 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-f4903b49-dd7a-47fe-a9e6-a75e7fa8aef9 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:59:30.138249 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-f4903b49-dd7a-47fe-a9e6-a75e7fa8aef9 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:59:30.142535 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-f4903b49-dd7a-47fe-a9e6-a75e7fa8aef9 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:59:30.151410 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-f4903b49-dd7a-47fe-a9e6-a75e7fa8aef9 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:59:30.152531 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-f4903b49-dd7a-47fe-a9e6-a75e7fa8aef9 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:59:30.202518 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-f4903b49-dd7a-47fe-a9e6-a75e7fa8aef9 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] HTTP exception thrown: Instance 753bb23d-ad3b-4fc0-be8f-fed753940dde could not be found. Aug 10 17:59:30.206299 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-f4903b49-dd7a-47fe-a9e6-a75e7fa8aef9 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Request method failure captured: Aug 10 17:59:30.206299 n-d-852296-2 devstack@n-api.service[129409]: request: GET /compute/v2.1/servers/753bb23d-ad3b-4fc0-be8f-fed753940dde HTTP/1.1 Aug 10 17:59:30.206299 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 17:59:30.206299 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 17:59:30.206299 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 17:59:30.206299 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 0 Aug 10 17:59:30.206299 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 17:59:30.206299 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 17:59:30.206299 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 17:59:30.206299 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 17:59:30.206299 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8_HNOFirbZQoUZu-i1tfLttGyfgRj4iZCuUxnLuhFEINmmvp8WitJFosC9uuu8s3jKmqbKQRK4jWn6Rx3fLy0kFJI4aIi6ixhXIGzaw5mHRlWeQqoDKnzBCeReDNebVOvsNFY-w8eUxXV5qZ_6FfJxwoPW9HM6JL7I5L4VieO-QacPA Aug 10 17:59:30.206299 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 17:59:30.206299 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 17:59:30.206299 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 17:59:30.206299 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 17:59:30.206299 n-d-852296-2 devstack@n-api.service[129409]: X-Openstack-Nova-Api-Version: 2.54 Aug 10 17:59:30.206299 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 17:59:30.206299 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 17:59:30.206299 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: da4f95a4b9a4417da0b00d881dee9481 Aug 10 17:59:30.206299 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-ServerShowV254Test-356445409 Aug 10 17:59:30.206299 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 17:59:30.206299 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 17:59:30.206299 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/da4f95a4b9a4417da0b00d881dee9481"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/da4f95a4b9a4417da0b00d881dee9481"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/da4f95a4b9a4417da0b00d881dee9481"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_da4f95a4b9a4417da0b00d881dee9481", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:59:30.206299 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-ServerShowV254Test-356445409 Aug 10 17:59:30.206299 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: da4f95a4b9a4417da0b00d881dee9481 Aug 10 17:59:30.206299 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-ServerShowV254Test-356445409 Aug 10 17:59:30.206299 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-ServerShowV254Test-356445409-project Aug 10 17:59:30.206299 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 17:59:30.206299 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 17:59:30.206299 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: a99171d2ccde4a108b820c7ce2aa3ee5 Aug 10 17:59:30.206299 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-ServerShowV254Test-356445409-project Aug 10 17:59:30.206299 n-d-852296-2 devstack@n-api.service[129409]: method: > Aug 10 17:59:30.206299 n-d-852296-2 devstack@n-api.service[129409]: exception: Instance 753bb23d-ad3b-4fc0-be8f-fed753940dde could not be found. Aug 10 17:59:30.206299 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'id': '753bb23d-ad3b-4fc0-be8f-fed753940dde'} Aug 10 17:59:30.206299 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:59:30.206299 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:59:30.206299 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 17:59:30.206299 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 17:59:30.206299 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 17:59:30.206299 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 17:59:30.206299 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 17:59:30.206299 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 17:59:30.206299 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 17:59:30.206299 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 17:59:30.206299 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 753bb23d-ad3b-4fc0-be8f-fed753940dde could not be found. Aug 10 17:59:30.206299 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:59:30.206299 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:59:30.206299 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:59:30.206299 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:59:30.206299 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:59:30.206299 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:59:30.206299 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:59:30.206299 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:59:30.206299 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:59:30.206299 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:59:30.206299 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 17:59:30.206299 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 17:59:30.206299 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 17:59:30.206299 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 17:59:30.206299 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 17:59:30.206299 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:59:30.206299 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 753bb23d-ad3b-4fc0-be8f-fed753940dde could not be found. Aug 10 17:59:30.206299 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:59:30.206299 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:59:30.206299 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:59:30.215788 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:59:30.215788 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:59:30.215788 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:59:30.215788 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:59:30.215788 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:59:30.215788 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 753bb23d-ad3b-4fc0-be8f-fed753940dde could not be found. Aug 10 17:59:30.215788 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:59:30.215788 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-f4903b49-dd7a-47fe-a9e6-a75e7fa8aef9 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] Returning 404 to user: Instance 753bb23d-ad3b-4fc0-be8f-fed753940dde could not be found. {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:59:30.215788 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-f4903b49-dd7a-47fe-a9e6-a75e7fa8aef9 tempest-ServerShowV254Test-356445409 tempest-ServerShowV254Test-356445409-project] 10.222.0.50 "GET /compute/v2.1/servers/753bb23d-ad3b-4fc0-be8f-fed753940dde" status: 404 len: 111 microversion: 2.54 time: 0.122626 Aug 10 17:59:30.219363 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 929/1823] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:59:30 2022] GET /compute/v2.1/servers/753bb23d-ad3b-4fc0-be8f-fed753940dde => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 10 17:59:30.259226 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-f361d206-1617-4eb0-897c-16379040fec5 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:59:30.259846 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-f361d206-1617-4eb0-897c-16379040fec5 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] [instance: bdb37605-6cb4-40e2-a17d-09d77aea7bbf] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:59:30.418108 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-f361d206-1617-4eb0-897c-16379040fec5 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:30.427090 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-f361d206-1617-4eb0-897c-16379040fec5 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:30.428567 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-f361d206-1617-4eb0-897c-16379040fec5 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:30.429740 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-f361d206-1617-4eb0-897c-16379040fec5 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] 10.222.0.50 "GET /compute/v2.1/servers/bdb37605-6cb4-40e2-a17d-09d77aea7bbf" status: 200 len: 1278 microversion: 2.47 time: 0.209107 Aug 10 17:59:30.447540 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 930/1824] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:59:30 2022] GET /compute/v2.1/servers/bdb37605-6cb4-40e2-a17d-09d77aea7bbf => generated 1278 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:59:30.458857 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-bc07e75b-cfc0-4c3d-99da-ec1b9793a268 tempest-SecurityGroupsTestJSON-1015574949 tempest-SecurityGroupsTestJSON-1015574949-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.493156 Aug 10 17:59:30.460015 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 895/1825] 10.222.0.50 () {60 vars in 1180 bytes} [Wed Aug 10 17:59:28 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1495 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:59:30.473542 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-90193f35-06b0-45a9-913f-95762d3a396b tempest-SecurityGroupsTestJSON-1015574949 tempest-SecurityGroupsTestJSON-1015574949-project] Calling method '.version_select at 0x7fb345dfd670>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:59:30.553010 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-badb45b1-249b-45cf-ba8b-9617bba2650f tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1521845721", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": "none"}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:59:30.638779 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.virt.hardware [None req-badb45b1-249b-45cf-ba8b-9617bba2650f tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Flavor limits 0:0:0 {{(pid=129410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 17:59:30.639322 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.virt.hardware [None req-badb45b1-249b-45cf-ba8b-9617bba2650f tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Image limits 0:0:0 {{(pid=129410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 17:59:30.639928 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.virt.hardware [None req-badb45b1-249b-45cf-ba8b-9617bba2650f tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Flavor pref 0:0:0 {{(pid=129410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 17:59:30.640534 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.virt.hardware [None req-badb45b1-249b-45cf-ba8b-9617bba2650f tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Image pref 0:0:0 {{(pid=129410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 17:59:30.642533 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.virt.hardware [None req-badb45b1-249b-45cf-ba8b-9617bba2650f tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 17:59:30.656540 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-badb45b1-249b-45cf-ba8b-9617bba2650f tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:59:30.657416 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-badb45b1-249b-45cf-ba8b-9617bba2650f tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:59:30.659209 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-badb45b1-249b-45cf-ba8b-9617bba2650f tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:59:30.661439 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-badb45b1-249b-45cf-ba8b-9617bba2650f tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:59:30.668910 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-badb45b1-249b-45cf-ba8b-9617bba2650f tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:59:30.668910 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-badb45b1-249b-45cf-ba8b-9617bba2650f tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:59:30.717966 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.quota [None req-badb45b1-249b-45cf-ba8b-9617bba2650f tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Getting quotas for project 0fde43f99a694fa5a0d746dc2ff05424. Resources: {'instances', 'ram', 'cores'} {{(pid=129410) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:59:30.729693 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.quota [None req-badb45b1-249b-45cf-ba8b-9617bba2650f tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Getting quotas for user cd878de9fde9475ba4104e44587597c6 and project 0fde43f99a694fa5a0d746dc2ff05424. Resources: {'instances', 'ram', 'cores'} {{(pid=129410) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:59:30.751463 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-badb45b1-249b-45cf-ba8b-9617bba2650f tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Going to run 1 instances... {{(pid=129410) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 17:59:30.756962 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-badb45b1-249b-45cf-ba8b-9617bba2650f tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] [instance: fc188b51-5fbb-4924-830b-fd2791814d09] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a735ff26-463a-4ffe-a981-ab9d9baa494f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129410) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 17:59:31.098691 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-badb45b1-249b-45cf-ba8b-9617bba2650f tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.543944 Aug 10 17:59:31.121982 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 896/1826] 10.222.0.50 () {62 vars in 1188 bytes} [Wed Aug 10 17:59:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 574 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 10 17:59:31.155535 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-fda4ddae-35f3-4ad3-8e48-1a70e28ed415 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:59:31.159438 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-fda4ddae-35f3-4ad3-8e48-1a70e28ed415 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] [instance: fc188b51-5fbb-4924-830b-fd2791814d09] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:59:31.282097 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-fda4ddae-35f3-4ad3-8e48-1a70e28ed415 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] 10.222.0.50 "PUT /compute/v2.1/servers/fc188b51-5fbb-4924-830b-fd2791814d09" status: 200 len: 992 microversion: 2.47 time: 0.155567 Aug 10 17:59:31.295591 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 897/1827] 10.222.0.50 () {62 vars in 1297 bytes} [Wed Aug 10 17:59:31 2022] PUT /compute/v2.1/servers/fc188b51-5fbb-4924-830b-fd2791814d09 => generated 992 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 17:59:31.310518 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-d926426c-4507-4514-98d8-d18b1499b99a tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:59:31.311141 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-d926426c-4507-4514-98d8-d18b1499b99a tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] [instance: fc188b51-5fbb-4924-830b-fd2791814d09] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:59:31.435259 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-d926426c-4507-4514-98d8-d18b1499b99a tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:31.448728 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-d926426c-4507-4514-98d8-d18b1499b99a tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:31.450417 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-d926426c-4507-4514-98d8-d18b1499b99a tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:31.453301 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-d926426c-4507-4514-98d8-d18b1499b99a tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] 10.222.0.50 "GET /compute/v2.1/servers/fc188b51-5fbb-4924-830b-fd2791814d09" status: 200 len: 1278 microversion: 2.47 time: 0.152105 Aug 10 17:59:31.469330 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 898/1828] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:59:31 2022] GET /compute/v2.1/servers/fc188b51-5fbb-4924-830b-fd2791814d09 => generated 1278 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:59:31.573041 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-90193f35-06b0-45a9-913f-95762d3a396b tempest-SecurityGroupsTestJSON-1015574949 tempest-SecurityGroupsTestJSON-1015574949-project] 10.222.0.50 "GET /compute/v2.1/os-security-groups" status: 200 len: 1833 microversion: 2.1 time: 1.103215 Aug 10 17:59:31.574339 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 931/1829] 10.222.0.50 () {58 vars in 1158 bytes} [Wed Aug 10 17:59:30 2022] GET /compute/v2.1/os-security-groups => generated 1833 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:59:31.587598 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-415befd4-419e-4f7b-9606-f597b16b230c tempest-SecurityGroupsTestJSON-1015574949 tempest-SecurityGroupsTestJSON-1015574949-project] Calling method '.version_select at 0x7fb345c3c8b0>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:59:32.479010 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-415befd4-419e-4f7b-9606-f597b16b230c tempest-SecurityGroupsTestJSON-1015574949 tempest-SecurityGroupsTestJSON-1015574949-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/5a025cce-3e8f-4243-a2dc-422a2f872af3" status: 202 len: 0 microversion: 2.1 time: 0.895420 Aug 10 17:59:32.480674 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 899/1830] 10.222.0.50 () {58 vars in 1272 bytes} [Wed Aug 10 17:59:31 2022] DELETE /compute/v2.1/os-security-groups/5a025cce-3e8f-4243-a2dc-422a2f872af3 => generated 0 bytes in 898 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 17:59:32.481449 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-41561a42-9a3f-4d66-91d6-706536bbdf49 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:59:32.482354 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-41561a42-9a3f-4d66-91d6-706536bbdf49 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] [instance: fc188b51-5fbb-4924-830b-fd2791814d09] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:59:32.489403 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-53449a8e-53f4-4a18-835b-4060e7237759 tempest-SecurityGroupsTestJSON-1015574949 tempest-SecurityGroupsTestJSON-1015574949-project] Calling method '.version_select at 0x7fb345dbfdc0>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:59:32.621658 n-d-852296-2 devstack@n-api.service[129410]: DEBUG neutronclient.v2_0.client [None req-53449a8e-53f4-4a18-835b-4060e7237759 tempest-SecurityGroupsTestJSON-1015574949 tempest-SecurityGroupsTestJSON-1015574949-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 5a025cce-3e8f-4243-a2dc-422a2f872af3 does not exist", "detail": ""}} {{(pid=129410) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 10 17:59:32.625262 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.network.security_group_api [None req-53449a8e-53f4-4a18-835b-4060e7237759 tempest-SecurityGroupsTestJSON-1015574949 tempest-SecurityGroupsTestJSON-1015574949-project] Neutron security group 5a025cce-3e8f-4243-a2dc-422a2f872af3 not found {{(pid=129410) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 10 17:59:32.625676 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-41561a42-9a3f-4d66-91d6-706536bbdf49 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:32.626772 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-53449a8e-53f4-4a18-835b-4060e7237759 tempest-SecurityGroupsTestJSON-1015574949 tempest-SecurityGroupsTestJSON-1015574949-project] HTTP exception thrown: Security group 5a025cce-3e8f-4243-a2dc-422a2f872af3 does not exist Aug 10 17:59:32.626772 n-d-852296-2 devstack@n-api.service[129410]: Neutron server returns request_ids: ['req-fa880bfd-08f0-47d8-b1ba-f44944f3a719'] Aug 10 17:59:32.633023 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-53449a8e-53f4-4a18-835b-4060e7237759 tempest-SecurityGroupsTestJSON-1015574949 tempest-SecurityGroupsTestJSON-1015574949-project] Request method failure captured: Aug 10 17:59:32.633023 n-d-852296-2 devstack@n-api.service[129410]: request: GET /compute/v2.1/os-security-groups/5a025cce-3e8f-4243-a2dc-422a2f872af3 HTTP/1.1 Aug 10 17:59:32.633023 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 17:59:32.633023 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 17:59:32.633023 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 17:59:32.633023 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 0 Aug 10 17:59:32.633023 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 17:59:32.633023 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 17:59:32.633023 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 17:59:32.633023 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 17:59:32.633023 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8_H41UWn8v8K3fsyKPT7OaQXoGJFLNxnh1ePGOtxVbMhdLgXNCNN0NrnCNtgHBi1CtlCNKZmx4uk6tgFgQhh5Xq_p7l3GA2mS-R_B8G_Y5ArxD2_QwnJBi-rWbEr_yOa6UfCPZWrf4NXKgoQqB992TY45ipTMzvSaJJ4v-Zc1ug8MJY Aug 10 17:59:32.633023 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 17:59:32.633023 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 17:59:32.633023 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 17:59:32.633023 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 17:59:32.633023 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 17:59:32.633023 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 17:59:32.633023 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: d463f2ef16c940a3bd99d9f79ae3e60d Aug 10 17:59:32.633023 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-SecurityGroupsTestJSON-1015574949 Aug 10 17:59:32.633023 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 17:59:32.633023 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 17:59:32.633023 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d463f2ef16c940a3bd99d9f79ae3e60d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d463f2ef16c940a3bd99d9f79ae3e60d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d463f2ef16c940a3bd99d9f79ae3e60d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d463f2ef16c940a3bd99d9f79ae3e60d", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:59:32.633023 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-SecurityGroupsTestJSON-1015574949 Aug 10 17:59:32.633023 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: d463f2ef16c940a3bd99d9f79ae3e60d Aug 10 17:59:32.633023 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1015574949 Aug 10 17:59:32.633023 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-SecurityGroupsTestJSON-1015574949-project Aug 10 17:59:32.633023 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 17:59:32.633023 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 17:59:32.633023 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: d38b40d915604752967356b497aee153 Aug 10 17:59:32.633023 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-SecurityGroupsTestJSON-1015574949-project Aug 10 17:59:32.633023 n-d-852296-2 devstack@n-api.service[129410]: method: Aug 10 17:59:32.633023 n-d-852296-2 devstack@n-api.service[129410]: exception: Security group 5a025cce-3e8f-4243-a2dc-422a2f872af3 does not exist Aug 10 17:59:32.633023 n-d-852296-2 devstack@n-api.service[129410]: Neutron server returns request_ids: ['req-fa880bfd-08f0-47d8-b1ba-f44944f3a719'] Aug 10 17:59:32.633023 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'id': '5a025cce-3e8f-4243-a2dc-422a2f872af3'} Aug 10 17:59:32.633023 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:59:32.633023 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:59:32.633023 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 10 17:59:32.633023 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 10 17:59:32.633023 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:59:32.633023 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:59:32.633023 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 10 17:59:32.633023 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 10 17:59:32.633023 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:59:32.633023 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:59:32.633023 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:59:32.633023 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:59:32.633023 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:59:32.633023 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:59:32.633023 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:59:32.633023 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:59:32.633023 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:59:32.633023 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:59:32.633023 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 10 17:59:32.633023 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 10 17:59:32.633023 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:59:32.633023 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:59:32.633023 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 10 17:59:32.633023 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 10 17:59:32.633023 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 10 17:59:32.633023 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 10 17:59:32.633023 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 5a025cce-3e8f-4243-a2dc-422a2f872af3 does not exist Aug 10 17:59:32.643883 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fa880bfd-08f0-47d8-b1ba-f44944f3a719'] Aug 10 17:59:32.643883 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:59:32.643883 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:59:32.643883 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:59:32.643883 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:59:32.643883 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 10 17:59:32.643883 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 10 17:59:32.643883 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 10 17:59:32.643883 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 10 17:59:32.643883 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 5a025cce-3e8f-4243-a2dc-422a2f872af3 does not exist Aug 10 17:59:32.643883 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fa880bfd-08f0-47d8-b1ba-f44944f3a719'] Aug 10 17:59:32.643883 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:59:32.643883 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:59:32.643883 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:59:32.643883 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:59:32.643883 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:59:32.643883 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:59:32.643883 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:59:32.643883 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:59:32.643883 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 17:59:32.643883 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 17:59:32.643883 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:59:32.643883 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:59:32.643883 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 10 17:59:32.643883 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 10 17:59:32.643883 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 5a025cce-3e8f-4243-a2dc-422a2f872af3 does not exist Aug 10 17:59:32.643883 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fa880bfd-08f0-47d8-b1ba-f44944f3a719'] Aug 10 17:59:32.643883 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:59:32.643883 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:59:32.643883 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:59:32.643883 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:59:32.643883 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:59:32.643883 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:59:32.643883 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:59:32.643883 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:59:32.643883 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 5a025cce-3e8f-4243-a2dc-422a2f872af3 does not exist Aug 10 17:59:32.643883 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fa880bfd-08f0-47d8-b1ba-f44944f3a719'] Aug 10 17:59:32.643883 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:59:32.643883 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-53449a8e-53f4-4a18-835b-4060e7237759 tempest-SecurityGroupsTestJSON-1015574949 tempest-SecurityGroupsTestJSON-1015574949-project] Returning 404 to user: Security group 5a025cce-3e8f-4243-a2dc-422a2f872af3 does not exist Aug 10 17:59:32.643883 n-d-852296-2 devstack@n-api.service[129410]: Neutron server returns request_ids: ['req-fa880bfd-08f0-47d8-b1ba-f44944f3a719'] {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:59:32.647260 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-41561a42-9a3f-4d66-91d6-706536bbdf49 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:32.647659 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-53449a8e-53f4-4a18-835b-4060e7237759 tempest-SecurityGroupsTestJSON-1015574949 tempest-SecurityGroupsTestJSON-1015574949-project] 10.222.0.50 "GET /compute/v2.1/os-security-groups/5a025cce-3e8f-4243-a2dc-422a2f872af3" status: 404 len: 194 microversion: 2.1 time: 0.149506 Aug 10 17:59:32.647659 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 900/1831] 10.222.0.50 () {58 vars in 1269 bytes} [Wed Aug 10 17:59:32 2022] GET /compute/v2.1/os-security-groups/5a025cce-3e8f-4243-a2dc-422a2f872af3 => generated 194 bytes in 155 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:59:32.649027 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-41561a42-9a3f-4d66-91d6-706536bbdf49 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:32.654113 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-41561a42-9a3f-4d66-91d6-706536bbdf49 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] 10.222.0.50 "GET /compute/v2.1/servers/fc188b51-5fbb-4924-830b-fd2791814d09" status: 200 len: 1278 microversion: 2.47 time: 0.178925 Aug 10 17:59:32.654924 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 932/1832] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:59:32 2022] GET /compute/v2.1/servers/fc188b51-5fbb-4924-830b-fd2791814d09 => generated 1278 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 17:59:32.668651 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-7fa96df1-000e-4abb-bb96-2338269de044 tempest-SecurityGroupsTestJSON-1015574949 tempest-SecurityGroupsTestJSON-1015574949-project] Calling method '.version_select at 0x7fb345c3c940>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:59:33.600331 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-7fa96df1-000e-4abb-bb96-2338269de044 tempest-SecurityGroupsTestJSON-1015574949 tempest-SecurityGroupsTestJSON-1015574949-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/fd83375a-7127-40cd-af73-c0911bb49257" status: 202 len: 0 microversion: 2.1 time: 0.953825 Aug 10 17:59:33.601574 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 901/1833] 10.222.0.50 () {58 vars in 1272 bytes} [Wed Aug 10 17:59:32 2022] DELETE /compute/v2.1/os-security-groups/fd83375a-7127-40cd-af73-c0911bb49257 => generated 0 bytes in 956 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 17:59:33.615747 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-7cc1b17c-59b7-45cf-86ba-d77fceaa85d8 tempest-SecurityGroupsTestJSON-1015574949 tempest-SecurityGroupsTestJSON-1015574949-project] Calling method '.version_select at 0x7fb345d76160>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:59:33.679327 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-312ad900-1a38-4989-995a-181792fa1cfa tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:59:33.680209 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-312ad900-1a38-4989-995a-181792fa1cfa tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] [instance: fc188b51-5fbb-4924-830b-fd2791814d09] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:59:33.690725 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-312ad900-1a38-4989-995a-181792fa1cfa tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:59:33.691593 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-312ad900-1a38-4989-995a-181792fa1cfa tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:59:33.692227 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-312ad900-1a38-4989-995a-181792fa1cfa tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:59:33.693176 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-312ad900-1a38-4989-995a-181792fa1cfa tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:59:33.693802 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-312ad900-1a38-4989-995a-181792fa1cfa tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:59:33.694497 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-312ad900-1a38-4989-995a-181792fa1cfa tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:59:33.713362 n-d-852296-2 devstack@n-api.service[129409]: DEBUG neutronclient.v2_0.client [None req-7cc1b17c-59b7-45cf-86ba-d77fceaa85d8 tempest-SecurityGroupsTestJSON-1015574949 tempest-SecurityGroupsTestJSON-1015574949-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group fd83375a-7127-40cd-af73-c0911bb49257 does not exist", "detail": ""}} {{(pid=129409) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 10 17:59:33.714487 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.network.security_group_api [None req-7cc1b17c-59b7-45cf-86ba-d77fceaa85d8 tempest-SecurityGroupsTestJSON-1015574949 tempest-SecurityGroupsTestJSON-1015574949-project] Neutron security group fd83375a-7127-40cd-af73-c0911bb49257 not found {{(pid=129409) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 10 17:59:33.715113 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-7cc1b17c-59b7-45cf-86ba-d77fceaa85d8 tempest-SecurityGroupsTestJSON-1015574949 tempest-SecurityGroupsTestJSON-1015574949-project] HTTP exception thrown: Security group fd83375a-7127-40cd-af73-c0911bb49257 does not exist Aug 10 17:59:33.715113 n-d-852296-2 devstack@n-api.service[129409]: Neutron server returns request_ids: ['req-86778a78-44f4-4654-9c5a-7e06fc4b4113'] Aug 10 17:59:33.717139 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-7cc1b17c-59b7-45cf-86ba-d77fceaa85d8 tempest-SecurityGroupsTestJSON-1015574949 tempest-SecurityGroupsTestJSON-1015574949-project] Request method failure captured: Aug 10 17:59:33.717139 n-d-852296-2 devstack@n-api.service[129409]: request: GET /compute/v2.1/os-security-groups/fd83375a-7127-40cd-af73-c0911bb49257 HTTP/1.1 Aug 10 17:59:33.717139 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 17:59:33.717139 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 17:59:33.717139 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 17:59:33.717139 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 0 Aug 10 17:59:33.717139 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 17:59:33.717139 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 17:59:33.717139 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 17:59:33.717139 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 17:59:33.717139 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8_H41UWn8v8K3fsyKPT7OaQXoGJFLNxnh1ePGOtxVbMhdLgXNCNN0NrnCNtgHBi1CtlCNKZmx4uk6tgFgQhh5Xq_p7l3GA2mS-R_B8G_Y5ArxD2_QwnJBi-rWbEr_yOa6UfCPZWrf4NXKgoQqB992TY45ipTMzvSaJJ4v-Zc1ug8MJY Aug 10 17:59:33.717139 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 17:59:33.717139 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 17:59:33.717139 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 17:59:33.717139 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 17:59:33.717139 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 17:59:33.717139 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 17:59:33.717139 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: d463f2ef16c940a3bd99d9f79ae3e60d Aug 10 17:59:33.717139 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-SecurityGroupsTestJSON-1015574949 Aug 10 17:59:33.717139 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 17:59:33.717139 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 17:59:33.717139 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d463f2ef16c940a3bd99d9f79ae3e60d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d463f2ef16c940a3bd99d9f79ae3e60d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d463f2ef16c940a3bd99d9f79ae3e60d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d463f2ef16c940a3bd99d9f79ae3e60d", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:59:33.717139 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-SecurityGroupsTestJSON-1015574949 Aug 10 17:59:33.717139 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: d463f2ef16c940a3bd99d9f79ae3e60d Aug 10 17:59:33.717139 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1015574949 Aug 10 17:59:33.717139 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-SecurityGroupsTestJSON-1015574949-project Aug 10 17:59:33.717139 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 17:59:33.717139 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 17:59:33.717139 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: d38b40d915604752967356b497aee153 Aug 10 17:59:33.717139 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-SecurityGroupsTestJSON-1015574949-project Aug 10 17:59:33.717139 n-d-852296-2 devstack@n-api.service[129409]: method: Aug 10 17:59:33.717139 n-d-852296-2 devstack@n-api.service[129409]: exception: Security group fd83375a-7127-40cd-af73-c0911bb49257 does not exist Aug 10 17:59:33.717139 n-d-852296-2 devstack@n-api.service[129409]: Neutron server returns request_ids: ['req-86778a78-44f4-4654-9c5a-7e06fc4b4113'] Aug 10 17:59:33.717139 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'id': 'fd83375a-7127-40cd-af73-c0911bb49257'} Aug 10 17:59:33.717139 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:59:33.717139 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:59:33.717139 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 10 17:59:33.717139 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 10 17:59:33.717139 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:59:33.717139 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:59:33.717139 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 10 17:59:33.717139 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 10 17:59:33.717139 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:59:33.717139 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:59:33.717139 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:59:33.717139 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:59:33.717139 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:59:33.717139 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:59:33.717139 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:59:33.717139 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:59:33.717139 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:59:33.717139 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:59:33.717139 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 10 17:59:33.717139 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 10 17:59:33.717139 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:59:33.717139 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:59:33.717139 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 10 17:59:33.717139 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 10 17:59:33.717139 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 10 17:59:33.717139 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 10 17:59:33.717139 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group fd83375a-7127-40cd-af73-c0911bb49257 does not exist Aug 10 17:59:33.721828 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-86778a78-44f4-4654-9c5a-7e06fc4b4113'] Aug 10 17:59:33.721828 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:59:33.721828 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:59:33.721828 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:59:33.721828 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:59:33.721828 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 10 17:59:33.721828 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 10 17:59:33.721828 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 10 17:59:33.721828 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 10 17:59:33.721828 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group fd83375a-7127-40cd-af73-c0911bb49257 does not exist Aug 10 17:59:33.721828 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-86778a78-44f4-4654-9c5a-7e06fc4b4113'] Aug 10 17:59:33.721828 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:59:33.721828 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:59:33.721828 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:59:33.721828 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:59:33.721828 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:59:33.721828 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:59:33.721828 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:59:33.721828 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:59:33.721828 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 17:59:33.721828 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 17:59:33.721828 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:59:33.721828 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:59:33.721828 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 10 17:59:33.721828 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 10 17:59:33.721828 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group fd83375a-7127-40cd-af73-c0911bb49257 does not exist Aug 10 17:59:33.721828 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-86778a78-44f4-4654-9c5a-7e06fc4b4113'] Aug 10 17:59:33.721828 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:59:33.721828 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:59:33.721828 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:59:33.721828 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:59:33.721828 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:59:33.721828 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:59:33.721828 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:59:33.721828 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:59:33.721828 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group fd83375a-7127-40cd-af73-c0911bb49257 does not exist Aug 10 17:59:33.721828 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-86778a78-44f4-4654-9c5a-7e06fc4b4113'] Aug 10 17:59:33.721828 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:59:33.721828 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-7cc1b17c-59b7-45cf-86ba-d77fceaa85d8 tempest-SecurityGroupsTestJSON-1015574949 tempest-SecurityGroupsTestJSON-1015574949-project] Returning 404 to user: Security group fd83375a-7127-40cd-af73-c0911bb49257 does not exist Aug 10 17:59:33.721828 n-d-852296-2 devstack@n-api.service[129409]: Neutron server returns request_ids: ['req-86778a78-44f4-4654-9c5a-7e06fc4b4113'] {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:59:33.721828 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-7cc1b17c-59b7-45cf-86ba-d77fceaa85d8 tempest-SecurityGroupsTestJSON-1015574949 tempest-SecurityGroupsTestJSON-1015574949-project] 10.222.0.50 "GET /compute/v2.1/os-security-groups/fd83375a-7127-40cd-af73-c0911bb49257" status: 404 len: 194 microversion: 2.1 time: 0.113901 Aug 10 17:59:33.721828 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 933/1834] 10.222.0.50 () {58 vars in 1269 bytes} [Wed Aug 10 17:59:33 2022] GET /compute/v2.1/os-security-groups/fd83375a-7127-40cd-af73-c0911bb49257 => generated 194 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:59:33.737176 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-9bc4c8f4-8438-4810-8969-59a7bb2c43c1 tempest-SecurityGroupsTestJSON-1015574949 tempest-SecurityGroupsTestJSON-1015574949-project] Calling method '.version_select at 0x7fb345d76ee0>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:59:33.836628 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-312ad900-1a38-4989-995a-181792fa1cfa tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:33.847665 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-312ad900-1a38-4989-995a-181792fa1cfa tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:33.860663 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-312ad900-1a38-4989-995a-181792fa1cfa tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:33.862359 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-312ad900-1a38-4989-995a-181792fa1cfa tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] 10.222.0.50 "GET /compute/v2.1/servers/fc188b51-5fbb-4924-830b-fd2791814d09" status: 200 len: 1274 microversion: 2.47 time: 0.187047 Aug 10 17:59:33.864329 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 902/1835] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:59:33 2022] GET /compute/v2.1/servers/fc188b51-5fbb-4924-830b-fd2791814d09 => generated 1274 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:59:34.890807 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-f95b3c33-5234-44f9-bfbb-b806cec051d6 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:59:34.892500 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-f95b3c33-5234-44f9-bfbb-b806cec051d6 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] [instance: fc188b51-5fbb-4924-830b-fd2791814d09] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:59:34.895329 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_api:SELECT=73,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:59:34.910919 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-f95b3c33-5234-44f9-bfbb-b806cec051d6 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:59:34.911444 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-f95b3c33-5234-44f9-bfbb-b806cec051d6 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:59:34.913115 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-f95b3c33-5234-44f9-bfbb-b806cec051d6 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:59:34.913880 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-f95b3c33-5234-44f9-bfbb-b806cec051d6 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:59:34.927299 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-f95b3c33-5234-44f9-bfbb-b806cec051d6 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:59:34.928093 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-f95b3c33-5234-44f9-bfbb-b806cec051d6 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:59:34.943793 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-9bc4c8f4-8438-4810-8969-59a7bb2c43c1 tempest-SecurityGroupsTestJSON-1015574949 tempest-SecurityGroupsTestJSON-1015574949-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/e9001c88-d6d1-4965-a186-6cf0bc9162a7" status: 202 len: 0 microversion: 2.1 time: 1.217990 Aug 10 17:59:34.944788 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 934/1836] 10.222.0.50 () {58 vars in 1272 bytes} [Wed Aug 10 17:59:33 2022] DELETE /compute/v2.1/os-security-groups/e9001c88-d6d1-4965-a186-6cf0bc9162a7 => generated 0 bytes in 1220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 17:59:34.953461 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-d3113c01-2046-4339-8a4a-3012611b3fda tempest-SecurityGroupsTestJSON-1015574949 tempest-SecurityGroupsTestJSON-1015574949-project] Calling method '.version_select at 0x7fb345d763a0>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:59:35.116834 n-d-852296-2 devstack@n-api.service[129409]: DEBUG neutronclient.v2_0.client [None req-d3113c01-2046-4339-8a4a-3012611b3fda tempest-SecurityGroupsTestJSON-1015574949 tempest-SecurityGroupsTestJSON-1015574949-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group e9001c88-d6d1-4965-a186-6cf0bc9162a7 does not exist", "detail": ""}} {{(pid=129409) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 10 17:59:35.117430 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.network.security_group_api [None req-d3113c01-2046-4339-8a4a-3012611b3fda tempest-SecurityGroupsTestJSON-1015574949 tempest-SecurityGroupsTestJSON-1015574949-project] Neutron security group e9001c88-d6d1-4965-a186-6cf0bc9162a7 not found {{(pid=129409) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 10 17:59:35.118422 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-d3113c01-2046-4339-8a4a-3012611b3fda tempest-SecurityGroupsTestJSON-1015574949 tempest-SecurityGroupsTestJSON-1015574949-project] HTTP exception thrown: Security group e9001c88-d6d1-4965-a186-6cf0bc9162a7 does not exist Aug 10 17:59:35.118422 n-d-852296-2 devstack@n-api.service[129409]: Neutron server returns request_ids: ['req-bed9cbe4-85f2-48ad-9cde-098b385834c4'] Aug 10 17:59:35.121798 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-d3113c01-2046-4339-8a4a-3012611b3fda tempest-SecurityGroupsTestJSON-1015574949 tempest-SecurityGroupsTestJSON-1015574949-project] Request method failure captured: Aug 10 17:59:35.121798 n-d-852296-2 devstack@n-api.service[129409]: request: GET /compute/v2.1/os-security-groups/e9001c88-d6d1-4965-a186-6cf0bc9162a7 HTTP/1.1 Aug 10 17:59:35.121798 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 17:59:35.121798 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 17:59:35.121798 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 17:59:35.121798 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 0 Aug 10 17:59:35.121798 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 17:59:35.121798 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 17:59:35.121798 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 17:59:35.121798 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 17:59:35.121798 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8_H41UWn8v8K3fsyKPT7OaQXoGJFLNxnh1ePGOtxVbMhdLgXNCNN0NrnCNtgHBi1CtlCNKZmx4uk6tgFgQhh5Xq_p7l3GA2mS-R_B8G_Y5ArxD2_QwnJBi-rWbEr_yOa6UfCPZWrf4NXKgoQqB992TY45ipTMzvSaJJ4v-Zc1ug8MJY Aug 10 17:59:35.121798 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 17:59:35.121798 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 17:59:35.121798 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 17:59:35.121798 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 17:59:35.121798 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 17:59:35.121798 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 17:59:35.121798 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: d463f2ef16c940a3bd99d9f79ae3e60d Aug 10 17:59:35.121798 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-SecurityGroupsTestJSON-1015574949 Aug 10 17:59:35.121798 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 17:59:35.121798 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 17:59:35.121798 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d463f2ef16c940a3bd99d9f79ae3e60d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d463f2ef16c940a3bd99d9f79ae3e60d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d463f2ef16c940a3bd99d9f79ae3e60d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d463f2ef16c940a3bd99d9f79ae3e60d", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:59:35.121798 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-SecurityGroupsTestJSON-1015574949 Aug 10 17:59:35.121798 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: d463f2ef16c940a3bd99d9f79ae3e60d Aug 10 17:59:35.121798 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1015574949 Aug 10 17:59:35.121798 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-SecurityGroupsTestJSON-1015574949-project Aug 10 17:59:35.121798 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 17:59:35.121798 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 17:59:35.121798 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: d38b40d915604752967356b497aee153 Aug 10 17:59:35.121798 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-SecurityGroupsTestJSON-1015574949-project Aug 10 17:59:35.121798 n-d-852296-2 devstack@n-api.service[129409]: method: Aug 10 17:59:35.121798 n-d-852296-2 devstack@n-api.service[129409]: exception: Security group e9001c88-d6d1-4965-a186-6cf0bc9162a7 does not exist Aug 10 17:59:35.121798 n-d-852296-2 devstack@n-api.service[129409]: Neutron server returns request_ids: ['req-bed9cbe4-85f2-48ad-9cde-098b385834c4'] Aug 10 17:59:35.121798 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'id': 'e9001c88-d6d1-4965-a186-6cf0bc9162a7'} Aug 10 17:59:35.121798 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:59:35.121798 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:59:35.121798 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 10 17:59:35.121798 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 10 17:59:35.121798 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:59:35.121798 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:59:35.121798 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 10 17:59:35.121798 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 10 17:59:35.121798 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:59:35.121798 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:59:35.121798 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:59:35.121798 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:59:35.121798 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:59:35.121798 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:59:35.121798 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:59:35.121798 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:59:35.121798 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:59:35.121798 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:59:35.121798 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 10 17:59:35.121798 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 10 17:59:35.121798 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:59:35.121798 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:59:35.121798 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 10 17:59:35.121798 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 10 17:59:35.121798 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 10 17:59:35.121798 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 10 17:59:35.121798 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group e9001c88-d6d1-4965-a186-6cf0bc9162a7 does not exist Aug 10 17:59:35.125551 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bed9cbe4-85f2-48ad-9cde-098b385834c4'] Aug 10 17:59:35.125551 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:59:35.125551 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:59:35.125551 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:59:35.125551 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:59:35.125551 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 10 17:59:35.125551 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 10 17:59:35.125551 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 10 17:59:35.125551 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 10 17:59:35.125551 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group e9001c88-d6d1-4965-a186-6cf0bc9162a7 does not exist Aug 10 17:59:35.125551 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bed9cbe4-85f2-48ad-9cde-098b385834c4'] Aug 10 17:59:35.125551 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:59:35.125551 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:59:35.125551 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:59:35.125551 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:59:35.125551 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:59:35.125551 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:59:35.125551 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:59:35.125551 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:59:35.125551 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 17:59:35.125551 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 17:59:35.125551 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:59:35.125551 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:59:35.125551 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 10 17:59:35.125551 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 10 17:59:35.125551 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group e9001c88-d6d1-4965-a186-6cf0bc9162a7 does not exist Aug 10 17:59:35.125551 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bed9cbe4-85f2-48ad-9cde-098b385834c4'] Aug 10 17:59:35.125551 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:59:35.125551 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:59:35.125551 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:59:35.125551 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:59:35.125551 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:59:35.125551 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:59:35.125551 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:59:35.125551 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:59:35.125551 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group e9001c88-d6d1-4965-a186-6cf0bc9162a7 does not exist Aug 10 17:59:35.125551 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bed9cbe4-85f2-48ad-9cde-098b385834c4'] Aug 10 17:59:35.125551 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:59:35.133070 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-d3113c01-2046-4339-8a4a-3012611b3fda tempest-SecurityGroupsTestJSON-1015574949 tempest-SecurityGroupsTestJSON-1015574949-project] Returning 404 to user: Security group e9001c88-d6d1-4965-a186-6cf0bc9162a7 does not exist Aug 10 17:59:35.133070 n-d-852296-2 devstack@n-api.service[129409]: Neutron server returns request_ids: ['req-bed9cbe4-85f2-48ad-9cde-098b385834c4'] {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:59:35.134580 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-d3113c01-2046-4339-8a4a-3012611b3fda tempest-SecurityGroupsTestJSON-1015574949 tempest-SecurityGroupsTestJSON-1015574949-project] 10.222.0.50 "GET /compute/v2.1/os-security-groups/e9001c88-d6d1-4965-a186-6cf0bc9162a7" status: 404 len: 194 microversion: 2.1 time: 0.185579 Aug 10 17:59:35.136405 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 935/1837] 10.222.0.50 () {58 vars in 1269 bytes} [Wed Aug 10 17:59:34 2022] GET /compute/v2.1/os-security-groups/e9001c88-d6d1-4965-a186-6cf0bc9162a7 => generated 194 bytes in 188 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 17:59:35.145541 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-7310cb79-694a-4fea-ad3e-a4b0a4474dfa tempest-SecurityGroupsTestJSON-1015574949 tempest-SecurityGroupsTestJSON-1015574949-project] Calling method '.version_select at 0x7fb346015940>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:59:35.252690 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-f95b3c33-5234-44f9-bfbb-b806cec051d6 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:35.269539 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-f95b3c33-5234-44f9-bfbb-b806cec051d6 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:35.281825 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-f95b3c33-5234-44f9-bfbb-b806cec051d6 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:35.291395 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-f95b3c33-5234-44f9-bfbb-b806cec051d6 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] 10.222.0.50 "GET /compute/v2.1/servers/fc188b51-5fbb-4924-830b-fd2791814d09" status: 200 len: 1338 microversion: 2.47 time: 0.397575 Aug 10 17:59:35.294620 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 903/1838] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:59:34 2022] GET /compute/v2.1/servers/fc188b51-5fbb-4924-830b-fd2791814d09 => generated 1338 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:59:35.648012 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-9db4a4bb-dbfe-486c-a10b-f175a29ec095 tempest-AttachVolumeTestJSON-828505371 tempest-AttachVolumeTestJSON-828505371-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1813768343", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "11229dd6-3fd8-4235-a564-1d5a149b3b7b"}], "security_groups": [{"name": "tempest-securitygroup--1100459714"}], "key_name": "tempest-keypair-1508889050", "user_data": "}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:59:35.835984 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.network.neutron [None req-9db4a4bb-dbfe-486c-a10b-f175a29ec095 tempest-AttachVolumeTestJSON-828505371 tempest-AttachVolumeTestJSON-828505371-project] validate_networks() for [('11229dd6-3fd8-4235-a564-1d5a149b3b7b', None, None, None, None, None)] {{(pid=129410) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 17:59:35.915233 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-7310cb79-694a-4fea-ad3e-a4b0a4474dfa tempest-SecurityGroupsTestJSON-1015574949 tempest-SecurityGroupsTestJSON-1015574949-project] 10.222.0.50 "GET /compute/v2.1/os-security-groups" status: 200 len: 1158 microversion: 2.1 time: 0.774586 Aug 10 17:59:35.928343 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 936/1839] 10.222.0.50 () {58 vars in 1158 bytes} [Wed Aug 10 17:59:35 2022] GET /compute/v2.1/os-security-groups => generated 1158 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:59:36.122299 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-5b492bc5-e331-47ad-aceb-fa128e49559c tempest-ExtensionsTest-1854830529 tempest-ExtensionsTest-1854830529-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:59:36.124050 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-5b492bc5-e331-47ad-aceb-fa128e49559c tempest-ExtensionsTest-1854830529 tempest-ExtensionsTest-1854830529-project] 10.222.0.50 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.202780 Aug 10 17:59:36.124796 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 937/1840] 10.222.0.50 () {58 vars in 1170 bytes} [Wed Aug 10 17:59:35 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:59:36.135105 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-559325e1-dfe2-4020-a4cb-3db95d80bc34 tempest-SecurityGroupsTestJSON-1015574949 tempest-SecurityGroupsTestJSON-1015574949-project] Action: 'create', calling method: .version_select at 0x7fb345dfdee0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1119199363", "description": "tempest-description-1304025157"}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:59:36.164788 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [None req-9db4a4bb-dbfe-486c-a10b-f175a29ec095 tempest-AttachVolumeTestJSON-828505371 tempest-AttachVolumeTestJSON-828505371-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-1f962430-0a19-4b16-8e8a-a2c4ecfea640) Aug 10 17:59:36.164788 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:59:36.164788 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:59:36.164788 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:59:36.164788 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:59:36.164788 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:59:36.164788 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:59:36.164788 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:59:36.164788 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:59:36.164788 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:59:36.164788 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 17:59:36.164788 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 17:59:36.164788 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 17:59:36.164788 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 17:59:36.164788 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 17:59:36.164788 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 17:59:36.164788 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 17:59:36.164788 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 17:59:36.164788 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 17:59:36.164788 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 17:59:36.164788 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 17:59:36.164788 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 17:59:36.164788 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 17:59:36.164788 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 17:59:36.164788 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 17:59:36.164788 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 17:59:36.164788 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 17:59:36.164788 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:59:36.164788 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:59:36.164788 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 17:59:36.164788 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 17:59:36.164788 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:59:36.164788 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:59:36.164788 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:59:36.164788 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:59:36.164788 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:59:36.164788 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:59:36.164788 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:59:36.164788 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:59:36.164788 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:59:36.164788 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:59:36.164788 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 17:59:36.164788 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 17:59:36.164788 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 17:59:36.164788 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 17:59:36.164788 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 17:59:36.164788 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 17:59:36.164788 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 17:59:36.164788 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 17:59:36.164788 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 17:59:36.164788 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 17:59:36.164788 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 17:59:36.164788 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 17:59:36.170287 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 17:59:36.170287 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 17:59:36.170287 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 17:59:36.170287 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 17:59:36.170287 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 17:59:36.170287 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 17:59:36.170287 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 17:59:36.170287 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 17:59:36.170287 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 17:59:36.170287 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 17:59:36.170287 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 17:59:36.170287 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 17:59:36.170287 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 17:59:36.170287 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 17:59:36.170287 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-1f962430-0a19-4b16-8e8a-a2c4ecfea640) Aug 10 17:59:36.170287 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:59:36.170287 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-9db4a4bb-dbfe-486c-a10b-f175a29ec095 tempest-AttachVolumeTestJSON-828505371 tempest-AttachVolumeTestJSON-828505371-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:59:36.170287 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 17:59:36.173042 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-9db4a4bb-dbfe-486c-a10b-f175a29ec095 tempest-AttachVolumeTestJSON-828505371 tempest-AttachVolumeTestJSON-828505371-project] Request method failure captured: Aug 10 17:59:36.173042 n-d-852296-2 devstack@n-api.service[129410]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 17:59:36.173042 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 17:59:36.173042 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 17:59:36.173042 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 17:59:36.173042 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 486 Aug 10 17:59:36.173042 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 17:59:36.173042 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 17:59:36.173042 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 17:59:36.173042 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 17:59:36.173042 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8_HxSijsLEChzSy6WrMRSnFF2QUUxvZLUD6QC7jRJZ9eqs9tOtQWZT4eACv0TSu7-d36446JHP0Cqz_1_s5SR21b-pUmbRR-RD3OHMZlFWDVM1lfQEfPjIBU6u7Sf5OC8KNFV0_wiytAc7u_7T_m4m0UIzC8kHL9mjrhSh8kAtBhqkw Aug 10 17:59:36.173042 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 17:59:36.173042 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 17:59:36.173042 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 17:59:36.173042 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 17:59:36.173042 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 17:59:36.173042 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 17:59:36.173042 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: 2e2dbac423fc4f6296b1d5bca148dd22 Aug 10 17:59:36.173042 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-AttachVolumeTestJSON-828505371 Aug 10 17:59:36.173042 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 17:59:36.173042 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 17:59:36.173042 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2e2dbac423fc4f6296b1d5bca148dd22"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/2e2dbac423fc4f6296b1d5bca148dd22"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2e2dbac423fc4f6296b1d5bca148dd22"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_2e2dbac423fc4f6296b1d5bca148dd22", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:59:36.173042 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-AttachVolumeTestJSON-828505371 Aug 10 17:59:36.173042 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: 2e2dbac423fc4f6296b1d5bca148dd22 Aug 10 17:59:36.173042 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-AttachVolumeTestJSON-828505371 Aug 10 17:59:36.173042 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-AttachVolumeTestJSON-828505371-project Aug 10 17:59:36.173042 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 17:59:36.173042 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 17:59:36.173042 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: ecf05b05d0e948e3867f0e9b479dd0f4 Aug 10 17:59:36.173042 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-AttachVolumeTestJSON-828505371-project Aug 10 17:59:36.173042 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 17:59:36.173042 n-d-852296-2 devstack@n-api.service[129410]: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1813768343", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "adminPass": "password", "networks": [{"uuid": "11229dd6-3fd8-4235-a564-1d5a149b3b7b"}], "security_groups": [{"name": "tempest-securitygroup--1100459714"}], "key_name": "tempest-keypair-1508889050", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} Aug 10 17:59:36.173042 n-d-852296-2 devstack@n-api.service[129410]: method: > Aug 10 17:59:36.173042 n-d-852296-2 devstack@n-api.service[129410]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:59:36.173042 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 17:59:36.173042 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'body': {'server': {'name': 'tempest-AttachVolumeTestJSON-server-1813768343', 'imageRef': 'a735ff26-463a-4ffe-a981-ab9d9baa494f', 'flavorRef': '452', 'adminPass': 'password', 'networks': [{'uuid': '11229dd6-3fd8-4235-a564-1d5a149b3b7b'}], 'security_groups': [{'name': 'tempest-securitygroup--1100459714'}], 'key_name': 'tempest-keypair-1508889050', 'user_data': 'IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo='}}} Aug 10 17:59:36.173042 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:59:36.173042 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:59:36.173042 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:59:36.173042 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:59:36.173042 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:59:36.173042 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:59:36.173042 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:59:36.173042 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:59:36.173042 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:59:36.173042 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:59:36.173042 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 17:59:36.173042 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 17:59:36.173042 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 17:59:36.173042 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 17:59:36.173042 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 17:59:36.173042 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 17:59:36.173042 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 17:59:36.173042 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 17:59:36.173042 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 17:59:36.173042 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 17:59:36.177481 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 17:59:36.177481 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 17:59:36.177481 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 17:59:36.177481 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 17:59:36.177481 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 17:59:36.177481 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 17:59:36.177481 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 17:59:36.177481 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:59:36.177481 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:59:36.177481 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 17:59:36.177481 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 17:59:36.177481 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:59:36.177481 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:59:36.177481 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:59:36.177481 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:59:36.177481 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:59:36.177481 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:59:36.177481 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:59:36.177481 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:59:36.177481 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:59:36.177481 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:59:36.177481 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 17:59:36.177481 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 17:59:36.177481 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 17:59:36.177481 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 17:59:36.177481 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 17:59:36.177481 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 17:59:36.177481 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 17:59:36.177481 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 17:59:36.177481 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 17:59:36.177481 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 17:59:36.177481 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 17:59:36.177481 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 17:59:36.177481 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 17:59:36.177481 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 17:59:36.177481 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 17:59:36.177481 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 17:59:36.177481 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 17:59:36.177481 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 17:59:36.177481 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 17:59:36.177481 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 17:59:36.177481 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 17:59:36.177481 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 17:59:36.177481 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 17:59:36.177481 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 17:59:36.177481 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 17:59:36.177481 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 17:59:36.177481 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-1f962430-0a19-4b16-8e8a-a2c4ecfea640) Aug 10 17:59:36.177481 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:59:36.177481 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:59:36.177481 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:59:36.177481 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:59:36.177481 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:59:36.181323 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:59:36.181323 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:59:36.181323 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:59:36.181323 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 10 17:59:36.181323 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 10 17:59:36.181323 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:59:36.181323 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:59:36.181323 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:59:36.181323 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:59:36.181323 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:59:36.181323 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:59:36.181323 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:59:36.181323 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:59:36.181323 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:59:36.181323 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:59:36.181323 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:59:36.181323 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:59:36.181323 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:59:36.181323 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-9db4a4bb-dbfe-486c-a10b-f175a29ec095 tempest-AttachVolumeTestJSON-828505371 tempest-AttachVolumeTestJSON-828505371-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:59:36.181323 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:59:36.183424 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-9db4a4bb-dbfe-486c-a10b-f175a29ec095 tempest-AttachVolumeTestJSON-828505371 tempest-AttachVolumeTestJSON-828505371-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.535733 Aug 10 17:59:36.186862 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 904/1841] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 17:59:35 2022] POST /compute/v2.1/servers => generated 214 bytes in 541 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 10 17:59:36.189270 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-199d3369-4bfd-4351-889b-c0bb86e11440 tempest-ExtensionsTest-1854830529 tempest-ExtensionsTest-1854830529-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:59:36.206743 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-199d3369-4bfd-4351-889b-c0bb86e11440 tempest-ExtensionsTest-1854830529 tempest-ExtensionsTest-1854830529-project] 10.222.0.50 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.005936 Aug 10 17:59:36.206743 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 905/1842] 10.222.0.50 () {58 vars in 1134 bytes} [Wed Aug 10 17:59:36 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 17:59:36.206743 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-9b0a6c84-5212-4926-b4a0-8a74188721f1 tempest-AttachVolumeTestJSON-828505371 tempest-AttachVolumeTestJSON-828505371-project] Calling method '.version_select at 0x7fb345df7040>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:59:36.399060 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-9b0a6c84-5212-4926-b4a0-8a74188721f1 tempest-AttachVolumeTestJSON-828505371 tempest-AttachVolumeTestJSON-828505371-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1508889050" status: 202 len: 0 microversion: 2.1 time: 0.205568 Aug 10 17:59:36.399867 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 906/1843] 10.222.0.50 () {58 vars in 1221 bytes} [Wed Aug 10 17:59:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1508889050 => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 17:59:36.405451 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-db395682-e297-4037-b53c-531284fca2a2 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:59:36.406052 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-db395682-e297-4037-b53c-531284fca2a2 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] [instance: fc188b51-5fbb-4924-830b-fd2791814d09] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:59:36.413051 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-db395682-e297-4037-b53c-531284fca2a2 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:59:36.413870 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-db395682-e297-4037-b53c-531284fca2a2 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:59:36.414543 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-db395682-e297-4037-b53c-531284fca2a2 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:59:36.415465 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-db395682-e297-4037-b53c-531284fca2a2 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:59:36.416142 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-db395682-e297-4037-b53c-531284fca2a2 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:59:36.417654 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-db395682-e297-4037-b53c-531284fca2a2 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:59:36.560311 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-db395682-e297-4037-b53c-531284fca2a2 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:36.572429 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-db395682-e297-4037-b53c-531284fca2a2 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:36.574316 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-db395682-e297-4037-b53c-531284fca2a2 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:36.575762 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-db395682-e297-4037-b53c-531284fca2a2 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] 10.222.0.50 "GET /compute/v2.1/servers/fc188b51-5fbb-4924-830b-fd2791814d09" status: 200 len: 1336 microversion: 2.47 time: 0.174734 Aug 10 17:59:36.577281 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 907/1844] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:59:36 2022] GET /compute/v2.1/servers/fc188b51-5fbb-4924-830b-fd2791814d09 => generated 1336 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:59:37.070092 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-559325e1-dfe2-4020-a4cb-3db95d80bc34 tempest-SecurityGroupsTestJSON-1015574949 tempest-SecurityGroupsTestJSON-1015574949-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.939525 Aug 10 17:59:37.071147 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 938/1845] 10.222.0.50 () {60 vars in 1180 bytes} [Wed Aug 10 17:59:36 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:59:37.084388 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-cf7dca37-28ec-4be1-bae8-67e3226841cb tempest-SecurityGroupsTestJSON-1015574949 tempest-SecurityGroupsTestJSON-1015574949-project] Action: 'create', calling method: .version_select at 0x7fb345df79d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1838927838", "description": "tempest-description-862593796"}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:59:37.599484 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-b4a38ce3-cdab-4690-96b4-4d651022607a tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:59:37.600107 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-b4a38ce3-cdab-4690-96b4-4d651022607a tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] [instance: fc188b51-5fbb-4924-830b-fd2791814d09] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:59:37.607543 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-b4a38ce3-cdab-4690-96b4-4d651022607a tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:59:37.608053 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-b4a38ce3-cdab-4690-96b4-4d651022607a tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:59:37.608521 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-b4a38ce3-cdab-4690-96b4-4d651022607a tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:59:37.609237 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-b4a38ce3-cdab-4690-96b4-4d651022607a tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:59:37.609695 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-b4a38ce3-cdab-4690-96b4-4d651022607a tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:59:37.610123 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-b4a38ce3-cdab-4690-96b4-4d651022607a tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:59:37.691305 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-b4a38ce3-cdab-4690-96b4-4d651022607a tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:37.712662 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-b4a38ce3-cdab-4690-96b4-4d651022607a tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:37.712662 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-b4a38ce3-cdab-4690-96b4-4d651022607a tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:37.712662 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-b4a38ce3-cdab-4690-96b4-4d651022607a tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] 10.222.0.50 "GET /compute/v2.1/servers/fc188b51-5fbb-4924-830b-fd2791814d09" status: 200 len: 1336 microversion: 2.47 time: 0.109880 Aug 10 17:59:37.712662 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 939/1846] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:59:37 2022] GET /compute/v2.1/servers/fc188b51-5fbb-4924-830b-fd2791814d09 => generated 1336 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 17:59:38.570330 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-cf7dca37-28ec-4be1-bae8-67e3226841cb tempest-SecurityGroupsTestJSON-1015574949 tempest-SecurityGroupsTestJSON-1015574949-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.490589 Aug 10 17:59:38.577289 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 908/1847] 10.222.0.50 () {60 vars in 1180 bytes} [Wed Aug 10 17:59:37 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1498 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:59:38.730347 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-c70a089e-09a5-4e3c-9797-fe72cdbeffb7 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:59:38.731871 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-c70a089e-09a5-4e3c-9797-fe72cdbeffb7 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] [instance: fc188b51-5fbb-4924-830b-fd2791814d09] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:59:38.741235 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c70a089e-09a5-4e3c-9797-fe72cdbeffb7 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:59:38.746873 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c70a089e-09a5-4e3c-9797-fe72cdbeffb7 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:59:38.747642 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c70a089e-09a5-4e3c-9797-fe72cdbeffb7 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:59:38.748912 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c70a089e-09a5-4e3c-9797-fe72cdbeffb7 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:59:38.749735 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c70a089e-09a5-4e3c-9797-fe72cdbeffb7 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:59:38.750332 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c70a089e-09a5-4e3c-9797-fe72cdbeffb7 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:59:38.877735 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-400b9883-b10a-4758-9d95-badcb363a924 tempest-SecurityGroupsTestJSON-1015574949 tempest-SecurityGroupsTestJSON-1015574949-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1451082482", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "3e5deeb2-598f-46b2-82c7-15e5b5515127"}]}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:59:38.952012 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-c70a089e-09a5-4e3c-9797-fe72cdbeffb7 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:38.968963 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-c70a089e-09a5-4e3c-9797-fe72cdbeffb7 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:38.970507 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-c70a089e-09a5-4e3c-9797-fe72cdbeffb7 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:38.971749 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-c70a089e-09a5-4e3c-9797-fe72cdbeffb7 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] 10.222.0.50 "GET /compute/v2.1/servers/fc188b51-5fbb-4924-830b-fd2791814d09" status: 200 len: 1336 microversion: 2.47 time: 0.247640 Aug 10 17:59:38.990889 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.network.neutron [None req-400b9883-b10a-4758-9d95-badcb363a924 tempest-SecurityGroupsTestJSON-1015574949 tempest-SecurityGroupsTestJSON-1015574949-project] validate_networks() for [('3e5deeb2-598f-46b2-82c7-15e5b5515127', None, None, None, None, None)] {{(pid=129410) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 17:59:38.992744 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 940/1848] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:59:38 2022] GET /compute/v2.1/servers/fc188b51-5fbb-4924-830b-fd2791814d09 => generated 1336 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:59:39.454643 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [None req-400b9883-b10a-4758-9d95-badcb363a924 tempest-SecurityGroupsTestJSON-1015574949 tempest-SecurityGroupsTestJSON-1015574949-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-3eff81bf-e3bb-4a07-befe-999b51c7d490) Aug 10 17:59:39.454643 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:59:39.454643 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:59:39.454643 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:59:39.454643 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:59:39.454643 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:59:39.454643 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:59:39.454643 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:59:39.454643 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:59:39.454643 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:59:39.454643 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 17:59:39.454643 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 17:59:39.454643 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 17:59:39.454643 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 17:59:39.454643 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 17:59:39.454643 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 17:59:39.454643 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 17:59:39.454643 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 17:59:39.454643 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 17:59:39.454643 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 17:59:39.454643 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 17:59:39.454643 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 17:59:39.454643 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 17:59:39.454643 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 17:59:39.454643 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 17:59:39.454643 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 17:59:39.454643 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 17:59:39.454643 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:59:39.454643 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:59:39.454643 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 17:59:39.454643 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 17:59:39.454643 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:59:39.454643 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:59:39.454643 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:59:39.454643 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:59:39.454643 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:59:39.454643 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:59:39.454643 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:59:39.454643 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:59:39.454643 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:59:39.454643 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:59:39.454643 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 17:59:39.454643 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 17:59:39.454643 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 17:59:39.454643 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 17:59:39.454643 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 17:59:39.454643 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 17:59:39.454643 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 17:59:39.454643 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 17:59:39.454643 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 17:59:39.454643 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 17:59:39.454643 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 17:59:39.454643 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 17:59:39.458596 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 17:59:39.458596 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 17:59:39.458596 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 17:59:39.458596 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 17:59:39.458596 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 17:59:39.458596 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 17:59:39.458596 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 17:59:39.458596 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 17:59:39.458596 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 17:59:39.458596 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 17:59:39.458596 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 17:59:39.458596 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 17:59:39.458596 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 17:59:39.458596 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 17:59:39.458596 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-3eff81bf-e3bb-4a07-befe-999b51c7d490) Aug 10 17:59:39.458596 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:59:39.458596 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-400b9883-b10a-4758-9d95-badcb363a924 tempest-SecurityGroupsTestJSON-1015574949 tempest-SecurityGroupsTestJSON-1015574949-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:59:39.458596 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 17:59:39.460943 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-400b9883-b10a-4758-9d95-badcb363a924 tempest-SecurityGroupsTestJSON-1015574949 tempest-SecurityGroupsTestJSON-1015574949-project] Request method failure captured: Aug 10 17:59:39.460943 n-d-852296-2 devstack@n-api.service[129410]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 17:59:39.460943 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 17:59:39.460943 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 17:59:39.460943 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 17:59:39.460943 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 208 Aug 10 17:59:39.460943 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 17:59:39.460943 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 17:59:39.460943 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 17:59:39.460943 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 17:59:39.460943 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8_H41UWn8v8K3fsyKPT7OaQXoGJFLNxnh1ePGOtxVbMhdLgXNCNN0NrnCNtgHBi1CtlCNKZmx4uk6tgFgQhh5Xq_p7l3GA2mS-R_B8G_Y5ArxD2_QwnJBi-rWbEr_yOa6UfCPZWrf4NXKgoQqB992TY45ipTMzvSaJJ4v-Zc1ug8MJY Aug 10 17:59:39.460943 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 17:59:39.460943 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 17:59:39.460943 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 17:59:39.460943 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 17:59:39.460943 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 17:59:39.460943 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 17:59:39.460943 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: d463f2ef16c940a3bd99d9f79ae3e60d Aug 10 17:59:39.460943 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-SecurityGroupsTestJSON-1015574949 Aug 10 17:59:39.460943 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 17:59:39.460943 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 17:59:39.460943 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d463f2ef16c940a3bd99d9f79ae3e60d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d463f2ef16c940a3bd99d9f79ae3e60d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d463f2ef16c940a3bd99d9f79ae3e60d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d463f2ef16c940a3bd99d9f79ae3e60d", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:59:39.460943 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-SecurityGroupsTestJSON-1015574949 Aug 10 17:59:39.460943 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: d463f2ef16c940a3bd99d9f79ae3e60d Aug 10 17:59:39.460943 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1015574949 Aug 10 17:59:39.460943 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-SecurityGroupsTestJSON-1015574949-project Aug 10 17:59:39.460943 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 17:59:39.460943 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 17:59:39.460943 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: d38b40d915604752967356b497aee153 Aug 10 17:59:39.460943 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-SecurityGroupsTestJSON-1015574949-project Aug 10 17:59:39.460943 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 17:59:39.460943 n-d-852296-2 devstack@n-api.service[129410]: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1451082482", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "3e5deeb2-598f-46b2-82c7-15e5b5515127"}]}} Aug 10 17:59:39.460943 n-d-852296-2 devstack@n-api.service[129410]: method: > Aug 10 17:59:39.460943 n-d-852296-2 devstack@n-api.service[129410]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:59:39.460943 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 17:59:39.460943 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'body': {'server': {'name': 'tempest-SecurityGroupsTestJSON-server-1451082482', 'imageRef': 'a735ff26-463a-4ffe-a981-ab9d9baa494f', 'flavorRef': '452', 'networks': [{'uuid': '3e5deeb2-598f-46b2-82c7-15e5b5515127'}]}}} Aug 10 17:59:39.460943 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:59:39.460943 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:59:39.460943 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:59:39.460943 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:59:39.460943 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:59:39.460943 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:59:39.460943 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:59:39.460943 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:59:39.460943 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:59:39.460943 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:59:39.460943 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 17:59:39.460943 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 17:59:39.460943 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 17:59:39.460943 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 17:59:39.460943 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 17:59:39.460943 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 17:59:39.460943 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 17:59:39.460943 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 17:59:39.460943 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 17:59:39.460943 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 17:59:39.460943 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 17:59:39.460943 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 17:59:39.460943 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 17:59:39.460943 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 17:59:39.460943 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 17:59:39.475919 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 17:59:39.475919 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 17:59:39.475919 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:59:39.475919 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:59:39.475919 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 17:59:39.475919 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 17:59:39.475919 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:59:39.475919 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:59:39.475919 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:59:39.475919 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:59:39.475919 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:59:39.475919 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:59:39.475919 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:59:39.475919 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:59:39.475919 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:59:39.475919 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:59:39.475919 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 17:59:39.475919 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 17:59:39.475919 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 17:59:39.475919 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 17:59:39.475919 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 17:59:39.475919 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 17:59:39.475919 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 17:59:39.475919 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 17:59:39.475919 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 17:59:39.475919 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 17:59:39.475919 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 17:59:39.475919 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 17:59:39.475919 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 17:59:39.475919 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 17:59:39.475919 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 17:59:39.475919 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 17:59:39.475919 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 17:59:39.475919 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 17:59:39.475919 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 17:59:39.475919 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 17:59:39.475919 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 17:59:39.475919 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 17:59:39.475919 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 17:59:39.475919 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 17:59:39.475919 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 17:59:39.475919 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 17:59:39.475919 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-3eff81bf-e3bb-4a07-befe-999b51c7d490) Aug 10 17:59:39.475919 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:59:39.475919 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:59:39.475919 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:59:39.475919 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:59:39.475919 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:59:39.475919 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:59:39.475919 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:59:39.475919 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:59:39.475919 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 10 17:59:39.475919 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 10 17:59:39.485771 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:59:39.485771 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:59:39.485771 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:59:39.485771 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:59:39.485771 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:59:39.485771 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:59:39.485771 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:59:39.485771 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:59:39.485771 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:59:39.485771 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:59:39.485771 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:59:39.485771 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:59:39.485771 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:59:39.485771 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-400b9883-b10a-4758-9d95-badcb363a924 tempest-SecurityGroupsTestJSON-1015574949 tempest-SecurityGroupsTestJSON-1015574949-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:59:39.485771 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:59:39.485771 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-400b9883-b10a-4758-9d95-badcb363a924 tempest-SecurityGroupsTestJSON-1015574949 tempest-SecurityGroupsTestJSON-1015574949-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.600645 Aug 10 17:59:39.485771 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 909/1849] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 17:59:38 2022] POST /compute/v2.1/servers => generated 214 bytes in 602 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 10 17:59:39.487946 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-ee4291d5-3916-46e1-92fc-27338c9b8edc tempest-SecurityGroupsTestJSON-1015574949 tempest-SecurityGroupsTestJSON-1015574949-project] Action: 'create', calling method: .version_select at 0x7fb345d9b670>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-270628444", "description": "tempest-description-1239239322"}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:59:39.755421 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_cell0:SELECT=2 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:59:40.015006 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-2351ec74-6e48-48b3-a9e6-2c2ef4148c79 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:59:40.015632 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-2351ec74-6e48-48b3-a9e6-2c2ef4148c79 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] [instance: fc188b51-5fbb-4924-830b-fd2791814d09] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:59:40.031181 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2351ec74-6e48-48b3-a9e6-2c2ef4148c79 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:59:40.031710 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2351ec74-6e48-48b3-a9e6-2c2ef4148c79 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:59:40.032365 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2351ec74-6e48-48b3-a9e6-2c2ef4148c79 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:59:40.033095 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2351ec74-6e48-48b3-a9e6-2c2ef4148c79 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:59:40.033561 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2351ec74-6e48-48b3-a9e6-2c2ef4148c79 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:59:40.039740 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2351ec74-6e48-48b3-a9e6-2c2ef4148c79 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:59:40.301064 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-2351ec74-6e48-48b3-a9e6-2c2ef4148c79 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:40.310205 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-2351ec74-6e48-48b3-a9e6-2c2ef4148c79 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:40.311774 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-2351ec74-6e48-48b3-a9e6-2c2ef4148c79 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:40.312982 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-2351ec74-6e48-48b3-a9e6-2c2ef4148c79 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] 10.222.0.50 "GET /compute/v2.1/servers/fc188b51-5fbb-4924-830b-fd2791814d09" status: 200 len: 1357 microversion: 2.47 time: 0.302544 Aug 10 17:59:40.318419 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 910/1850] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:59:40 2022] GET /compute/v2.1/servers/fc188b51-5fbb-4924-830b-fd2791814d09 => generated 1357 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:59:40.343868 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-195a5ad8-3cb3-435a-8152-afbae0c5db76 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f"}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:59:40.350585 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-195a5ad8-3cb3-435a-8152-afbae0c5db76 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] [instance: fc188b51-5fbb-4924-830b-fd2791814d09] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:59:40.365738 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-195a5ad8-3cb3-435a-8152-afbae0c5db76 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:59:40.366234 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-195a5ad8-3cb3-435a-8152-afbae0c5db76 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:59:40.366994 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-195a5ad8-3cb3-435a-8152-afbae0c5db76 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:59:40.368024 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-195a5ad8-3cb3-435a-8152-afbae0c5db76 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:59:40.368791 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-195a5ad8-3cb3-435a-8152-afbae0c5db76 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:59:40.369446 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-195a5ad8-3cb3-435a-8152-afbae0c5db76 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:59:40.497786 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.virt.hardware [None req-195a5ad8-3cb3-435a-8152-afbae0c5db76 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Flavor limits 0:0:0 {{(pid=129410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 17:59:40.502976 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.virt.hardware [None req-195a5ad8-3cb3-435a-8152-afbae0c5db76 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Image limits 0:0:0 {{(pid=129410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 17:59:40.502976 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.virt.hardware [None req-195a5ad8-3cb3-435a-8152-afbae0c5db76 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Flavor pref 0:0:0 {{(pid=129410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 17:59:40.502976 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.virt.hardware [None req-195a5ad8-3cb3-435a-8152-afbae0c5db76 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Image pref 0:0:0 {{(pid=129410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 17:59:40.502976 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.virt.hardware [None req-195a5ad8-3cb3-435a-8152-afbae0c5db76 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 17:59:40.676644 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_cell0:SELECT=2 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:59:40.740115 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-ee4291d5-3916-46e1-92fc-27338c9b8edc tempest-SecurityGroupsTestJSON-1015574949 tempest-SecurityGroupsTestJSON-1015574949-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.261923 Aug 10 17:59:40.743757 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 941/1851] 10.222.0.50 () {60 vars in 1180 bytes} [Wed Aug 10 17:59:39 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:59:40.746072 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-195a5ad8-3cb3-435a-8152-afbae0c5db76 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] [instance: fc188b51-5fbb-4924-830b-fd2791814d09] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:59:40.753359 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-195a5ad8-3cb3-435a-8152-afbae0c5db76 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:59:40.754896 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-195a5ad8-3cb3-435a-8152-afbae0c5db76 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:59:40.755530 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-195a5ad8-3cb3-435a-8152-afbae0c5db76 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:59:40.756972 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-195a5ad8-3cb3-435a-8152-afbae0c5db76 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:59:40.757754 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-195a5ad8-3cb3-435a-8152-afbae0c5db76 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:59:40.758531 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-195a5ad8-3cb3-435a-8152-afbae0c5db76 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:59:40.762485 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-86081a84-fead-4db8-a33e-805122ca3ef5 tempest-SecurityGroupsTestJSON-1015574949 tempest-SecurityGroupsTestJSON-1015574949-project] Action: 'update', calling method: .version_select at 0x7fb345d76c10>, body: {"security_group": {"name": "tempest-sg-hth-1937654124", "description": "tempest-description-hth-433538840"}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:59:40.864142 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-195a5ad8-3cb3-435a-8152-afbae0c5db76 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] 10.222.0.50 "POST /compute/v2.1/servers/fc188b51-5fbb-4924-830b-fd2791814d09/action" status: 202 len: 1079 microversion: 2.47 time: 0.524021 Aug 10 17:59:40.865428 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 911/1852] 10.222.0.50 () {62 vars in 1319 bytes} [Wed Aug 10 17:59:40 2022] POST /compute/v2.1/servers/fc188b51-5fbb-4924-830b-fd2791814d09/action => generated 1079 bytes in 530 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Aug 10 17:59:40.892497 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-4b03dcfd-5dd1-4c8e-8b2c-b1f141d362f7 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:59:40.895588 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-4b03dcfd-5dd1-4c8e-8b2c-b1f141d362f7 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] [instance: fc188b51-5fbb-4924-830b-fd2791814d09] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:59:40.904275 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-4b03dcfd-5dd1-4c8e-8b2c-b1f141d362f7 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:59:40.905454 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-4b03dcfd-5dd1-4c8e-8b2c-b1f141d362f7 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:59:40.906097 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-4b03dcfd-5dd1-4c8e-8b2c-b1f141d362f7 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:59:40.907036 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-4b03dcfd-5dd1-4c8e-8b2c-b1f141d362f7 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:59:40.907656 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-4b03dcfd-5dd1-4c8e-8b2c-b1f141d362f7 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:59:40.908290 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-4b03dcfd-5dd1-4c8e-8b2c-b1f141d362f7 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:59:41.095008 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-4b03dcfd-5dd1-4c8e-8b2c-b1f141d362f7 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:41.097413 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:59:41.107113 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-4b03dcfd-5dd1-4c8e-8b2c-b1f141d362f7 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:41.108685 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-4b03dcfd-5dd1-4c8e-8b2c-b1f141d362f7 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:41.111769 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-4b03dcfd-5dd1-4c8e-8b2c-b1f141d362f7 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] 10.222.0.50 "GET /compute/v2.1/servers/fc188b51-5fbb-4924-830b-fd2791814d09" status: 200 len: 1366 microversion: 2.47 time: 0.227563 Aug 10 17:59:41.113188 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 912/1853] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:59:40 2022] GET /compute/v2.1/servers/fc188b51-5fbb-4924-830b-fd2791814d09 => generated 1366 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:59:41.686872 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-86081a84-fead-4db8-a33e-805122ca3ef5 tempest-SecurityGroupsTestJSON-1015574949 tempest-SecurityGroupsTestJSON-1015574949-project] 10.222.0.50 "PUT /compute/v2.1/os-security-groups/fe77d667-dd82-469e-890e-8303a0aec098" status: 200 len: 217 microversion: 2.1 time: 0.936225 Aug 10 17:59:41.687541 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 942/1854] 10.222.0.50 () {60 vars in 1290 bytes} [Wed Aug 10 17:59:40 2022] PUT /compute/v2.1/os-security-groups/fe77d667-dd82-469e-890e-8303a0aec098 => generated 217 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:59:41.701259 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-e39d8ce6-a050-4ae5-9c93-efd44c8f4213 tempest-SecurityGroupsTestJSON-1015574949 tempest-SecurityGroupsTestJSON-1015574949-project] Calling method '.version_select at 0x7fb345a3edc0>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:59:41.715101 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_cell0:SELECT=12 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:59:42.102086 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-e39d8ce6-a050-4ae5-9c93-efd44c8f4213 tempest-SecurityGroupsTestJSON-1015574949 tempest-SecurityGroupsTestJSON-1015574949-project] 10.222.0.50 "GET /compute/v2.1/os-security-groups/fe77d667-dd82-469e-890e-8303a0aec098" status: 200 len: 217 microversion: 2.1 time: 0.405854 Aug 10 17:59:42.104014 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 913/1855] 10.222.0.50 () {58 vars in 1269 bytes} [Wed Aug 10 17:59:41 2022] GET /compute/v2.1/os-security-groups/fe77d667-dd82-469e-890e-8303a0aec098 => generated 217 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:59:42.120198 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-db7d7ade-4184-4cdd-b518-69bfdd015916 tempest-SecurityGroupsTestJSON-1015574949 tempest-SecurityGroupsTestJSON-1015574949-project] Calling method '.version_select at 0x7fb345d76700>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:59:42.146399 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-d7e2ed28-aadc-4955-9eaf-3d9d37d5d85f tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:59:42.152810 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-d7e2ed28-aadc-4955-9eaf-3d9d37d5d85f tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] [instance: fc188b51-5fbb-4924-830b-fd2791814d09] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:59:42.157369 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d7e2ed28-aadc-4955-9eaf-3d9d37d5d85f tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:59:42.161245 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d7e2ed28-aadc-4955-9eaf-3d9d37d5d85f tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:59:42.161926 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d7e2ed28-aadc-4955-9eaf-3d9d37d5d85f tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:59:42.163090 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d7e2ed28-aadc-4955-9eaf-3d9d37d5d85f tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:59:42.171242 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d7e2ed28-aadc-4955-9eaf-3d9d37d5d85f tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:59:42.171955 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d7e2ed28-aadc-4955-9eaf-3d9d37d5d85f tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:59:42.657945 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_cell0:SELECT=10 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:59:42.992556 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-db7d7ade-4184-4cdd-b518-69bfdd015916 tempest-SecurityGroupsTestJSON-1015574949 tempest-SecurityGroupsTestJSON-1015574949-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/fe77d667-dd82-469e-890e-8303a0aec098" status: 202 len: 0 microversion: 2.1 time: 0.877639 Aug 10 17:59:42.993398 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 943/1856] 10.222.0.50 () {58 vars in 1272 bytes} [Wed Aug 10 17:59:42 2022] DELETE /compute/v2.1/os-security-groups/fe77d667-dd82-469e-890e-8303a0aec098 => generated 0 bytes in 879 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 17:59:43.026916 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-d7e2ed28-aadc-4955-9eaf-3d9d37d5d85f tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:43.047207 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-d7e2ed28-aadc-4955-9eaf-3d9d37d5d85f tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:43.056264 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-d7e2ed28-aadc-4955-9eaf-3d9d37d5d85f tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:43.061067 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-d7e2ed28-aadc-4955-9eaf-3d9d37d5d85f tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] 10.222.0.50 "GET /compute/v2.1/servers/fc188b51-5fbb-4924-830b-fd2791814d09" status: 200 len: 1366 microversion: 2.47 time: 0.919695 Aug 10 17:59:43.084964 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 914/1857] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:59:42 2022] GET /compute/v2.1/servers/fc188b51-5fbb-4924-830b-fd2791814d09 => generated 1366 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:59:43.105180 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-aa7a704e-6aa2-46f8-9ab1-23f722156da9 tempest-SecurityGroupsTestJSON-1015574949 tempest-SecurityGroupsTestJSON-1015574949-project] Calling method '.version_select at 0x7fb345bd3c10>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:59:43.204072 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-1c73c592-96ea-4a4b-8394-c1cd5b7c7e41 tempest-ListServerFiltersTestJSON-1606274534 tempest-ListServerFiltersTestJSON-1606274534-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-826514211", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "79b76940-fb92-4cb8-8d7b-20d3b58fe6e8"}]}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:59:43.365875 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.network.neutron [None req-1c73c592-96ea-4a4b-8394-c1cd5b7c7e41 tempest-ListServerFiltersTestJSON-1606274534 tempest-ListServerFiltersTestJSON-1606274534-project] validate_networks() for [('79b76940-fb92-4cb8-8d7b-20d3b58fe6e8', None, None, None, None, None)] {{(pid=129409) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 17:59:44.134026 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-aa7a704e-6aa2-46f8-9ab1-23f722156da9 tempest-SecurityGroupsTestJSON-1015574949 tempest-SecurityGroupsTestJSON-1015574949-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/6522f65c-7714-44c8-8c18-074439e6ffb0" status: 202 len: 0 microversion: 2.1 time: 1.046342 Aug 10 17:59:44.138302 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 915/1858] 10.222.0.50 () {58 vars in 1272 bytes} [Wed Aug 10 17:59:43 2022] DELETE /compute/v2.1/os-security-groups/6522f65c-7714-44c8-8c18-074439e6ffb0 => generated 0 bytes in 1049 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 17:59:44.143237 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-52354928-9cec-4e46-abb9-e22cdf632642 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:59:44.144516 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-52354928-9cec-4e46-abb9-e22cdf632642 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] [instance: fc188b51-5fbb-4924-830b-fd2791814d09] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:59:44.157775 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-52354928-9cec-4e46-abb9-e22cdf632642 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:59:44.158977 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-52354928-9cec-4e46-abb9-e22cdf632642 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:59:44.159667 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-52354928-9cec-4e46-abb9-e22cdf632642 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:59:44.160661 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-52354928-9cec-4e46-abb9-e22cdf632642 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:59:44.161378 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-52354928-9cec-4e46-abb9-e22cdf632642 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:59:44.162262 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-52354928-9cec-4e46-abb9-e22cdf632642 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:59:44.275439 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-52354928-9cec-4e46-abb9-e22cdf632642 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:44.305433 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-52354928-9cec-4e46-abb9-e22cdf632642 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:44.307392 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-52354928-9cec-4e46-abb9-e22cdf632642 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:44.310175 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-52354928-9cec-4e46-abb9-e22cdf632642 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] 10.222.0.50 "GET /compute/v2.1/servers/fc188b51-5fbb-4924-830b-fd2791814d09" status: 200 len: 1366 microversion: 2.47 time: 0.172454 Aug 10 17:59:44.311587 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 916/1859] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:59:44 2022] GET /compute/v2.1/servers/fc188b51-5fbb-4924-830b-fd2791814d09 => generated 1366 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:59:44.316726 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-424c5f5d-5a7f-4095-9f0c-e19f7ae9bfca tempest-SecurityGroupsTestJSON-1015574949 tempest-SecurityGroupsTestJSON-1015574949-project] Calling method '.version_select at 0x7fb345bd3700>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:59:44.557375 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [None req-1c73c592-96ea-4a4b-8394-c1cd5b7c7e41 tempest-ListServerFiltersTestJSON-1606274534 tempest-ListServerFiltersTestJSON-1606274534-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-921f8400-24a1-44e9-9f0b-a2a98671e016) Aug 10 17:59:44.557375 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:59:44.557375 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:59:44.557375 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:59:44.557375 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:59:44.557375 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:59:44.557375 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:59:44.557375 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:59:44.557375 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:59:44.557375 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:59:44.557375 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 17:59:44.557375 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 17:59:44.557375 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 17:59:44.557375 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 17:59:44.557375 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 17:59:44.557375 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 17:59:44.557375 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 17:59:44.557375 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 17:59:44.557375 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 17:59:44.557375 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 17:59:44.557375 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 17:59:44.557375 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 17:59:44.557375 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 17:59:44.557375 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 17:59:44.557375 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 17:59:44.557375 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 17:59:44.557375 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 17:59:44.557375 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:59:44.557375 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:59:44.557375 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 17:59:44.557375 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 17:59:44.557375 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:59:44.557375 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:59:44.557375 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:59:44.557375 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:59:44.557375 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:59:44.557375 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:59:44.557375 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:59:44.557375 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:59:44.557375 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:59:44.557375 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:59:44.557375 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 17:59:44.557375 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 17:59:44.557375 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 17:59:44.557375 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 17:59:44.557375 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 17:59:44.557375 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 17:59:44.557375 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 17:59:44.557375 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 17:59:44.557375 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 17:59:44.557375 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 17:59:44.557375 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 17:59:44.561939 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 17:59:44.561939 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 17:59:44.561939 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 17:59:44.561939 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 17:59:44.561939 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 17:59:44.561939 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 17:59:44.561939 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 17:59:44.561939 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 17:59:44.561939 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 17:59:44.561939 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 17:59:44.561939 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 17:59:44.561939 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 17:59:44.561939 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 17:59:44.561939 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 17:59:44.561939 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 17:59:44.561939 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-921f8400-24a1-44e9-9f0b-a2a98671e016) Aug 10 17:59:44.561939 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:59:44.564130 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-1c73c592-96ea-4a4b-8394-c1cd5b7c7e41 tempest-ListServerFiltersTestJSON-1606274534 tempest-ListServerFiltersTestJSON-1606274534-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:59:44.564130 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:59:44.571835 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-1c73c592-96ea-4a4b-8394-c1cd5b7c7e41 tempest-ListServerFiltersTestJSON-1606274534 tempest-ListServerFiltersTestJSON-1606274534-project] Request method failure captured: Aug 10 17:59:44.571835 n-d-852296-2 devstack@n-api.service[129409]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 17:59:44.571835 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 17:59:44.571835 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 17:59:44.571835 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 17:59:44.571835 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 212 Aug 10 17:59:44.571835 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 17:59:44.571835 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 17:59:44.571835 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 17:59:44.571835 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 17:59:44.571835 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8_IOYa-k4pjCHMd0zDpv9hCf_8p6qlJDnnRMA-6cENqb4wfm-AR8PL2NWeDExHe5IyKBYPAbfHdDjGeS2ZpkJ24Sya_j5FpvRqr3cFpalxa_FEZUW2WITWjna11BV3KcnDZU5c__kC0vGduW2Uv2wTifFZixHNq5zX1qGGQUuqI6TY8 Aug 10 17:59:44.571835 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 17:59:44.571835 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 17:59:44.571835 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 17:59:44.571835 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 17:59:44.571835 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 17:59:44.571835 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 17:59:44.571835 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: bd2eb490859e40768b3d04d49e05bc99 Aug 10 17:59:44.571835 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-ListServerFiltersTestJSON-1606274534 Aug 10 17:59:44.571835 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 17:59:44.571835 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 17:59:44.571835 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/bd2eb490859e40768b3d04d49e05bc99"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/bd2eb490859e40768b3d04d49e05bc99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/bd2eb490859e40768b3d04d49e05bc99"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_bd2eb490859e40768b3d04d49e05bc99", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:59:44.571835 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-ListServerFiltersTestJSON-1606274534 Aug 10 17:59:44.571835 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: bd2eb490859e40768b3d04d49e05bc99 Aug 10 17:59:44.571835 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1606274534 Aug 10 17:59:44.571835 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-ListServerFiltersTestJSON-1606274534-project Aug 10 17:59:44.571835 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 17:59:44.571835 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 17:59:44.571835 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: 9316607ee85e43808e7ca30f30342d5c Aug 10 17:59:44.571835 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-ListServerFiltersTestJSON-1606274534-project Aug 10 17:59:44.571835 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:59:44.571835 n-d-852296-2 devstack@n-api.service[129409]: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-826514211", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "79b76940-fb92-4cb8-8d7b-20d3b58fe6e8"}]}} Aug 10 17:59:44.571835 n-d-852296-2 devstack@n-api.service[129409]: method: > Aug 10 17:59:44.571835 n-d-852296-2 devstack@n-api.service[129409]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:59:44.571835 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:59:44.571835 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'body': {'server': {'name': 'tempest-ListServerFiltersTestJSON-instance-826514211', 'imageRef': 'a735ff26-463a-4ffe-a981-ab9d9baa494f', 'flavorRef': '452', 'networks': [{'uuid': '79b76940-fb92-4cb8-8d7b-20d3b58fe6e8'}]}}} Aug 10 17:59:44.571835 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:59:44.571835 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:59:44.571835 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:59:44.571835 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:59:44.571835 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:59:44.571835 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:59:44.571835 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:59:44.571835 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:59:44.571835 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:59:44.571835 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:59:44.571835 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 17:59:44.571835 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 17:59:44.571835 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 17:59:44.571835 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 17:59:44.571835 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 17:59:44.571835 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 17:59:44.571835 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 17:59:44.571835 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 17:59:44.571835 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 17:59:44.571835 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 17:59:44.571835 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 17:59:44.571835 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 17:59:44.571835 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 17:59:44.571835 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 17:59:44.571835 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 17:59:44.580662 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 17:59:44.580662 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 17:59:44.580662 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:59:44.580662 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:59:44.580662 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 17:59:44.580662 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 17:59:44.580662 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:59:44.580662 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:59:44.580662 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:59:44.580662 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:59:44.580662 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:59:44.580662 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:59:44.580662 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:59:44.580662 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:59:44.580662 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:59:44.580662 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:59:44.580662 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 17:59:44.580662 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 17:59:44.580662 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 17:59:44.580662 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 17:59:44.580662 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 17:59:44.580662 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 17:59:44.580662 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 17:59:44.580662 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 17:59:44.580662 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 17:59:44.580662 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 17:59:44.580662 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 17:59:44.580662 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 17:59:44.580662 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 17:59:44.580662 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 17:59:44.580662 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 17:59:44.580662 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 17:59:44.580662 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 17:59:44.580662 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 17:59:44.580662 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 17:59:44.580662 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 17:59:44.580662 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 17:59:44.580662 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 17:59:44.580662 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 17:59:44.580662 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 17:59:44.580662 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 17:59:44.580662 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 17:59:44.580662 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-921f8400-24a1-44e9-9f0b-a2a98671e016) Aug 10 17:59:44.580662 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:59:44.580662 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:59:44.580662 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:59:44.580662 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:59:44.580662 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:59:44.580662 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:59:44.580662 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:59:44.580662 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:59:44.580662 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 10 17:59:44.580662 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 10 17:59:44.584588 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:59:44.584588 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:59:44.584588 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:59:44.584588 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:59:44.584588 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:59:44.584588 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:59:44.584588 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:59:44.584588 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:59:44.584588 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:59:44.584588 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:59:44.584588 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:59:44.584588 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:59:44.584588 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:59:44.584588 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-1c73c592-96ea-4a4b-8394-c1cd5b7c7e41 tempest-ListServerFiltersTestJSON-1606274534 tempest-ListServerFiltersTestJSON-1606274534-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:59:44.584588 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:59:44.586479 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-1c73c592-96ea-4a4b-8394-c1cd5b7c7e41 tempest-ListServerFiltersTestJSON-1606274534 tempest-ListServerFiltersTestJSON-1606274534-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.591680 Aug 10 17:59:44.589940 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 944/1860] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 17:59:42 2022] POST /compute/v2.1/servers => generated 214 bytes in 1596 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 10 17:59:44.946046 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-424c5f5d-5a7f-4095-9f0c-e19f7ae9bfca tempest-SecurityGroupsTestJSON-1015574949 tempest-SecurityGroupsTestJSON-1015574949-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/c9498e61-c9c0-4f4f-a4ab-30f922ce6172" status: 202 len: 0 microversion: 2.1 time: 0.633114 Aug 10 17:59:44.946755 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 917/1861] 10.222.0.50 () {58 vars in 1272 bytes} [Wed Aug 10 17:59:44 2022] DELETE /compute/v2.1/os-security-groups/c9498e61-c9c0-4f4f-a4ab-30f922ce6172 => generated 0 bytes in 634 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 17:59:44.957735 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-7c319953-ae8d-4e3a-8f2f-d996f97b9f6f tempest-SecurityGroupsTestJSON-1015574949 tempest-SecurityGroupsTestJSON-1015574949-project] Calling method '.version_select at 0x7fb345ebef70>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:59:45.111742 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-00cfa9e7-b051-44da-b26c-839fb3fde9bd tempest-VolumesTestJSON-2039126440 tempest-VolumesTestJSON-2039126440-project] Calling method '.version_select at 0x7fb345c3cd30>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:59:45.198740 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-00cfa9e7-b051-44da-b26c-839fb3fde9bd tempest-VolumesTestJSON-2039126440 tempest-VolumesTestJSON-2039126440-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/f32ea7b0-33d7-43a6-9191-fddafb6af41b" status: 200 len: 351 microversion: 2.1 time: 0.091262 Aug 10 17:59:45.199973 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 918/1862] 10.222.0.50 () {58 vars in 1245 bytes} [Wed Aug 10 17:59:45 2022] GET /compute/v2.1/os-volumes/f32ea7b0-33d7-43a6-9191-fddafb6af41b => generated 351 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:59:45.249291 n-d-852296-2 devstack@n-api.service[129409]: DEBUG neutronclient.v2_0.client [None req-7c319953-ae8d-4e3a-8f2f-d996f97b9f6f tempest-SecurityGroupsTestJSON-1015574949 tempest-SecurityGroupsTestJSON-1015574949-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group e9001c88-d6d1-4965-a186-6cf0bc9162a7 does not exist", "detail": ""}} {{(pid=129409) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 10 17:59:45.249291 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.network.security_group_api [None req-7c319953-ae8d-4e3a-8f2f-d996f97b9f6f tempest-SecurityGroupsTestJSON-1015574949 tempest-SecurityGroupsTestJSON-1015574949-project] Neutron security group e9001c88-d6d1-4965-a186-6cf0bc9162a7 not found {{(pid=129409) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 10 17:59:45.249291 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-7c319953-ae8d-4e3a-8f2f-d996f97b9f6f tempest-SecurityGroupsTestJSON-1015574949 tempest-SecurityGroupsTestJSON-1015574949-project] HTTP exception thrown: Security group e9001c88-d6d1-4965-a186-6cf0bc9162a7 does not exist Aug 10 17:59:45.249291 n-d-852296-2 devstack@n-api.service[129409]: Neutron server returns request_ids: ['req-9f815653-b2c5-4bd5-922e-a1e1884eb7fb'] Aug 10 17:59:45.251495 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-7c319953-ae8d-4e3a-8f2f-d996f97b9f6f tempest-SecurityGroupsTestJSON-1015574949 tempest-SecurityGroupsTestJSON-1015574949-project] Request method failure captured: Aug 10 17:59:45.251495 n-d-852296-2 devstack@n-api.service[129409]: request: DELETE /compute/v2.1/os-security-groups/e9001c88-d6d1-4965-a186-6cf0bc9162a7 HTTP/1.1 Aug 10 17:59:45.251495 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 17:59:45.251495 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 17:59:45.251495 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 17:59:45.251495 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 0 Aug 10 17:59:45.251495 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 17:59:45.251495 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 17:59:45.251495 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 17:59:45.251495 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 17:59:45.251495 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8_H41UWn8v8K3fsyKPT7OaQXoGJFLNxnh1ePGOtxVbMhdLgXNCNN0NrnCNtgHBi1CtlCNKZmx4uk6tgFgQhh5Xq_p7l3GA2mS-R_B8G_Y5ArxD2_QwnJBi-rWbEr_yOa6UfCPZWrf4NXKgoQqB992TY45ipTMzvSaJJ4v-Zc1ug8MJY Aug 10 17:59:45.251495 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 17:59:45.251495 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 17:59:45.251495 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 17:59:45.251495 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 17:59:45.251495 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 17:59:45.251495 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 17:59:45.251495 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: d463f2ef16c940a3bd99d9f79ae3e60d Aug 10 17:59:45.251495 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-SecurityGroupsTestJSON-1015574949 Aug 10 17:59:45.251495 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 17:59:45.251495 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 17:59:45.251495 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d463f2ef16c940a3bd99d9f79ae3e60d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d463f2ef16c940a3bd99d9f79ae3e60d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d463f2ef16c940a3bd99d9f79ae3e60d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d463f2ef16c940a3bd99d9f79ae3e60d", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:59:45.251495 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-SecurityGroupsTestJSON-1015574949 Aug 10 17:59:45.251495 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: d463f2ef16c940a3bd99d9f79ae3e60d Aug 10 17:59:45.251495 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1015574949 Aug 10 17:59:45.251495 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-SecurityGroupsTestJSON-1015574949-project Aug 10 17:59:45.251495 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 17:59:45.251495 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 17:59:45.251495 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: d38b40d915604752967356b497aee153 Aug 10 17:59:45.251495 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-SecurityGroupsTestJSON-1015574949-project Aug 10 17:59:45.251495 n-d-852296-2 devstack@n-api.service[129409]: method: Aug 10 17:59:45.251495 n-d-852296-2 devstack@n-api.service[129409]: exception: Security group e9001c88-d6d1-4965-a186-6cf0bc9162a7 does not exist Aug 10 17:59:45.251495 n-d-852296-2 devstack@n-api.service[129409]: Neutron server returns request_ids: ['req-9f815653-b2c5-4bd5-922e-a1e1884eb7fb'] Aug 10 17:59:45.251495 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'id': 'e9001c88-d6d1-4965-a186-6cf0bc9162a7'} Aug 10 17:59:45.251495 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:59:45.251495 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:59:45.251495 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 10 17:59:45.251495 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 10 17:59:45.251495 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:59:45.251495 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:59:45.251495 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 10 17:59:45.251495 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 10 17:59:45.251495 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:59:45.251495 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:59:45.251495 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:59:45.251495 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:59:45.251495 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:59:45.251495 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:59:45.251495 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:59:45.251495 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:59:45.251495 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:59:45.251495 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:59:45.251495 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 10 17:59:45.251495 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 10 17:59:45.251495 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:59:45.251495 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:59:45.251495 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 10 17:59:45.251495 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 10 17:59:45.251495 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 10 17:59:45.251495 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 10 17:59:45.251495 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group e9001c88-d6d1-4965-a186-6cf0bc9162a7 does not exist Aug 10 17:59:45.256597 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9f815653-b2c5-4bd5-922e-a1e1884eb7fb'] Aug 10 17:59:45.256597 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:59:45.256597 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:59:45.256597 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:59:45.256597 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:59:45.256597 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 10 17:59:45.256597 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 10 17:59:45.256597 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 10 17:59:45.256597 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 10 17:59:45.256597 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group e9001c88-d6d1-4965-a186-6cf0bc9162a7 does not exist Aug 10 17:59:45.256597 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9f815653-b2c5-4bd5-922e-a1e1884eb7fb'] Aug 10 17:59:45.256597 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:59:45.256597 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:59:45.256597 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:59:45.256597 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:59:45.256597 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:59:45.256597 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:59:45.256597 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:59:45.256597 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:59:45.256597 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 17:59:45.256597 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 17:59:45.256597 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:59:45.256597 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:59:45.256597 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 10 17:59:45.256597 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 10 17:59:45.256597 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group e9001c88-d6d1-4965-a186-6cf0bc9162a7 does not exist Aug 10 17:59:45.256597 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9f815653-b2c5-4bd5-922e-a1e1884eb7fb'] Aug 10 17:59:45.256597 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:59:45.256597 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:59:45.256597 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:59:45.256597 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:59:45.256597 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:59:45.256597 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:59:45.256597 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:59:45.256597 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:59:45.256597 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group e9001c88-d6d1-4965-a186-6cf0bc9162a7 does not exist Aug 10 17:59:45.256597 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9f815653-b2c5-4bd5-922e-a1e1884eb7fb'] Aug 10 17:59:45.256597 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:59:45.263990 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-7c319953-ae8d-4e3a-8f2f-d996f97b9f6f tempest-SecurityGroupsTestJSON-1015574949 tempest-SecurityGroupsTestJSON-1015574949-project] Returning 404 to user: Security group e9001c88-d6d1-4965-a186-6cf0bc9162a7 does not exist Aug 10 17:59:45.263990 n-d-852296-2 devstack@n-api.service[129409]: Neutron server returns request_ids: ['req-9f815653-b2c5-4bd5-922e-a1e1884eb7fb'] {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:59:45.265583 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-7c319953-ae8d-4e3a-8f2f-d996f97b9f6f tempest-SecurityGroupsTestJSON-1015574949 tempest-SecurityGroupsTestJSON-1015574949-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/e9001c88-d6d1-4965-a186-6cf0bc9162a7" status: 404 len: 194 microversion: 2.1 time: 0.313585 Aug 10 17:59:45.266864 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 945/1863] 10.222.0.50 () {58 vars in 1272 bytes} [Wed Aug 10 17:59:44 2022] DELETE /compute/v2.1/os-security-groups/e9001c88-d6d1-4965-a186-6cf0bc9162a7 => generated 194 bytes in 316 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:59:45.274878 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-c06ef07b-4d89-47aa-b957-b1fb3ef8e2e6 tempest-SecurityGroupsTestJSON-1015574949 tempest-SecurityGroupsTestJSON-1015574949-project] Calling method '.version_select at 0x7fb345df7e50>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:59:45.339226 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-2b40ec25-5abe-499b-8485-be52d2fdd7e6 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:59:45.340721 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-2b40ec25-5abe-499b-8485-be52d2fdd7e6 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] [instance: fc188b51-5fbb-4924-830b-fd2791814d09] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:59:45.356960 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-2b40ec25-5abe-499b-8485-be52d2fdd7e6 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:59:45.358742 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-2b40ec25-5abe-499b-8485-be52d2fdd7e6 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:59:45.361183 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-2b40ec25-5abe-499b-8485-be52d2fdd7e6 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:59:45.362559 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-2b40ec25-5abe-499b-8485-be52d2fdd7e6 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:59:45.365418 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-2b40ec25-5abe-499b-8485-be52d2fdd7e6 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:59:45.365814 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-2b40ec25-5abe-499b-8485-be52d2fdd7e6 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:59:45.379726 n-d-852296-2 devstack@n-api.service[129410]: DEBUG neutronclient.v2_0.client [None req-c06ef07b-4d89-47aa-b957-b1fb3ef8e2e6 tempest-SecurityGroupsTestJSON-1015574949 tempest-SecurityGroupsTestJSON-1015574949-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group fd83375a-7127-40cd-af73-c0911bb49257 does not exist", "detail": ""}} {{(pid=129410) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 10 17:59:45.380368 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.network.security_group_api [None req-c06ef07b-4d89-47aa-b957-b1fb3ef8e2e6 tempest-SecurityGroupsTestJSON-1015574949 tempest-SecurityGroupsTestJSON-1015574949-project] Neutron security group fd83375a-7127-40cd-af73-c0911bb49257 not found {{(pid=129410) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 10 17:59:45.381147 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-c06ef07b-4d89-47aa-b957-b1fb3ef8e2e6 tempest-SecurityGroupsTestJSON-1015574949 tempest-SecurityGroupsTestJSON-1015574949-project] HTTP exception thrown: Security group fd83375a-7127-40cd-af73-c0911bb49257 does not exist Aug 10 17:59:45.381147 n-d-852296-2 devstack@n-api.service[129410]: Neutron server returns request_ids: ['req-4961ec09-e095-446e-9ede-89e6d14bc56b'] Aug 10 17:59:45.383120 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-c06ef07b-4d89-47aa-b957-b1fb3ef8e2e6 tempest-SecurityGroupsTestJSON-1015574949 tempest-SecurityGroupsTestJSON-1015574949-project] Request method failure captured: Aug 10 17:59:45.383120 n-d-852296-2 devstack@n-api.service[129410]: request: DELETE /compute/v2.1/os-security-groups/fd83375a-7127-40cd-af73-c0911bb49257 HTTP/1.1 Aug 10 17:59:45.383120 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 17:59:45.383120 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 17:59:45.383120 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 17:59:45.383120 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 0 Aug 10 17:59:45.383120 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 17:59:45.383120 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 17:59:45.383120 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 17:59:45.383120 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 17:59:45.383120 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8_H41UWn8v8K3fsyKPT7OaQXoGJFLNxnh1ePGOtxVbMhdLgXNCNN0NrnCNtgHBi1CtlCNKZmx4uk6tgFgQhh5Xq_p7l3GA2mS-R_B8G_Y5ArxD2_QwnJBi-rWbEr_yOa6UfCPZWrf4NXKgoQqB992TY45ipTMzvSaJJ4v-Zc1ug8MJY Aug 10 17:59:45.383120 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 17:59:45.383120 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 17:59:45.383120 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 17:59:45.383120 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 17:59:45.383120 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 17:59:45.383120 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 17:59:45.383120 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: d463f2ef16c940a3bd99d9f79ae3e60d Aug 10 17:59:45.383120 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-SecurityGroupsTestJSON-1015574949 Aug 10 17:59:45.383120 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 17:59:45.383120 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 17:59:45.383120 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d463f2ef16c940a3bd99d9f79ae3e60d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d463f2ef16c940a3bd99d9f79ae3e60d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d463f2ef16c940a3bd99d9f79ae3e60d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d463f2ef16c940a3bd99d9f79ae3e60d", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:59:45.383120 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-SecurityGroupsTestJSON-1015574949 Aug 10 17:59:45.383120 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: d463f2ef16c940a3bd99d9f79ae3e60d Aug 10 17:59:45.383120 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1015574949 Aug 10 17:59:45.383120 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-SecurityGroupsTestJSON-1015574949-project Aug 10 17:59:45.383120 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 17:59:45.383120 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 17:59:45.383120 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: d38b40d915604752967356b497aee153 Aug 10 17:59:45.383120 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-SecurityGroupsTestJSON-1015574949-project Aug 10 17:59:45.383120 n-d-852296-2 devstack@n-api.service[129410]: method: Aug 10 17:59:45.383120 n-d-852296-2 devstack@n-api.service[129410]: exception: Security group fd83375a-7127-40cd-af73-c0911bb49257 does not exist Aug 10 17:59:45.383120 n-d-852296-2 devstack@n-api.service[129410]: Neutron server returns request_ids: ['req-4961ec09-e095-446e-9ede-89e6d14bc56b'] Aug 10 17:59:45.383120 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'id': 'fd83375a-7127-40cd-af73-c0911bb49257'} Aug 10 17:59:45.383120 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:59:45.383120 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:59:45.383120 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 10 17:59:45.383120 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 10 17:59:45.383120 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:59:45.383120 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:59:45.383120 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 10 17:59:45.383120 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 10 17:59:45.383120 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:59:45.383120 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:59:45.383120 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:59:45.383120 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:59:45.383120 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:59:45.383120 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:59:45.383120 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:59:45.383120 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:59:45.383120 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:59:45.383120 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:59:45.383120 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 10 17:59:45.383120 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 10 17:59:45.383120 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:59:45.383120 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:59:45.383120 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 10 17:59:45.383120 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 10 17:59:45.383120 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 10 17:59:45.383120 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 10 17:59:45.383120 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group fd83375a-7127-40cd-af73-c0911bb49257 does not exist Aug 10 17:59:45.388964 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4961ec09-e095-446e-9ede-89e6d14bc56b'] Aug 10 17:59:45.388964 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:59:45.388964 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:59:45.388964 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:59:45.388964 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:59:45.388964 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 10 17:59:45.388964 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 10 17:59:45.388964 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 10 17:59:45.388964 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 10 17:59:45.388964 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group fd83375a-7127-40cd-af73-c0911bb49257 does not exist Aug 10 17:59:45.388964 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4961ec09-e095-446e-9ede-89e6d14bc56b'] Aug 10 17:59:45.388964 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:59:45.388964 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:59:45.388964 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:59:45.388964 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:59:45.388964 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:59:45.388964 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:59:45.388964 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:59:45.388964 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:59:45.388964 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 17:59:45.388964 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 17:59:45.388964 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:59:45.388964 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:59:45.388964 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 10 17:59:45.388964 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 10 17:59:45.388964 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group fd83375a-7127-40cd-af73-c0911bb49257 does not exist Aug 10 17:59:45.388964 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4961ec09-e095-446e-9ede-89e6d14bc56b'] Aug 10 17:59:45.388964 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:59:45.388964 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:59:45.388964 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:59:45.388964 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:59:45.388964 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:59:45.388964 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:59:45.388964 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:59:45.388964 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:59:45.388964 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group fd83375a-7127-40cd-af73-c0911bb49257 does not exist Aug 10 17:59:45.388964 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4961ec09-e095-446e-9ede-89e6d14bc56b'] Aug 10 17:59:45.388964 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:59:45.388964 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-c06ef07b-4d89-47aa-b957-b1fb3ef8e2e6 tempest-SecurityGroupsTestJSON-1015574949 tempest-SecurityGroupsTestJSON-1015574949-project] Returning 404 to user: Security group fd83375a-7127-40cd-af73-c0911bb49257 does not exist Aug 10 17:59:45.388964 n-d-852296-2 devstack@n-api.service[129410]: Neutron server returns request_ids: ['req-4961ec09-e095-446e-9ede-89e6d14bc56b'] {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:59:45.388964 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-c06ef07b-4d89-47aa-b957-b1fb3ef8e2e6 tempest-SecurityGroupsTestJSON-1015574949 tempest-SecurityGroupsTestJSON-1015574949-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/fd83375a-7127-40cd-af73-c0911bb49257" status: 404 len: 194 microversion: 2.1 time: 0.113827 Aug 10 17:59:45.388964 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 919/1864] 10.222.0.50 () {58 vars in 1272 bytes} [Wed Aug 10 17:59:45 2022] DELETE /compute/v2.1/os-security-groups/fd83375a-7127-40cd-af73-c0911bb49257 => generated 194 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:59:45.407165 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-18286571-585e-45e2-9ae6-c7e8979253b2 tempest-TaggedBootDevicesTest_v242-2127026373 tempest-TaggedBootDevicesTest_v242-2127026373-project] Action: 'create', calling method: .version_select at 0x7fb345c3c310>, body: {"keypair": {"name": "tempest-keypair-1484805741", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG4PComiAff67ybqvAspF1TJRFEZ0jgM1DAgRoM2kj1yV72st2jdBEfLwidSsQuZJtkYDfWIqf0Y0THDjdiVamFmFCHBgcHNuK2XbNSM2ioIPyt2MNMMvRsqlzVNo2XWVQ=="}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:59:45.467684 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.quota [None req-18286571-585e-45e2-9ae6-c7e8979253b2 tempest-TaggedBootDevicesTest_v242-2127026373 tempest-TaggedBootDevicesTest_v242-2127026373-project] Getting quotas for project e5b58f79d17e4bc4a6f97dc2a01edf10. Resources: {'key_pairs'} {{(pid=129410) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:59:45.511845 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.quota [None req-18286571-585e-45e2-9ae6-c7e8979253b2 tempest-TaggedBootDevicesTest_v242-2127026373 tempest-TaggedBootDevicesTest_v242-2127026373-project] Getting quotas for user cd660d04d7a64e34b8b823a64dc36856 and project e5b58f79d17e4bc4a6f97dc2a01edf10. Resources: {'key_pairs'} {{(pid=129410) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:59:45.690513 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-2b40ec25-5abe-499b-8485-be52d2fdd7e6 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:45.702725 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-2b40ec25-5abe-499b-8485-be52d2fdd7e6 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:45.705958 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-2b40ec25-5abe-499b-8485-be52d2fdd7e6 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:45.717865 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-18286571-585e-45e2-9ae6-c7e8979253b2 tempest-TaggedBootDevicesTest_v242-2127026373 tempest-TaggedBootDevicesTest_v242-2127026373-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 0.324121 Aug 10 17:59:45.719859 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 920/1865] 10.222.0.50 () {62 vars in 1200 bytes} [Wed Aug 10 17:59:45 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 326 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 10 17:59:45.725922 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-2b40ec25-5abe-499b-8485-be52d2fdd7e6 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] 10.222.0.50 "GET /compute/v2.1/servers/fc188b51-5fbb-4924-830b-fd2791814d09" status: 200 len: 1366 microversion: 2.47 time: 0.374375 Aug 10 17:59:45.726970 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-37fca589-0caf-4070-8ade-5b11ed3c9deb tempest-SecurityGroupsTestJSON-1015574949 tempest-SecurityGroupsTestJSON-1015574949-project] Calling method '.version_select at 0x7fb345bf8940>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:59:45.732392 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 946/1866] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:59:45 2022] GET /compute/v2.1/servers/fc188b51-5fbb-4924-830b-fd2791814d09 => generated 1366 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:59:45.801887 n-d-852296-2 devstack@n-api.service[129410]: DEBUG neutronclient.v2_0.client [None req-37fca589-0caf-4070-8ade-5b11ed3c9deb tempest-SecurityGroupsTestJSON-1015574949 tempest-SecurityGroupsTestJSON-1015574949-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 5a025cce-3e8f-4243-a2dc-422a2f872af3 does not exist", "detail": ""}} {{(pid=129410) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 10 17:59:45.802482 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.network.security_group_api [None req-37fca589-0caf-4070-8ade-5b11ed3c9deb tempest-SecurityGroupsTestJSON-1015574949 tempest-SecurityGroupsTestJSON-1015574949-project] Neutron security group 5a025cce-3e8f-4243-a2dc-422a2f872af3 not found {{(pid=129410) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 10 17:59:45.803006 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-37fca589-0caf-4070-8ade-5b11ed3c9deb tempest-SecurityGroupsTestJSON-1015574949 tempest-SecurityGroupsTestJSON-1015574949-project] HTTP exception thrown: Security group 5a025cce-3e8f-4243-a2dc-422a2f872af3 does not exist Aug 10 17:59:45.803006 n-d-852296-2 devstack@n-api.service[129410]: Neutron server returns request_ids: ['req-d46226c5-bdce-45a0-b9ba-6f8bcd5312d5'] Aug 10 17:59:45.804979 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-37fca589-0caf-4070-8ade-5b11ed3c9deb tempest-SecurityGroupsTestJSON-1015574949 tempest-SecurityGroupsTestJSON-1015574949-project] Request method failure captured: Aug 10 17:59:45.804979 n-d-852296-2 devstack@n-api.service[129410]: request: DELETE /compute/v2.1/os-security-groups/5a025cce-3e8f-4243-a2dc-422a2f872af3 HTTP/1.1 Aug 10 17:59:45.804979 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 17:59:45.804979 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 17:59:45.804979 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 17:59:45.804979 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 0 Aug 10 17:59:45.804979 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 17:59:45.804979 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 17:59:45.804979 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 17:59:45.804979 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 17:59:45.804979 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8_H41UWn8v8K3fsyKPT7OaQXoGJFLNxnh1ePGOtxVbMhdLgXNCNN0NrnCNtgHBi1CtlCNKZmx4uk6tgFgQhh5Xq_p7l3GA2mS-R_B8G_Y5ArxD2_QwnJBi-rWbEr_yOa6UfCPZWrf4NXKgoQqB992TY45ipTMzvSaJJ4v-Zc1ug8MJY Aug 10 17:59:45.804979 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 17:59:45.804979 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 17:59:45.804979 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 17:59:45.804979 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 17:59:45.804979 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 17:59:45.804979 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 17:59:45.804979 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: d463f2ef16c940a3bd99d9f79ae3e60d Aug 10 17:59:45.804979 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-SecurityGroupsTestJSON-1015574949 Aug 10 17:59:45.804979 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 17:59:45.804979 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 17:59:45.804979 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d463f2ef16c940a3bd99d9f79ae3e60d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d463f2ef16c940a3bd99d9f79ae3e60d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d463f2ef16c940a3bd99d9f79ae3e60d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d463f2ef16c940a3bd99d9f79ae3e60d", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:59:45.804979 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-SecurityGroupsTestJSON-1015574949 Aug 10 17:59:45.804979 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: d463f2ef16c940a3bd99d9f79ae3e60d Aug 10 17:59:45.804979 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1015574949 Aug 10 17:59:45.804979 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-SecurityGroupsTestJSON-1015574949-project Aug 10 17:59:45.804979 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 17:59:45.804979 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 17:59:45.804979 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: d38b40d915604752967356b497aee153 Aug 10 17:59:45.804979 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-SecurityGroupsTestJSON-1015574949-project Aug 10 17:59:45.804979 n-d-852296-2 devstack@n-api.service[129410]: method: Aug 10 17:59:45.804979 n-d-852296-2 devstack@n-api.service[129410]: exception: Security group 5a025cce-3e8f-4243-a2dc-422a2f872af3 does not exist Aug 10 17:59:45.804979 n-d-852296-2 devstack@n-api.service[129410]: Neutron server returns request_ids: ['req-d46226c5-bdce-45a0-b9ba-6f8bcd5312d5'] Aug 10 17:59:45.804979 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'id': '5a025cce-3e8f-4243-a2dc-422a2f872af3'} Aug 10 17:59:45.804979 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:59:45.804979 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:59:45.804979 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 10 17:59:45.804979 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 10 17:59:45.804979 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:59:45.804979 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:59:45.804979 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 10 17:59:45.804979 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 10 17:59:45.804979 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:59:45.804979 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:59:45.804979 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:59:45.804979 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:59:45.804979 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:59:45.804979 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:59:45.804979 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:59:45.804979 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:59:45.804979 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:59:45.804979 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:59:45.804979 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 10 17:59:45.804979 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 10 17:59:45.804979 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:59:45.804979 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:59:45.804979 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 10 17:59:45.804979 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 10 17:59:45.804979 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 10 17:59:45.804979 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 10 17:59:45.804979 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 5a025cce-3e8f-4243-a2dc-422a2f872af3 does not exist Aug 10 17:59:45.814772 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d46226c5-bdce-45a0-b9ba-6f8bcd5312d5'] Aug 10 17:59:45.814772 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:59:45.814772 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:59:45.814772 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:59:45.814772 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:59:45.814772 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 10 17:59:45.814772 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 10 17:59:45.814772 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 10 17:59:45.814772 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 10 17:59:45.814772 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 5a025cce-3e8f-4243-a2dc-422a2f872af3 does not exist Aug 10 17:59:45.814772 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d46226c5-bdce-45a0-b9ba-6f8bcd5312d5'] Aug 10 17:59:45.814772 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:59:45.814772 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:59:45.814772 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:59:45.814772 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:59:45.814772 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:59:45.814772 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:59:45.814772 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:59:45.814772 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:59:45.814772 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 17:59:45.814772 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 17:59:45.814772 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:59:45.814772 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:59:45.814772 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 10 17:59:45.814772 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 10 17:59:45.814772 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 5a025cce-3e8f-4243-a2dc-422a2f872af3 does not exist Aug 10 17:59:45.814772 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d46226c5-bdce-45a0-b9ba-6f8bcd5312d5'] Aug 10 17:59:45.814772 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:59:45.814772 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:59:45.814772 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:59:45.814772 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:59:45.814772 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:59:45.814772 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:59:45.814772 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:59:45.814772 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:59:45.814772 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 5a025cce-3e8f-4243-a2dc-422a2f872af3 does not exist Aug 10 17:59:45.814772 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d46226c5-bdce-45a0-b9ba-6f8bcd5312d5'] Aug 10 17:59:45.814772 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 17:59:45.814772 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-37fca589-0caf-4070-8ade-5b11ed3c9deb tempest-SecurityGroupsTestJSON-1015574949 tempest-SecurityGroupsTestJSON-1015574949-project] Returning 404 to user: Security group 5a025cce-3e8f-4243-a2dc-422a2f872af3 does not exist Aug 10 17:59:45.814772 n-d-852296-2 devstack@n-api.service[129410]: Neutron server returns request_ids: ['req-d46226c5-bdce-45a0-b9ba-6f8bcd5312d5'] {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:59:45.814772 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-37fca589-0caf-4070-8ade-5b11ed3c9deb tempest-SecurityGroupsTestJSON-1015574949 tempest-SecurityGroupsTestJSON-1015574949-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/5a025cce-3e8f-4243-a2dc-422a2f872af3" status: 404 len: 194 microversion: 2.1 time: 0.086912 Aug 10 17:59:45.814772 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 921/1867] 10.222.0.50 () {58 vars in 1272 bytes} [Wed Aug 10 17:59:45 2022] DELETE /compute/v2.1/os-security-groups/5a025cce-3e8f-4243-a2dc-422a2f872af3 => generated 194 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:59:45.834232 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-9ecbd0b0-b58b-435d-aa4d-fe64bf3c8a5b tempest-SecurityGroupsTestJSON-1015574949 tempest-SecurityGroupsTestJSON-1015574949-project] Calling method '.version_select at 0x7fb345d32ca0>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:59:45.972545 n-d-852296-2 devstack@n-api.service[129409]: DEBUG neutronclient.v2_0.client [None req-9ecbd0b0-b58b-435d-aa4d-fe64bf3c8a5b tempest-SecurityGroupsTestJSON-1015574949 tempest-SecurityGroupsTestJSON-1015574949-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c9a9a4fc-33da-44f1-a191-b6f13686ef78 does not exist", "detail": ""}} {{(pid=129409) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 10 17:59:45.973146 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.network.security_group_api [None req-9ecbd0b0-b58b-435d-aa4d-fe64bf3c8a5b tempest-SecurityGroupsTestJSON-1015574949 tempest-SecurityGroupsTestJSON-1015574949-project] Neutron security group c9a9a4fc-33da-44f1-a191-b6f13686ef78 not found {{(pid=129409) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 10 17:59:45.973668 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-9ecbd0b0-b58b-435d-aa4d-fe64bf3c8a5b tempest-SecurityGroupsTestJSON-1015574949 tempest-SecurityGroupsTestJSON-1015574949-project] HTTP exception thrown: Security group c9a9a4fc-33da-44f1-a191-b6f13686ef78 does not exist Aug 10 17:59:45.973668 n-d-852296-2 devstack@n-api.service[129409]: Neutron server returns request_ids: ['req-3c61f267-fbdc-4e87-a6d3-dd347fb0701f'] Aug 10 17:59:45.977123 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-9ecbd0b0-b58b-435d-aa4d-fe64bf3c8a5b tempest-SecurityGroupsTestJSON-1015574949 tempest-SecurityGroupsTestJSON-1015574949-project] Request method failure captured: Aug 10 17:59:45.977123 n-d-852296-2 devstack@n-api.service[129409]: request: DELETE /compute/v2.1/os-security-groups/c9a9a4fc-33da-44f1-a191-b6f13686ef78 HTTP/1.1 Aug 10 17:59:45.977123 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 17:59:45.977123 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 17:59:45.977123 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 17:59:45.977123 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 0 Aug 10 17:59:45.977123 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 17:59:45.977123 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 17:59:45.977123 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 17:59:45.977123 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 17:59:45.977123 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8_H41UWn8v8K3fsyKPT7OaQXoGJFLNxnh1ePGOtxVbMhdLgXNCNN0NrnCNtgHBi1CtlCNKZmx4uk6tgFgQhh5Xq_p7l3GA2mS-R_B8G_Y5ArxD2_QwnJBi-rWbEr_yOa6UfCPZWrf4NXKgoQqB992TY45ipTMzvSaJJ4v-Zc1ug8MJY Aug 10 17:59:45.977123 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 17:59:45.977123 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 17:59:45.977123 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 17:59:45.977123 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 17:59:45.977123 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 17:59:45.977123 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 17:59:45.977123 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: d463f2ef16c940a3bd99d9f79ae3e60d Aug 10 17:59:45.977123 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-SecurityGroupsTestJSON-1015574949 Aug 10 17:59:45.977123 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 17:59:45.977123 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 17:59:45.977123 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d463f2ef16c940a3bd99d9f79ae3e60d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d463f2ef16c940a3bd99d9f79ae3e60d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d463f2ef16c940a3bd99d9f79ae3e60d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d463f2ef16c940a3bd99d9f79ae3e60d", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:59:45.977123 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-SecurityGroupsTestJSON-1015574949 Aug 10 17:59:45.977123 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: d463f2ef16c940a3bd99d9f79ae3e60d Aug 10 17:59:45.977123 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1015574949 Aug 10 17:59:45.977123 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-SecurityGroupsTestJSON-1015574949-project Aug 10 17:59:45.977123 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 17:59:45.977123 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 17:59:45.977123 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: d38b40d915604752967356b497aee153 Aug 10 17:59:45.977123 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-SecurityGroupsTestJSON-1015574949-project Aug 10 17:59:45.977123 n-d-852296-2 devstack@n-api.service[129409]: method: Aug 10 17:59:45.977123 n-d-852296-2 devstack@n-api.service[129409]: exception: Security group c9a9a4fc-33da-44f1-a191-b6f13686ef78 does not exist Aug 10 17:59:45.977123 n-d-852296-2 devstack@n-api.service[129409]: Neutron server returns request_ids: ['req-3c61f267-fbdc-4e87-a6d3-dd347fb0701f'] Aug 10 17:59:45.977123 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'id': 'c9a9a4fc-33da-44f1-a191-b6f13686ef78'} Aug 10 17:59:45.977123 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:59:45.977123 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:59:45.977123 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 10 17:59:45.977123 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 10 17:59:45.977123 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:59:45.977123 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:59:45.977123 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 10 17:59:45.977123 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 10 17:59:45.977123 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:59:45.977123 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:59:45.977123 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:59:45.977123 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:59:45.977123 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:59:45.977123 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:59:45.977123 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:59:45.977123 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:59:45.977123 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:59:45.977123 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:59:45.977123 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 10 17:59:45.977123 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 10 17:59:45.977123 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:59:45.977123 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:59:45.977123 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 10 17:59:45.977123 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 10 17:59:45.977123 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 10 17:59:45.977123 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 10 17:59:45.977123 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c9a9a4fc-33da-44f1-a191-b6f13686ef78 does not exist Aug 10 17:59:45.981927 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3c61f267-fbdc-4e87-a6d3-dd347fb0701f'] Aug 10 17:59:45.981927 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:59:45.981927 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:59:45.981927 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:59:45.981927 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:59:45.981927 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 10 17:59:45.981927 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 10 17:59:45.981927 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 10 17:59:45.981927 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 10 17:59:45.981927 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c9a9a4fc-33da-44f1-a191-b6f13686ef78 does not exist Aug 10 17:59:45.981927 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3c61f267-fbdc-4e87-a6d3-dd347fb0701f'] Aug 10 17:59:45.981927 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:59:45.981927 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:59:45.981927 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:59:45.981927 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:59:45.981927 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:59:45.981927 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:59:45.981927 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:59:45.981927 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:59:45.981927 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 17:59:45.981927 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 17:59:45.981927 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:59:45.981927 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:59:45.981927 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 10 17:59:45.981927 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 10 17:59:45.981927 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c9a9a4fc-33da-44f1-a191-b6f13686ef78 does not exist Aug 10 17:59:45.981927 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3c61f267-fbdc-4e87-a6d3-dd347fb0701f'] Aug 10 17:59:45.981927 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:59:45.981927 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:59:45.981927 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:59:45.981927 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:59:45.981927 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:59:45.981927 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:59:45.981927 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:59:45.981927 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:59:45.981927 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c9a9a4fc-33da-44f1-a191-b6f13686ef78 does not exist Aug 10 17:59:45.981927 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3c61f267-fbdc-4e87-a6d3-dd347fb0701f'] Aug 10 17:59:45.981927 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:59:45.986420 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-9ecbd0b0-b58b-435d-aa4d-fe64bf3c8a5b tempest-SecurityGroupsTestJSON-1015574949 tempest-SecurityGroupsTestJSON-1015574949-project] Returning 404 to user: Security group c9a9a4fc-33da-44f1-a191-b6f13686ef78 does not exist Aug 10 17:59:45.986420 n-d-852296-2 devstack@n-api.service[129409]: Neutron server returns request_ids: ['req-3c61f267-fbdc-4e87-a6d3-dd347fb0701f'] {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:59:45.986895 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-9ecbd0b0-b58b-435d-aa4d-fe64bf3c8a5b tempest-SecurityGroupsTestJSON-1015574949 tempest-SecurityGroupsTestJSON-1015574949-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/c9a9a4fc-33da-44f1-a191-b6f13686ef78" status: 404 len: 194 microversion: 2.1 time: 0.162518 Aug 10 17:59:45.996287 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-dfb72a80-425b-4252-af6d-187eacdeebba tempest-SecurityGroupsTestJSON-1015574949 tempest-SecurityGroupsTestJSON-1015574949-project] Calling method '.version_select at 0x7fb345dbf310>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:59:46.002903 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 947/1868] 10.222.0.50 () {58 vars in 1272 bytes} [Wed Aug 10 17:59:45 2022] DELETE /compute/v2.1/os-security-groups/c9a9a4fc-33da-44f1-a191-b6f13686ef78 => generated 194 bytes in 180 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:59:46.751647 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-06cc5af4-4b39-475c-bbb7-807720732a69 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:59:46.752327 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-06cc5af4-4b39-475c-bbb7-807720732a69 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] [instance: fc188b51-5fbb-4924-830b-fd2791814d09] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:59:46.775419 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-06cc5af4-4b39-475c-bbb7-807720732a69 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:59:46.777361 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-06cc5af4-4b39-475c-bbb7-807720732a69 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:59:46.778715 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-06cc5af4-4b39-475c-bbb7-807720732a69 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:59:46.779663 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-06cc5af4-4b39-475c-bbb7-807720732a69 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:59:46.780354 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-06cc5af4-4b39-475c-bbb7-807720732a69 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:59:46.780935 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-06cc5af4-4b39-475c-bbb7-807720732a69 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:59:46.863228 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:59:47.038483 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-06cc5af4-4b39-475c-bbb7-807720732a69 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:47.051638 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-06cc5af4-4b39-475c-bbb7-807720732a69 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:47.060473 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-06cc5af4-4b39-475c-bbb7-807720732a69 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:47.061974 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-06cc5af4-4b39-475c-bbb7-807720732a69 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] 10.222.0.50 "GET /compute/v2.1/servers/fc188b51-5fbb-4924-830b-fd2791814d09" status: 200 len: 1366 microversion: 2.47 time: 0.314439 Aug 10 17:59:47.063251 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 948/1869] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:59:46 2022] GET /compute/v2.1/servers/fc188b51-5fbb-4924-830b-fd2791814d09 => generated 1366 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 17:59:47.339008 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-dfb72a80-425b-4252-af6d-187eacdeebba tempest-SecurityGroupsTestJSON-1015574949 tempest-SecurityGroupsTestJSON-1015574949-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/c6c7f336-7b5b-429e-bf97-4a7c32d7501f" status: 202 len: 0 microversion: 2.1 time: 1.346589 Aug 10 17:59:47.344320 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 922/1870] 10.222.0.50 () {58 vars in 1272 bytes} [Wed Aug 10 17:59:45 2022] DELETE /compute/v2.1/os-security-groups/c6c7f336-7b5b-429e-bf97-4a7c32d7501f => generated 0 bytes in 1353 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 17:59:47.348894 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-cccf5112-f2e3-4370-b78d-2497f517dc93 tempest-SecurityGroupsTestJSON-1015574949 tempest-SecurityGroupsTestJSON-1015574949-project] Calling method '.version_select at 0x7fb345eba940>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:59:48.106595 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-cff3f345-c0fc-4b04-8a1b-806133cc5d72 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:59:48.106595 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-cff3f345-c0fc-4b04-8a1b-806133cc5d72 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] [instance: fc188b51-5fbb-4924-830b-fd2791814d09] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:59:48.106595 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-cff3f345-c0fc-4b04-8a1b-806133cc5d72 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:59:48.106595 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-cff3f345-c0fc-4b04-8a1b-806133cc5d72 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:59:48.106595 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-cff3f345-c0fc-4b04-8a1b-806133cc5d72 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:59:48.106595 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-cff3f345-c0fc-4b04-8a1b-806133cc5d72 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:59:48.106595 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-cff3f345-c0fc-4b04-8a1b-806133cc5d72 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:59:48.106595 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-cff3f345-c0fc-4b04-8a1b-806133cc5d72 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:59:48.239166 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-cff3f345-c0fc-4b04-8a1b-806133cc5d72 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:48.257363 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-cff3f345-c0fc-4b04-8a1b-806133cc5d72 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:48.259909 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-cff3f345-c0fc-4b04-8a1b-806133cc5d72 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:48.263481 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-cff3f345-c0fc-4b04-8a1b-806133cc5d72 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] 10.222.0.50 "GET /compute/v2.1/servers/fc188b51-5fbb-4924-830b-fd2791814d09" status: 200 len: 1366 microversion: 2.47 time: 0.174484 Aug 10 17:59:48.283592 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 923/1871] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:59:48 2022] GET /compute/v2.1/servers/fc188b51-5fbb-4924-830b-fd2791814d09 => generated 1366 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:59:48.469911 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-cccf5112-f2e3-4370-b78d-2497f517dc93 tempest-SecurityGroupsTestJSON-1015574949 tempest-SecurityGroupsTestJSON-1015574949-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/5560b29f-27db-4df2-95cb-f92afeef2c73" status: 202 len: 0 microversion: 2.1 time: 1.125463 Aug 10 17:59:48.472082 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 949/1872] 10.222.0.50 () {58 vars in 1272 bytes} [Wed Aug 10 17:59:47 2022] DELETE /compute/v2.1/os-security-groups/5560b29f-27db-4df2-95cb-f92afeef2c73 => generated 0 bytes in 1129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 17:59:49.304503 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-29de5f15-5cf8-452f-bd9b-11a7c4d241ae tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:59:49.305276 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-29de5f15-5cf8-452f-bd9b-11a7c4d241ae tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] [instance: fc188b51-5fbb-4924-830b-fd2791814d09] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:59:49.329563 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-29de5f15-5cf8-452f-bd9b-11a7c4d241ae tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:59:49.329563 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-29de5f15-5cf8-452f-bd9b-11a7c4d241ae tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:59:49.337387 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-29de5f15-5cf8-452f-bd9b-11a7c4d241ae tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:59:49.338933 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-29de5f15-5cf8-452f-bd9b-11a7c4d241ae tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:59:49.339619 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-29de5f15-5cf8-452f-bd9b-11a7c4d241ae tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:59:49.340222 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-29de5f15-5cf8-452f-bd9b-11a7c4d241ae tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:59:49.528815 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-29de5f15-5cf8-452f-bd9b-11a7c4d241ae tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:49.572198 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-29de5f15-5cf8-452f-bd9b-11a7c4d241ae tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:49.576666 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-29de5f15-5cf8-452f-bd9b-11a7c4d241ae tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:49.581488 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-29de5f15-5cf8-452f-bd9b-11a7c4d241ae tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] 10.222.0.50 "GET /compute/v2.1/servers/fc188b51-5fbb-4924-830b-fd2791814d09" status: 200 len: 1366 microversion: 2.47 time: 0.292516 Aug 10 17:59:49.590226 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 924/1873] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:59:49 2022] GET /compute/v2.1/servers/fc188b51-5fbb-4924-830b-fd2791814d09 => generated 1366 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:59:49.706624 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-054c9552-6e39-48cc-a50b-d4d3e66f6bdd tempest-VolumesTestJSON-2039126440 tempest-VolumesTestJSON-2039126440-project] Calling method '.version_select at 0x7fb345d32ee0>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:59:49.770057 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-054c9552-6e39-48cc-a50b-d4d3e66f6bdd tempest-VolumesTestJSON-2039126440 tempest-VolumesTestJSON-2039126440-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/ac21a7a7-e3ec-4e24-b85d-a7734f00d5a5" status: 200 len: 351 microversion: 2.1 time: 0.067215 Aug 10 17:59:49.771258 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 950/1874] 10.222.0.50 () {58 vars in 1245 bytes} [Wed Aug 10 17:59:49 2022] GET /compute/v2.1/os-volumes/ac21a7a7-e3ec-4e24-b85d-a7734f00d5a5 => generated 351 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:59:50.606451 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-a8a4915b-6891-4db6-b747-e612e4e4be99 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:59:50.607054 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-a8a4915b-6891-4db6-b747-e612e4e4be99 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] [instance: fc188b51-5fbb-4924-830b-fd2791814d09] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:59:50.629443 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a8a4915b-6891-4db6-b747-e612e4e4be99 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:59:50.631363 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a8a4915b-6891-4db6-b747-e612e4e4be99 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:59:50.631995 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a8a4915b-6891-4db6-b747-e612e4e4be99 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:59:50.633768 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a8a4915b-6891-4db6-b747-e612e4e4be99 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:59:50.636420 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a8a4915b-6891-4db6-b747-e612e4e4be99 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:59:50.637035 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a8a4915b-6891-4db6-b747-e612e4e4be99 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:59:50.821563 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-a8a4915b-6891-4db6-b747-e612e4e4be99 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:50.835411 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-a8a4915b-6891-4db6-b747-e612e4e4be99 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:50.836984 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-a8a4915b-6891-4db6-b747-e612e4e4be99 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:50.838753 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-a8a4915b-6891-4db6-b747-e612e4e4be99 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] 10.222.0.50 "GET /compute/v2.1/servers/fc188b51-5fbb-4924-830b-fd2791814d09" status: 200 len: 1366 microversion: 2.47 time: 0.236393 Aug 10 17:59:50.839338 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 925/1875] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:59:50 2022] GET /compute/v2.1/servers/fc188b51-5fbb-4924-830b-fd2791814d09 => generated 1366 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:59:51.877018 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-cc12700c-2019-4932-9caa-a9448a8bb344 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:59:51.881995 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-cc12700c-2019-4932-9caa-a9448a8bb344 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] [instance: fc188b51-5fbb-4924-830b-fd2791814d09] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:59:51.893126 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-cc12700c-2019-4932-9caa-a9448a8bb344 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:59:51.894072 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-cc12700c-2019-4932-9caa-a9448a8bb344 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:59:51.896091 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-cc12700c-2019-4932-9caa-a9448a8bb344 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:59:51.897186 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-cc12700c-2019-4932-9caa-a9448a8bb344 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:59:51.897871 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-cc12700c-2019-4932-9caa-a9448a8bb344 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:59:51.898508 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-cc12700c-2019-4932-9caa-a9448a8bb344 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:59:52.043172 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-cc12700c-2019-4932-9caa-a9448a8bb344 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:52.063662 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-cc12700c-2019-4932-9caa-a9448a8bb344 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:52.065989 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-cc12700c-2019-4932-9caa-a9448a8bb344 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:52.067873 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-cc12700c-2019-4932-9caa-a9448a8bb344 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] 10.222.0.50 "GET /compute/v2.1/servers/fc188b51-5fbb-4924-830b-fd2791814d09" status: 200 len: 1366 microversion: 2.47 time: 0.203772 Aug 10 17:59:52.070772 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 951/1876] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:59:51 2022] GET /compute/v2.1/servers/fc188b51-5fbb-4924-830b-fd2791814d09 => generated 1366 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:59:53.007818 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-6710b173-ebcd-454a-be2e-17c545f0f939 tempest-VolumesTestJSON-2039126440 tempest-VolumesTestJSON-2039126440-project] Calling method '.version_select at 0x7fb345c738b0>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:59:53.030633 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-00cd2a25-1cb6-407a-ba3e-cb751aab7557 tempest-TaggedBootDevicesTest_v242-2127026373 tempest-TaggedBootDevicesTest_v242-2127026373-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-2031803521", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "c02021e8-0d47-4533-8b72-a01319472caa"}, {"port": "6b2fcce8-cb00-4243-95c9-ea4877052068", "tag": "port-1"}, {"port": "e4fd464a-19a7-4d91-b2e9-ba0029e711e6", "tag": "port-2"}, {"uuid": "4da37fb4-a45b-4396-bc48-1c355e7c5844", "tag": "net-1"}, {"uuid": "4da37fb4-a45b-4396-bc48-1c355e7c5844"}, {"uuid": "7925f459-f359-4281-a9fd-7fd3d9dcc1f1", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "7925f459-f359-4281-a9fd-7fd3d9dcc1f1", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "d59e15b9-fbbd-4d09-b66a-766d72c82198", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "98219ed6-6994-4a02-ae19-da45a6972d3b", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "6ab0ec6b-a934-4656-9d31-66833f99c177", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1253805622"}], "key_name": "tempest-keypair-1484805741", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:59:53.052498 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_api:SELECT=56,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:59:53.155215 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-6710b173-ebcd-454a-be2e-17c545f0f939 tempest-VolumesTestJSON-2039126440 tempest-VolumesTestJSON-2039126440-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/5bcce97c-476f-4474-96cc-afed5f9daac2" status: 200 len: 350 microversion: 2.1 time: 0.151356 Aug 10 17:59:53.155981 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 926/1877] 10.222.0.50 () {58 vars in 1245 bytes} [Wed Aug 10 17:59:53 2022] GET /compute/v2.1/os-volumes/5bcce97c-476f-4474-96cc-afed5f9daac2 => generated 350 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:59:53.161068 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-19d9d378-2631-4874-913a-64b70b5b06f6 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:59:53.161866 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-19d9d378-2631-4874-913a-64b70b5b06f6 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] [instance: fc188b51-5fbb-4924-830b-fd2791814d09] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:59:53.177845 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-19d9d378-2631-4874-913a-64b70b5b06f6 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:59:53.178341 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-19d9d378-2631-4874-913a-64b70b5b06f6 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:59:53.178779 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-19d9d378-2631-4874-913a-64b70b5b06f6 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:59:53.179700 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-19d9d378-2631-4874-913a-64b70b5b06f6 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:59:53.180346 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-19d9d378-2631-4874-913a-64b70b5b06f6 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:59:53.184745 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-19d9d378-2631-4874-913a-64b70b5b06f6 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:59:53.315907 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-19d9d378-2631-4874-913a-64b70b5b06f6 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:53.325306 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-19d9d378-2631-4874-913a-64b70b5b06f6 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:53.327715 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-19d9d378-2631-4874-913a-64b70b5b06f6 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:53.329876 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-19d9d378-2631-4874-913a-64b70b5b06f6 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] 10.222.0.50 "GET /compute/v2.1/servers/fc188b51-5fbb-4924-830b-fd2791814d09" status: 200 len: 1366 microversion: 2.47 time: 0.172745 Aug 10 17:59:53.331168 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 927/1878] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:59:53 2022] GET /compute/v2.1/servers/fc188b51-5fbb-4924-830b-fd2791814d09 => generated 1366 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:59:53.346649 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-10c45afe-4566-4b27-9c92-2a4af6da5295 tempest-VolumesTestJSON-2039126440 tempest-VolumesTestJSON-2039126440-project] Calling method '.version_select at 0x7fb345e749d0>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:59:53.362230 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.network.neutron [None req-00cd2a25-1cb6-407a-ba3e-cb751aab7557 tempest-TaggedBootDevicesTest_v242-2127026373 tempest-TaggedBootDevicesTest_v242-2127026373-project] validate_networks() for [('c02021e8-0d47-4533-8b72-a01319472caa', None, None, None, None, None), (None, None, '6b2fcce8-cb00-4243-95c9-ea4877052068', None, None, None), (None, None, 'e4fd464a-19a7-4d91-b2e9-ba0029e711e6', None, None, None), ('4da37fb4-a45b-4396-bc48-1c355e7c5844', None, None, None, None, None), ('4da37fb4-a45b-4396-bc48-1c355e7c5844', None, None, None, None, None), ('7925f459-f359-4281-a9fd-7fd3d9dcc1f1', '10.2.2.100', None, None, None, None), ('7925f459-f359-4281-a9fd-7fd3d9dcc1f1', '10.2.2.200', None, None, None, None)] {{(pid=129409) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 17:59:53.514481 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-10c45afe-4566-4b27-9c92-2a4af6da5295 tempest-VolumesTestJSON-2039126440 tempest-VolumesTestJSON-2039126440-project] 10.222.0.50 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.171637 Aug 10 17:59:53.520676 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 928/1879] 10.222.0.50 () {58 vars in 1134 bytes} [Wed Aug 10 17:59:53 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:59:53.527131 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-e3c87828-9cca-4f00-9aa1-ee6340b32f57 tempest-VolumesTestJSON-2039126440 tempest-VolumesTestJSON-2039126440-project] Calling method '.version_select at 0x7fb345bc48b0>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:59:53.668111 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-e3c87828-9cca-4f00-9aa1-ee6340b32f57 tempest-VolumesTestJSON-2039126440 tempest-VolumesTestJSON-2039126440-project] 10.222.0.50 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.145929 Aug 10 17:59:53.668739 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 929/1880] 10.222.0.50 () {58 vars in 1149 bytes} [Wed Aug 10 17:59:53 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:59:53.682617 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-2d3a1962-a99a-4a94-be3d-aca42e99833b tempest-VolumesTestJSON-2039126440 tempest-VolumesTestJSON-2039126440-project] Calling method '.version_select at 0x7fb345cfad30>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:59:53.813096 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-2d3a1962-a99a-4a94-be3d-aca42e99833b tempest-VolumesTestJSON-2039126440 tempest-VolumesTestJSON-2039126440-project] 10.222.0.50 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.134489 Aug 10 17:59:53.814216 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 930/1881] 10.222.0.50 () {58 vars in 1134 bytes} [Wed Aug 10 17:59:53 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:59:53.832830 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-aef24a21-f936-4be5-8d42-7dd099af85ae tempest-VolumesTestJSON-2039126440 tempest-VolumesTestJSON-2039126440-project] Calling method '.version_select at 0x7fb345df7ca0>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:59:54.018172 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-aef24a21-f936-4be5-8d42-7dd099af85ae tempest-VolumesTestJSON-2039126440 tempest-VolumesTestJSON-2039126440-project] 10.222.0.50 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.194702 Aug 10 17:59:54.032539 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 931/1882] 10.222.0.50 () {58 vars in 1167 bytes} [Wed Aug 10 17:59:53 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:59:54.205960 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-605af6ef-905f-4b00-8120-524d16d007f8 tempest-VolumesGetTestJSON-1472674091 tempest-VolumesGetTestJSON-1472674091-project] Action: 'create', calling method: .version_select at 0x7fb345c14430>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-898449440", "metadata": {"Type": "work"}}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:59:54.484141 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [None req-00cd2a25-1cb6-407a-ba3e-cb751aab7557 tempest-TaggedBootDevicesTest_v242-2127026373 tempest-TaggedBootDevicesTest_v242-2127026373-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-12578c98-26cf-4982-8c7a-c1006bd2a5cb) Aug 10 17:59:54.484141 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:59:54.484141 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:59:54.484141 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:59:54.484141 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:59:54.484141 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:59:54.484141 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:59:54.484141 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:59:54.484141 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:59:54.484141 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:59:54.484141 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 17:59:54.484141 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 17:59:54.484141 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 17:59:54.484141 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 17:59:54.484141 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 17:59:54.484141 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 17:59:54.484141 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 17:59:54.484141 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 17:59:54.484141 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 17:59:54.484141 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 17:59:54.484141 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 17:59:54.484141 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 17:59:54.484141 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 17:59:54.484141 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 17:59:54.484141 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 17:59:54.484141 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 17:59:54.484141 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 17:59:54.484141 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:59:54.484141 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:59:54.484141 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 17:59:54.484141 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 17:59:54.484141 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:59:54.484141 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:59:54.484141 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:59:54.484141 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:59:54.484141 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:59:54.484141 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:59:54.484141 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:59:54.484141 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:59:54.484141 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:59:54.484141 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:59:54.484141 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 17:59:54.484141 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 17:59:54.484141 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 17:59:54.484141 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 17:59:54.484141 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 17:59:54.484141 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 17:59:54.484141 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 17:59:54.484141 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 17:59:54.484141 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 17:59:54.484141 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 17:59:54.484141 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 17:59:54.487759 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 17:59:54.487759 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 17:59:54.487759 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 17:59:54.487759 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 17:59:54.487759 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 17:59:54.487759 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 17:59:54.487759 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 17:59:54.487759 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 17:59:54.487759 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 17:59:54.487759 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 17:59:54.487759 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 17:59:54.487759 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 17:59:54.487759 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 17:59:54.487759 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 17:59:54.487759 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 17:59:54.487759 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-12578c98-26cf-4982-8c7a-c1006bd2a5cb) Aug 10 17:59:54.487759 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:59:54.487759 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-00cd2a25-1cb6-407a-ba3e-cb751aab7557 tempest-TaggedBootDevicesTest_v242-2127026373 tempest-TaggedBootDevicesTest_v242-2127026373-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:59:54.487759 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:59:54.501783 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-00cd2a25-1cb6-407a-ba3e-cb751aab7557 tempest-TaggedBootDevicesTest_v242-2127026373 tempest-TaggedBootDevicesTest_v242-2127026373-project] Request method failure captured: Aug 10 17:59:54.501783 n-d-852296-2 devstack@n-api.service[129409]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 17:59:54.501783 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 17:59:54.501783 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 17:59:54.501783 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 17:59:54.501783 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 1345 Aug 10 17:59:54.501783 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 17:59:54.501783 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 17:59:54.501783 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 17:59:54.501783 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 17:59:54.501783 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8_Grmyw9Tn-MEGvhfiyhk7hHWDv4hYxReuyIjuFcfTOu5VyZoab0z1Nl4SWuK9rpVi9pZr9koGyyY9cUvi4Ik5LbI4MVu3sD0pQPmBIW3Vq2j07ldIDYKPt1IfQvp5JhyvdtQfhdaCx9pBd0pj3mRtQLbxl7vYE7JBmgxWfhXMwRgH8 Aug 10 17:59:54.501783 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 17:59:54.501783 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 17:59:54.501783 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 17:59:54.501783 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 17:59:54.501783 n-d-852296-2 devstack@n-api.service[129409]: X-Openstack-Nova-Api-Version: 2.42 Aug 10 17:59:54.501783 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 17:59:54.501783 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 17:59:54.501783 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: e5b58f79d17e4bc4a6f97dc2a01edf10 Aug 10 17:59:54.501783 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-2127026373 Aug 10 17:59:54.501783 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 17:59:54.501783 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 17:59:54.501783 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e5b58f79d17e4bc4a6f97dc2a01edf10"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/e5b58f79d17e4bc4a6f97dc2a01edf10"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e5b58f79d17e4bc4a6f97dc2a01edf10"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_e5b58f79d17e4bc4a6f97dc2a01edf10", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 17:59:54.501783 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-TaggedBootDevicesTest_v242-2127026373 Aug 10 17:59:54.501783 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: e5b58f79d17e4bc4a6f97dc2a01edf10 Aug 10 17:59:54.501783 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-2127026373 Aug 10 17:59:54.501783 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-TaggedBootDevicesTest_v242-2127026373-project Aug 10 17:59:54.501783 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 17:59:54.501783 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 17:59:54.501783 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: cd660d04d7a64e34b8b823a64dc36856 Aug 10 17:59:54.501783 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-TaggedBootDevicesTest_v242-2127026373-project Aug 10 17:59:54.501783 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:59:54.501783 n-d-852296-2 devstack@n-api.service[129409]: {"server": {"name": "tempest-device-tagging-server-2031803521", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "c02021e8-0d47-4533-8b72-a01319472caa"}, {"port": "6b2fcce8-cb00-4243-95c9-ea4877052068", "tag": "port-1"}, {"port": "e4fd464a-19a7-4d91-b2e9-ba0029e711e6", "tag": "port-2"}, {"uuid": "4da37fb4-a45b-4396-bc48-1c355e7c5844", "tag": "net-1"}, {"uuid": "4da37fb4-a45b-4396-bc48-1c355e7c5844"}, {"uuid": "7925f459-f359-4281-a9fd-7fd3d9dcc1f1", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "7925f459-f359-4281-a9fd-7fd3d9dcc1f1", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "d59e15b9-fbbd-4d09-b66a-766d72c82198", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "98219ed6-6994-4a02-ae19-da45a6972d3b", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "6ab0ec6b-a934-4656-9d31-66833f99c177", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1253805622"}], "key_name": "tempest-keypair-1484805741", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} Aug 10 17:59:54.501783 n-d-852296-2 devstack@n-api.service[129409]: method: > Aug 10 17:59:54.501783 n-d-852296-2 devstack@n-api.service[129409]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:59:54.501783 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 17:59:54.501783 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'body': {'server': {'name': 'tempest-device-tagging-server-2031803521', 'imageRef': 'a735ff26-463a-4ffe-a981-ab9d9baa494f', 'flavorRef': '452', 'config_drive': True, 'networks': [{'uuid': 'c02021e8-0d47-4533-8b72-a01319472caa'}, {'port': '6b2fcce8-cb00-4243-95c9-ea4877052068', 'tag': 'port-1'}, {'port': 'e4fd464a-19a7-4d91-b2e9-ba0029e711e6', 'tag': 'port-2'}, {'uuid': '4da37fb4-a45b-4396-bc48-1c355e7c5844', 'tag': 'net-1'}, {'uuid': '4da37fb4-a45b-4396-bc48-1c355e7c5844'}, {'uuid': '7925f459-f359-4281-a9fd-7fd3d9dcc1f1', 'fixed_ip': '10.2.2.100', 'tag': 'net-2-100'}, {'uuid': '7925f459-f359-4281-a9fd-7fd3d9dcc1f1', 'fixed_ip': '10.2.2.200', 'tag': 'net-2-200'}], 'block_device_mapping_v2': [{'source_type': 'volume', 'destination_type': 'volume', 'boot_index': 0, 'tag': 'boot', 'volume_id': 'd59e15b9-fbbd-4d09-b66a-766d72c82198', 'delete_on_termination': False}, {'source_type': 'volume', 'destination_type': 'volume', 'boot_index': 1, 'tag': 'other', 'volume_id': '98219ed6-6994-4a02-ae19-da45a6972d3b', 'delete_on_termination': False}, {'source_type': 'volume', 'destination_type': 'volume', 'boot_index': 2, 'volume_id': '6ab0ec6b-a934-4656-9d31-66833f99c177', 'delete_on_termination': False}], 'security_groups': [{'name': 'tempest-securitygroup--1253805622'}], 'key_name': 'tempest-keypair-1484805741', 'user_data': 'IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo='}}} Aug 10 17:59:54.501783 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:59:54.501783 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:59:54.512226 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:59:54.512226 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:59:54.512226 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:59:54.512226 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:59:54.512226 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:59:54.512226 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:59:54.512226 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:59:54.512226 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:59:54.512226 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 17:59:54.512226 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 17:59:54.512226 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 17:59:54.512226 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 17:59:54.512226 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 17:59:54.512226 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 17:59:54.512226 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 17:59:54.512226 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 17:59:54.512226 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 17:59:54.512226 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 17:59:54.512226 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 17:59:54.512226 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 17:59:54.512226 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 17:59:54.512226 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 17:59:54.512226 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 17:59:54.512226 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 17:59:54.512226 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 17:59:54.512226 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:59:54.512226 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:59:54.512226 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 17:59:54.512226 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 17:59:54.512226 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:59:54.512226 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:59:54.512226 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 17:59:54.512226 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 17:59:54.512226 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:59:54.512226 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:59:54.512226 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 17:59:54.512226 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 17:59:54.512226 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 17:59:54.512226 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 17:59:54.512226 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 17:59:54.512226 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 17:59:54.512226 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 17:59:54.512226 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 17:59:54.512226 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 17:59:54.512226 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 17:59:54.512226 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 17:59:54.512226 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 17:59:54.512226 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 17:59:54.512226 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 17:59:54.512226 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 17:59:54.512226 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 17:59:54.512226 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 17:59:54.512226 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 17:59:54.512226 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 17:59:54.512226 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 17:59:54.516287 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 17:59:54.516287 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 17:59:54.516287 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 17:59:54.516287 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 17:59:54.516287 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 17:59:54.516287 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 17:59:54.516287 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 17:59:54.516287 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 17:59:54.516287 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 17:59:54.516287 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 17:59:54.516287 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-12578c98-26cf-4982-8c7a-c1006bd2a5cb) Aug 10 17:59:54.516287 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:59:54.516287 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:59:54.516287 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:59:54.516287 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:59:54.516287 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:59:54.516287 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:59:54.516287 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:59:54.516287 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:59:54.516287 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 10 17:59:54.516287 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 10 17:59:54.516287 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:59:54.516287 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:59:54.516287 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:59:54.516287 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:59:54.516287 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:59:54.516287 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:59:54.516287 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:59:54.516287 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:59:54.516287 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:59:54.516287 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:59:54.516287 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:59:54.516287 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:59:54.516287 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 17:59:54.516287 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-00cd2a25-1cb6-407a-ba3e-cb751aab7557 tempest-TaggedBootDevicesTest_v242-2127026373 tempest-TaggedBootDevicesTest_v242-2127026373-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 17:59:54.516287 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:59:54.516287 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-00cd2a25-1cb6-407a-ba3e-cb751aab7557 tempest-TaggedBootDevicesTest_v242-2127026373 tempest-TaggedBootDevicesTest_v242-2127026373-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.42 time: 1.478082 Aug 10 17:59:54.516287 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 952/1883] 10.222.0.50 () {62 vars in 1189 bytes} [Wed Aug 10 17:59:53 2022] POST /compute/v2.1/servers => generated 214 bytes in 1481 msecs (HTTP/1.1 500) 9 headers in 393 bytes (1 switches on core 0) Aug 10 17:59:54.516287 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-d25e956d-04fb-47a9-ae96-4dbaccf7e5fe tempest-VolumesTestJSON-2039126440 tempest-VolumesTestJSON-2039126440-project] Calling method '.version_select at 0x7fb345dfde50>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:59:54.660725 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-d25e956d-04fb-47a9-ae96-4dbaccf7e5fe tempest-VolumesTestJSON-2039126440 tempest-VolumesTestJSON-2039126440-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.153303 Aug 10 17:59:54.661301 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 953/1884] 10.222.0.50 () {58 vars in 1170 bytes} [Wed Aug 10 17:59:54 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:59:54.666981 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-75cd3204-87b0-475a-91a0-05f5e55fc552 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:59:54.668422 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-75cd3204-87b0-475a-91a0-05f5e55fc552 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] [instance: fc188b51-5fbb-4924-830b-fd2791814d09] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:59:54.695396 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-75cd3204-87b0-475a-91a0-05f5e55fc552 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:59:54.698497 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-75cd3204-87b0-475a-91a0-05f5e55fc552 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:59:54.698497 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-75cd3204-87b0-475a-91a0-05f5e55fc552 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:59:54.700453 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-75cd3204-87b0-475a-91a0-05f5e55fc552 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:59:54.700899 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-75cd3204-87b0-475a-91a0-05f5e55fc552 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:59:54.701914 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-75cd3204-87b0-475a-91a0-05f5e55fc552 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:59:54.838763 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-75cd3204-87b0-475a-91a0-05f5e55fc552 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:54.848909 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-75cd3204-87b0-475a-91a0-05f5e55fc552 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:54.850747 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-75cd3204-87b0-475a-91a0-05f5e55fc552 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:54.852103 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-75cd3204-87b0-475a-91a0-05f5e55fc552 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] 10.222.0.50 "GET /compute/v2.1/servers/fc188b51-5fbb-4924-830b-fd2791814d09" status: 200 len: 1366 microversion: 2.47 time: 0.189877 Aug 10 17:59:54.852978 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 954/1885] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:59:54 2022] GET /compute/v2.1/servers/fc188b51-5fbb-4924-830b-fd2791814d09 => generated 1366 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:59:54.874195 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-d03c4676-2fda-4dfc-a757-f026769964ec tempest-TaggedBootDevicesTest_v242-2127026373 tempest-TaggedBootDevicesTest_v242-2127026373-project] Calling method '.version_select at 0x7fb345d1d700>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:59:55.033115 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-d03c4676-2fda-4dfc-a757-f026769964ec tempest-TaggedBootDevicesTest_v242-2127026373 tempest-TaggedBootDevicesTest_v242-2127026373-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1484805741" status: 204 len: 0 microversion: 2.42 time: 0.167067 Aug 10 17:59:55.033738 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 955/1886] 10.222.0.50 () {60 vars in 1262 bytes} [Wed Aug 10 17:59:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1484805741 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 10 17:59:55.040375 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-adfbd1b4-a677-4079-8d4e-a8232b4341f4 tempest-VolumesTestJSON-2039126440 tempest-VolumesTestJSON-2039126440-project] Calling method '.version_select at 0x7fb345d32670>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:59:55.148988 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-adfbd1b4-a677-4079-8d4e-a8232b4341f4 tempest-VolumesTestJSON-2039126440 tempest-VolumesTestJSON-2039126440-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.111530 Aug 10 17:59:55.148988 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 956/1887] 10.222.0.50 () {58 vars in 1155 bytes} [Wed Aug 10 17:59:55 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:59:55.161298 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-424b4240-bfb1-4386-8e0a-0cbae09443de tempest-VolumesTestJSON-2039126440 tempest-VolumesTestJSON-2039126440-project] Calling method '.version_select at 0x7fb345cd4700>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:59:55.278325 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-424b4240-bfb1-4386-8e0a-0cbae09443de tempest-VolumesTestJSON-2039126440 tempest-VolumesTestJSON-2039126440-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.121703 Aug 10 17:59:55.286443 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 957/1888] 10.222.0.50 () {58 vars in 1188 bytes} [Wed Aug 10 17:59:55 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:59:55.294594 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-c76fa89c-d578-4b2c-8edb-e91770d9ae40 tempest-VolumesTestJSON-2039126440 tempest-VolumesTestJSON-2039126440-project] Calling method '.version_select at 0x7fb345cd48b0>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:59:55.374330 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-605af6ef-905f-4b00-8120-524d16d007f8 tempest-VolumesGetTestJSON-1472674091 tempest-VolumesGetTestJSON-1472674091-project] 10.222.0.50 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 1.340346 Aug 10 17:59:55.383233 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 932/1889] 10.222.0.50 () {60 vars in 1156 bytes} [Wed Aug 10 17:59:54 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 1343 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 10 17:59:55.404865 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-e5189c32-d191-4f4d-a164-ab1230350f9f tempest-VolumesGetTestJSON-1472674091 tempest-VolumesGetTestJSON-1472674091-project] Calling method '.version_select at 0x7fb345c738b0>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:59:55.453888 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-c76fa89c-d578-4b2c-8edb-e91770d9ae40 tempest-VolumesTestJSON-2039126440 tempest-VolumesTestJSON-2039126440-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.159396 Aug 10 17:59:55.465416 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 958/1890] 10.222.0.50 () {58 vars in 1155 bytes} [Wed Aug 10 17:59:55 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:59:55.495936 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-e5189c32-d191-4f4d-a164-ab1230350f9f tempest-VolumesGetTestJSON-1472674091 tempest-VolumesGetTestJSON-1472674091-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/1cb631cb-8b0f-46a6-9334-75527707ea08" status: 200 len: 352 microversion: 2.1 time: 0.102190 Aug 10 17:59:55.497153 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 933/1891] 10.222.0.50 () {58 vars in 1245 bytes} [Wed Aug 10 17:59:55 2022] GET /compute/v2.1/os-volumes/1cb631cb-8b0f-46a6-9334-75527707ea08 => generated 352 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:59:55.887277 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-0d1c70d7-4aaf-49ae-a4e3-0575d626898f tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:59:55.888442 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-0d1c70d7-4aaf-49ae-a4e3-0575d626898f tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] [instance: fc188b51-5fbb-4924-830b-fd2791814d09] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:59:55.911824 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-0d1c70d7-4aaf-49ae-a4e3-0575d626898f tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:59:55.912815 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-0d1c70d7-4aaf-49ae-a4e3-0575d626898f tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:59:55.913239 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-0d1c70d7-4aaf-49ae-a4e3-0575d626898f tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:59:55.914237 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-0d1c70d7-4aaf-49ae-a4e3-0575d626898f tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:59:55.914848 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-0d1c70d7-4aaf-49ae-a4e3-0575d626898f tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:59:55.915446 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-0d1c70d7-4aaf-49ae-a4e3-0575d626898f tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:59:56.453586 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-0d1c70d7-4aaf-49ae-a4e3-0575d626898f tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:56.469814 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-0d1c70d7-4aaf-49ae-a4e3-0575d626898f tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:56.471363 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-0d1c70d7-4aaf-49ae-a4e3-0575d626898f tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:56.481433 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-0d1c70d7-4aaf-49ae-a4e3-0575d626898f tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] 10.222.0.50 "GET /compute/v2.1/servers/fc188b51-5fbb-4924-830b-fd2791814d09" status: 200 len: 1366 microversion: 2.47 time: 0.605324 Aug 10 17:59:56.499474 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 959/1892] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:59:55 2022] GET /compute/v2.1/servers/fc188b51-5fbb-4924-830b-fd2791814d09 => generated 1366 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:59:56.511549 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-086978f4-ad37-4a7a-8bec-f09453c1876f tempest-VolumesGetTestJSON-1472674091 tempest-VolumesGetTestJSON-1472674091-project] Calling method '.version_select at 0x7fb345e741f0>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:59:56.523424 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_cell0:SELECT=4 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:59:56.614989 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-086978f4-ad37-4a7a-8bec-f09453c1876f tempest-VolumesGetTestJSON-1472674091 tempest-VolumesGetTestJSON-1472674091-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/1cb631cb-8b0f-46a6-9334-75527707ea08" status: 200 len: 352 microversion: 2.1 time: 0.108349 Aug 10 17:59:56.615670 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 934/1893] 10.222.0.50 () {58 vars in 1245 bytes} [Wed Aug 10 17:59:56 2022] GET /compute/v2.1/os-volumes/1cb631cb-8b0f-46a6-9334-75527707ea08 => generated 352 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:59:57.511742 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-3b958647-5882-4bd5-a293-54d54e1c4593 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:59:57.512370 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-3b958647-5882-4bd5-a293-54d54e1c4593 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] [instance: fc188b51-5fbb-4924-830b-fd2791814d09] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:59:57.530420 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-3b958647-5882-4bd5-a293-54d54e1c4593 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:59:57.532512 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-3b958647-5882-4bd5-a293-54d54e1c4593 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:59:57.532512 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-3b958647-5882-4bd5-a293-54d54e1c4593 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:59:57.539558 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-3b958647-5882-4bd5-a293-54d54e1c4593 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:59:57.540054 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-3b958647-5882-4bd5-a293-54d54e1c4593 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:59:57.540526 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-3b958647-5882-4bd5-a293-54d54e1c4593 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:59:57.641261 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-8e2d9c11-f1f9-40f1-98ec-09c77a8ba555 tempest-VolumesGetTestJSON-1472674091 tempest-VolumesGetTestJSON-1472674091-project] Calling method '.version_select at 0x7fb345c3cd30>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:59:57.747740 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-3b958647-5882-4bd5-a293-54d54e1c4593 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:57.759418 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-3b958647-5882-4bd5-a293-54d54e1c4593 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:57.766240 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-3b958647-5882-4bd5-a293-54d54e1c4593 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:57.767789 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-3b958647-5882-4bd5-a293-54d54e1c4593 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] 10.222.0.50 "GET /compute/v2.1/servers/fc188b51-5fbb-4924-830b-fd2791814d09" status: 200 len: 1366 microversion: 2.47 time: 0.260680 Aug 10 17:59:57.773093 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 960/1894] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:59:57 2022] GET /compute/v2.1/servers/fc188b51-5fbb-4924-830b-fd2791814d09 => generated 1366 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:59:57.803538 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-8e2d9c11-f1f9-40f1-98ec-09c77a8ba555 tempest-VolumesGetTestJSON-1472674091 tempest-VolumesGetTestJSON-1472674091-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/1cb631cb-8b0f-46a6-9334-75527707ea08" status: 200 len: 352 microversion: 2.1 time: 0.175951 Aug 10 17:59:57.810316 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 935/1895] 10.222.0.50 () {58 vars in 1245 bytes} [Wed Aug 10 17:59:57 2022] GET /compute/v2.1/os-volumes/1cb631cb-8b0f-46a6-9334-75527707ea08 => generated 352 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:59:58.795625 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-52a1b490-5935-4bc9-a914-ce3c76e34c7c tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:59:58.796163 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-52a1b490-5935-4bc9-a914-ce3c76e34c7c tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] [instance: fc188b51-5fbb-4924-830b-fd2791814d09] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:59:58.807184 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-52a1b490-5935-4bc9-a914-ce3c76e34c7c tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:59:58.808981 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-52a1b490-5935-4bc9-a914-ce3c76e34c7c tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:59:58.808981 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-52a1b490-5935-4bc9-a914-ce3c76e34c7c tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:59:58.809192 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-52a1b490-5935-4bc9-a914-ce3c76e34c7c tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:59:58.809459 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-52a1b490-5935-4bc9-a914-ce3c76e34c7c tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:59:58.809882 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-52a1b490-5935-4bc9-a914-ce3c76e34c7c tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:59:58.818653 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-dcbb6cc1-8373-40ce-8748-0ba748a3d079 tempest-VolumesGetTestJSON-1472674091 tempest-VolumesGetTestJSON-1472674091-project] Calling method '.version_select at 0x7fb345e74040>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:59:58.946310 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-dcbb6cc1-8373-40ce-8748-0ba748a3d079 tempest-VolumesGetTestJSON-1472674091 tempest-VolumesGetTestJSON-1472674091-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/1cb631cb-8b0f-46a6-9334-75527707ea08" status: 200 len: 353 microversion: 2.1 time: 0.132022 Aug 10 17:59:58.948286 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 936/1896] 10.222.0.50 () {58 vars in 1245 bytes} [Wed Aug 10 17:59:58 2022] GET /compute/v2.1/os-volumes/1cb631cb-8b0f-46a6-9334-75527707ea08 => generated 353 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:59:58.955897 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-52a1b490-5935-4bc9-a914-ce3c76e34c7c tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:58.966389 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-d8764ff2-853f-41b8-8e14-781e53533ee9 tempest-VolumesGetTestJSON-1472674091 tempest-VolumesGetTestJSON-1472674091-project] Calling method '.version_select at 0x7fb345bde820>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:59:58.966888 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-52a1b490-5935-4bc9-a914-ce3c76e34c7c tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:58.972800 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-52a1b490-5935-4bc9-a914-ce3c76e34c7c tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:59:58.979436 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-52a1b490-5935-4bc9-a914-ce3c76e34c7c tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] 10.222.0.50 "GET /compute/v2.1/servers/fc188b51-5fbb-4924-830b-fd2791814d09" status: 200 len: 1366 microversion: 2.47 time: 0.185610 Aug 10 17:59:58.981734 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 961/1897] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 17:59:58 2022] GET /compute/v2.1/servers/fc188b51-5fbb-4924-830b-fd2791814d09 => generated 1366 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:59:59.046034 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-d8764ff2-853f-41b8-8e14-781e53533ee9 tempest-VolumesGetTestJSON-1472674091 tempest-VolumesGetTestJSON-1472674091-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/1cb631cb-8b0f-46a6-9334-75527707ea08" status: 200 len: 353 microversion: 2.1 time: 0.084076 Aug 10 17:59:59.046993 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 937/1898] 10.222.0.50 () {58 vars in 1245 bytes} [Wed Aug 10 17:59:58 2022] GET /compute/v2.1/os-volumes/1cb631cb-8b0f-46a6-9334-75527707ea08 => generated 353 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:59:59.066558 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-2c3c101c-6460-4e85-879d-ed404d640ed3 tempest-VolumesGetTestJSON-1472674091 tempest-VolumesGetTestJSON-1472674091-project] Calling method '.version_select at 0x7fb345d32160>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:59:59.552946 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-2c3c101c-6460-4e85-879d-ed404d640ed3 tempest-VolumesGetTestJSON-1472674091 tempest-VolumesGetTestJSON-1472674091-project] 10.222.0.50 "DELETE /compute/v2.1/os-volumes/1cb631cb-8b0f-46a6-9334-75527707ea08" status: 202 len: 0 microversion: 2.1 time: 0.479204 Aug 10 17:59:59.556033 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 962/1899] 10.222.0.50 () {58 vars in 1248 bytes} [Wed Aug 10 17:59:59 2022] DELETE /compute/v2.1/os-volumes/1cb631cb-8b0f-46a6-9334-75527707ea08 => generated 0 bytes in 497 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 17:59:59.562028 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-02bf56a0-1b83-4307-bd11-5909828b4d25 tempest-VolumesGetTestJSON-1472674091 tempest-VolumesGetTestJSON-1472674091-project] Calling method '.version_select at 0x7fb345e07310>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:59:59.685491 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-02bf56a0-1b83-4307-bd11-5909828b4d25 tempest-VolumesGetTestJSON-1472674091 tempest-VolumesGetTestJSON-1472674091-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/1cb631cb-8b0f-46a6-9334-75527707ea08" status: 200 len: 352 microversion: 2.1 time: 0.127135 Aug 10 17:59:59.691535 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 938/1900] 10.222.0.50 () {58 vars in 1245 bytes} [Wed Aug 10 17:59:59 2022] GET /compute/v2.1/os-volumes/1cb631cb-8b0f-46a6-9334-75527707ea08 => generated 352 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 18:00:00.011473 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-a31eb278-a9fa-4add-8b33-494016baa16d tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:00:00.012097 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-a31eb278-a9fa-4add-8b33-494016baa16d tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] [instance: fc188b51-5fbb-4924-830b-fd2791814d09] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:00:00.029033 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a31eb278-a9fa-4add-8b33-494016baa16d tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:00:00.029812 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a31eb278-a9fa-4add-8b33-494016baa16d tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:00:00.030426 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a31eb278-a9fa-4add-8b33-494016baa16d tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:00:00.031292 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a31eb278-a9fa-4add-8b33-494016baa16d tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:00:00.031900 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a31eb278-a9fa-4add-8b33-494016baa16d tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:00:00.033222 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a31eb278-a9fa-4add-8b33-494016baa16d tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:00:00.242524 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-a31eb278-a9fa-4add-8b33-494016baa16d tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:00:00.251450 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-a31eb278-a9fa-4add-8b33-494016baa16d tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:00:00.262792 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-a31eb278-a9fa-4add-8b33-494016baa16d tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:00:00.264109 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-a31eb278-a9fa-4add-8b33-494016baa16d tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] 10.222.0.50 "GET /compute/v2.1/servers/fc188b51-5fbb-4924-830b-fd2791814d09" status: 200 len: 1366 microversion: 2.47 time: 0.257575 Aug 10 18:00:00.265331 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 963/1901] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 18:00:00 2022] GET /compute/v2.1/servers/fc188b51-5fbb-4924-830b-fd2791814d09 => generated 1366 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 18:00:00.698929 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-2632d027-aecd-4489-84a6-c40aace6e9e2 tempest-VolumesGetTestJSON-1472674091 tempest-VolumesGetTestJSON-1472674091-project] Calling method '.version_select at 0x7fb345d5df70>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:00:00.851765 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-2632d027-aecd-4489-84a6-c40aace6e9e2 tempest-VolumesGetTestJSON-1472674091 tempest-VolumesGetTestJSON-1472674091-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/1cb631cb-8b0f-46a6-9334-75527707ea08" status: 200 len: 352 microversion: 2.1 time: 0.156680 Aug 10 18:00:00.859339 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 939/1902] 10.222.0.50 () {58 vars in 1245 bytes} [Wed Aug 10 18:00:00 2022] GET /compute/v2.1/os-volumes/1cb631cb-8b0f-46a6-9334-75527707ea08 => generated 352 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 18:00:01.295567 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-4d895761-c557-4b60-9276-90a7d432da02 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:00:01.296861 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-4d895761-c557-4b60-9276-90a7d432da02 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] [instance: fc188b51-5fbb-4924-830b-fd2791814d09] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:00:01.311143 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-4d895761-c557-4b60-9276-90a7d432da02 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:00:01.311823 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-4d895761-c557-4b60-9276-90a7d432da02 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:00:01.312489 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-4d895761-c557-4b60-9276-90a7d432da02 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:00:01.313913 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-4d895761-c557-4b60-9276-90a7d432da02 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:00:01.315727 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-4d895761-c557-4b60-9276-90a7d432da02 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:00:01.317808 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-4d895761-c557-4b60-9276-90a7d432da02 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:00:01.747711 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-4d895761-c557-4b60-9276-90a7d432da02 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:00:01.756920 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-4d895761-c557-4b60-9276-90a7d432da02 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:00:01.758422 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-4d895761-c557-4b60-9276-90a7d432da02 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:00:01.772054 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-4d895761-c557-4b60-9276-90a7d432da02 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] 10.222.0.50 "GET /compute/v2.1/servers/fc188b51-5fbb-4924-830b-fd2791814d09" status: 200 len: 1366 microversion: 2.47 time: 0.481510 Aug 10 18:00:01.777315 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 964/1903] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 18:00:01 2022] GET /compute/v2.1/servers/fc188b51-5fbb-4924-830b-fd2791814d09 => generated 1366 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 18:00:01.866493 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-45397732-02c9-4a99-911b-68d3390e6da8 tempest-VolumesGetTestJSON-1472674091 tempest-VolumesGetTestJSON-1472674091-project] Calling method '.version_select at 0x7fb345c73f70>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:00:01.995871 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-45397732-02c9-4a99-911b-68d3390e6da8 tempest-VolumesGetTestJSON-1472674091 tempest-VolumesGetTestJSON-1472674091-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/1cb631cb-8b0f-46a6-9334-75527707ea08" status: 200 len: 352 microversion: 2.1 time: 0.133000 Aug 10 18:00:01.997388 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 940/1904] 10.222.0.50 () {58 vars in 1245 bytes} [Wed Aug 10 18:00:01 2022] GET /compute/v2.1/os-volumes/1cb631cb-8b0f-46a6-9334-75527707ea08 => generated 352 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 18:00:02.799493 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-20623c8c-ad79-4787-8877-6f42d45814a9 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:00:02.800315 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-20623c8c-ad79-4787-8877-6f42d45814a9 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] [instance: fc188b51-5fbb-4924-830b-fd2791814d09] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:00:02.809601 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-20623c8c-ad79-4787-8877-6f42d45814a9 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:00:02.818821 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-20623c8c-ad79-4787-8877-6f42d45814a9 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:00:02.819279 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-20623c8c-ad79-4787-8877-6f42d45814a9 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:00:02.820028 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-20623c8c-ad79-4787-8877-6f42d45814a9 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:00:02.821133 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-20623c8c-ad79-4787-8877-6f42d45814a9 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:00:02.821565 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-20623c8c-ad79-4787-8877-6f42d45814a9 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:00:02.964734 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-20623c8c-ad79-4787-8877-6f42d45814a9 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:00:02.974679 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-20623c8c-ad79-4787-8877-6f42d45814a9 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:00:02.976185 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-20623c8c-ad79-4787-8877-6f42d45814a9 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:00:02.987781 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-20623c8c-ad79-4787-8877-6f42d45814a9 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] 10.222.0.50 "GET /compute/v2.1/servers/fc188b51-5fbb-4924-830b-fd2791814d09" status: 200 len: 1366 microversion: 2.47 time: 0.192494 Aug 10 18:00:02.988997 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 965/1905] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 18:00:02 2022] GET /compute/v2.1/servers/fc188b51-5fbb-4924-830b-fd2791814d09 => generated 1366 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 18:00:03.012672 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-ec0fbc69-8dc6-495c-a688-b16dda2ad206 tempest-VolumesGetTestJSON-1472674091 tempest-VolumesGetTestJSON-1472674091-project] Calling method '.version_select at 0x7fb345d9d310>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:00:03.134433 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-ec0fbc69-8dc6-495c-a688-b16dda2ad206 tempest-VolumesGetTestJSON-1472674091 tempest-VolumesGetTestJSON-1472674091-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/1cb631cb-8b0f-46a6-9334-75527707ea08" status: 200 len: 352 microversion: 2.1 time: 0.127320 Aug 10 18:00:03.141653 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 941/1906] 10.222.0.50 () {58 vars in 1245 bytes} [Wed Aug 10 18:00:03 2022] GET /compute/v2.1/os-volumes/1cb631cb-8b0f-46a6-9334-75527707ea08 => generated 352 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 18:00:04.016200 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-c4edc849-09ff-4c4c-9594-8d2c111af6ae tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:00:04.020861 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-c4edc849-09ff-4c4c-9594-8d2c111af6ae tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] [instance: fc188b51-5fbb-4924-830b-fd2791814d09] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:00:04.026791 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c4edc849-09ff-4c4c-9594-8d2c111af6ae tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:00:04.029929 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c4edc849-09ff-4c4c-9594-8d2c111af6ae tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:00:04.031398 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c4edc849-09ff-4c4c-9594-8d2c111af6ae tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:00:04.034883 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c4edc849-09ff-4c4c-9594-8d2c111af6ae tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:00:04.034883 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c4edc849-09ff-4c4c-9594-8d2c111af6ae tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:00:04.036504 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c4edc849-09ff-4c4c-9594-8d2c111af6ae tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:00:04.149645 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-2123b7f3-fa11-4251-8b85-0d5d45ec5a9d tempest-VolumesGetTestJSON-1472674091 tempest-VolumesGetTestJSON-1472674091-project] Calling method '.version_select at 0x7fb345b610d0>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:00:04.160831 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_api:SELECT=45,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 18:00:04.171921 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_cell1:SELECT=37 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 18:00:04.247521 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-2123b7f3-fa11-4251-8b85-0d5d45ec5a9d tempest-VolumesGetTestJSON-1472674091 tempest-VolumesGetTestJSON-1472674091-project] HTTP exception thrown: Volume 1cb631cb-8b0f-46a6-9334-75527707ea08 could not be found. Aug 10 18:00:04.250329 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-2123b7f3-fa11-4251-8b85-0d5d45ec5a9d tempest-VolumesGetTestJSON-1472674091 tempest-VolumesGetTestJSON-1472674091-project] Request method failure captured: Aug 10 18:00:04.250329 n-d-852296-2 devstack@n-api.service[129410]: request: GET /compute/v2.1/os-volumes/1cb631cb-8b0f-46a6-9334-75527707ea08 HTTP/1.1 Aug 10 18:00:04.250329 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 18:00:04.250329 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 18:00:04.250329 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 18:00:04.250329 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 0 Aug 10 18:00:04.250329 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 18:00:04.250329 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 18:00:04.250329 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 18:00:04.250329 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 18:00:04.250329 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8_IZRoBjjZ7B5WE7TXg3p4-x9T6MK9GMsdcWpbrxLY-6OTNPDmymjnw6EtBv44qOQJK_kuTLg1kp9FiemUCH9lJjLe9IjaT2DPPmkuq4xjBZQT3cD9X7eUS3Uf4Kq-8K-A0y5kiM9_vlfwzFhkqPGRQf5a3CSpfMIZF6xy7st1DV9fM Aug 10 18:00:04.250329 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 18:00:04.250329 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 18:00:04.250329 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 18:00:04.250329 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 18:00:04.250329 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 18:00:04.250329 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 18:00:04.250329 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: 7645af82f5164943a9eea5ee8e0df5a2 Aug 10 18:00:04.250329 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-VolumesGetTestJSON-1472674091 Aug 10 18:00:04.250329 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 18:00:04.250329 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 18:00:04.250329 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7645af82f5164943a9eea5ee8e0df5a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/7645af82f5164943a9eea5ee8e0df5a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7645af82f5164943a9eea5ee8e0df5a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_7645af82f5164943a9eea5ee8e0df5a2", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 18:00:04.250329 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-VolumesGetTestJSON-1472674091 Aug 10 18:00:04.250329 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: 7645af82f5164943a9eea5ee8e0df5a2 Aug 10 18:00:04.250329 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-VolumesGetTestJSON-1472674091 Aug 10 18:00:04.250329 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-VolumesGetTestJSON-1472674091-project Aug 10 18:00:04.250329 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 18:00:04.250329 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 18:00:04.250329 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: 16a35fc172524c03a7dcc9a86112b003 Aug 10 18:00:04.250329 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-VolumesGetTestJSON-1472674091-project Aug 10 18:00:04.250329 n-d-852296-2 devstack@n-api.service[129410]: method: Aug 10 18:00:04.250329 n-d-852296-2 devstack@n-api.service[129410]: exception: Volume 1cb631cb-8b0f-46a6-9334-75527707ea08 could not be found. Aug 10 18:00:04.250329 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'id': '1cb631cb-8b0f-46a6-9334-75527707ea08'} Aug 10 18:00:04.250329 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 18:00:04.250329 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:00:04.250329 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 18:00:04.250329 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 18:00:04.250329 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 10 18:00:04.250329 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 10 18:00:04.250329 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 10 18:00:04.250329 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 10 18:00:04.250329 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 18:00:04.250329 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 18:00:04.250329 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 18:00:04.250329 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 18:00:04.250329 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 18:00:04.250329 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 18:00:04.250329 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 18:00:04.250329 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 18:00:04.250329 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1cb631cb-8b0f-46a6-9334-75527707ea08 could not be found. (HTTP 404) (Request-ID: req-58a3b8c6-2c68-4dd3-86a6-85d1b39451de) Aug 10 18:00:04.250329 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:00:04.250329 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:00:04.250329 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:00:04.250329 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:00:04.250329 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 10 18:00:04.250329 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 10 18:00:04.250329 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 10 18:00:04.250329 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 10 18:00:04.250329 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 10 18:00:04.250329 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 10 18:00:04.250329 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 10 18:00:04.250329 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 10 18:00:04.250329 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 18:00:04.261384 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 18:00:04.261384 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 10 18:00:04.261384 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 10 18:00:04.261384 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 10 18:00:04.261384 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 10 18:00:04.261384 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 18:00:04.261384 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 18:00:04.261384 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 18:00:04.261384 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 18:00:04.261384 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 18:00:04.261384 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 18:00:04.261384 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 18:00:04.261384 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 18:00:04.261384 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1cb631cb-8b0f-46a6-9334-75527707ea08 could not be found. Aug 10 18:00:04.261384 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:00:04.261384 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:00:04.261384 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:00:04.261384 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:00:04.261384 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:00:04.261384 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:00:04.261384 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 18:00:04.261384 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 18:00:04.261384 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 18:00:04.261384 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 18:00:04.261384 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:00:04.261384 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:00:04.261384 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 10 18:00:04.261384 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 18:00:04.261384 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1cb631cb-8b0f-46a6-9334-75527707ea08 could not be found. Aug 10 18:00:04.261384 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:00:04.261384 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:00:04.261384 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:00:04.261384 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:00:04.261384 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:00:04.261384 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:00:04.261384 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 18:00:04.261384 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 18:00:04.261384 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1cb631cb-8b0f-46a6-9334-75527707ea08 could not be found. Aug 10 18:00:04.261384 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:00:04.261384 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-2123b7f3-fa11-4251-8b85-0d5d45ec5a9d tempest-VolumesGetTestJSON-1472674091 tempest-VolumesGetTestJSON-1472674091-project] Returning 404 to user: Volume 1cb631cb-8b0f-46a6-9334-75527707ea08 could not be found. {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 18:00:04.261384 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-2123b7f3-fa11-4251-8b85-0d5d45ec5a9d tempest-VolumesGetTestJSON-1472674091 tempest-VolumesGetTestJSON-1472674091-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/1cb631cb-8b0f-46a6-9334-75527707ea08" status: 404 len: 109 microversion: 2.1 time: 0.106668 Aug 10 18:00:04.261384 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 942/1907] 10.222.0.50 () {58 vars in 1245 bytes} [Wed Aug 10 18:00:04 2022] GET /compute/v2.1/os-volumes/1cb631cb-8b0f-46a6-9334-75527707ea08 => generated 109 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 18:00:05.534584 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-c4edc849-09ff-4c4c-9594-8d2c111af6ae tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:00:05.555393 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-c4edc849-09ff-4c4c-9594-8d2c111af6ae tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:00:05.558079 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-c4edc849-09ff-4c4c-9594-8d2c111af6ae tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:00:05.560714 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-c4edc849-09ff-4c4c-9594-8d2c111af6ae tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] 10.222.0.50 "GET /compute/v2.1/servers/fc188b51-5fbb-4924-830b-fd2791814d09" status: 200 len: 1366 microversion: 2.47 time: 1.548414 Aug 10 18:00:05.566758 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 966/1908] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 18:00:04 2022] GET /compute/v2.1/servers/fc188b51-5fbb-4924-830b-fd2791814d09 => generated 1366 bytes in 1555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 18:00:06.586522 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-b471bfd5-72ad-4309-8019-470937de84f1 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:00:06.587150 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-b471bfd5-72ad-4309-8019-470937de84f1 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] [instance: fc188b51-5fbb-4924-830b-fd2791814d09] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:00:06.610844 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b471bfd5-72ad-4309-8019-470937de84f1 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:00:06.613173 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b471bfd5-72ad-4309-8019-470937de84f1 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:00:06.613790 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b471bfd5-72ad-4309-8019-470937de84f1 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:00:06.617084 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b471bfd5-72ad-4309-8019-470937de84f1 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:00:06.622016 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b471bfd5-72ad-4309-8019-470937de84f1 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:00:06.622659 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b471bfd5-72ad-4309-8019-470937de84f1 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:00:06.802758 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-b471bfd5-72ad-4309-8019-470937de84f1 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:00:06.817912 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-b471bfd5-72ad-4309-8019-470937de84f1 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:00:06.819891 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-b471bfd5-72ad-4309-8019-470937de84f1 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:00:06.824007 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-b471bfd5-72ad-4309-8019-470937de84f1 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] 10.222.0.50 "GET /compute/v2.1/servers/fc188b51-5fbb-4924-830b-fd2791814d09" status: 200 len: 1366 microversion: 2.47 time: 0.241478 Aug 10 18:00:06.828286 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 943/1909] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 18:00:06 2022] GET /compute/v2.1/servers/fc188b51-5fbb-4924-830b-fd2791814d09 => generated 1366 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 18:00:07.853815 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-37cabd84-bab1-4ec5-8d98-056310a83546 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:00:07.854433 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-37cabd84-bab1-4ec5-8d98-056310a83546 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] [instance: fc188b51-5fbb-4924-830b-fd2791814d09] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:00:07.870269 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-37cabd84-bab1-4ec5-8d98-056310a83546 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:00:07.870754 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-37cabd84-bab1-4ec5-8d98-056310a83546 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:00:07.871185 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-37cabd84-bab1-4ec5-8d98-056310a83546 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:00:07.871888 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-37cabd84-bab1-4ec5-8d98-056310a83546 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:00:07.881170 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-37cabd84-bab1-4ec5-8d98-056310a83546 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:00:07.885769 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-37cabd84-bab1-4ec5-8d98-056310a83546 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:00:08.303822 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-37cabd84-bab1-4ec5-8d98-056310a83546 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:00:08.313654 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-37cabd84-bab1-4ec5-8d98-056310a83546 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:00:08.320048 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-37cabd84-bab1-4ec5-8d98-056310a83546 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:00:08.326979 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-37cabd84-bab1-4ec5-8d98-056310a83546 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] 10.222.0.50 "GET /compute/v2.1/servers/fc188b51-5fbb-4924-830b-fd2791814d09" status: 200 len: 1366 microversion: 2.47 time: 0.477007 Aug 10 18:00:08.332741 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 967/1910] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 18:00:07 2022] GET /compute/v2.1/servers/fc188b51-5fbb-4924-830b-fd2791814d09 => generated 1366 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 18:00:09.358322 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-608690d6-9de9-4a02-978a-f60aab861b92 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:00:09.358986 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-608690d6-9de9-4a02-978a-f60aab861b92 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] [instance: fc188b51-5fbb-4924-830b-fd2791814d09] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:00:09.388752 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-608690d6-9de9-4a02-978a-f60aab861b92 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:00:09.395160 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-608690d6-9de9-4a02-978a-f60aab861b92 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:00:09.396280 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-608690d6-9de9-4a02-978a-f60aab861b92 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:00:09.399062 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-608690d6-9de9-4a02-978a-f60aab861b92 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:00:09.402310 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-608690d6-9de9-4a02-978a-f60aab861b92 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:00:09.402997 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-608690d6-9de9-4a02-978a-f60aab861b92 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:00:09.736196 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-608690d6-9de9-4a02-978a-f60aab861b92 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:00:09.752474 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-608690d6-9de9-4a02-978a-f60aab861b92 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:00:09.757954 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-608690d6-9de9-4a02-978a-f60aab861b92 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:00:09.788425 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-608690d6-9de9-4a02-978a-f60aab861b92 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] 10.222.0.50 "GET /compute/v2.1/servers/fc188b51-5fbb-4924-830b-fd2791814d09" status: 200 len: 1366 microversion: 2.47 time: 0.427771 Aug 10 18:00:09.789252 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 944/1911] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 18:00:09 2022] GET /compute/v2.1/servers/fc188b51-5fbb-4924-830b-fd2791814d09 => generated 1366 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 18:00:10.815686 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-6bbb670d-4675-42f1-be81-cc5762e30943 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:00:10.817620 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-6bbb670d-4675-42f1-be81-cc5762e30943 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] [instance: fc188b51-5fbb-4924-830b-fd2791814d09] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:00:10.833326 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-6bbb670d-4675-42f1-be81-cc5762e30943 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:00:10.844754 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-6bbb670d-4675-42f1-be81-cc5762e30943 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:00:10.845285 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-6bbb670d-4675-42f1-be81-cc5762e30943 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:00:10.846161 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-6bbb670d-4675-42f1-be81-cc5762e30943 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:00:10.852383 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-6bbb670d-4675-42f1-be81-cc5762e30943 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:00:10.852383 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-6bbb670d-4675-42f1-be81-cc5762e30943 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:00:10.951422 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-6bbb670d-4675-42f1-be81-cc5762e30943 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:00:10.964403 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-6bbb670d-4675-42f1-be81-cc5762e30943 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:00:10.967163 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-6bbb670d-4675-42f1-be81-cc5762e30943 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:00:10.968684 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-6bbb670d-4675-42f1-be81-cc5762e30943 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] 10.222.0.50 "GET /compute/v2.1/servers/fc188b51-5fbb-4924-830b-fd2791814d09" status: 200 len: 1366 microversion: 2.47 time: 0.157634 Aug 10 18:00:10.969966 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 968/1912] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 18:00:10 2022] GET /compute/v2.1/servers/fc188b51-5fbb-4924-830b-fd2791814d09 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 18:00:11.995049 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-2a289f15-82a6-4b17-8cb9-31ad61a234e4 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:00:11.995910 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-2a289f15-82a6-4b17-8cb9-31ad61a234e4 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] [instance: fc188b51-5fbb-4924-830b-fd2791814d09] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:00:12.007316 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2a289f15-82a6-4b17-8cb9-31ad61a234e4 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:00:12.007689 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2a289f15-82a6-4b17-8cb9-31ad61a234e4 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:00:12.012332 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2a289f15-82a6-4b17-8cb9-31ad61a234e4 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:00:12.013401 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2a289f15-82a6-4b17-8cb9-31ad61a234e4 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:00:12.016465 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2a289f15-82a6-4b17-8cb9-31ad61a234e4 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:00:12.016965 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2a289f15-82a6-4b17-8cb9-31ad61a234e4 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:00:12.237686 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-2a289f15-82a6-4b17-8cb9-31ad61a234e4 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:00:12.253545 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-2a289f15-82a6-4b17-8cb9-31ad61a234e4 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:00:12.256992 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-2a289f15-82a6-4b17-8cb9-31ad61a234e4 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:00:12.262332 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-2a289f15-82a6-4b17-8cb9-31ad61a234e4 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] 10.222.0.50 "GET /compute/v2.1/servers/fc188b51-5fbb-4924-830b-fd2791814d09" status: 200 len: 1366 microversion: 2.47 time: 0.271008 Aug 10 18:00:12.267339 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 945/1913] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 18:00:11 2022] GET /compute/v2.1/servers/fc188b51-5fbb-4924-830b-fd2791814d09 => generated 1366 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 18:00:13.292981 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-ccabb019-5a87-449e-8611-0182fa6cc79b tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:00:13.294560 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-ccabb019-5a87-449e-8611-0182fa6cc79b tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] [instance: fc188b51-5fbb-4924-830b-fd2791814d09] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:00:13.307465 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-ccabb019-5a87-449e-8611-0182fa6cc79b tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:00:13.311279 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-ccabb019-5a87-449e-8611-0182fa6cc79b tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:00:13.311905 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-ccabb019-5a87-449e-8611-0182fa6cc79b tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:00:13.312953 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-ccabb019-5a87-449e-8611-0182fa6cc79b tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:00:13.315670 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-ccabb019-5a87-449e-8611-0182fa6cc79b tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:00:13.316355 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-ccabb019-5a87-449e-8611-0182fa6cc79b tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:00:13.502984 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-ccabb019-5a87-449e-8611-0182fa6cc79b tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:00:13.519557 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-ccabb019-5a87-449e-8611-0182fa6cc79b tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:00:13.525251 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-ccabb019-5a87-449e-8611-0182fa6cc79b tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:00:13.529891 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-ccabb019-5a87-449e-8611-0182fa6cc79b tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] 10.222.0.50 "GET /compute/v2.1/servers/fc188b51-5fbb-4924-830b-fd2791814d09" status: 200 len: 1366 microversion: 2.47 time: 0.242948 Aug 10 18:00:13.536419 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 946/1914] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 18:00:13 2022] GET /compute/v2.1/servers/fc188b51-5fbb-4924-830b-fd2791814d09 => generated 1366 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 18:00:13.964532 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-ab4864bd-be11-4242-a53f-03a6e7e0e3f8 tempest-ServerMetadataNegativeTestJSON-1042250130 tempest-ServerMetadataNegativeTestJSON-1042250130-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1462421668", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "f8ef8b72-2ff3-47ee-b575-b87a0304855f"}]}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 18:00:14.086076 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.network.neutron [None req-ab4864bd-be11-4242-a53f-03a6e7e0e3f8 tempest-ServerMetadataNegativeTestJSON-1042250130 tempest-ServerMetadataNegativeTestJSON-1042250130-project] validate_networks() for [('f8ef8b72-2ff3-47ee-b575-b87a0304855f', None, None, None, None, None)] {{(pid=129409) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 18:00:14.567142 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-233cb9e7-2ac9-4401-990d-52169162ef7c tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:00:14.568179 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-233cb9e7-2ac9-4401-990d-52169162ef7c tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] [instance: fc188b51-5fbb-4924-830b-fd2791814d09] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:00:14.580631 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-233cb9e7-2ac9-4401-990d-52169162ef7c tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:00:14.581130 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-233cb9e7-2ac9-4401-990d-52169162ef7c tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:00:14.586355 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-233cb9e7-2ac9-4401-990d-52169162ef7c tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:00:14.587575 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-233cb9e7-2ac9-4401-990d-52169162ef7c tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:00:14.588924 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-233cb9e7-2ac9-4401-990d-52169162ef7c tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:00:14.592320 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-233cb9e7-2ac9-4401-990d-52169162ef7c tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:00:14.914439 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [None req-ab4864bd-be11-4242-a53f-03a6e7e0e3f8 tempest-ServerMetadataNegativeTestJSON-1042250130 tempest-ServerMetadataNegativeTestJSON-1042250130-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-7a1e9754-cccc-4f0d-a40f-c0446535e356) Aug 10 18:00:14.914439 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:00:14.914439 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:00:14.914439 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:00:14.914439 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:00:14.914439 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:00:14.914439 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:00:14.914439 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:00:14.914439 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:00:14.914439 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:00:14.914439 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 18:00:14.914439 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 18:00:14.914439 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 18:00:14.914439 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 18:00:14.914439 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 18:00:14.914439 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 18:00:14.914439 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 18:00:14.914439 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 18:00:14.914439 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 18:00:14.914439 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 18:00:14.914439 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 18:00:14.914439 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 18:00:14.914439 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 18:00:14.914439 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 18:00:14.914439 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 18:00:14.914439 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 18:00:14.914439 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 18:00:14.914439 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:00:14.914439 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:00:14.914439 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 18:00:14.914439 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 18:00:14.914439 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:00:14.914439 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:00:14.914439 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 18:00:14.914439 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 18:00:14.914439 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:00:14.914439 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:00:14.914439 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:00:14.914439 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:00:14.914439 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:00:14.914439 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:00:14.914439 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 18:00:14.914439 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 18:00:14.914439 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 18:00:14.914439 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 18:00:14.914439 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 18:00:14.914439 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 18:00:14.914439 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 18:00:14.914439 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 18:00:14.914439 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 18:00:14.914439 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 18:00:14.914439 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 18:00:14.919876 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 18:00:14.919876 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 18:00:14.919876 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 18:00:14.919876 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 18:00:14.919876 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 18:00:14.919876 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 18:00:14.919876 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 18:00:14.919876 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 18:00:14.919876 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 18:00:14.919876 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 18:00:14.919876 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 18:00:14.919876 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 18:00:14.919876 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 18:00:14.919876 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 18:00:14.919876 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 18:00:14.919876 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-7a1e9754-cccc-4f0d-a40f-c0446535e356) Aug 10 18:00:14.919876 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:00:14.919876 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-ab4864bd-be11-4242-a53f-03a6e7e0e3f8 tempest-ServerMetadataNegativeTestJSON-1042250130 tempest-ServerMetadataNegativeTestJSON-1042250130-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:00:14.919876 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 18:00:14.919876 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-ab4864bd-be11-4242-a53f-03a6e7e0e3f8 tempest-ServerMetadataNegativeTestJSON-1042250130 tempest-ServerMetadataNegativeTestJSON-1042250130-project] Request method failure captured: Aug 10 18:00:14.919876 n-d-852296-2 devstack@n-api.service[129409]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 18:00:14.919876 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 18:00:14.919876 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 18:00:14.919876 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 18:00:14.919876 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 232 Aug 10 18:00:14.919876 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 18:00:14.919876 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 18:00:14.919876 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 18:00:14.919876 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 18:00:14.919876 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8_IsetuFzABwmqNjHFgSQ6CxDGJskX_p8nqtl4Q8vyUYRYvDSPS0h08EtcQk7DlE2UiixksBVoGY2KPIw7e7pdrDedTAIa9LrH7LjID_hwOTVW4_Xfc-5da-Ls37lk9SxvfgUgfL1fJFH-xA_z2fcd9D72MHzMzp9IKDGzmpN5iC2Vc Aug 10 18:00:14.919876 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 18:00:14.919876 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 18:00:14.919876 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 18:00:14.919876 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 18:00:14.919876 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 18:00:14.919876 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 18:00:14.919876 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: fe824b6724cf4b5395848c1ce9dc6e34 Aug 10 18:00:14.919876 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1042250130 Aug 10 18:00:14.919876 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 18:00:14.919876 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 18:00:14.919876 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/fe824b6724cf4b5395848c1ce9dc6e34"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/fe824b6724cf4b5395848c1ce9dc6e34"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/fe824b6724cf4b5395848c1ce9dc6e34"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_fe824b6724cf4b5395848c1ce9dc6e34", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 18:00:14.919876 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1042250130 Aug 10 18:00:14.919876 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: fe824b6724cf4b5395848c1ce9dc6e34 Aug 10 18:00:14.919876 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1042250130 Aug 10 18:00:14.919876 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-ServerMetadataNegativeTestJSON-1042250130-project Aug 10 18:00:14.919876 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 18:00:14.919876 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 18:00:14.919876 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: 6f3552f0d8da456db1d692c7105b8d30 Aug 10 18:00:14.919876 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1042250130-project Aug 10 18:00:14.919876 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 18:00:14.919876 n-d-852296-2 devstack@n-api.service[129409]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1462421668", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "f8ef8b72-2ff3-47ee-b575-b87a0304855f"}]}} Aug 10 18:00:14.919876 n-d-852296-2 devstack@n-api.service[129409]: method: > Aug 10 18:00:14.919876 n-d-852296-2 devstack@n-api.service[129409]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:00:14.919876 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 18:00:14.923989 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1462421668', 'imageRef': 'a735ff26-463a-4ffe-a981-ab9d9baa494f', 'flavorRef': '452', 'metadata': {}, 'networks': [{'uuid': 'f8ef8b72-2ff3-47ee-b575-b87a0304855f'}]}}} Aug 10 18:00:14.923989 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 18:00:14.923989 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:00:14.923989 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:00:14.923989 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:00:14.923989 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:00:14.923989 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:00:14.923989 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:00:14.923989 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:00:14.923989 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:00:14.923989 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:00:14.923989 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 18:00:14.923989 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 18:00:14.923989 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 18:00:14.923989 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 18:00:14.923989 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 18:00:14.923989 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 18:00:14.923989 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 18:00:14.923989 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 18:00:14.923989 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 18:00:14.923989 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 18:00:14.923989 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 18:00:14.923989 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 18:00:14.923989 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 18:00:14.923989 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 18:00:14.923989 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 18:00:14.923989 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 18:00:14.923989 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 18:00:14.923989 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:00:14.923989 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:00:14.923989 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 18:00:14.923989 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 18:00:14.923989 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:00:14.923989 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:00:14.923989 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 18:00:14.923989 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 18:00:14.923989 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:00:14.923989 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:00:14.923989 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:00:14.923989 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:00:14.923989 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:00:14.923989 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:00:14.923989 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 18:00:14.923989 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 18:00:14.923989 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 18:00:14.923989 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 18:00:14.923989 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 18:00:14.923989 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 18:00:14.923989 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 18:00:14.923989 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 18:00:14.923989 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 18:00:14.923989 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 18:00:14.923989 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 18:00:14.923989 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 18:00:14.923989 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 18:00:14.929947 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 18:00:14.929947 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 18:00:14.929947 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 18:00:14.929947 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 18:00:14.929947 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 18:00:14.929947 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 18:00:14.929947 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 18:00:14.929947 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 18:00:14.929947 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 18:00:14.929947 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 18:00:14.929947 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 18:00:14.929947 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 18:00:14.929947 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 18:00:14.929947 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-7a1e9754-cccc-4f0d-a40f-c0446535e356) Aug 10 18:00:14.929947 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:00:14.929947 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:00:14.929947 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:00:14.929947 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:00:14.929947 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:00:14.929947 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:00:14.929947 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 18:00:14.929947 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 18:00:14.929947 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 10 18:00:14.929947 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 10 18:00:14.929947 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:00:14.929947 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:00:14.929947 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:00:14.929947 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:00:14.929947 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:00:14.929947 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:00:14.929947 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:00:14.929947 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:00:14.929947 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 18:00:14.929947 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 18:00:14.929947 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:00:14.929947 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:00:14.929947 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:00:14.929947 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-ab4864bd-be11-4242-a53f-03a6e7e0e3f8 tempest-ServerMetadataNegativeTestJSON-1042250130 tempest-ServerMetadataNegativeTestJSON-1042250130-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:00:14.929947 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 18:00:14.929947 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-ab4864bd-be11-4242-a53f-03a6e7e0e3f8 tempest-ServerMetadataNegativeTestJSON-1042250130 tempest-ServerMetadataNegativeTestJSON-1042250130-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.835994 Aug 10 18:00:14.929947 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 969/1915] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 18:00:13 2022] POST /compute/v2.1/servers => generated 214 bytes in 1837 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 10 18:00:14.976859 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-233cb9e7-2ac9-4401-990d-52169162ef7c tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:00:14.989327 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-233cb9e7-2ac9-4401-990d-52169162ef7c tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:00:14.992845 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-233cb9e7-2ac9-4401-990d-52169162ef7c tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:00:14.995454 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-233cb9e7-2ac9-4401-990d-52169162ef7c tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] 10.222.0.50 "GET /compute/v2.1/servers/fc188b51-5fbb-4924-830b-fd2791814d09" status: 200 len: 1372 microversion: 2.47 time: 0.435893 Aug 10 18:00:14.997390 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 947/1916] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 18:00:14 2022] GET /compute/v2.1/servers/fc188b51-5fbb-4924-830b-fd2791814d09 => generated 1372 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 18:00:16.019972 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-b167067b-7e9f-4ac7-b5cc-26d106ab261a tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:00:16.021943 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-b167067b-7e9f-4ac7-b5cc-26d106ab261a tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] [instance: fc188b51-5fbb-4924-830b-fd2791814d09] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:00:16.035739 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-b167067b-7e9f-4ac7-b5cc-26d106ab261a tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:00:16.042909 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-b167067b-7e9f-4ac7-b5cc-26d106ab261a tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:00:16.042909 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-b167067b-7e9f-4ac7-b5cc-26d106ab261a tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:00:16.044014 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-b167067b-7e9f-4ac7-b5cc-26d106ab261a tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:00:16.046890 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-b167067b-7e9f-4ac7-b5cc-26d106ab261a tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:00:16.047709 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-b167067b-7e9f-4ac7-b5cc-26d106ab261a tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:00:16.595012 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-b167067b-7e9f-4ac7-b5cc-26d106ab261a tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:00:16.604364 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-b167067b-7e9f-4ac7-b5cc-26d106ab261a tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:00:16.625838 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-b167067b-7e9f-4ac7-b5cc-26d106ab261a tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:00:16.630285 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-b167067b-7e9f-4ac7-b5cc-26d106ab261a tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] 10.222.0.50 "GET /compute/v2.1/servers/fc188b51-5fbb-4924-830b-fd2791814d09" status: 200 len: 1372 microversion: 2.47 time: 0.613892 Aug 10 18:00:16.632461 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 970/1917] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 18:00:16 2022] GET /compute/v2.1/servers/fc188b51-5fbb-4924-830b-fd2791814d09 => generated 1372 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 18:00:17.655862 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-09109286-ef11-4a75-8063-37ff94a391c2 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:00:17.656498 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-09109286-ef11-4a75-8063-37ff94a391c2 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] [instance: fc188b51-5fbb-4924-830b-fd2791814d09] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:00:17.669017 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-09109286-ef11-4a75-8063-37ff94a391c2 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:00:17.676286 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-09109286-ef11-4a75-8063-37ff94a391c2 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:00:17.677884 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-09109286-ef11-4a75-8063-37ff94a391c2 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:00:17.681631 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-09109286-ef11-4a75-8063-37ff94a391c2 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:00:17.691268 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-09109286-ef11-4a75-8063-37ff94a391c2 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:00:17.695317 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-09109286-ef11-4a75-8063-37ff94a391c2 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:00:18.221407 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-09109286-ef11-4a75-8063-37ff94a391c2 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:00:18.230957 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-09109286-ef11-4a75-8063-37ff94a391c2 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:00:18.242148 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-09109286-ef11-4a75-8063-37ff94a391c2 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:00:18.243535 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-09109286-ef11-4a75-8063-37ff94a391c2 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] 10.222.0.50 "GET /compute/v2.1/servers/fc188b51-5fbb-4924-830b-fd2791814d09" status: 200 len: 1372 microversion: 2.47 time: 0.592222 Aug 10 18:00:18.244139 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 948/1918] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 18:00:17 2022] GET /compute/v2.1/servers/fc188b51-5fbb-4924-830b-fd2791814d09 => generated 1372 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 18:00:19.270186 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-44ad7a06-f50e-4fa3-9104-0c22799e7ca3 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:00:19.270775 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-44ad7a06-f50e-4fa3-9104-0c22799e7ca3 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] [instance: fc188b51-5fbb-4924-830b-fd2791814d09] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:00:19.293667 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-44ad7a06-f50e-4fa3-9104-0c22799e7ca3 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:00:19.294164 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-44ad7a06-f50e-4fa3-9104-0c22799e7ca3 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:00:19.294607 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-44ad7a06-f50e-4fa3-9104-0c22799e7ca3 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:00:19.298633 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-44ad7a06-f50e-4fa3-9104-0c22799e7ca3 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:00:19.316125 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-44ad7a06-f50e-4fa3-9104-0c22799e7ca3 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:00:19.316717 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-44ad7a06-f50e-4fa3-9104-0c22799e7ca3 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:00:19.646757 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-44ad7a06-f50e-4fa3-9104-0c22799e7ca3 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:00:19.670532 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-44ad7a06-f50e-4fa3-9104-0c22799e7ca3 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:00:19.680382 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-44ad7a06-f50e-4fa3-9104-0c22799e7ca3 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:00:19.691831 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-44ad7a06-f50e-4fa3-9104-0c22799e7ca3 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] 10.222.0.50 "GET /compute/v2.1/servers/fc188b51-5fbb-4924-830b-fd2791814d09" status: 200 len: 1357 microversion: 2.47 time: 0.425362 Aug 10 18:00:19.699773 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 971/1919] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 18:00:19 2022] GET /compute/v2.1/servers/fc188b51-5fbb-4924-830b-fd2791814d09 => generated 1357 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 18:00:19.726787 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-cd7a5d75-6fe2-4ca2-82fc-32fb695b5df8 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:00:19.734003 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-cd7a5d75-6fe2-4ca2-82fc-32fb695b5df8 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:00:19.737871 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-cd7a5d75-6fe2-4ca2-82fc-32fb695b5df8 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Searching by: {'deleted': False, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424'} {{(pid=129410) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 10 18:00:19.757339 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-cd7a5d75-6fe2-4ca2-82fc-32fb695b5df8 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:00:19.760020 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-cd7a5d75-6fe2-4ca2-82fc-32fb695b5df8 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:00:19.761124 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-cd7a5d75-6fe2-4ca2-82fc-32fb695b5df8 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:00:19.762304 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-cd7a5d75-6fe2-4ca2-82fc-32fb695b5df8 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:00:19.765913 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-cd7a5d75-6fe2-4ca2-82fc-32fb695b5df8 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:00:19.768162 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-cd7a5d75-6fe2-4ca2-82fc-32fb695b5df8 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:00:20.192178 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.multi_cell_list [None req-cd7a5d75-6fe2-4ca2-82fc-32fb695b5df8 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=129410) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 10 18:00:20.467155 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-cd7a5d75-6fe2-4ca2-82fc-32fb695b5df8 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:00:20.508615 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-cd7a5d75-6fe2-4ca2-82fc-32fb695b5df8 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:00:20.510730 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-cd7a5d75-6fe2-4ca2-82fc-32fb695b5df8 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:00:20.511337 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-cd7a5d75-6fe2-4ca2-82fc-32fb695b5df8 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:00:20.541155 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-cd7a5d75-6fe2-4ca2-82fc-32fb695b5df8 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:00:20.543653 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-cd7a5d75-6fe2-4ca2-82fc-32fb695b5df8 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:00:20.712660 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-cd7a5d75-6fe2-4ca2-82fc-32fb695b5df8 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] 10.222.0.50 "GET /compute/v2.1/servers/detail" status: 200 len: 2707 microversion: 2.47 time: 0.989195 Aug 10 18:00:20.713595 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 949/1920] 10.222.0.50 () {60 vars in 1187 bytes} [Wed Aug 10 18:00:19 2022] GET /compute/v2.1/servers/detail => generated 2707 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 18:00:20.749268 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-e1d9831a-3564-4fd9-ba35-164b335abd03 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:00:20.750905 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-e1d9831a-3564-4fd9-ba35-164b335abd03 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] [instance: fc188b51-5fbb-4924-830b-fd2791814d09] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:00:20.797076 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e1d9831a-3564-4fd9-ba35-164b335abd03 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:00:20.799586 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e1d9831a-3564-4fd9-ba35-164b335abd03 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:00:20.800064 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e1d9831a-3564-4fd9-ba35-164b335abd03 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:00:20.803347 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e1d9831a-3564-4fd9-ba35-164b335abd03 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:00:20.804632 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e1d9831a-3564-4fd9-ba35-164b335abd03 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:00:20.809469 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e1d9831a-3564-4fd9-ba35-164b335abd03 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:00:20.935787 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-e1d9831a-3564-4fd9-ba35-164b335abd03 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] [instance: fc188b51-5fbb-4924-830b-fd2791814d09] Going to try to terminate instance {{(pid=129409) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 18:00:21.581851 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-e1d9831a-3564-4fd9-ba35-164b335abd03 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] 10.222.0.50 "DELETE /compute/v2.1/servers/fc188b51-5fbb-4924-830b-fd2791814d09" status: 204 len: 0 microversion: 2.47 time: 0.831311 Aug 10 18:00:21.581851 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 972/1921] 10.222.0.50 () {60 vars in 1280 bytes} [Wed Aug 10 18:00:20 2022] DELETE /compute/v2.1/servers/fc188b51-5fbb-4924-830b-fd2791814d09 => generated 0 bytes in 840 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 10 18:00:21.591687 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-7c917282-60cb-4f3a-9465-f49c476249b7 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:00:21.592382 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-7c917282-60cb-4f3a-9465-f49c476249b7 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] [instance: fc188b51-5fbb-4924-830b-fd2791814d09] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:00:21.603548 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-7c917282-60cb-4f3a-9465-f49c476249b7 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:00:21.608842 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-7c917282-60cb-4f3a-9465-f49c476249b7 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:00:21.609404 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-7c917282-60cb-4f3a-9465-f49c476249b7 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:00:21.613375 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-7c917282-60cb-4f3a-9465-f49c476249b7 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:00:21.615166 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-7c917282-60cb-4f3a-9465-f49c476249b7 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:00:21.620672 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-7c917282-60cb-4f3a-9465-f49c476249b7 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:00:21.812001 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-7c917282-60cb-4f3a-9465-f49c476249b7 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:00:21.825717 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-7c917282-60cb-4f3a-9465-f49c476249b7 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:00:21.827510 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-7c917282-60cb-4f3a-9465-f49c476249b7 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:00:21.830393 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-7c917282-60cb-4f3a-9465-f49c476249b7 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] 10.222.0.50 "GET /compute/v2.1/servers/fc188b51-5fbb-4924-830b-fd2791814d09" status: 200 len: 1363 microversion: 2.47 time: 0.245414 Aug 10 18:00:21.841086 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 950/1922] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 18:00:21 2022] GET /compute/v2.1/servers/fc188b51-5fbb-4924-830b-fd2791814d09 => generated 1363 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 18:00:22.867941 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-f6ca9842-80d9-4f81-9880-c754cb86409b tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:00:22.869937 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-f6ca9842-80d9-4f81-9880-c754cb86409b tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] [instance: fc188b51-5fbb-4924-830b-fd2791814d09] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:00:22.877588 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-f6ca9842-80d9-4f81-9880-c754cb86409b tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:00:22.884120 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-f6ca9842-80d9-4f81-9880-c754cb86409b tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:00:22.884715 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-f6ca9842-80d9-4f81-9880-c754cb86409b tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:00:22.888639 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-f6ca9842-80d9-4f81-9880-c754cb86409b tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:00:22.889150 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-f6ca9842-80d9-4f81-9880-c754cb86409b tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:00:22.889596 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-f6ca9842-80d9-4f81-9880-c754cb86409b tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:00:23.142631 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-f6ca9842-80d9-4f81-9880-c754cb86409b tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:00:23.156114 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-f6ca9842-80d9-4f81-9880-c754cb86409b tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:00:23.157695 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-f6ca9842-80d9-4f81-9880-c754cb86409b tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:00:23.163978 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-6305f155-b256-4572-aec1-8056ba79e9a9 tempest-SecurityGroupsNegativeTestJSON-376067525 tempest-SecurityGroupsNegativeTestJSON-376067525-project] Calling method '.version_select at 0x7fb345dfdee0>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:00:23.179587 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-f6ca9842-80d9-4f81-9880-c754cb86409b tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] 10.222.0.50 "GET /compute/v2.1/servers/fc188b51-5fbb-4924-830b-fd2791814d09" status: 200 len: 1363 microversion: 2.47 time: 0.316216 Aug 10 18:00:23.183148 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 951/1923] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 18:00:22 2022] GET /compute/v2.1/servers/fc188b51-5fbb-4924-830b-fd2791814d09 => generated 1363 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 18:00:23.905554 n-d-852296-2 devstack@n-api.service[129409]: DEBUG neutronclient.v2_0.client [None req-6305f155-b256-4572-aec1-8056ba79e9a9 tempest-SecurityGroupsNegativeTestJSON-376067525 tempest-SecurityGroupsNegativeTestJSON-376067525-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 4b13480b-5fc3-48ea-b215-26257b14fbe4 does not exist", "detail": ""}} {{(pid=129409) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 10 18:00:23.906652 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.network.security_group_api [None req-6305f155-b256-4572-aec1-8056ba79e9a9 tempest-SecurityGroupsNegativeTestJSON-376067525 tempest-SecurityGroupsNegativeTestJSON-376067525-project] Neutron security group 4b13480b-5fc3-48ea-b215-26257b14fbe4 not found {{(pid=129409) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 10 18:00:23.908670 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-6305f155-b256-4572-aec1-8056ba79e9a9 tempest-SecurityGroupsNegativeTestJSON-376067525 tempest-SecurityGroupsNegativeTestJSON-376067525-project] HTTP exception thrown: Security group 4b13480b-5fc3-48ea-b215-26257b14fbe4 does not exist Aug 10 18:00:23.908670 n-d-852296-2 devstack@n-api.service[129409]: Neutron server returns request_ids: ['req-71ab8439-f34c-4b90-b522-2c05a3d9fb68'] Aug 10 18:00:23.913583 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-6305f155-b256-4572-aec1-8056ba79e9a9 tempest-SecurityGroupsNegativeTestJSON-376067525 tempest-SecurityGroupsNegativeTestJSON-376067525-project] Request method failure captured: Aug 10 18:00:23.913583 n-d-852296-2 devstack@n-api.service[129409]: request: DELETE /compute/v2.1/os-security-groups/4b13480b-5fc3-48ea-b215-26257b14fbe4 HTTP/1.1 Aug 10 18:00:23.913583 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 18:00:23.913583 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 18:00:23.913583 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 18:00:23.913583 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 0 Aug 10 18:00:23.913583 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 18:00:23.913583 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 18:00:23.913583 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 18:00:23.913583 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 18:00:23.913583 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8_I2bjd-z04z-QBCPd-nYfibMO8TXtWF0OuSpKTXkfVqWxrOa6yocKTJf5amg4tIThVIGKDsxfYvb97dxH8HrgxM2WPehTq3axCtdmr5TubJ0kQT75vBr9IOvh40Vk39coaWmTmFArljNzVanQ5TCymB4cYk7n9otR4FO-2Abefrj88 Aug 10 18:00:23.913583 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 18:00:23.913583 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 18:00:23.913583 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 18:00:23.913583 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 18:00:23.913583 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 18:00:23.913583 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 18:00:23.913583 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: 9b65668ab1c54ca2b44aeed76abef0bf Aug 10 18:00:23.913583 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-376067525 Aug 10 18:00:23.913583 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 18:00:23.913583 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 18:00:23.913583 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9b65668ab1c54ca2b44aeed76abef0bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9b65668ab1c54ca2b44aeed76abef0bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "tempest-ServicesTestJSON-Type-2125925520", "name": "tempest-ServicesTestJSON-Service-986152647", "endpoints": []}, {"type": "tempest-ServicesTestJSON-Type-205296589", "name": "tempest-ServicesTestJSON-Service-1180804720", "endpoints": []}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9b65668ab1c54ca2b44aeed76abef0bf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9b65668ab1c54ca2b44aeed76abef0bf", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "tempest-ServicesTestJSON-Type-778514754", "name": "tempest-ServicesTestJSON-Service-1478262031", "endpoints": []}] Aug 10 18:00:23.913583 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-376067525 Aug 10 18:00:23.913583 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: 9b65668ab1c54ca2b44aeed76abef0bf Aug 10 18:00:23.913583 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-376067525 Aug 10 18:00:23.913583 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-SecurityGroupsNegativeTestJSON-376067525-project Aug 10 18:00:23.913583 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 18:00:23.913583 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 18:00:23.913583 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: 8662ef1ffeca47508a474e28a5e8e6a4 Aug 10 18:00:23.913583 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-376067525-project Aug 10 18:00:23.913583 n-d-852296-2 devstack@n-api.service[129409]: method: Aug 10 18:00:23.913583 n-d-852296-2 devstack@n-api.service[129409]: exception: Security group 4b13480b-5fc3-48ea-b215-26257b14fbe4 does not exist Aug 10 18:00:23.913583 n-d-852296-2 devstack@n-api.service[129409]: Neutron server returns request_ids: ['req-71ab8439-f34c-4b90-b522-2c05a3d9fb68'] Aug 10 18:00:23.913583 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'id': '4b13480b-5fc3-48ea-b215-26257b14fbe4'} Aug 10 18:00:23.913583 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 18:00:23.913583 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:00:23.913583 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 10 18:00:23.913583 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 10 18:00:23.913583 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:00:23.913583 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:00:23.913583 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 10 18:00:23.913583 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 10 18:00:23.913583 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:00:23.913583 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:00:23.913583 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 18:00:23.913583 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 18:00:23.913583 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:00:23.913583 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:00:23.913583 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:00:23.913583 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:00:23.913583 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:00:23.913583 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:00:23.913583 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 10 18:00:23.913583 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 10 18:00:23.913583 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:00:23.913583 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:00:23.913583 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 10 18:00:23.913583 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 10 18:00:23.930299 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 10 18:00:23.930299 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 10 18:00:23.930299 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 4b13480b-5fc3-48ea-b215-26257b14fbe4 does not exist Aug 10 18:00:23.930299 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-71ab8439-f34c-4b90-b522-2c05a3d9fb68'] Aug 10 18:00:23.930299 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:00:23.930299 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:00:23.930299 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:00:23.930299 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:00:23.930299 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 10 18:00:23.930299 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 10 18:00:23.930299 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 10 18:00:23.930299 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 10 18:00:23.930299 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 4b13480b-5fc3-48ea-b215-26257b14fbe4 does not exist Aug 10 18:00:23.930299 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-71ab8439-f34c-4b90-b522-2c05a3d9fb68'] Aug 10 18:00:23.930299 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:00:23.930299 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:00:23.930299 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:00:23.930299 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:00:23.930299 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:00:23.930299 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:00:23.930299 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 18:00:23.930299 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 18:00:23.930299 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 18:00:23.930299 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 18:00:23.930299 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:00:23.930299 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:00:23.930299 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 10 18:00:23.930299 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 10 18:00:23.930299 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 4b13480b-5fc3-48ea-b215-26257b14fbe4 does not exist Aug 10 18:00:23.930299 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-71ab8439-f34c-4b90-b522-2c05a3d9fb68'] Aug 10 18:00:23.930299 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:00:23.930299 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:00:23.930299 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:00:23.930299 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:00:23.930299 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:00:23.930299 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:00:23.930299 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 18:00:23.930299 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 18:00:23.930299 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 4b13480b-5fc3-48ea-b215-26257b14fbe4 does not exist Aug 10 18:00:23.930299 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-71ab8439-f34c-4b90-b522-2c05a3d9fb68'] Aug 10 18:00:23.930299 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:00:23.930299 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-6305f155-b256-4572-aec1-8056ba79e9a9 tempest-SecurityGroupsNegativeTestJSON-376067525 tempest-SecurityGroupsNegativeTestJSON-376067525-project] Returning 404 to user: Security group 4b13480b-5fc3-48ea-b215-26257b14fbe4 does not exist Aug 10 18:00:23.930299 n-d-852296-2 devstack@n-api.service[129409]: Neutron server returns request_ids: ['req-71ab8439-f34c-4b90-b522-2c05a3d9fb68'] {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 18:00:23.930299 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-6305f155-b256-4572-aec1-8056ba79e9a9 tempest-SecurityGroupsNegativeTestJSON-376067525 tempest-SecurityGroupsNegativeTestJSON-376067525-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/4b13480b-5fc3-48ea-b215-26257b14fbe4" status: 404 len: 194 microversion: 2.1 time: 1.647581 Aug 10 18:00:23.930299 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 973/1924] 10.222.0.50 () {58 vars in 1272 bytes} [Wed Aug 10 18:00:22 2022] DELETE /compute/v2.1/os-security-groups/4b13480b-5fc3-48ea-b215-26257b14fbe4 => generated 194 bytes in 1649 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 18:00:23.939718 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-e97cd06b-69e1-475c-aab9-40d8d36b48da tempest-SecurityGroupsNegativeTestJSON-376067525 tempest-SecurityGroupsNegativeTestJSON-376067525-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.008815 Aug 10 18:00:23.951719 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 952/1925] 10.222.0.50 () {58 vars in 1164 bytes} [Wed Aug 10 18:00:23 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 17 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 10 18:00:23.957331 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-72601c2a-a12e-46e8-83df-747ef9f27ce2 tempest-SecurityGroupsNegativeTestJSON-376067525 tempest-SecurityGroupsNegativeTestJSON-376067525-project] Calling method '.version_select at 0x7fb345d76280>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:00:24.208220 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-03cf5101-232c-4967-a497-f817b6408edd tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:00:24.209777 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-03cf5101-232c-4967-a497-f817b6408edd tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] [instance: fc188b51-5fbb-4924-830b-fd2791814d09] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:00:24.231282 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-03cf5101-232c-4967-a497-f817b6408edd tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:00:24.232732 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-03cf5101-232c-4967-a497-f817b6408edd tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:00:24.232732 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-03cf5101-232c-4967-a497-f817b6408edd tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:00:24.233719 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-03cf5101-232c-4967-a497-f817b6408edd tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:00:24.234379 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-03cf5101-232c-4967-a497-f817b6408edd tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:00:24.235035 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-03cf5101-232c-4967-a497-f817b6408edd tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:00:24.335482 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-03cf5101-232c-4967-a497-f817b6408edd tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:00:24.336132 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-03cf5101-232c-4967-a497-f817b6408edd tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:00:24.342109 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-03cf5101-232c-4967-a497-f817b6408edd tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:00:24.342919 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.objects.instance [None req-03cf5101-232c-4967-a497-f817b6408edd tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lazy-loading 'fault' on Instance uuid fc188b51-5fbb-4924-830b-fd2791814d09 {{(pid=129410) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 18:00:24.487479 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-03cf5101-232c-4967-a497-f817b6408edd tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:00:24.532163 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-03cf5101-232c-4967-a497-f817b6408edd tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:00:24.538749 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-03cf5101-232c-4967-a497-f817b6408edd tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:00:24.540322 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-03cf5101-232c-4967-a497-f817b6408edd tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] 10.222.0.50 "GET /compute/v2.1/servers/fc188b51-5fbb-4924-830b-fd2791814d09" status: 200 len: 1368 microversion: 2.47 time: 0.338057 Aug 10 18:00:24.545200 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 953/1926] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 18:00:24 2022] GET /compute/v2.1/servers/fc188b51-5fbb-4924-830b-fd2791814d09 => generated 1368 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 18:00:24.568388 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-72601c2a-a12e-46e8-83df-747ef9f27ce2 tempest-SecurityGroupsNegativeTestJSON-376067525 tempest-SecurityGroupsNegativeTestJSON-376067525-project] 10.222.0.50 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.608546 Aug 10 18:00:24.568388 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 974/1927] 10.222.0.50 () {58 vars in 1158 bytes} [Wed Aug 10 18:00:23 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 18:00:24.581040 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-0a699490-9cc0-48ec-98a9-57d740e84fa6 tempest-SecurityGroupsNegativeTestJSON-376067525 tempest-SecurityGroupsNegativeTestJSON-376067525-project] Calling method '.version_select at 0x7fb345d77940>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:00:25.396880 n-d-852296-2 devstack@n-api.service[129410]: DEBUG neutronclient.v2_0.client [None req-0a699490-9cc0-48ec-98a9-57d740e84fa6 tempest-SecurityGroupsNegativeTestJSON-376067525 tempest-SecurityGroupsNegativeTestJSON-376067525-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=129410) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 10 18:00:25.399805 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-0a699490-9cc0-48ec-98a9-57d740e84fa6 tempest-SecurityGroupsNegativeTestJSON-376067525 tempest-SecurityGroupsNegativeTestJSON-376067525-project] HTTP exception thrown: Insufficient rights for removing default security group. Aug 10 18:00:25.399805 n-d-852296-2 devstack@n-api.service[129410]: Neutron server returns request_ids: ['req-7d6d7539-2e24-410b-b370-f9a131747856'] Aug 10 18:00:25.401876 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-0a699490-9cc0-48ec-98a9-57d740e84fa6 tempest-SecurityGroupsNegativeTestJSON-376067525 tempest-SecurityGroupsNegativeTestJSON-376067525-project] Request method failure captured: Aug 10 18:00:25.401876 n-d-852296-2 devstack@n-api.service[129410]: request: DELETE /compute/v2.1/os-security-groups/2a561b95-5413-4fc9-9133-e96c9642894f HTTP/1.1 Aug 10 18:00:25.401876 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 18:00:25.401876 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 18:00:25.401876 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 18:00:25.401876 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 0 Aug 10 18:00:25.401876 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 18:00:25.401876 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 18:00:25.401876 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 18:00:25.401876 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 18:00:25.401876 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8_I2bjd-z04z-QBCPd-nYfibMO8TXtWF0OuSpKTXkfVqWxrOa6yocKTJf5amg4tIThVIGKDsxfYvb97dxH8HrgxM2WPehTq3axCtdmr5TubJ0kQT75vBr9IOvh40Vk39coaWmTmFArljNzVanQ5TCymB4cYk7n9otR4FO-2Abefrj88 Aug 10 18:00:25.401876 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 18:00:25.401876 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 18:00:25.401876 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 18:00:25.401876 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 18:00:25.401876 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 18:00:25.401876 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 18:00:25.401876 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: 9b65668ab1c54ca2b44aeed76abef0bf Aug 10 18:00:25.401876 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-376067525 Aug 10 18:00:25.401876 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 18:00:25.401876 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 18:00:25.401876 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9b65668ab1c54ca2b44aeed76abef0bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9b65668ab1c54ca2b44aeed76abef0bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "tempest-ServicesTestJSON-Type-2125925520", "name": "tempest-ServicesTestJSON-Service-986152647", "endpoints": []}, {"type": "tempest-ServicesTestJSON-Type-205296589", "name": "tempest-ServicesTestJSON-Service-1180804720", "endpoints": []}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9b65668ab1c54ca2b44aeed76abef0bf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9b65668ab1c54ca2b44aeed76abef0bf", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "tempest-ServicesTestJSON-Type-778514754", "name": "tempest-ServicesTestJSON-Service-1478262031", "endpoints": []}] Aug 10 18:00:25.401876 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-376067525 Aug 10 18:00:25.401876 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: 9b65668ab1c54ca2b44aeed76abef0bf Aug 10 18:00:25.401876 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-376067525 Aug 10 18:00:25.401876 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-SecurityGroupsNegativeTestJSON-376067525-project Aug 10 18:00:25.401876 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 18:00:25.401876 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 18:00:25.401876 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: 8662ef1ffeca47508a474e28a5e8e6a4 Aug 10 18:00:25.401876 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-376067525-project Aug 10 18:00:25.401876 n-d-852296-2 devstack@n-api.service[129410]: method: Aug 10 18:00:25.401876 n-d-852296-2 devstack@n-api.service[129410]: exception: Insufficient rights for removing default security group. Aug 10 18:00:25.401876 n-d-852296-2 devstack@n-api.service[129410]: Neutron server returns request_ids: ['req-7d6d7539-2e24-410b-b370-f9a131747856'] Aug 10 18:00:25.401876 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'id': '2a561b95-5413-4fc9-9133-e96c9642894f'} Aug 10 18:00:25.401876 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 18:00:25.401876 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:00:25.401876 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Aug 10 18:00:25.401876 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Aug 10 18:00:25.401876 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:00:25.401876 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:00:25.401876 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Aug 10 18:00:25.401876 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Aug 10 18:00:25.401876 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:00:25.401876 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:00:25.401876 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Aug 10 18:00:25.401876 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Aug 10 18:00:25.401876 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:00:25.401876 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:00:25.401876 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:00:25.401876 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:00:25.401876 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:00:25.401876 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:00:25.401876 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 10 18:00:25.401876 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 10 18:00:25.401876 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:00:25.401876 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:00:25.401876 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 10 18:00:25.401876 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 10 18:00:25.406448 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 10 18:00:25.406448 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 10 18:00:25.406448 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Aug 10 18:00:25.406448 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7d6d7539-2e24-410b-b370-f9a131747856'] Aug 10 18:00:25.406448 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:00:25.406448 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:00:25.406448 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:00:25.406448 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:00:25.406448 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Aug 10 18:00:25.406448 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Aug 10 18:00:25.406448 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Aug 10 18:00:25.406448 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Aug 10 18:00:25.406448 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Aug 10 18:00:25.406448 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7d6d7539-2e24-410b-b370-f9a131747856'] Aug 10 18:00:25.406448 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:00:25.406448 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:00:25.406448 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:00:25.406448 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:00:25.406448 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:00:25.406448 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:00:25.406448 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 18:00:25.406448 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 18:00:25.406448 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 18:00:25.406448 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 18:00:25.406448 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:00:25.406448 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:00:25.406448 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Aug 10 18:00:25.406448 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 10 18:00:25.406448 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Aug 10 18:00:25.406448 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7d6d7539-2e24-410b-b370-f9a131747856'] Aug 10 18:00:25.406448 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:00:25.406448 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:00:25.406448 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:00:25.406448 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:00:25.406448 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:00:25.406448 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:00:25.406448 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 18:00:25.406448 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 18:00:25.406448 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Aug 10 18:00:25.406448 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7d6d7539-2e24-410b-b370-f9a131747856'] Aug 10 18:00:25.406448 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:00:25.406448 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-0a699490-9cc0-48ec-98a9-57d740e84fa6 tempest-SecurityGroupsNegativeTestJSON-376067525 tempest-SecurityGroupsNegativeTestJSON-376067525-project] Returning 400 to user: Insufficient rights for removing default security group. Aug 10 18:00:25.406448 n-d-852296-2 devstack@n-api.service[129410]: Neutron server returns request_ids: ['req-7d6d7539-2e24-410b-b370-f9a131747856'] {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 18:00:25.406448 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-0a699490-9cc0-48ec-98a9-57d740e84fa6 tempest-SecurityGroupsNegativeTestJSON-376067525 tempest-SecurityGroupsNegativeTestJSON-376067525-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/2a561b95-5413-4fc9-9133-e96c9642894f" status: 400 len: 182 microversion: 2.1 time: 0.826888 Aug 10 18:00:25.406448 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 954/1928] 10.222.0.50 () {58 vars in 1272 bytes} [Wed Aug 10 18:00:24 2022] DELETE /compute/v2.1/os-security-groups/2a561b95-5413-4fc9-9133-e96c9642894f => generated 182 bytes in 829 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 10 18:00:25.431521 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-4b242ebb-2d60-47a7-9524-a980acd519f0 tempest-SecurityGroupsNegativeTestJSON-376067525 tempest-SecurityGroupsNegativeTestJSON-376067525-project] Calling method '.version_select at 0x7fb345d76310>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:00:25.512580 n-d-852296-2 devstack@n-api.service[129409]: DEBUG neutronclient.v2_0.client [None req-4b242ebb-2d60-47a7-9524-a980acd519f0 tempest-SecurityGroupsNegativeTestJSON-376067525 tempest-SecurityGroupsNegativeTestJSON-376067525-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 6378aef9-b3f3-4d2c-90cf-17c53dfdff68 does not exist", "detail": ""}} {{(pid=129409) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 10 18:00:25.513198 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.network.security_group_api [None req-4b242ebb-2d60-47a7-9524-a980acd519f0 tempest-SecurityGroupsNegativeTestJSON-376067525 tempest-SecurityGroupsNegativeTestJSON-376067525-project] Neutron security group 6378aef9-b3f3-4d2c-90cf-17c53dfdff68 not found {{(pid=129409) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 10 18:00:25.513723 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-4b242ebb-2d60-47a7-9524-a980acd519f0 tempest-SecurityGroupsNegativeTestJSON-376067525 tempest-SecurityGroupsNegativeTestJSON-376067525-project] HTTP exception thrown: Security group 6378aef9-b3f3-4d2c-90cf-17c53dfdff68 does not exist Aug 10 18:00:25.513723 n-d-852296-2 devstack@n-api.service[129409]: Neutron server returns request_ids: ['req-5bb53fb8-5198-4f69-8562-9ec60e6a3f5d'] Aug 10 18:00:25.516229 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-4b242ebb-2d60-47a7-9524-a980acd519f0 tempest-SecurityGroupsNegativeTestJSON-376067525 tempest-SecurityGroupsNegativeTestJSON-376067525-project] Request method failure captured: Aug 10 18:00:25.516229 n-d-852296-2 devstack@n-api.service[129409]: request: GET /compute/v2.1/os-security-groups/6378aef9-b3f3-4d2c-90cf-17c53dfdff68 HTTP/1.1 Aug 10 18:00:25.516229 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 18:00:25.516229 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 18:00:25.516229 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 18:00:25.516229 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 0 Aug 10 18:00:25.516229 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 18:00:25.516229 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 18:00:25.516229 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 18:00:25.516229 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 18:00:25.516229 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8_I2bjd-z04z-QBCPd-nYfibMO8TXtWF0OuSpKTXkfVqWxrOa6yocKTJf5amg4tIThVIGKDsxfYvb97dxH8HrgxM2WPehTq3axCtdmr5TubJ0kQT75vBr9IOvh40Vk39coaWmTmFArljNzVanQ5TCymB4cYk7n9otR4FO-2Abefrj88 Aug 10 18:00:25.516229 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 18:00:25.516229 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 18:00:25.516229 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 18:00:25.516229 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 18:00:25.516229 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 18:00:25.516229 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 18:00:25.516229 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: 9b65668ab1c54ca2b44aeed76abef0bf Aug 10 18:00:25.516229 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-376067525 Aug 10 18:00:25.516229 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 18:00:25.516229 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 18:00:25.516229 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9b65668ab1c54ca2b44aeed76abef0bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9b65668ab1c54ca2b44aeed76abef0bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "tempest-ServicesTestJSON-Type-2125925520", "name": "tempest-ServicesTestJSON-Service-986152647", "endpoints": []}, {"type": "tempest-ServicesTestJSON-Type-205296589", "name": "tempest-ServicesTestJSON-Service-1180804720", "endpoints": []}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9b65668ab1c54ca2b44aeed76abef0bf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9b65668ab1c54ca2b44aeed76abef0bf", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "tempest-ServicesTestJSON-Type-778514754", "name": "tempest-ServicesTestJSON-Service-1478262031", "endpoints": []}] Aug 10 18:00:25.516229 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-376067525 Aug 10 18:00:25.516229 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: 9b65668ab1c54ca2b44aeed76abef0bf Aug 10 18:00:25.516229 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-376067525 Aug 10 18:00:25.516229 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-SecurityGroupsNegativeTestJSON-376067525-project Aug 10 18:00:25.516229 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 18:00:25.516229 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 18:00:25.516229 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: 8662ef1ffeca47508a474e28a5e8e6a4 Aug 10 18:00:25.516229 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-376067525-project Aug 10 18:00:25.516229 n-d-852296-2 devstack@n-api.service[129409]: method: Aug 10 18:00:25.516229 n-d-852296-2 devstack@n-api.service[129409]: exception: Security group 6378aef9-b3f3-4d2c-90cf-17c53dfdff68 does not exist Aug 10 18:00:25.516229 n-d-852296-2 devstack@n-api.service[129409]: Neutron server returns request_ids: ['req-5bb53fb8-5198-4f69-8562-9ec60e6a3f5d'] Aug 10 18:00:25.516229 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'id': '6378aef9-b3f3-4d2c-90cf-17c53dfdff68'} Aug 10 18:00:25.516229 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 18:00:25.516229 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:00:25.516229 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 10 18:00:25.516229 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 10 18:00:25.516229 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:00:25.516229 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:00:25.516229 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 10 18:00:25.516229 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 10 18:00:25.516229 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:00:25.516229 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:00:25.516229 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 18:00:25.516229 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 18:00:25.516229 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:00:25.516229 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:00:25.516229 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:00:25.516229 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:00:25.516229 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:00:25.516229 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:00:25.516229 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 10 18:00:25.516229 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 10 18:00:25.516229 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:00:25.516229 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:00:25.516229 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 10 18:00:25.516229 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 10 18:00:25.526944 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 10 18:00:25.526944 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 10 18:00:25.526944 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 6378aef9-b3f3-4d2c-90cf-17c53dfdff68 does not exist Aug 10 18:00:25.526944 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5bb53fb8-5198-4f69-8562-9ec60e6a3f5d'] Aug 10 18:00:25.526944 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:00:25.526944 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:00:25.526944 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:00:25.526944 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:00:25.526944 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 10 18:00:25.526944 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 10 18:00:25.526944 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 10 18:00:25.526944 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 10 18:00:25.526944 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 6378aef9-b3f3-4d2c-90cf-17c53dfdff68 does not exist Aug 10 18:00:25.526944 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5bb53fb8-5198-4f69-8562-9ec60e6a3f5d'] Aug 10 18:00:25.526944 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:00:25.526944 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:00:25.526944 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:00:25.526944 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:00:25.526944 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:00:25.526944 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:00:25.526944 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 18:00:25.526944 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 18:00:25.526944 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 18:00:25.526944 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 18:00:25.526944 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:00:25.526944 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:00:25.526944 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 10 18:00:25.526944 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 10 18:00:25.526944 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 6378aef9-b3f3-4d2c-90cf-17c53dfdff68 does not exist Aug 10 18:00:25.526944 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5bb53fb8-5198-4f69-8562-9ec60e6a3f5d'] Aug 10 18:00:25.526944 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:00:25.526944 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:00:25.526944 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:00:25.526944 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:00:25.526944 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:00:25.526944 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:00:25.526944 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 18:00:25.526944 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 18:00:25.526944 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 6378aef9-b3f3-4d2c-90cf-17c53dfdff68 does not exist Aug 10 18:00:25.526944 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5bb53fb8-5198-4f69-8562-9ec60e6a3f5d'] Aug 10 18:00:25.526944 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:00:25.526944 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-4b242ebb-2d60-47a7-9524-a980acd519f0 tempest-SecurityGroupsNegativeTestJSON-376067525 tempest-SecurityGroupsNegativeTestJSON-376067525-project] Returning 404 to user: Security group 6378aef9-b3f3-4d2c-90cf-17c53dfdff68 does not exist Aug 10 18:00:25.526944 n-d-852296-2 devstack@n-api.service[129409]: Neutron server returns request_ids: ['req-5bb53fb8-5198-4f69-8562-9ec60e6a3f5d'] {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 18:00:25.526944 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-4b242ebb-2d60-47a7-9524-a980acd519f0 tempest-SecurityGroupsNegativeTestJSON-376067525 tempest-SecurityGroupsNegativeTestJSON-376067525-project] 10.222.0.50 "GET /compute/v2.1/os-security-groups/6378aef9-b3f3-4d2c-90cf-17c53dfdff68" status: 404 len: 194 microversion: 2.1 time: 0.091805 Aug 10 18:00:25.526944 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 975/1929] 10.222.0.50 () {58 vars in 1269 bytes} [Wed Aug 10 18:00:25 2022] GET /compute/v2.1/os-security-groups/6378aef9-b3f3-4d2c-90cf-17c53dfdff68 => generated 194 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 18:00:25.535039 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-8a0b7aa9-ac7f-44eb-b123-89967373db9a tempest-SecurityGroupsNegativeTestJSON-376067525 tempest-SecurityGroupsNegativeTestJSON-376067525-project] Action: 'update', calling method: .version_select at 0x7fb345bdeb80>, body: {"security_group": {"name": "tempest-sg-1949573616", "description": "tempest-description-1068618877"}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 18:00:25.575078 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-0bf014af-9982-48c1-a375-83310851ba3b tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:00:25.575811 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-0bf014af-9982-48c1-a375-83310851ba3b tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] [instance: fc188b51-5fbb-4924-830b-fd2791814d09] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:00:25.632667 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-0bf014af-9982-48c1-a375-83310851ba3b tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:00:25.633330 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-0bf014af-9982-48c1-a375-83310851ba3b tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:00:25.634448 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-0bf014af-9982-48c1-a375-83310851ba3b tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:00:25.635338 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-0bf014af-9982-48c1-a375-83310851ba3b tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:00:25.635836 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-0bf014af-9982-48c1-a375-83310851ba3b tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:00:25.636343 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-0bf014af-9982-48c1-a375-83310851ba3b tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:00:25.684876 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 18:00:25.687090 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-0bf014af-9982-48c1-a375-83310851ba3b tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] HTTP exception thrown: Instance fc188b51-5fbb-4924-830b-fd2791814d09 could not be found. Aug 10 18:00:25.695455 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-0bf014af-9982-48c1-a375-83310851ba3b tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Request method failure captured: Aug 10 18:00:25.695455 n-d-852296-2 devstack@n-api.service[129409]: request: GET /compute/v2.1/servers/fc188b51-5fbb-4924-830b-fd2791814d09 HTTP/1.1 Aug 10 18:00:25.695455 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 18:00:25.695455 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 18:00:25.695455 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 18:00:25.695455 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 0 Aug 10 18:00:25.695455 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 18:00:25.695455 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 18:00:25.695455 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 18:00:25.695455 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 18:00:25.695455 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8_IBNRH_KzCL5olSQk6OzsKtBYre58nM1Xcl5gfIF05xr2vgLg1ym9ABJpdTqTIHRC6X4FKjFHaK_n8vh7Dnu0hR9QNAGuQOj7UkgFbb-lAzCHfFmiklwGkirGtf51uqU_HHQdHl_uIoKNdOuVw1J6hof53IfNc2eUoQbkedq0MGO3k Aug 10 18:00:25.695455 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 18:00:25.695455 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 18:00:25.695455 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 18:00:25.695455 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 18:00:25.695455 n-d-852296-2 devstack@n-api.service[129409]: X-Openstack-Nova-Api-Version: 2.47 Aug 10 18:00:25.695455 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 18:00:25.695455 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 18:00:25.695455 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: 0fde43f99a694fa5a0d746dc2ff05424 Aug 10 18:00:25.695455 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-ServerShowV247Test-1292079140 Aug 10 18:00:25.695455 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 18:00:25.695455 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 18:00:25.695455 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0fde43f99a694fa5a0d746dc2ff05424"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/0fde43f99a694fa5a0d746dc2ff05424"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0fde43f99a694fa5a0d746dc2ff05424"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_0fde43f99a694fa5a0d746dc2ff05424", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 18:00:25.695455 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-ServerShowV247Test-1292079140 Aug 10 18:00:25.695455 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: 0fde43f99a694fa5a0d746dc2ff05424 Aug 10 18:00:25.695455 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-ServerShowV247Test-1292079140 Aug 10 18:00:25.695455 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-ServerShowV247Test-1292079140-project Aug 10 18:00:25.695455 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 18:00:25.695455 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 18:00:25.695455 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: cd878de9fde9475ba4104e44587597c6 Aug 10 18:00:25.695455 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-ServerShowV247Test-1292079140-project Aug 10 18:00:25.695455 n-d-852296-2 devstack@n-api.service[129409]: method: > Aug 10 18:00:25.695455 n-d-852296-2 devstack@n-api.service[129409]: exception: Instance fc188b51-5fbb-4924-830b-fd2791814d09 could not be found. Aug 10 18:00:25.695455 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'id': 'fc188b51-5fbb-4924-830b-fd2791814d09'} Aug 10 18:00:25.695455 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 18:00:25.695455 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:00:25.695455 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 18:00:25.695455 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 18:00:25.695455 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 18:00:25.695455 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 18:00:25.695455 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 18:00:25.695455 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 18:00:25.695455 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 18:00:25.695455 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 18:00:25.695455 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc188b51-5fbb-4924-830b-fd2791814d09 could not be found. Aug 10 18:00:25.695455 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:00:25.695455 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:00:25.695455 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:00:25.695455 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:00:25.695455 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:00:25.695455 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:00:25.695455 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 18:00:25.695455 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 18:00:25.695455 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:00:25.695455 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:00:25.695455 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 18:00:25.695455 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 18:00:25.695455 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 18:00:25.695455 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 18:00:25.695455 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 18:00:25.695455 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 18:00:25.695455 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc188b51-5fbb-4924-830b-fd2791814d09 could not be found. Aug 10 18:00:25.695455 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:00:25.695455 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:00:25.695455 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:00:25.701691 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:00:25.701691 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:00:25.701691 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:00:25.701691 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 18:00:25.701691 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 18:00:25.701691 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc188b51-5fbb-4924-830b-fd2791814d09 could not be found. Aug 10 18:00:25.701691 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:00:25.701691 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-0bf014af-9982-48c1-a375-83310851ba3b tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Returning 404 to user: Instance fc188b51-5fbb-4924-830b-fd2791814d09 could not be found. {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 18:00:25.706009 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-0bf014af-9982-48c1-a375-83310851ba3b tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] 10.222.0.50 "GET /compute/v2.1/servers/fc188b51-5fbb-4924-830b-fd2791814d09" status: 404 len: 111 microversion: 2.47 time: 0.134852 Aug 10 18:00:25.713054 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 976/1930] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 18:00:25 2022] GET /compute/v2.1/servers/fc188b51-5fbb-4924-830b-fd2791814d09 => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 10 18:00:25.723967 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-4c3d20a7-7670-45c5-ba7c-ac8ae003709c tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:00:25.724498 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-4c3d20a7-7670-45c5-ba7c-ac8ae003709c tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] [instance: bdb37605-6cb4-40e2-a17d-09d77aea7bbf] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:00:25.752345 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-4c3d20a7-7670-45c5-ba7c-ac8ae003709c tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:00:25.752893 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-4c3d20a7-7670-45c5-ba7c-ac8ae003709c tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:00:25.753325 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-4c3d20a7-7670-45c5-ba7c-ac8ae003709c tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:00:25.754048 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-4c3d20a7-7670-45c5-ba7c-ac8ae003709c tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:00:25.754498 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-4c3d20a7-7670-45c5-ba7c-ac8ae003709c tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:00:25.755000 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-4c3d20a7-7670-45c5-ba7c-ac8ae003709c tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:00:25.810851 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-4c3d20a7-7670-45c5-ba7c-ac8ae003709c tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] [instance: bdb37605-6cb4-40e2-a17d-09d77aea7bbf] Going to try to terminate instance {{(pid=129409) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 18:00:25.832137 n-d-852296-2 devstack@n-api.service[129410]: DEBUG neutronclient.v2_0.client [None req-8a0b7aa9-ac7f-44eb-b123-89967373db9a tempest-SecurityGroupsNegativeTestJSON-376067525 tempest-SecurityGroupsNegativeTestJSON-376067525-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d3d930a6-bfe1-4476-907e-d076dca6051a does not exist", "detail": ""}} {{(pid=129410) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 10 18:00:25.832822 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.network.security_group_api [None req-8a0b7aa9-ac7f-44eb-b123-89967373db9a tempest-SecurityGroupsNegativeTestJSON-376067525 tempest-SecurityGroupsNegativeTestJSON-376067525-project] Neutron security group d3d930a6-bfe1-4476-907e-d076dca6051a not found {{(pid=129410) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 10 18:00:25.833360 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-8a0b7aa9-ac7f-44eb-b123-89967373db9a tempest-SecurityGroupsNegativeTestJSON-376067525 tempest-SecurityGroupsNegativeTestJSON-376067525-project] HTTP exception thrown: Security group d3d930a6-bfe1-4476-907e-d076dca6051a does not exist Aug 10 18:00:25.833360 n-d-852296-2 devstack@n-api.service[129410]: Neutron server returns request_ids: ['req-465a720b-ef99-4e7b-adf8-28946203b12b'] Aug 10 18:00:25.835409 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-8a0b7aa9-ac7f-44eb-b123-89967373db9a tempest-SecurityGroupsNegativeTestJSON-376067525 tempest-SecurityGroupsNegativeTestJSON-376067525-project] Request method failure captured: Aug 10 18:00:25.835409 n-d-852296-2 devstack@n-api.service[129410]: request: PUT /compute/v2.1/os-security-groups/d3d930a6-bfe1-4476-907e-d076dca6051a HTTP/1.1 Aug 10 18:00:25.835409 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 18:00:25.835409 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 18:00:25.835409 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 18:00:25.835409 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 102 Aug 10 18:00:25.835409 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 18:00:25.835409 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 18:00:25.835409 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 18:00:25.835409 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 18:00:25.835409 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8_I2bjd-z04z-QBCPd-nYfibMO8TXtWF0OuSpKTXkfVqWxrOa6yocKTJf5amg4tIThVIGKDsxfYvb97dxH8HrgxM2WPehTq3axCtdmr5TubJ0kQT75vBr9IOvh40Vk39coaWmTmFArljNzVanQ5TCymB4cYk7n9otR4FO-2Abefrj88 Aug 10 18:00:25.835409 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 18:00:25.835409 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 18:00:25.835409 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 18:00:25.835409 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 18:00:25.835409 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 18:00:25.835409 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 18:00:25.835409 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: 9b65668ab1c54ca2b44aeed76abef0bf Aug 10 18:00:25.835409 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-376067525 Aug 10 18:00:25.835409 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 18:00:25.835409 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 18:00:25.835409 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9b65668ab1c54ca2b44aeed76abef0bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9b65668ab1c54ca2b44aeed76abef0bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "tempest-ServicesTestJSON-Type-2125925520", "name": "tempest-ServicesTestJSON-Service-986152647", "endpoints": []}, {"type": "tempest-ServicesTestJSON-Type-205296589", "name": "tempest-ServicesTestJSON-Service-1180804720", "endpoints": []}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9b65668ab1c54ca2b44aeed76abef0bf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9b65668ab1c54ca2b44aeed76abef0bf", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "tempest-ServicesTestJSON-Type-778514754", "name": "tempest-ServicesTestJSON-Service-1478262031", "endpoints": []}] Aug 10 18:00:25.835409 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-376067525 Aug 10 18:00:25.835409 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: 9b65668ab1c54ca2b44aeed76abef0bf Aug 10 18:00:25.835409 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-376067525 Aug 10 18:00:25.835409 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-SecurityGroupsNegativeTestJSON-376067525-project Aug 10 18:00:25.835409 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 18:00:25.835409 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 18:00:25.835409 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: 8662ef1ffeca47508a474e28a5e8e6a4 Aug 10 18:00:25.835409 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-376067525-project Aug 10 18:00:25.835409 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 18:00:25.835409 n-d-852296-2 devstack@n-api.service[129410]: {"security_group": {"name": "tempest-sg-1949573616", "description": "tempest-description-1068618877"}} Aug 10 18:00:25.835409 n-d-852296-2 devstack@n-api.service[129410]: method: Aug 10 18:00:25.835409 n-d-852296-2 devstack@n-api.service[129410]: exception: Security group d3d930a6-bfe1-4476-907e-d076dca6051a does not exist Aug 10 18:00:25.835409 n-d-852296-2 devstack@n-api.service[129410]: Neutron server returns request_ids: ['req-465a720b-ef99-4e7b-adf8-28946203b12b'] Aug 10 18:00:25.835409 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'id': 'd3d930a6-bfe1-4476-907e-d076dca6051a', 'body': {'security_group': {'name': 'tempest-sg-1949573616', 'description': 'tempest-description-1068618877'}}} Aug 10 18:00:25.835409 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 18:00:25.835409 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:00:25.835409 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 10 18:00:25.835409 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 10 18:00:25.835409 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:00:25.835409 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:00:25.835409 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 10 18:00:25.835409 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 10 18:00:25.835409 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:00:25.835409 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:00:25.835409 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 18:00:25.835409 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 18:00:25.835409 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:00:25.835409 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:00:25.835409 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:00:25.835409 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:00:25.835409 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:00:25.835409 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:00:25.835409 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 10 18:00:25.835409 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 10 18:00:25.835409 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:00:25.835409 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:00:25.841888 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 10 18:00:25.841888 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 10 18:00:25.841888 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 10 18:00:25.841888 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 10 18:00:25.841888 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d3d930a6-bfe1-4476-907e-d076dca6051a does not exist Aug 10 18:00:25.841888 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-465a720b-ef99-4e7b-adf8-28946203b12b'] Aug 10 18:00:25.841888 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:00:25.841888 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:00:25.841888 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:00:25.841888 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:00:25.841888 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Aug 10 18:00:25.841888 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 10 18:00:25.841888 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 10 18:00:25.841888 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 10 18:00:25.841888 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d3d930a6-bfe1-4476-907e-d076dca6051a does not exist Aug 10 18:00:25.841888 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-465a720b-ef99-4e7b-adf8-28946203b12b'] Aug 10 18:00:25.841888 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:00:25.841888 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:00:25.841888 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:00:25.841888 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:00:25.841888 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:00:25.841888 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:00:25.841888 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 18:00:25.841888 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 18:00:25.841888 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 18:00:25.841888 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 18:00:25.841888 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:00:25.841888 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:00:25.841888 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Aug 10 18:00:25.841888 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 10 18:00:25.841888 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d3d930a6-bfe1-4476-907e-d076dca6051a does not exist Aug 10 18:00:25.841888 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-465a720b-ef99-4e7b-adf8-28946203b12b'] Aug 10 18:00:25.841888 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:00:25.841888 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:00:25.841888 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:00:25.841888 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:00:25.841888 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:00:25.841888 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:00:25.841888 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 18:00:25.841888 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 18:00:25.841888 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d3d930a6-bfe1-4476-907e-d076dca6051a does not exist Aug 10 18:00:25.841888 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-465a720b-ef99-4e7b-adf8-28946203b12b'] Aug 10 18:00:25.841888 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:00:25.841888 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-8a0b7aa9-ac7f-44eb-b123-89967373db9a tempest-SecurityGroupsNegativeTestJSON-376067525 tempest-SecurityGroupsNegativeTestJSON-376067525-project] Returning 404 to user: Security group d3d930a6-bfe1-4476-907e-d076dca6051a does not exist Aug 10 18:00:25.841888 n-d-852296-2 devstack@n-api.service[129410]: Neutron server returns request_ids: ['req-465a720b-ef99-4e7b-adf8-28946203b12b'] {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 18:00:25.841888 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-8a0b7aa9-ac7f-44eb-b123-89967373db9a tempest-SecurityGroupsNegativeTestJSON-376067525 tempest-SecurityGroupsNegativeTestJSON-376067525-project] 10.222.0.50 "PUT /compute/v2.1/os-security-groups/d3d930a6-bfe1-4476-907e-d076dca6051a" status: 404 len: 194 microversion: 2.1 time: 0.310546 Aug 10 18:00:25.841888 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 955/1931] 10.222.0.50 () {60 vars in 1290 bytes} [Wed Aug 10 18:00:25 2022] PUT /compute/v2.1/os-security-groups/d3d930a6-bfe1-4476-907e-d076dca6051a => generated 194 bytes in 312 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 18:00:26.359915 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-4c3d20a7-7670-45c5-ba7c-ac8ae003709c tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] 10.222.0.50 "DELETE /compute/v2.1/servers/bdb37605-6cb4-40e2-a17d-09d77aea7bbf" status: 204 len: 0 microversion: 2.47 time: 0.643824 Aug 10 18:00:26.362080 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 977/1932] 10.222.0.50 () {60 vars in 1280 bytes} [Wed Aug 10 18:00:25 2022] DELETE /compute/v2.1/servers/bdb37605-6cb4-40e2-a17d-09d77aea7bbf => generated 0 bytes in 648 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 10 18:00:26.370736 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-2c148e75-ed0f-4e73-88e6-8feec71559bb tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:00:26.371379 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-2c148e75-ed0f-4e73-88e6-8feec71559bb tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] [instance: bdb37605-6cb4-40e2-a17d-09d77aea7bbf] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:00:26.394362 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2c148e75-ed0f-4e73-88e6-8feec71559bb tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:00:26.395027 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2c148e75-ed0f-4e73-88e6-8feec71559bb tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:00:26.408719 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2c148e75-ed0f-4e73-88e6-8feec71559bb tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:00:26.408719 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2c148e75-ed0f-4e73-88e6-8feec71559bb tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:00:26.408719 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2c148e75-ed0f-4e73-88e6-8feec71559bb tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:00:26.408719 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2c148e75-ed0f-4e73-88e6-8feec71559bb tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:00:26.582007 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-2c148e75-ed0f-4e73-88e6-8feec71559bb tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:00:26.587830 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-2c148e75-ed0f-4e73-88e6-8feec71559bb tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:00:26.594820 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-2c148e75-ed0f-4e73-88e6-8feec71559bb tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:00:26.605841 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-2c148e75-ed0f-4e73-88e6-8feec71559bb tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] 10.222.0.50 "GET /compute/v2.1/servers/bdb37605-6cb4-40e2-a17d-09d77aea7bbf" status: 200 len: 1363 microversion: 2.47 time: 0.238281 Aug 10 18:00:26.608975 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 956/1933] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 18:00:26 2022] GET /compute/v2.1/servers/bdb37605-6cb4-40e2-a17d-09d77aea7bbf => generated 1363 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 18:00:27.632573 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-43e6b0cf-36eb-43a2-9e38-ada52441af05 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:00:27.634525 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-43e6b0cf-36eb-43a2-9e38-ada52441af05 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] [instance: bdb37605-6cb4-40e2-a17d-09d77aea7bbf] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:00:27.648610 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-43e6b0cf-36eb-43a2-9e38-ada52441af05 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:00:27.649761 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-43e6b0cf-36eb-43a2-9e38-ada52441af05 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:00:27.651561 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-43e6b0cf-36eb-43a2-9e38-ada52441af05 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:00:27.653983 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-43e6b0cf-36eb-43a2-9e38-ada52441af05 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:00:27.656779 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-43e6b0cf-36eb-43a2-9e38-ada52441af05 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:00:27.657498 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-43e6b0cf-36eb-43a2-9e38-ada52441af05 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:00:27.949404 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-43e6b0cf-36eb-43a2-9e38-ada52441af05 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:00:27.960354 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-43e6b0cf-36eb-43a2-9e38-ada52441af05 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:00:27.961986 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-43e6b0cf-36eb-43a2-9e38-ada52441af05 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:00:27.967807 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-43e6b0cf-36eb-43a2-9e38-ada52441af05 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] 10.222.0.50 "GET /compute/v2.1/servers/bdb37605-6cb4-40e2-a17d-09d77aea7bbf" status: 200 len: 1363 microversion: 2.47 time: 0.337013 Aug 10 18:00:27.973256 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 978/1934] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 18:00:27 2022] GET /compute/v2.1/servers/bdb37605-6cb4-40e2-a17d-09d77aea7bbf => generated 1363 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 18:00:28.989549 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-a6a6b910-f0a2-4e70-a46c-1f4294cd7131 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:00:28.990110 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-a6a6b910-f0a2-4e70-a46c-1f4294cd7131 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] [instance: bdb37605-6cb4-40e2-a17d-09d77aea7bbf] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:00:29.006951 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a6a6b910-f0a2-4e70-a46c-1f4294cd7131 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:00:29.007802 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a6a6b910-f0a2-4e70-a46c-1f4294cd7131 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:00:29.008477 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a6a6b910-f0a2-4e70-a46c-1f4294cd7131 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:00:29.009526 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a6a6b910-f0a2-4e70-a46c-1f4294cd7131 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:00:29.010231 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a6a6b910-f0a2-4e70-a46c-1f4294cd7131 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:00:29.011077 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a6a6b910-f0a2-4e70-a46c-1f4294cd7131 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:00:29.273192 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-a6a6b910-f0a2-4e70-a46c-1f4294cd7131 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:00:29.304868 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-a6a6b910-f0a2-4e70-a46c-1f4294cd7131 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:00:29.314006 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-a6a6b910-f0a2-4e70-a46c-1f4294cd7131 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:00:29.317931 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-a6a6b910-f0a2-4e70-a46c-1f4294cd7131 tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] 10.222.0.50 "GET /compute/v2.1/servers/bdb37605-6cb4-40e2-a17d-09d77aea7bbf" status: 200 len: 1363 microversion: 2.47 time: 0.332317 Aug 10 18:00:29.322648 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 957/1935] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 18:00:28 2022] GET /compute/v2.1/servers/bdb37605-6cb4-40e2-a17d-09d77aea7bbf => generated 1363 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 18:00:30.348577 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-c548f0df-5ed9-4b22-97a4-51da746e8f5c tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:00:30.350054 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-c548f0df-5ed9-4b22-97a4-51da746e8f5c tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] [instance: bdb37605-6cb4-40e2-a17d-09d77aea7bbf] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:00:30.352289 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_api:SELECT=51,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 18:00:30.376036 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c548f0df-5ed9-4b22-97a4-51da746e8f5c tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:00:30.377252 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c548f0df-5ed9-4b22-97a4-51da746e8f5c tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:00:30.378056 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c548f0df-5ed9-4b22-97a4-51da746e8f5c tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:00:30.379007 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c548f0df-5ed9-4b22-97a4-51da746e8f5c tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:00:30.379666 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c548f0df-5ed9-4b22-97a4-51da746e8f5c tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:00:30.380410 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c548f0df-5ed9-4b22-97a4-51da746e8f5c tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:00:30.490648 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c548f0df-5ed9-4b22-97a4-51da746e8f5c tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:00:30.502877 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c548f0df-5ed9-4b22-97a4-51da746e8f5c tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:00:30.521773 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c548f0df-5ed9-4b22-97a4-51da746e8f5c tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:00:30.523618 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.objects.instance [None req-c548f0df-5ed9-4b22-97a4-51da746e8f5c tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lazy-loading 'fault' on Instance uuid bdb37605-6cb4-40e2-a17d-09d77aea7bbf {{(pid=129409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 18:00:30.707410 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-c548f0df-5ed9-4b22-97a4-51da746e8f5c tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:00:30.729829 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-c548f0df-5ed9-4b22-97a4-51da746e8f5c tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:00:30.737499 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-c548f0df-5ed9-4b22-97a4-51da746e8f5c tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd878de9fde9475ba4104e44587597c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fde43f99a694fa5a0d746dc2ff05424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:00:30.741260 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-c548f0df-5ed9-4b22-97a4-51da746e8f5c tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] 10.222.0.50 "GET /compute/v2.1/servers/bdb37605-6cb4-40e2-a17d-09d77aea7bbf" status: 200 len: 1368 microversion: 2.47 time: 0.396628 Aug 10 18:00:30.742209 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 979/1936] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 18:00:30 2022] GET /compute/v2.1/servers/bdb37605-6cb4-40e2-a17d-09d77aea7bbf => generated 1368 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 18:00:31.780087 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-1775dd9f-fb9f-4fbe-8f61-fed93c6a07fb tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:00:31.780087 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-1775dd9f-fb9f-4fbe-8f61-fed93c6a07fb tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] [instance: bdb37605-6cb4-40e2-a17d-09d77aea7bbf] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:00:31.787157 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_cell0:SELECT=2 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 18:00:31.791429 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_cell0:SELECT=2 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 18:00:31.794691 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-1775dd9f-fb9f-4fbe-8f61-fed93c6a07fb tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:00:31.795192 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-1775dd9f-fb9f-4fbe-8f61-fed93c6a07fb tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:00:31.796909 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-1775dd9f-fb9f-4fbe-8f61-fed93c6a07fb tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:00:31.798021 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-1775dd9f-fb9f-4fbe-8f61-fed93c6a07fb tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:00:31.798133 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-1775dd9f-fb9f-4fbe-8f61-fed93c6a07fb tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:00:31.798496 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-1775dd9f-fb9f-4fbe-8f61-fed93c6a07fb tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:00:31.832868 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-1775dd9f-fb9f-4fbe-8f61-fed93c6a07fb tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] HTTP exception thrown: Instance bdb37605-6cb4-40e2-a17d-09d77aea7bbf could not be found. Aug 10 18:00:31.837480 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-1775dd9f-fb9f-4fbe-8f61-fed93c6a07fb tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Request method failure captured: Aug 10 18:00:31.837480 n-d-852296-2 devstack@n-api.service[129410]: request: GET /compute/v2.1/servers/bdb37605-6cb4-40e2-a17d-09d77aea7bbf HTTP/1.1 Aug 10 18:00:31.837480 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 18:00:31.837480 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 18:00:31.837480 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 18:00:31.837480 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 0 Aug 10 18:00:31.837480 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 18:00:31.837480 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 18:00:31.837480 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 18:00:31.837480 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 18:00:31.837480 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8_IBNRH_KzCL5olSQk6OzsKtBYre58nM1Xcl5gfIF05xr2vgLg1ym9ABJpdTqTIHRC6X4FKjFHaK_n8vh7Dnu0hR9QNAGuQOj7UkgFbb-lAzCHfFmiklwGkirGtf51uqU_HHQdHl_uIoKNdOuVw1J6hof53IfNc2eUoQbkedq0MGO3k Aug 10 18:00:31.837480 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 18:00:31.837480 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 18:00:31.837480 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 18:00:31.837480 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 18:00:31.837480 n-d-852296-2 devstack@n-api.service[129410]: X-Openstack-Nova-Api-Version: 2.47 Aug 10 18:00:31.837480 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 18:00:31.837480 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 18:00:31.837480 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: 0fde43f99a694fa5a0d746dc2ff05424 Aug 10 18:00:31.837480 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-ServerShowV247Test-1292079140 Aug 10 18:00:31.837480 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 18:00:31.837480 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 18:00:31.837480 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0fde43f99a694fa5a0d746dc2ff05424"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/0fde43f99a694fa5a0d746dc2ff05424"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0fde43f99a694fa5a0d746dc2ff05424"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_0fde43f99a694fa5a0d746dc2ff05424", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 18:00:31.837480 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-ServerShowV247Test-1292079140 Aug 10 18:00:31.837480 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: 0fde43f99a694fa5a0d746dc2ff05424 Aug 10 18:00:31.837480 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-ServerShowV247Test-1292079140 Aug 10 18:00:31.837480 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-ServerShowV247Test-1292079140-project Aug 10 18:00:31.837480 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 18:00:31.837480 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 18:00:31.837480 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: cd878de9fde9475ba4104e44587597c6 Aug 10 18:00:31.837480 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-ServerShowV247Test-1292079140-project Aug 10 18:00:31.837480 n-d-852296-2 devstack@n-api.service[129410]: method: > Aug 10 18:00:31.837480 n-d-852296-2 devstack@n-api.service[129410]: exception: Instance bdb37605-6cb4-40e2-a17d-09d77aea7bbf could not be found. Aug 10 18:00:31.837480 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'id': 'bdb37605-6cb4-40e2-a17d-09d77aea7bbf'} Aug 10 18:00:31.837480 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 18:00:31.837480 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:00:31.837480 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 18:00:31.837480 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 18:00:31.837480 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 18:00:31.837480 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 18:00:31.837480 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 18:00:31.837480 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 18:00:31.837480 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 18:00:31.837480 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 18:00:31.837480 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bdb37605-6cb4-40e2-a17d-09d77aea7bbf could not be found. Aug 10 18:00:31.837480 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:00:31.837480 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:00:31.837480 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:00:31.837480 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:00:31.837480 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:00:31.837480 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:00:31.837480 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 18:00:31.837480 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 18:00:31.837480 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:00:31.837480 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:00:31.837480 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 18:00:31.837480 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 18:00:31.837480 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 18:00:31.837480 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 18:00:31.837480 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 18:00:31.837480 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 18:00:31.837480 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bdb37605-6cb4-40e2-a17d-09d77aea7bbf could not be found. Aug 10 18:00:31.837480 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:00:31.837480 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:00:31.837480 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:00:31.850928 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:00:31.850928 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:00:31.850928 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:00:31.850928 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 18:00:31.850928 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 18:00:31.850928 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bdb37605-6cb4-40e2-a17d-09d77aea7bbf could not be found. Aug 10 18:00:31.850928 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:00:31.850928 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-1775dd9f-fb9f-4fbe-8f61-fed93c6a07fb tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] Returning 404 to user: Instance bdb37605-6cb4-40e2-a17d-09d77aea7bbf could not be found. {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 18:00:31.850928 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-1775dd9f-fb9f-4fbe-8f61-fed93c6a07fb tempest-ServerShowV247Test-1292079140 tempest-ServerShowV247Test-1292079140-project] 10.222.0.50 "GET /compute/v2.1/servers/bdb37605-6cb4-40e2-a17d-09d77aea7bbf" status: 404 len: 111 microversion: 2.47 time: 0.072573 Aug 10 18:00:31.850928 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 958/1937] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 18:00:31 2022] GET /compute/v2.1/servers/bdb37605-6cb4-40e2-a17d-09d77aea7bbf => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 10 18:00:34.443113 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-56abd0f3-95de-464f-ae7f-3b713bf9ec79 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-724252429", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": "none"}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 18:00:34.520145 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.virt.hardware [None req-56abd0f3-95de-464f-ae7f-3b713bf9ec79 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Flavor limits 0:0:0 {{(pid=129409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 18:00:34.520733 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.virt.hardware [None req-56abd0f3-95de-464f-ae7f-3b713bf9ec79 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Image limits 0:0:0 {{(pid=129409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 18:00:34.521406 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.virt.hardware [None req-56abd0f3-95de-464f-ae7f-3b713bf9ec79 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Flavor pref 0:0:0 {{(pid=129409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 18:00:34.521994 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.virt.hardware [None req-56abd0f3-95de-464f-ae7f-3b713bf9ec79 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Image pref 0:0:0 {{(pid=129409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 18:00:34.522573 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.virt.hardware [None req-56abd0f3-95de-464f-ae7f-3b713bf9ec79 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 18:00:34.534529 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-56abd0f3-95de-464f-ae7f-3b713bf9ec79 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:00:34.535248 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-56abd0f3-95de-464f-ae7f-3b713bf9ec79 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:00:34.535847 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-56abd0f3-95de-464f-ae7f-3b713bf9ec79 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:00:34.536786 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-56abd0f3-95de-464f-ae7f-3b713bf9ec79 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:00:34.537425 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-56abd0f3-95de-464f-ae7f-3b713bf9ec79 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:00:34.538277 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-56abd0f3-95de-464f-ae7f-3b713bf9ec79 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:00:34.562430 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-56abd0f3-95de-464f-ae7f-3b713bf9ec79 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Getting quotas for project bcf5c80544ad4a58a38c6af33a9d191c. Resources: {'instances', 'ram', 'cores'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 18:00:34.568506 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-56abd0f3-95de-464f-ae7f-3b713bf9ec79 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Getting quotas for user ec98ff0c96a348cdbb28f75575750cd4 and project bcf5c80544ad4a58a38c6af33a9d191c. Resources: {'instances', 'ram', 'cores'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 18:00:34.584182 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-56abd0f3-95de-464f-ae7f-3b713bf9ec79 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Going to run 1 instances... {{(pid=129409) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 18:00:34.587259 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-56abd0f3-95de-464f-ae7f-3b713bf9ec79 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] [instance: eaea86c8-028c-4254-a992-5f7c9d06f5fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a735ff26-463a-4ffe-a981-ab9d9baa494f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 18:00:34.833135 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-56abd0f3-95de-464f-ae7f-3b713bf9ec79 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.697097 Aug 10 18:00:34.833135 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 980/1938] 10.222.0.50 () {62 vars in 1188 bytes} [Wed Aug 10 18:00:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 702 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 10 18:00:34.844189 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-a645d7bd-47a1-4a40-9158-283bcd5b4f4b tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:00:34.844866 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-a645d7bd-47a1-4a40-9158-283bcd5b4f4b tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] [instance: eaea86c8-028c-4254-a992-5f7c9d06f5fc] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:00:34.957811 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-a645d7bd-47a1-4a40-9158-283bcd5b4f4b tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec98ff0c96a348cdbb28f75575750cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf5c80544ad4a58a38c6af33a9d191c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:00:34.968286 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-a645d7bd-47a1-4a40-9158-283bcd5b4f4b tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec98ff0c96a348cdbb28f75575750cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf5c80544ad4a58a38c6af33a9d191c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:00:34.970151 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-a645d7bd-47a1-4a40-9158-283bcd5b4f4b tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec98ff0c96a348cdbb28f75575750cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf5c80544ad4a58a38c6af33a9d191c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:00:34.971983 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-a645d7bd-47a1-4a40-9158-283bcd5b4f4b tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] 10.222.0.50 "GET /compute/v2.1/servers/eaea86c8-028c-4254-a992-5f7c9d06f5fc" status: 200 len: 1277 microversion: 2.57 time: 0.135718 Aug 10 18:00:34.973273 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 959/1939] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 18:00:34 2022] GET /compute/v2.1/servers/eaea86c8-028c-4254-a992-5f7c9d06f5fc => generated 1277 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 18:00:35.999115 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-c080f679-0c34-4974-8d2b-3bd3147d98d3 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:00:35.999876 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-c080f679-0c34-4974-8d2b-3bd3147d98d3 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] [instance: eaea86c8-028c-4254-a992-5f7c9d06f5fc] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:00:36.163857 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-c080f679-0c34-4974-8d2b-3bd3147d98d3 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec98ff0c96a348cdbb28f75575750cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf5c80544ad4a58a38c6af33a9d191c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:00:36.171780 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-c080f679-0c34-4974-8d2b-3bd3147d98d3 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec98ff0c96a348cdbb28f75575750cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf5c80544ad4a58a38c6af33a9d191c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:00:36.174235 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-c080f679-0c34-4974-8d2b-3bd3147d98d3 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec98ff0c96a348cdbb28f75575750cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf5c80544ad4a58a38c6af33a9d191c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:00:36.175855 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-c080f679-0c34-4974-8d2b-3bd3147d98d3 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] 10.222.0.50 "GET /compute/v2.1/servers/eaea86c8-028c-4254-a992-5f7c9d06f5fc" status: 200 len: 1277 microversion: 2.57 time: 0.182561 Aug 10 18:00:36.176842 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 981/1940] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 18:00:35 2022] GET /compute/v2.1/servers/eaea86c8-028c-4254-a992-5f7c9d06f5fc => generated 1277 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 18:00:37.200902 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-4541ce0f-6f42-4f36-95c8-5c32be7c59d9 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:00:37.201426 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-4541ce0f-6f42-4f36-95c8-5c32be7c59d9 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] [instance: eaea86c8-028c-4254-a992-5f7c9d06f5fc] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:00:37.777210 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-4541ce0f-6f42-4f36-95c8-5c32be7c59d9 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec98ff0c96a348cdbb28f75575750cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf5c80544ad4a58a38c6af33a9d191c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:00:37.802322 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-4541ce0f-6f42-4f36-95c8-5c32be7c59d9 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec98ff0c96a348cdbb28f75575750cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf5c80544ad4a58a38c6af33a9d191c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:00:37.806620 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-4541ce0f-6f42-4f36-95c8-5c32be7c59d9 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec98ff0c96a348cdbb28f75575750cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf5c80544ad4a58a38c6af33a9d191c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:00:37.816455 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-4541ce0f-6f42-4f36-95c8-5c32be7c59d9 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] 10.222.0.50 "GET /compute/v2.1/servers/eaea86c8-028c-4254-a992-5f7c9d06f5fc" status: 200 len: 1277 microversion: 2.57 time: 0.619523 Aug 10 18:00:37.818355 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 960/1941] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 18:00:37 2022] GET /compute/v2.1/servers/eaea86c8-028c-4254-a992-5f7c9d06f5fc => generated 1277 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 18:00:38.845762 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-60ed448a-b376-4b6a-9b46-3ea10161065e tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:00:38.846646 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-60ed448a-b376-4b6a-9b46-3ea10161065e tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] [instance: eaea86c8-028c-4254-a992-5f7c9d06f5fc] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:00:38.862851 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-60ed448a-b376-4b6a-9b46-3ea10161065e tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:00:38.863639 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-60ed448a-b376-4b6a-9b46-3ea10161065e tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:00:38.864528 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-60ed448a-b376-4b6a-9b46-3ea10161065e tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:00:38.865807 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-60ed448a-b376-4b6a-9b46-3ea10161065e tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:00:38.866561 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-60ed448a-b376-4b6a-9b46-3ea10161065e tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:00:38.867658 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-60ed448a-b376-4b6a-9b46-3ea10161065e tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:00:38.983359 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-60ed448a-b376-4b6a-9b46-3ea10161065e tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec98ff0c96a348cdbb28f75575750cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf5c80544ad4a58a38c6af33a9d191c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:00:39.006727 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-60ed448a-b376-4b6a-9b46-3ea10161065e tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec98ff0c96a348cdbb28f75575750cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf5c80544ad4a58a38c6af33a9d191c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:00:39.008749 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-60ed448a-b376-4b6a-9b46-3ea10161065e tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec98ff0c96a348cdbb28f75575750cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf5c80544ad4a58a38c6af33a9d191c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:00:39.009936 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-60ed448a-b376-4b6a-9b46-3ea10161065e tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] 10.222.0.50 "GET /compute/v2.1/servers/eaea86c8-028c-4254-a992-5f7c9d06f5fc" status: 200 len: 1329 microversion: 2.57 time: 0.171511 Aug 10 18:00:39.015443 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 982/1942] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 18:00:38 2022] GET /compute/v2.1/servers/eaea86c8-028c-4254-a992-5f7c9d06f5fc => generated 1329 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 18:00:40.034180 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-2b38c802-b432-43ed-84e9-ba2befd7630b tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:00:40.035005 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-2b38c802-b432-43ed-84e9-ba2befd7630b tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] [instance: eaea86c8-028c-4254-a992-5f7c9d06f5fc] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:00:40.045532 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2b38c802-b432-43ed-84e9-ba2befd7630b tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:00:40.046645 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2b38c802-b432-43ed-84e9-ba2befd7630b tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:00:40.049137 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2b38c802-b432-43ed-84e9-ba2befd7630b tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:00:40.050183 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2b38c802-b432-43ed-84e9-ba2befd7630b tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:00:40.051955 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2b38c802-b432-43ed-84e9-ba2befd7630b tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:00:40.052800 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2b38c802-b432-43ed-84e9-ba2befd7630b tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:00:40.085490 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_cell1:SELECT=81 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 18:00:40.142327 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-2b38c802-b432-43ed-84e9-ba2befd7630b tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec98ff0c96a348cdbb28f75575750cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf5c80544ad4a58a38c6af33a9d191c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:00:40.153544 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-2b38c802-b432-43ed-84e9-ba2befd7630b tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec98ff0c96a348cdbb28f75575750cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf5c80544ad4a58a38c6af33a9d191c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:00:40.155496 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-2b38c802-b432-43ed-84e9-ba2befd7630b tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec98ff0c96a348cdbb28f75575750cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf5c80544ad4a58a38c6af33a9d191c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:00:40.157510 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-2b38c802-b432-43ed-84e9-ba2befd7630b tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] 10.222.0.50 "GET /compute/v2.1/servers/eaea86c8-028c-4254-a992-5f7c9d06f5fc" status: 200 len: 1335 microversion: 2.57 time: 0.127215 Aug 10 18:00:40.174295 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 961/1943] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 18:00:40 2022] GET /compute/v2.1/servers/eaea86c8-028c-4254-a992-5f7c9d06f5fc => generated 1335 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 18:00:41.188444 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-924f14c3-1e0b-445e-933b-84357a60c881 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:00:41.189283 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-924f14c3-1e0b-445e-933b-84357a60c881 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] [instance: eaea86c8-028c-4254-a992-5f7c9d06f5fc] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:00:41.203782 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-924f14c3-1e0b-445e-933b-84357a60c881 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:00:41.204366 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-924f14c3-1e0b-445e-933b-84357a60c881 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:00:41.206014 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-924f14c3-1e0b-445e-933b-84357a60c881 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:00:41.206760 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-924f14c3-1e0b-445e-933b-84357a60c881 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:00:41.209755 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-924f14c3-1e0b-445e-933b-84357a60c881 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:00:41.211572 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-924f14c3-1e0b-445e-933b-84357a60c881 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:00:41.841084 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-924f14c3-1e0b-445e-933b-84357a60c881 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec98ff0c96a348cdbb28f75575750cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf5c80544ad4a58a38c6af33a9d191c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:00:41.862532 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-924f14c3-1e0b-445e-933b-84357a60c881 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec98ff0c96a348cdbb28f75575750cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf5c80544ad4a58a38c6af33a9d191c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:00:41.868815 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-924f14c3-1e0b-445e-933b-84357a60c881 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec98ff0c96a348cdbb28f75575750cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf5c80544ad4a58a38c6af33a9d191c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:00:41.870008 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-924f14c3-1e0b-445e-933b-84357a60c881 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] 10.222.0.50 "GET /compute/v2.1/servers/eaea86c8-028c-4254-a992-5f7c9d06f5fc" status: 200 len: 1335 microversion: 2.57 time: 0.686306 Aug 10 18:00:41.870567 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 983/1944] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 18:00:41 2022] GET /compute/v2.1/servers/eaea86c8-028c-4254-a992-5f7c9d06f5fc => generated 1335 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 18:00:42.919391 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-27a411d7-9238-464d-9865-8691353f6875 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:00:42.920030 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-27a411d7-9238-464d-9865-8691353f6875 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] [instance: eaea86c8-028c-4254-a992-5f7c9d06f5fc] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:00:42.943221 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_api:SELECT=41 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 18:00:42.945243 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-27a411d7-9238-464d-9865-8691353f6875 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:00:42.947578 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-27a411d7-9238-464d-9865-8691353f6875 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:00:42.950666 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-27a411d7-9238-464d-9865-8691353f6875 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:00:42.951743 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-27a411d7-9238-464d-9865-8691353f6875 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:00:42.953557 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-27a411d7-9238-464d-9865-8691353f6875 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:00:42.955299 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-27a411d7-9238-464d-9865-8691353f6875 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:00:43.295950 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-27a411d7-9238-464d-9865-8691353f6875 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec98ff0c96a348cdbb28f75575750cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf5c80544ad4a58a38c6af33a9d191c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:00:43.308122 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-27a411d7-9238-464d-9865-8691353f6875 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec98ff0c96a348cdbb28f75575750cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf5c80544ad4a58a38c6af33a9d191c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:00:43.311762 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-27a411d7-9238-464d-9865-8691353f6875 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec98ff0c96a348cdbb28f75575750cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf5c80544ad4a58a38c6af33a9d191c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:00:43.313691 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-27a411d7-9238-464d-9865-8691353f6875 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] 10.222.0.50 "GET /compute/v2.1/servers/eaea86c8-028c-4254-a992-5f7c9d06f5fc" status: 200 len: 1335 microversion: 2.57 time: 0.405836 Aug 10 18:00:43.314457 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 962/1945] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 18:00:42 2022] GET /compute/v2.1/servers/eaea86c8-028c-4254-a992-5f7c9d06f5fc => generated 1335 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 18:00:44.339547 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-c9224eff-230e-49ba-a3db-051483d8862d tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:00:44.341195 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-c9224eff-230e-49ba-a3db-051483d8862d tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] [instance: eaea86c8-028c-4254-a992-5f7c9d06f5fc] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:00:44.365922 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c9224eff-230e-49ba-a3db-051483d8862d tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:00:44.365922 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c9224eff-230e-49ba-a3db-051483d8862d tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:00:44.369502 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c9224eff-230e-49ba-a3db-051483d8862d tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:00:44.370428 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c9224eff-230e-49ba-a3db-051483d8862d tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:00:44.370850 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c9224eff-230e-49ba-a3db-051483d8862d tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:00:44.371361 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c9224eff-230e-49ba-a3db-051483d8862d tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:00:44.556850 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-c9224eff-230e-49ba-a3db-051483d8862d tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec98ff0c96a348cdbb28f75575750cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf5c80544ad4a58a38c6af33a9d191c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:00:44.560679 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_cell0:SELECT=2 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 18:00:44.572201 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-c9224eff-230e-49ba-a3db-051483d8862d tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec98ff0c96a348cdbb28f75575750cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf5c80544ad4a58a38c6af33a9d191c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:00:44.582991 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-c9224eff-230e-49ba-a3db-051483d8862d tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec98ff0c96a348cdbb28f75575750cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf5c80544ad4a58a38c6af33a9d191c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:00:44.584379 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-c9224eff-230e-49ba-a3db-051483d8862d tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] 10.222.0.50 "GET /compute/v2.1/servers/eaea86c8-028c-4254-a992-5f7c9d06f5fc" status: 200 len: 1335 microversion: 2.57 time: 0.250127 Aug 10 18:00:44.585597 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 984/1946] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 18:00:44 2022] GET /compute/v2.1/servers/eaea86c8-028c-4254-a992-5f7c9d06f5fc => generated 1335 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 18:00:45.614416 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-43cdecfa-5f19-4fa3-9963-819e27bdbb11 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:00:45.615208 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-43cdecfa-5f19-4fa3-9963-819e27bdbb11 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] [instance: eaea86c8-028c-4254-a992-5f7c9d06f5fc] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:00:45.640612 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-43cdecfa-5f19-4fa3-9963-819e27bdbb11 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:00:45.645974 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-43cdecfa-5f19-4fa3-9963-819e27bdbb11 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:00:45.651007 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-43cdecfa-5f19-4fa3-9963-819e27bdbb11 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:00:45.652194 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-43cdecfa-5f19-4fa3-9963-819e27bdbb11 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:00:45.659692 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-43cdecfa-5f19-4fa3-9963-819e27bdbb11 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:00:45.661456 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-43cdecfa-5f19-4fa3-9963-819e27bdbb11 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:00:46.001206 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-43cdecfa-5f19-4fa3-9963-819e27bdbb11 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec98ff0c96a348cdbb28f75575750cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf5c80544ad4a58a38c6af33a9d191c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:00:46.042115 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-43cdecfa-5f19-4fa3-9963-819e27bdbb11 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec98ff0c96a348cdbb28f75575750cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf5c80544ad4a58a38c6af33a9d191c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:00:46.050799 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-43cdecfa-5f19-4fa3-9963-819e27bdbb11 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec98ff0c96a348cdbb28f75575750cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf5c80544ad4a58a38c6af33a9d191c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:00:46.057178 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-43cdecfa-5f19-4fa3-9963-819e27bdbb11 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] 10.222.0.50 "GET /compute/v2.1/servers/eaea86c8-028c-4254-a992-5f7c9d06f5fc" status: 200 len: 1356 microversion: 2.57 time: 0.446063 Aug 10 18:00:46.059768 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 963/1947] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 18:00:45 2022] GET /compute/v2.1/servers/eaea86c8-028c-4254-a992-5f7c9d06f5fc => generated 1356 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 18:00:46.084907 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-a5f57a03-10ae-4d32-9c78-2368bee3b139 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f"}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 18:00:46.093592 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-a5f57a03-10ae-4d32-9c78-2368bee3b139 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] [instance: eaea86c8-028c-4254-a992-5f7c9d06f5fc] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:00:46.109530 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a5f57a03-10ae-4d32-9c78-2368bee3b139 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:00:46.110615 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a5f57a03-10ae-4d32-9c78-2368bee3b139 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:00:46.113353 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a5f57a03-10ae-4d32-9c78-2368bee3b139 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:00:46.114280 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a5f57a03-10ae-4d32-9c78-2368bee3b139 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:00:46.114907 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a5f57a03-10ae-4d32-9c78-2368bee3b139 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:00:46.118632 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a5f57a03-10ae-4d32-9c78-2368bee3b139 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:00:46.169834 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_cell0:SELECT=8 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 18:00:46.266498 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.virt.hardware [None req-a5f57a03-10ae-4d32-9c78-2368bee3b139 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Flavor limits 0:0:0 {{(pid=129409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 18:00:46.267222 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.virt.hardware [None req-a5f57a03-10ae-4d32-9c78-2368bee3b139 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Image limits 0:0:0 {{(pid=129409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 18:00:46.267926 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.virt.hardware [None req-a5f57a03-10ae-4d32-9c78-2368bee3b139 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Flavor pref 0:0:0 {{(pid=129409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 18:00:46.268685 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.virt.hardware [None req-a5f57a03-10ae-4d32-9c78-2368bee3b139 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Image pref 0:0:0 {{(pid=129409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 18:00:46.269342 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.virt.hardware [None req-a5f57a03-10ae-4d32-9c78-2368bee3b139 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 18:00:46.686742 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-a5f57a03-10ae-4d32-9c78-2368bee3b139 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] [instance: eaea86c8-028c-4254-a992-5f7c9d06f5fc] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:00:46.706448 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a5f57a03-10ae-4d32-9c78-2368bee3b139 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:00:46.707466 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a5f57a03-10ae-4d32-9c78-2368bee3b139 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:00:46.708048 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a5f57a03-10ae-4d32-9c78-2368bee3b139 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:00:46.709389 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a5f57a03-10ae-4d32-9c78-2368bee3b139 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:00:46.710293 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a5f57a03-10ae-4d32-9c78-2368bee3b139 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:00:46.711519 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a5f57a03-10ae-4d32-9c78-2368bee3b139 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:00:46.780522 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-a5f57a03-10ae-4d32-9c78-2368bee3b139 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] 10.222.0.50 "POST /compute/v2.1/servers/eaea86c8-028c-4254-a992-5f7c9d06f5fc/action" status: 202 len: 1137 microversion: 2.57 time: 0.701214 Aug 10 18:00:46.781736 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 985/1948] 10.222.0.50 () {62 vars in 1320 bytes} [Wed Aug 10 18:00:46 2022] POST /compute/v2.1/servers/eaea86c8-028c-4254-a992-5f7c9d06f5fc/action => generated 1137 bytes in 703 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 10 18:00:46.831295 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-dd584e08-ee71-45b1-95c4-2eba7481e2b5 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:00:46.839103 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-dd584e08-ee71-45b1-95c4-2eba7481e2b5 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] [instance: eaea86c8-028c-4254-a992-5f7c9d06f5fc] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:00:46.840618 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-dd584e08-ee71-45b1-95c4-2eba7481e2b5 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:00:46.841245 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-dd584e08-ee71-45b1-95c4-2eba7481e2b5 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:00:46.841785 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-dd584e08-ee71-45b1-95c4-2eba7481e2b5 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:00:46.842600 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-dd584e08-ee71-45b1-95c4-2eba7481e2b5 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:00:46.843159 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-dd584e08-ee71-45b1-95c4-2eba7481e2b5 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:00:46.843688 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-dd584e08-ee71-45b1-95c4-2eba7481e2b5 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:00:47.507053 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-dd584e08-ee71-45b1-95c4-2eba7481e2b5 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec98ff0c96a348cdbb28f75575750cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf5c80544ad4a58a38c6af33a9d191c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:00:47.603438 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-dd584e08-ee71-45b1-95c4-2eba7481e2b5 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec98ff0c96a348cdbb28f75575750cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf5c80544ad4a58a38c6af33a9d191c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:00:47.618323 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-dd584e08-ee71-45b1-95c4-2eba7481e2b5 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec98ff0c96a348cdbb28f75575750cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf5c80544ad4a58a38c6af33a9d191c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:00:47.630163 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-dd584e08-ee71-45b1-95c4-2eba7481e2b5 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] 10.222.0.50 "GET /compute/v2.1/servers/eaea86c8-028c-4254-a992-5f7c9d06f5fc" status: 200 len: 1365 microversion: 2.57 time: 0.821615 Aug 10 18:00:47.633221 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 964/1949] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 18:00:46 2022] GET /compute/v2.1/servers/eaea86c8-028c-4254-a992-5f7c9d06f5fc => generated 1365 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 18:00:48.657002 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-e1803b52-bdcf-4e2f-957b-d0d43545305f tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:00:48.657627 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-e1803b52-bdcf-4e2f-957b-d0d43545305f tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] [instance: eaea86c8-028c-4254-a992-5f7c9d06f5fc] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:00:48.675527 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e1803b52-bdcf-4e2f-957b-d0d43545305f tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:00:48.678258 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e1803b52-bdcf-4e2f-957b-d0d43545305f tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:00:48.679008 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e1803b52-bdcf-4e2f-957b-d0d43545305f tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:00:48.686100 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e1803b52-bdcf-4e2f-957b-d0d43545305f tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:00:48.686644 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e1803b52-bdcf-4e2f-957b-d0d43545305f tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:00:48.687019 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e1803b52-bdcf-4e2f-957b-d0d43545305f tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:00:49.058814 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-e1803b52-bdcf-4e2f-957b-d0d43545305f tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec98ff0c96a348cdbb28f75575750cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf5c80544ad4a58a38c6af33a9d191c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:00:49.080468 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-e1803b52-bdcf-4e2f-957b-d0d43545305f tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec98ff0c96a348cdbb28f75575750cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf5c80544ad4a58a38c6af33a9d191c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:00:49.085035 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-e1803b52-bdcf-4e2f-957b-d0d43545305f tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec98ff0c96a348cdbb28f75575750cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf5c80544ad4a58a38c6af33a9d191c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:00:49.092914 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-e1803b52-bdcf-4e2f-957b-d0d43545305f tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] 10.222.0.50 "GET /compute/v2.1/servers/eaea86c8-028c-4254-a992-5f7c9d06f5fc" status: 200 len: 1365 microversion: 2.57 time: 0.436397 Aug 10 18:00:49.094889 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 986/1950] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 18:00:48 2022] GET /compute/v2.1/servers/eaea86c8-028c-4254-a992-5f7c9d06f5fc => generated 1365 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 18:00:50.126337 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-c215b37e-8120-4585-8033-e2eddb692ccf tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:00:50.130947 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-c215b37e-8120-4585-8033-e2eddb692ccf tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] [instance: eaea86c8-028c-4254-a992-5f7c9d06f5fc] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:00:50.163302 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_cell0:SELECT=4 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 18:00:50.174822 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-c215b37e-8120-4585-8033-e2eddb692ccf tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:00:50.175974 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-c215b37e-8120-4585-8033-e2eddb692ccf tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:00:50.176789 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-c215b37e-8120-4585-8033-e2eddb692ccf tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:00:50.183043 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-c215b37e-8120-4585-8033-e2eddb692ccf tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:00:50.184910 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-c215b37e-8120-4585-8033-e2eddb692ccf tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:00:50.187589 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-c215b37e-8120-4585-8033-e2eddb692ccf tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:00:50.887729 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-c215b37e-8120-4585-8033-e2eddb692ccf tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec98ff0c96a348cdbb28f75575750cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf5c80544ad4a58a38c6af33a9d191c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:00:50.903431 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-c215b37e-8120-4585-8033-e2eddb692ccf tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec98ff0c96a348cdbb28f75575750cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf5c80544ad4a58a38c6af33a9d191c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:00:50.909175 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-c215b37e-8120-4585-8033-e2eddb692ccf tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec98ff0c96a348cdbb28f75575750cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf5c80544ad4a58a38c6af33a9d191c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:00:50.914074 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-c215b37e-8120-4585-8033-e2eddb692ccf tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] 10.222.0.50 "GET /compute/v2.1/servers/eaea86c8-028c-4254-a992-5f7c9d06f5fc" status: 200 len: 1365 microversion: 2.57 time: 0.797758 Aug 10 18:00:50.916408 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 965/1951] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 18:00:50 2022] GET /compute/v2.1/servers/eaea86c8-028c-4254-a992-5f7c9d06f5fc => generated 1365 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 18:00:51.939166 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-4b298100-17e3-4a03-9908-d5954c745df8 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:00:51.939949 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-4b298100-17e3-4a03-9908-d5954c745df8 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] [instance: eaea86c8-028c-4254-a992-5f7c9d06f5fc] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:00:51.949756 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-4b298100-17e3-4a03-9908-d5954c745df8 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:00:51.953228 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-4b298100-17e3-4a03-9908-d5954c745df8 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:00:51.954222 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-4b298100-17e3-4a03-9908-d5954c745df8 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:00:51.955915 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-4b298100-17e3-4a03-9908-d5954c745df8 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:00:51.956486 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-4b298100-17e3-4a03-9908-d5954c745df8 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:00:51.961889 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-4b298100-17e3-4a03-9908-d5954c745df8 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:00:52.145726 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-4b298100-17e3-4a03-9908-d5954c745df8 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec98ff0c96a348cdbb28f75575750cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf5c80544ad4a58a38c6af33a9d191c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:00:52.154345 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-4b298100-17e3-4a03-9908-d5954c745df8 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec98ff0c96a348cdbb28f75575750cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf5c80544ad4a58a38c6af33a9d191c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:00:52.158633 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-4b298100-17e3-4a03-9908-d5954c745df8 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec98ff0c96a348cdbb28f75575750cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf5c80544ad4a58a38c6af33a9d191c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:00:52.159873 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-4b298100-17e3-4a03-9908-d5954c745df8 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] 10.222.0.50 "GET /compute/v2.1/servers/eaea86c8-028c-4254-a992-5f7c9d06f5fc" status: 200 len: 1365 microversion: 2.57 time: 0.224818 Aug 10 18:00:52.160462 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 987/1952] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 18:00:51 2022] GET /compute/v2.1/servers/eaea86c8-028c-4254-a992-5f7c9d06f5fc => generated 1365 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 18:00:53.187902 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-fc085721-356c-409c-aad9-bc6edf9dfd14 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:00:53.189223 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-fc085721-356c-409c-aad9-bc6edf9dfd14 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] [instance: eaea86c8-028c-4254-a992-5f7c9d06f5fc] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:00:53.218965 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-fc085721-356c-409c-aad9-bc6edf9dfd14 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:00:53.224018 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-fc085721-356c-409c-aad9-bc6edf9dfd14 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:00:53.224669 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-fc085721-356c-409c-aad9-bc6edf9dfd14 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:00:53.227972 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-fc085721-356c-409c-aad9-bc6edf9dfd14 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:00:53.237861 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-fc085721-356c-409c-aad9-bc6edf9dfd14 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:00:53.239529 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-fc085721-356c-409c-aad9-bc6edf9dfd14 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:00:53.424628 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-fc085721-356c-409c-aad9-bc6edf9dfd14 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec98ff0c96a348cdbb28f75575750cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf5c80544ad4a58a38c6af33a9d191c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:00:53.460533 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-fc085721-356c-409c-aad9-bc6edf9dfd14 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec98ff0c96a348cdbb28f75575750cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf5c80544ad4a58a38c6af33a9d191c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:00:53.466682 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-fc085721-356c-409c-aad9-bc6edf9dfd14 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec98ff0c96a348cdbb28f75575750cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf5c80544ad4a58a38c6af33a9d191c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:00:53.469786 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-fc085721-356c-409c-aad9-bc6edf9dfd14 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] 10.222.0.50 "GET /compute/v2.1/servers/eaea86c8-028c-4254-a992-5f7c9d06f5fc" status: 200 len: 1365 microversion: 2.57 time: 0.286587 Aug 10 18:00:53.472622 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 966/1953] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 18:00:53 2022] GET /compute/v2.1/servers/eaea86c8-028c-4254-a992-5f7c9d06f5fc => generated 1365 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 18:00:54.503469 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-58aa8fc1-8bb4-402e-b7b0-a6ca1e5445fb tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:00:54.505431 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-58aa8fc1-8bb4-402e-b7b0-a6ca1e5445fb tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] [instance: eaea86c8-028c-4254-a992-5f7c9d06f5fc] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:00:54.519922 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-58aa8fc1-8bb4-402e-b7b0-a6ca1e5445fb tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:00:54.527509 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-58aa8fc1-8bb4-402e-b7b0-a6ca1e5445fb tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:00:54.528309 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-58aa8fc1-8bb4-402e-b7b0-a6ca1e5445fb tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:00:54.534803 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-58aa8fc1-8bb4-402e-b7b0-a6ca1e5445fb tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:00:54.535683 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-58aa8fc1-8bb4-402e-b7b0-a6ca1e5445fb tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:00:54.536779 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-58aa8fc1-8bb4-402e-b7b0-a6ca1e5445fb tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:00:54.862468 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-58aa8fc1-8bb4-402e-b7b0-a6ca1e5445fb tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec98ff0c96a348cdbb28f75575750cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf5c80544ad4a58a38c6af33a9d191c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:00:54.875865 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-58aa8fc1-8bb4-402e-b7b0-a6ca1e5445fb tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec98ff0c96a348cdbb28f75575750cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf5c80544ad4a58a38c6af33a9d191c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:00:54.886088 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-58aa8fc1-8bb4-402e-b7b0-a6ca1e5445fb tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec98ff0c96a348cdbb28f75575750cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf5c80544ad4a58a38c6af33a9d191c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:00:54.901287 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-58aa8fc1-8bb4-402e-b7b0-a6ca1e5445fb tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] 10.222.0.50 "GET /compute/v2.1/servers/eaea86c8-028c-4254-a992-5f7c9d06f5fc" status: 200 len: 1365 microversion: 2.57 time: 0.400706 Aug 10 18:00:54.904070 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 988/1954] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 18:00:54 2022] GET /compute/v2.1/servers/eaea86c8-028c-4254-a992-5f7c9d06f5fc => generated 1365 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 18:00:55.928539 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-84886961-473b-4789-8750-87bfc2abade9 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:00:55.933690 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-84886961-473b-4789-8750-87bfc2abade9 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] [instance: eaea86c8-028c-4254-a992-5f7c9d06f5fc] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:00:55.944577 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-84886961-473b-4789-8750-87bfc2abade9 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:00:55.946944 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-84886961-473b-4789-8750-87bfc2abade9 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:00:55.947921 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-84886961-473b-4789-8750-87bfc2abade9 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:00:55.951348 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-84886961-473b-4789-8750-87bfc2abade9 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:00:55.952521 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-84886961-473b-4789-8750-87bfc2abade9 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:00:55.953578 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-84886961-473b-4789-8750-87bfc2abade9 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:00:56.991556 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-84886961-473b-4789-8750-87bfc2abade9 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec98ff0c96a348cdbb28f75575750cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf5c80544ad4a58a38c6af33a9d191c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:00:57.009965 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-84886961-473b-4789-8750-87bfc2abade9 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec98ff0c96a348cdbb28f75575750cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf5c80544ad4a58a38c6af33a9d191c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:00:57.018088 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-84886961-473b-4789-8750-87bfc2abade9 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec98ff0c96a348cdbb28f75575750cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf5c80544ad4a58a38c6af33a9d191c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:00:57.019953 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-84886961-473b-4789-8750-87bfc2abade9 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] 10.222.0.50 "GET /compute/v2.1/servers/eaea86c8-028c-4254-a992-5f7c9d06f5fc" status: 200 len: 1365 microversion: 2.57 time: 1.097121 Aug 10 18:00:57.023217 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 967/1955] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 18:00:55 2022] GET /compute/v2.1/servers/eaea86c8-028c-4254-a992-5f7c9d06f5fc => generated 1365 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 18:00:58.054800 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-28eb686a-f9a8-47aa-bd6e-d76d7e4c6c54 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:00:58.056212 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-28eb686a-f9a8-47aa-bd6e-d76d7e4c6c54 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] [instance: eaea86c8-028c-4254-a992-5f7c9d06f5fc] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:00:58.064323 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-28eb686a-f9a8-47aa-bd6e-d76d7e4c6c54 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:00:58.070572 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-28eb686a-f9a8-47aa-bd6e-d76d7e4c6c54 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:00:58.071410 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-28eb686a-f9a8-47aa-bd6e-d76d7e4c6c54 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:00:58.072621 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-28eb686a-f9a8-47aa-bd6e-d76d7e4c6c54 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:00:58.073543 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-28eb686a-f9a8-47aa-bd6e-d76d7e4c6c54 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:00:58.074202 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-28eb686a-f9a8-47aa-bd6e-d76d7e4c6c54 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:00:58.216226 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-28eb686a-f9a8-47aa-bd6e-d76d7e4c6c54 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec98ff0c96a348cdbb28f75575750cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf5c80544ad4a58a38c6af33a9d191c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:00:58.232717 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-28eb686a-f9a8-47aa-bd6e-d76d7e4c6c54 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec98ff0c96a348cdbb28f75575750cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf5c80544ad4a58a38c6af33a9d191c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:00:58.255414 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-28eb686a-f9a8-47aa-bd6e-d76d7e4c6c54 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec98ff0c96a348cdbb28f75575750cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf5c80544ad4a58a38c6af33a9d191c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:00:58.275849 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-28eb686a-f9a8-47aa-bd6e-d76d7e4c6c54 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] 10.222.0.50 "GET /compute/v2.1/servers/eaea86c8-028c-4254-a992-5f7c9d06f5fc" status: 200 len: 1365 microversion: 2.57 time: 0.228698 Aug 10 18:00:58.292926 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 989/1956] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 18:00:58 2022] GET /compute/v2.1/servers/eaea86c8-028c-4254-a992-5f7c9d06f5fc => generated 1365 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 18:00:59.307959 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-4bb13517-e782-47a1-9971-a8c7be6a606b tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:00:59.309356 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-4bb13517-e782-47a1-9971-a8c7be6a606b tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] [instance: eaea86c8-028c-4254-a992-5f7c9d06f5fc] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:00:59.326868 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-4bb13517-e782-47a1-9971-a8c7be6a606b tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:00:59.327608 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-4bb13517-e782-47a1-9971-a8c7be6a606b tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:00:59.328806 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-4bb13517-e782-47a1-9971-a8c7be6a606b tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:00:59.357127 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-4bb13517-e782-47a1-9971-a8c7be6a606b tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:00:59.357127 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-4bb13517-e782-47a1-9971-a8c7be6a606b tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:00:59.357127 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-4bb13517-e782-47a1-9971-a8c7be6a606b tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:00:59.542501 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-4bb13517-e782-47a1-9971-a8c7be6a606b tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec98ff0c96a348cdbb28f75575750cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf5c80544ad4a58a38c6af33a9d191c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:00:59.566541 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-4bb13517-e782-47a1-9971-a8c7be6a606b tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec98ff0c96a348cdbb28f75575750cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf5c80544ad4a58a38c6af33a9d191c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:00:59.593095 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-4bb13517-e782-47a1-9971-a8c7be6a606b tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec98ff0c96a348cdbb28f75575750cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf5c80544ad4a58a38c6af33a9d191c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:00:59.596736 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-4bb13517-e782-47a1-9971-a8c7be6a606b tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] 10.222.0.50 "GET /compute/v2.1/servers/eaea86c8-028c-4254-a992-5f7c9d06f5fc" status: 200 len: 1365 microversion: 2.57 time: 0.293412 Aug 10 18:00:59.602061 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 968/1957] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 18:00:59 2022] GET /compute/v2.1/servers/eaea86c8-028c-4254-a992-5f7c9d06f5fc => generated 1365 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 18:01:00.625058 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-5c58ac64-ee32-4d22-bb81-8b050f52760e tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:01:00.630941 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-5c58ac64-ee32-4d22-bb81-8b050f52760e tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] [instance: eaea86c8-028c-4254-a992-5f7c9d06f5fc] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:01:00.640270 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-5c58ac64-ee32-4d22-bb81-8b050f52760e tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:01:00.640882 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-5c58ac64-ee32-4d22-bb81-8b050f52760e tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:01:00.642397 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-5c58ac64-ee32-4d22-bb81-8b050f52760e tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:01:00.644574 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-5c58ac64-ee32-4d22-bb81-8b050f52760e tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:01:00.648891 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-5c58ac64-ee32-4d22-bb81-8b050f52760e tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:01:00.649510 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-5c58ac64-ee32-4d22-bb81-8b050f52760e tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:01:01.367189 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-5c58ac64-ee32-4d22-bb81-8b050f52760e tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec98ff0c96a348cdbb28f75575750cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf5c80544ad4a58a38c6af33a9d191c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:01:01.388349 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-5c58ac64-ee32-4d22-bb81-8b050f52760e tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec98ff0c96a348cdbb28f75575750cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf5c80544ad4a58a38c6af33a9d191c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:01:01.396266 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-5c58ac64-ee32-4d22-bb81-8b050f52760e tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec98ff0c96a348cdbb28f75575750cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf5c80544ad4a58a38c6af33a9d191c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:01:01.399633 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-5c58ac64-ee32-4d22-bb81-8b050f52760e tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] 10.222.0.50 "GET /compute/v2.1/servers/eaea86c8-028c-4254-a992-5f7c9d06f5fc" status: 200 len: 1365 microversion: 2.57 time: 0.779203 Aug 10 18:01:01.404014 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 990/1958] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 18:01:00 2022] GET /compute/v2.1/servers/eaea86c8-028c-4254-a992-5f7c9d06f5fc => generated 1365 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 18:01:02.427421 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-3c7b5a07-c3d6-48c9-b521-b6f7c42a4ff5 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:01:02.428035 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-3c7b5a07-c3d6-48c9-b521-b6f7c42a4ff5 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] [instance: eaea86c8-028c-4254-a992-5f7c9d06f5fc] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:01:02.441641 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-3c7b5a07-c3d6-48c9-b521-b6f7c42a4ff5 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:01:02.442366 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-3c7b5a07-c3d6-48c9-b521-b6f7c42a4ff5 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:01:02.442994 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-3c7b5a07-c3d6-48c9-b521-b6f7c42a4ff5 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:01:02.443884 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-3c7b5a07-c3d6-48c9-b521-b6f7c42a4ff5 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:01:02.449513 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-3c7b5a07-c3d6-48c9-b521-b6f7c42a4ff5 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:01:02.451873 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-3c7b5a07-c3d6-48c9-b521-b6f7c42a4ff5 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:01:02.610274 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-3c7b5a07-c3d6-48c9-b521-b6f7c42a4ff5 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec98ff0c96a348cdbb28f75575750cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf5c80544ad4a58a38c6af33a9d191c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:01:02.625753 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-3c7b5a07-c3d6-48c9-b521-b6f7c42a4ff5 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec98ff0c96a348cdbb28f75575750cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf5c80544ad4a58a38c6af33a9d191c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:01:02.628051 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-3c7b5a07-c3d6-48c9-b521-b6f7c42a4ff5 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec98ff0c96a348cdbb28f75575750cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf5c80544ad4a58a38c6af33a9d191c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:01:02.630011 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-3c7b5a07-c3d6-48c9-b521-b6f7c42a4ff5 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] 10.222.0.50 "GET /compute/v2.1/servers/eaea86c8-028c-4254-a992-5f7c9d06f5fc" status: 200 len: 1365 microversion: 2.57 time: 0.206406 Aug 10 18:01:02.634854 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 969/1959] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 18:01:02 2022] GET /compute/v2.1/servers/eaea86c8-028c-4254-a992-5f7c9d06f5fc => generated 1365 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 18:01:03.659884 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-042d10ae-1660-455a-8074-4ae76eac2efc tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:01:03.661177 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-042d10ae-1660-455a-8074-4ae76eac2efc tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] [instance: eaea86c8-028c-4254-a992-5f7c9d06f5fc] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:01:03.669425 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-042d10ae-1660-455a-8074-4ae76eac2efc tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:01:03.670129 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-042d10ae-1660-455a-8074-4ae76eac2efc tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:01:03.670576 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-042d10ae-1660-455a-8074-4ae76eac2efc tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:01:03.671325 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-042d10ae-1660-455a-8074-4ae76eac2efc tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:01:03.671757 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-042d10ae-1660-455a-8074-4ae76eac2efc tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:01:03.672185 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-042d10ae-1660-455a-8074-4ae76eac2efc tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:01:03.675250 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 18:01:03.761623 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-042d10ae-1660-455a-8074-4ae76eac2efc tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec98ff0c96a348cdbb28f75575750cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf5c80544ad4a58a38c6af33a9d191c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:01:03.780222 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-042d10ae-1660-455a-8074-4ae76eac2efc tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec98ff0c96a348cdbb28f75575750cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf5c80544ad4a58a38c6af33a9d191c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:01:03.787318 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-042d10ae-1660-455a-8074-4ae76eac2efc tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec98ff0c96a348cdbb28f75575750cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf5c80544ad4a58a38c6af33a9d191c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:01:03.791615 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-042d10ae-1660-455a-8074-4ae76eac2efc tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] 10.222.0.50 "GET /compute/v2.1/servers/eaea86c8-028c-4254-a992-5f7c9d06f5fc" status: 200 len: 1365 microversion: 2.57 time: 0.136543 Aug 10 18:01:03.813583 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 991/1960] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 18:01:03 2022] GET /compute/v2.1/servers/eaea86c8-028c-4254-a992-5f7c9d06f5fc => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 18:01:04.822951 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-693188d0-dbbd-4b93-b53b-bbf1bd95ffc8 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:01:04.823760 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-693188d0-dbbd-4b93-b53b-bbf1bd95ffc8 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] [instance: eaea86c8-028c-4254-a992-5f7c9d06f5fc] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:01:04.830282 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-693188d0-dbbd-4b93-b53b-bbf1bd95ffc8 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:01:04.840484 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-693188d0-dbbd-4b93-b53b-bbf1bd95ffc8 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:01:04.843451 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-693188d0-dbbd-4b93-b53b-bbf1bd95ffc8 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:01:04.847409 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-693188d0-dbbd-4b93-b53b-bbf1bd95ffc8 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:01:04.850015 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-693188d0-dbbd-4b93-b53b-bbf1bd95ffc8 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:01:04.854485 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-693188d0-dbbd-4b93-b53b-bbf1bd95ffc8 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:01:05.043285 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-693188d0-dbbd-4b93-b53b-bbf1bd95ffc8 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec98ff0c96a348cdbb28f75575750cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf5c80544ad4a58a38c6af33a9d191c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:01:05.055636 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-693188d0-dbbd-4b93-b53b-bbf1bd95ffc8 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec98ff0c96a348cdbb28f75575750cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf5c80544ad4a58a38c6af33a9d191c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:01:05.058284 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-693188d0-dbbd-4b93-b53b-bbf1bd95ffc8 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec98ff0c96a348cdbb28f75575750cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf5c80544ad4a58a38c6af33a9d191c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:01:05.059986 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-693188d0-dbbd-4b93-b53b-bbf1bd95ffc8 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] 10.222.0.50 "GET /compute/v2.1/servers/eaea86c8-028c-4254-a992-5f7c9d06f5fc" status: 200 len: 1365 microversion: 2.57 time: 0.244627 Aug 10 18:01:05.061154 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 970/1961] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 18:01:04 2022] GET /compute/v2.1/servers/eaea86c8-028c-4254-a992-5f7c9d06f5fc => generated 1365 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 18:01:06.087366 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-77cfcdf3-fcc0-4252-b21e-83319151765a tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:01:06.088744 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-77cfcdf3-fcc0-4252-b21e-83319151765a tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] [instance: eaea86c8-028c-4254-a992-5f7c9d06f5fc] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:01:06.099609 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-77cfcdf3-fcc0-4252-b21e-83319151765a tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:01:06.100367 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-77cfcdf3-fcc0-4252-b21e-83319151765a tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:01:06.101763 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-77cfcdf3-fcc0-4252-b21e-83319151765a tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:01:06.114513 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-77cfcdf3-fcc0-4252-b21e-83319151765a tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:01:06.114513 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-77cfcdf3-fcc0-4252-b21e-83319151765a tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:01:06.114513 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-77cfcdf3-fcc0-4252-b21e-83319151765a tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:01:06.296556 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-77cfcdf3-fcc0-4252-b21e-83319151765a tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec98ff0c96a348cdbb28f75575750cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf5c80544ad4a58a38c6af33a9d191c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:01:06.310581 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-77cfcdf3-fcc0-4252-b21e-83319151765a tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec98ff0c96a348cdbb28f75575750cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf5c80544ad4a58a38c6af33a9d191c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:01:06.312228 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-77cfcdf3-fcc0-4252-b21e-83319151765a tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec98ff0c96a348cdbb28f75575750cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf5c80544ad4a58a38c6af33a9d191c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:01:06.316051 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-77cfcdf3-fcc0-4252-b21e-83319151765a tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] 10.222.0.50 "GET /compute/v2.1/servers/eaea86c8-028c-4254-a992-5f7c9d06f5fc" status: 200 len: 1365 microversion: 2.57 time: 0.231487 Aug 10 18:01:06.316051 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 992/1962] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 18:01:06 2022] GET /compute/v2.1/servers/eaea86c8-028c-4254-a992-5f7c9d06f5fc => generated 1365 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 18:01:07.338139 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-0c1cf053-4cb6-48a1-9e2f-f656cebc13e9 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:01:07.339817 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-0c1cf053-4cb6-48a1-9e2f-f656cebc13e9 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] [instance: eaea86c8-028c-4254-a992-5f7c9d06f5fc] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:01:07.358508 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-0c1cf053-4cb6-48a1-9e2f-f656cebc13e9 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:01:07.366182 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-0c1cf053-4cb6-48a1-9e2f-f656cebc13e9 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:01:07.373380 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-0c1cf053-4cb6-48a1-9e2f-f656cebc13e9 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:01:07.374317 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-0c1cf053-4cb6-48a1-9e2f-f656cebc13e9 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:01:07.374906 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-0c1cf053-4cb6-48a1-9e2f-f656cebc13e9 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:01:07.375442 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-0c1cf053-4cb6-48a1-9e2f-f656cebc13e9 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:01:08.092208 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-0c1cf053-4cb6-48a1-9e2f-f656cebc13e9 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec98ff0c96a348cdbb28f75575750cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf5c80544ad4a58a38c6af33a9d191c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:01:08.123679 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-0c1cf053-4cb6-48a1-9e2f-f656cebc13e9 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec98ff0c96a348cdbb28f75575750cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf5c80544ad4a58a38c6af33a9d191c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:01:08.126905 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-0c1cf053-4cb6-48a1-9e2f-f656cebc13e9 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec98ff0c96a348cdbb28f75575750cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf5c80544ad4a58a38c6af33a9d191c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:01:08.128067 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-0c1cf053-4cb6-48a1-9e2f-f656cebc13e9 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] 10.222.0.50 "GET /compute/v2.1/servers/eaea86c8-028c-4254-a992-5f7c9d06f5fc" status: 200 len: 1365 microversion: 2.57 time: 0.794497 Aug 10 18:01:08.128672 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 971/1963] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 18:01:07 2022] GET /compute/v2.1/servers/eaea86c8-028c-4254-a992-5f7c9d06f5fc => generated 1365 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 18:01:09.152811 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-845f50e7-acd2-44ef-86a0-d9d5c25d8a43 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:01:09.153438 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-845f50e7-acd2-44ef-86a0-d9d5c25d8a43 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] [instance: eaea86c8-028c-4254-a992-5f7c9d06f5fc] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:01:09.155801 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 18:01:09.181286 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-845f50e7-acd2-44ef-86a0-d9d5c25d8a43 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:01:09.181803 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-845f50e7-acd2-44ef-86a0-d9d5c25d8a43 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:01:09.188878 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-845f50e7-acd2-44ef-86a0-d9d5c25d8a43 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:01:09.191097 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-845f50e7-acd2-44ef-86a0-d9d5c25d8a43 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:01:09.191949 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-845f50e7-acd2-44ef-86a0-d9d5c25d8a43 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:01:09.195016 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-845f50e7-acd2-44ef-86a0-d9d5c25d8a43 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:01:09.414589 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-845f50e7-acd2-44ef-86a0-d9d5c25d8a43 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec98ff0c96a348cdbb28f75575750cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf5c80544ad4a58a38c6af33a9d191c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:01:09.442725 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-845f50e7-acd2-44ef-86a0-d9d5c25d8a43 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec98ff0c96a348cdbb28f75575750cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf5c80544ad4a58a38c6af33a9d191c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:01:09.450207 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-845f50e7-acd2-44ef-86a0-d9d5c25d8a43 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec98ff0c96a348cdbb28f75575750cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf5c80544ad4a58a38c6af33a9d191c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:01:09.451285 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-845f50e7-acd2-44ef-86a0-d9d5c25d8a43 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] 10.222.0.50 "GET /compute/v2.1/servers/eaea86c8-028c-4254-a992-5f7c9d06f5fc" status: 200 len: 1365 microversion: 2.57 time: 0.302490 Aug 10 18:01:09.462062 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 993/1964] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 18:01:09 2022] GET /compute/v2.1/servers/eaea86c8-028c-4254-a992-5f7c9d06f5fc => generated 1365 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 18:01:10.481363 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-ee842162-3520-4d85-9c38-ebea14d6b3b7 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:01:10.482608 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-ee842162-3520-4d85-9c38-ebea14d6b3b7 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] [instance: eaea86c8-028c-4254-a992-5f7c9d06f5fc] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:01:10.494528 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-ee842162-3520-4d85-9c38-ebea14d6b3b7 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:01:10.495013 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-ee842162-3520-4d85-9c38-ebea14d6b3b7 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:01:10.495455 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-ee842162-3520-4d85-9c38-ebea14d6b3b7 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:01:10.499282 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-ee842162-3520-4d85-9c38-ebea14d6b3b7 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:01:10.499747 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-ee842162-3520-4d85-9c38-ebea14d6b3b7 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:01:10.500186 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-ee842162-3520-4d85-9c38-ebea14d6b3b7 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:01:10.821091 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-ee842162-3520-4d85-9c38-ebea14d6b3b7 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec98ff0c96a348cdbb28f75575750cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf5c80544ad4a58a38c6af33a9d191c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:01:10.836211 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-ee842162-3520-4d85-9c38-ebea14d6b3b7 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec98ff0c96a348cdbb28f75575750cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf5c80544ad4a58a38c6af33a9d191c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:01:10.849295 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-ee842162-3520-4d85-9c38-ebea14d6b3b7 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec98ff0c96a348cdbb28f75575750cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf5c80544ad4a58a38c6af33a9d191c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:01:10.850824 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-ee842162-3520-4d85-9c38-ebea14d6b3b7 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] 10.222.0.50 "GET /compute/v2.1/servers/eaea86c8-028c-4254-a992-5f7c9d06f5fc" status: 200 len: 1365 microversion: 2.57 time: 0.375712 Aug 10 18:01:10.851390 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 972/1965] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 18:01:10 2022] GET /compute/v2.1/servers/eaea86c8-028c-4254-a992-5f7c9d06f5fc => generated 1365 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 18:01:11.878183 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-80c0caf1-02d4-47d7-bb25-fa8c8689c148 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:01:11.878751 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-80c0caf1-02d4-47d7-bb25-fa8c8689c148 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] [instance: eaea86c8-028c-4254-a992-5f7c9d06f5fc] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:01:11.893295 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-80c0caf1-02d4-47d7-bb25-fa8c8689c148 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:01:11.893860 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-80c0caf1-02d4-47d7-bb25-fa8c8689c148 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:01:11.894301 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-80c0caf1-02d4-47d7-bb25-fa8c8689c148 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:01:11.901967 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-80c0caf1-02d4-47d7-bb25-fa8c8689c148 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:01:11.911209 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-80c0caf1-02d4-47d7-bb25-fa8c8689c148 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:01:11.911810 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-80c0caf1-02d4-47d7-bb25-fa8c8689c148 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:01:12.125527 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-80c0caf1-02d4-47d7-bb25-fa8c8689c148 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec98ff0c96a348cdbb28f75575750cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf5c80544ad4a58a38c6af33a9d191c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:01:12.165637 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-80c0caf1-02d4-47d7-bb25-fa8c8689c148 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec98ff0c96a348cdbb28f75575750cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf5c80544ad4a58a38c6af33a9d191c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:01:12.167833 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-80c0caf1-02d4-47d7-bb25-fa8c8689c148 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec98ff0c96a348cdbb28f75575750cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf5c80544ad4a58a38c6af33a9d191c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:01:12.175848 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-80c0caf1-02d4-47d7-bb25-fa8c8689c148 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] 10.222.0.50 "GET /compute/v2.1/servers/eaea86c8-028c-4254-a992-5f7c9d06f5fc" status: 200 len: 1365 microversion: 2.57 time: 0.300323 Aug 10 18:01:12.177966 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 994/1966] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 18:01:11 2022] GET /compute/v2.1/servers/eaea86c8-028c-4254-a992-5f7c9d06f5fc => generated 1365 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 18:01:13.206612 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-49b84173-d624-40be-a6f4-599cf6019d65 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:01:13.211229 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-49b84173-d624-40be-a6f4-599cf6019d65 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] [instance: eaea86c8-028c-4254-a992-5f7c9d06f5fc] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:01:13.223720 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-49b84173-d624-40be-a6f4-599cf6019d65 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:01:13.227254 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-49b84173-d624-40be-a6f4-599cf6019d65 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:01:13.227974 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-49b84173-d624-40be-a6f4-599cf6019d65 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:01:13.229094 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-49b84173-d624-40be-a6f4-599cf6019d65 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:01:13.231255 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-49b84173-d624-40be-a6f4-599cf6019d65 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:01:13.231921 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-49b84173-d624-40be-a6f4-599cf6019d65 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:01:13.240730 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_cell1:SELECT=72 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 18:01:13.442013 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-49b84173-d624-40be-a6f4-599cf6019d65 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec98ff0c96a348cdbb28f75575750cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf5c80544ad4a58a38c6af33a9d191c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:01:13.462648 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-49b84173-d624-40be-a6f4-599cf6019d65 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec98ff0c96a348cdbb28f75575750cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf5c80544ad4a58a38c6af33a9d191c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:01:13.465285 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-49b84173-d624-40be-a6f4-599cf6019d65 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec98ff0c96a348cdbb28f75575750cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf5c80544ad4a58a38c6af33a9d191c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:01:13.466036 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-49b84173-d624-40be-a6f4-599cf6019d65 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] 10.222.0.50 "GET /compute/v2.1/servers/eaea86c8-028c-4254-a992-5f7c9d06f5fc" status: 200 len: 1365 microversion: 2.57 time: 0.268636 Aug 10 18:01:13.467216 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 973/1967] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 18:01:13 2022] GET /compute/v2.1/servers/eaea86c8-028c-4254-a992-5f7c9d06f5fc => generated 1365 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 18:01:14.491737 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-ddde65f8-b85b-4cc4-b710-b17dac324a41 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:01:14.492502 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-ddde65f8-b85b-4cc4-b710-b17dac324a41 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] [instance: eaea86c8-028c-4254-a992-5f7c9d06f5fc] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:01:14.504939 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-ddde65f8-b85b-4cc4-b710-b17dac324a41 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:01:14.506433 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-ddde65f8-b85b-4cc4-b710-b17dac324a41 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:01:14.506433 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-ddde65f8-b85b-4cc4-b710-b17dac324a41 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:01:14.508145 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-ddde65f8-b85b-4cc4-b710-b17dac324a41 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:01:14.510189 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-ddde65f8-b85b-4cc4-b710-b17dac324a41 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:01:14.511420 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-ddde65f8-b85b-4cc4-b710-b17dac324a41 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:01:14.846967 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-ddde65f8-b85b-4cc4-b710-b17dac324a41 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec98ff0c96a348cdbb28f75575750cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf5c80544ad4a58a38c6af33a9d191c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:01:14.858177 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-ddde65f8-b85b-4cc4-b710-b17dac324a41 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec98ff0c96a348cdbb28f75575750cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf5c80544ad4a58a38c6af33a9d191c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:01:14.871674 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-ddde65f8-b85b-4cc4-b710-b17dac324a41 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec98ff0c96a348cdbb28f75575750cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf5c80544ad4a58a38c6af33a9d191c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:01:14.873756 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-ddde65f8-b85b-4cc4-b710-b17dac324a41 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] 10.222.0.50 "GET /compute/v2.1/servers/eaea86c8-028c-4254-a992-5f7c9d06f5fc" status: 200 len: 1383 microversion: 2.57 time: 0.386804 Aug 10 18:01:14.875573 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 995/1968] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 18:01:14 2022] GET /compute/v2.1/servers/eaea86c8-028c-4254-a992-5f7c9d06f5fc => generated 1383 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 18:01:15.903030 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-86332a43-6f06-49f7-a3f3-c400294d90bc tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:01:15.906877 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-86332a43-6f06-49f7-a3f3-c400294d90bc tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] [instance: eaea86c8-028c-4254-a992-5f7c9d06f5fc] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:01:15.928184 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_api:SELECT=24 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 18:01:15.931453 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-86332a43-6f06-49f7-a3f3-c400294d90bc tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:01:15.932574 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-86332a43-6f06-49f7-a3f3-c400294d90bc tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:01:15.933319 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-86332a43-6f06-49f7-a3f3-c400294d90bc tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:01:15.935233 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-86332a43-6f06-49f7-a3f3-c400294d90bc tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:01:15.936409 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-86332a43-6f06-49f7-a3f3-c400294d90bc tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:01:15.937077 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-86332a43-6f06-49f7-a3f3-c400294d90bc tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:01:16.352958 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-86332a43-6f06-49f7-a3f3-c400294d90bc tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec98ff0c96a348cdbb28f75575750cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf5c80544ad4a58a38c6af33a9d191c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:01:16.352958 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-86332a43-6f06-49f7-a3f3-c400294d90bc tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec98ff0c96a348cdbb28f75575750cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf5c80544ad4a58a38c6af33a9d191c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:01:16.359094 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-86332a43-6f06-49f7-a3f3-c400294d90bc tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec98ff0c96a348cdbb28f75575750cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf5c80544ad4a58a38c6af33a9d191c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:01:16.365552 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-86332a43-6f06-49f7-a3f3-c400294d90bc tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] 10.222.0.50 "GET /compute/v2.1/servers/eaea86c8-028c-4254-a992-5f7c9d06f5fc" status: 200 len: 1371 microversion: 2.57 time: 0.463713 Aug 10 18:01:16.366497 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 974/1969] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 18:01:15 2022] GET /compute/v2.1/servers/eaea86c8-028c-4254-a992-5f7c9d06f5fc => generated 1371 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 18:01:17.393030 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-d9d2abb9-dfa3-4db6-8fde-b92570d90cc9 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:01:17.393685 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-d9d2abb9-dfa3-4db6-8fde-b92570d90cc9 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] [instance: eaea86c8-028c-4254-a992-5f7c9d06f5fc] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:01:17.405794 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d9d2abb9-dfa3-4db6-8fde-b92570d90cc9 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:01:17.406434 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d9d2abb9-dfa3-4db6-8fde-b92570d90cc9 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:01:17.406988 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d9d2abb9-dfa3-4db6-8fde-b92570d90cc9 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:01:17.407700 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d9d2abb9-dfa3-4db6-8fde-b92570d90cc9 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:01:17.408154 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d9d2abb9-dfa3-4db6-8fde-b92570d90cc9 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:01:17.424894 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d9d2abb9-dfa3-4db6-8fde-b92570d90cc9 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:01:17.689650 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-88d3971e-b7ca-4540-b416-3e09956301c9 tempest-ServersNegativeTestMultiTenantJSON-840176460 tempest-ServersNegativeTestMultiTenantJSON-840176460-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-894060411", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "a88a6477-a2fe-495f-b334-314cd7d799aa"}]}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 18:01:17.751240 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-d9d2abb9-dfa3-4db6-8fde-b92570d90cc9 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec98ff0c96a348cdbb28f75575750cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf5c80544ad4a58a38c6af33a9d191c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:01:17.759766 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-d9d2abb9-dfa3-4db6-8fde-b92570d90cc9 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec98ff0c96a348cdbb28f75575750cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf5c80544ad4a58a38c6af33a9d191c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:01:17.761307 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-d9d2abb9-dfa3-4db6-8fde-b92570d90cc9 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec98ff0c96a348cdbb28f75575750cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf5c80544ad4a58a38c6af33a9d191c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:01:17.762505 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-d9d2abb9-dfa3-4db6-8fde-b92570d90cc9 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] 10.222.0.50 "GET /compute/v2.1/servers/eaea86c8-028c-4254-a992-5f7c9d06f5fc" status: 200 len: 1371 microversion: 2.57 time: 0.374634 Aug 10 18:01:17.773690 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 975/1970] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 18:01:17 2022] GET /compute/v2.1/servers/eaea86c8-028c-4254-a992-5f7c9d06f5fc => generated 1371 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 18:01:17.835317 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.network.neutron [None req-88d3971e-b7ca-4540-b416-3e09956301c9 tempest-ServersNegativeTestMultiTenantJSON-840176460 tempest-ServersNegativeTestMultiTenantJSON-840176460-project] validate_networks() for [('a88a6477-a2fe-495f-b334-314cd7d799aa', None, None, None, None, None)] {{(pid=129409) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 18:01:18.793042 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-8c430701-dcc3-4a3c-970d-b42a7a82bf46 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:01:18.794285 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-8c430701-dcc3-4a3c-970d-b42a7a82bf46 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] [instance: eaea86c8-028c-4254-a992-5f7c9d06f5fc] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:01:18.805243 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-8c430701-dcc3-4a3c-970d-b42a7a82bf46 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:01:18.807955 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-8c430701-dcc3-4a3c-970d-b42a7a82bf46 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:01:18.808619 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-8c430701-dcc3-4a3c-970d-b42a7a82bf46 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:01:18.811722 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-8c430701-dcc3-4a3c-970d-b42a7a82bf46 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:01:18.817865 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-8c430701-dcc3-4a3c-970d-b42a7a82bf46 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:01:18.817865 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-8c430701-dcc3-4a3c-970d-b42a7a82bf46 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:01:18.964057 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-8c430701-dcc3-4a3c-970d-b42a7a82bf46 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec98ff0c96a348cdbb28f75575750cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf5c80544ad4a58a38c6af33a9d191c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:01:18.973489 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-8c430701-dcc3-4a3c-970d-b42a7a82bf46 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec98ff0c96a348cdbb28f75575750cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf5c80544ad4a58a38c6af33a9d191c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:01:18.985768 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-8c430701-dcc3-4a3c-970d-b42a7a82bf46 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec98ff0c96a348cdbb28f75575750cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf5c80544ad4a58a38c6af33a9d191c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:01:18.987186 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-8c430701-dcc3-4a3c-970d-b42a7a82bf46 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] 10.222.0.50 "GET /compute/v2.1/servers/eaea86c8-028c-4254-a992-5f7c9d06f5fc" status: 200 len: 1371 microversion: 2.57 time: 0.198284 Aug 10 18:01:18.987809 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 976/1971] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 18:01:18 2022] GET /compute/v2.1/servers/eaea86c8-028c-4254-a992-5f7c9d06f5fc => generated 1371 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 18:01:19.343769 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [None req-88d3971e-b7ca-4540-b416-3e09956301c9 tempest-ServersNegativeTestMultiTenantJSON-840176460 tempest-ServersNegativeTestMultiTenantJSON-840176460-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-e83a1a0d-c021-4023-8c3c-842bcd2f830d) Aug 10 18:01:19.343769 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:01:19.343769 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:01:19.343769 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:01:19.343769 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:01:19.343769 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:01:19.343769 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:01:19.343769 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:01:19.343769 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:01:19.343769 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:01:19.343769 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 18:01:19.343769 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 18:01:19.343769 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 18:01:19.343769 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 18:01:19.343769 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 18:01:19.343769 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 18:01:19.343769 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 18:01:19.343769 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 18:01:19.343769 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 18:01:19.343769 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 18:01:19.343769 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 18:01:19.343769 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 18:01:19.343769 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 18:01:19.343769 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 18:01:19.343769 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 18:01:19.343769 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 18:01:19.343769 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 18:01:19.343769 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:01:19.343769 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:01:19.343769 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 18:01:19.343769 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 18:01:19.343769 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:01:19.343769 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:01:19.343769 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 18:01:19.343769 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 18:01:19.343769 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:01:19.343769 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:01:19.343769 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:01:19.343769 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:01:19.343769 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:01:19.343769 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:01:19.343769 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 18:01:19.343769 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 18:01:19.343769 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 18:01:19.343769 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 18:01:19.343769 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 18:01:19.343769 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 18:01:19.343769 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 18:01:19.343769 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 18:01:19.343769 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 18:01:19.343769 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 18:01:19.343769 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 18:01:19.352105 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 18:01:19.352105 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 18:01:19.352105 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 18:01:19.352105 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 18:01:19.352105 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 18:01:19.352105 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 18:01:19.352105 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 18:01:19.352105 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 18:01:19.352105 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 18:01:19.352105 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 18:01:19.352105 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 18:01:19.352105 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 18:01:19.352105 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 18:01:19.352105 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 18:01:19.352105 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 18:01:19.352105 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-e83a1a0d-c021-4023-8c3c-842bcd2f830d) Aug 10 18:01:19.352105 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:01:19.352105 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-88d3971e-b7ca-4540-b416-3e09956301c9 tempest-ServersNegativeTestMultiTenantJSON-840176460 tempest-ServersNegativeTestMultiTenantJSON-840176460-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:01:19.352105 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 18:01:19.352105 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-88d3971e-b7ca-4540-b416-3e09956301c9 tempest-ServersNegativeTestMultiTenantJSON-840176460 tempest-ServersNegativeTestMultiTenantJSON-840176460-project] Request method failure captured: Aug 10 18:01:19.352105 n-d-852296-2 devstack@n-api.service[129409]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 18:01:19.352105 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 18:01:19.352105 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 18:01:19.352105 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 18:01:19.352105 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 219 Aug 10 18:01:19.352105 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 18:01:19.352105 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 18:01:19.352105 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 18:01:19.352105 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 18:01:19.352105 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8_JXK3QrpXH7owE4nhjIfD2islypsCkcfm7jvn0Mmz0lguoXPv6szTWyHS3p_v_ZhpOFjXiHbV2ZCHMDHCIUHr-NOXFPjPg52A4Bhiu_MAR_kyVlZi8aW2CfrR3Z9DDABL0fv0uaijjKLxXnH6F5KB-P9QuF1cQECZ7Zh-ojoYbNppo Aug 10 18:01:19.352105 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 18:01:19.352105 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 18:01:19.352105 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 18:01:19.352105 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 18:01:19.352105 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 18:01:19.352105 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 18:01:19.352105 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: 1b99925c85a942a28e1bcc44f6e0cf77 Aug 10 18:01:19.352105 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-840176460 Aug 10 18:01:19.352105 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 18:01:19.352105 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 18:01:19.352105 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/1b99925c85a942a28e1bcc44f6e0cf77"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/1b99925c85a942a28e1bcc44f6e0cf77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/1b99925c85a942a28e1bcc44f6e0cf77"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_1b99925c85a942a28e1bcc44f6e0cf77", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 18:01:19.352105 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-840176460 Aug 10 18:01:19.352105 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: 1b99925c85a942a28e1bcc44f6e0cf77 Aug 10 18:01:19.352105 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-840176460 Aug 10 18:01:19.352105 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-ServersNegativeTestMultiTenantJSON-840176460-project Aug 10 18:01:19.352105 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 18:01:19.352105 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 18:01:19.352105 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: 52db193d98a04364aedfec14326b6215 Aug 10 18:01:19.352105 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-840176460-project Aug 10 18:01:19.352105 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 18:01:19.352105 n-d-852296-2 devstack@n-api.service[129409]: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-894060411", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "a88a6477-a2fe-495f-b334-314cd7d799aa"}]}} Aug 10 18:01:19.352105 n-d-852296-2 devstack@n-api.service[129409]: method: > Aug 10 18:01:19.352105 n-d-852296-2 devstack@n-api.service[129409]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:01:19.352105 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 18:01:19.363093 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestMultiTenantJSON-server-894060411', 'imageRef': 'a735ff26-463a-4ffe-a981-ab9d9baa494f', 'flavorRef': '452', 'networks': [{'uuid': 'a88a6477-a2fe-495f-b334-314cd7d799aa'}]}}} Aug 10 18:01:19.363093 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 18:01:19.363093 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:01:19.363093 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:01:19.363093 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:01:19.363093 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:01:19.363093 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:01:19.363093 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:01:19.363093 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:01:19.363093 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:01:19.363093 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:01:19.363093 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 18:01:19.363093 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 18:01:19.363093 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 18:01:19.363093 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 18:01:19.363093 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 18:01:19.363093 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 18:01:19.363093 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 18:01:19.363093 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 18:01:19.363093 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 18:01:19.363093 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 18:01:19.363093 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 18:01:19.363093 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 18:01:19.363093 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 18:01:19.363093 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 18:01:19.363093 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 18:01:19.363093 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 18:01:19.363093 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 18:01:19.363093 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:01:19.363093 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:01:19.363093 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 18:01:19.363093 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 18:01:19.363093 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:01:19.363093 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:01:19.363093 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 18:01:19.363093 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 18:01:19.363093 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:01:19.363093 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:01:19.363093 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:01:19.363093 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:01:19.363093 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:01:19.363093 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:01:19.363093 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 18:01:19.363093 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 18:01:19.363093 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 18:01:19.363093 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 18:01:19.363093 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 18:01:19.363093 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 18:01:19.363093 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 18:01:19.363093 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 18:01:19.363093 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 18:01:19.363093 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 18:01:19.363093 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 18:01:19.363093 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 18:01:19.363093 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 18:01:19.374826 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 18:01:19.374826 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 18:01:19.374826 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 18:01:19.374826 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 18:01:19.374826 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 18:01:19.374826 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 18:01:19.374826 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 18:01:19.374826 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 18:01:19.374826 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 18:01:19.374826 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 18:01:19.374826 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 18:01:19.374826 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 18:01:19.374826 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 18:01:19.374826 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-e83a1a0d-c021-4023-8c3c-842bcd2f830d) Aug 10 18:01:19.374826 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:01:19.374826 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:01:19.374826 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:01:19.374826 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:01:19.374826 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:01:19.374826 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:01:19.374826 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 18:01:19.374826 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 18:01:19.374826 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 10 18:01:19.374826 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 10 18:01:19.374826 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:01:19.374826 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:01:19.374826 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:01:19.374826 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:01:19.374826 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:01:19.374826 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:01:19.374826 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:01:19.374826 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:01:19.374826 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 18:01:19.374826 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 18:01:19.374826 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:01:19.374826 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:01:19.374826 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:01:19.374826 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-88d3971e-b7ca-4540-b416-3e09956301c9 tempest-ServersNegativeTestMultiTenantJSON-840176460 tempest-ServersNegativeTestMultiTenantJSON-840176460-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:01:19.374826 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 18:01:19.374826 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-88d3971e-b7ca-4540-b416-3e09956301c9 tempest-ServersNegativeTestMultiTenantJSON-840176460 tempest-ServersNegativeTestMultiTenantJSON-840176460-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 2.113071 Aug 10 18:01:19.374826 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 996/1972] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 18:01:17 2022] POST /compute/v2.1/servers => generated 214 bytes in 2125 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 10 18:01:19.549478 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-3f14bed9-c19f-4c1a-ba9e-9d3ab0cf1e29 tempest-ServerDiskConfigTestJSON-573066234 tempest-ServerDiskConfigTestJSON-573066234-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-489665614", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "309e3111-f27a-4aad-9e2b-a3db173c1413"}]}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 18:01:19.688375 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.network.neutron [None req-3f14bed9-c19f-4c1a-ba9e-9d3ab0cf1e29 tempest-ServerDiskConfigTestJSON-573066234 tempest-ServerDiskConfigTestJSON-573066234-project] validate_networks() for [('309e3111-f27a-4aad-9e2b-a3db173c1413', None, None, None, None, None)] {{(pid=129410) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 18:01:20.019424 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-ace59e6b-10b8-4c1b-a43e-b6a602627cf2 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:01:20.020122 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-ace59e6b-10b8-4c1b-a43e-b6a602627cf2 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] [instance: eaea86c8-028c-4254-a992-5f7c9d06f5fc] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:01:20.035686 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-ace59e6b-10b8-4c1b-a43e-b6a602627cf2 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:01:20.039238 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-ace59e6b-10b8-4c1b-a43e-b6a602627cf2 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:01:20.039804 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-ace59e6b-10b8-4c1b-a43e-b6a602627cf2 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:01:20.043997 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-ace59e6b-10b8-4c1b-a43e-b6a602627cf2 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:01:20.043997 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-ace59e6b-10b8-4c1b-a43e-b6a602627cf2 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:01:20.043997 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-ace59e6b-10b8-4c1b-a43e-b6a602627cf2 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:01:20.343334 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-ace59e6b-10b8-4c1b-a43e-b6a602627cf2 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec98ff0c96a348cdbb28f75575750cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf5c80544ad4a58a38c6af33a9d191c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:01:20.360113 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-ace59e6b-10b8-4c1b-a43e-b6a602627cf2 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec98ff0c96a348cdbb28f75575750cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf5c80544ad4a58a38c6af33a9d191c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:01:20.362781 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-ace59e6b-10b8-4c1b-a43e-b6a602627cf2 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec98ff0c96a348cdbb28f75575750cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf5c80544ad4a58a38c6af33a9d191c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:01:20.364299 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-ace59e6b-10b8-4c1b-a43e-b6a602627cf2 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] 10.222.0.50 "GET /compute/v2.1/servers/eaea86c8-028c-4254-a992-5f7c9d06f5fc" status: 200 len: 1356 microversion: 2.57 time: 0.354533 Aug 10 18:01:20.386309 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 997/1973] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 18:01:20 2022] GET /compute/v2.1/servers/eaea86c8-028c-4254-a992-5f7c9d06f5fc => generated 1356 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 18:01:20.402256 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-cbb0b72b-9fdd-43fd-a929-d10a37963b28 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:01:20.403097 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-cbb0b72b-9fdd-43fd-a929-d10a37963b28 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] [instance: eaea86c8-028c-4254-a992-5f7c9d06f5fc] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:01:20.415001 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-cbb0b72b-9fdd-43fd-a929-d10a37963b28 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:01:20.418463 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-cbb0b72b-9fdd-43fd-a929-d10a37963b28 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:01:20.418884 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-cbb0b72b-9fdd-43fd-a929-d10a37963b28 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:01:20.419877 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-cbb0b72b-9fdd-43fd-a929-d10a37963b28 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:01:20.420628 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-cbb0b72b-9fdd-43fd-a929-d10a37963b28 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:01:20.421671 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-cbb0b72b-9fdd-43fd-a929-d10a37963b28 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:01:20.498805 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-cbb0b72b-9fdd-43fd-a929-d10a37963b28 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] [instance: eaea86c8-028c-4254-a992-5f7c9d06f5fc] Going to try to terminate instance {{(pid=129409) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 18:01:20.969410 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [None req-3f14bed9-c19f-4c1a-ba9e-9d3ab0cf1e29 tempest-ServerDiskConfigTestJSON-573066234 tempest-ServerDiskConfigTestJSON-573066234-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-e78aee57-949c-412a-8057-bbd6c8d91ac8) Aug 10 18:01:20.969410 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:01:20.969410 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:01:20.969410 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:01:20.969410 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:01:20.969410 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:01:20.969410 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:01:20.969410 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:01:20.969410 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:01:20.969410 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:01:20.969410 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 18:01:20.969410 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 18:01:20.969410 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 18:01:20.969410 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 18:01:20.969410 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 18:01:20.969410 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 18:01:20.969410 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 18:01:20.969410 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 18:01:20.969410 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 18:01:20.969410 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 18:01:20.969410 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 18:01:20.969410 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 18:01:20.969410 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 18:01:20.969410 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 18:01:20.969410 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 18:01:20.969410 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 18:01:20.969410 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 18:01:20.969410 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:01:20.969410 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:01:20.969410 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 18:01:20.969410 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 18:01:20.969410 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:01:20.969410 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:01:20.969410 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 18:01:20.969410 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 18:01:20.969410 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:01:20.969410 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:01:20.969410 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:01:20.969410 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:01:20.969410 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:01:20.969410 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:01:20.969410 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 18:01:20.969410 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 18:01:20.969410 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 18:01:20.969410 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 18:01:20.969410 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 18:01:20.969410 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 18:01:20.969410 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 18:01:20.969410 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 18:01:20.969410 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 18:01:20.969410 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 18:01:20.969410 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 18:01:20.973242 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 18:01:20.973242 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 18:01:20.973242 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 18:01:20.973242 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 18:01:20.973242 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 18:01:20.973242 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 18:01:20.973242 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 18:01:20.973242 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 18:01:20.973242 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 18:01:20.973242 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 18:01:20.973242 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 18:01:20.973242 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 18:01:20.973242 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 18:01:20.973242 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 18:01:20.973242 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 18:01:20.973242 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-e78aee57-949c-412a-8057-bbd6c8d91ac8) Aug 10 18:01:20.973242 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:01:20.973242 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-3f14bed9-c19f-4c1a-ba9e-9d3ab0cf1e29 tempest-ServerDiskConfigTestJSON-573066234 tempest-ServerDiskConfigTestJSON-573066234-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:01:20.973242 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 18:01:20.973242 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-3f14bed9-c19f-4c1a-ba9e-9d3ab0cf1e29 tempest-ServerDiskConfigTestJSON-573066234 tempest-ServerDiskConfigTestJSON-573066234-project] Request method failure captured: Aug 10 18:01:20.973242 n-d-852296-2 devstack@n-api.service[129410]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 18:01:20.973242 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 18:01:20.973242 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 18:01:20.973242 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 18:01:20.973242 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 209 Aug 10 18:01:20.973242 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 18:01:20.973242 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 18:01:20.973242 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 18:01:20.973242 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 18:01:20.973242 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8_JuR2qZaoWnVk1dBuSVM0cQCxi_5aiNzV2W1YkGEphmaAk0CIK5feBw7ydu26BH6sYIZhU5aGkcMFzA5p7KvEn51uk54PLKPH8iFb0HJT00px0MysEBRWaVaN9tIuuOs5AeIHvFK-5HT_1e7xaFs7hNkD8v4RNTGIwkIrTsWVy5t7Q Aug 10 18:01:20.973242 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 18:01:20.973242 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 18:01:20.973242 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 18:01:20.973242 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 18:01:20.973242 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 18:01:20.973242 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 18:01:20.973242 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: 82b04b1e58584c0cb7b0669846698620 Aug 10 18:01:20.973242 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-ServerDiskConfigTestJSON-573066234 Aug 10 18:01:20.973242 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 18:01:20.973242 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 18:01:20.973242 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/82b04b1e58584c0cb7b0669846698620"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/82b04b1e58584c0cb7b0669846698620"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/82b04b1e58584c0cb7b0669846698620"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_82b04b1e58584c0cb7b0669846698620", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 18:01:20.973242 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-ServerDiskConfigTestJSON-573066234 Aug 10 18:01:20.973242 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: 82b04b1e58584c0cb7b0669846698620 Aug 10 18:01:20.973242 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-573066234 Aug 10 18:01:20.973242 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-ServerDiskConfigTestJSON-573066234-project Aug 10 18:01:20.973242 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 18:01:20.973242 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 18:01:20.973242 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: e89e037bc28748118185f13c704a798c Aug 10 18:01:20.973242 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-ServerDiskConfigTestJSON-573066234-project Aug 10 18:01:20.973242 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 18:01:20.973242 n-d-852296-2 devstack@n-api.service[129410]: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-489665614", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "309e3111-f27a-4aad-9e2b-a3db173c1413"}]}} Aug 10 18:01:20.973242 n-d-852296-2 devstack@n-api.service[129410]: method: > Aug 10 18:01:20.973242 n-d-852296-2 devstack@n-api.service[129410]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:01:20.973242 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 18:01:20.973242 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'body': {'server': {'name': 'tempest-ServerDiskConfigTestJSON-server-489665614', 'imageRef': 'a735ff26-463a-4ffe-a981-ab9d9baa494f', 'flavorRef': '452', 'networks': [{'uuid': '309e3111-f27a-4aad-9e2b-a3db173c1413'}]}}} Aug 10 18:01:20.979889 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 18:01:20.979889 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:01:20.979889 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:01:20.979889 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:01:20.979889 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:01:20.979889 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:01:20.979889 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:01:20.979889 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:01:20.979889 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:01:20.979889 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:01:20.979889 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 18:01:20.979889 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 18:01:20.979889 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 18:01:20.979889 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 18:01:20.979889 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 18:01:20.979889 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 18:01:20.979889 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 18:01:20.979889 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 18:01:20.979889 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 18:01:20.979889 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 18:01:20.979889 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 18:01:20.979889 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 18:01:20.979889 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 18:01:20.979889 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 18:01:20.979889 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 18:01:20.979889 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 18:01:20.979889 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 18:01:20.979889 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:01:20.979889 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:01:20.979889 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 18:01:20.979889 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 18:01:20.979889 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:01:20.979889 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:01:20.979889 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 18:01:20.979889 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 18:01:20.979889 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:01:20.979889 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:01:20.979889 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:01:20.979889 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:01:20.979889 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:01:20.979889 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:01:20.979889 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 18:01:20.979889 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 18:01:20.979889 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 18:01:20.979889 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 18:01:20.979889 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 18:01:20.979889 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 18:01:20.979889 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 18:01:20.979889 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 18:01:20.979889 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 18:01:20.979889 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 18:01:20.979889 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 18:01:20.979889 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 18:01:20.979889 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 18:01:20.979889 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 18:01:20.979889 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 18:01:20.994618 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 18:01:20.994618 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 18:01:20.994618 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 18:01:20.994618 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 18:01:20.994618 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 18:01:20.994618 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 18:01:20.994618 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 18:01:20.994618 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 18:01:20.994618 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 18:01:20.994618 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 18:01:20.994618 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 18:01:20.994618 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-e78aee57-949c-412a-8057-bbd6c8d91ac8) Aug 10 18:01:20.994618 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:01:20.994618 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:01:20.994618 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:01:20.994618 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:01:20.994618 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:01:20.994618 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:01:20.994618 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 18:01:20.994618 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 18:01:20.994618 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 10 18:01:20.994618 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 10 18:01:20.994618 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:01:20.994618 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:01:20.994618 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:01:20.994618 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:01:20.994618 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:01:20.994618 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:01:20.994618 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:01:20.994618 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:01:20.994618 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 18:01:20.994618 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 18:01:20.994618 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:01:20.994618 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:01:20.994618 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:01:20.994618 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-3f14bed9-c19f-4c1a-ba9e-9d3ab0cf1e29 tempest-ServerDiskConfigTestJSON-573066234 tempest-ServerDiskConfigTestJSON-573066234-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:01:20.994618 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 18:01:20.994618 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-3f14bed9-c19f-4c1a-ba9e-9d3ab0cf1e29 tempest-ServerDiskConfigTestJSON-573066234 tempest-ServerDiskConfigTestJSON-573066234-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.985633 Aug 10 18:01:20.994618 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 977/1974] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 18:01:18 2022] POST /compute/v2.1/servers => generated 214 bytes in 1988 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 10 18:01:21.087107 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-cbb0b72b-9fdd-43fd-a929-d10a37963b28 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] 10.222.0.50 "DELETE /compute/v2.1/servers/eaea86c8-028c-4254-a992-5f7c9d06f5fc" status: 204 len: 0 microversion: 2.57 time: 0.688653 Aug 10 18:01:21.087969 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 998/1975] 10.222.0.50 () {60 vars in 1280 bytes} [Wed Aug 10 18:01:20 2022] DELETE /compute/v2.1/servers/eaea86c8-028c-4254-a992-5f7c9d06f5fc => generated 0 bytes in 690 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 10 18:01:21.097694 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-59296d11-4f96-486c-9d92-0e64434bacad tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:01:21.098389 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-59296d11-4f96-486c-9d92-0e64434bacad tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] [instance: eaea86c8-028c-4254-a992-5f7c9d06f5fc] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:01:21.114233 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-59296d11-4f96-486c-9d92-0e64434bacad tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:01:21.119017 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-59296d11-4f96-486c-9d92-0e64434bacad tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:01:21.119017 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-59296d11-4f96-486c-9d92-0e64434bacad tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:01:21.119017 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-59296d11-4f96-486c-9d92-0e64434bacad tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:01:21.119017 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-59296d11-4f96-486c-9d92-0e64434bacad tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:01:21.119017 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-59296d11-4f96-486c-9d92-0e64434bacad tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:01:21.250527 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-59296d11-4f96-486c-9d92-0e64434bacad tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec98ff0c96a348cdbb28f75575750cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf5c80544ad4a58a38c6af33a9d191c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:01:21.259671 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-59296d11-4f96-486c-9d92-0e64434bacad tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec98ff0c96a348cdbb28f75575750cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf5c80544ad4a58a38c6af33a9d191c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:01:21.262023 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-59296d11-4f96-486c-9d92-0e64434bacad tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec98ff0c96a348cdbb28f75575750cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf5c80544ad4a58a38c6af33a9d191c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:01:21.263890 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-59296d11-4f96-486c-9d92-0e64434bacad tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] 10.222.0.50 "GET /compute/v2.1/servers/eaea86c8-028c-4254-a992-5f7c9d06f5fc" status: 200 len: 1362 microversion: 2.57 time: 0.172031 Aug 10 18:01:21.265061 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 978/1976] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 18:01:21 2022] GET /compute/v2.1/servers/eaea86c8-028c-4254-a992-5f7c9d06f5fc => generated 1362 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 18:01:21.707577 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-2a5b12cd-41c5-4814-b1e8-3cd211e776dc tempest-ServerDiskConfigTestJSON-573066234 tempest-ServerDiskConfigTestJSON-573066234-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-372101048", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "309e3111-f27a-4aad-9e2b-a3db173c1413"}]}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 18:01:21.809999 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.network.neutron [None req-2a5b12cd-41c5-4814-b1e8-3cd211e776dc tempest-ServerDiskConfigTestJSON-573066234 tempest-ServerDiskConfigTestJSON-573066234-project] validate_networks() for [('309e3111-f27a-4aad-9e2b-a3db173c1413', None, None, None, None, None)] {{(pid=129409) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 18:01:22.293500 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-2269c1e9-7554-458c-aa3f-4734702ba598 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:01:22.294143 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-2269c1e9-7554-458c-aa3f-4734702ba598 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] [instance: eaea86c8-028c-4254-a992-5f7c9d06f5fc] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:01:22.302082 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2269c1e9-7554-458c-aa3f-4734702ba598 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:01:22.302551 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2269c1e9-7554-458c-aa3f-4734702ba598 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:01:22.302993 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2269c1e9-7554-458c-aa3f-4734702ba598 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:01:22.306712 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2269c1e9-7554-458c-aa3f-4734702ba598 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:01:22.311535 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2269c1e9-7554-458c-aa3f-4734702ba598 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:01:22.312377 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2269c1e9-7554-458c-aa3f-4734702ba598 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:01:22.501783 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-2269c1e9-7554-458c-aa3f-4734702ba598 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec98ff0c96a348cdbb28f75575750cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf5c80544ad4a58a38c6af33a9d191c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:01:22.527104 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-2269c1e9-7554-458c-aa3f-4734702ba598 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec98ff0c96a348cdbb28f75575750cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf5c80544ad4a58a38c6af33a9d191c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:01:22.535246 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-2269c1e9-7554-458c-aa3f-4734702ba598 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec98ff0c96a348cdbb28f75575750cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf5c80544ad4a58a38c6af33a9d191c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:01:22.541882 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-2269c1e9-7554-458c-aa3f-4734702ba598 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] 10.222.0.50 "GET /compute/v2.1/servers/eaea86c8-028c-4254-a992-5f7c9d06f5fc" status: 200 len: 1362 microversion: 2.57 time: 0.252371 Aug 10 18:01:22.542527 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 979/1977] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 18:01:22 2022] GET /compute/v2.1/servers/eaea86c8-028c-4254-a992-5f7c9d06f5fc => generated 1362 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 18:01:22.657974 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [None req-2a5b12cd-41c5-4814-b1e8-3cd211e776dc tempest-ServerDiskConfigTestJSON-573066234 tempest-ServerDiskConfigTestJSON-573066234-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-9b04dfb7-79d8-4183-b5e8-b4a1c169ef4a) Aug 10 18:01:22.657974 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:01:22.657974 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:01:22.657974 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:01:22.657974 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:01:22.657974 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:01:22.657974 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:01:22.657974 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:01:22.657974 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:01:22.657974 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:01:22.657974 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 18:01:22.657974 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 18:01:22.657974 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 18:01:22.657974 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 18:01:22.657974 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 18:01:22.657974 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 18:01:22.657974 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 18:01:22.657974 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 18:01:22.657974 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 18:01:22.657974 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 18:01:22.657974 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 18:01:22.657974 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 18:01:22.657974 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 18:01:22.657974 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 18:01:22.657974 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 18:01:22.657974 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 18:01:22.657974 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 18:01:22.657974 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:01:22.657974 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:01:22.657974 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 18:01:22.657974 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 18:01:22.657974 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:01:22.657974 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:01:22.657974 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 18:01:22.657974 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 18:01:22.657974 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:01:22.657974 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:01:22.657974 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:01:22.657974 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:01:22.657974 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:01:22.657974 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:01:22.657974 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 18:01:22.657974 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 18:01:22.657974 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 18:01:22.657974 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 18:01:22.657974 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 18:01:22.657974 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 18:01:22.657974 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 18:01:22.657974 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 18:01:22.657974 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 18:01:22.657974 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 18:01:22.657974 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 18:01:22.663589 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 18:01:22.663589 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 18:01:22.663589 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 18:01:22.663589 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 18:01:22.663589 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 18:01:22.663589 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 18:01:22.663589 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 18:01:22.663589 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 18:01:22.663589 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 18:01:22.663589 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 18:01:22.663589 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 18:01:22.663589 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 18:01:22.663589 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 18:01:22.663589 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 18:01:22.663589 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 18:01:22.663589 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-9b04dfb7-79d8-4183-b5e8-b4a1c169ef4a) Aug 10 18:01:22.663589 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:01:22.663589 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-2a5b12cd-41c5-4814-b1e8-3cd211e776dc tempest-ServerDiskConfigTestJSON-573066234 tempest-ServerDiskConfigTestJSON-573066234-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:01:22.663589 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 18:01:22.663589 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-2a5b12cd-41c5-4814-b1e8-3cd211e776dc tempest-ServerDiskConfigTestJSON-573066234 tempest-ServerDiskConfigTestJSON-573066234-project] Request method failure captured: Aug 10 18:01:22.663589 n-d-852296-2 devstack@n-api.service[129409]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 18:01:22.663589 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 18:01:22.663589 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 18:01:22.663589 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 18:01:22.663589 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 209 Aug 10 18:01:22.663589 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 18:01:22.663589 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 18:01:22.663589 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 18:01:22.663589 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 18:01:22.663589 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8_JuR2qZaoWnVk1dBuSVM0cQCxi_5aiNzV2W1YkGEphmaAk0CIK5feBw7ydu26BH6sYIZhU5aGkcMFzA5p7KvEn51uk54PLKPH8iFb0HJT00px0MysEBRWaVaN9tIuuOs5AeIHvFK-5HT_1e7xaFs7hNkD8v4RNTGIwkIrTsWVy5t7Q Aug 10 18:01:22.663589 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 18:01:22.663589 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 18:01:22.663589 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 18:01:22.663589 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 18:01:22.663589 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 18:01:22.663589 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 18:01:22.663589 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: 82b04b1e58584c0cb7b0669846698620 Aug 10 18:01:22.663589 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-ServerDiskConfigTestJSON-573066234 Aug 10 18:01:22.663589 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 18:01:22.663589 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 18:01:22.663589 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/82b04b1e58584c0cb7b0669846698620"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/82b04b1e58584c0cb7b0669846698620"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/82b04b1e58584c0cb7b0669846698620"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_82b04b1e58584c0cb7b0669846698620", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 18:01:22.663589 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-ServerDiskConfigTestJSON-573066234 Aug 10 18:01:22.663589 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: 82b04b1e58584c0cb7b0669846698620 Aug 10 18:01:22.663589 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-573066234 Aug 10 18:01:22.663589 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-ServerDiskConfigTestJSON-573066234-project Aug 10 18:01:22.663589 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 18:01:22.663589 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 18:01:22.663589 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: e89e037bc28748118185f13c704a798c Aug 10 18:01:22.663589 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-ServerDiskConfigTestJSON-573066234-project Aug 10 18:01:22.663589 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 18:01:22.663589 n-d-852296-2 devstack@n-api.service[129409]: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-372101048", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "309e3111-f27a-4aad-9e2b-a3db173c1413"}]}} Aug 10 18:01:22.663589 n-d-852296-2 devstack@n-api.service[129409]: method: > Aug 10 18:01:22.663589 n-d-852296-2 devstack@n-api.service[129409]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:01:22.663589 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 18:01:22.663589 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'body': {'server': {'name': 'tempest-ServerDiskConfigTestJSON-server-372101048', 'imageRef': 'a735ff26-463a-4ffe-a981-ab9d9baa494f', 'flavorRef': '452', 'networks': [{'uuid': '309e3111-f27a-4aad-9e2b-a3db173c1413'}]}}} Aug 10 18:01:22.671569 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 18:01:22.671569 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:01:22.671569 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:01:22.671569 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:01:22.671569 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:01:22.671569 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:01:22.671569 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:01:22.671569 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:01:22.671569 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:01:22.671569 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:01:22.671569 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 18:01:22.671569 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 18:01:22.671569 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 18:01:22.671569 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 18:01:22.671569 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 18:01:22.671569 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 18:01:22.671569 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 18:01:22.671569 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 18:01:22.671569 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 18:01:22.671569 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 18:01:22.671569 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 18:01:22.671569 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 18:01:22.671569 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 18:01:22.671569 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 18:01:22.671569 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 18:01:22.671569 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 18:01:22.671569 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 18:01:22.671569 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:01:22.671569 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:01:22.671569 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 18:01:22.671569 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 18:01:22.671569 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:01:22.671569 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:01:22.671569 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 18:01:22.671569 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 18:01:22.671569 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:01:22.671569 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:01:22.671569 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:01:22.671569 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:01:22.671569 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:01:22.671569 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:01:22.671569 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 18:01:22.671569 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 18:01:22.671569 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 18:01:22.671569 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 18:01:22.671569 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 18:01:22.671569 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 18:01:22.671569 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 18:01:22.671569 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 18:01:22.671569 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 18:01:22.671569 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 18:01:22.671569 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 18:01:22.671569 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 18:01:22.671569 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 18:01:22.671569 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 18:01:22.671569 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 18:01:22.682773 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 18:01:22.682773 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 18:01:22.682773 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 18:01:22.682773 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 18:01:22.682773 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 18:01:22.682773 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 18:01:22.682773 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 18:01:22.682773 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 18:01:22.682773 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 18:01:22.682773 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 18:01:22.682773 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 18:01:22.682773 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-9b04dfb7-79d8-4183-b5e8-b4a1c169ef4a) Aug 10 18:01:22.682773 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:01:22.682773 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:01:22.682773 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:01:22.682773 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:01:22.682773 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:01:22.682773 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:01:22.682773 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 18:01:22.682773 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 18:01:22.682773 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 10 18:01:22.682773 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 10 18:01:22.682773 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:01:22.682773 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:01:22.682773 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:01:22.682773 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:01:22.682773 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:01:22.682773 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:01:22.682773 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:01:22.682773 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:01:22.682773 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 18:01:22.682773 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 18:01:22.682773 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:01:22.682773 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:01:22.682773 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:01:22.682773 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-2a5b12cd-41c5-4814-b1e8-3cd211e776dc tempest-ServerDiskConfigTestJSON-573066234 tempest-ServerDiskConfigTestJSON-573066234-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:01:22.682773 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 18:01:22.682773 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-2a5b12cd-41c5-4814-b1e8-3cd211e776dc tempest-ServerDiskConfigTestJSON-573066234 tempest-ServerDiskConfigTestJSON-573066234-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.953302 Aug 10 18:01:22.682773 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 999/1978] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 18:01:21 2022] POST /compute/v2.1/servers => generated 214 bytes in 955 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 10 18:01:23.072376 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-a5ce2615-74c7-4801-8732-5891ea8bcd77 tempest-ServerDiskConfigTestJSON-573066234 tempest-ServerDiskConfigTestJSON-573066234-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-560699956", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "309e3111-f27a-4aad-9e2b-a3db173c1413"}]}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 18:01:23.265537 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.network.neutron [None req-a5ce2615-74c7-4801-8732-5891ea8bcd77 tempest-ServerDiskConfigTestJSON-573066234 tempest-ServerDiskConfigTestJSON-573066234-project] validate_networks() for [('309e3111-f27a-4aad-9e2b-a3db173c1413', None, None, None, None, None)] {{(pid=129410) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 18:01:23.573002 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-0b1aa412-08c0-43b2-9d62-bd19a6b6a288 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:01:23.573836 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-0b1aa412-08c0-43b2-9d62-bd19a6b6a288 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] [instance: eaea86c8-028c-4254-a992-5f7c9d06f5fc] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:01:23.586965 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-0b1aa412-08c0-43b2-9d62-bd19a6b6a288 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:01:23.588608 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-0b1aa412-08c0-43b2-9d62-bd19a6b6a288 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:01:23.597837 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-0b1aa412-08c0-43b2-9d62-bd19a6b6a288 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:01:23.597837 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-0b1aa412-08c0-43b2-9d62-bd19a6b6a288 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:01:23.597837 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-0b1aa412-08c0-43b2-9d62-bd19a6b6a288 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:01:23.599768 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-0b1aa412-08c0-43b2-9d62-bd19a6b6a288 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:01:23.710937 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-0b1aa412-08c0-43b2-9d62-bd19a6b6a288 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:01:23.711702 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-0b1aa412-08c0-43b2-9d62-bd19a6b6a288 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:01:23.713837 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-0b1aa412-08c0-43b2-9d62-bd19a6b6a288 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:01:23.716589 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.objects.instance [None req-0b1aa412-08c0-43b2-9d62-bd19a6b6a288 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lazy-loading 'fault' on Instance uuid eaea86c8-028c-4254-a992-5f7c9d06f5fc {{(pid=129409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 18:01:23.825768 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-0b1aa412-08c0-43b2-9d62-bd19a6b6a288 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec98ff0c96a348cdbb28f75575750cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf5c80544ad4a58a38c6af33a9d191c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:01:23.869403 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-0b1aa412-08c0-43b2-9d62-bd19a6b6a288 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec98ff0c96a348cdbb28f75575750cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf5c80544ad4a58a38c6af33a9d191c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:01:23.869403 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-0b1aa412-08c0-43b2-9d62-bd19a6b6a288 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec98ff0c96a348cdbb28f75575750cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf5c80544ad4a58a38c6af33a9d191c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:01:23.869403 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-0b1aa412-08c0-43b2-9d62-bd19a6b6a288 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] 10.222.0.50 "GET /compute/v2.1/servers/eaea86c8-028c-4254-a992-5f7c9d06f5fc" status: 200 len: 1367 microversion: 2.57 time: 0.288169 Aug 10 18:01:23.869403 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1000/1979] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 18:01:23 2022] GET /compute/v2.1/servers/eaea86c8-028c-4254-a992-5f7c9d06f5fc => generated 1367 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 18:01:24.888044 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-c633e32a-8abb-40f5-8566-bd00bd5ccb59 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:01:24.888767 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-c633e32a-8abb-40f5-8566-bd00bd5ccb59 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] [instance: eaea86c8-028c-4254-a992-5f7c9d06f5fc] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:01:24.911398 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c633e32a-8abb-40f5-8566-bd00bd5ccb59 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:01:24.914532 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c633e32a-8abb-40f5-8566-bd00bd5ccb59 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:01:24.921154 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c633e32a-8abb-40f5-8566-bd00bd5ccb59 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:01:24.922170 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c633e32a-8abb-40f5-8566-bd00bd5ccb59 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:01:24.922835 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c633e32a-8abb-40f5-8566-bd00bd5ccb59 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:01:24.923439 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c633e32a-8abb-40f5-8566-bd00bd5ccb59 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:01:24.953231 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-c633e32a-8abb-40f5-8566-bd00bd5ccb59 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] HTTP exception thrown: Instance eaea86c8-028c-4254-a992-5f7c9d06f5fc could not be found. Aug 10 18:01:24.956486 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-c633e32a-8abb-40f5-8566-bd00bd5ccb59 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Request method failure captured: Aug 10 18:01:24.956486 n-d-852296-2 devstack@n-api.service[129409]: request: GET /compute/v2.1/servers/eaea86c8-028c-4254-a992-5f7c9d06f5fc HTTP/1.1 Aug 10 18:01:24.956486 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 18:01:24.956486 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 18:01:24.956486 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 18:01:24.956486 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 0 Aug 10 18:01:24.956486 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 18:01:24.956486 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 18:01:24.956486 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 18:01:24.956486 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 18:01:24.956486 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8_JBEXoCAtPmdoPdgQ_m-j4BO5wmHr-ofpls_iQKYpAyKQ9y7pTzP3rS-ynE5DjSO-JJwqUgCEBr4YCMlY5MUtmQQd23FGLsv6pFKQTApDLtYMaI6mfH9RhhcKJC29iJKT4pXlYq3xIVLyF7oGZbG6HjBds4J4aW3FuI2F8BLwjyQ7U Aug 10 18:01:24.956486 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 18:01:24.956486 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 18:01:24.956486 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 18:01:24.956486 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 18:01:24.956486 n-d-852296-2 devstack@n-api.service[129409]: X-Openstack-Nova-Api-Version: 2.57 Aug 10 18:01:24.956486 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 18:01:24.956486 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 18:01:24.956486 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: bcf5c80544ad4a58a38c6af33a9d191c Aug 10 18:01:24.956486 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-ServerShowV257Test-202560203 Aug 10 18:01:24.956486 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 18:01:24.956486 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 18:01:24.956486 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/bcf5c80544ad4a58a38c6af33a9d191c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "tempest-type-2028682234", "name": "tempest-service-1190650438", "endpoints": []}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/bcf5c80544ad4a58a38c6af33a9d191c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/bcf5c80544ad4a58a38c6af33a9d191c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_bcf5c80544ad4a58a38c6af33a9d191c", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "tempest-type-1865912440", "name": "tempest-service-498082939", "endpoints": []}] Aug 10 18:01:24.956486 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-ServerShowV257Test-202560203 Aug 10 18:01:24.956486 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: bcf5c80544ad4a58a38c6af33a9d191c Aug 10 18:01:24.956486 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-ServerShowV257Test-202560203 Aug 10 18:01:24.956486 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-ServerShowV257Test-202560203-project Aug 10 18:01:24.956486 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 18:01:24.956486 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 18:01:24.956486 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: ec98ff0c96a348cdbb28f75575750cd4 Aug 10 18:01:24.956486 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-ServerShowV257Test-202560203-project Aug 10 18:01:24.956486 n-d-852296-2 devstack@n-api.service[129409]: method: > Aug 10 18:01:24.956486 n-d-852296-2 devstack@n-api.service[129409]: exception: Instance eaea86c8-028c-4254-a992-5f7c9d06f5fc could not be found. Aug 10 18:01:24.956486 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'id': 'eaea86c8-028c-4254-a992-5f7c9d06f5fc'} Aug 10 18:01:24.956486 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 18:01:24.956486 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:01:24.956486 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 18:01:24.956486 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 18:01:24.956486 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 18:01:24.956486 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 18:01:24.956486 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 18:01:24.956486 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 18:01:24.956486 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 18:01:24.956486 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 18:01:24.956486 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eaea86c8-028c-4254-a992-5f7c9d06f5fc could not be found. Aug 10 18:01:24.956486 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:01:24.956486 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:01:24.956486 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:01:24.956486 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:01:24.956486 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:01:24.956486 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:01:24.956486 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 18:01:24.956486 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 18:01:24.956486 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:01:24.956486 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:01:24.956486 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 18:01:24.956486 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 18:01:24.956486 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 18:01:24.956486 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 18:01:24.956486 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 18:01:24.956486 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 18:01:24.956486 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eaea86c8-028c-4254-a992-5f7c9d06f5fc could not be found. Aug 10 18:01:24.961868 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:01:24.961868 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:01:24.961868 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:01:24.961868 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:01:24.961868 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:01:24.961868 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:01:24.961868 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 18:01:24.961868 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 18:01:24.961868 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eaea86c8-028c-4254-a992-5f7c9d06f5fc could not be found. Aug 10 18:01:24.961868 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:01:24.961868 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-c633e32a-8abb-40f5-8566-bd00bd5ccb59 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] Returning 404 to user: Instance eaea86c8-028c-4254-a992-5f7c9d06f5fc could not be found. {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 18:01:24.964018 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-c633e32a-8abb-40f5-8566-bd00bd5ccb59 tempest-ServerShowV257Test-202560203 tempest-ServerShowV257Test-202560203-project] 10.222.0.50 "GET /compute/v2.1/servers/eaea86c8-028c-4254-a992-5f7c9d06f5fc" status: 404 len: 111 microversion: 2.57 time: 0.080548 Aug 10 18:01:24.965130 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1001/1980] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 10 18:01:24 2022] GET /compute/v2.1/servers/eaea86c8-028c-4254-a992-5f7c9d06f5fc => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 10 18:01:25.532917 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [None req-a5ce2615-74c7-4801-8732-5891ea8bcd77 tempest-ServerDiskConfigTestJSON-573066234 tempest-ServerDiskConfigTestJSON-573066234-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-d7dcb9a3-dbd4-422e-a2a0-f69712054006) Aug 10 18:01:25.532917 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:01:25.532917 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:01:25.532917 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:01:25.532917 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:01:25.532917 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:01:25.532917 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:01:25.532917 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:01:25.532917 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:01:25.532917 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:01:25.532917 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 18:01:25.532917 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 18:01:25.532917 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 18:01:25.532917 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 18:01:25.532917 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 18:01:25.532917 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 18:01:25.532917 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 18:01:25.532917 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 18:01:25.532917 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 18:01:25.532917 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 18:01:25.532917 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 18:01:25.532917 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 18:01:25.532917 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 18:01:25.532917 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 18:01:25.532917 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 18:01:25.532917 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 18:01:25.532917 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 18:01:25.532917 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:01:25.532917 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:01:25.532917 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 18:01:25.532917 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 18:01:25.532917 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:01:25.532917 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:01:25.532917 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 18:01:25.532917 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 18:01:25.532917 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:01:25.532917 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:01:25.532917 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:01:25.532917 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:01:25.532917 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:01:25.532917 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:01:25.532917 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 18:01:25.532917 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 18:01:25.532917 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 18:01:25.532917 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 18:01:25.532917 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 18:01:25.532917 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 18:01:25.532917 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 18:01:25.532917 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 18:01:25.532917 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 18:01:25.532917 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 18:01:25.532917 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 18:01:25.538457 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 18:01:25.538457 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 18:01:25.538457 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 18:01:25.538457 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 18:01:25.538457 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 18:01:25.538457 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 18:01:25.538457 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 18:01:25.538457 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 18:01:25.538457 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 18:01:25.538457 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 18:01:25.538457 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 18:01:25.538457 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 18:01:25.538457 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 18:01:25.538457 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 18:01:25.538457 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 18:01:25.538457 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-d7dcb9a3-dbd4-422e-a2a0-f69712054006) Aug 10 18:01:25.538457 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:01:25.538457 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-a5ce2615-74c7-4801-8732-5891ea8bcd77 tempest-ServerDiskConfigTestJSON-573066234 tempest-ServerDiskConfigTestJSON-573066234-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:01:25.538457 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 18:01:25.538457 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-a5ce2615-74c7-4801-8732-5891ea8bcd77 tempest-ServerDiskConfigTestJSON-573066234 tempest-ServerDiskConfigTestJSON-573066234-project] Request method failure captured: Aug 10 18:01:25.538457 n-d-852296-2 devstack@n-api.service[129410]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 18:01:25.538457 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 18:01:25.538457 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 18:01:25.538457 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 18:01:25.538457 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 209 Aug 10 18:01:25.538457 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 18:01:25.538457 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 18:01:25.538457 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 18:01:25.538457 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 18:01:25.538457 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8_JuR2qZaoWnVk1dBuSVM0cQCxi_5aiNzV2W1YkGEphmaAk0CIK5feBw7ydu26BH6sYIZhU5aGkcMFzA5p7KvEn51uk54PLKPH8iFb0HJT00px0MysEBRWaVaN9tIuuOs5AeIHvFK-5HT_1e7xaFs7hNkD8v4RNTGIwkIrTsWVy5t7Q Aug 10 18:01:25.538457 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 18:01:25.538457 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 18:01:25.538457 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 18:01:25.538457 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 18:01:25.538457 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 18:01:25.538457 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 18:01:25.538457 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: 82b04b1e58584c0cb7b0669846698620 Aug 10 18:01:25.538457 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-ServerDiskConfigTestJSON-573066234 Aug 10 18:01:25.538457 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 18:01:25.538457 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 18:01:25.538457 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/82b04b1e58584c0cb7b0669846698620"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/82b04b1e58584c0cb7b0669846698620"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/82b04b1e58584c0cb7b0669846698620"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_82b04b1e58584c0cb7b0669846698620", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 18:01:25.538457 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-ServerDiskConfigTestJSON-573066234 Aug 10 18:01:25.538457 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: 82b04b1e58584c0cb7b0669846698620 Aug 10 18:01:25.538457 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-573066234 Aug 10 18:01:25.538457 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-ServerDiskConfigTestJSON-573066234-project Aug 10 18:01:25.538457 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 18:01:25.538457 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 18:01:25.538457 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: e89e037bc28748118185f13c704a798c Aug 10 18:01:25.538457 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-ServerDiskConfigTestJSON-573066234-project Aug 10 18:01:25.538457 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 18:01:25.538457 n-d-852296-2 devstack@n-api.service[129410]: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-560699956", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "309e3111-f27a-4aad-9e2b-a3db173c1413"}]}} Aug 10 18:01:25.538457 n-d-852296-2 devstack@n-api.service[129410]: method: > Aug 10 18:01:25.538457 n-d-852296-2 devstack@n-api.service[129410]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:01:25.538457 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 18:01:25.538457 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'body': {'server': {'name': 'tempest-ServerDiskConfigTestJSON-server-560699956', 'imageRef': 'a735ff26-463a-4ffe-a981-ab9d9baa494f', 'flavorRef': '452', 'networks': [{'uuid': '309e3111-f27a-4aad-9e2b-a3db173c1413'}]}}} Aug 10 18:01:25.548800 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 18:01:25.548800 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:01:25.548800 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:01:25.548800 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:01:25.548800 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:01:25.548800 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:01:25.548800 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:01:25.548800 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:01:25.548800 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:01:25.548800 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:01:25.548800 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 18:01:25.548800 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 18:01:25.548800 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 18:01:25.548800 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 18:01:25.548800 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 18:01:25.548800 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 18:01:25.548800 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 18:01:25.548800 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 18:01:25.548800 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 18:01:25.548800 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 18:01:25.548800 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 18:01:25.548800 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 18:01:25.548800 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 18:01:25.548800 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 18:01:25.548800 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 18:01:25.548800 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 18:01:25.548800 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 18:01:25.548800 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:01:25.548800 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:01:25.548800 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 18:01:25.548800 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 18:01:25.548800 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:01:25.548800 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:01:25.548800 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 18:01:25.548800 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 18:01:25.548800 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:01:25.548800 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:01:25.548800 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:01:25.548800 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:01:25.548800 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:01:25.548800 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:01:25.548800 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 18:01:25.548800 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 18:01:25.548800 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 18:01:25.548800 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 18:01:25.548800 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 18:01:25.548800 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 18:01:25.548800 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 18:01:25.548800 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 18:01:25.548800 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 18:01:25.548800 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 18:01:25.548800 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 18:01:25.548800 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 18:01:25.548800 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 18:01:25.548800 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 18:01:25.548800 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 18:01:25.556780 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 18:01:25.556780 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 18:01:25.556780 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 18:01:25.556780 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 18:01:25.556780 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 18:01:25.556780 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 18:01:25.556780 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 18:01:25.556780 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 18:01:25.556780 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 18:01:25.556780 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 18:01:25.556780 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 18:01:25.556780 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-d7dcb9a3-dbd4-422e-a2a0-f69712054006) Aug 10 18:01:25.556780 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:01:25.556780 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:01:25.556780 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:01:25.556780 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:01:25.556780 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:01:25.556780 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:01:25.556780 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 18:01:25.556780 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 18:01:25.556780 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 10 18:01:25.556780 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 10 18:01:25.556780 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:01:25.556780 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:01:25.556780 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:01:25.556780 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:01:25.556780 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:01:25.556780 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:01:25.556780 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:01:25.556780 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:01:25.556780 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 18:01:25.556780 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 18:01:25.556780 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:01:25.556780 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:01:25.556780 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:01:25.556780 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-a5ce2615-74c7-4801-8732-5891ea8bcd77 tempest-ServerDiskConfigTestJSON-573066234 tempest-ServerDiskConfigTestJSON-573066234-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:01:25.556780 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 18:01:25.556780 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-a5ce2615-74c7-4801-8732-5891ea8bcd77 tempest-ServerDiskConfigTestJSON-573066234 tempest-ServerDiskConfigTestJSON-573066234-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 2.474375 Aug 10 18:01:25.556780 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 980/1981] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 18:01:23 2022] POST /compute/v2.1/servers => generated 214 bytes in 2479 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 10 18:01:44.292482 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 18:01:44.294052 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 18:01:44.514158 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-b7a9e3d3-ebaf-4faf-a4da-3a75ce21685a tempest-VolumesActionsTest-1965382928 tempest-VolumesActionsTest-1965382928-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-714737103", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "575c4ef7-7997-4908-8134-eb0e95ea924c"}]}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 18:01:44.603074 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.network.neutron [None req-b7a9e3d3-ebaf-4faf-a4da-3a75ce21685a tempest-VolumesActionsTest-1965382928 tempest-VolumesActionsTest-1965382928-project] validate_networks() for [('575c4ef7-7997-4908-8134-eb0e95ea924c', None, None, None, None, None)] {{(pid=129409) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 18:01:47.103951 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [None req-b7a9e3d3-ebaf-4faf-a4da-3a75ce21685a tempest-VolumesActionsTest-1965382928 tempest-VolumesActionsTest-1965382928-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-8ca035e2-b912-4187-ac16-a50ed374dcb5) Aug 10 18:01:47.103951 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:01:47.103951 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:01:47.103951 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:01:47.103951 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:01:47.103951 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:01:47.103951 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:01:47.103951 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:01:47.103951 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:01:47.103951 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:01:47.103951 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 18:01:47.103951 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 18:01:47.103951 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 18:01:47.103951 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 18:01:47.103951 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 18:01:47.103951 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 18:01:47.103951 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 18:01:47.103951 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 18:01:47.103951 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 18:01:47.103951 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 18:01:47.103951 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 18:01:47.103951 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 18:01:47.103951 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 18:01:47.103951 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 18:01:47.103951 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 18:01:47.103951 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 18:01:47.103951 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 18:01:47.103951 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:01:47.103951 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:01:47.103951 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 18:01:47.103951 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 18:01:47.103951 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:01:47.103951 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:01:47.103951 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 18:01:47.103951 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 18:01:47.103951 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:01:47.103951 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:01:47.103951 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:01:47.103951 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:01:47.103951 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:01:47.103951 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:01:47.103951 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 18:01:47.103951 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 18:01:47.103951 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 18:01:47.103951 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 18:01:47.103951 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 18:01:47.103951 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 18:01:47.103951 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 18:01:47.103951 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 18:01:47.103951 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 18:01:47.103951 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 18:01:47.103951 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 18:01:47.103951 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 18:01:47.108442 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 18:01:47.108442 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 18:01:47.108442 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 18:01:47.108442 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 18:01:47.108442 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 18:01:47.108442 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 18:01:47.108442 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 18:01:47.108442 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 18:01:47.108442 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 18:01:47.108442 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 18:01:47.108442 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 18:01:47.108442 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 18:01:47.108442 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 18:01:47.108442 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 18:01:47.108442 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-8ca035e2-b912-4187-ac16-a50ed374dcb5) Aug 10 18:01:47.108442 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:01:47.112926 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-b7a9e3d3-ebaf-4faf-a4da-3a75ce21685a tempest-VolumesActionsTest-1965382928 tempest-VolumesActionsTest-1965382928-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:01:47.112926 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 18:01:47.116481 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-b7a9e3d3-ebaf-4faf-a4da-3a75ce21685a tempest-VolumesActionsTest-1965382928 tempest-VolumesActionsTest-1965382928-project] Request method failure captured: Aug 10 18:01:47.116481 n-d-852296-2 devstack@n-api.service[129409]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 18:01:47.116481 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 18:01:47.116481 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 18:01:47.116481 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 18:01:47.116481 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 205 Aug 10 18:01:47.116481 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 18:01:47.116481 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 18:01:47.116481 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 18:01:47.116481 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 18:01:47.116481 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8_J_knVKK2Qyv4wlELfjGaCZqGGYwaWW7SKVw9t_35Wom0UTLRMBg6iuTK0SWyChEp2I9EMYtgD7ptGF3cNg7mtu35unoANhCQm8DSypuoeiljYPWHe4KPoZjHG_TB1UjYr52dvXdkahNBwkgOUJW5VZIVBeam3CG0kKS7eG2poeo4g Aug 10 18:01:47.116481 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 18:01:47.116481 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 18:01:47.116481 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 18:01:47.116481 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 18:01:47.116481 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 18:01:47.116481 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 18:01:47.116481 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: 525cbcdc021c4b849844355b5ec37496 Aug 10 18:01:47.116481 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-VolumesActionsTest-1965382928 Aug 10 18:01:47.116481 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 18:01:47.116481 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 18:01:47.116481 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/525cbcdc021c4b849844355b5ec37496"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/525cbcdc021c4b849844355b5ec37496"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/525cbcdc021c4b849844355b5ec37496"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_525cbcdc021c4b849844355b5ec37496", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 18:01:47.116481 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-VolumesActionsTest-1965382928 Aug 10 18:01:47.116481 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: 525cbcdc021c4b849844355b5ec37496 Aug 10 18:01:47.116481 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-VolumesActionsTest-1965382928 Aug 10 18:01:47.116481 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-VolumesActionsTest-1965382928-project Aug 10 18:01:47.116481 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 18:01:47.116481 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 18:01:47.116481 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: d792695d69194ac194c857bb3bd8153e Aug 10 18:01:47.116481 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-VolumesActionsTest-1965382928-project Aug 10 18:01:47.116481 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 18:01:47.116481 n-d-852296-2 devstack@n-api.service[129409]: {"server": {"name": "tempest-VolumesActionsTest-instance-714737103", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "575c4ef7-7997-4908-8134-eb0e95ea924c"}]}} Aug 10 18:01:47.116481 n-d-852296-2 devstack@n-api.service[129409]: method: > Aug 10 18:01:47.116481 n-d-852296-2 devstack@n-api.service[129409]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:01:47.116481 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 18:01:47.116481 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'body': {'server': {'name': 'tempest-VolumesActionsTest-instance-714737103', 'imageRef': 'a735ff26-463a-4ffe-a981-ab9d9baa494f', 'flavorRef': '452', 'networks': [{'uuid': '575c4ef7-7997-4908-8134-eb0e95ea924c'}]}}} Aug 10 18:01:47.116481 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 18:01:47.116481 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:01:47.116481 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:01:47.116481 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:01:47.116481 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:01:47.116481 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:01:47.116481 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:01:47.116481 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:01:47.116481 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:01:47.116481 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:01:47.116481 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 18:01:47.116481 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 18:01:47.116481 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 18:01:47.116481 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 18:01:47.116481 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 18:01:47.116481 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 18:01:47.116481 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 18:01:47.116481 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 18:01:47.116481 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 18:01:47.116481 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 18:01:47.116481 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 18:01:47.116481 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 18:01:47.116481 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 18:01:47.116481 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 18:01:47.116481 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 18:01:47.120741 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 18:01:47.120741 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 18:01:47.120741 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:01:47.120741 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:01:47.120741 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 18:01:47.120741 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 18:01:47.120741 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:01:47.120741 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:01:47.120741 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 18:01:47.120741 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 18:01:47.120741 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:01:47.120741 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:01:47.120741 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:01:47.120741 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:01:47.120741 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:01:47.120741 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:01:47.120741 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 18:01:47.120741 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 18:01:47.120741 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 18:01:47.120741 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 18:01:47.120741 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 18:01:47.120741 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 18:01:47.120741 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 18:01:47.120741 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 18:01:47.120741 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 18:01:47.120741 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 18:01:47.120741 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 18:01:47.120741 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 18:01:47.120741 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 18:01:47.120741 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 18:01:47.120741 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 18:01:47.120741 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 18:01:47.120741 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 18:01:47.120741 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 18:01:47.120741 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 18:01:47.120741 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 18:01:47.120741 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 18:01:47.120741 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 18:01:47.120741 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 18:01:47.120741 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 18:01:47.120741 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 18:01:47.120741 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 18:01:47.120741 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-8ca035e2-b912-4187-ac16-a50ed374dcb5) Aug 10 18:01:47.120741 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:01:47.120741 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:01:47.120741 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:01:47.120741 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:01:47.120741 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:01:47.120741 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:01:47.120741 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 18:01:47.120741 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 18:01:47.120741 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 10 18:01:47.120741 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 10 18:01:47.135611 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:01:47.135611 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:01:47.135611 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:01:47.135611 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:01:47.135611 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:01:47.135611 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:01:47.135611 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:01:47.135611 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:01:47.135611 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 18:01:47.135611 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 18:01:47.135611 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:01:47.135611 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:01:47.135611 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:01:47.135611 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-b7a9e3d3-ebaf-4faf-a4da-3a75ce21685a tempest-VolumesActionsTest-1965382928 tempest-VolumesActionsTest-1965382928-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:01:47.135611 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 18:01:47.135611 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-b7a9e3d3-ebaf-4faf-a4da-3a75ce21685a tempest-VolumesActionsTest-1965382928 tempest-VolumesActionsTest-1965382928-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 2.837040 Aug 10 18:01:47.135611 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1002/1982] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 18:01:44 2022] POST /compute/v2.1/servers => generated 214 bytes in 2839 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 10 18:01:59.872433 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_cell1:SELECT=35 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 18:01:59.873194 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_api:SELECT=13 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 18:02:00.237817 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-1fc0d5d5-a48b-40c4-bcfb-a8cda331c51c tempest-InstanceActionsV221TestJSON-1350459589 tempest-InstanceActionsV221TestJSON-1350459589-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-1813841717", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "23557609-9568-4448-9fb0-6ef1e387f405"}]}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 18:02:00.320625 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.network.neutron [None req-1fc0d5d5-a48b-40c4-bcfb-a8cda331c51c tempest-InstanceActionsV221TestJSON-1350459589 tempest-InstanceActionsV221TestJSON-1350459589-project] validate_networks() for [('23557609-9568-4448-9fb0-6ef1e387f405', None, None, None, None, None)] {{(pid=129410) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 18:02:01.597609 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [None req-1fc0d5d5-a48b-40c4-bcfb-a8cda331c51c tempest-InstanceActionsV221TestJSON-1350459589 tempest-InstanceActionsV221TestJSON-1350459589-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-3569b34e-1472-4f02-89d2-722cdab10ac2) Aug 10 18:02:01.597609 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:02:01.597609 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:02:01.597609 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:02:01.597609 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:02:01.597609 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:02:01.597609 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:02:01.597609 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:02:01.597609 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:02:01.597609 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:02:01.597609 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 18:02:01.597609 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 18:02:01.597609 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 18:02:01.597609 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 18:02:01.597609 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 18:02:01.597609 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 18:02:01.597609 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 18:02:01.597609 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 18:02:01.597609 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 18:02:01.597609 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 18:02:01.597609 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 18:02:01.597609 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 18:02:01.597609 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 18:02:01.597609 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 18:02:01.597609 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 18:02:01.597609 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 18:02:01.597609 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 18:02:01.597609 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:02:01.597609 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:02:01.597609 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 18:02:01.597609 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 18:02:01.597609 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:02:01.597609 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:02:01.597609 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 18:02:01.597609 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 18:02:01.597609 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:02:01.597609 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:02:01.597609 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:02:01.597609 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:02:01.597609 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:02:01.597609 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:02:01.597609 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 18:02:01.597609 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 18:02:01.597609 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 18:02:01.597609 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 18:02:01.597609 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 18:02:01.597609 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 18:02:01.597609 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 18:02:01.597609 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 18:02:01.597609 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 18:02:01.597609 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 18:02:01.597609 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 18:02:01.603331 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 18:02:01.603331 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 18:02:01.603331 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 18:02:01.603331 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 18:02:01.603331 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 18:02:01.603331 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 18:02:01.603331 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 18:02:01.603331 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 18:02:01.603331 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 18:02:01.603331 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 18:02:01.603331 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 18:02:01.603331 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 18:02:01.603331 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 18:02:01.603331 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 18:02:01.603331 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 18:02:01.603331 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-3569b34e-1472-4f02-89d2-722cdab10ac2) Aug 10 18:02:01.603331 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:02:01.603331 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-1fc0d5d5-a48b-40c4-bcfb-a8cda331c51c tempest-InstanceActionsV221TestJSON-1350459589 tempest-InstanceActionsV221TestJSON-1350459589-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:02:01.603331 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 18:02:01.603331 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-1fc0d5d5-a48b-40c4-bcfb-a8cda331c51c tempest-InstanceActionsV221TestJSON-1350459589 tempest-InstanceActionsV221TestJSON-1350459589-project] Request method failure captured: Aug 10 18:02:01.603331 n-d-852296-2 devstack@n-api.service[129410]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 18:02:01.603331 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 18:02:01.603331 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 18:02:01.603331 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 18:02:01.603331 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 213 Aug 10 18:02:01.603331 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 18:02:01.603331 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 18:02:01.603331 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 18:02:01.603331 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 18:02:01.603331 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8_KXhIQO_jxMYWR1-muDrK3V-CKFPJpD6l_71zBG6aEwz6PXmm6tNlE9RA8oel5RMunofIrEJmhHcwu-S9ZsFSrvSomzPYBqcVUfM-aPnZP4xKPmYc6YtR3WQ71IVULJ9uXEBhS5uoXplQVco_9liN6bhBqqhZpWhY6zc3dmLgaO_CY Aug 10 18:02:01.603331 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 18:02:01.603331 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 18:02:01.603331 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 18:02:01.603331 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 18:02:01.603331 n-d-852296-2 devstack@n-api.service[129410]: X-Openstack-Nova-Api-Version: 2.21 Aug 10 18:02:01.603331 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 18:02:01.603331 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 18:02:01.603331 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: c2a98b7f70b148d5a17978ac19e68fec Aug 10 18:02:01.603331 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1350459589 Aug 10 18:02:01.603331 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 18:02:01.603331 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 18:02:01.603331 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c2a98b7f70b148d5a17978ac19e68fec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c2a98b7f70b148d5a17978ac19e68fec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c2a98b7f70b148d5a17978ac19e68fec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c2a98b7f70b148d5a17978ac19e68fec", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 18:02:01.603331 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-InstanceActionsV221TestJSON-1350459589 Aug 10 18:02:01.603331 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: c2a98b7f70b148d5a17978ac19e68fec Aug 10 18:02:01.603331 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1350459589 Aug 10 18:02:01.603331 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-InstanceActionsV221TestJSON-1350459589-project Aug 10 18:02:01.603331 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 18:02:01.603331 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 18:02:01.603331 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: 216f35e0c6b3409a935d1ffd50cced21 Aug 10 18:02:01.603331 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-InstanceActionsV221TestJSON-1350459589-project Aug 10 18:02:01.603331 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 18:02:01.603331 n-d-852296-2 devstack@n-api.service[129410]: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-1813841717", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "23557609-9568-4448-9fb0-6ef1e387f405"}]}} Aug 10 18:02:01.603331 n-d-852296-2 devstack@n-api.service[129410]: method: > Aug 10 18:02:01.603331 n-d-852296-2 devstack@n-api.service[129410]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:02:01.603331 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 18:02:01.611404 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'body': {'server': {'name': 'tempest-InstanceActionsV221TestJSON-server-1813841717', 'imageRef': 'a735ff26-463a-4ffe-a981-ab9d9baa494f', 'flavorRef': '452', 'networks': [{'uuid': '23557609-9568-4448-9fb0-6ef1e387f405'}]}}} Aug 10 18:02:01.611404 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 18:02:01.611404 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:02:01.611404 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:02:01.611404 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:02:01.611404 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:02:01.611404 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:02:01.611404 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:02:01.611404 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:02:01.611404 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:02:01.611404 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:02:01.611404 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 18:02:01.611404 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 18:02:01.611404 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 18:02:01.611404 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 18:02:01.611404 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 18:02:01.611404 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 18:02:01.611404 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 18:02:01.611404 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 18:02:01.611404 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 18:02:01.611404 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 18:02:01.611404 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 18:02:01.611404 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 18:02:01.611404 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 18:02:01.611404 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 18:02:01.611404 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 18:02:01.611404 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 18:02:01.611404 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 18:02:01.611404 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:02:01.611404 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:02:01.611404 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 18:02:01.611404 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 18:02:01.611404 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:02:01.611404 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:02:01.611404 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 18:02:01.611404 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 18:02:01.611404 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:02:01.611404 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:02:01.611404 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:02:01.611404 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:02:01.611404 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:02:01.611404 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:02:01.611404 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 18:02:01.611404 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 18:02:01.611404 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 18:02:01.611404 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 18:02:01.611404 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 18:02:01.611404 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 18:02:01.611404 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 18:02:01.611404 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 18:02:01.611404 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 18:02:01.611404 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 18:02:01.611404 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 18:02:01.611404 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 18:02:01.611404 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 18:02:01.621714 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 18:02:01.621714 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 18:02:01.621714 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 18:02:01.621714 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 18:02:01.621714 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 18:02:01.621714 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 18:02:01.621714 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 18:02:01.621714 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 18:02:01.621714 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 18:02:01.621714 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 18:02:01.621714 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 18:02:01.621714 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 18:02:01.621714 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 18:02:01.621714 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-3569b34e-1472-4f02-89d2-722cdab10ac2) Aug 10 18:02:01.621714 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:02:01.621714 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:02:01.621714 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:02:01.621714 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:02:01.621714 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:02:01.621714 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:02:01.621714 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 18:02:01.621714 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 18:02:01.621714 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 10 18:02:01.621714 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 10 18:02:01.621714 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:02:01.621714 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:02:01.621714 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:02:01.621714 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:02:01.621714 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:02:01.621714 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:02:01.621714 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:02:01.621714 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:02:01.621714 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 18:02:01.621714 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 18:02:01.621714 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:02:01.621714 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:02:01.621714 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:02:01.621714 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-1fc0d5d5-a48b-40c4-bcfb-a8cda331c51c tempest-InstanceActionsV221TestJSON-1350459589 tempest-InstanceActionsV221TestJSON-1350459589-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:02:01.621714 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 18:02:01.621714 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-1fc0d5d5-a48b-40c4-bcfb-a8cda331c51c tempest-InstanceActionsV221TestJSON-1350459589 tempest-InstanceActionsV221TestJSON-1350459589-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.21 time: 1.731662 Aug 10 18:02:01.621714 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 981/1983] 10.222.0.50 () {62 vars in 1188 bytes} [Wed Aug 10 18:01:59 2022] POST /compute/v2.1/servers => generated 214 bytes in 1734 msecs (HTTP/1.1 500) 9 headers in 393 bytes (1 switches on core 0) Aug 10 18:02:15.055080 n-d-852296-2 devstack@n-api.service[129410]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 18:02:15.056724 n-d-852296-2 devstack@n-api.service[129410]: Wed Aug 10 18:02:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 18:02:15.220965 n-d-852296-2 devstack@n-api.service[129410]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 18:02:15.221166 n-d-852296-2 devstack@n-api.service[129410]: Wed Aug 10 18:02:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 18:02:16.035948 n-d-852296-2 devstack@n-api.service[129409]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 18:02:16.036567 n-d-852296-2 devstack@n-api.service[129409]: Wed Aug 10 18:02:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 18:02:24.114927 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-f70416bb-c8b0-4c11-b7ec-814094d77934 tempest-TaggedBootDevicesTest-529294924 tempest-TaggedBootDevicesTest-529294924-project] Action: 'create', calling method: .version_select at 0x7fb345e67790>, body: {"keypair": {"name": "tempest-keypair-453940614", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJr5V5cN1Rio+RTK7k/UXnvSMINhg4iMUawejEvm93LdbLjiZgyXq4Vx30OPQw88biFqrd+GDp/IWl+Az1MxzBFbkyUs/OxcksQsF/9GTnYLNDquPKwr+iJmx4lNxJkt7Q=="}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 18:02:24.151439 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-f70416bb-c8b0-4c11-b7ec-814094d77934 tempest-TaggedBootDevicesTest-529294924 tempest-TaggedBootDevicesTest-529294924-project] Getting quotas for project 3bec2ea808454f4e9b7f9f69a5aa89e5. Resources: {'key_pairs'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 18:02:24.164074 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-f70416bb-c8b0-4c11-b7ec-814094d77934 tempest-TaggedBootDevicesTest-529294924 tempest-TaggedBootDevicesTest-529294924-project] Getting quotas for user 7a480b98a1164063b8e05e97a6c6ce30 and project 3bec2ea808454f4e9b7f9f69a5aa89e5. Resources: {'key_pairs'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 18:02:24.293866 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-f70416bb-c8b0-4c11-b7ec-814094d77934 tempest-TaggedBootDevicesTest-529294924 tempest-TaggedBootDevicesTest-529294924-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.32 time: 0.185888 Aug 10 18:02:24.294561 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1003/1984] 10.222.0.50 () {62 vars in 1200 bytes} [Wed Aug 10 18:02:24 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 188 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 10 18:02:32.589194 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-23280806-674e-4a11-9933-1f71feadaf55 tempest-InstanceActionsNegativeTestJSON-1924288918 tempest-InstanceActionsNegativeTestJSON-1924288918-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-560903537", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "8af78fa9-1f68-4d81-b417-a662f98cc527"}]}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 18:02:32.700045 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-ed0d3f9c-5470-42c6-9bf4-1c436c06b91c tempest-TaggedBootDevicesTest-529294924 tempest-TaggedBootDevicesTest-529294924-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-504372705", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "8bc31f48-7b54-4560-b639-9cd7fd1ec496"}, {"port": "57a98386-379d-4199-938e-2ed4f8d055c1", "tag": "port-1"}, {"port": "028664dc-1d60-4f6f-a4f9-a462fd492107", "tag": "port-2"}, {"uuid": "9aeac279-4136-4bd6-b03d-af20d8d7eb74", "tag": "net-1"}, {"uuid": "9aeac279-4136-4bd6-b03d-af20d8d7eb74"}, {"uuid": "622e5534-7a55-4ac3-8cb5-fba75c29bb44", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "622e5534-7a55-4ac3-8cb5-fba75c29bb44", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "ec0bc941-604f-4a57-9b61-16f210b85dcb", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "7c81bbad-5c6c-450f-bd15-6681b888d26b", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "6b49e3b6-cf95-43e1-8e3e-4f7381689b3c", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1029724458"}], "key_name": "tempest-keypair-453940614", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 18:02:32.713537 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.network.neutron [None req-23280806-674e-4a11-9933-1f71feadaf55 tempest-InstanceActionsNegativeTestJSON-1924288918 tempest-InstanceActionsNegativeTestJSON-1924288918-project] validate_networks() for [('8af78fa9-1f68-4d81-b417-a662f98cc527', None, None, None, None, None)] {{(pid=129410) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 18:02:32.939071 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.network.neutron [None req-ed0d3f9c-5470-42c6-9bf4-1c436c06b91c tempest-TaggedBootDevicesTest-529294924 tempest-TaggedBootDevicesTest-529294924-project] validate_networks() for [('8bc31f48-7b54-4560-b639-9cd7fd1ec496', None, None, None, None, None), (None, None, '57a98386-379d-4199-938e-2ed4f8d055c1', None, None, None), (None, None, '028664dc-1d60-4f6f-a4f9-a462fd492107', None, None, None), ('9aeac279-4136-4bd6-b03d-af20d8d7eb74', None, None, None, None, None), ('9aeac279-4136-4bd6-b03d-af20d8d7eb74', None, None, None, None, None), ('622e5534-7a55-4ac3-8cb5-fba75c29bb44', '10.2.2.100', None, None, None, None), ('622e5534-7a55-4ac3-8cb5-fba75c29bb44', '10.2.2.200', None, None, None, None)] {{(pid=129409) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 18:02:33.583721 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [None req-23280806-674e-4a11-9933-1f71feadaf55 tempest-InstanceActionsNegativeTestJSON-1924288918 tempest-InstanceActionsNegativeTestJSON-1924288918-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-192b994e-7c6a-42e9-a2fa-d684eb9665b3) Aug 10 18:02:33.583721 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:02:33.583721 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:02:33.583721 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:02:33.583721 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:02:33.583721 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:02:33.583721 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:02:33.583721 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:02:33.583721 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:02:33.583721 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:02:33.583721 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 18:02:33.583721 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 18:02:33.583721 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 18:02:33.583721 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 18:02:33.583721 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 18:02:33.583721 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 18:02:33.583721 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 18:02:33.583721 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 18:02:33.583721 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 18:02:33.583721 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 18:02:33.583721 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 18:02:33.583721 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 18:02:33.583721 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 18:02:33.583721 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 18:02:33.583721 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 18:02:33.583721 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 18:02:33.583721 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 18:02:33.583721 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:02:33.583721 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:02:33.583721 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 18:02:33.583721 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 18:02:33.583721 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:02:33.583721 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:02:33.583721 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 18:02:33.583721 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 18:02:33.583721 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:02:33.583721 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:02:33.583721 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:02:33.583721 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:02:33.583721 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:02:33.583721 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:02:33.583721 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 18:02:33.583721 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 18:02:33.583721 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 18:02:33.583721 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 18:02:33.583721 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 18:02:33.583721 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 18:02:33.583721 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 18:02:33.583721 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 18:02:33.583721 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 18:02:33.583721 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 18:02:33.583721 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 18:02:33.587535 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 18:02:33.587535 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 18:02:33.587535 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 18:02:33.587535 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 18:02:33.587535 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 18:02:33.587535 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 18:02:33.587535 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 18:02:33.587535 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 18:02:33.587535 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 18:02:33.587535 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 18:02:33.587535 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 18:02:33.587535 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 18:02:33.587535 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 18:02:33.587535 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 18:02:33.587535 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 18:02:33.587535 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-192b994e-7c6a-42e9-a2fa-d684eb9665b3) Aug 10 18:02:33.587535 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:02:33.587535 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-23280806-674e-4a11-9933-1f71feadaf55 tempest-InstanceActionsNegativeTestJSON-1924288918 tempest-InstanceActionsNegativeTestJSON-1924288918-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:02:33.587535 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 18:02:33.591692 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-23280806-674e-4a11-9933-1f71feadaf55 tempest-InstanceActionsNegativeTestJSON-1924288918 tempest-InstanceActionsNegativeTestJSON-1924288918-project] Request method failure captured: Aug 10 18:02:33.591692 n-d-852296-2 devstack@n-api.service[129410]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 18:02:33.591692 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 18:02:33.591692 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 18:02:33.591692 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 18:02:33.591692 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 216 Aug 10 18:02:33.591692 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 18:02:33.591692 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 18:02:33.591692 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 18:02:33.591692 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 18:02:33.591692 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8_K3c_ghvihH8ruMexUtDGExginUDJZsvjma7Y45MzsNytWgaLEZY6ohjJ9RSm9F40OQ26q1NQrQmJgR3NeOk5Q6jPN3mUyvNVhGcy4kH9N4PZK7SAHvfuTn3qSYbaq6P0GFuhjsDw2cl4uJB3uTiLY8t9JFsTz28jgveAPqx28v8ng Aug 10 18:02:33.591692 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 18:02:33.591692 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 18:02:33.591692 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 18:02:33.591692 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 18:02:33.591692 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 18:02:33.591692 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 18:02:33.591692 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: 66600d2f0c374236822ea3ab8025695d Aug 10 18:02:33.591692 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1924288918 Aug 10 18:02:33.591692 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 18:02:33.591692 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 18:02:33.591692 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/66600d2f0c374236822ea3ab8025695d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/66600d2f0c374236822ea3ab8025695d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/66600d2f0c374236822ea3ab8025695d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_66600d2f0c374236822ea3ab8025695d", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 18:02:33.591692 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1924288918 Aug 10 18:02:33.591692 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: 66600d2f0c374236822ea3ab8025695d Aug 10 18:02:33.591692 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1924288918 Aug 10 18:02:33.591692 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-InstanceActionsNegativeTestJSON-1924288918-project Aug 10 18:02:33.591692 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 18:02:33.591692 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 18:02:33.591692 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: 830398e978c94da3a1cbb2ee7a4f2ce2 Aug 10 18:02:33.591692 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1924288918-project Aug 10 18:02:33.591692 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 18:02:33.591692 n-d-852296-2 devstack@n-api.service[129410]: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-560903537", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "8af78fa9-1f68-4d81-b417-a662f98cc527"}]}} Aug 10 18:02:33.591692 n-d-852296-2 devstack@n-api.service[129410]: method: > Aug 10 18:02:33.591692 n-d-852296-2 devstack@n-api.service[129410]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:02:33.591692 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 18:02:33.591692 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'body': {'server': {'name': 'tempest-InstanceActionsNegativeTestJSON-server-560903537', 'imageRef': 'a735ff26-463a-4ffe-a981-ab9d9baa494f', 'flavorRef': '452', 'networks': [{'uuid': '8af78fa9-1f68-4d81-b417-a662f98cc527'}]}}} Aug 10 18:02:33.591692 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 18:02:33.591692 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:02:33.591692 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:02:33.591692 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:02:33.591692 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:02:33.591692 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:02:33.591692 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:02:33.591692 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:02:33.591692 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:02:33.591692 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:02:33.591692 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 18:02:33.591692 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 18:02:33.591692 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 18:02:33.591692 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 18:02:33.591692 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 18:02:33.591692 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 18:02:33.591692 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 18:02:33.591692 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 18:02:33.591692 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 18:02:33.591692 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 18:02:33.591692 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 18:02:33.591692 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 18:02:33.591692 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 18:02:33.591692 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 18:02:33.591692 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 18:02:33.605897 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 18:02:33.605897 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 18:02:33.605897 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:02:33.605897 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:02:33.605897 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 18:02:33.605897 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 18:02:33.605897 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:02:33.605897 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:02:33.605897 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 18:02:33.605897 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 18:02:33.605897 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:02:33.605897 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:02:33.605897 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:02:33.605897 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:02:33.605897 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:02:33.605897 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:02:33.605897 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 18:02:33.605897 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 18:02:33.605897 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 18:02:33.605897 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 18:02:33.605897 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 18:02:33.605897 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 18:02:33.605897 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 18:02:33.605897 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 18:02:33.605897 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 18:02:33.605897 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 18:02:33.605897 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 18:02:33.605897 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 18:02:33.605897 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 18:02:33.605897 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 18:02:33.605897 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 18:02:33.605897 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 18:02:33.605897 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 18:02:33.605897 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 18:02:33.605897 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 18:02:33.605897 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 18:02:33.605897 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 18:02:33.605897 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 18:02:33.605897 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 18:02:33.605897 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 18:02:33.605897 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 18:02:33.605897 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 18:02:33.605897 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-192b994e-7c6a-42e9-a2fa-d684eb9665b3) Aug 10 18:02:33.605897 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:02:33.605897 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:02:33.605897 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:02:33.605897 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:02:33.605897 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:02:33.605897 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:02:33.605897 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 18:02:33.605897 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 18:02:33.605897 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 10 18:02:33.605897 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 10 18:02:33.622901 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:02:33.622901 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:02:33.622901 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:02:33.622901 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:02:33.622901 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:02:33.622901 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:02:33.622901 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:02:33.622901 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:02:33.622901 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 18:02:33.622901 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 18:02:33.622901 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:02:33.622901 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:02:33.622901 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:02:33.622901 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-23280806-674e-4a11-9933-1f71feadaf55 tempest-InstanceActionsNegativeTestJSON-1924288918 tempest-InstanceActionsNegativeTestJSON-1924288918-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:02:33.622901 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 18:02:33.622901 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-23280806-674e-4a11-9933-1f71feadaf55 tempest-InstanceActionsNegativeTestJSON-1924288918 tempest-InstanceActionsNegativeTestJSON-1924288918-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.638762 Aug 10 18:02:33.622901 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 982/1985] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 18:02:31 2022] POST /compute/v2.1/servers => generated 214 bytes in 1642 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 10 18:02:34.175570 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_cell0:SELECT=4 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 18:02:34.373328 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [None req-ed0d3f9c-5470-42c6-9bf4-1c436c06b91c tempest-TaggedBootDevicesTest-529294924 tempest-TaggedBootDevicesTest-529294924-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-e3e55b95-a175-4961-8833-a9b10dbe626e) Aug 10 18:02:34.373328 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:02:34.373328 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:02:34.373328 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:02:34.373328 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:02:34.373328 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:02:34.373328 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:02:34.373328 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:02:34.373328 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:02:34.373328 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:02:34.373328 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 18:02:34.373328 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 18:02:34.373328 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 18:02:34.373328 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 18:02:34.373328 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 18:02:34.373328 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 18:02:34.373328 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 18:02:34.373328 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 18:02:34.373328 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 18:02:34.373328 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 18:02:34.373328 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 18:02:34.373328 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 18:02:34.373328 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 18:02:34.373328 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 18:02:34.373328 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 18:02:34.373328 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 18:02:34.373328 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 18:02:34.373328 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:02:34.373328 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:02:34.373328 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 18:02:34.373328 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 18:02:34.373328 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:02:34.373328 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:02:34.373328 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 18:02:34.373328 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 18:02:34.373328 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:02:34.373328 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:02:34.373328 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:02:34.373328 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:02:34.373328 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:02:34.373328 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:02:34.373328 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 18:02:34.373328 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 18:02:34.373328 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 18:02:34.373328 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 18:02:34.373328 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 18:02:34.373328 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 18:02:34.373328 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 18:02:34.373328 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 18:02:34.373328 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 18:02:34.373328 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 18:02:34.373328 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 18:02:34.373328 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 18:02:34.382260 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 18:02:34.382260 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 18:02:34.382260 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 18:02:34.382260 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 18:02:34.382260 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 18:02:34.382260 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 18:02:34.382260 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 18:02:34.382260 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 18:02:34.382260 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 18:02:34.382260 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 18:02:34.382260 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 18:02:34.382260 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 18:02:34.382260 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 18:02:34.382260 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 18:02:34.382260 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-e3e55b95-a175-4961-8833-a9b10dbe626e) Aug 10 18:02:34.382260 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:02:34.382260 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-ed0d3f9c-5470-42c6-9bf4-1c436c06b91c tempest-TaggedBootDevicesTest-529294924 tempest-TaggedBootDevicesTest-529294924-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:02:34.382260 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 18:02:34.382260 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-ed0d3f9c-5470-42c6-9bf4-1c436c06b91c tempest-TaggedBootDevicesTest-529294924 tempest-TaggedBootDevicesTest-529294924-project] Request method failure captured: Aug 10 18:02:34.382260 n-d-852296-2 devstack@n-api.service[129409]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 18:02:34.382260 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 18:02:34.382260 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 18:02:34.382260 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 18:02:34.382260 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 1343 Aug 10 18:02:34.382260 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 18:02:34.382260 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 18:02:34.382260 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 18:02:34.382260 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 18:02:34.382260 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8_JexhexfXOelkXnjgddgwbPwF9RjA9XeFMzlASztsJ6usPkXCCndwUtzCttX-FK_QgzYp2Q_2nQZkBlL4Qu7ltbMB582GXK92xuP9qe0Q-aqUY7kZk8ilXM7OIGl9lrI4Fojt5pHbwh_CbyTp87i2CFzg5_EjjjInPwDHmhpfaiTME Aug 10 18:02:34.382260 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 18:02:34.382260 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 18:02:34.382260 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 18:02:34.382260 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 18:02:34.382260 n-d-852296-2 devstack@n-api.service[129409]: X-Openstack-Nova-Api-Version: 2.32 Aug 10 18:02:34.382260 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 18:02:34.382260 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 18:02:34.382260 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: 3bec2ea808454f4e9b7f9f69a5aa89e5 Aug 10 18:02:34.382260 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-TaggedBootDevicesTest-529294924 Aug 10 18:02:34.382260 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 18:02:34.382260 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 18:02:34.382260 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3bec2ea808454f4e9b7f9f69a5aa89e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3bec2ea808454f4e9b7f9f69a5aa89e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3bec2ea808454f4e9b7f9f69a5aa89e5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3bec2ea808454f4e9b7f9f69a5aa89e5", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 18:02:34.382260 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-TaggedBootDevicesTest-529294924 Aug 10 18:02:34.382260 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: 3bec2ea808454f4e9b7f9f69a5aa89e5 Aug 10 18:02:34.382260 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-TaggedBootDevicesTest-529294924 Aug 10 18:02:34.382260 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-TaggedBootDevicesTest-529294924-project Aug 10 18:02:34.382260 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 18:02:34.382260 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 18:02:34.382260 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: 7a480b98a1164063b8e05e97a6c6ce30 Aug 10 18:02:34.382260 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-TaggedBootDevicesTest-529294924-project Aug 10 18:02:34.382260 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 18:02:34.386148 n-d-852296-2 devstack@n-api.service[129409]: {"server": {"name": "tempest-device-tagging-server-504372705", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "8bc31f48-7b54-4560-b639-9cd7fd1ec496"}, {"port": "57a98386-379d-4199-938e-2ed4f8d055c1", "tag": "port-1"}, {"port": "028664dc-1d60-4f6f-a4f9-a462fd492107", "tag": "port-2"}, {"uuid": "9aeac279-4136-4bd6-b03d-af20d8d7eb74", "tag": "net-1"}, {"uuid": "9aeac279-4136-4bd6-b03d-af20d8d7eb74"}, {"uuid": "622e5534-7a55-4ac3-8cb5-fba75c29bb44", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "622e5534-7a55-4ac3-8cb5-fba75c29bb44", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "ec0bc941-604f-4a57-9b61-16f210b85dcb", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "7c81bbad-5c6c-450f-bd15-6681b888d26b", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "6b49e3b6-cf95-43e1-8e3e-4f7381689b3c", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1029724458"}], "key_name": "tempest-keypair-453940614", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} Aug 10 18:02:34.386148 n-d-852296-2 devstack@n-api.service[129409]: method: > Aug 10 18:02:34.386148 n-d-852296-2 devstack@n-api.service[129409]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:02:34.386148 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 18:02:34.386148 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'body': {'server': {'name': 'tempest-device-tagging-server-504372705', 'imageRef': 'a735ff26-463a-4ffe-a981-ab9d9baa494f', 'flavorRef': '452', 'config_drive': True, 'networks': [{'uuid': '8bc31f48-7b54-4560-b639-9cd7fd1ec496'}, {'port': '57a98386-379d-4199-938e-2ed4f8d055c1', 'tag': 'port-1'}, {'port': '028664dc-1d60-4f6f-a4f9-a462fd492107', 'tag': 'port-2'}, {'uuid': '9aeac279-4136-4bd6-b03d-af20d8d7eb74', 'tag': 'net-1'}, {'uuid': '9aeac279-4136-4bd6-b03d-af20d8d7eb74'}, {'uuid': '622e5534-7a55-4ac3-8cb5-fba75c29bb44', 'fixed_ip': '10.2.2.100', 'tag': 'net-2-100'}, {'uuid': '622e5534-7a55-4ac3-8cb5-fba75c29bb44', 'fixed_ip': '10.2.2.200', 'tag': 'net-2-200'}], 'block_device_mapping_v2': [{'source_type': 'volume', 'destination_type': 'volume', 'boot_index': 0, 'tag': 'boot', 'volume_id': 'ec0bc941-604f-4a57-9b61-16f210b85dcb', 'delete_on_termination': False}, {'source_type': 'volume', 'destination_type': 'volume', 'boot_index': 1, 'tag': 'other', 'volume_id': '7c81bbad-5c6c-450f-bd15-6681b888d26b', 'delete_on_termination': False}, {'source_type': 'volume', 'destination_type': 'volume', 'boot_index': 2, 'volume_id': '6b49e3b6-cf95-43e1-8e3e-4f7381689b3c', 'delete_on_termination': False}], 'security_groups': [{'name': 'tempest-securitygroup--1029724458'}], 'key_name': 'tempest-keypair-453940614', 'user_data': 'IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo='}}} Aug 10 18:02:34.386148 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 18:02:34.386148 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:02:34.386148 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:02:34.386148 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:02:34.386148 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:02:34.386148 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:02:34.386148 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:02:34.386148 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:02:34.386148 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:02:34.386148 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:02:34.386148 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 18:02:34.386148 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 18:02:34.386148 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 18:02:34.386148 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 18:02:34.386148 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 18:02:34.386148 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 18:02:34.386148 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 18:02:34.386148 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 18:02:34.386148 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 18:02:34.386148 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 18:02:34.386148 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 18:02:34.386148 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 18:02:34.386148 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 18:02:34.386148 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 18:02:34.386148 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 18:02:34.386148 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 18:02:34.386148 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 18:02:34.386148 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:02:34.386148 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:02:34.393316 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 18:02:34.393316 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 18:02:34.393316 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:02:34.393316 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:02:34.393316 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 18:02:34.393316 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 18:02:34.393316 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:02:34.393316 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:02:34.393316 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:02:34.393316 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:02:34.393316 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:02:34.393316 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:02:34.393316 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 18:02:34.393316 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 18:02:34.393316 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 18:02:34.393316 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 18:02:34.393316 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 18:02:34.393316 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 18:02:34.393316 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 18:02:34.393316 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 18:02:34.393316 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 18:02:34.393316 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 18:02:34.393316 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 18:02:34.393316 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 18:02:34.393316 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 18:02:34.393316 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 18:02:34.393316 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 18:02:34.393316 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 18:02:34.393316 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 18:02:34.393316 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 18:02:34.393316 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 18:02:34.393316 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 18:02:34.393316 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 18:02:34.393316 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 18:02:34.393316 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 18:02:34.393316 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 18:02:34.393316 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 18:02:34.393316 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 18:02:34.393316 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-e3e55b95-a175-4961-8833-a9b10dbe626e) Aug 10 18:02:34.393316 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:02:34.393316 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:02:34.393316 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:02:34.393316 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:02:34.393316 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:02:34.393316 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:02:34.393316 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 18:02:34.393316 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 18:02:34.393316 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 10 18:02:34.393316 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 10 18:02:34.393316 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:02:34.393316 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:02:34.393316 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:02:34.393316 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:02:34.397796 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:02:34.397796 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:02:34.397796 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:02:34.397796 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:02:34.397796 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 18:02:34.397796 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 18:02:34.397796 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:02:34.397796 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:02:34.397796 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:02:34.397796 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-ed0d3f9c-5470-42c6-9bf4-1c436c06b91c tempest-TaggedBootDevicesTest-529294924 tempest-TaggedBootDevicesTest-529294924-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:02:34.397796 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 18:02:34.397796 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-ed0d3f9c-5470-42c6-9bf4-1c436c06b91c tempest-TaggedBootDevicesTest-529294924 tempest-TaggedBootDevicesTest-529294924-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.32 time: 1.709198 Aug 10 18:02:34.397796 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1004/1986] 10.222.0.50 () {62 vars in 1189 bytes} [Wed Aug 10 18:02:32 2022] POST /compute/v2.1/servers => generated 214 bytes in 1711 msecs (HTTP/1.1 500) 9 headers in 393 bytes (1 switches on core 0) Aug 10 18:02:34.403461 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-b61801c9-a4ec-4705-944f-b23c916fba03 tempest-TaggedBootDevicesTest-529294924 tempest-TaggedBootDevicesTest-529294924-project] Calling method '.version_select at 0x7fb345d9d820>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:02:34.568585 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-b61801c9-a4ec-4705-944f-b23c916fba03 tempest-TaggedBootDevicesTest-529294924 tempest-TaggedBootDevicesTest-529294924-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-453940614" status: 204 len: 0 microversion: 2.32 time: 0.168816 Aug 10 18:02:34.569615 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 983/1987] 10.222.0.50 () {60 vars in 1259 bytes} [Wed Aug 10 18:02:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-453940614 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 10 18:02:53.983172 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=1 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 18:02:54.712362 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-8c26c1f5-fdf9-472a-a3bd-65bae4e3962b tempest-MultipleCreateNegativeTestJSON-1876538800 tempest-MultipleCreateNegativeTestJSON-1876538800-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1367419206", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 18:02:54.715750 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-8c26c1f5-fdf9-472a-a3bd-65bae4e3962b tempest-MultipleCreateNegativeTestJSON-1876538800 tempest-MultipleCreateNegativeTestJSON-1876538800-project] HTTP exception thrown: min_count must be <= max_count Aug 10 18:02:54.729708 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-8c26c1f5-fdf9-472a-a3bd-65bae4e3962b tempest-MultipleCreateNegativeTestJSON-1876538800 tempest-MultipleCreateNegativeTestJSON-1876538800-project] Request method failure captured: Aug 10 18:02:54.729708 n-d-852296-2 devstack@n-api.service[129409]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 18:02:54.729708 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 18:02:54.729708 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 18:02:54.729708 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 18:02:54.729708 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 184 Aug 10 18:02:54.729708 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 18:02:54.729708 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 18:02:54.729708 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 18:02:54.729708 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 18:02:54.729708 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8_LNzPdGIFVh4PnWp7LMKEX0WW4nGBH6ITmJ0IiePsy2wNSRzjZdusjSDeQGWhPx04VYv9f_IyJyfOffpHyTQLVXb8uV9eAtmOy-DAE1ToNiQwQftaJoL25ZkuRqY27k4SjEWJ0V2TpF8k3AUeHvgt3cCSoK8TW9SQlpFM6B9SOacgc Aug 10 18:02:54.729708 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 18:02:54.729708 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 18:02:54.729708 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 18:02:54.729708 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 18:02:54.729708 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 18:02:54.729708 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 18:02:54.729708 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: 2b3b01d461d54a69ac80c1d992420eaa Aug 10 18:02:54.729708 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1876538800 Aug 10 18:02:54.729708 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 18:02:54.729708 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 18:02:54.729708 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2b3b01d461d54a69ac80c1d992420eaa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/2b3b01d461d54a69ac80c1d992420eaa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2b3b01d461d54a69ac80c1d992420eaa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_2b3b01d461d54a69ac80c1d992420eaa", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 18:02:54.729708 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1876538800 Aug 10 18:02:54.729708 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: 2b3b01d461d54a69ac80c1d992420eaa Aug 10 18:02:54.729708 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1876538800 Aug 10 18:02:54.729708 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-MultipleCreateNegativeTestJSON-1876538800-project Aug 10 18:02:54.729708 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 18:02:54.729708 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 18:02:54.729708 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: f48ee90b6cb5489fbd455aec6190886f Aug 10 18:02:54.729708 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1876538800-project Aug 10 18:02:54.729708 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 18:02:54.729708 n-d-852296-2 devstack@n-api.service[129409]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1367419206", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "min_count": 3, "max_count": 2}} Aug 10 18:02:54.729708 n-d-852296-2 devstack@n-api.service[129409]: method: > Aug 10 18:02:54.729708 n-d-852296-2 devstack@n-api.service[129409]: exception: min_count must be <= max_count Aug 10 18:02:54.729708 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1367419206', 'imageRef': 'a735ff26-463a-4ffe-a981-ab9d9baa494f', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Aug 10 18:02:54.729708 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 18:02:54.729708 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:02:54.729708 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:02:54.729708 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:02:54.729708 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 18:02:54.729708 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 18:02:54.729708 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:02:54.729708 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:02:54.729708 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:02:54.729708 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:02:54.729708 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:02:54.729708 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:02:54.729708 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:02:54.729708 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:02:54.729708 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 18:02:54.729708 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Aug 10 18:02:54.729708 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 10 18:02:54.729708 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Aug 10 18:02:54.729708 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:02:54.729708 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:02:54.729708 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:02:54.729708 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:02:54.729708 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:02:54.729708 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:02:54.729708 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 18:02:54.729708 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 18:02:54.729708 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Aug 10 18:02:54.729708 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:02:54.741726 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-8c26c1f5-fdf9-472a-a3bd-65bae4e3962b tempest-MultipleCreateNegativeTestJSON-1876538800 tempest-MultipleCreateNegativeTestJSON-1876538800-project] Returning 400 to user: min_count must be <= max_count {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 18:02:54.741726 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-8c26c1f5-fdf9-472a-a3bd-65bae4e3962b tempest-MultipleCreateNegativeTestJSON-1876538800 tempest-MultipleCreateNegativeTestJSON-1876538800-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.751464 Aug 10 18:02:54.741726 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1005/1988] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 18:02:53 2022] POST /compute/v2.1/servers => generated 74 bytes in 753 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 10 18:02:55.248787 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_api:SELECT=7,nova_api:DELETE=1 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 18:02:55.254765 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-47a9fc1c-fb9b-4f3d-a065-9fe9e5c9378f tempest-MultipleCreateNegativeTestJSON-1876538800 tempest-MultipleCreateNegativeTestJSON-1876538800-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-697460033", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "max_count": 0}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 18:02:55.258958 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-47a9fc1c-fb9b-4f3d-a065-9fe9e5c9378f tempest-MultipleCreateNegativeTestJSON-1876538800 tempest-MultipleCreateNegativeTestJSON-1876538800-project] Request method failure captured: Aug 10 18:02:55.258958 n-d-852296-2 devstack@n-api.service[129410]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 18:02:55.258958 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 18:02:55.258958 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 18:02:55.258958 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 18:02:55.258958 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 167 Aug 10 18:02:55.258958 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 18:02:55.258958 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 18:02:55.258958 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 18:02:55.258958 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 18:02:55.258958 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8_LNzPdGIFVh4PnWp7LMKEX0WW4nGBH6ITmJ0IiePsy2wNSRzjZdusjSDeQGWhPx04VYv9f_IyJyfOffpHyTQLVXb8uV9eAtmOy-DAE1ToNiQwQftaJoL25ZkuRqY27k4SjEWJ0V2TpF8k3AUeHvgt3cCSoK8TW9SQlpFM6B9SOacgc Aug 10 18:02:55.258958 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 18:02:55.258958 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 18:02:55.258958 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 18:02:55.258958 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 18:02:55.258958 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 18:02:55.258958 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 18:02:55.258958 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: 2b3b01d461d54a69ac80c1d992420eaa Aug 10 18:02:55.258958 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1876538800 Aug 10 18:02:55.258958 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 18:02:55.258958 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 18:02:55.258958 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2b3b01d461d54a69ac80c1d992420eaa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/2b3b01d461d54a69ac80c1d992420eaa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2b3b01d461d54a69ac80c1d992420eaa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_2b3b01d461d54a69ac80c1d992420eaa", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 18:02:55.258958 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1876538800 Aug 10 18:02:55.258958 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: 2b3b01d461d54a69ac80c1d992420eaa Aug 10 18:02:55.258958 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1876538800 Aug 10 18:02:55.258958 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-MultipleCreateNegativeTestJSON-1876538800-project Aug 10 18:02:55.258958 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 18:02:55.258958 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 18:02:55.258958 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: f48ee90b6cb5489fbd455aec6190886f Aug 10 18:02:55.258958 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1876538800-project Aug 10 18:02:55.258958 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 18:02:55.258958 n-d-852296-2 devstack@n-api.service[129410]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-697460033", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "max_count": 0}} Aug 10 18:02:55.258958 n-d-852296-2 devstack@n-api.service[129410]: method: > Aug 10 18:02:55.258958 n-d-852296-2 devstack@n-api.service[129410]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Aug 10 18:02:55.258958 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-697460033', 'imageRef': 'a735ff26-463a-4ffe-a981-ab9d9baa494f', 'flavorRef': '452', 'max_count': 0}}} Aug 10 18:02:55.258958 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 18:02:55.258958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:02:55.258958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 10 18:02:55.258958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 10 18:02:55.258958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 10 18:02:55.258958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise error Aug 10 18:02:55.258958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 10 18:02:55.258958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:02:55.258958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Aug 10 18:02:55.258958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 10 18:02:55.258958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 10 18:02:55.258958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 10 18:02:55.258958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 10 18:02:55.258958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:02:55.258958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 10 18:02:55.258958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi 0 Aug 10 18:02:55.258958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:02:55.258958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:02:55.258958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:02:55.258958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:02:55.258958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:02:55.258958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:02:55.258958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 18:02:55.258958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 18:02:55.258958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:02:55.258958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:02:55.258958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:02:55.258958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:02:55.258958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 10 18:02:55.258958 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 10 18:02:55.264739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 10 18:02:55.264739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 10 18:02:55.264739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 10 18:02:55.264739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 10 18:02:55.264739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Aug 10 18:02:55.264739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:02:55.264739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:02:55.264739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:02:55.264739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:02:55.264739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:02:55.264739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:02:55.264739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 10 18:02:55.264739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 10 18:02:55.264739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Aug 10 18:02:55.264739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:02:55.264739 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-47a9fc1c-fb9b-4f3d-a065-9fe9e5c9378f tempest-MultipleCreateNegativeTestJSON-1876538800 tempest-MultipleCreateNegativeTestJSON-1876538800-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 18:02:55.276229 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-47a9fc1c-fb9b-4f3d-a065-9fe9e5c9378f tempest-MultipleCreateNegativeTestJSON-1876538800 tempest-MultipleCreateNegativeTestJSON-1876538800-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.013094 Aug 10 18:02:55.277256 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 984/1989] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 18:02:55 2022] POST /compute/v2.1/servers => generated 130 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 10 18:02:55.642665 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-60da28ee-f9a0-4678-8cb0-6053e5413b00 tempest-MultipleCreateNegativeTestJSON-1876538800 tempest-MultipleCreateNegativeTestJSON-1876538800-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1231047118", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "max_count": 2.5}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 18:02:55.646968 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-60da28ee-f9a0-4678-8cb0-6053e5413b00 tempest-MultipleCreateNegativeTestJSON-1876538800 tempest-MultipleCreateNegativeTestJSON-1876538800-project] Request method failure captured: Aug 10 18:02:55.646968 n-d-852296-2 devstack@n-api.service[129409]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 18:02:55.646968 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 18:02:55.646968 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 18:02:55.646968 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 18:02:55.646968 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 170 Aug 10 18:02:55.646968 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 18:02:55.646968 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 18:02:55.646968 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 18:02:55.646968 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 18:02:55.646968 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8_LNzPdGIFVh4PnWp7LMKEX0WW4nGBH6ITmJ0IiePsy2wNSRzjZdusjSDeQGWhPx04VYv9f_IyJyfOffpHyTQLVXb8uV9eAtmOy-DAE1ToNiQwQftaJoL25ZkuRqY27k4SjEWJ0V2TpF8k3AUeHvgt3cCSoK8TW9SQlpFM6B9SOacgc Aug 10 18:02:55.646968 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 18:02:55.646968 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 18:02:55.646968 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 18:02:55.646968 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 18:02:55.646968 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 18:02:55.646968 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 18:02:55.646968 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: 2b3b01d461d54a69ac80c1d992420eaa Aug 10 18:02:55.646968 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1876538800 Aug 10 18:02:55.646968 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 18:02:55.646968 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 18:02:55.646968 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2b3b01d461d54a69ac80c1d992420eaa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/2b3b01d461d54a69ac80c1d992420eaa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2b3b01d461d54a69ac80c1d992420eaa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_2b3b01d461d54a69ac80c1d992420eaa", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 18:02:55.646968 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1876538800 Aug 10 18:02:55.646968 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: 2b3b01d461d54a69ac80c1d992420eaa Aug 10 18:02:55.646968 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1876538800 Aug 10 18:02:55.646968 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-MultipleCreateNegativeTestJSON-1876538800-project Aug 10 18:02:55.646968 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 18:02:55.646968 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 18:02:55.646968 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: f48ee90b6cb5489fbd455aec6190886f Aug 10 18:02:55.646968 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1876538800-project Aug 10 18:02:55.646968 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 18:02:55.646968 n-d-852296-2 devstack@n-api.service[129409]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1231047118", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "max_count": 2.5}} Aug 10 18:02:55.646968 n-d-852296-2 devstack@n-api.service[129409]: method: > Aug 10 18:02:55.646968 n-d-852296-2 devstack@n-api.service[129409]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 10 18:02:55.646968 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1231047118', 'imageRef': 'a735ff26-463a-4ffe-a981-ab9d9baa494f', 'flavorRef': '452', 'max_count': 2.5}}} Aug 10 18:02:55.646968 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 18:02:55.646968 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:02:55.646968 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 10 18:02:55.646968 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 10 18:02:55.646968 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 10 18:02:55.646968 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise error Aug 10 18:02:55.646968 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Aug 10 18:02:55.646968 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:02:55.646968 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Aug 10 18:02:55.646968 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 10 18:02:55.646968 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 10 18:02:55.646968 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 10 18:02:55.646968 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 10 18:02:55.646968 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:02:55.646968 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 10 18:02:55.646968 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi 2.5 Aug 10 18:02:55.646968 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:02:55.646968 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:02:55.646968 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:02:55.646968 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:02:55.646968 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:02:55.646968 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:02:55.646968 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 18:02:55.646968 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 18:02:55.646968 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:02:55.646968 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:02:55.646968 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:02:55.646968 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:02:55.646968 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 10 18:02:55.646968 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 10 18:02:55.654927 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 10 18:02:55.654927 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 10 18:02:55.654927 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 10 18:02:55.654927 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 10 18:02:55.654927 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 10 18:02:55.654927 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:02:55.654927 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:02:55.654927 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:02:55.654927 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:02:55.654927 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:02:55.654927 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:02:55.654927 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 10 18:02:55.654927 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 10 18:02:55.654927 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 10 18:02:55.654927 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:02:55.654927 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-60da28ee-f9a0-4678-8cb0-6053e5413b00 tempest-MultipleCreateNegativeTestJSON-1876538800 tempest-MultipleCreateNegativeTestJSON-1876538800-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 18:02:55.654927 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-60da28ee-f9a0-4678-8cb0-6053e5413b00 tempest-MultipleCreateNegativeTestJSON-1876538800 tempest-MultipleCreateNegativeTestJSON-1876538800-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.011236 Aug 10 18:02:55.654927 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1006/1990] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 18:02:55 2022] POST /compute/v2.1/servers => generated 139 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 10 18:02:56.162621 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-6526ec06-d0cb-4a84-b5b6-db2ac2fbd213 tempest-MultipleCreateNegativeTestJSON-1876538800 tempest-MultipleCreateNegativeTestJSON-1876538800-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1850536288", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "min_count": 0}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 18:02:56.172021 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-6526ec06-d0cb-4a84-b5b6-db2ac2fbd213 tempest-MultipleCreateNegativeTestJSON-1876538800 tempest-MultipleCreateNegativeTestJSON-1876538800-project] Request method failure captured: Aug 10 18:02:56.172021 n-d-852296-2 devstack@n-api.service[129410]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 18:02:56.172021 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 18:02:56.172021 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 18:02:56.172021 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 18:02:56.172021 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 168 Aug 10 18:02:56.172021 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 18:02:56.172021 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 18:02:56.172021 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 18:02:56.172021 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 18:02:56.172021 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8_LNzPdGIFVh4PnWp7LMKEX0WW4nGBH6ITmJ0IiePsy2wNSRzjZdusjSDeQGWhPx04VYv9f_IyJyfOffpHyTQLVXb8uV9eAtmOy-DAE1ToNiQwQftaJoL25ZkuRqY27k4SjEWJ0V2TpF8k3AUeHvgt3cCSoK8TW9SQlpFM6B9SOacgc Aug 10 18:02:56.172021 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 18:02:56.172021 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 18:02:56.172021 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 18:02:56.172021 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 18:02:56.172021 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 18:02:56.172021 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 18:02:56.172021 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: 2b3b01d461d54a69ac80c1d992420eaa Aug 10 18:02:56.172021 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1876538800 Aug 10 18:02:56.172021 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 18:02:56.172021 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 18:02:56.172021 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2b3b01d461d54a69ac80c1d992420eaa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/2b3b01d461d54a69ac80c1d992420eaa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2b3b01d461d54a69ac80c1d992420eaa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_2b3b01d461d54a69ac80c1d992420eaa", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 18:02:56.172021 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1876538800 Aug 10 18:02:56.172021 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: 2b3b01d461d54a69ac80c1d992420eaa Aug 10 18:02:56.172021 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1876538800 Aug 10 18:02:56.172021 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-MultipleCreateNegativeTestJSON-1876538800-project Aug 10 18:02:56.172021 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 18:02:56.172021 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 18:02:56.172021 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: f48ee90b6cb5489fbd455aec6190886f Aug 10 18:02:56.172021 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1876538800-project Aug 10 18:02:56.172021 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 18:02:56.172021 n-d-852296-2 devstack@n-api.service[129410]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1850536288", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "min_count": 0}} Aug 10 18:02:56.172021 n-d-852296-2 devstack@n-api.service[129410]: method: > Aug 10 18:02:56.172021 n-d-852296-2 devstack@n-api.service[129410]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Aug 10 18:02:56.172021 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1850536288', 'imageRef': 'a735ff26-463a-4ffe-a981-ab9d9baa494f', 'flavorRef': '452', 'min_count': 0}}} Aug 10 18:02:56.172021 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 18:02:56.172021 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:02:56.172021 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 10 18:02:56.172021 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 10 18:02:56.172021 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 10 18:02:56.172021 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise error Aug 10 18:02:56.172021 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 10 18:02:56.172021 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:02:56.172021 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Aug 10 18:02:56.172021 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 10 18:02:56.172021 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 10 18:02:56.172021 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 10 18:02:56.172021 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 10 18:02:56.172021 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:02:56.172021 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 10 18:02:56.172021 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi 0 Aug 10 18:02:56.172021 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:02:56.172021 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:02:56.172021 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:02:56.172021 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:02:56.172021 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:02:56.172021 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:02:56.172021 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 18:02:56.172021 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 18:02:56.172021 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:02:56.172021 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:02:56.172021 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:02:56.172021 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:02:56.172021 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 10 18:02:56.172021 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 10 18:02:56.179005 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 10 18:02:56.179005 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 10 18:02:56.179005 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 10 18:02:56.179005 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 10 18:02:56.179005 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Aug 10 18:02:56.179005 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:02:56.179005 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:02:56.179005 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:02:56.179005 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:02:56.179005 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:02:56.179005 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:02:56.179005 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 10 18:02:56.179005 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 10 18:02:56.179005 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Aug 10 18:02:56.179005 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:02:56.179005 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-6526ec06-d0cb-4a84-b5b6-db2ac2fbd213 tempest-MultipleCreateNegativeTestJSON-1876538800 tempest-MultipleCreateNegativeTestJSON-1876538800-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 18:02:56.179005 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-6526ec06-d0cb-4a84-b5b6-db2ac2fbd213 tempest-MultipleCreateNegativeTestJSON-1876538800 tempest-MultipleCreateNegativeTestJSON-1876538800-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.015321 Aug 10 18:02:56.179005 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 985/1991] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 18:02:56 2022] POST /compute/v2.1/servers => generated 130 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 10 18:02:56.719087 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-c548f469-4d3e-415a-8567-247118f0afef tempest-MultipleCreateNegativeTestJSON-1876538800 tempest-MultipleCreateNegativeTestJSON-1876538800-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1901795848", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "min_count": 2.5}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 18:02:56.724221 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-c548f469-4d3e-415a-8567-247118f0afef tempest-MultipleCreateNegativeTestJSON-1876538800 tempest-MultipleCreateNegativeTestJSON-1876538800-project] Request method failure captured: Aug 10 18:02:56.724221 n-d-852296-2 devstack@n-api.service[129409]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 18:02:56.724221 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 18:02:56.724221 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 18:02:56.724221 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 18:02:56.724221 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 170 Aug 10 18:02:56.724221 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 18:02:56.724221 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 18:02:56.724221 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 18:02:56.724221 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 18:02:56.724221 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8_LNzPdGIFVh4PnWp7LMKEX0WW4nGBH6ITmJ0IiePsy2wNSRzjZdusjSDeQGWhPx04VYv9f_IyJyfOffpHyTQLVXb8uV9eAtmOy-DAE1ToNiQwQftaJoL25ZkuRqY27k4SjEWJ0V2TpF8k3AUeHvgt3cCSoK8TW9SQlpFM6B9SOacgc Aug 10 18:02:56.724221 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 18:02:56.724221 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 18:02:56.724221 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 18:02:56.724221 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 18:02:56.724221 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 18:02:56.724221 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 18:02:56.724221 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: 2b3b01d461d54a69ac80c1d992420eaa Aug 10 18:02:56.724221 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1876538800 Aug 10 18:02:56.724221 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 18:02:56.724221 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 18:02:56.724221 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2b3b01d461d54a69ac80c1d992420eaa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/2b3b01d461d54a69ac80c1d992420eaa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2b3b01d461d54a69ac80c1d992420eaa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_2b3b01d461d54a69ac80c1d992420eaa", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 18:02:56.724221 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1876538800 Aug 10 18:02:56.724221 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: 2b3b01d461d54a69ac80c1d992420eaa Aug 10 18:02:56.724221 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1876538800 Aug 10 18:02:56.724221 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-MultipleCreateNegativeTestJSON-1876538800-project Aug 10 18:02:56.724221 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 18:02:56.724221 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 18:02:56.724221 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: f48ee90b6cb5489fbd455aec6190886f Aug 10 18:02:56.724221 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1876538800-project Aug 10 18:02:56.724221 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 18:02:56.724221 n-d-852296-2 devstack@n-api.service[129409]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1901795848", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "min_count": 2.5}} Aug 10 18:02:56.724221 n-d-852296-2 devstack@n-api.service[129409]: method: > Aug 10 18:02:56.724221 n-d-852296-2 devstack@n-api.service[129409]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 10 18:02:56.724221 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1901795848', 'imageRef': 'a735ff26-463a-4ffe-a981-ab9d9baa494f', 'flavorRef': '452', 'min_count': 2.5}}} Aug 10 18:02:56.724221 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 18:02:56.724221 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:02:56.724221 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 10 18:02:56.724221 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 10 18:02:56.724221 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 10 18:02:56.724221 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise error Aug 10 18:02:56.724221 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Aug 10 18:02:56.724221 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:02:56.724221 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Aug 10 18:02:56.724221 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 10 18:02:56.724221 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 10 18:02:56.724221 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 10 18:02:56.724221 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 10 18:02:56.724221 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:02:56.724221 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 10 18:02:56.724221 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi 2.5 Aug 10 18:02:56.724221 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:02:56.724221 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:02:56.724221 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:02:56.724221 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:02:56.724221 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:02:56.724221 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:02:56.724221 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 18:02:56.724221 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 18:02:56.724221 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:02:56.724221 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:02:56.724221 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:02:56.724221 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:02:56.724221 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 10 18:02:56.724221 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 10 18:02:56.733216 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 10 18:02:56.733216 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 10 18:02:56.733216 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 10 18:02:56.733216 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 10 18:02:56.733216 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 10 18:02:56.733216 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:02:56.733216 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:02:56.733216 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:02:56.733216 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:02:56.733216 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:02:56.733216 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:02:56.733216 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 10 18:02:56.733216 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 10 18:02:56.733216 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 10 18:02:56.733216 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:02:56.733216 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-c548f469-4d3e-415a-8567-247118f0afef tempest-MultipleCreateNegativeTestJSON-1876538800 tempest-MultipleCreateNegativeTestJSON-1876538800-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 18:02:56.733216 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-c548f469-4d3e-415a-8567-247118f0afef tempest-MultipleCreateNegativeTestJSON-1876538800 tempest-MultipleCreateNegativeTestJSON-1876538800-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.011668 Aug 10 18:02:56.733216 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1007/1992] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 18:02:56 2022] POST /compute/v2.1/servers => generated 139 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 10 18:03:05.389502 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-6526ec06-d0cb-4a84-b5b6-db2ac2fbd213 tempest-MultipleCreateNegativeTestJSON-1876538800 tempest-MultipleCreateNegativeTestJSON-1876538800-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:03:05.390513 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-6526ec06-d0cb-4a84-b5b6-db2ac2fbd213 tempest-MultipleCreateNegativeTestJSON-1876538800 tempest-MultipleCreateNegativeTestJSON-1876538800-project] 10.222.0.50 "GET /compute//" status: 200 len: 377 microversion: - time: 0.003434 Aug 10 18:03:05.390858 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 986/1993] 10.222.0.50 () {56 vars in 886 bytes} [Wed Aug 10 18:03:05 2022] GET /compute/ => generated 377 bytes in 4 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 10 18:03:12.325188 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-659fc09b-8d87-42da-a68f-ed19f87db28b tempest-VolumesSnapshotsTestJSON-1433915430 tempest-VolumesSnapshotsTestJSON-1433915430-project] Action: 'create', calling method: .version_select at 0x7fb345e67040>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1522938252"}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 18:03:13.373833 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-659fc09b-8d87-42da-a68f-ed19f87db28b tempest-VolumesSnapshotsTestJSON-1433915430 tempest-VolumesSnapshotsTestJSON-1433915430-project] 10.222.0.50 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 1.250691 Aug 10 18:03:13.383140 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1008/1994] 10.222.0.50 () {60 vars in 1155 bytes} [Wed Aug 10 18:03:12 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 1252 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Aug 10 18:03:13.391018 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-86e2e837-3b2f-4218-9d6e-6d36180941c4 tempest-VolumesSnapshotsTestJSON-1433915430 tempest-VolumesSnapshotsTestJSON-1433915430-project] Calling method '.version_select at 0x7fb345b61310>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:03:13.453874 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-86e2e837-3b2f-4218-9d6e-6d36180941c4 tempest-VolumesSnapshotsTestJSON-1433915430 tempest-VolumesSnapshotsTestJSON-1433915430-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/c4530bc8-aec0-4c02-ba4c-5162652b7af2" status: 200 len: 345 microversion: 2.1 time: 0.070092 Aug 10 18:03:13.455422 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 987/1995] 10.222.0.50 () {58 vars in 1245 bytes} [Wed Aug 10 18:03:13 2022] GET /compute/v2.1/os-volumes/c4530bc8-aec0-4c02-ba4c-5162652b7af2 => generated 345 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 18:03:13.896670 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-080cf2d3-9fe9-4bc9-9c40-9fd8a3850b9c tempest-VolumesActionsTest-931379613 tempest-VolumesActionsTest-931379613-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1912059871", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "2f59edb7-678a-4f09-af11-c66c30ea8730"}]}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 18:03:13.976097 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.network.neutron [None req-080cf2d3-9fe9-4bc9-9c40-9fd8a3850b9c tempest-VolumesActionsTest-931379613 tempest-VolumesActionsTest-931379613-project] validate_networks() for [('2f59edb7-678a-4f09-af11-c66c30ea8730', None, None, None, None, None)] {{(pid=129409) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 18:03:14.469780 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-8edc957c-78c8-4818-9d3b-d3b95e52e3b7 tempest-VolumesSnapshotsTestJSON-1433915430 tempest-VolumesSnapshotsTestJSON-1433915430-project] Calling method '.version_select at 0x7fb345c73670>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:03:14.535142 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-8edc957c-78c8-4818-9d3b-d3b95e52e3b7 tempest-VolumesSnapshotsTestJSON-1433915430 tempest-VolumesSnapshotsTestJSON-1433915430-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/c4530bc8-aec0-4c02-ba4c-5162652b7af2" status: 200 len: 345 microversion: 2.1 time: 0.070310 Aug 10 18:03:14.535710 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 988/1996] 10.222.0.50 () {58 vars in 1245 bytes} [Wed Aug 10 18:03:14 2022] GET /compute/v2.1/os-volumes/c4530bc8-aec0-4c02-ba4c-5162652b7af2 => generated 345 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 18:03:14.688838 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [None req-080cf2d3-9fe9-4bc9-9c40-9fd8a3850b9c tempest-VolumesActionsTest-931379613 tempest-VolumesActionsTest-931379613-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-96521520-af0c-423f-9a20-0f07d8b69796) Aug 10 18:03:14.688838 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:03:14.688838 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:03:14.688838 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:03:14.688838 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:03:14.688838 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:03:14.688838 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:03:14.688838 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:03:14.688838 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:03:14.688838 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:03:14.688838 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 18:03:14.688838 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 18:03:14.688838 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 18:03:14.688838 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 18:03:14.688838 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 18:03:14.688838 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 18:03:14.688838 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 18:03:14.688838 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 18:03:14.688838 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 18:03:14.688838 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 18:03:14.688838 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 18:03:14.688838 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 18:03:14.688838 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 18:03:14.688838 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 18:03:14.688838 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 18:03:14.688838 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 18:03:14.688838 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 18:03:14.688838 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:03:14.688838 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:03:14.688838 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 18:03:14.688838 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 18:03:14.688838 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:03:14.688838 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:03:14.688838 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 18:03:14.688838 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 18:03:14.688838 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:03:14.688838 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:03:14.688838 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:03:14.688838 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:03:14.688838 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:03:14.688838 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:03:14.688838 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 18:03:14.688838 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 18:03:14.688838 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 18:03:14.688838 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 18:03:14.688838 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 18:03:14.688838 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 18:03:14.688838 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 18:03:14.688838 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 18:03:14.688838 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 18:03:14.688838 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 18:03:14.688838 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 18:03:14.688838 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 18:03:14.695245 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 18:03:14.695245 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 18:03:14.695245 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 18:03:14.695245 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 18:03:14.695245 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 18:03:14.695245 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 18:03:14.695245 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 18:03:14.695245 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 18:03:14.695245 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 18:03:14.695245 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 18:03:14.695245 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 18:03:14.695245 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 18:03:14.695245 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 18:03:14.695245 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 18:03:14.695245 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-96521520-af0c-423f-9a20-0f07d8b69796) Aug 10 18:03:14.695245 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:03:14.695245 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-080cf2d3-9fe9-4bc9-9c40-9fd8a3850b9c tempest-VolumesActionsTest-931379613 tempest-VolumesActionsTest-931379613-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:03:14.695245 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 18:03:14.695245 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-080cf2d3-9fe9-4bc9-9c40-9fd8a3850b9c tempest-VolumesActionsTest-931379613 tempest-VolumesActionsTest-931379613-project] Request method failure captured: Aug 10 18:03:14.695245 n-d-852296-2 devstack@n-api.service[129409]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 18:03:14.695245 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 18:03:14.695245 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 18:03:14.695245 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 18:03:14.695245 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 206 Aug 10 18:03:14.695245 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 18:03:14.695245 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 18:03:14.695245 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 18:03:14.695245 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 18:03:14.695245 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8_LcTDo5CsVzXWJVP7IKHruPLcGw5Kr-kwqKFPzgXbUJjR4H8H5frfn29m9XtjXuA9Z9uYEoVpqBAHBERiHdE4Drjw1VLwJ9vPRMH-86RbB74RjjDGzlEQ9LZ1mw_7AffO7pRfWFGk6Tf3-_SAFPDaAtaOP6qPCYTQvBq2yxEEIiLBc Aug 10 18:03:14.695245 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 18:03:14.695245 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 18:03:14.695245 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 18:03:14.695245 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 18:03:14.695245 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 18:03:14.695245 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 18:03:14.695245 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: e454d92f8aac410d9db007f3056476a2 Aug 10 18:03:14.695245 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-VolumesActionsTest-931379613 Aug 10 18:03:14.695245 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 18:03:14.695245 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 18:03:14.695245 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e454d92f8aac410d9db007f3056476a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/e454d92f8aac410d9db007f3056476a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e454d92f8aac410d9db007f3056476a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_e454d92f8aac410d9db007f3056476a2", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 18:03:14.695245 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-VolumesActionsTest-931379613 Aug 10 18:03:14.695245 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: e454d92f8aac410d9db007f3056476a2 Aug 10 18:03:14.695245 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-VolumesActionsTest-931379613 Aug 10 18:03:14.695245 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-VolumesActionsTest-931379613-project Aug 10 18:03:14.695245 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 18:03:14.695245 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 18:03:14.695245 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: 6aaf94babf924829b4f92cce3b544f68 Aug 10 18:03:14.695245 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-VolumesActionsTest-931379613-project Aug 10 18:03:14.695245 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 18:03:14.695245 n-d-852296-2 devstack@n-api.service[129409]: {"server": {"name": "tempest-VolumesActionsTest-instance-1912059871", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "2f59edb7-678a-4f09-af11-c66c30ea8730"}]}} Aug 10 18:03:14.695245 n-d-852296-2 devstack@n-api.service[129409]: method: > Aug 10 18:03:14.695245 n-d-852296-2 devstack@n-api.service[129409]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:03:14.695245 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 18:03:14.695245 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'body': {'server': {'name': 'tempest-VolumesActionsTest-instance-1912059871', 'imageRef': 'a735ff26-463a-4ffe-a981-ab9d9baa494f', 'flavorRef': '452', 'networks': [{'uuid': '2f59edb7-678a-4f09-af11-c66c30ea8730'}]}}} Aug 10 18:03:14.695245 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 18:03:14.695245 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:03:14.705517 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:03:14.705517 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:03:14.705517 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:03:14.705517 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:03:14.705517 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:03:14.705517 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:03:14.705517 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:03:14.705517 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:03:14.705517 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 18:03:14.705517 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 18:03:14.705517 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 18:03:14.705517 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 18:03:14.705517 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 18:03:14.705517 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 18:03:14.705517 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 18:03:14.705517 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 18:03:14.705517 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 18:03:14.705517 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 18:03:14.705517 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 18:03:14.705517 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 18:03:14.705517 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 18:03:14.705517 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 18:03:14.705517 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 18:03:14.705517 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 18:03:14.705517 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 18:03:14.705517 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:03:14.705517 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:03:14.705517 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 18:03:14.705517 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 18:03:14.705517 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:03:14.705517 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:03:14.705517 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 18:03:14.705517 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 18:03:14.705517 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:03:14.705517 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:03:14.705517 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:03:14.705517 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:03:14.705517 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:03:14.705517 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:03:14.705517 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 18:03:14.705517 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 18:03:14.705517 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 18:03:14.705517 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 18:03:14.705517 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 18:03:14.705517 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 18:03:14.705517 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 18:03:14.705517 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 18:03:14.705517 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 18:03:14.705517 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 18:03:14.705517 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 18:03:14.705517 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 18:03:14.705517 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 18:03:14.705517 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 18:03:14.705517 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 18:03:14.705517 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 18:03:14.712479 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 18:03:14.712479 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 18:03:14.712479 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 18:03:14.712479 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 18:03:14.712479 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 18:03:14.712479 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 18:03:14.712479 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 18:03:14.712479 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 18:03:14.712479 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 18:03:14.712479 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 18:03:14.712479 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-96521520-af0c-423f-9a20-0f07d8b69796) Aug 10 18:03:14.712479 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:03:14.712479 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:03:14.712479 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:03:14.712479 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:03:14.712479 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:03:14.712479 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:03:14.712479 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 18:03:14.712479 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 18:03:14.712479 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 10 18:03:14.712479 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 10 18:03:14.712479 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:03:14.712479 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:03:14.712479 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:03:14.712479 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:03:14.712479 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:03:14.712479 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:03:14.712479 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:03:14.712479 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:03:14.712479 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 18:03:14.712479 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 18:03:14.712479 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:03:14.712479 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:03:14.712479 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:03:14.712479 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-080cf2d3-9fe9-4bc9-9c40-9fd8a3850b9c tempest-VolumesActionsTest-931379613 tempest-VolumesActionsTest-931379613-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:03:14.712479 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 18:03:14.712479 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-080cf2d3-9fe9-4bc9-9c40-9fd8a3850b9c tempest-VolumesActionsTest-931379613 tempest-VolumesActionsTest-931379613-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.802870 Aug 10 18:03:14.712479 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1009/1997] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 18:03:13 2022] POST /compute/v2.1/servers => generated 214 bytes in 813 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 10 18:03:15.387029 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-f8846bfd-8599-483a-b46b-213b210e609a tempest-VolumesActionsTest-931379613 tempest-VolumesActionsTest-931379613-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1340255057", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "2f59edb7-678a-4f09-af11-c66c30ea8730"}]}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 18:03:15.463046 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.network.neutron [None req-f8846bfd-8599-483a-b46b-213b210e609a tempest-VolumesActionsTest-931379613 tempest-VolumesActionsTest-931379613-project] validate_networks() for [('2f59edb7-678a-4f09-af11-c66c30ea8730', None, None, None, None, None)] {{(pid=129410) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 18:03:15.551694 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-7249d5c9-b671-43fb-b1b0-4abbbfed9de2 tempest-VolumesSnapshotsTestJSON-1433915430 tempest-VolumesSnapshotsTestJSON-1433915430-project] Calling method '.version_select at 0x7fb345d32430>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:03:15.652003 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-7249d5c9-b671-43fb-b1b0-4abbbfed9de2 tempest-VolumesSnapshotsTestJSON-1433915430 tempest-VolumesSnapshotsTestJSON-1433915430-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/c4530bc8-aec0-4c02-ba4c-5162652b7af2" status: 200 len: 346 microversion: 2.1 time: 0.106529 Aug 10 18:03:15.652606 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1010/1998] 10.222.0.50 () {58 vars in 1245 bytes} [Wed Aug 10 18:03:15 2022] GET /compute/v2.1/os-volumes/c4530bc8-aec0-4c02-ba4c-5162652b7af2 => generated 346 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 18:03:15.665384 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-053cab5d-6214-47f0-9dab-a609a283baae tempest-VolumesSnapshotsTestJSON-1433915430 tempest-VolumesSnapshotsTestJSON-1433915430-project] Action: 'create', calling method: .version_select at 0x7fb345dfd160>, body: {"snapshot": {"volume_id": "c4530bc8-aec0-4c02-ba4c-5162652b7af2", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1287882642"}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 18:03:16.361864 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-053cab5d-6214-47f0-9dab-a609a283baae tempest-VolumesSnapshotsTestJSON-1433915430 tempest-VolumesSnapshotsTestJSON-1433915430-project] 10.222.0.50 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.699951 Aug 10 18:03:16.363321 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1011/1999] 10.222.0.50 () {60 vars in 1162 bytes} [Wed Aug 10 18:03:15 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 18:03:16.374744 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-1faae05e-8003-4f4b-af3e-07c252cf9305 tempest-VolumesSnapshotsTestJSON-1433915430 tempest-VolumesSnapshotsTestJSON-1433915430-project] Calling method '.version_select at 0x7fb345d32ee0>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:03:16.448921 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-1faae05e-8003-4f4b-af3e-07c252cf9305 tempest-VolumesSnapshotsTestJSON-1433915430 tempest-VolumesSnapshotsTestJSON-1433915430-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/f86344b5-7799-4e84-90ce-eeb19f624c5f" status: 200 len: 287 microversion: 2.1 time: 0.078480 Aug 10 18:03:16.449828 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1012/2000] 10.222.0.50 () {58 vars in 1251 bytes} [Wed Aug 10 18:03:16 2022] GET /compute/v2.1/os-snapshots/f86344b5-7799-4e84-90ce-eeb19f624c5f => generated 287 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 18:03:16.460707 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-a0f4606e-f82f-4e64-a615-eb84936711a2 tempest-VolumesSnapshotsTestJSON-1433915430 tempest-VolumesSnapshotsTestJSON-1433915430-project] Calling method '.version_select at 0x7fb346784ee0>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:03:16.510686 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-a0f4606e-f82f-4e64-a615-eb84936711a2 tempest-VolumesSnapshotsTestJSON-1433915430 tempest-VolumesSnapshotsTestJSON-1433915430-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.053667 Aug 10 18:03:16.511332 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1013/2001] 10.222.0.50 () {58 vars in 1140 bytes} [Wed Aug 10 18:03:16 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 18:03:16.522016 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-1964bf40-4235-4c62-9872-29d61415bd40 tempest-VolumesSnapshotsTestJSON-1433915430 tempest-VolumesSnapshotsTestJSON-1433915430-project] Calling method '.version_select at 0x7fb345ebedc0>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:03:16.551215 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [None req-f8846bfd-8599-483a-b46b-213b210e609a tempest-VolumesActionsTest-931379613 tempest-VolumesActionsTest-931379613-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-e54b87ff-be10-4286-8f2f-55f184f5746a) Aug 10 18:03:16.551215 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:03:16.551215 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:03:16.551215 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:03:16.551215 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:03:16.551215 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:03:16.551215 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:03:16.551215 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:03:16.551215 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:03:16.551215 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:03:16.551215 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 18:03:16.551215 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 18:03:16.551215 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 18:03:16.551215 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 18:03:16.551215 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 18:03:16.551215 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 18:03:16.551215 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 18:03:16.551215 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 18:03:16.551215 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 18:03:16.551215 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 18:03:16.551215 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 18:03:16.551215 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 18:03:16.551215 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 18:03:16.551215 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 18:03:16.551215 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 18:03:16.551215 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 18:03:16.551215 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 18:03:16.551215 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:03:16.551215 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:03:16.551215 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 18:03:16.551215 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 18:03:16.551215 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:03:16.551215 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:03:16.551215 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 18:03:16.551215 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 18:03:16.551215 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:03:16.551215 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:03:16.551215 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:03:16.551215 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:03:16.551215 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:03:16.551215 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:03:16.551215 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 18:03:16.551215 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 18:03:16.551215 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 18:03:16.551215 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 18:03:16.551215 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 18:03:16.551215 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 18:03:16.551215 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 18:03:16.551215 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 18:03:16.551215 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 18:03:16.551215 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 18:03:16.551215 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 18:03:16.551215 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 18:03:16.556605 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 18:03:16.556605 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 18:03:16.556605 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 18:03:16.556605 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 18:03:16.556605 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 18:03:16.556605 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 18:03:16.556605 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 18:03:16.556605 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 18:03:16.556605 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 18:03:16.556605 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 18:03:16.556605 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 18:03:16.556605 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 18:03:16.556605 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 18:03:16.556605 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 18:03:16.556605 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-e54b87ff-be10-4286-8f2f-55f184f5746a) Aug 10 18:03:16.556605 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:03:16.556605 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-f8846bfd-8599-483a-b46b-213b210e609a tempest-VolumesActionsTest-931379613 tempest-VolumesActionsTest-931379613-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:03:16.556605 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 18:03:16.556605 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-f8846bfd-8599-483a-b46b-213b210e609a tempest-VolumesActionsTest-931379613 tempest-VolumesActionsTest-931379613-project] Request method failure captured: Aug 10 18:03:16.556605 n-d-852296-2 devstack@n-api.service[129410]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 18:03:16.556605 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 18:03:16.556605 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 18:03:16.556605 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 18:03:16.556605 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 206 Aug 10 18:03:16.556605 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 18:03:16.556605 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 18:03:16.556605 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 18:03:16.556605 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 18:03:16.556605 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8_LcTDo5CsVzXWJVP7IKHruPLcGw5Kr-kwqKFPzgXbUJjR4H8H5frfn29m9XtjXuA9Z9uYEoVpqBAHBERiHdE4Drjw1VLwJ9vPRMH-86RbB74RjjDGzlEQ9LZ1mw_7AffO7pRfWFGk6Tf3-_SAFPDaAtaOP6qPCYTQvBq2yxEEIiLBc Aug 10 18:03:16.556605 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 18:03:16.556605 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 18:03:16.556605 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 18:03:16.556605 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 18:03:16.556605 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 18:03:16.556605 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 18:03:16.556605 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: e454d92f8aac410d9db007f3056476a2 Aug 10 18:03:16.556605 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-VolumesActionsTest-931379613 Aug 10 18:03:16.556605 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 18:03:16.556605 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 18:03:16.556605 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e454d92f8aac410d9db007f3056476a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/e454d92f8aac410d9db007f3056476a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e454d92f8aac410d9db007f3056476a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_e454d92f8aac410d9db007f3056476a2", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 18:03:16.556605 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-VolumesActionsTest-931379613 Aug 10 18:03:16.556605 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: e454d92f8aac410d9db007f3056476a2 Aug 10 18:03:16.556605 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-VolumesActionsTest-931379613 Aug 10 18:03:16.556605 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-VolumesActionsTest-931379613-project Aug 10 18:03:16.556605 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 18:03:16.556605 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 18:03:16.556605 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: 6aaf94babf924829b4f92cce3b544f68 Aug 10 18:03:16.556605 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-VolumesActionsTest-931379613-project Aug 10 18:03:16.556605 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 18:03:16.556605 n-d-852296-2 devstack@n-api.service[129410]: {"server": {"name": "tempest-VolumesActionsTest-instance-1340255057", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "2f59edb7-678a-4f09-af11-c66c30ea8730"}]}} Aug 10 18:03:16.556605 n-d-852296-2 devstack@n-api.service[129410]: method: > Aug 10 18:03:16.556605 n-d-852296-2 devstack@n-api.service[129410]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:03:16.556605 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 18:03:16.556605 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'body': {'server': {'name': 'tempest-VolumesActionsTest-instance-1340255057', 'imageRef': 'a735ff26-463a-4ffe-a981-ab9d9baa494f', 'flavorRef': '452', 'networks': [{'uuid': '2f59edb7-678a-4f09-af11-c66c30ea8730'}]}}} Aug 10 18:03:16.556605 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 18:03:16.556605 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:03:16.563385 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:03:16.563385 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:03:16.563385 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:03:16.563385 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:03:16.563385 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:03:16.563385 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:03:16.563385 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:03:16.563385 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:03:16.563385 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 18:03:16.563385 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 18:03:16.563385 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 18:03:16.563385 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 18:03:16.563385 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 18:03:16.563385 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 18:03:16.563385 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 18:03:16.563385 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 18:03:16.563385 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 18:03:16.563385 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 18:03:16.563385 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 18:03:16.563385 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 18:03:16.563385 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 18:03:16.563385 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 18:03:16.563385 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 18:03:16.563385 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 18:03:16.563385 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 18:03:16.563385 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:03:16.563385 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:03:16.563385 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 18:03:16.563385 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 18:03:16.563385 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:03:16.563385 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:03:16.563385 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 18:03:16.563385 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 18:03:16.563385 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:03:16.563385 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:03:16.563385 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:03:16.563385 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:03:16.563385 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:03:16.563385 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:03:16.563385 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 18:03:16.563385 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 18:03:16.563385 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 18:03:16.563385 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 18:03:16.563385 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 18:03:16.563385 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 18:03:16.563385 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 18:03:16.563385 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 18:03:16.563385 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 18:03:16.563385 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 18:03:16.563385 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 18:03:16.563385 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 18:03:16.563385 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 18:03:16.563385 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 18:03:16.563385 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 18:03:16.563385 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 18:03:16.582227 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 18:03:16.582227 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 18:03:16.582227 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 18:03:16.582227 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 18:03:16.582227 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 18:03:16.582227 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 18:03:16.582227 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 18:03:16.582227 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 18:03:16.582227 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 18:03:16.582227 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 18:03:16.582227 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-e54b87ff-be10-4286-8f2f-55f184f5746a) Aug 10 18:03:16.582227 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:03:16.582227 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:03:16.582227 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:03:16.582227 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:03:16.582227 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:03:16.582227 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:03:16.582227 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 18:03:16.582227 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 18:03:16.582227 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 10 18:03:16.582227 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 10 18:03:16.582227 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:03:16.582227 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:03:16.582227 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:03:16.582227 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:03:16.582227 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:03:16.582227 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:03:16.582227 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:03:16.582227 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:03:16.582227 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 18:03:16.582227 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 18:03:16.582227 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:03:16.582227 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:03:16.582227 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:03:16.582227 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-f8846bfd-8599-483a-b46b-213b210e609a tempest-VolumesActionsTest-931379613 tempest-VolumesActionsTest-931379613-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:03:16.582227 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 18:03:16.582227 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-f8846bfd-8599-483a-b46b-213b210e609a tempest-VolumesActionsTest-931379613 tempest-VolumesActionsTest-931379613-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.173134 Aug 10 18:03:16.588083 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 989/2002] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 18:03:15 2022] POST /compute/v2.1/servers => generated 214 bytes in 1206 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 10 18:03:16.591033 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-1964bf40-4235-4c62-9872-29d61415bd40 tempest-VolumesSnapshotsTestJSON-1433915430 tempest-VolumesSnapshotsTestJSON-1433915430-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/f86344b5-7799-4e84-90ce-eeb19f624c5f" status: 200 len: 287 microversion: 2.1 time: 0.072722 Aug 10 18:03:16.599156 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1014/2003] 10.222.0.50 () {58 vars in 1251 bytes} [Wed Aug 10 18:03:16 2022] GET /compute/v2.1/os-snapshots/f86344b5-7799-4e84-90ce-eeb19f624c5f => generated 287 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 18:03:17.612630 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-4788e037-a976-4568-9724-589eebd8a0cf tempest-VolumesSnapshotsTestJSON-1433915430 tempest-VolumesSnapshotsTestJSON-1433915430-project] Calling method '.version_select at 0x7fb346523820>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:03:17.643311 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-4788e037-a976-4568-9724-589eebd8a0cf tempest-VolumesSnapshotsTestJSON-1433915430 tempest-VolumesSnapshotsTestJSON-1433915430-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/f86344b5-7799-4e84-90ce-eeb19f624c5f" status: 200 len: 287 microversion: 2.1 time: 0.035861 Aug 10 18:03:17.644020 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 990/2004] 10.222.0.50 () {58 vars in 1251 bytes} [Wed Aug 10 18:03:17 2022] GET /compute/v2.1/os-snapshots/f86344b5-7799-4e84-90ce-eeb19f624c5f => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 18:03:18.659965 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-d14747fd-49c3-4501-abbd-72ba3630760f tempest-VolumesSnapshotsTestJSON-1433915430 tempest-VolumesSnapshotsTestJSON-1433915430-project] Calling method '.version_select at 0x7fb345d1dd30>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:03:18.726394 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-d14747fd-49c3-4501-abbd-72ba3630760f tempest-VolumesSnapshotsTestJSON-1433915430 tempest-VolumesSnapshotsTestJSON-1433915430-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/f86344b5-7799-4e84-90ce-eeb19f624c5f" status: 200 len: 287 microversion: 2.1 time: 0.072600 Aug 10 18:03:18.727056 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1015/2005] 10.222.0.50 () {58 vars in 1251 bytes} [Wed Aug 10 18:03:18 2022] GET /compute/v2.1/os-snapshots/f86344b5-7799-4e84-90ce-eeb19f624c5f => generated 287 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 18:03:19.743170 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-f5d8ff17-16a9-412d-9c54-7dd66e8eb304 tempest-VolumesSnapshotsTestJSON-1433915430 tempest-VolumesSnapshotsTestJSON-1433915430-project] Calling method '.version_select at 0x7fb346562a60>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:03:19.791933 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-f5d8ff17-16a9-412d-9c54-7dd66e8eb304 tempest-VolumesSnapshotsTestJSON-1433915430 tempest-VolumesSnapshotsTestJSON-1433915430-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/f86344b5-7799-4e84-90ce-eeb19f624c5f" status: 200 len: 288 microversion: 2.1 time: 0.055550 Aug 10 18:03:19.801309 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 991/2006] 10.222.0.50 () {58 vars in 1251 bytes} [Wed Aug 10 18:03:19 2022] GET /compute/v2.1/os-snapshots/f86344b5-7799-4e84-90ce-eeb19f624c5f => generated 288 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 18:03:19.804476 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-50660192-3b19-4450-b3f4-072904b113be tempest-VolumesSnapshotsTestJSON-1433915430 tempest-VolumesSnapshotsTestJSON-1433915430-project] Calling method '.version_select at 0x7fb345dfdf70>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:03:19.972645 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-50660192-3b19-4450-b3f4-072904b113be tempest-VolumesSnapshotsTestJSON-1433915430 tempest-VolumesSnapshotsTestJSON-1433915430-project] 10.222.0.50 "DELETE /compute/v2.1/os-snapshots/f86344b5-7799-4e84-90ce-eeb19f624c5f" status: 202 len: 0 microversion: 2.1 time: 0.172431 Aug 10 18:03:19.976686 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1016/2007] 10.222.0.50 () {58 vars in 1254 bytes} [Wed Aug 10 18:03:19 2022] DELETE /compute/v2.1/os-snapshots/f86344b5-7799-4e84-90ce-eeb19f624c5f => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 18:03:19.982076 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-ad909155-5e4d-4684-94ce-89da6ee9bceb tempest-VolumesSnapshotsTestJSON-1433915430 tempest-VolumesSnapshotsTestJSON-1433915430-project] Calling method '.version_select at 0x7fb345e74550>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:03:20.030801 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-ad909155-5e4d-4684-94ce-89da6ee9bceb tempest-VolumesSnapshotsTestJSON-1433915430 tempest-VolumesSnapshotsTestJSON-1433915430-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/f86344b5-7799-4e84-90ce-eeb19f624c5f" status: 200 len: 287 microversion: 2.1 time: 0.052626 Aug 10 18:03:20.031524 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 992/2008] 10.222.0.50 () {58 vars in 1251 bytes} [Wed Aug 10 18:03:19 2022] GET /compute/v2.1/os-snapshots/f86344b5-7799-4e84-90ce-eeb19f624c5f => generated 287 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 18:03:21.042958 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-ad5d14d9-99d4-4e28-b9ab-2bc02243bc33 tempest-VolumesSnapshotsTestJSON-1433915430 tempest-VolumesSnapshotsTestJSON-1433915430-project] Calling method '.version_select at 0x7fb345d32a60>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:03:21.101839 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-ad5d14d9-99d4-4e28-b9ab-2bc02243bc33 tempest-VolumesSnapshotsTestJSON-1433915430 tempest-VolumesSnapshotsTestJSON-1433915430-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/f86344b5-7799-4e84-90ce-eeb19f624c5f" status: 200 len: 287 microversion: 2.1 time: 0.062791 Aug 10 18:03:21.102657 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1017/2009] 10.222.0.50 () {58 vars in 1251 bytes} [Wed Aug 10 18:03:21 2022] GET /compute/v2.1/os-snapshots/f86344b5-7799-4e84-90ce-eeb19f624c5f => generated 287 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 18:03:22.117535 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-777218b1-eeb3-40df-90e8-da43a1e46fb6 tempest-VolumesSnapshotsTestJSON-1433915430 tempest-VolumesSnapshotsTestJSON-1433915430-project] Calling method '.version_select at 0x7fb345e6ea60>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:03:22.246914 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-777218b1-eeb3-40df-90e8-da43a1e46fb6 tempest-VolumesSnapshotsTestJSON-1433915430 tempest-VolumesSnapshotsTestJSON-1433915430-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/f86344b5-7799-4e84-90ce-eeb19f624c5f" status: 200 len: 287 microversion: 2.1 time: 0.136512 Aug 10 18:03:22.248648 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 993/2010] 10.222.0.50 () {58 vars in 1251 bytes} [Wed Aug 10 18:03:22 2022] GET /compute/v2.1/os-snapshots/f86344b5-7799-4e84-90ce-eeb19f624c5f => generated 287 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 18:03:23.262097 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-404a19ce-c546-4eda-a9eb-69dedbca0bed tempest-VolumesSnapshotsTestJSON-1433915430 tempest-VolumesSnapshotsTestJSON-1433915430-project] Calling method '.version_select at 0x7fb345d32ee0>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:03:23.302363 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-404a19ce-c546-4eda-a9eb-69dedbca0bed tempest-VolumesSnapshotsTestJSON-1433915430 tempest-VolumesSnapshotsTestJSON-1433915430-project] HTTP exception thrown: Snapshot f86344b5-7799-4e84-90ce-eeb19f624c5f could not be found. Aug 10 18:03:23.307943 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-404a19ce-c546-4eda-a9eb-69dedbca0bed tempest-VolumesSnapshotsTestJSON-1433915430 tempest-VolumesSnapshotsTestJSON-1433915430-project] Request method failure captured: Aug 10 18:03:23.307943 n-d-852296-2 devstack@n-api.service[129409]: request: GET /compute/v2.1/os-snapshots/f86344b5-7799-4e84-90ce-eeb19f624c5f HTTP/1.1 Aug 10 18:03:23.307943 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 18:03:23.307943 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 18:03:23.307943 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 18:03:23.307943 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 0 Aug 10 18:03:23.307943 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 18:03:23.307943 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 18:03:23.307943 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 18:03:23.307943 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 18:03:23.307943 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8_Lf-W4n9OJVq9PiBemEnIWqXlrygQ5SofGQbNxhT31mo1mlbdoiqmt9x0-k9X4O2z2ILenfmftzzRyp3mtOGTe9hXNA2yzmYSLakjCRPmQEIM5DLE2rXtH-dZxI7iuHYFvmdOq48IfO9xXNqkr4I88PtmILNgTXjIbdaM7KVBrCSnY Aug 10 18:03:23.307943 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 18:03:23.307943 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 18:03:23.307943 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 18:03:23.307943 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 18:03:23.307943 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 18:03:23.307943 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 18:03:23.307943 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: d31700903f84451492d666c3ac883340 Aug 10 18:03:23.307943 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1433915430 Aug 10 18:03:23.307943 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 18:03:23.307943 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 18:03:23.307943 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d31700903f84451492d666c3ac883340"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d31700903f84451492d666c3ac883340"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d31700903f84451492d666c3ac883340"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d31700903f84451492d666c3ac883340", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 18:03:23.307943 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1433915430 Aug 10 18:03:23.307943 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: d31700903f84451492d666c3ac883340 Aug 10 18:03:23.307943 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1433915430 Aug 10 18:03:23.307943 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-VolumesSnapshotsTestJSON-1433915430-project Aug 10 18:03:23.307943 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 18:03:23.307943 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 18:03:23.307943 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: 8756833d78d54e00b5b4a99a4dd34abb Aug 10 18:03:23.307943 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1433915430-project Aug 10 18:03:23.307943 n-d-852296-2 devstack@n-api.service[129409]: method: Aug 10 18:03:23.307943 n-d-852296-2 devstack@n-api.service[129409]: exception: Snapshot f86344b5-7799-4e84-90ce-eeb19f624c5f could not be found. Aug 10 18:03:23.307943 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'id': 'f86344b5-7799-4e84-90ce-eeb19f624c5f'} Aug 10 18:03:23.307943 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 18:03:23.307943 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:03:23.307943 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 10 18:03:23.307943 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 10 18:03:23.307943 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 10 18:03:23.307943 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 10 18:03:23.307943 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 10 18:03:23.307943 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 10 18:03:23.307943 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 18:03:23.307943 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 18:03:23.307943 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 18:03:23.307943 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 18:03:23.307943 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 18:03:23.307943 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 18:03:23.307943 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 18:03:23.307943 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 18:03:23.307943 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot f86344b5-7799-4e84-90ce-eeb19f624c5f could not be found. (HTTP 404) (Request-ID: req-c819ad5e-783a-4e23-b9fa-9c3ee30184ad) Aug 10 18:03:23.307943 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:03:23.307943 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:03:23.307943 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:03:23.307943 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:03:23.307943 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 10 18:03:23.307943 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 10 18:03:23.307943 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 10 18:03:23.307943 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 10 18:03:23.307943 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 10 18:03:23.307943 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 10 18:03:23.307943 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 10 18:03:23.307943 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 10 18:03:23.320887 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 10 18:03:23.320887 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 10 18:03:23.320887 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 10 18:03:23.320887 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 10 18:03:23.320887 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 10 18:03:23.320887 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 10 18:03:23.320887 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 18:03:23.320887 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 18:03:23.320887 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 18:03:23.320887 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 18:03:23.320887 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 18:03:23.320887 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 18:03:23.320887 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 18:03:23.320887 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 18:03:23.320887 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot f86344b5-7799-4e84-90ce-eeb19f624c5f could not be found. Aug 10 18:03:23.320887 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:03:23.320887 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:03:23.320887 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:03:23.320887 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:03:23.320887 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:03:23.320887 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:03:23.320887 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 18:03:23.320887 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 18:03:23.320887 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 18:03:23.320887 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 18:03:23.320887 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:03:23.320887 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:03:23.320887 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 10 18:03:23.320887 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 18:03:23.320887 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot f86344b5-7799-4e84-90ce-eeb19f624c5f could not be found. Aug 10 18:03:23.320887 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:03:23.320887 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:03:23.320887 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:03:23.320887 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:03:23.320887 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:03:23.320887 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:03:23.320887 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 18:03:23.320887 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 18:03:23.320887 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot f86344b5-7799-4e84-90ce-eeb19f624c5f could not be found. Aug 10 18:03:23.320887 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:03:23.320887 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-404a19ce-c546-4eda-a9eb-69dedbca0bed tempest-VolumesSnapshotsTestJSON-1433915430 tempest-VolumesSnapshotsTestJSON-1433915430-project] Returning 404 to user: Snapshot f86344b5-7799-4e84-90ce-eeb19f624c5f could not be found. {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 18:03:23.320887 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-404a19ce-c546-4eda-a9eb-69dedbca0bed tempest-VolumesSnapshotsTestJSON-1433915430 tempest-VolumesSnapshotsTestJSON-1433915430-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/f86344b5-7799-4e84-90ce-eeb19f624c5f" status: 404 len: 111 microversion: 2.1 time: 0.052214 Aug 10 18:03:23.325068 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-cfd5e98a-cb2a-42cc-be0c-63beef9e0b1e tempest-VolumesSnapshotsTestJSON-1433915430 tempest-VolumesSnapshotsTestJSON-1433915430-project] Calling method '.version_select at 0x7fb345e745e0>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:03:23.325456 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1018/2011] 10.222.0.50 () {58 vars in 1251 bytes} [Wed Aug 10 18:03:23 2022] GET /compute/v2.1/os-snapshots/f86344b5-7799-4e84-90ce-eeb19f624c5f => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 18:03:23.737823 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-cfd5e98a-cb2a-42cc-be0c-63beef9e0b1e tempest-VolumesSnapshotsTestJSON-1433915430 tempest-VolumesSnapshotsTestJSON-1433915430-project] 10.222.0.50 "DELETE /compute/v2.1/os-volumes/c4530bc8-aec0-4c02-ba4c-5162652b7af2" status: 202 len: 0 microversion: 2.1 time: 0.422817 Aug 10 18:03:23.743920 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 994/2012] 10.222.0.50 () {58 vars in 1248 bytes} [Wed Aug 10 18:03:23 2022] DELETE /compute/v2.1/os-volumes/c4530bc8-aec0-4c02-ba4c-5162652b7af2 => generated 0 bytes in 425 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 18:03:23.746785 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-e93db4ee-601a-4455-a15d-16a95112610a tempest-VolumesSnapshotsTestJSON-1433915430 tempest-VolumesSnapshotsTestJSON-1433915430-project] Calling method '.version_select at 0x7fb346784ee0>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:03:23.878786 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-e93db4ee-601a-4455-a15d-16a95112610a tempest-VolumesSnapshotsTestJSON-1433915430 tempest-VolumesSnapshotsTestJSON-1433915430-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/c4530bc8-aec0-4c02-ba4c-5162652b7af2" status: 200 len: 345 microversion: 2.1 time: 0.135644 Aug 10 18:03:23.879564 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1019/2013] 10.222.0.50 () {58 vars in 1245 bytes} [Wed Aug 10 18:03:23 2022] GET /compute/v2.1/os-volumes/c4530bc8-aec0-4c02-ba4c-5162652b7af2 => generated 345 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 18:03:24.915308 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-7a43c940-d470-457f-9d7c-10e34daedd56 tempest-VolumesSnapshotsTestJSON-1433915430 tempest-VolumesSnapshotsTestJSON-1433915430-project] Calling method '.version_select at 0x7fb346523b80>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:03:24.994799 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-7a43c940-d470-457f-9d7c-10e34daedd56 tempest-VolumesSnapshotsTestJSON-1433915430 tempest-VolumesSnapshotsTestJSON-1433915430-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/c4530bc8-aec0-4c02-ba4c-5162652b7af2" status: 200 len: 345 microversion: 2.1 time: 0.105740 Aug 10 18:03:24.995455 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 995/2014] 10.222.0.50 () {58 vars in 1245 bytes} [Wed Aug 10 18:03:24 2022] GET /compute/v2.1/os-volumes/c4530bc8-aec0-4c02-ba4c-5162652b7af2 => generated 345 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 18:03:26.008660 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-75aeb1d5-5ee6-43c8-a0cd-a2a604f1bb3e tempest-VolumesSnapshotsTestJSON-1433915430 tempest-VolumesSnapshotsTestJSON-1433915430-project] Calling method '.version_select at 0x7fb345dfd670>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:03:26.015524 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_api:SELECT=2 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 18:03:26.159533 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-75aeb1d5-5ee6-43c8-a0cd-a2a604f1bb3e tempest-VolumesSnapshotsTestJSON-1433915430 tempest-VolumesSnapshotsTestJSON-1433915430-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/c4530bc8-aec0-4c02-ba4c-5162652b7af2" status: 200 len: 345 microversion: 2.1 time: 0.154257 Aug 10 18:03:26.161689 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1020/2015] 10.222.0.50 () {58 vars in 1245 bytes} [Wed Aug 10 18:03:26 2022] GET /compute/v2.1/os-volumes/c4530bc8-aec0-4c02-ba4c-5162652b7af2 => generated 345 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 18:03:27.175147 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-d54b5213-144b-48aa-9e0d-89c0494c8fc5 tempest-VolumesSnapshotsTestJSON-1433915430 tempest-VolumesSnapshotsTestJSON-1433915430-project] Calling method '.version_select at 0x7fb345e6e3a0>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:03:27.192368 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_api:SELECT=2 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 18:03:27.350649 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-d54b5213-144b-48aa-9e0d-89c0494c8fc5 tempest-VolumesSnapshotsTestJSON-1433915430 tempest-VolumesSnapshotsTestJSON-1433915430-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/c4530bc8-aec0-4c02-ba4c-5162652b7af2" status: 200 len: 345 microversion: 2.1 time: 0.180336 Aug 10 18:03:27.352007 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 996/2016] 10.222.0.50 () {58 vars in 1245 bytes} [Wed Aug 10 18:03:27 2022] GET /compute/v2.1/os-volumes/c4530bc8-aec0-4c02-ba4c-5162652b7af2 => generated 345 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 18:03:28.366289 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-979b8694-203c-4138-993d-2d9de67bb5ec tempest-VolumesSnapshotsTestJSON-1433915430 tempest-VolumesSnapshotsTestJSON-1433915430-project] Calling method '.version_select at 0x7fb345d9b160>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:03:28.465244 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-979b8694-203c-4138-993d-2d9de67bb5ec tempest-VolumesSnapshotsTestJSON-1433915430 tempest-VolumesSnapshotsTestJSON-1433915430-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/c4530bc8-aec0-4c02-ba4c-5162652b7af2" status: 200 len: 345 microversion: 2.1 time: 0.103191 Aug 10 18:03:28.465972 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1021/2017] 10.222.0.50 () {58 vars in 1245 bytes} [Wed Aug 10 18:03:28 2022] GET /compute/v2.1/os-volumes/c4530bc8-aec0-4c02-ba4c-5162652b7af2 => generated 345 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 18:03:29.484184 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-f2a865a1-3a9e-4789-9849-5dc6d39d7262 tempest-VolumesSnapshotsTestJSON-1433915430 tempest-VolumesSnapshotsTestJSON-1433915430-project] Calling method '.version_select at 0x7fb3465623a0>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:03:29.562761 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-f2a865a1-3a9e-4789-9849-5dc6d39d7262 tempest-VolumesSnapshotsTestJSON-1433915430 tempest-VolumesSnapshotsTestJSON-1433915430-project] HTTP exception thrown: Volume c4530bc8-aec0-4c02-ba4c-5162652b7af2 could not be found. Aug 10 18:03:29.566371 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-f2a865a1-3a9e-4789-9849-5dc6d39d7262 tempest-VolumesSnapshotsTestJSON-1433915430 tempest-VolumesSnapshotsTestJSON-1433915430-project] Request method failure captured: Aug 10 18:03:29.566371 n-d-852296-2 devstack@n-api.service[129410]: request: GET /compute/v2.1/os-volumes/c4530bc8-aec0-4c02-ba4c-5162652b7af2 HTTP/1.1 Aug 10 18:03:29.566371 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 18:03:29.566371 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 18:03:29.566371 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 18:03:29.566371 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 0 Aug 10 18:03:29.566371 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 18:03:29.566371 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 18:03:29.566371 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 18:03:29.566371 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 18:03:29.566371 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8_Lf-W4n9OJVq9PiBemEnIWqXlrygQ5SofGQbNxhT31mo1mlbdoiqmt9x0-k9X4O2z2ILenfmftzzRyp3mtOGTe9hXNA2yzmYSLakjCRPmQEIM5DLE2rXtH-dZxI7iuHYFvmdOq48IfO9xXNqkr4I88PtmILNgTXjIbdaM7KVBrCSnY Aug 10 18:03:29.566371 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 18:03:29.566371 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 18:03:29.566371 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 18:03:29.566371 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 18:03:29.566371 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 18:03:29.566371 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 18:03:29.566371 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: d31700903f84451492d666c3ac883340 Aug 10 18:03:29.566371 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1433915430 Aug 10 18:03:29.566371 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 18:03:29.566371 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 18:03:29.566371 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d31700903f84451492d666c3ac883340"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d31700903f84451492d666c3ac883340"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d31700903f84451492d666c3ac883340"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d31700903f84451492d666c3ac883340", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 18:03:29.566371 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1433915430 Aug 10 18:03:29.566371 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: d31700903f84451492d666c3ac883340 Aug 10 18:03:29.566371 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1433915430 Aug 10 18:03:29.566371 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-VolumesSnapshotsTestJSON-1433915430-project Aug 10 18:03:29.566371 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 18:03:29.566371 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 18:03:29.566371 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: 8756833d78d54e00b5b4a99a4dd34abb Aug 10 18:03:29.566371 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1433915430-project Aug 10 18:03:29.566371 n-d-852296-2 devstack@n-api.service[129410]: method: Aug 10 18:03:29.566371 n-d-852296-2 devstack@n-api.service[129410]: exception: Volume c4530bc8-aec0-4c02-ba4c-5162652b7af2 could not be found. Aug 10 18:03:29.566371 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'id': 'c4530bc8-aec0-4c02-ba4c-5162652b7af2'} Aug 10 18:03:29.566371 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 18:03:29.566371 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:03:29.566371 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 18:03:29.566371 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 18:03:29.566371 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 10 18:03:29.566371 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 10 18:03:29.566371 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 10 18:03:29.566371 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 10 18:03:29.566371 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 18:03:29.566371 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 18:03:29.566371 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 18:03:29.566371 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 18:03:29.566371 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 18:03:29.566371 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 18:03:29.566371 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 18:03:29.566371 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 18:03:29.566371 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c4530bc8-aec0-4c02-ba4c-5162652b7af2 could not be found. (HTTP 404) (Request-ID: req-f78d3475-e034-422a-b595-ef50198d4f04) Aug 10 18:03:29.566371 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:03:29.566371 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:03:29.566371 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:03:29.566371 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:03:29.566371 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 10 18:03:29.566371 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 10 18:03:29.566371 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 10 18:03:29.566371 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 10 18:03:29.566371 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 10 18:03:29.566371 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 10 18:03:29.566371 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 10 18:03:29.566371 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 10 18:03:29.566371 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 18:03:29.571328 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 18:03:29.571328 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 10 18:03:29.571328 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 10 18:03:29.571328 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 10 18:03:29.571328 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 10 18:03:29.571328 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 18:03:29.571328 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 18:03:29.571328 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 18:03:29.571328 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 18:03:29.571328 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 18:03:29.571328 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 18:03:29.571328 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 18:03:29.571328 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 18:03:29.571328 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c4530bc8-aec0-4c02-ba4c-5162652b7af2 could not be found. Aug 10 18:03:29.571328 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:03:29.571328 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:03:29.571328 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:03:29.571328 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:03:29.571328 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:03:29.571328 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:03:29.571328 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 18:03:29.571328 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 18:03:29.571328 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 18:03:29.571328 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 18:03:29.571328 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:03:29.571328 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:03:29.571328 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 10 18:03:29.571328 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 18:03:29.571328 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c4530bc8-aec0-4c02-ba4c-5162652b7af2 could not be found. Aug 10 18:03:29.571328 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:03:29.571328 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:03:29.571328 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:03:29.571328 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:03:29.571328 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:03:29.571328 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:03:29.571328 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 18:03:29.571328 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 18:03:29.571328 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c4530bc8-aec0-4c02-ba4c-5162652b7af2 could not be found. Aug 10 18:03:29.571328 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:03:29.577977 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-f2a865a1-3a9e-4789-9849-5dc6d39d7262 tempest-VolumesSnapshotsTestJSON-1433915430 tempest-VolumesSnapshotsTestJSON-1433915430-project] Returning 404 to user: Volume c4530bc8-aec0-4c02-ba4c-5162652b7af2 could not be found. {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 18:03:29.580578 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-f2a865a1-3a9e-4789-9849-5dc6d39d7262 tempest-VolumesSnapshotsTestJSON-1433915430 tempest-VolumesSnapshotsTestJSON-1433915430-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/c4530bc8-aec0-4c02-ba4c-5162652b7af2" status: 404 len: 109 microversion: 2.1 time: 0.102980 Aug 10 18:03:29.595770 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-2e043262-6b4f-45f1-8512-ebd5d37d4429 tempest-VolumesSnapshotsTestJSON-1433915430 tempest-VolumesSnapshotsTestJSON-1433915430-project] Calling method '.version_select at 0x7fb345d32040>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:03:29.599262 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 997/2018] 10.222.0.50 () {58 vars in 1245 bytes} [Wed Aug 10 18:03:29 2022] GET /compute/v2.1/os-volumes/c4530bc8-aec0-4c02-ba4c-5162652b7af2 => generated 109 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 18:03:29.646863 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-2e043262-6b4f-45f1-8512-ebd5d37d4429 tempest-VolumesSnapshotsTestJSON-1433915430 tempest-VolumesSnapshotsTestJSON-1433915430-project] HTTP exception thrown: Volume c4530bc8-aec0-4c02-ba4c-5162652b7af2 could not be found. Aug 10 18:03:29.649115 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-2e043262-6b4f-45f1-8512-ebd5d37d4429 tempest-VolumesSnapshotsTestJSON-1433915430 tempest-VolumesSnapshotsTestJSON-1433915430-project] Request method failure captured: Aug 10 18:03:29.649115 n-d-852296-2 devstack@n-api.service[129409]: request: DELETE /compute/v2.1/os-volumes/c4530bc8-aec0-4c02-ba4c-5162652b7af2 HTTP/1.1 Aug 10 18:03:29.649115 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 18:03:29.649115 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 18:03:29.649115 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 18:03:29.649115 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 0 Aug 10 18:03:29.649115 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 18:03:29.649115 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 18:03:29.649115 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 18:03:29.649115 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 18:03:29.649115 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8_Lf-W4n9OJVq9PiBemEnIWqXlrygQ5SofGQbNxhT31mo1mlbdoiqmt9x0-k9X4O2z2ILenfmftzzRyp3mtOGTe9hXNA2yzmYSLakjCRPmQEIM5DLE2rXtH-dZxI7iuHYFvmdOq48IfO9xXNqkr4I88PtmILNgTXjIbdaM7KVBrCSnY Aug 10 18:03:29.649115 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 18:03:29.649115 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 18:03:29.649115 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 18:03:29.649115 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 18:03:29.649115 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 18:03:29.649115 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 18:03:29.649115 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: d31700903f84451492d666c3ac883340 Aug 10 18:03:29.649115 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1433915430 Aug 10 18:03:29.649115 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 18:03:29.649115 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 18:03:29.649115 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d31700903f84451492d666c3ac883340"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d31700903f84451492d666c3ac883340"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d31700903f84451492d666c3ac883340"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d31700903f84451492d666c3ac883340", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 18:03:29.649115 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1433915430 Aug 10 18:03:29.649115 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: d31700903f84451492d666c3ac883340 Aug 10 18:03:29.649115 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1433915430 Aug 10 18:03:29.649115 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-VolumesSnapshotsTestJSON-1433915430-project Aug 10 18:03:29.649115 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 18:03:29.649115 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 18:03:29.649115 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: 8756833d78d54e00b5b4a99a4dd34abb Aug 10 18:03:29.649115 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1433915430-project Aug 10 18:03:29.649115 n-d-852296-2 devstack@n-api.service[129409]: method: Aug 10 18:03:29.649115 n-d-852296-2 devstack@n-api.service[129409]: exception: Volume c4530bc8-aec0-4c02-ba4c-5162652b7af2 could not be found. Aug 10 18:03:29.649115 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'id': 'c4530bc8-aec0-4c02-ba4c-5162652b7af2'} Aug 10 18:03:29.649115 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 18:03:29.649115 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:03:29.649115 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 18:03:29.649115 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 18:03:29.649115 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 10 18:03:29.649115 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 10 18:03:29.649115 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 10 18:03:29.649115 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 10 18:03:29.649115 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 10 18:03:29.649115 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 10 18:03:29.649115 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 10 18:03:29.649115 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 10 18:03:29.649115 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 18:03:29.649115 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 18:03:29.649115 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 18:03:29.649115 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 18:03:29.649115 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c4530bc8-aec0-4c02-ba4c-5162652b7af2 could not be found. (HTTP 404) (Request-ID: req-b7595796-edf8-44e9-81f1-966197786527) Aug 10 18:03:29.649115 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:03:29.649115 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:03:29.649115 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:03:29.649115 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:03:29.649115 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 10 18:03:29.649115 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 10 18:03:29.649115 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 10 18:03:29.649115 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 10 18:03:29.649115 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 10 18:03:29.649115 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 10 18:03:29.649115 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 10 18:03:29.649115 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 10 18:03:29.649115 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 18:03:29.655191 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 18:03:29.655191 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 10 18:03:29.655191 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 10 18:03:29.655191 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 10 18:03:29.655191 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 10 18:03:29.655191 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 10 18:03:29.655191 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 10 18:03:29.655191 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 10 18:03:29.655191 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 10 18:03:29.655191 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 18:03:29.655191 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 18:03:29.655191 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 18:03:29.655191 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 18:03:29.655191 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c4530bc8-aec0-4c02-ba4c-5162652b7af2 could not be found. Aug 10 18:03:29.655191 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:03:29.655191 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:03:29.655191 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:03:29.655191 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:03:29.655191 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:03:29.655191 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:03:29.655191 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 18:03:29.655191 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 18:03:29.655191 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 18:03:29.655191 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 18:03:29.655191 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:03:29.655191 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:03:29.655191 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 10 18:03:29.655191 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 18:03:29.655191 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c4530bc8-aec0-4c02-ba4c-5162652b7af2 could not be found. Aug 10 18:03:29.655191 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:03:29.655191 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:03:29.655191 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:03:29.655191 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:03:29.655191 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:03:29.655191 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:03:29.655191 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 18:03:29.655191 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 18:03:29.655191 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c4530bc8-aec0-4c02-ba4c-5162652b7af2 could not be found. Aug 10 18:03:29.655191 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:03:29.655191 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-2e043262-6b4f-45f1-8512-ebd5d37d4429 tempest-VolumesSnapshotsTestJSON-1433915430 tempest-VolumesSnapshotsTestJSON-1433915430-project] Returning 404 to user: Volume c4530bc8-aec0-4c02-ba4c-5162652b7af2 could not be found. {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 18:03:29.655191 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-2e043262-6b4f-45f1-8512-ebd5d37d4429 tempest-VolumesSnapshotsTestJSON-1433915430 tempest-VolumesSnapshotsTestJSON-1433915430-project] 10.222.0.50 "DELETE /compute/v2.1/os-volumes/c4530bc8-aec0-4c02-ba4c-5162652b7af2" status: 404 len: 109 microversion: 2.1 time: 0.060060 Aug 10 18:03:29.664779 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-7a9183bb-bce9-4d7e-9a66-7d7f8496c4e4 tempest-VolumesSnapshotsTestJSON-1433915430 tempest-VolumesSnapshotsTestJSON-1433915430-project] Calling method '.version_select at 0x7fb3460c8160>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:03:29.665559 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1022/2019] 10.222.0.50 () {58 vars in 1248 bytes} [Wed Aug 10 18:03:29 2022] DELETE /compute/v2.1/os-volumes/c4530bc8-aec0-4c02-ba4c-5162652b7af2 => generated 109 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 18:03:29.740259 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-7a9183bb-bce9-4d7e-9a66-7d7f8496c4e4 tempest-VolumesSnapshotsTestJSON-1433915430 tempest-VolumesSnapshotsTestJSON-1433915430-project] HTTP exception thrown: Volume c4530bc8-aec0-4c02-ba4c-5162652b7af2 could not be found. Aug 10 18:03:29.742621 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-7a9183bb-bce9-4d7e-9a66-7d7f8496c4e4 tempest-VolumesSnapshotsTestJSON-1433915430 tempest-VolumesSnapshotsTestJSON-1433915430-project] Request method failure captured: Aug 10 18:03:29.742621 n-d-852296-2 devstack@n-api.service[129410]: request: GET /compute/v2.1/os-volumes/c4530bc8-aec0-4c02-ba4c-5162652b7af2 HTTP/1.1 Aug 10 18:03:29.742621 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 18:03:29.742621 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 18:03:29.742621 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 18:03:29.742621 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 0 Aug 10 18:03:29.742621 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 18:03:29.742621 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 18:03:29.742621 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 18:03:29.742621 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 18:03:29.742621 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8_Lf-W4n9OJVq9PiBemEnIWqXlrygQ5SofGQbNxhT31mo1mlbdoiqmt9x0-k9X4O2z2ILenfmftzzRyp3mtOGTe9hXNA2yzmYSLakjCRPmQEIM5DLE2rXtH-dZxI7iuHYFvmdOq48IfO9xXNqkr4I88PtmILNgTXjIbdaM7KVBrCSnY Aug 10 18:03:29.742621 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 18:03:29.742621 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 18:03:29.742621 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 18:03:29.742621 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 18:03:29.742621 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 18:03:29.742621 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 18:03:29.742621 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: d31700903f84451492d666c3ac883340 Aug 10 18:03:29.742621 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1433915430 Aug 10 18:03:29.742621 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 18:03:29.742621 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 18:03:29.742621 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d31700903f84451492d666c3ac883340"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d31700903f84451492d666c3ac883340"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d31700903f84451492d666c3ac883340"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d31700903f84451492d666c3ac883340", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 18:03:29.742621 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1433915430 Aug 10 18:03:29.742621 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: d31700903f84451492d666c3ac883340 Aug 10 18:03:29.742621 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1433915430 Aug 10 18:03:29.742621 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-VolumesSnapshotsTestJSON-1433915430-project Aug 10 18:03:29.742621 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 18:03:29.742621 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 18:03:29.742621 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: 8756833d78d54e00b5b4a99a4dd34abb Aug 10 18:03:29.742621 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1433915430-project Aug 10 18:03:29.742621 n-d-852296-2 devstack@n-api.service[129410]: method: Aug 10 18:03:29.742621 n-d-852296-2 devstack@n-api.service[129410]: exception: Volume c4530bc8-aec0-4c02-ba4c-5162652b7af2 could not be found. Aug 10 18:03:29.742621 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'id': 'c4530bc8-aec0-4c02-ba4c-5162652b7af2'} Aug 10 18:03:29.742621 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 18:03:29.742621 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:03:29.742621 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 18:03:29.742621 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 18:03:29.742621 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 10 18:03:29.742621 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 10 18:03:29.742621 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 10 18:03:29.742621 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 10 18:03:29.742621 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 18:03:29.742621 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 18:03:29.742621 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 18:03:29.742621 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 18:03:29.742621 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 18:03:29.742621 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 18:03:29.742621 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 18:03:29.742621 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 18:03:29.742621 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c4530bc8-aec0-4c02-ba4c-5162652b7af2 could not be found. (HTTP 404) (Request-ID: req-81e61ac1-bb13-4a55-a7f2-041abcce3c8d) Aug 10 18:03:29.742621 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:03:29.742621 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:03:29.742621 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:03:29.742621 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:03:29.742621 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 10 18:03:29.742621 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 10 18:03:29.742621 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 10 18:03:29.742621 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 10 18:03:29.742621 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 10 18:03:29.742621 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 10 18:03:29.742621 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 10 18:03:29.742621 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 10 18:03:29.742621 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 18:03:29.747429 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 18:03:29.747429 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 10 18:03:29.747429 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 10 18:03:29.747429 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 10 18:03:29.747429 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 10 18:03:29.747429 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 18:03:29.747429 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 18:03:29.747429 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 18:03:29.747429 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 18:03:29.747429 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 18:03:29.747429 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 18:03:29.747429 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 18:03:29.747429 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 18:03:29.747429 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c4530bc8-aec0-4c02-ba4c-5162652b7af2 could not be found. Aug 10 18:03:29.747429 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:03:29.747429 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:03:29.747429 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:03:29.747429 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:03:29.747429 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:03:29.747429 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:03:29.747429 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 18:03:29.747429 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 18:03:29.747429 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 18:03:29.747429 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 18:03:29.747429 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:03:29.747429 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:03:29.747429 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 10 18:03:29.747429 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 18:03:29.747429 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c4530bc8-aec0-4c02-ba4c-5162652b7af2 could not be found. Aug 10 18:03:29.747429 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:03:29.747429 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:03:29.747429 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:03:29.747429 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:03:29.747429 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:03:29.747429 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:03:29.747429 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 18:03:29.747429 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 18:03:29.747429 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c4530bc8-aec0-4c02-ba4c-5162652b7af2 could not be found. Aug 10 18:03:29.747429 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:03:29.754972 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-7a9183bb-bce9-4d7e-9a66-7d7f8496c4e4 tempest-VolumesSnapshotsTestJSON-1433915430 tempest-VolumesSnapshotsTestJSON-1433915430-project] Returning 404 to user: Volume c4530bc8-aec0-4c02-ba4c-5162652b7af2 could not be found. {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 18:03:29.754972 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-7a9183bb-bce9-4d7e-9a66-7d7f8496c4e4 tempest-VolumesSnapshotsTestJSON-1433915430 tempest-VolumesSnapshotsTestJSON-1433915430-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/c4530bc8-aec0-4c02-ba4c-5162652b7af2" status: 404 len: 109 microversion: 2.1 time: 0.095349 Aug 10 18:03:29.759961 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 998/2020] 10.222.0.50 () {58 vars in 1245 bytes} [Wed Aug 10 18:03:29 2022] GET /compute/v2.1/os-volumes/c4530bc8-aec0-4c02-ba4c-5162652b7af2 => generated 109 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 18:03:40.996221 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-6bdfe01f-fdb9-40a3-b859-ee66204e12bc tempest-ServerAddressesTestJSON-1500572157 tempest-ServerAddressesTestJSON-1500572157-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-1632911255", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "513734f7-1e96-4a8f-9588-473f163e6a21"}]}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 18:03:41.124495 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.network.neutron [None req-6bdfe01f-fdb9-40a3-b859-ee66204e12bc tempest-ServerAddressesTestJSON-1500572157 tempest-ServerAddressesTestJSON-1500572157-project] validate_networks() for [('513734f7-1e96-4a8f-9588-473f163e6a21', None, None, None, None, None)] {{(pid=129409) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 18:03:42.526696 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [None req-6bdfe01f-fdb9-40a3-b859-ee66204e12bc tempest-ServerAddressesTestJSON-1500572157 tempest-ServerAddressesTestJSON-1500572157-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-27635e0e-f3e0-4608-8ff2-2732b0de681d) Aug 10 18:03:42.526696 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:03:42.526696 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:03:42.526696 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:03:42.526696 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:03:42.526696 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:03:42.526696 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:03:42.526696 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:03:42.526696 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:03:42.526696 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:03:42.526696 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 18:03:42.526696 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 18:03:42.526696 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 18:03:42.526696 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 18:03:42.526696 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 18:03:42.526696 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 18:03:42.526696 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 18:03:42.526696 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 18:03:42.526696 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 18:03:42.526696 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 18:03:42.526696 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 18:03:42.526696 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 18:03:42.526696 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 18:03:42.526696 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 18:03:42.526696 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 18:03:42.526696 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 18:03:42.526696 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 18:03:42.526696 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:03:42.526696 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:03:42.526696 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 18:03:42.526696 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 18:03:42.526696 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:03:42.526696 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:03:42.526696 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 18:03:42.526696 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 18:03:42.526696 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:03:42.526696 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:03:42.526696 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:03:42.526696 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:03:42.526696 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:03:42.526696 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:03:42.526696 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 18:03:42.526696 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 18:03:42.526696 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 18:03:42.526696 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 18:03:42.526696 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 18:03:42.526696 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 18:03:42.526696 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 18:03:42.526696 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 18:03:42.526696 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 18:03:42.526696 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 18:03:42.526696 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 18:03:42.532516 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 18:03:42.532516 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 18:03:42.532516 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 18:03:42.532516 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 18:03:42.532516 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 18:03:42.532516 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 18:03:42.532516 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 18:03:42.532516 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 18:03:42.532516 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 18:03:42.532516 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 18:03:42.532516 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 18:03:42.532516 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 18:03:42.532516 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 18:03:42.532516 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 18:03:42.532516 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 18:03:42.532516 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-27635e0e-f3e0-4608-8ff2-2732b0de681d) Aug 10 18:03:42.532516 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:03:42.532516 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-6bdfe01f-fdb9-40a3-b859-ee66204e12bc tempest-ServerAddressesTestJSON-1500572157 tempest-ServerAddressesTestJSON-1500572157-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:03:42.532516 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 18:03:42.536310 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-6bdfe01f-fdb9-40a3-b859-ee66204e12bc tempest-ServerAddressesTestJSON-1500572157 tempest-ServerAddressesTestJSON-1500572157-project] Request method failure captured: Aug 10 18:03:42.536310 n-d-852296-2 devstack@n-api.service[129409]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 18:03:42.536310 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 18:03:42.536310 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 18:03:42.536310 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 18:03:42.536310 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 209 Aug 10 18:03:42.536310 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 18:03:42.536310 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 18:03:42.536310 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 18:03:42.536310 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 18:03:42.536310 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8_L66ymID6ClVq0w8dH-VX8_DTgSi4cziBklgks_QxS3GwoLKA76SINIaGDBEIviV-1er2GlduuZqng2NvQD_Caft3Ie1h8cp1VtK550SMfQ4GWGtRfcUAIxs4-cthhHKR8vLf12fzzbnO9fDBpQMQW2bO6ML8ralx3GE2Ld7L2uY7E Aug 10 18:03:42.536310 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 18:03:42.536310 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 18:03:42.536310 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 18:03:42.536310 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 18:03:42.536310 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 18:03:42.536310 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 18:03:42.536310 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: 958eb43874ef4366a50c2ccea17f6ac6 Aug 10 18:03:42.536310 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-ServerAddressesTestJSON-1500572157 Aug 10 18:03:42.536310 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 18:03:42.536310 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 18:03:42.536310 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/958eb43874ef4366a50c2ccea17f6ac6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/958eb43874ef4366a50c2ccea17f6ac6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/958eb43874ef4366a50c2ccea17f6ac6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_958eb43874ef4366a50c2ccea17f6ac6", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 18:03:42.536310 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-ServerAddressesTestJSON-1500572157 Aug 10 18:03:42.536310 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: 958eb43874ef4366a50c2ccea17f6ac6 Aug 10 18:03:42.536310 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-ServerAddressesTestJSON-1500572157 Aug 10 18:03:42.536310 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-ServerAddressesTestJSON-1500572157-project Aug 10 18:03:42.536310 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 18:03:42.536310 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 18:03:42.536310 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: ad6f7325f38f4f50879e97c28e1de1f1 Aug 10 18:03:42.536310 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-ServerAddressesTestJSON-1500572157-project Aug 10 18:03:42.536310 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 18:03:42.536310 n-d-852296-2 devstack@n-api.service[129409]: {"server": {"name": "tempest-ServerAddressesTestJSON-server-1632911255", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "513734f7-1e96-4a8f-9588-473f163e6a21"}]}} Aug 10 18:03:42.536310 n-d-852296-2 devstack@n-api.service[129409]: method: > Aug 10 18:03:42.536310 n-d-852296-2 devstack@n-api.service[129409]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:03:42.536310 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 18:03:42.536310 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'body': {'server': {'name': 'tempest-ServerAddressesTestJSON-server-1632911255', 'imageRef': 'a735ff26-463a-4ffe-a981-ab9d9baa494f', 'flavorRef': '452', 'networks': [{'uuid': '513734f7-1e96-4a8f-9588-473f163e6a21'}]}}} Aug 10 18:03:42.536310 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 18:03:42.536310 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:03:42.536310 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:03:42.536310 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:03:42.536310 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:03:42.536310 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:03:42.536310 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:03:42.536310 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:03:42.536310 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:03:42.536310 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:03:42.536310 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 18:03:42.536310 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 18:03:42.536310 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 18:03:42.536310 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 18:03:42.536310 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 18:03:42.536310 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 18:03:42.536310 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 18:03:42.536310 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 18:03:42.536310 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 18:03:42.536310 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 18:03:42.536310 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 18:03:42.536310 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 18:03:42.536310 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 18:03:42.536310 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 18:03:42.536310 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 18:03:42.550536 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 18:03:42.550536 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 18:03:42.550536 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:03:42.550536 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:03:42.550536 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 18:03:42.550536 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 18:03:42.550536 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:03:42.550536 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:03:42.550536 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 18:03:42.550536 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 18:03:42.550536 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:03:42.550536 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:03:42.550536 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:03:42.550536 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:03:42.550536 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:03:42.550536 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:03:42.550536 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 18:03:42.550536 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 18:03:42.550536 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 18:03:42.550536 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 18:03:42.550536 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 18:03:42.550536 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 18:03:42.550536 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 18:03:42.550536 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 18:03:42.550536 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 18:03:42.550536 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 18:03:42.550536 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 18:03:42.550536 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 18:03:42.550536 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 18:03:42.550536 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 18:03:42.550536 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 18:03:42.550536 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 18:03:42.550536 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 18:03:42.550536 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 18:03:42.550536 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 18:03:42.550536 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 18:03:42.550536 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 18:03:42.550536 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 18:03:42.550536 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 18:03:42.550536 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 18:03:42.550536 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 18:03:42.550536 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 18:03:42.550536 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-27635e0e-f3e0-4608-8ff2-2732b0de681d) Aug 10 18:03:42.550536 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:03:42.550536 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:03:42.550536 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:03:42.550536 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:03:42.550536 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:03:42.550536 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:03:42.550536 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 18:03:42.550536 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 18:03:42.550536 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 10 18:03:42.550536 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 10 18:03:42.556214 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:03:42.556214 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:03:42.556214 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:03:42.556214 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:03:42.556214 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:03:42.556214 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:03:42.556214 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:03:42.556214 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:03:42.556214 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 18:03:42.556214 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 18:03:42.556214 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:03:42.556214 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:03:42.556214 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:03:42.556214 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-6bdfe01f-fdb9-40a3-b859-ee66204e12bc tempest-ServerAddressesTestJSON-1500572157 tempest-ServerAddressesTestJSON-1500572157-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:03:42.556214 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 18:03:42.556214 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-6bdfe01f-fdb9-40a3-b859-ee66204e12bc tempest-ServerAddressesTestJSON-1500572157 tempest-ServerAddressesTestJSON-1500572157-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 2.630384 Aug 10 18:03:42.556214 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1023/2021] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 18:03:39 2022] POST /compute/v2.1/servers => generated 214 bytes in 2636 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 10 18:03:56.168313 n-d-852296-2 devstack@n-api.service[129409]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 18:03:56.170048 n-d-852296-2 devstack@n-api.service[129409]: Wed Aug 10 18:03:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 18:04:17.067604 n-d-852296-2 devstack@n-api.service[129410]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 18:04:17.068218 n-d-852296-2 devstack@n-api.service[129410]: Wed Aug 10 18:04:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 18:04:22.158631 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-4cd41b54-0cd9-4274-bb40-2c11a050a6f2 tempest-ServerAddressesNegativeTestJSON-1002152757 tempest-ServerAddressesNegativeTestJSON-1002152757-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-2131672086", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "a7e9ebe8-74d6-4acf-896d-c8cce53b06fb"}]}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 18:04:22.685562 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.network.neutron [None req-4cd41b54-0cd9-4274-bb40-2c11a050a6f2 tempest-ServerAddressesNegativeTestJSON-1002152757 tempest-ServerAddressesNegativeTestJSON-1002152757-project] validate_networks() for [('a7e9ebe8-74d6-4acf-896d-c8cce53b06fb', None, None, None, None, None)] {{(pid=129410) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 18:04:23.862116 n-d-852296-2 devstack@n-api.service[129409]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 18:04:23.862658 n-d-852296-2 devstack@n-api.service[129409]: Wed Aug 10 18:04:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 18:04:23.953272 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [None req-4cd41b54-0cd9-4274-bb40-2c11a050a6f2 tempest-ServerAddressesNegativeTestJSON-1002152757 tempest-ServerAddressesNegativeTestJSON-1002152757-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-f911701b-691e-4ea1-a7f8-d582d75da69e) Aug 10 18:04:23.953272 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:04:23.953272 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:04:23.953272 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:04:23.953272 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:04:23.953272 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:04:23.953272 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:04:23.953272 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:04:23.953272 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:04:23.953272 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:04:23.953272 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 18:04:23.953272 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 18:04:23.953272 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 18:04:23.953272 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 18:04:23.953272 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 18:04:23.953272 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 18:04:23.953272 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 18:04:23.953272 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 18:04:23.953272 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 18:04:23.953272 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 18:04:23.953272 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 18:04:23.953272 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 18:04:23.953272 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 18:04:23.953272 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 18:04:23.953272 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 18:04:23.953272 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 18:04:23.953272 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 18:04:23.953272 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:04:23.953272 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:04:23.953272 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 18:04:23.953272 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 18:04:23.953272 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:04:23.953272 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:04:23.953272 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 18:04:23.953272 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 18:04:23.953272 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:04:23.953272 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:04:23.953272 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:04:23.953272 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:04:23.953272 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:04:23.953272 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:04:23.953272 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 18:04:23.953272 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 18:04:23.953272 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 18:04:23.953272 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 18:04:23.953272 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 18:04:23.953272 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 18:04:23.953272 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 18:04:23.953272 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 18:04:23.953272 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 18:04:23.953272 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 18:04:23.953272 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 18:04:23.958808 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 18:04:23.958808 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 18:04:23.958808 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 18:04:23.958808 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 18:04:23.958808 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 18:04:23.958808 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 18:04:23.958808 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 18:04:23.958808 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 18:04:23.958808 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 18:04:23.958808 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 18:04:23.958808 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 18:04:23.958808 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 18:04:23.958808 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 18:04:23.958808 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 18:04:23.958808 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 18:04:23.958808 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-f911701b-691e-4ea1-a7f8-d582d75da69e) Aug 10 18:04:23.958808 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:04:23.958808 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-4cd41b54-0cd9-4274-bb40-2c11a050a6f2 tempest-ServerAddressesNegativeTestJSON-1002152757 tempest-ServerAddressesNegativeTestJSON-1002152757-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:04:23.958808 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 18:04:23.958808 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-4cd41b54-0cd9-4274-bb40-2c11a050a6f2 tempest-ServerAddressesNegativeTestJSON-1002152757 tempest-ServerAddressesNegativeTestJSON-1002152757-project] Request method failure captured: Aug 10 18:04:23.958808 n-d-852296-2 devstack@n-api.service[129410]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 18:04:23.958808 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 18:04:23.958808 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 18:04:23.958808 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 18:04:23.958808 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 217 Aug 10 18:04:23.958808 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 18:04:23.958808 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 18:04:23.958808 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 18:04:23.958808 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 18:04:23.958808 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8_MltL6mJ-cqbDbmBoxxLFUDRIVOkyXan2BGdnY4RYfl7CX5hJwdlZ1jzUttrKJ_SNLl5Dxwph2aTMJKeq_Abv3G91B-jniCg9yzdZRKSCeIguLt6YjridSGdarIO6e69y-zTt13HHPvQo0tDU5uX1I931WUi9HAnctgtO-T7xqnnY0 Aug 10 18:04:23.958808 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 18:04:23.958808 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 18:04:23.958808 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 18:04:23.958808 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 18:04:23.958808 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 18:04:23.958808 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 18:04:23.958808 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: 177d573e0a7348dba8ebd8d038aa2abc Aug 10 18:04:23.958808 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1002152757 Aug 10 18:04:23.958808 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 18:04:23.958808 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 18:04:23.958808 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/177d573e0a7348dba8ebd8d038aa2abc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/177d573e0a7348dba8ebd8d038aa2abc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/177d573e0a7348dba8ebd8d038aa2abc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_177d573e0a7348dba8ebd8d038aa2abc", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 18:04:23.958808 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1002152757 Aug 10 18:04:23.958808 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: 177d573e0a7348dba8ebd8d038aa2abc Aug 10 18:04:23.958808 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1002152757 Aug 10 18:04:23.958808 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-ServerAddressesNegativeTestJSON-1002152757-project Aug 10 18:04:23.958808 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 18:04:23.958808 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 18:04:23.958808 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: ca09152d449b4473915997d73f47068c Aug 10 18:04:23.958808 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1002152757-project Aug 10 18:04:23.958808 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 18:04:23.958808 n-d-852296-2 devstack@n-api.service[129410]: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-2131672086", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "a7e9ebe8-74d6-4acf-896d-c8cce53b06fb"}]}} Aug 10 18:04:23.958808 n-d-852296-2 devstack@n-api.service[129410]: method: > Aug 10 18:04:23.958808 n-d-852296-2 devstack@n-api.service[129410]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:04:23.958808 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 18:04:23.965631 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'body': {'server': {'name': 'tempest-ServerAddressesNegativeTestJSON-server-2131672086', 'imageRef': 'a735ff26-463a-4ffe-a981-ab9d9baa494f', 'flavorRef': '452', 'networks': [{'uuid': 'a7e9ebe8-74d6-4acf-896d-c8cce53b06fb'}]}}} Aug 10 18:04:23.965631 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 18:04:23.965631 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:04:23.965631 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:04:23.965631 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:04:23.965631 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:04:23.965631 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:04:23.965631 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:04:23.965631 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:04:23.965631 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:04:23.965631 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:04:23.965631 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 18:04:23.965631 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 18:04:23.965631 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 18:04:23.965631 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 18:04:23.965631 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 18:04:23.965631 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 18:04:23.965631 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 18:04:23.965631 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 18:04:23.965631 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 18:04:23.965631 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 18:04:23.965631 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 18:04:23.965631 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 18:04:23.965631 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 18:04:23.965631 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 18:04:23.965631 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 18:04:23.965631 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 18:04:23.965631 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 18:04:23.965631 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:04:23.965631 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:04:23.965631 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 18:04:23.965631 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 18:04:23.965631 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:04:23.965631 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:04:23.965631 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 18:04:23.965631 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 18:04:23.965631 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:04:23.965631 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:04:23.965631 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:04:23.965631 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:04:23.965631 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:04:23.965631 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:04:23.965631 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 18:04:23.965631 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 18:04:23.965631 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 18:04:23.965631 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 18:04:23.965631 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 18:04:23.965631 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 18:04:23.965631 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 18:04:23.965631 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 18:04:23.965631 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 18:04:23.965631 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 18:04:23.965631 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 18:04:23.965631 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 18:04:23.965631 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 18:04:23.975634 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 18:04:23.975634 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 18:04:23.975634 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 18:04:23.975634 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 18:04:23.975634 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 18:04:23.975634 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 18:04:23.975634 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 18:04:23.975634 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 18:04:23.975634 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 18:04:23.975634 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 18:04:23.975634 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 18:04:23.975634 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 18:04:23.975634 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 18:04:23.975634 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-f911701b-691e-4ea1-a7f8-d582d75da69e) Aug 10 18:04:23.975634 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:04:23.975634 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:04:23.975634 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:04:23.975634 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:04:23.975634 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:04:23.975634 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:04:23.975634 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 18:04:23.975634 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 18:04:23.975634 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 10 18:04:23.975634 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 10 18:04:23.975634 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:04:23.975634 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:04:23.975634 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:04:23.975634 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:04:23.975634 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:04:23.975634 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:04:23.975634 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:04:23.975634 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:04:23.975634 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 18:04:23.975634 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 18:04:23.975634 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:04:23.975634 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:04:23.975634 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:04:23.975634 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-4cd41b54-0cd9-4274-bb40-2c11a050a6f2 tempest-ServerAddressesNegativeTestJSON-1002152757 tempest-ServerAddressesNegativeTestJSON-1002152757-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:04:23.975634 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 18:04:23.975634 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-4cd41b54-0cd9-4274-bb40-2c11a050a6f2 tempest-ServerAddressesNegativeTestJSON-1002152757 tempest-ServerAddressesNegativeTestJSON-1002152757-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 2.405956 Aug 10 18:04:23.975634 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 999/2022] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 18:04:21 2022] POST /compute/v2.1/servers => generated 214 bytes in 2411 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 10 18:04:25.953686 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_api:SELECT=2 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 18:04:26.753036 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-37c61c27-7237-441d-941f-56c5741db5e2 tempest-PortsAdminExtendedAttrsIpV6TestJSON-397037059 tempest-PortsAdminExtendedAttrsIpV6TestJSON-397037059-project-admin] Calling method '.version_select at 0x7fb345ebe8b0>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:04:26.753036 n-d-852296-2 devstack@n-api.service[129409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 18:04:26.753036 n-d-852296-2 devstack@n-api.service[129409]: warnings.warn(msg) Aug 10 18:04:26.753036 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-37c61c27-7237-441d-941f-56c5741db5e2 tempest-PortsAdminExtendedAttrsIpV6TestJSON-397037059 tempest-PortsAdminExtendedAttrsIpV6TestJSON-397037059-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:04:26.753544 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-37c61c27-7237-441d-941f-56c5741db5e2 tempest-PortsAdminExtendedAttrsIpV6TestJSON-397037059 tempest-PortsAdminExtendedAttrsIpV6TestJSON-397037059-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:04:26.753544 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-37c61c27-7237-441d-941f-56c5741db5e2 tempest-PortsAdminExtendedAttrsIpV6TestJSON-397037059 tempest-PortsAdminExtendedAttrsIpV6TestJSON-397037059-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:04:26.786138 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-37c61c27-7237-441d-941f-56c5741db5e2 tempest-PortsAdminExtendedAttrsIpV6TestJSON-397037059 tempest-PortsAdminExtendedAttrsIpV6TestJSON-397037059-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:04:26.786644 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-37c61c27-7237-441d-941f-56c5741db5e2 tempest-PortsAdminExtendedAttrsIpV6TestJSON-397037059 tempest-PortsAdminExtendedAttrsIpV6TestJSON-397037059-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:04:26.787088 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-37c61c27-7237-441d-941f-56c5741db5e2 tempest-PortsAdminExtendedAttrsIpV6TestJSON-397037059 tempest-PortsAdminExtendedAttrsIpV6TestJSON-397037059-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:04:26.824697 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-37c61c27-7237-441d-941f-56c5741db5e2 tempest-PortsAdminExtendedAttrsIpV6TestJSON-397037059 tempest-PortsAdminExtendedAttrsIpV6TestJSON-397037059-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:04:26.825636 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-37c61c27-7237-441d-941f-56c5741db5e2 tempest-PortsAdminExtendedAttrsIpV6TestJSON-397037059 tempest-PortsAdminExtendedAttrsIpV6TestJSON-397037059-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:04:26.828163 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-37c61c27-7237-441d-941f-56c5741db5e2 tempest-PortsAdminExtendedAttrsIpV6TestJSON-397037059 tempest-PortsAdminExtendedAttrsIpV6TestJSON-397037059-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:04:26.860942 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-37c61c27-7237-441d-941f-56c5741db5e2 tempest-PortsAdminExtendedAttrsIpV6TestJSON-397037059 tempest-PortsAdminExtendedAttrsIpV6TestJSON-397037059-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.914248 Aug 10 18:04:26.880646 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1024/2023] 10.222.0.50 () {58 vars in 1146 bytes} [Wed Aug 10 18:04:25 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 18:04:56.276827 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_api:SELECT=2 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 18:04:56.890402 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-a63445b9-0cce-4542-8ed8-5c432ebfc80f tempest-ServerGroup264TestJSON-455892154 tempest-ServerGroup264TestJSON-455892154-project] Action: 'create', calling method: .version_select at 0x7fb34637b670>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 18:04:56.939211 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.quota [None req-a63445b9-0cce-4542-8ed8-5c432ebfc80f tempest-ServerGroup264TestJSON-455892154 tempest-ServerGroup264TestJSON-455892154-project] Getting quotas for project e671d0ff927e41aa8107f77b4142710c. Resources: {'server_groups'} {{(pid=129410) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 18:04:56.953317 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.quota [None req-a63445b9-0cce-4542-8ed8-5c432ebfc80f tempest-ServerGroup264TestJSON-455892154 tempest-ServerGroup264TestJSON-455892154-project] Getting quotas for user 56bbf5f0dcfa40f38c08c1091e737b03 and project e671d0ff927e41aa8107f77b4142710c. Resources: {'server_groups'} {{(pid=129410) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 18:04:57.162229 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.quota [None req-a63445b9-0cce-4542-8ed8-5c432ebfc80f tempest-ServerGroup264TestJSON-455892154 tempest-ServerGroup264TestJSON-455892154-project] Getting quotas for project e671d0ff927e41aa8107f77b4142710c. Resources: {'server_groups'} {{(pid=129410) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 18:04:57.168497 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.quota [None req-a63445b9-0cce-4542-8ed8-5c432ebfc80f tempest-ServerGroup264TestJSON-455892154 tempest-ServerGroup264TestJSON-455892154-project] Getting quotas for user 56bbf5f0dcfa40f38c08c1091e737b03 and project e671d0ff927e41aa8107f77b4142710c. Resources: {'server_groups'} {{(pid=129410) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 18:04:57.188754 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-a63445b9-0cce-4542-8ed8-5c432ebfc80f tempest-ServerGroup264TestJSON-455892154 tempest-ServerGroup264TestJSON-455892154-project] 10.222.0.50 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.913311 Aug 10 18:04:57.190001 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 1000/2024] 10.222.0.50 () {62 vars in 1214 bytes} [Wed Aug 10 18:04:56 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 18:04:57.201672 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-cb9abc0d-5100-49eb-b9e5-9c820d5839cd tempest-ServerGroup264TestJSON-455892154 tempest-ServerGroup264TestJSON-455892154-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:04:57.214332 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_api:SELECT=4 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 18:04:57.225548 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_cell1:SELECT=6 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 18:04:57.225548 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-cb9abc0d-5100-49eb-b9e5-9c820d5839cd tempest-ServerGroup264TestJSON-455892154 tempest-ServerGroup264TestJSON-455892154-project] 10.222.0.50 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.022840 Aug 10 18:04:57.225548 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1025/2025] 10.222.0.50 () {60 vars in 1193 bytes} [Wed Aug 10 18:04:57 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 18:04:57.231572 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-8737f975-33d7-48a7-a3f9-3d942302fd75 tempest-ServerGroup264TestJSON-455892154 tempest-ServerGroup264TestJSON-455892154-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:04:57.240716 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-8737f975-33d7-48a7-a3f9-3d942302fd75 tempest-ServerGroup264TestJSON-455892154 tempest-ServerGroup264TestJSON-455892154-project] 10.222.0.50 "GET /compute/v2.1/os-server-groups/42ed0c5f-8626-4a6c-ac30-71691ced4be7" status: 200 len: 235 microversion: 2.64 time: 0.013599 Aug 10 18:04:57.241799 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 1001/2026] 10.222.0.50 () {60 vars in 1304 bytes} [Wed Aug 10 18:04:57 2022] GET /compute/v2.1/os-server-groups/42ed0c5f-8626-4a6c-ac30-71691ced4be7 => generated 235 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 18:04:57.254673 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-829bcf03-fcb9-49b2-8e44-8b9237060c7b tempest-ServerGroup264TestJSON-455892154 tempest-ServerGroup264TestJSON-455892154-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:04:57.550444 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-829bcf03-fcb9-49b2-8e44-8b9237060c7b tempest-ServerGroup264TestJSON-455892154 tempest-ServerGroup264TestJSON-455892154-project] 10.222.0.50 "DELETE /compute/v2.1/os-server-groups/42ed0c5f-8626-4a6c-ac30-71691ced4be7" status: 204 len: 0 microversion: 2.64 time: 0.300801 Aug 10 18:04:57.551206 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1026/2027] 10.222.0.50 () {60 vars in 1307 bytes} [Wed Aug 10 18:04:57 2022] DELETE /compute/v2.1/os-server-groups/42ed0c5f-8626-4a6c-ac30-71691ced4be7 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 10 18:04:57.562283 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-d2b4aab9-927e-4aad-8a47-6b1e6b9e0c7b tempest-ServerGroup264TestJSON-455892154 tempest-ServerGroup264TestJSON-455892154-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:04:57.570641 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-d2b4aab9-927e-4aad-8a47-6b1e6b9e0c7b tempest-ServerGroup264TestJSON-455892154 tempest-ServerGroup264TestJSON-455892154-project] HTTP exception thrown: Instance group 42ed0c5f-8626-4a6c-ac30-71691ced4be7 could not be found. Aug 10 18:04:57.572866 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-d2b4aab9-927e-4aad-8a47-6b1e6b9e0c7b tempest-ServerGroup264TestJSON-455892154 tempest-ServerGroup264TestJSON-455892154-project] Request method failure captured: Aug 10 18:04:57.572866 n-d-852296-2 devstack@n-api.service[129410]: request: DELETE /compute/v2.1/os-server-groups/42ed0c5f-8626-4a6c-ac30-71691ced4be7 HTTP/1.1 Aug 10 18:04:57.572866 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 18:04:57.572866 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 18:04:57.572866 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 18:04:57.572866 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 0 Aug 10 18:04:57.572866 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 18:04:57.572866 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 18:04:57.572866 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 18:04:57.572866 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 18:04:57.572866 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8_NI02fRs0qzGKvIXWLdker421Ci-Eaa_SZUUdhBIqgr30lRB1X9jpuIcemll0AVhYWykeBXRU2MIQL2xdQpWOWoAqYp_aq2ybYk4my-5gFFSdXEghVU18cjVzcMUQT3Hk_3GDmk5t2y0U0dOKEq6MMFOqExzz5KbMjSheKNED0sSaQ Aug 10 18:04:57.572866 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 18:04:57.572866 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 18:04:57.572866 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 18:04:57.572866 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 18:04:57.572866 n-d-852296-2 devstack@n-api.service[129410]: X-Openstack-Nova-Api-Version: 2.64 Aug 10 18:04:57.572866 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 18:04:57.572866 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 18:04:57.572866 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: e671d0ff927e41aa8107f77b4142710c Aug 10 18:04:57.572866 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-ServerGroup264TestJSON-455892154 Aug 10 18:04:57.572866 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 18:04:57.572866 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 18:04:57.572866 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e671d0ff927e41aa8107f77b4142710c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/e671d0ff927e41aa8107f77b4142710c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e671d0ff927e41aa8107f77b4142710c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_e671d0ff927e41aa8107f77b4142710c", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 18:04:57.572866 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-ServerGroup264TestJSON-455892154 Aug 10 18:04:57.572866 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: e671d0ff927e41aa8107f77b4142710c Aug 10 18:04:57.572866 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-ServerGroup264TestJSON-455892154 Aug 10 18:04:57.572866 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-ServerGroup264TestJSON-455892154-project Aug 10 18:04:57.572866 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 18:04:57.572866 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 18:04:57.572866 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: 56bbf5f0dcfa40f38c08c1091e737b03 Aug 10 18:04:57.572866 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-ServerGroup264TestJSON-455892154-project Aug 10 18:04:57.572866 n-d-852296-2 devstack@n-api.service[129410]: method: > Aug 10 18:04:57.572866 n-d-852296-2 devstack@n-api.service[129410]: exception: Instance group 42ed0c5f-8626-4a6c-ac30-71691ced4be7 could not be found. Aug 10 18:04:57.572866 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'id': '42ed0c5f-8626-4a6c-ac30-71691ced4be7'} Aug 10 18:04:57.572866 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 18:04:57.572866 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:04:57.572866 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 10 18:04:57.572866 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 10 18:04:57.572866 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 18:04:57.572866 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 18:04:57.572866 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 10 18:04:57.572866 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 10 18:04:57.572866 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 10 18:04:57.572866 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 10 18:04:57.572866 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 10 18:04:57.572866 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 10 18:04:57.572866 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 42ed0c5f-8626-4a6c-ac30-71691ced4be7 could not be found. Aug 10 18:04:57.572866 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:04:57.572866 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:04:57.572866 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:04:57.572866 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:04:57.572866 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:04:57.572866 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:04:57.572866 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 18:04:57.572866 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 18:04:57.572866 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:04:57.572866 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:04:57.572866 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 10 18:04:57.572866 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 10 18:04:57.572866 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 42ed0c5f-8626-4a6c-ac30-71691ced4be7 could not be found. Aug 10 18:04:57.572866 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:04:57.572866 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:04:57.572866 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:04:57.572866 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:04:57.577423 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:04:57.577423 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:04:57.577423 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 18:04:57.577423 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 18:04:57.577423 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 42ed0c5f-8626-4a6c-ac30-71691ced4be7 could not be found. Aug 10 18:04:57.577423 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:04:57.593788 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-d2b4aab9-927e-4aad-8a47-6b1e6b9e0c7b tempest-ServerGroup264TestJSON-455892154 tempest-ServerGroup264TestJSON-455892154-project] Returning 404 to user: Instance group 42ed0c5f-8626-4a6c-ac30-71691ced4be7 could not be found. {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 18:04:57.594995 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-d2b4aab9-927e-4aad-8a47-6b1e6b9e0c7b tempest-ServerGroup264TestJSON-455892154 tempest-ServerGroup264TestJSON-455892154-project] 10.222.0.50 "DELETE /compute/v2.1/os-server-groups/42ed0c5f-8626-4a6c-ac30-71691ced4be7" status: 404 len: 117 microversion: 2.64 time: 0.038473 Aug 10 18:04:57.597992 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 1002/2028] 10.222.0.50 () {60 vars in 1307 bytes} [Wed Aug 10 18:04:57 2022] DELETE /compute/v2.1/os-server-groups/42ed0c5f-8626-4a6c-ac30-71691ced4be7 => generated 117 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 10 18:05:30.339804 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-81fa30cc-7148-4926-99b2-b9e78c24635a tempest-ServersTestJSON-1630654139 tempest-ServersTestJSON-1630654139-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-864490457", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "926cb984-90cd-45ce-82dc-a2ee45e5a0e3"}]}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 18:05:30.768996 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.network.neutron [None req-81fa30cc-7148-4926-99b2-b9e78c24635a tempest-ServersTestJSON-1630654139 tempest-ServersTestJSON-1630654139-project] validate_networks() for [('926cb984-90cd-45ce-82dc-a2ee45e5a0e3', None, None, None, None, None)] {{(pid=129409) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 18:05:31.563043 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [None req-81fa30cc-7148-4926-99b2-b9e78c24635a tempest-ServersTestJSON-1630654139 tempest-ServersTestJSON-1630654139-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-c73e4243-28e9-4dac-902a-d5a75be87536) Aug 10 18:05:31.563043 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:05:31.563043 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:05:31.563043 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:05:31.563043 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:05:31.563043 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:05:31.563043 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:05:31.563043 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:05:31.563043 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:05:31.563043 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:05:31.563043 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 18:05:31.563043 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 18:05:31.563043 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 18:05:31.563043 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 18:05:31.563043 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 18:05:31.563043 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 18:05:31.563043 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 18:05:31.563043 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 18:05:31.563043 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 18:05:31.563043 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 18:05:31.563043 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 18:05:31.563043 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 18:05:31.563043 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 18:05:31.563043 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 18:05:31.563043 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 18:05:31.563043 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 18:05:31.563043 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 18:05:31.563043 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:05:31.563043 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:05:31.563043 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 18:05:31.563043 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 18:05:31.563043 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:05:31.563043 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:05:31.563043 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 18:05:31.563043 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 18:05:31.563043 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:05:31.563043 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:05:31.563043 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:05:31.563043 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:05:31.563043 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:05:31.563043 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:05:31.563043 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 18:05:31.563043 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 18:05:31.563043 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 18:05:31.563043 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 18:05:31.563043 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 18:05:31.563043 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 18:05:31.563043 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 18:05:31.563043 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 18:05:31.563043 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 18:05:31.563043 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 18:05:31.563043 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 18:05:31.563043 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 18:05:31.567047 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 18:05:31.567047 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 18:05:31.567047 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 18:05:31.567047 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 18:05:31.567047 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 18:05:31.567047 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 18:05:31.567047 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 18:05:31.567047 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 18:05:31.567047 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 18:05:31.567047 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 18:05:31.567047 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 18:05:31.567047 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 18:05:31.567047 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 18:05:31.567047 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 18:05:31.567047 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-c73e4243-28e9-4dac-902a-d5a75be87536) Aug 10 18:05:31.567047 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:05:31.567047 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-81fa30cc-7148-4926-99b2-b9e78c24635a tempest-ServersTestJSON-1630654139 tempest-ServersTestJSON-1630654139-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:05:31.567047 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 18:05:31.574391 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-81fa30cc-7148-4926-99b2-b9e78c24635a tempest-ServersTestJSON-1630654139 tempest-ServersTestJSON-1630654139-project] Request method failure captured: Aug 10 18:05:31.574391 n-d-852296-2 devstack@n-api.service[129409]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 18:05:31.574391 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 18:05:31.574391 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 18:05:31.574391 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 18:05:31.574391 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 184 Aug 10 18:05:31.574391 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 18:05:31.574391 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 18:05:31.574391 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 18:05:31.574391 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 18:05:31.574391 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8_NpG461t7Wh4xqSGgpz6tVheb3RhfaKxcIE9oNxw9K6BYRzknX-AFkfe5riXHRxyluLwenPIJFFWVg8YmqJ3fSpeHNbIUjkNvuBl-c-kpU5MqggrrRkQdftSFrQJt7toGcDMdNWl54HfIRsHBDiwC2H-8MCcN-7QRiR_RFAXk7fnfk Aug 10 18:05:31.574391 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 18:05:31.574391 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 18:05:31.574391 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 18:05:31.574391 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 18:05:31.574391 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 18:05:31.574391 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 18:05:31.574391 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: ab3b279d78ee41caa5687d574919832c Aug 10 18:05:31.574391 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-ServersTestJSON-1630654139 Aug 10 18:05:31.574391 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 18:05:31.574391 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 18:05:31.574391 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ab3b279d78ee41caa5687d574919832c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/ab3b279d78ee41caa5687d574919832c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ab3b279d78ee41caa5687d574919832c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_ab3b279d78ee41caa5687d574919832c", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 18:05:31.574391 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-ServersTestJSON-1630654139 Aug 10 18:05:31.574391 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: ab3b279d78ee41caa5687d574919832c Aug 10 18:05:31.574391 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-ServersTestJSON-1630654139 Aug 10 18:05:31.574391 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-ServersTestJSON-1630654139-project Aug 10 18:05:31.574391 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 18:05:31.574391 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 18:05:31.574391 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: cdc1545e8c0d4534a9d647e671979a54 Aug 10 18:05:31.574391 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-ServersTestJSON-1630654139-project Aug 10 18:05:31.574391 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 18:05:31.574391 n-d-852296-2 devstack@n-api.service[129409]: {"server": {"name": "tempest-\u20a1-864490457", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "926cb984-90cd-45ce-82dc-a2ee45e5a0e3"}]}} Aug 10 18:05:31.574391 n-d-852296-2 devstack@n-api.service[129409]: method: > Aug 10 18:05:31.574391 n-d-852296-2 devstack@n-api.service[129409]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:05:31.574391 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 18:05:31.574391 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'body': {'server': {'name': 'tempest-₡-864490457', 'imageRef': 'a735ff26-463a-4ffe-a981-ab9d9baa494f', 'flavorRef': '452', 'networks': [{'uuid': '926cb984-90cd-45ce-82dc-a2ee45e5a0e3'}]}}} Aug 10 18:05:31.574391 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 18:05:31.574391 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:05:31.574391 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:05:31.574391 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:05:31.574391 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:05:31.574391 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:05:31.574391 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:05:31.574391 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:05:31.574391 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:05:31.574391 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:05:31.574391 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 18:05:31.574391 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 18:05:31.574391 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 18:05:31.574391 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 18:05:31.574391 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 18:05:31.574391 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 18:05:31.574391 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 18:05:31.574391 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 18:05:31.574391 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 18:05:31.574391 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 18:05:31.574391 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 18:05:31.574391 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 18:05:31.574391 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 18:05:31.574391 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 18:05:31.574391 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 18:05:31.574391 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 18:05:31.579057 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 18:05:31.579057 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:05:31.579057 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:05:31.579057 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 18:05:31.579057 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 18:05:31.579057 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:05:31.579057 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:05:31.579057 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 18:05:31.579057 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 18:05:31.579057 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:05:31.579057 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:05:31.579057 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:05:31.579057 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:05:31.579057 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:05:31.579057 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:05:31.579057 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 18:05:31.579057 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 18:05:31.579057 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 18:05:31.579057 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 18:05:31.579057 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 18:05:31.579057 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 18:05:31.579057 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 18:05:31.579057 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 18:05:31.579057 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 18:05:31.579057 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 18:05:31.579057 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 18:05:31.579057 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 18:05:31.579057 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 18:05:31.579057 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 18:05:31.579057 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 18:05:31.579057 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 18:05:31.579057 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 18:05:31.579057 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 18:05:31.579057 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 18:05:31.579057 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 18:05:31.579057 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 18:05:31.579057 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 18:05:31.579057 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 18:05:31.579057 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 18:05:31.579057 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 18:05:31.579057 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 18:05:31.579057 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-c73e4243-28e9-4dac-902a-d5a75be87536) Aug 10 18:05:31.579057 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:05:31.579057 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:05:31.579057 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:05:31.579057 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:05:31.579057 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:05:31.579057 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:05:31.579057 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 18:05:31.579057 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 18:05:31.579057 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 10 18:05:31.579057 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 10 18:05:31.579057 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:05:31.585437 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:05:31.585437 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:05:31.585437 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:05:31.585437 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:05:31.585437 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:05:31.585437 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:05:31.585437 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:05:31.585437 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 18:05:31.585437 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 18:05:31.585437 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:05:31.585437 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:05:31.585437 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:05:31.585437 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-81fa30cc-7148-4926-99b2-b9e78c24635a tempest-ServersTestJSON-1630654139 tempest-ServersTestJSON-1630654139-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:05:31.585437 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 18:05:31.585437 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-81fa30cc-7148-4926-99b2-b9e78c24635a tempest-ServersTestJSON-1630654139 tempest-ServersTestJSON-1630654139-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.537909 Aug 10 18:05:31.585437 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1027/2029] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 18:05:30 2022] POST /compute/v2.1/servers => generated 214 bytes in 1546 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 10 18:05:31.796071 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_cell0:SELECT=8 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 18:05:31.797013 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=2 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 18:05:31.801624 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-d1275feb-8cd8-4489-9ee6-ba7f44e2a132 tempest-ServersTestJSON-1630654139 tempest-ServersTestJSON-1630654139-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-143690161", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 18:05:31.863091 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.network.neutron [None req-d1275feb-8cd8-4489-9ee6-ba7f44e2a132 tempest-ServersTestJSON-1630654139 tempest-ServersTestJSON-1630654139-project] validate_networks() for [('926cb984-90cd-45ce-82dc-a2ee45e5a0e3', None, None, None, None, None)] {{(pid=129410) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 18:05:32.787331 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [None req-d1275feb-8cd8-4489-9ee6-ba7f44e2a132 tempest-ServersTestJSON-1630654139 tempest-ServersTestJSON-1630654139-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-40c51bb2-0611-4e30-98f5-e251120349e2) Aug 10 18:05:32.787331 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:05:32.787331 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:05:32.787331 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:05:32.787331 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:05:32.787331 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:05:32.787331 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:05:32.787331 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:05:32.787331 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:05:32.787331 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:05:32.787331 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 18:05:32.787331 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 18:05:32.787331 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 18:05:32.787331 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 18:05:32.787331 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 18:05:32.787331 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 18:05:32.787331 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 18:05:32.787331 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 18:05:32.787331 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 18:05:32.787331 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 18:05:32.787331 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 18:05:32.787331 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 18:05:32.787331 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 18:05:32.787331 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 18:05:32.787331 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 18:05:32.787331 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 18:05:32.787331 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 18:05:32.787331 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:05:32.787331 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:05:32.787331 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 18:05:32.787331 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 18:05:32.787331 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:05:32.787331 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:05:32.787331 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 18:05:32.787331 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 18:05:32.787331 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:05:32.787331 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:05:32.787331 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:05:32.787331 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:05:32.787331 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:05:32.787331 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:05:32.787331 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 18:05:32.787331 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 18:05:32.787331 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 18:05:32.787331 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 18:05:32.787331 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 18:05:32.787331 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 18:05:32.787331 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 18:05:32.787331 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 18:05:32.787331 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 18:05:32.787331 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 18:05:32.787331 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 18:05:32.787331 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 18:05:32.791314 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 18:05:32.791314 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 18:05:32.791314 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 18:05:32.791314 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 18:05:32.791314 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 18:05:32.791314 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 18:05:32.791314 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 18:05:32.791314 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 18:05:32.791314 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 18:05:32.791314 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 18:05:32.791314 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 18:05:32.791314 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 18:05:32.791314 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 18:05:32.791314 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 18:05:32.791314 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-40c51bb2-0611-4e30-98f5-e251120349e2) Aug 10 18:05:32.791314 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:05:32.795581 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-d1275feb-8cd8-4489-9ee6-ba7f44e2a132 tempest-ServersTestJSON-1630654139 tempest-ServersTestJSON-1630654139-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:05:32.795581 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 18:05:32.808564 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-d1275feb-8cd8-4489-9ee6-ba7f44e2a132 tempest-ServersTestJSON-1630654139 tempest-ServersTestJSON-1630654139-project] Request method failure captured: Aug 10 18:05:32.808564 n-d-852296-2 devstack@n-api.service[129410]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 18:05:32.808564 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 18:05:32.808564 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 18:05:32.808564 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 18:05:32.808564 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 229 Aug 10 18:05:32.808564 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 18:05:32.808564 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 18:05:32.808564 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 18:05:32.808564 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 18:05:32.808564 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8_NpG461t7Wh4xqSGgpz6tVheb3RhfaKxcIE9oNxw9K6BYRzknX-AFkfe5riXHRxyluLwenPIJFFWVg8YmqJ3fSpeHNbIUjkNvuBl-c-kpU5MqggrrRkQdftSFrQJt7toGcDMdNWl54HfIRsHBDiwC2H-8MCcN-7QRiR_RFAXk7fnfk Aug 10 18:05:32.808564 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 18:05:32.808564 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 18:05:32.808564 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 18:05:32.808564 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 18:05:32.808564 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 18:05:32.808564 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 18:05:32.808564 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: ab3b279d78ee41caa5687d574919832c Aug 10 18:05:32.808564 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-ServersTestJSON-1630654139 Aug 10 18:05:32.808564 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 18:05:32.808564 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 18:05:32.808564 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ab3b279d78ee41caa5687d574919832c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/ab3b279d78ee41caa5687d574919832c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ab3b279d78ee41caa5687d574919832c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_ab3b279d78ee41caa5687d574919832c", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 18:05:32.808564 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-ServersTestJSON-1630654139 Aug 10 18:05:32.808564 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: ab3b279d78ee41caa5687d574919832c Aug 10 18:05:32.808564 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-ServersTestJSON-1630654139 Aug 10 18:05:32.808564 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-ServersTestJSON-1630654139-project Aug 10 18:05:32.808564 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 18:05:32.808564 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 18:05:32.808564 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: cdc1545e8c0d4534a9d647e671979a54 Aug 10 18:05:32.808564 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-ServersTestJSON-1630654139-project Aug 10 18:05:32.808564 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 18:05:32.808564 n-d-852296-2 devstack@n-api.service[129410]: {"server": {"name": "tempest-ServersTestJSON-server-143690161", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "adminPass": "testpassword", "networks": [{"uuid": "926cb984-90cd-45ce-82dc-a2ee45e5a0e3"}]}} Aug 10 18:05:32.808564 n-d-852296-2 devstack@n-api.service[129410]: method: > Aug 10 18:05:32.808564 n-d-852296-2 devstack@n-api.service[129410]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:05:32.808564 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 18:05:32.808564 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'body': {'server': {'name': 'tempest-ServersTestJSON-server-143690161', 'imageRef': 'a735ff26-463a-4ffe-a981-ab9d9baa494f', 'flavorRef': '452', 'adminPass': 'testpassword', 'networks': [{'uuid': '926cb984-90cd-45ce-82dc-a2ee45e5a0e3'}]}}} Aug 10 18:05:32.808564 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 18:05:32.808564 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:05:32.808564 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:05:32.808564 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:05:32.808564 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:05:32.808564 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:05:32.808564 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:05:32.808564 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:05:32.808564 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:05:32.808564 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:05:32.808564 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 18:05:32.808564 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 18:05:32.808564 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 18:05:32.808564 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 18:05:32.808564 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 18:05:32.808564 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 18:05:32.808564 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 18:05:32.808564 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 18:05:32.808564 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 18:05:32.808564 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 18:05:32.808564 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 18:05:32.808564 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 18:05:32.808564 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 18:05:32.808564 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 18:05:32.808564 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 18:05:32.813009 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 18:05:32.813009 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 18:05:32.813009 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:05:32.813009 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:05:32.813009 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 18:05:32.813009 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 18:05:32.813009 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:05:32.813009 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:05:32.813009 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 18:05:32.813009 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 18:05:32.813009 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:05:32.813009 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:05:32.813009 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:05:32.813009 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:05:32.813009 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:05:32.813009 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:05:32.813009 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 18:05:32.813009 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 18:05:32.813009 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 18:05:32.813009 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 18:05:32.813009 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 18:05:32.813009 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 18:05:32.813009 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 18:05:32.813009 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 18:05:32.813009 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 18:05:32.813009 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 18:05:32.813009 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 18:05:32.813009 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 18:05:32.813009 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 18:05:32.813009 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 18:05:32.813009 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 18:05:32.813009 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 18:05:32.813009 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 18:05:32.813009 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 18:05:32.813009 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 18:05:32.813009 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 18:05:32.813009 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 18:05:32.813009 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 18:05:32.813009 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 18:05:32.813009 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 18:05:32.813009 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 18:05:32.813009 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 18:05:32.813009 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-40c51bb2-0611-4e30-98f5-e251120349e2) Aug 10 18:05:32.813009 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:05:32.813009 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:05:32.813009 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:05:32.813009 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:05:32.813009 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:05:32.813009 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:05:32.813009 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 18:05:32.813009 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 18:05:32.813009 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 10 18:05:32.813009 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 10 18:05:32.818991 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:05:32.818991 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:05:32.818991 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:05:32.818991 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:05:32.818991 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:05:32.818991 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:05:32.818991 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:05:32.818991 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:05:32.818991 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 18:05:32.818991 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 18:05:32.818991 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:05:32.818991 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:05:32.818991 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:05:32.822171 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-d1275feb-8cd8-4489-9ee6-ba7f44e2a132 tempest-ServersTestJSON-1630654139 tempest-ServersTestJSON-1630654139-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:05:32.822171 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 18:05:32.824972 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-d1275feb-8cd8-4489-9ee6-ba7f44e2a132 tempest-ServersTestJSON-1630654139 tempest-ServersTestJSON-1630654139-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.032926 Aug 10 18:05:32.840605 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 1003/2030] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 18:05:31 2022] POST /compute/v2.1/servers => generated 214 bytes in 1049 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 10 18:05:33.050491 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-d3fabf12-1a04-4027-ba55-4fe718f02fcb tempest-ServersTestJSON-1630654139 tempest-ServersTestJSON-1630654139-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-363348678", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "926cb984-90cd-45ce-82dc-a2ee45e5a0e3"}]}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 18:05:33.156446 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.network.neutron [None req-d3fabf12-1a04-4027-ba55-4fe718f02fcb tempest-ServersTestJSON-1630654139 tempest-ServersTestJSON-1630654139-project] validate_networks() for [('926cb984-90cd-45ce-82dc-a2ee45e5a0e3', None, None, None, None, None)] {{(pid=129409) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 18:05:33.833247 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [None req-d3fabf12-1a04-4027-ba55-4fe718f02fcb tempest-ServersTestJSON-1630654139 tempest-ServersTestJSON-1630654139-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-fb11c9a6-eb29-495e-904a-e9c8b77554d2) Aug 10 18:05:33.833247 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:05:33.833247 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:05:33.833247 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:05:33.833247 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:05:33.833247 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:05:33.833247 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:05:33.833247 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:05:33.833247 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:05:33.833247 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:05:33.833247 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 18:05:33.833247 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 18:05:33.833247 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 18:05:33.833247 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 18:05:33.833247 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 18:05:33.833247 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 18:05:33.833247 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 18:05:33.833247 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 18:05:33.833247 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 18:05:33.833247 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 18:05:33.833247 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 18:05:33.833247 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 18:05:33.833247 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 18:05:33.833247 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 18:05:33.833247 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 18:05:33.833247 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 18:05:33.833247 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 18:05:33.833247 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:05:33.833247 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:05:33.833247 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 18:05:33.833247 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 18:05:33.833247 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:05:33.833247 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:05:33.833247 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 18:05:33.833247 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 18:05:33.833247 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:05:33.833247 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:05:33.833247 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:05:33.833247 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:05:33.833247 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:05:33.833247 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:05:33.833247 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 18:05:33.833247 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 18:05:33.833247 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 18:05:33.833247 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 18:05:33.833247 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 18:05:33.833247 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 18:05:33.833247 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 18:05:33.833247 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 18:05:33.833247 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 18:05:33.833247 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 18:05:33.833247 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 18:05:33.833247 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 18:05:33.836741 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 18:05:33.836741 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 18:05:33.836741 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 18:05:33.836741 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 18:05:33.836741 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 18:05:33.836741 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 18:05:33.836741 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 18:05:33.836741 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 18:05:33.836741 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 18:05:33.836741 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 18:05:33.836741 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 18:05:33.836741 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 18:05:33.836741 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 18:05:33.836741 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 18:05:33.836741 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-fb11c9a6-eb29-495e-904a-e9c8b77554d2) Aug 10 18:05:33.836741 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:05:33.838340 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-d3fabf12-1a04-4027-ba55-4fe718f02fcb tempest-ServersTestJSON-1630654139 tempest-ServersTestJSON-1630654139-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:05:33.838340 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 18:05:33.841450 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-d3fabf12-1a04-4027-ba55-4fe718f02fcb tempest-ServersTestJSON-1630654139 tempest-ServersTestJSON-1630654139-project] Request method failure captured: Aug 10 18:05:33.841450 n-d-852296-2 devstack@n-api.service[129409]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 18:05:33.841450 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 18:05:33.841450 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 18:05:33.841450 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 18:05:33.841450 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 230 Aug 10 18:05:33.841450 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 18:05:33.841450 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 18:05:33.841450 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 18:05:33.841450 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 18:05:33.841450 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8_NpG461t7Wh4xqSGgpz6tVheb3RhfaKxcIE9oNxw9K6BYRzknX-AFkfe5riXHRxyluLwenPIJFFWVg8YmqJ3fSpeHNbIUjkNvuBl-c-kpU5MqggrrRkQdftSFrQJt7toGcDMdNWl54HfIRsHBDiwC2H-8MCcN-7QRiR_RFAXk7fnfk Aug 10 18:05:33.841450 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 18:05:33.841450 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 18:05:33.841450 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 18:05:33.841450 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 18:05:33.841450 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 18:05:33.841450 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 18:05:33.841450 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: ab3b279d78ee41caa5687d574919832c Aug 10 18:05:33.841450 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-ServersTestJSON-1630654139 Aug 10 18:05:33.841450 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 18:05:33.841450 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 18:05:33.841450 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ab3b279d78ee41caa5687d574919832c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/ab3b279d78ee41caa5687d574919832c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ab3b279d78ee41caa5687d574919832c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_ab3b279d78ee41caa5687d574919832c", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 18:05:33.841450 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-ServersTestJSON-1630654139 Aug 10 18:05:33.841450 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: ab3b279d78ee41caa5687d574919832c Aug 10 18:05:33.841450 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-ServersTestJSON-1630654139 Aug 10 18:05:33.841450 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-ServersTestJSON-1630654139-project Aug 10 18:05:33.841450 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 18:05:33.841450 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 18:05:33.841450 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: cdc1545e8c0d4534a9d647e671979a54 Aug 10 18:05:33.841450 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-ServersTestJSON-1630654139-project Aug 10 18:05:33.841450 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 18:05:33.841450 n-d-852296-2 devstack@n-api.service[129409]: {"server": {"name": "tempest-ServersTestJSON-server-363348678", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "926cb984-90cd-45ce-82dc-a2ee45e5a0e3"}]}} Aug 10 18:05:33.841450 n-d-852296-2 devstack@n-api.service[129409]: method: > Aug 10 18:05:33.841450 n-d-852296-2 devstack@n-api.service[129409]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:05:33.841450 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 18:05:33.841450 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'body': {'server': {'name': 'tempest-ServersTestJSON-server-363348678', 'imageRef': 'a735ff26-463a-4ffe-a981-ab9d9baa494f', 'flavorRef': '452', 'networks': [{'uuid': '926cb984-90cd-45ce-82dc-a2ee45e5a0e3'}]}}} Aug 10 18:05:33.841450 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 18:05:33.841450 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:05:33.841450 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:05:33.841450 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:05:33.841450 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:05:33.841450 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:05:33.841450 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:05:33.841450 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:05:33.841450 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:05:33.841450 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:05:33.841450 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 18:05:33.841450 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 18:05:33.841450 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 18:05:33.841450 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 18:05:33.841450 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 18:05:33.841450 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 18:05:33.841450 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 18:05:33.841450 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 18:05:33.841450 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 18:05:33.841450 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 18:05:33.841450 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 18:05:33.841450 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 18:05:33.841450 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 18:05:33.841450 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 18:05:33.841450 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 18:05:33.855491 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 18:05:33.855491 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 18:05:33.855491 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:05:33.855491 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:05:33.855491 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 18:05:33.855491 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 18:05:33.855491 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:05:33.855491 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:05:33.855491 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 18:05:33.855491 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 18:05:33.855491 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:05:33.855491 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:05:33.855491 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:05:33.855491 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:05:33.855491 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:05:33.855491 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:05:33.855491 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 18:05:33.855491 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 18:05:33.855491 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 18:05:33.855491 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 18:05:33.855491 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 18:05:33.855491 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 18:05:33.855491 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 18:05:33.855491 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 18:05:33.855491 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 18:05:33.855491 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 18:05:33.855491 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 18:05:33.855491 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 18:05:33.855491 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 18:05:33.855491 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 18:05:33.855491 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 18:05:33.855491 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 18:05:33.855491 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 18:05:33.855491 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 18:05:33.855491 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 18:05:33.855491 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 18:05:33.855491 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 18:05:33.855491 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 18:05:33.855491 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 18:05:33.855491 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 18:05:33.855491 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 18:05:33.855491 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 18:05:33.855491 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-fb11c9a6-eb29-495e-904a-e9c8b77554d2) Aug 10 18:05:33.855491 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:05:33.855491 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:05:33.855491 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:05:33.855491 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:05:33.855491 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:05:33.855491 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:05:33.855491 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 18:05:33.855491 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 18:05:33.855491 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 10 18:05:33.855491 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 10 18:05:33.858841 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:05:33.858841 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:05:33.858841 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:05:33.858841 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:05:33.858841 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:05:33.858841 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:05:33.858841 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:05:33.858841 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:05:33.858841 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 18:05:33.858841 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 18:05:33.858841 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:05:33.858841 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:05:33.858841 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:05:33.858841 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-d3fabf12-1a04-4027-ba55-4fe718f02fcb tempest-ServersTestJSON-1630654139 tempest-ServersTestJSON-1630654139-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:05:33.858841 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 18:05:33.858841 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-d3fabf12-1a04-4027-ba55-4fe718f02fcb tempest-ServersTestJSON-1630654139 tempest-ServersTestJSON-1630654139-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.797964 Aug 10 18:05:33.860068 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-03f75ec4-cc86-4929-83ad-7c04f4347976 tempest-ServersTestJSON-1630654139 tempest-ServersTestJSON-1630654139-project] Action: 'create', calling method: .version_select at 0x7fb34668ae50>, body: {"keypair": {"name": "tempest-key-1247225010", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBOpXDW3Rou/4i7UR0hFGzQvVURXuB+KKdNnDBRt8aVATZvTVV4+wFxAzSUCbxGCdCNRAq23yXOczs3y2M0HYwk4u1DrRjQnk/3Qk4kSAN5xz4IBw/W97W8EtiP98DU2PQ=="}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 18:05:33.860889 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1028/2031] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 18:05:33 2022] POST /compute/v2.1/servers => generated 214 bytes in 816 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 10 18:05:33.898048 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.quota [None req-03f75ec4-cc86-4929-83ad-7c04f4347976 tempest-ServersTestJSON-1630654139 tempest-ServersTestJSON-1630654139-project] Getting quotas for project ab3b279d78ee41caa5687d574919832c. Resources: {'key_pairs'} {{(pid=129410) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 18:05:33.906043 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.quota [None req-03f75ec4-cc86-4929-83ad-7c04f4347976 tempest-ServersTestJSON-1630654139 tempest-ServersTestJSON-1630654139-project] Getting quotas for user cdc1545e8c0d4534a9d647e671979a54 and project ab3b279d78ee41caa5687d574919832c. Resources: {'key_pairs'} {{(pid=129410) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 18:05:34.033414 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-03f75ec4-cc86-4929-83ad-7c04f4347976 tempest-ServersTestJSON-1630654139 tempest-ServersTestJSON-1630654139-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 382 microversion: 2.1 time: 0.179637 Aug 10 18:05:34.034667 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 1004/2032] 10.222.0.50 () {60 vars in 1159 bytes} [Wed Aug 10 18:05:33 2022] POST /compute/v2.1/os-keypairs => generated 382 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 18:05:34.060975 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-1fae848d-c1f7-4fda-9b3f-e034be84ef14 tempest-ServersTestJSON-1630654139 tempest-ServersTestJSON-1630654139-project] Calling method '.version_select at 0x7fb345dfd670>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:05:34.073969 n-d-852296-2 devstack@n-api.service[129409]: WARNING oslo_db.sqlalchemy.utils [None req-1fae848d-c1f7-4fda-9b3f-e034be84ef14 tempest-ServersTestJSON-1630654139 tempest-ServersTestJSON-1630654139-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 10 18:05:34.091279 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-1fae848d-c1f7-4fda-9b3f-e034be84ef14 tempest-ServersTestJSON-1630654139 tempest-ServersTestJSON-1630654139-project] 10.222.0.50 "GET /compute/v2.1/os-keypairs" status: 200 len: 351 microversion: 2.1 time: 0.041989 Aug 10 18:05:34.095346 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1029/2033] 10.222.0.50 () {58 vars in 1137 bytes} [Wed Aug 10 18:05:34 2022] GET /compute/v2.1/os-keypairs => generated 351 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 18:05:34.282462 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-5f7fc76b-0da4-450a-b278-3a1120e443b2 tempest-ServersTestJSON-1630654139 tempest-ServersTestJSON-1630654139-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-726000845", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "key_name": "tempest-key-1247225010", "networks": [{"uuid": "926cb984-90cd-45ce-82dc-a2ee45e5a0e3"}]}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 18:05:34.372888 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.network.neutron [None req-5f7fc76b-0da4-450a-b278-3a1120e443b2 tempest-ServersTestJSON-1630654139 tempest-ServersTestJSON-1630654139-project] validate_networks() for [('926cb984-90cd-45ce-82dc-a2ee45e5a0e3', None, None, None, None, None)] {{(pid=129410) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 18:05:34.731897 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [None req-5f7fc76b-0da4-450a-b278-3a1120e443b2 tempest-ServersTestJSON-1630654139 tempest-ServersTestJSON-1630654139-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-83e024a7-e348-4e25-a9c5-e1624d643ec3) Aug 10 18:05:34.731897 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:05:34.731897 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:05:34.731897 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:05:34.731897 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:05:34.731897 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:05:34.731897 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:05:34.731897 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:05:34.731897 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:05:34.731897 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:05:34.731897 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 18:05:34.731897 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 18:05:34.731897 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 18:05:34.731897 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 18:05:34.731897 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 18:05:34.731897 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 18:05:34.731897 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 18:05:34.731897 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 18:05:34.731897 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 18:05:34.731897 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 18:05:34.731897 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 18:05:34.731897 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 18:05:34.731897 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 18:05:34.731897 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 18:05:34.731897 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 18:05:34.731897 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 18:05:34.731897 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 18:05:34.731897 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:05:34.731897 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:05:34.731897 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 18:05:34.731897 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 18:05:34.731897 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:05:34.731897 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:05:34.731897 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 18:05:34.731897 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 18:05:34.731897 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:05:34.731897 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:05:34.731897 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:05:34.731897 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:05:34.731897 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:05:34.731897 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:05:34.731897 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 18:05:34.731897 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 18:05:34.731897 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 18:05:34.731897 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 18:05:34.731897 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 18:05:34.731897 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 18:05:34.731897 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 18:05:34.731897 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 18:05:34.731897 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 18:05:34.731897 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 18:05:34.731897 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 18:05:34.731897 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 18:05:34.740727 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 18:05:34.740727 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 18:05:34.740727 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 18:05:34.740727 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 18:05:34.740727 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 18:05:34.740727 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 18:05:34.740727 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 18:05:34.740727 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 18:05:34.740727 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 18:05:34.740727 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 18:05:34.740727 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 18:05:34.740727 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 18:05:34.740727 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 18:05:34.740727 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 18:05:34.740727 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-83e024a7-e348-4e25-a9c5-e1624d643ec3) Aug 10 18:05:34.740727 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:05:34.740727 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-5f7fc76b-0da4-450a-b278-3a1120e443b2 tempest-ServersTestJSON-1630654139 tempest-ServersTestJSON-1630654139-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:05:34.740727 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 18:05:34.740727 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-5f7fc76b-0da4-450a-b278-3a1120e443b2 tempest-ServersTestJSON-1630654139 tempest-ServersTestJSON-1630654139-project] Request method failure captured: Aug 10 18:05:34.740727 n-d-852296-2 devstack@n-api.service[129410]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 18:05:34.740727 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 18:05:34.740727 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 18:05:34.740727 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 18:05:34.740727 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 238 Aug 10 18:05:34.740727 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 18:05:34.740727 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 18:05:34.740727 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 18:05:34.740727 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 18:05:34.740727 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8_NpG461t7Wh4xqSGgpz6tVheb3RhfaKxcIE9oNxw9K6BYRzknX-AFkfe5riXHRxyluLwenPIJFFWVg8YmqJ3fSpeHNbIUjkNvuBl-c-kpU5MqggrrRkQdftSFrQJt7toGcDMdNWl54HfIRsHBDiwC2H-8MCcN-7QRiR_RFAXk7fnfk Aug 10 18:05:34.740727 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 18:05:34.740727 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 18:05:34.740727 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 18:05:34.740727 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 18:05:34.740727 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 18:05:34.740727 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 18:05:34.740727 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: ab3b279d78ee41caa5687d574919832c Aug 10 18:05:34.740727 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-ServersTestJSON-1630654139 Aug 10 18:05:34.740727 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 18:05:34.740727 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 18:05:34.740727 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ab3b279d78ee41caa5687d574919832c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/ab3b279d78ee41caa5687d574919832c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ab3b279d78ee41caa5687d574919832c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_ab3b279d78ee41caa5687d574919832c", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 18:05:34.740727 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-ServersTestJSON-1630654139 Aug 10 18:05:34.740727 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: ab3b279d78ee41caa5687d574919832c Aug 10 18:05:34.740727 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-ServersTestJSON-1630654139 Aug 10 18:05:34.740727 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-ServersTestJSON-1630654139-project Aug 10 18:05:34.740727 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 18:05:34.740727 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 18:05:34.740727 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: cdc1545e8c0d4534a9d647e671979a54 Aug 10 18:05:34.740727 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-ServersTestJSON-1630654139-project Aug 10 18:05:34.740727 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 18:05:34.740727 n-d-852296-2 devstack@n-api.service[129410]: {"server": {"name": "tempest-ServersTestJSON-server-726000845", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "key_name": "tempest-key-1247225010", "networks": [{"uuid": "926cb984-90cd-45ce-82dc-a2ee45e5a0e3"}]}} Aug 10 18:05:34.740727 n-d-852296-2 devstack@n-api.service[129410]: method: > Aug 10 18:05:34.740727 n-d-852296-2 devstack@n-api.service[129410]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:05:34.740727 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 18:05:34.740727 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'body': {'server': {'name': 'tempest-ServersTestJSON-server-726000845', 'imageRef': 'a735ff26-463a-4ffe-a981-ab9d9baa494f', 'flavorRef': '452', 'key_name': 'tempest-key-1247225010', 'networks': [{'uuid': '926cb984-90cd-45ce-82dc-a2ee45e5a0e3'}]}}} Aug 10 18:05:34.740727 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 18:05:34.747511 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:05:34.747511 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:05:34.747511 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:05:34.747511 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:05:34.747511 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:05:34.747511 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:05:34.747511 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:05:34.747511 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:05:34.747511 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:05:34.747511 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 18:05:34.747511 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 18:05:34.747511 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 18:05:34.747511 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 18:05:34.747511 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 18:05:34.747511 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 18:05:34.747511 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 18:05:34.747511 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 18:05:34.747511 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 18:05:34.747511 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 18:05:34.747511 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 18:05:34.747511 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 18:05:34.747511 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 18:05:34.747511 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 18:05:34.747511 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 18:05:34.747511 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 18:05:34.747511 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 18:05:34.747511 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:05:34.747511 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:05:34.747511 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 18:05:34.747511 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 18:05:34.747511 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:05:34.747511 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:05:34.747511 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 18:05:34.747511 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 18:05:34.747511 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:05:34.747511 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:05:34.747511 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:05:34.747511 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:05:34.747511 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:05:34.747511 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:05:34.747511 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 18:05:34.747511 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 18:05:34.747511 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 18:05:34.747511 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 18:05:34.747511 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 18:05:34.747511 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 18:05:34.747511 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 18:05:34.747511 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 18:05:34.747511 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 18:05:34.747511 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 18:05:34.747511 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 18:05:34.747511 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 18:05:34.747511 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 18:05:34.747511 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 18:05:34.747511 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 18:05:34.747511 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 18:05:34.755597 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 18:05:34.755597 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 18:05:34.755597 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 18:05:34.755597 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 18:05:34.755597 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 18:05:34.755597 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 18:05:34.755597 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 18:05:34.755597 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 18:05:34.755597 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 18:05:34.755597 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 18:05:34.755597 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-83e024a7-e348-4e25-a9c5-e1624d643ec3) Aug 10 18:05:34.755597 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:05:34.755597 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:05:34.755597 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:05:34.755597 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:05:34.755597 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:05:34.755597 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:05:34.755597 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 18:05:34.755597 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 18:05:34.755597 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 10 18:05:34.755597 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 10 18:05:34.755597 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:05:34.755597 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:05:34.755597 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:05:34.755597 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:05:34.755597 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:05:34.755597 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:05:34.755597 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:05:34.755597 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:05:34.755597 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 18:05:34.755597 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 18:05:34.755597 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:05:34.755597 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:05:34.755597 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:05:34.755597 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-5f7fc76b-0da4-450a-b278-3a1120e443b2 tempest-ServersTestJSON-1630654139 tempest-ServersTestJSON-1630654139-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:05:34.755597 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 18:05:34.755597 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-5f7fc76b-0da4-450a-b278-3a1120e443b2 tempest-ServersTestJSON-1630654139 tempest-ServersTestJSON-1630654139-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.472172 Aug 10 18:05:34.755597 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 1005/2034] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 18:05:34 2022] POST /compute/v2.1/servers => generated 214 bytes in 474 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 10 18:05:34.762428 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-cd3f0dc9-231e-4823-abd2-62116a735b6a tempest-ServersTestJSON-1630654139 tempest-ServersTestJSON-1630654139-project] Calling method '.version_select at 0x7fb345dfd9d0>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:05:34.912054 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-cd3f0dc9-231e-4823-abd2-62116a735b6a tempest-ServersTestJSON-1630654139 tempest-ServersTestJSON-1630654139-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-key-1247225010" status: 202 len: 0 microversion: 2.1 time: 0.155636 Aug 10 18:05:34.912973 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1030/2035] 10.222.0.50 () {58 vars in 1209 bytes} [Wed Aug 10 18:05:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-1247225010 => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 18:05:35.038945 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-cb7d2571-10c6-4080-86fa-a65a21c2d8fd tempest-ServersTestJSON-1630654139 tempest-ServersTestJSON-1630654139-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-231066053", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "926cb984-90cd-45ce-82dc-a2ee45e5a0e3"}]}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 18:05:35.115926 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.network.neutron [None req-cb7d2571-10c6-4080-86fa-a65a21c2d8fd tempest-ServersTestJSON-1630654139 tempest-ServersTestJSON-1630654139-project] validate_networks() for [('926cb984-90cd-45ce-82dc-a2ee45e5a0e3', None, None, None, None, None)] {{(pid=129410) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 18:05:35.231135 n-d-852296-2 devstack@n-api.service[129410]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 18:05:35.231303 n-d-852296-2 devstack@n-api.service[129410]: Wed Aug 10 18:05:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.50) !!! Aug 10 18:05:35.877934 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [None req-cb7d2571-10c6-4080-86fa-a65a21c2d8fd tempest-ServersTestJSON-1630654139 tempest-ServersTestJSON-1630654139-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-af9bafaa-d761-43e2-a436-14c2e28bc339) Aug 10 18:05:35.877934 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:05:35.877934 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:05:35.877934 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:05:35.877934 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:05:35.877934 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:05:35.877934 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:05:35.877934 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:05:35.877934 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:05:35.877934 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:05:35.877934 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 18:05:35.877934 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 18:05:35.877934 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 18:05:35.877934 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 18:05:35.877934 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 18:05:35.877934 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 18:05:35.877934 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 18:05:35.877934 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 18:05:35.877934 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 18:05:35.877934 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 18:05:35.877934 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 18:05:35.877934 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 18:05:35.877934 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 18:05:35.877934 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 18:05:35.877934 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 18:05:35.877934 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 18:05:35.877934 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 18:05:35.877934 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:05:35.877934 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:05:35.877934 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 18:05:35.877934 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 18:05:35.877934 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:05:35.877934 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:05:35.877934 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 18:05:35.877934 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 18:05:35.877934 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:05:35.877934 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:05:35.877934 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:05:35.877934 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:05:35.877934 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:05:35.877934 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:05:35.877934 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 18:05:35.877934 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 18:05:35.877934 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 18:05:35.877934 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 18:05:35.877934 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 18:05:35.877934 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 18:05:35.877934 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 18:05:35.877934 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 18:05:35.877934 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 18:05:35.877934 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 18:05:35.877934 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 18:05:35.877934 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 18:05:35.880797 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 18:05:35.880797 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 18:05:35.880797 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 18:05:35.880797 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 18:05:35.880797 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 18:05:35.880797 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 18:05:35.880797 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 18:05:35.880797 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 18:05:35.880797 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 18:05:35.880797 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 18:05:35.880797 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 18:05:35.880797 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 18:05:35.880797 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 18:05:35.880797 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 18:05:35.880797 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-af9bafaa-d761-43e2-a436-14c2e28bc339) Aug 10 18:05:35.880797 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:05:35.883149 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-cb7d2571-10c6-4080-86fa-a65a21c2d8fd tempest-ServersTestJSON-1630654139 tempest-ServersTestJSON-1630654139-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:05:35.883149 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 18:05:35.886233 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-cb7d2571-10c6-4080-86fa-a65a21c2d8fd tempest-ServersTestJSON-1630654139 tempest-ServersTestJSON-1630654139-project] Request method failure captured: Aug 10 18:05:35.886233 n-d-852296-2 devstack@n-api.service[129410]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 18:05:35.886233 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 18:05:35.886233 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 18:05:35.886233 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 18:05:35.886233 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 200 Aug 10 18:05:35.886233 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 18:05:35.886233 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 18:05:35.886233 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 18:05:35.886233 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 18:05:35.886233 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8_NpG461t7Wh4xqSGgpz6tVheb3RhfaKxcIE9oNxw9K6BYRzknX-AFkfe5riXHRxyluLwenPIJFFWVg8YmqJ3fSpeHNbIUjkNvuBl-c-kpU5MqggrrRkQdftSFrQJt7toGcDMdNWl54HfIRsHBDiwC2H-8MCcN-7QRiR_RFAXk7fnfk Aug 10 18:05:35.886233 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 18:05:35.886233 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 18:05:35.886233 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 18:05:35.886233 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 18:05:35.886233 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 18:05:35.886233 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 18:05:35.886233 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: ab3b279d78ee41caa5687d574919832c Aug 10 18:05:35.886233 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-ServersTestJSON-1630654139 Aug 10 18:05:35.886233 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 18:05:35.886233 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 18:05:35.886233 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ab3b279d78ee41caa5687d574919832c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/ab3b279d78ee41caa5687d574919832c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ab3b279d78ee41caa5687d574919832c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_ab3b279d78ee41caa5687d574919832c", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 18:05:35.886233 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-ServersTestJSON-1630654139 Aug 10 18:05:35.886233 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: ab3b279d78ee41caa5687d574919832c Aug 10 18:05:35.886233 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-ServersTestJSON-1630654139 Aug 10 18:05:35.886233 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-ServersTestJSON-1630654139-project Aug 10 18:05:35.886233 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 18:05:35.886233 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 18:05:35.886233 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: cdc1545e8c0d4534a9d647e671979a54 Aug 10 18:05:35.886233 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-ServersTestJSON-1630654139-project Aug 10 18:05:35.886233 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 18:05:35.886233 n-d-852296-2 devstack@n-api.service[129410]: {"server": {"name": "tempest-ServersTestJSON-server-231066053", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "926cb984-90cd-45ce-82dc-a2ee45e5a0e3"}]}} Aug 10 18:05:35.886233 n-d-852296-2 devstack@n-api.service[129410]: method: > Aug 10 18:05:35.886233 n-d-852296-2 devstack@n-api.service[129410]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:05:35.886233 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 18:05:35.886233 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'body': {'server': {'name': 'tempest-ServersTestJSON-server-231066053', 'imageRef': 'a735ff26-463a-4ffe-a981-ab9d9baa494f', 'flavorRef': '452', 'networks': [{'uuid': '926cb984-90cd-45ce-82dc-a2ee45e5a0e3'}]}}} Aug 10 18:05:35.886233 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 18:05:35.886233 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:05:35.886233 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:05:35.886233 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:05:35.886233 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:05:35.886233 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:05:35.886233 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:05:35.886233 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:05:35.886233 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:05:35.886233 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:05:35.886233 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 18:05:35.886233 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 18:05:35.886233 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 18:05:35.886233 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 18:05:35.886233 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 18:05:35.886233 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 18:05:35.886233 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 18:05:35.886233 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 18:05:35.886233 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 18:05:35.886233 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 18:05:35.886233 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 18:05:35.886233 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 18:05:35.886233 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 18:05:35.886233 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 18:05:35.886233 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 18:05:35.886233 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 18:05:35.899074 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 18:05:35.899074 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:05:35.899074 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:05:35.899074 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 18:05:35.899074 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 18:05:35.899074 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:05:35.899074 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:05:35.899074 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 18:05:35.899074 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 18:05:35.899074 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:05:35.899074 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:05:35.899074 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:05:35.899074 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:05:35.899074 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:05:35.899074 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:05:35.899074 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 18:05:35.899074 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 18:05:35.899074 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 18:05:35.899074 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 18:05:35.899074 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 18:05:35.899074 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 18:05:35.899074 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 18:05:35.899074 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 18:05:35.899074 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 18:05:35.899074 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 18:05:35.899074 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 18:05:35.899074 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 18:05:35.899074 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 18:05:35.899074 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 18:05:35.899074 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 18:05:35.899074 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 18:05:35.899074 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 18:05:35.899074 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 18:05:35.899074 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 18:05:35.899074 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 18:05:35.899074 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 18:05:35.899074 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 18:05:35.899074 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 18:05:35.899074 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 18:05:35.899074 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 18:05:35.899074 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 18:05:35.899074 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-af9bafaa-d761-43e2-a436-14c2e28bc339) Aug 10 18:05:35.899074 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:05:35.899074 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:05:35.899074 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:05:35.899074 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:05:35.899074 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:05:35.899074 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:05:35.899074 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 18:05:35.899074 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 18:05:35.899074 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 10 18:05:35.899074 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 10 18:05:35.899074 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:05:35.902652 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:05:35.902652 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:05:35.902652 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:05:35.902652 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:05:35.902652 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:05:35.902652 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:05:35.902652 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:05:35.902652 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 18:05:35.902652 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 18:05:35.902652 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:05:35.902652 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:05:35.902652 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:05:35.902652 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-cb7d2571-10c6-4080-86fa-a65a21c2d8fd tempest-ServersTestJSON-1630654139 tempest-ServersTestJSON-1630654139-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:05:35.902652 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 18:05:35.902652 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-cb7d2571-10c6-4080-86fa-a65a21c2d8fd tempest-ServersTestJSON-1630654139 tempest-ServersTestJSON-1630654139-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.854368 Aug 10 18:05:35.902652 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 1006/2036] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 18:05:35 2022] POST /compute/v2.1/servers => generated 214 bytes in 856 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 10 18:05:35.989479 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-301137a7-1315-4d27-9aa0-f0fa4c2c9d80 tempest-ServersTestJSON-1630654139 tempest-ServersTestJSON-1630654139-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-190723595", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "926cb984-90cd-45ce-82dc-a2ee45e5a0e3"}]}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 18:05:36.072438 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.network.neutron [None req-301137a7-1315-4d27-9aa0-f0fa4c2c9d80 tempest-ServersTestJSON-1630654139 tempest-ServersTestJSON-1630654139-project] validate_networks() for [('926cb984-90cd-45ce-82dc-a2ee45e5a0e3', None, None, None, None, None)] {{(pid=129409) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 18:05:36.639885 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [None req-301137a7-1315-4d27-9aa0-f0fa4c2c9d80 tempest-ServersTestJSON-1630654139 tempest-ServersTestJSON-1630654139-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-81b678eb-a9ed-4f5e-80aa-54ee52fdcccd) Aug 10 18:05:36.639885 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:05:36.639885 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:05:36.639885 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:05:36.639885 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:05:36.639885 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:05:36.639885 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:05:36.639885 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:05:36.639885 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:05:36.639885 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:05:36.639885 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 18:05:36.639885 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 18:05:36.639885 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 18:05:36.639885 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 18:05:36.639885 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 18:05:36.639885 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 18:05:36.639885 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 18:05:36.639885 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 18:05:36.639885 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 18:05:36.639885 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 18:05:36.639885 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 18:05:36.639885 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 18:05:36.639885 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 18:05:36.639885 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 18:05:36.639885 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 18:05:36.639885 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 18:05:36.639885 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 18:05:36.639885 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:05:36.639885 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:05:36.639885 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 18:05:36.639885 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 18:05:36.639885 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:05:36.639885 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:05:36.639885 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 18:05:36.639885 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 18:05:36.639885 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:05:36.639885 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:05:36.639885 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:05:36.639885 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:05:36.639885 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:05:36.639885 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:05:36.639885 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 18:05:36.639885 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 18:05:36.639885 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 18:05:36.639885 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 18:05:36.639885 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 18:05:36.639885 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 18:05:36.639885 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 18:05:36.639885 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 18:05:36.639885 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 18:05:36.639885 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 18:05:36.639885 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 18:05:36.639885 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 18:05:36.642936 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 18:05:36.642936 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 18:05:36.642936 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 18:05:36.642936 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 18:05:36.642936 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 18:05:36.642936 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 18:05:36.642936 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 18:05:36.642936 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 18:05:36.642936 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 18:05:36.642936 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 18:05:36.642936 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 18:05:36.642936 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 18:05:36.642936 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 18:05:36.642936 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 18:05:36.642936 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-81b678eb-a9ed-4f5e-80aa-54ee52fdcccd) Aug 10 18:05:36.642936 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:05:36.649239 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-301137a7-1315-4d27-9aa0-f0fa4c2c9d80 tempest-ServersTestJSON-1630654139 tempest-ServersTestJSON-1630654139-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:05:36.649239 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 18:05:36.654481 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-301137a7-1315-4d27-9aa0-f0fa4c2c9d80 tempest-ServersTestJSON-1630654139 tempest-ServersTestJSON-1630654139-project] Request method failure captured: Aug 10 18:05:36.654481 n-d-852296-2 devstack@n-api.service[129409]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 18:05:36.654481 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 18:05:36.654481 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 18:05:36.654481 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 18:05:36.654481 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 200 Aug 10 18:05:36.654481 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 18:05:36.654481 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 18:05:36.654481 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 18:05:36.654481 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 18:05:36.654481 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8_NpG461t7Wh4xqSGgpz6tVheb3RhfaKxcIE9oNxw9K6BYRzknX-AFkfe5riXHRxyluLwenPIJFFWVg8YmqJ3fSpeHNbIUjkNvuBl-c-kpU5MqggrrRkQdftSFrQJt7toGcDMdNWl54HfIRsHBDiwC2H-8MCcN-7QRiR_RFAXk7fnfk Aug 10 18:05:36.654481 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 18:05:36.654481 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 18:05:36.654481 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 18:05:36.654481 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 18:05:36.654481 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 18:05:36.654481 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 18:05:36.654481 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: ab3b279d78ee41caa5687d574919832c Aug 10 18:05:36.654481 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-ServersTestJSON-1630654139 Aug 10 18:05:36.654481 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 18:05:36.654481 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 18:05:36.654481 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ab3b279d78ee41caa5687d574919832c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/ab3b279d78ee41caa5687d574919832c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ab3b279d78ee41caa5687d574919832c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_ab3b279d78ee41caa5687d574919832c", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 18:05:36.654481 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-ServersTestJSON-1630654139 Aug 10 18:05:36.654481 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: ab3b279d78ee41caa5687d574919832c Aug 10 18:05:36.654481 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-ServersTestJSON-1630654139 Aug 10 18:05:36.654481 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-ServersTestJSON-1630654139-project Aug 10 18:05:36.654481 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 18:05:36.654481 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 18:05:36.654481 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: cdc1545e8c0d4534a9d647e671979a54 Aug 10 18:05:36.654481 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-ServersTestJSON-1630654139-project Aug 10 18:05:36.654481 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 18:05:36.654481 n-d-852296-2 devstack@n-api.service[129409]: {"server": {"name": "tempest-ServersTestJSON-server-190723595", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "926cb984-90cd-45ce-82dc-a2ee45e5a0e3"}]}} Aug 10 18:05:36.654481 n-d-852296-2 devstack@n-api.service[129409]: method: > Aug 10 18:05:36.654481 n-d-852296-2 devstack@n-api.service[129409]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:05:36.654481 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 18:05:36.654481 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'body': {'server': {'name': 'tempest-ServersTestJSON-server-190723595', 'imageRef': 'a735ff26-463a-4ffe-a981-ab9d9baa494f', 'flavorRef': '452', 'networks': [{'uuid': '926cb984-90cd-45ce-82dc-a2ee45e5a0e3'}]}}} Aug 10 18:05:36.654481 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 18:05:36.654481 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:05:36.654481 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:05:36.654481 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:05:36.654481 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:05:36.654481 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:05:36.654481 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:05:36.654481 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:05:36.654481 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:05:36.654481 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:05:36.654481 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 18:05:36.654481 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 18:05:36.654481 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 18:05:36.654481 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 18:05:36.654481 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 18:05:36.654481 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 18:05:36.654481 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 18:05:36.654481 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 18:05:36.654481 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 18:05:36.654481 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 18:05:36.654481 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 18:05:36.654481 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 18:05:36.654481 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 18:05:36.654481 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 18:05:36.654481 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 18:05:36.654481 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 18:05:36.659579 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 18:05:36.659579 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:05:36.659579 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:05:36.659579 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 18:05:36.659579 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 18:05:36.659579 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:05:36.659579 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:05:36.659579 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 18:05:36.659579 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 18:05:36.659579 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:05:36.659579 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:05:36.659579 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:05:36.659579 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:05:36.659579 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:05:36.659579 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:05:36.659579 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 18:05:36.659579 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 18:05:36.659579 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 18:05:36.659579 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 18:05:36.659579 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 18:05:36.659579 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 18:05:36.659579 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 18:05:36.659579 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 18:05:36.659579 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 18:05:36.659579 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 18:05:36.659579 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 18:05:36.659579 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 18:05:36.659579 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 18:05:36.659579 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 18:05:36.659579 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 18:05:36.659579 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 18:05:36.659579 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 18:05:36.659579 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 18:05:36.659579 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 18:05:36.659579 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 18:05:36.659579 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 18:05:36.659579 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 18:05:36.659579 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 18:05:36.659579 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 18:05:36.659579 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 18:05:36.659579 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 18:05:36.659579 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-81b678eb-a9ed-4f5e-80aa-54ee52fdcccd) Aug 10 18:05:36.659579 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:05:36.659579 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:05:36.659579 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:05:36.659579 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:05:36.659579 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:05:36.659579 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:05:36.659579 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 18:05:36.659579 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 18:05:36.659579 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 10 18:05:36.659579 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 10 18:05:36.659579 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:05:36.665959 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:05:36.665959 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:05:36.665959 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:05:36.665959 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:05:36.665959 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:05:36.665959 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:05:36.665959 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:05:36.665959 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 18:05:36.665959 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 18:05:36.665959 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:05:36.665959 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:05:36.665959 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:05:36.669425 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-301137a7-1315-4d27-9aa0-f0fa4c2c9d80 tempest-ServersTestJSON-1630654139 tempest-ServersTestJSON-1630654139-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:05:36.669425 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 18:05:36.672539 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-301137a7-1315-4d27-9aa0-f0fa4c2c9d80 tempest-ServersTestJSON-1630654139 tempest-ServersTestJSON-1630654139-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.686513 Aug 10 18:05:36.673728 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1031/2037] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 18:05:35 2022] POST /compute/v2.1/servers => generated 214 bytes in 689 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 10 18:05:36.753873 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-7bd8a0cd-1f7d-4675-a28c-d93a1f080810 tempest-ServersTestJSON-1630654139 tempest-ServersTestJSON-1630654139-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-848806633", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "926cb984-90cd-45ce-82dc-a2ee45e5a0e3"}]}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 18:05:36.863980 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.network.neutron [None req-7bd8a0cd-1f7d-4675-a28c-d93a1f080810 tempest-ServersTestJSON-1630654139 tempest-ServersTestJSON-1630654139-project] validate_networks() for [('926cb984-90cd-45ce-82dc-a2ee45e5a0e3', None, None, None, None, None)] {{(pid=129410) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 18:05:38.552093 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [None req-7bd8a0cd-1f7d-4675-a28c-d93a1f080810 tempest-ServersTestJSON-1630654139 tempest-ServersTestJSON-1630654139-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-e43cd2ac-3c98-483e-a11f-42a2c048e2db) Aug 10 18:05:38.552093 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:05:38.552093 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:05:38.552093 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:05:38.552093 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:05:38.552093 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:05:38.552093 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:05:38.552093 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:05:38.552093 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:05:38.552093 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:05:38.552093 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 18:05:38.552093 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 18:05:38.552093 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 18:05:38.552093 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 18:05:38.552093 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 18:05:38.552093 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 18:05:38.552093 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 18:05:38.552093 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 18:05:38.552093 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 18:05:38.552093 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 18:05:38.552093 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 18:05:38.552093 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 18:05:38.552093 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 18:05:38.552093 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 18:05:38.552093 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 18:05:38.552093 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 18:05:38.552093 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 18:05:38.552093 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:05:38.552093 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:05:38.552093 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 18:05:38.552093 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 18:05:38.552093 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:05:38.552093 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:05:38.552093 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 18:05:38.552093 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 18:05:38.552093 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:05:38.552093 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:05:38.552093 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:05:38.552093 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:05:38.552093 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:05:38.552093 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:05:38.552093 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 18:05:38.552093 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 18:05:38.552093 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 18:05:38.552093 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 18:05:38.552093 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 18:05:38.552093 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 18:05:38.552093 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 18:05:38.552093 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 18:05:38.552093 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 18:05:38.552093 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 18:05:38.552093 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 18:05:38.552093 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 18:05:38.556175 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 18:05:38.556175 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 18:05:38.556175 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 18:05:38.556175 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 18:05:38.556175 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 18:05:38.556175 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 18:05:38.556175 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 18:05:38.556175 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 18:05:38.556175 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 18:05:38.556175 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 18:05:38.556175 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 18:05:38.556175 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 18:05:38.556175 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 18:05:38.556175 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 18:05:38.556175 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-e43cd2ac-3c98-483e-a11f-42a2c048e2db) Aug 10 18:05:38.556175 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:05:38.556175 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-7bd8a0cd-1f7d-4675-a28c-d93a1f080810 tempest-ServersTestJSON-1630654139 tempest-ServersTestJSON-1630654139-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:05:38.556175 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 18:05:38.556175 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-7bd8a0cd-1f7d-4675-a28c-d93a1f080810 tempest-ServersTestJSON-1630654139 tempest-ServersTestJSON-1630654139-project] Request method failure captured: Aug 10 18:05:38.556175 n-d-852296-2 devstack@n-api.service[129410]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 18:05:38.556175 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 18:05:38.556175 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 18:05:38.556175 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 18:05:38.556175 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 200 Aug 10 18:05:38.556175 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 18:05:38.556175 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 18:05:38.556175 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 18:05:38.556175 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 18:05:38.556175 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8_NpG461t7Wh4xqSGgpz6tVheb3RhfaKxcIE9oNxw9K6BYRzknX-AFkfe5riXHRxyluLwenPIJFFWVg8YmqJ3fSpeHNbIUjkNvuBl-c-kpU5MqggrrRkQdftSFrQJt7toGcDMdNWl54HfIRsHBDiwC2H-8MCcN-7QRiR_RFAXk7fnfk Aug 10 18:05:38.556175 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 18:05:38.556175 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 18:05:38.556175 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 18:05:38.556175 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 18:05:38.556175 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 18:05:38.556175 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 18:05:38.556175 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: ab3b279d78ee41caa5687d574919832c Aug 10 18:05:38.556175 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-ServersTestJSON-1630654139 Aug 10 18:05:38.556175 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 18:05:38.556175 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 18:05:38.556175 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ab3b279d78ee41caa5687d574919832c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/ab3b279d78ee41caa5687d574919832c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ab3b279d78ee41caa5687d574919832c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_ab3b279d78ee41caa5687d574919832c", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 18:05:38.556175 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-ServersTestJSON-1630654139 Aug 10 18:05:38.556175 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: ab3b279d78ee41caa5687d574919832c Aug 10 18:05:38.556175 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-ServersTestJSON-1630654139 Aug 10 18:05:38.556175 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-ServersTestJSON-1630654139-project Aug 10 18:05:38.556175 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 18:05:38.556175 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 18:05:38.556175 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: cdc1545e8c0d4534a9d647e671979a54 Aug 10 18:05:38.556175 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-ServersTestJSON-1630654139-project Aug 10 18:05:38.556175 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 18:05:38.556175 n-d-852296-2 devstack@n-api.service[129410]: {"server": {"name": "tempest-ServersTestJSON-server-848806633", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "926cb984-90cd-45ce-82dc-a2ee45e5a0e3"}]}} Aug 10 18:05:38.556175 n-d-852296-2 devstack@n-api.service[129410]: method: > Aug 10 18:05:38.556175 n-d-852296-2 devstack@n-api.service[129410]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:05:38.556175 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 18:05:38.556175 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'body': {'server': {'name': 'tempest-ServersTestJSON-server-848806633', 'imageRef': 'a735ff26-463a-4ffe-a981-ab9d9baa494f', 'flavorRef': '452', 'networks': [{'uuid': '926cb984-90cd-45ce-82dc-a2ee45e5a0e3'}]}}} Aug 10 18:05:38.556175 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 18:05:38.556175 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:05:38.561198 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:05:38.561198 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:05:38.561198 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:05:38.561198 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:05:38.561198 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:05:38.561198 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:05:38.561198 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:05:38.561198 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:05:38.561198 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 18:05:38.561198 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 18:05:38.561198 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 18:05:38.561198 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 18:05:38.561198 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 18:05:38.561198 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 18:05:38.561198 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 18:05:38.561198 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 18:05:38.561198 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 18:05:38.561198 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 18:05:38.561198 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 18:05:38.561198 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 18:05:38.561198 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 18:05:38.561198 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 18:05:38.561198 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 18:05:38.561198 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 18:05:38.561198 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 18:05:38.561198 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:05:38.561198 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:05:38.561198 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 18:05:38.561198 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 18:05:38.561198 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:05:38.561198 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:05:38.561198 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 18:05:38.561198 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 18:05:38.561198 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:05:38.561198 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:05:38.561198 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:05:38.561198 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:05:38.561198 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:05:38.561198 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:05:38.561198 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 18:05:38.561198 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 18:05:38.561198 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 18:05:38.561198 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 18:05:38.561198 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 18:05:38.561198 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 18:05:38.561198 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 18:05:38.561198 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 18:05:38.561198 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 18:05:38.561198 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 18:05:38.561198 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 18:05:38.561198 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 18:05:38.561198 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 18:05:38.561198 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 18:05:38.561198 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 18:05:38.561198 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 18:05:38.569453 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 18:05:38.569453 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 18:05:38.569453 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 18:05:38.569453 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 18:05:38.569453 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 18:05:38.569453 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 18:05:38.569453 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 18:05:38.569453 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 18:05:38.569453 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 18:05:38.569453 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 18:05:38.569453 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-e43cd2ac-3c98-483e-a11f-42a2c048e2db) Aug 10 18:05:38.569453 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:05:38.569453 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:05:38.569453 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:05:38.569453 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:05:38.569453 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:05:38.569453 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:05:38.569453 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 18:05:38.569453 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 18:05:38.569453 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 10 18:05:38.569453 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 10 18:05:38.569453 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:05:38.569453 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:05:38.569453 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:05:38.569453 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:05:38.569453 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:05:38.569453 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:05:38.569453 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:05:38.569453 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:05:38.569453 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 18:05:38.569453 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 18:05:38.569453 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:05:38.569453 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:05:38.569453 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:05:38.569453 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-7bd8a0cd-1f7d-4675-a28c-d93a1f080810 tempest-ServersTestJSON-1630654139 tempest-ServersTestJSON-1630654139-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:05:38.569453 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 18:05:38.569453 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-7bd8a0cd-1f7d-4675-a28c-d93a1f080810 tempest-ServersTestJSON-1630654139 tempest-ServersTestJSON-1630654139-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.811969 Aug 10 18:05:38.569453 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 1007/2038] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 18:05:36 2022] POST /compute/v2.1/servers => generated 214 bytes in 1817 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 10 18:06:20.187944 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_api:SELECT=18,nova_api:DELETE=4 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 18:06:20.442341 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-ef826ac1-d1e6-4406-b79d-970f8de5427c tempest-AttachVolumeNegativeTest-446955792 tempest-AttachVolumeNegativeTest-446955792-project] Action: 'create', calling method: .version_select at 0x7fb345d32550>, body: {"keypair": {"name": "tempest-keypair-1019514101", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBrBkKrqcLPFELniBF7+yysDN4BBXdCRIFBN//9OIb0ZN8+M+kPP2xwcxIhKChzqbarHYyJmjGbOMHMp3SWNANBQx/Aq3/fuNTjVyd2n7BBAmsZ2psc/Od0NWZmC/KvyIQ=="}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 18:06:20.460638 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-ef826ac1-d1e6-4406-b79d-970f8de5427c tempest-AttachVolumeNegativeTest-446955792 tempest-AttachVolumeNegativeTest-446955792-project] Getting quotas for project 88744a563b6b4b47b03317b22d38f214. Resources: {'key_pairs'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 18:06:20.469396 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-ef826ac1-d1e6-4406-b79d-970f8de5427c tempest-AttachVolumeNegativeTest-446955792 tempest-AttachVolumeNegativeTest-446955792-project] Getting quotas for user 429872e23d5941d28ad760e031c97cd5 and project 88744a563b6b4b47b03317b22d38f214. Resources: {'key_pairs'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 18:06:20.688585 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-ef826ac1-d1e6-4406-b79d-970f8de5427c tempest-AttachVolumeNegativeTest-446955792 tempest-AttachVolumeNegativeTest-446955792-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.501400 Aug 10 18:06:20.698810 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1032/2039] 10.222.0.50 () {60 vars in 1159 bytes} [Wed Aug 10 18:06:20 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 18:06:27.684775 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_cell0:SELECT=4 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 18:06:27.685724 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=1 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 18:06:27.690477 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-3bd11d27-5653-4032-887f-7401c2726058 tempest-AttachVolumeNegativeTest-446955792 tempest-AttachVolumeNegativeTest-446955792-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1031245263", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b918fc97-e9f5-4cfd-8059-8d4ee34b54c1"}], "security_groups": [{"name": "tempest-securitygroup--810740886"}], "key_name": "tempest-keypair-1019514101", "user_data": "}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 18:06:27.880512 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.network.neutron [None req-3bd11d27-5653-4032-887f-7401c2726058 tempest-AttachVolumeNegativeTest-446955792 tempest-AttachVolumeNegativeTest-446955792-project] validate_networks() for [('b918fc97-e9f5-4cfd-8059-8d4ee34b54c1', None, None, None, None, None)] {{(pid=129410) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 18:06:28.291014 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [None req-3bd11d27-5653-4032-887f-7401c2726058 tempest-AttachVolumeNegativeTest-446955792 tempest-AttachVolumeNegativeTest-446955792-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-18c1f6e9-e286-450e-b3e4-d146b368000e) Aug 10 18:06:28.291014 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:06:28.291014 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:06:28.291014 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:06:28.291014 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:06:28.291014 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:06:28.291014 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:06:28.291014 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:06:28.291014 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:06:28.291014 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:06:28.291014 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 18:06:28.291014 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 18:06:28.291014 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 18:06:28.291014 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 18:06:28.291014 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 18:06:28.291014 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 18:06:28.291014 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 18:06:28.291014 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 18:06:28.291014 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 18:06:28.291014 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 18:06:28.291014 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 18:06:28.291014 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 18:06:28.291014 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 18:06:28.291014 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 18:06:28.291014 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 18:06:28.291014 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 18:06:28.291014 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 18:06:28.291014 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:06:28.291014 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:06:28.291014 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 18:06:28.291014 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 18:06:28.291014 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:06:28.291014 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:06:28.291014 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 18:06:28.291014 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 18:06:28.291014 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:06:28.291014 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:06:28.291014 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:06:28.291014 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:06:28.291014 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:06:28.291014 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:06:28.291014 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 18:06:28.291014 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 18:06:28.291014 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 18:06:28.291014 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 18:06:28.291014 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 18:06:28.291014 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 18:06:28.291014 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 18:06:28.291014 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 18:06:28.291014 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 18:06:28.291014 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 18:06:28.291014 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 18:06:28.294795 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 18:06:28.294795 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 18:06:28.294795 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 18:06:28.294795 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 18:06:28.294795 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 18:06:28.294795 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 18:06:28.294795 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 18:06:28.294795 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 18:06:28.294795 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 18:06:28.294795 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 18:06:28.294795 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 18:06:28.294795 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 18:06:28.294795 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 18:06:28.294795 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 18:06:28.294795 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 18:06:28.294795 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-18c1f6e9-e286-450e-b3e4-d146b368000e) Aug 10 18:06:28.294795 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:06:28.294795 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-3bd11d27-5653-4032-887f-7401c2726058 tempest-AttachVolumeNegativeTest-446955792 tempest-AttachVolumeNegativeTest-446955792-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:06:28.294795 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 18:06:28.294795 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-3bd11d27-5653-4032-887f-7401c2726058 tempest-AttachVolumeNegativeTest-446955792 tempest-AttachVolumeNegativeTest-446955792-project] Request method failure captured: Aug 10 18:06:28.294795 n-d-852296-2 devstack@n-api.service[129410]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 18:06:28.294795 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 18:06:28.294795 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 18:06:28.294795 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 18:06:28.294795 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 489 Aug 10 18:06:28.294795 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 18:06:28.294795 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 18:06:28.294795 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 18:06:28.294795 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 18:06:28.294795 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8_OcHRPy6RkYXSnFMVIgHSaRSha9nnaXEQ2jHGKYoAKKs5zXUdhqYwoIHJYrDDLO384NAXweSpsXYMdKXqWo5M8_5AenBqx9Vnyom3zsReaMtwhoBviMcizLbm6_U4gThV_20KlmNh5ZIGmIWTPDdH8-9e2duCyesk-WedK5y6htsJw Aug 10 18:06:28.294795 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 18:06:28.294795 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 18:06:28.294795 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 18:06:28.294795 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 18:06:28.294795 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 18:06:28.294795 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 18:06:28.294795 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: 88744a563b6b4b47b03317b22d38f214 Aug 10 18:06:28.294795 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-AttachVolumeNegativeTest-446955792 Aug 10 18:06:28.294795 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 18:06:28.294795 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 18:06:28.294795 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/88744a563b6b4b47b03317b22d38f214"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/88744a563b6b4b47b03317b22d38f214"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/88744a563b6b4b47b03317b22d38f214"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_88744a563b6b4b47b03317b22d38f214", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 18:06:28.294795 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-AttachVolumeNegativeTest-446955792 Aug 10 18:06:28.294795 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: 88744a563b6b4b47b03317b22d38f214 Aug 10 18:06:28.294795 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-446955792 Aug 10 18:06:28.294795 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-AttachVolumeNegativeTest-446955792-project Aug 10 18:06:28.294795 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 18:06:28.294795 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 18:06:28.294795 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: 429872e23d5941d28ad760e031c97cd5 Aug 10 18:06:28.294795 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-AttachVolumeNegativeTest-446955792-project Aug 10 18:06:28.294795 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 18:06:28.294795 n-d-852296-2 devstack@n-api.service[129410]: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1031245263", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "adminPass": "password", "networks": [{"uuid": "b918fc97-e9f5-4cfd-8059-8d4ee34b54c1"}], "security_groups": [{"name": "tempest-securitygroup--810740886"}], "key_name": "tempest-keypair-1019514101", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} Aug 10 18:06:28.294795 n-d-852296-2 devstack@n-api.service[129410]: method: > Aug 10 18:06:28.294795 n-d-852296-2 devstack@n-api.service[129410]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:06:28.294795 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 18:06:28.298962 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'body': {'server': {'name': 'tempest-AttachVolumeNegativeTest-server-1031245263', 'imageRef': 'a735ff26-463a-4ffe-a981-ab9d9baa494f', 'flavorRef': '452', 'adminPass': 'password', 'networks': [{'uuid': 'b918fc97-e9f5-4cfd-8059-8d4ee34b54c1'}], 'security_groups': [{'name': 'tempest-securitygroup--810740886'}], 'key_name': 'tempest-keypair-1019514101', 'user_data': 'IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo='}}} Aug 10 18:06:28.298962 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 18:06:28.298962 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:06:28.298962 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:06:28.298962 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:06:28.298962 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:06:28.298962 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:06:28.298962 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:06:28.298962 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:06:28.298962 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:06:28.298962 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:06:28.298962 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 18:06:28.298962 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 18:06:28.298962 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 18:06:28.298962 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 18:06:28.298962 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 18:06:28.298962 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 18:06:28.298962 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 18:06:28.298962 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 18:06:28.298962 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 18:06:28.298962 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 18:06:28.298962 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 18:06:28.298962 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 18:06:28.298962 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 18:06:28.298962 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 18:06:28.298962 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 18:06:28.298962 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 18:06:28.298962 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 18:06:28.298962 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:06:28.298962 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:06:28.298962 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 18:06:28.298962 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 18:06:28.298962 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:06:28.298962 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:06:28.298962 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 18:06:28.298962 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 18:06:28.298962 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:06:28.298962 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:06:28.298962 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:06:28.298962 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:06:28.298962 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:06:28.298962 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:06:28.298962 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 18:06:28.298962 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 18:06:28.298962 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 18:06:28.298962 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 18:06:28.298962 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 18:06:28.298962 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 18:06:28.298962 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 18:06:28.298962 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 18:06:28.298962 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 18:06:28.298962 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 18:06:28.298962 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 18:06:28.311031 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 18:06:28.311031 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 18:06:28.311031 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 18:06:28.311031 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 18:06:28.311031 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 18:06:28.311031 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 18:06:28.311031 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 18:06:28.311031 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 18:06:28.311031 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 18:06:28.311031 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 18:06:28.311031 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 18:06:28.311031 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 18:06:28.311031 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 18:06:28.311031 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 18:06:28.311031 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 18:06:28.311031 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-18c1f6e9-e286-450e-b3e4-d146b368000e) Aug 10 18:06:28.311031 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:06:28.311031 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:06:28.311031 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:06:28.311031 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:06:28.311031 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:06:28.311031 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:06:28.311031 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 18:06:28.311031 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 18:06:28.311031 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 10 18:06:28.311031 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 10 18:06:28.311031 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:06:28.311031 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:06:28.311031 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:06:28.311031 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:06:28.311031 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:06:28.311031 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:06:28.311031 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:06:28.311031 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:06:28.311031 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 18:06:28.311031 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 18:06:28.311031 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:06:28.311031 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:06:28.311031 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:06:28.311031 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-3bd11d27-5653-4032-887f-7401c2726058 tempest-AttachVolumeNegativeTest-446955792 tempest-AttachVolumeNegativeTest-446955792-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:06:28.311031 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 18:06:28.311031 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-3bd11d27-5653-4032-887f-7401c2726058 tempest-AttachVolumeNegativeTest-446955792 tempest-AttachVolumeNegativeTest-446955792-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.612624 Aug 10 18:06:28.311031 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 1008/2040] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 18:06:27 2022] POST /compute/v2.1/servers => generated 214 bytes in 614 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 10 18:06:28.319674 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-6090ceeb-3b32-4541-9cb8-bec7f055f159 tempest-AttachVolumeNegativeTest-446955792 tempest-AttachVolumeNegativeTest-446955792-project] Calling method '.version_select at 0x7fb345d1d430>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:06:28.453165 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-6090ceeb-3b32-4541-9cb8-bec7f055f159 tempest-AttachVolumeNegativeTest-446955792 tempest-AttachVolumeNegativeTest-446955792-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1019514101" status: 202 len: 0 microversion: 2.1 time: 0.137664 Aug 10 18:06:28.453952 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1033/2041] 10.222.0.50 () {58 vars in 1221 bytes} [Wed Aug 10 18:06:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1019514101 => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 18:06:32.216202 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-5ad0b8fa-5a10-4a82-8751-d1c8826da260 tempest-AttachVolumeNegativeTest-446955792 tempest-AttachVolumeNegativeTest-446955792-project] Action: 'create', calling method: .version_select at 0x7fb34637b430>, body: {"keypair": {"name": "tempest-keypair-365142553", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCu29rjbU1Zd/yUkbgvxkSetPjTYhNaFZt1ByEnkkwigqpsBqJg5Jr9GGtVq40ryK5+VEg/elwxnGCsHDfjO/dY8zfi/nfiRWVmfJHDZu2rM2Q+iXACBlcEWXq2+CMaWZA=="}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 18:06:32.271107 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.quota [None req-5ad0b8fa-5a10-4a82-8751-d1c8826da260 tempest-AttachVolumeNegativeTest-446955792 tempest-AttachVolumeNegativeTest-446955792-project] Getting quotas for project 88744a563b6b4b47b03317b22d38f214. Resources: {'key_pairs'} {{(pid=129410) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 18:06:32.292632 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.quota [None req-5ad0b8fa-5a10-4a82-8751-d1c8826da260 tempest-AttachVolumeNegativeTest-446955792 tempest-AttachVolumeNegativeTest-446955792-project] Getting quotas for user 429872e23d5941d28ad760e031c97cd5 and project 88744a563b6b4b47b03317b22d38f214. Resources: {'key_pairs'} {{(pid=129410) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 18:06:32.562039 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-5ad0b8fa-5a10-4a82-8751-d1c8826da260 tempest-AttachVolumeNegativeTest-446955792 tempest-AttachVolumeNegativeTest-446955792-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.351004 Aug 10 18:06:32.562656 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 1009/2042] 10.222.0.50 () {60 vars in 1159 bytes} [Wed Aug 10 18:06:32 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 18:06:39.934765 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_cell0:SELECT=4 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 18:06:39.941147 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-b8efdf89-52c3-426d-bac9-e2ac8031a330 tempest-AttachVolumeNegativeTest-446955792 tempest-AttachVolumeNegativeTest-446955792-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-768291180", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b918fc97-e9f5-4cfd-8059-8d4ee34b54c1"}], "security_groups": [{"name": "tempest-securitygroup--1816991254"}], "key_name": "tempest-keypair-365142553", "user_data": "}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 18:06:40.145770 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.network.neutron [None req-b8efdf89-52c3-426d-bac9-e2ac8031a330 tempest-AttachVolumeNegativeTest-446955792 tempest-AttachVolumeNegativeTest-446955792-project] validate_networks() for [('b918fc97-e9f5-4cfd-8059-8d4ee34b54c1', None, None, None, None, None)] {{(pid=129409) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 18:06:40.929453 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [None req-b8efdf89-52c3-426d-bac9-e2ac8031a330 tempest-AttachVolumeNegativeTest-446955792 tempest-AttachVolumeNegativeTest-446955792-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-ace88027-5873-445b-8e32-20c5bb40d99f) Aug 10 18:06:40.929453 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:06:40.929453 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:06:40.929453 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:06:40.929453 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:06:40.929453 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:06:40.929453 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:06:40.929453 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:06:40.929453 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:06:40.929453 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:06:40.929453 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 18:06:40.929453 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 18:06:40.929453 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 18:06:40.929453 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 18:06:40.929453 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 18:06:40.929453 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 18:06:40.929453 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 18:06:40.929453 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 18:06:40.929453 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 18:06:40.929453 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 18:06:40.929453 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 18:06:40.929453 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 18:06:40.929453 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 18:06:40.929453 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 18:06:40.929453 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 18:06:40.929453 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 18:06:40.929453 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 18:06:40.929453 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:06:40.929453 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:06:40.929453 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 18:06:40.929453 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 18:06:40.929453 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:06:40.929453 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:06:40.929453 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 18:06:40.929453 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 18:06:40.929453 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:06:40.929453 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:06:40.929453 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:06:40.929453 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:06:40.929453 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:06:40.929453 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:06:40.929453 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 18:06:40.929453 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 18:06:40.929453 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 18:06:40.929453 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 18:06:40.929453 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 18:06:40.929453 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 18:06:40.929453 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 18:06:40.929453 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 18:06:40.929453 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 18:06:40.929453 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 18:06:40.929453 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 18:06:40.934614 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 18:06:40.934614 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 18:06:40.934614 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 18:06:40.934614 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 18:06:40.934614 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 18:06:40.934614 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 18:06:40.934614 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 18:06:40.934614 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 18:06:40.934614 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 18:06:40.934614 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 18:06:40.934614 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 18:06:40.934614 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 18:06:40.934614 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 18:06:40.934614 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 18:06:40.934614 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 18:06:40.934614 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-ace88027-5873-445b-8e32-20c5bb40d99f) Aug 10 18:06:40.934614 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:06:40.937804 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-b8efdf89-52c3-426d-bac9-e2ac8031a330 tempest-AttachVolumeNegativeTest-446955792 tempest-AttachVolumeNegativeTest-446955792-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:06:40.937804 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 18:06:40.949593 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-b8efdf89-52c3-426d-bac9-e2ac8031a330 tempest-AttachVolumeNegativeTest-446955792 tempest-AttachVolumeNegativeTest-446955792-project] Request method failure captured: Aug 10 18:06:40.949593 n-d-852296-2 devstack@n-api.service[129409]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 18:06:40.949593 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 18:06:40.949593 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 18:06:40.949593 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 18:06:40.949593 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 488 Aug 10 18:06:40.949593 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 18:06:40.949593 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 18:06:40.949593 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 18:06:40.949593 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 18:06:40.949593 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8_OcHRPy6RkYXSnFMVIgHSaRSha9nnaXEQ2jHGKYoAKKs5zXUdhqYwoIHJYrDDLO384NAXweSpsXYMdKXqWo5M8_5AenBqx9Vnyom3zsReaMtwhoBviMcizLbm6_U4gThV_20KlmNh5ZIGmIWTPDdH8-9e2duCyesk-WedK5y6htsJw Aug 10 18:06:40.949593 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 18:06:40.949593 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 18:06:40.949593 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 18:06:40.949593 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 18:06:40.949593 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 18:06:40.949593 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 18:06:40.949593 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: 88744a563b6b4b47b03317b22d38f214 Aug 10 18:06:40.949593 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-AttachVolumeNegativeTest-446955792 Aug 10 18:06:40.949593 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 18:06:40.949593 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 18:06:40.949593 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/88744a563b6b4b47b03317b22d38f214"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/88744a563b6b4b47b03317b22d38f214"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/88744a563b6b4b47b03317b22d38f214"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_88744a563b6b4b47b03317b22d38f214", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 18:06:40.949593 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-AttachVolumeNegativeTest-446955792 Aug 10 18:06:40.949593 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: 88744a563b6b4b47b03317b22d38f214 Aug 10 18:06:40.949593 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-446955792 Aug 10 18:06:40.949593 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-AttachVolumeNegativeTest-446955792-project Aug 10 18:06:40.949593 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 18:06:40.949593 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 18:06:40.949593 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: 429872e23d5941d28ad760e031c97cd5 Aug 10 18:06:40.949593 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-AttachVolumeNegativeTest-446955792-project Aug 10 18:06:40.949593 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 18:06:40.949593 n-d-852296-2 devstack@n-api.service[129409]: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-768291180", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "adminPass": "password", "networks": [{"uuid": "b918fc97-e9f5-4cfd-8059-8d4ee34b54c1"}], "security_groups": [{"name": "tempest-securitygroup--1816991254"}], "key_name": "tempest-keypair-365142553", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} Aug 10 18:06:40.949593 n-d-852296-2 devstack@n-api.service[129409]: method: > Aug 10 18:06:40.949593 n-d-852296-2 devstack@n-api.service[129409]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:06:40.949593 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 18:06:40.949593 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'body': {'server': {'name': 'tempest-AttachVolumeNegativeTest-server-768291180', 'imageRef': 'a735ff26-463a-4ffe-a981-ab9d9baa494f', 'flavorRef': '452', 'adminPass': 'password', 'networks': [{'uuid': 'b918fc97-e9f5-4cfd-8059-8d4ee34b54c1'}], 'security_groups': [{'name': 'tempest-securitygroup--1816991254'}], 'key_name': 'tempest-keypair-365142553', 'user_data': 'IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo='}}} Aug 10 18:06:40.949593 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 18:06:40.949593 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:06:40.949593 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:06:40.949593 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:06:40.949593 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:06:40.949593 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:06:40.949593 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:06:40.949593 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:06:40.949593 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:06:40.949593 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:06:40.949593 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 18:06:40.949593 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 18:06:40.949593 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 18:06:40.949593 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 18:06:40.949593 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 18:06:40.949593 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 18:06:40.949593 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 18:06:40.949593 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 18:06:40.949593 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 18:06:40.949593 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 18:06:40.953646 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 18:06:40.953646 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 18:06:40.953646 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 18:06:40.953646 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 18:06:40.953646 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 18:06:40.953646 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 18:06:40.953646 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 18:06:40.953646 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:06:40.953646 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:06:40.953646 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 18:06:40.953646 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 18:06:40.953646 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:06:40.953646 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:06:40.953646 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 18:06:40.953646 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 18:06:40.953646 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:06:40.953646 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:06:40.953646 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:06:40.953646 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:06:40.953646 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:06:40.953646 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:06:40.953646 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 18:06:40.953646 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 18:06:40.953646 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 18:06:40.953646 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 18:06:40.953646 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 18:06:40.953646 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 18:06:40.953646 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 18:06:40.953646 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 18:06:40.953646 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 18:06:40.953646 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 18:06:40.953646 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 18:06:40.953646 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 18:06:40.953646 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 18:06:40.953646 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 18:06:40.953646 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 18:06:40.953646 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 18:06:40.953646 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 18:06:40.953646 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 18:06:40.953646 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 18:06:40.953646 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 18:06:40.953646 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 18:06:40.953646 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 18:06:40.953646 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 18:06:40.953646 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 18:06:40.953646 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 18:06:40.953646 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 18:06:40.953646 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-ace88027-5873-445b-8e32-20c5bb40d99f) Aug 10 18:06:40.953646 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:06:40.953646 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:06:40.953646 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:06:40.953646 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:06:40.953646 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:06:40.964821 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:06:40.964821 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 18:06:40.964821 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 18:06:40.964821 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 10 18:06:40.964821 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 10 18:06:40.964821 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:06:40.964821 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:06:40.964821 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:06:40.964821 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:06:40.964821 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:06:40.964821 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:06:40.964821 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:06:40.964821 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:06:40.964821 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 18:06:40.964821 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 18:06:40.964821 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:06:40.964821 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:06:40.964821 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:06:40.964821 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-b8efdf89-52c3-426d-bac9-e2ac8031a330 tempest-AttachVolumeNegativeTest-446955792 tempest-AttachVolumeNegativeTest-446955792-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:06:40.964821 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 18:06:40.964821 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-b8efdf89-52c3-426d-bac9-e2ac8031a330 tempest-AttachVolumeNegativeTest-446955792 tempest-AttachVolumeNegativeTest-446955792-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.027781 Aug 10 18:06:40.964821 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1034/2043] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 18:06:39 2022] POST /compute/v2.1/servers => generated 214 bytes in 1031 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 10 18:06:40.972047 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-74cfc2a1-6c1f-44d7-a898-1ad2b2ca88ec tempest-AttachVolumeNegativeTest-446955792 tempest-AttachVolumeNegativeTest-446955792-project] Calling method '.version_select at 0x7fb345e6e550>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:06:41.142861 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-74cfc2a1-6c1f-44d7-a898-1ad2b2ca88ec tempest-AttachVolumeNegativeTest-446955792 tempest-AttachVolumeNegativeTest-446955792-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-365142553" status: 202 len: 0 microversion: 2.1 time: 0.174765 Aug 10 18:06:41.144602 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 1010/2044] 10.222.0.50 () {58 vars in 1218 bytes} [Wed Aug 10 18:06:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-365142553 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 18:06:43.393737 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-660596e5-db1e-459a-9dad-5d495a89fa76 tempest-AttachVolumeNegativeTest-446955792 tempest-AttachVolumeNegativeTest-446955792-project] Action: 'create', calling method: .version_select at 0x7fb3460153a0>, body: {"keypair": {"name": "tempest-keypair-721843824", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHZ/cmv5vLYz7JnM/81VQP6TyK/g/mBIcrxJZKgG+/PYEWBuLO9UhWC4sAkD/O8U96FOjONhh45cNVH2Yw2S0O8F9chIwnGdz6FILIFLWUhv9eXRjwRJ6Jy0ipeWRM1sQQ=="}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 18:06:43.412027 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-660596e5-db1e-459a-9dad-5d495a89fa76 tempest-AttachVolumeNegativeTest-446955792 tempest-AttachVolumeNegativeTest-446955792-project] Getting quotas for project 88744a563b6b4b47b03317b22d38f214. Resources: {'key_pairs'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 18:06:43.420146 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-660596e5-db1e-459a-9dad-5d495a89fa76 tempest-AttachVolumeNegativeTest-446955792 tempest-AttachVolumeNegativeTest-446955792-project] Getting quotas for user 429872e23d5941d28ad760e031c97cd5 and project 88744a563b6b4b47b03317b22d38f214. Resources: {'key_pairs'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 18:06:43.641980 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-660596e5-db1e-459a-9dad-5d495a89fa76 tempest-AttachVolumeNegativeTest-446955792 tempest-AttachVolumeNegativeTest-446955792-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.252866 Aug 10 18:06:43.642589 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1035/2045] 10.222.0.50 () {60 vars in 1159 bytes} [Wed Aug 10 18:06:43 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 18:06:49.482414 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_cell0:SELECT=4 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 18:06:49.488123 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-0b9cdf9d-f7de-4716-a511-888751cfb914 tempest-AttachVolumeNegativeTest-446955792 tempest-AttachVolumeNegativeTest-446955792-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-926167001", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b918fc97-e9f5-4cfd-8059-8d4ee34b54c1"}], "security_groups": [{"name": "tempest-securitygroup--289706848"}], "key_name": "tempest-keypair-721843824", "user_data": "}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 18:06:49.767370 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.network.neutron [None req-0b9cdf9d-f7de-4716-a511-888751cfb914 tempest-AttachVolumeNegativeTest-446955792 tempest-AttachVolumeNegativeTest-446955792-project] validate_networks() for [('b918fc97-e9f5-4cfd-8059-8d4ee34b54c1', None, None, None, None, None)] {{(pid=129410) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 18:06:50.483647 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [None req-0b9cdf9d-f7de-4716-a511-888751cfb914 tempest-AttachVolumeNegativeTest-446955792 tempest-AttachVolumeNegativeTest-446955792-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-4814669f-5a69-4c9a-9558-342a616b6a80) Aug 10 18:06:50.483647 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:06:50.483647 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:06:50.483647 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:06:50.483647 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:06:50.483647 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:06:50.483647 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:06:50.483647 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:06:50.483647 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:06:50.483647 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:06:50.483647 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 18:06:50.483647 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 18:06:50.483647 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 18:06:50.483647 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 18:06:50.483647 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 18:06:50.483647 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 18:06:50.483647 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 18:06:50.483647 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 18:06:50.483647 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 18:06:50.483647 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 18:06:50.483647 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 18:06:50.483647 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 18:06:50.483647 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 18:06:50.483647 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 18:06:50.483647 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 18:06:50.483647 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 18:06:50.483647 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 18:06:50.483647 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:06:50.483647 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:06:50.483647 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 18:06:50.483647 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 18:06:50.483647 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:06:50.483647 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:06:50.483647 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 18:06:50.483647 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 18:06:50.483647 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:06:50.483647 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:06:50.483647 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:06:50.483647 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:06:50.483647 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:06:50.483647 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:06:50.483647 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 18:06:50.483647 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 18:06:50.483647 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 18:06:50.483647 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 18:06:50.483647 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 18:06:50.483647 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 18:06:50.483647 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 18:06:50.483647 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 18:06:50.483647 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 18:06:50.483647 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 18:06:50.483647 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 18:06:50.495528 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 18:06:50.495528 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 18:06:50.495528 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 18:06:50.495528 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 18:06:50.495528 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 18:06:50.495528 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 18:06:50.495528 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 18:06:50.495528 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 18:06:50.495528 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 18:06:50.495528 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 18:06:50.495528 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 18:06:50.495528 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 18:06:50.495528 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 18:06:50.495528 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 18:06:50.495528 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 18:06:50.495528 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-4814669f-5a69-4c9a-9558-342a616b6a80) Aug 10 18:06:50.495528 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:06:50.495528 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-0b9cdf9d-f7de-4716-a511-888751cfb914 tempest-AttachVolumeNegativeTest-446955792 tempest-AttachVolumeNegativeTest-446955792-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:06:50.495528 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 18:06:50.495528 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-0b9cdf9d-f7de-4716-a511-888751cfb914 tempest-AttachVolumeNegativeTest-446955792 tempest-AttachVolumeNegativeTest-446955792-project] Request method failure captured: Aug 10 18:06:50.495528 n-d-852296-2 devstack@n-api.service[129410]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 18:06:50.495528 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 18:06:50.495528 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 18:06:50.495528 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 18:06:50.495528 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 487 Aug 10 18:06:50.495528 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 18:06:50.495528 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 18:06:50.495528 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 18:06:50.495528 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 18:06:50.495528 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8_OcHRPy6RkYXSnFMVIgHSaRSha9nnaXEQ2jHGKYoAKKs5zXUdhqYwoIHJYrDDLO384NAXweSpsXYMdKXqWo5M8_5AenBqx9Vnyom3zsReaMtwhoBviMcizLbm6_U4gThV_20KlmNh5ZIGmIWTPDdH8-9e2duCyesk-WedK5y6htsJw Aug 10 18:06:50.495528 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 18:06:50.495528 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 18:06:50.495528 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 18:06:50.495528 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 18:06:50.495528 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 18:06:50.495528 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 18:06:50.495528 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: 88744a563b6b4b47b03317b22d38f214 Aug 10 18:06:50.495528 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-AttachVolumeNegativeTest-446955792 Aug 10 18:06:50.495528 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 18:06:50.495528 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 18:06:50.495528 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/88744a563b6b4b47b03317b22d38f214"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/88744a563b6b4b47b03317b22d38f214"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/88744a563b6b4b47b03317b22d38f214"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_88744a563b6b4b47b03317b22d38f214", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 18:06:50.495528 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-AttachVolumeNegativeTest-446955792 Aug 10 18:06:50.495528 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: 88744a563b6b4b47b03317b22d38f214 Aug 10 18:06:50.495528 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-446955792 Aug 10 18:06:50.495528 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-AttachVolumeNegativeTest-446955792-project Aug 10 18:06:50.495528 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 18:06:50.495528 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 18:06:50.495528 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: 429872e23d5941d28ad760e031c97cd5 Aug 10 18:06:50.495528 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-AttachVolumeNegativeTest-446955792-project Aug 10 18:06:50.495528 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 18:06:50.495528 n-d-852296-2 devstack@n-api.service[129410]: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-926167001", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "adminPass": "password", "networks": [{"uuid": "b918fc97-e9f5-4cfd-8059-8d4ee34b54c1"}], "security_groups": [{"name": "tempest-securitygroup--289706848"}], "key_name": "tempest-keypair-721843824", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} Aug 10 18:06:50.495528 n-d-852296-2 devstack@n-api.service[129410]: method: > Aug 10 18:06:50.495528 n-d-852296-2 devstack@n-api.service[129410]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:06:50.495528 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 18:06:50.501005 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'body': {'server': {'name': 'tempest-AttachVolumeNegativeTest-server-926167001', 'imageRef': 'a735ff26-463a-4ffe-a981-ab9d9baa494f', 'flavorRef': '452', 'adminPass': 'password', 'networks': [{'uuid': 'b918fc97-e9f5-4cfd-8059-8d4ee34b54c1'}], 'security_groups': [{'name': 'tempest-securitygroup--289706848'}], 'key_name': 'tempest-keypair-721843824', 'user_data': 'IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo='}}} Aug 10 18:06:50.501005 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 18:06:50.501005 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:06:50.501005 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:06:50.501005 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:06:50.501005 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:06:50.501005 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:06:50.501005 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:06:50.501005 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:06:50.501005 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:06:50.501005 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:06:50.501005 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 18:06:50.501005 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 18:06:50.501005 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 18:06:50.501005 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 18:06:50.501005 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 18:06:50.501005 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 18:06:50.501005 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 18:06:50.501005 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 18:06:50.501005 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 18:06:50.501005 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 18:06:50.501005 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 18:06:50.501005 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 18:06:50.501005 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 18:06:50.501005 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 18:06:50.501005 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 18:06:50.501005 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 18:06:50.501005 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 18:06:50.501005 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:06:50.501005 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:06:50.501005 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 18:06:50.501005 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 18:06:50.501005 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:06:50.501005 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:06:50.501005 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 18:06:50.501005 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 18:06:50.501005 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:06:50.501005 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:06:50.501005 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:06:50.501005 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:06:50.501005 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:06:50.501005 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:06:50.501005 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 18:06:50.501005 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 18:06:50.501005 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 18:06:50.501005 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 18:06:50.501005 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 18:06:50.501005 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 18:06:50.501005 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 18:06:50.501005 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 18:06:50.501005 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 18:06:50.501005 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 18:06:50.501005 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 18:06:50.511796 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 18:06:50.511796 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 18:06:50.511796 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 18:06:50.511796 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 18:06:50.511796 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 18:06:50.511796 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 18:06:50.511796 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 18:06:50.511796 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 18:06:50.511796 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 18:06:50.511796 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 18:06:50.511796 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 18:06:50.511796 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 18:06:50.511796 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 18:06:50.511796 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 18:06:50.511796 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 18:06:50.511796 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-4814669f-5a69-4c9a-9558-342a616b6a80) Aug 10 18:06:50.511796 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:06:50.511796 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:06:50.511796 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:06:50.511796 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:06:50.511796 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:06:50.511796 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:06:50.511796 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 18:06:50.511796 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 18:06:50.511796 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 10 18:06:50.511796 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 10 18:06:50.511796 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:06:50.511796 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:06:50.511796 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:06:50.511796 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:06:50.511796 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:06:50.511796 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:06:50.511796 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:06:50.511796 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:06:50.511796 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 18:06:50.511796 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 18:06:50.511796 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:06:50.511796 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:06:50.511796 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:06:50.511796 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-0b9cdf9d-f7de-4716-a511-888751cfb914 tempest-AttachVolumeNegativeTest-446955792 tempest-AttachVolumeNegativeTest-446955792-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:06:50.511796 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 18:06:50.511796 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-0b9cdf9d-f7de-4716-a511-888751cfb914 tempest-AttachVolumeNegativeTest-446955792 tempest-AttachVolumeNegativeTest-446955792-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.007335 Aug 10 18:06:50.511796 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 1011/2046] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 18:06:49 2022] POST /compute/v2.1/servers => generated 214 bytes in 1009 msecs (HTTP/1.1 500) 9 headers in 391 bytes (2 switches on core 0) Aug 10 18:06:50.517245 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-fabdcd73-ab33-4dd9-970e-ae1c6959e9c6 tempest-AttachVolumeNegativeTest-446955792 tempest-AttachVolumeNegativeTest-446955792-project] Calling method '.version_select at 0x7fb346015280>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:06:50.671878 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-fabdcd73-ab33-4dd9-970e-ae1c6959e9c6 tempest-AttachVolumeNegativeTest-446955792 tempest-AttachVolumeNegativeTest-446955792-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-721843824" status: 202 len: 0 microversion: 2.1 time: 0.174776 Aug 10 18:06:50.673883 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1036/2047] 10.222.0.50 () {58 vars in 1218 bytes} [Wed Aug 10 18:06:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-721843824 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 18:07:16.179119 n-d-852296-2 devstack@n-api.service[129409]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 18:07:16.180206 n-d-852296-2 devstack@n-api.service[129409]: Wed Aug 10 18:07:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 18:07:37.082470 n-d-852296-2 devstack@n-api.service[129410]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 18:07:37.083287 n-d-852296-2 devstack@n-api.service[129410]: Wed Aug 10 18:07:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 18:07:43.872894 n-d-852296-2 devstack@n-api.service[129409]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 18:07:43.873372 n-d-852296-2 devstack@n-api.service[129409]: Wed Aug 10 18:07:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 18:08:55.239669 n-d-852296-2 devstack@n-api.service[129410]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 18:08:55.246629 n-d-852296-2 devstack@n-api.service[129410]: Wed Aug 10 18:08:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 18:09:46.927771 n-d-852296-2 devstack@n-api.service[129410]: ERROR oslo.messaging._drivers.impl_rabbit [-] [35b81453-3f0e-4fee-81d1-faab338f27f8] AMQP server on 10.222.0.50:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 10 18:09:46.928556 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_api:SELECT=22,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 18:09:46.934932 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-3ffef567-eb1f-4e99-ad4b-8c0835fc26bc tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-99251168", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452"}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 18:09:47.424551 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.network.neutron [None req-3ffef567-eb1f-4e99-ad4b-8c0835fc26bc tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] validate_networks() for None {{(pid=129410) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 18:09:47.936984 n-d-852296-2 devstack@n-api.service[129410]: INFO oslo.messaging._drivers.impl_rabbit [-] [35b81453-3f0e-4fee-81d1-faab338f27f8] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 55898. Aug 10 18:09:48.328597 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.virt.hardware [None req-3ffef567-eb1f-4e99-ad4b-8c0835fc26bc tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Flavor limits 0:0:0 {{(pid=129410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 18:09:48.329193 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.virt.hardware [None req-3ffef567-eb1f-4e99-ad4b-8c0835fc26bc tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Image limits 0:0:0 {{(pid=129410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 18:09:48.330137 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.virt.hardware [None req-3ffef567-eb1f-4e99-ad4b-8c0835fc26bc tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Flavor pref 0:0:0 {{(pid=129410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 18:09:48.330960 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.virt.hardware [None req-3ffef567-eb1f-4e99-ad4b-8c0835fc26bc tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Image pref 0:0:0 {{(pid=129410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 18:09:48.332774 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.virt.hardware [None req-3ffef567-eb1f-4e99-ad4b-8c0835fc26bc tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 18:09:48.356522 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-3ffef567-eb1f-4e99-ad4b-8c0835fc26bc tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:09:48.360801 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-3ffef567-eb1f-4e99-ad4b-8c0835fc26bc tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:09:48.361270 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-3ffef567-eb1f-4e99-ad4b-8c0835fc26bc tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:09:48.365182 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-3ffef567-eb1f-4e99-ad4b-8c0835fc26bc tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:09:48.365835 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-3ffef567-eb1f-4e99-ad4b-8c0835fc26bc tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:09:48.366569 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-3ffef567-eb1f-4e99-ad4b-8c0835fc26bc tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:09:48.416136 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.quota [None req-3ffef567-eb1f-4e99-ad4b-8c0835fc26bc tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Getting quotas for project e98cd08ee22b4f0186fe5c62d611353d. Resources: {'instances', 'ram', 'cores'} {{(pid=129410) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 18:09:48.423316 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.quota [None req-3ffef567-eb1f-4e99-ad4b-8c0835fc26bc tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Getting quotas for user 5292bc31784241c3abc2e2a1828ec3ca and project e98cd08ee22b4f0186fe5c62d611353d. Resources: {'instances', 'ram', 'cores'} {{(pid=129410) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 18:09:48.438868 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-3ffef567-eb1f-4e99-ad4b-8c0835fc26bc tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Going to run 1 instances... {{(pid=129410) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 18:09:48.442022 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-3ffef567-eb1f-4e99-ad4b-8c0835fc26bc tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] [instance: 87b2af3e-cb72-4986-a6f2-8c22ba3632cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a735ff26-463a-4ffe-a981-ab9d9baa494f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129410) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 18:09:48.621642 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-3ffef567-eb1f-4e99-ad4b-8c0835fc26bc tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.689241 Aug 10 18:09:48.629352 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 1012/2048] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 18:09:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1706 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 18:09:48.637917 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_cell0:SELECT=4 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 18:09:48.639739 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=2,nova_api:DELETE=2 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 18:09:48.644491 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-6a46eb0b-ee4a-45ef-9d7d-cc606e175f72 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:09:48.646011 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-6a46eb0b-ee4a-45ef-9d7d-cc606e175f72 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] [instance: 87b2af3e-cb72-4986-a6f2-8c22ba3632cc] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:09:48.789818 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-6a46eb0b-ee4a-45ef-9d7d-cc606e175f72 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5292bc31784241c3abc2e2a1828ec3ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e98cd08ee22b4f0186fe5c62d611353d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:09:48.798610 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-6a46eb0b-ee4a-45ef-9d7d-cc606e175f72 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] 10.222.0.50 "GET /compute/v2.1/servers/87b2af3e-cb72-4986-a6f2-8c22ba3632cc" status: 200 len: 1212 microversion: 2.1 time: 0.161747 Aug 10 18:09:48.799747 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1037/2049] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 18:09:48 2022] GET /compute/v2.1/servers/87b2af3e-cb72-4986-a6f2-8c22ba3632cc => generated 1212 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 18:09:49.828436 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-b505d49d-5643-47c8-b234-11cc7a5cdef9 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:09:49.828436 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-b505d49d-5643-47c8-b234-11cc7a5cdef9 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] [instance: 87b2af3e-cb72-4986-a6f2-8c22ba3632cc] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:09:50.316808 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-b505d49d-5643-47c8-b234-11cc7a5cdef9 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5292bc31784241c3abc2e2a1828ec3ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e98cd08ee22b4f0186fe5c62d611353d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:09:50.327871 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-b505d49d-5643-47c8-b234-11cc7a5cdef9 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] 10.222.0.50 "GET /compute/v2.1/servers/87b2af3e-cb72-4986-a6f2-8c22ba3632cc" status: 200 len: 1212 microversion: 2.1 time: 0.512620 Aug 10 18:09:50.367284 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 1013/2050] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 18:09:49 2022] GET /compute/v2.1/servers/87b2af3e-cb72-4986-a6f2-8c22ba3632cc => generated 1212 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 18:09:51.373405 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-9e51d541-89e6-43a5-b177-b309d0dbe8e3 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:09:51.374591 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-9e51d541-89e6-43a5-b177-b309d0dbe8e3 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] [instance: 87b2af3e-cb72-4986-a6f2-8c22ba3632cc] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:09:51.528195 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-9e51d541-89e6-43a5-b177-b309d0dbe8e3 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5292bc31784241c3abc2e2a1828ec3ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e98cd08ee22b4f0186fe5c62d611353d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:09:51.542272 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-9e51d541-89e6-43a5-b177-b309d0dbe8e3 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] 10.222.0.50 "GET /compute/v2.1/servers/87b2af3e-cb72-4986-a6f2-8c22ba3632cc" status: 200 len: 1212 microversion: 2.1 time: 0.173953 Aug 10 18:09:51.544355 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1038/2051] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 18:09:51 2022] GET /compute/v2.1/servers/87b2af3e-cb72-4986-a6f2-8c22ba3632cc => generated 1212 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 18:09:52.566278 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-68f4dc09-b054-4bef-b90f-0a242a9c87c0 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:09:52.577333 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-68f4dc09-b054-4bef-b90f-0a242a9c87c0 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] [instance: 87b2af3e-cb72-4986-a6f2-8c22ba3632cc] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:09:52.598299 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-68f4dc09-b054-4bef-b90f-0a242a9c87c0 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:09:52.604725 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-68f4dc09-b054-4bef-b90f-0a242a9c87c0 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:09:52.605427 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-68f4dc09-b054-4bef-b90f-0a242a9c87c0 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:09:52.606387 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-68f4dc09-b054-4bef-b90f-0a242a9c87c0 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:09:52.607015 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-68f4dc09-b054-4bef-b90f-0a242a9c87c0 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:09:52.608089 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-68f4dc09-b054-4bef-b90f-0a242a9c87c0 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:09:52.842764 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-68f4dc09-b054-4bef-b90f-0a242a9c87c0 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5292bc31784241c3abc2e2a1828ec3ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e98cd08ee22b4f0186fe5c62d611353d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:09:52.854622 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-68f4dc09-b054-4bef-b90f-0a242a9c87c0 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] 10.222.0.50 "GET /compute/v2.1/servers/87b2af3e-cb72-4986-a6f2-8c22ba3632cc" status: 200 len: 1208 microversion: 2.1 time: 0.294668 Aug 10 18:09:52.855371 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 1014/2052] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 18:09:52 2022] GET /compute/v2.1/servers/87b2af3e-cb72-4986-a6f2-8c22ba3632cc => generated 1208 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 18:09:53.887667 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-956d526c-ae6f-4983-850b-e11cc33126d9 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:09:53.887667 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-956d526c-ae6f-4983-850b-e11cc33126d9 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] [instance: 87b2af3e-cb72-4986-a6f2-8c22ba3632cc] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:09:53.895356 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-956d526c-ae6f-4983-850b-e11cc33126d9 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:09:53.895723 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-956d526c-ae6f-4983-850b-e11cc33126d9 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:09:53.896152 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-956d526c-ae6f-4983-850b-e11cc33126d9 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:09:53.896892 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-956d526c-ae6f-4983-850b-e11cc33126d9 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:09:53.900433 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-956d526c-ae6f-4983-850b-e11cc33126d9 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:09:53.901529 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-956d526c-ae6f-4983-850b-e11cc33126d9 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:09:54.093217 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-956d526c-ae6f-4983-850b-e11cc33126d9 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5292bc31784241c3abc2e2a1828ec3ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e98cd08ee22b4f0186fe5c62d611353d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:09:54.117942 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-956d526c-ae6f-4983-850b-e11cc33126d9 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] 10.222.0.50 "GET /compute/v2.1/servers/87b2af3e-cb72-4986-a6f2-8c22ba3632cc" status: 200 len: 1264 microversion: 2.1 time: 0.240429 Aug 10 18:09:54.120642 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1039/2053] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 18:09:53 2022] GET /compute/v2.1/servers/87b2af3e-cb72-4986-a6f2-8c22ba3632cc => generated 1264 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 18:09:55.141095 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-3a143083-065d-45bf-9615-3cd0fb147a65 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:09:55.142407 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-3a143083-065d-45bf-9615-3cd0fb147a65 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] [instance: 87b2af3e-cb72-4986-a6f2-8c22ba3632cc] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:09:55.183084 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-3a143083-065d-45bf-9615-3cd0fb147a65 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:09:55.193699 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-3a143083-065d-45bf-9615-3cd0fb147a65 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:09:55.195697 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-3a143083-065d-45bf-9615-3cd0fb147a65 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:09:55.198073 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-3a143083-065d-45bf-9615-3cd0fb147a65 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:09:55.198714 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-3a143083-065d-45bf-9615-3cd0fb147a65 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:09:55.199954 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-3a143083-065d-45bf-9615-3cd0fb147a65 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:09:55.397864 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-3a143083-065d-45bf-9615-3cd0fb147a65 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5292bc31784241c3abc2e2a1828ec3ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e98cd08ee22b4f0186fe5c62d611353d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:09:55.424736 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-3a143083-065d-45bf-9615-3cd0fb147a65 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] 10.222.0.50 "GET /compute/v2.1/servers/87b2af3e-cb72-4986-a6f2-8c22ba3632cc" status: 200 len: 1282 microversion: 2.1 time: 0.287995 Aug 10 18:09:55.429025 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 1015/2054] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 18:09:55 2022] GET /compute/v2.1/servers/87b2af3e-cb72-4986-a6f2-8c22ba3632cc => generated 1282 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 18:09:56.447205 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-a595e8ff-9bab-4556-9b0f-adcc344f7207 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:09:56.449442 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-a595e8ff-9bab-4556-9b0f-adcc344f7207 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] [instance: 87b2af3e-cb72-4986-a6f2-8c22ba3632cc] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:09:56.467678 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a595e8ff-9bab-4556-9b0f-adcc344f7207 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:09:56.469796 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a595e8ff-9bab-4556-9b0f-adcc344f7207 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:09:56.471259 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a595e8ff-9bab-4556-9b0f-adcc344f7207 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:09:56.475150 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a595e8ff-9bab-4556-9b0f-adcc344f7207 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:09:56.477217 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a595e8ff-9bab-4556-9b0f-adcc344f7207 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:09:56.477956 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a595e8ff-9bab-4556-9b0f-adcc344f7207 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:09:56.705963 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-a595e8ff-9bab-4556-9b0f-adcc344f7207 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5292bc31784241c3abc2e2a1828ec3ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e98cd08ee22b4f0186fe5c62d611353d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:09:56.714988 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-a595e8ff-9bab-4556-9b0f-adcc344f7207 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] 10.222.0.50 "GET /compute/v2.1/servers/87b2af3e-cb72-4986-a6f2-8c22ba3632cc" status: 200 len: 1270 microversion: 2.1 time: 0.273407 Aug 10 18:09:56.715582 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1040/2055] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 18:09:56 2022] GET /compute/v2.1/servers/87b2af3e-cb72-4986-a6f2-8c22ba3632cc => generated 1270 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 18:09:57.741550 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-76966f79-25ed-497d-affa-061bb2422196 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:09:57.742161 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-76966f79-25ed-497d-affa-061bb2422196 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] [instance: 87b2af3e-cb72-4986-a6f2-8c22ba3632cc] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:09:57.773502 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-76966f79-25ed-497d-affa-061bb2422196 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:09:57.784049 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-76966f79-25ed-497d-affa-061bb2422196 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:09:57.784506 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-76966f79-25ed-497d-affa-061bb2422196 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:09:57.785263 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-76966f79-25ed-497d-affa-061bb2422196 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:09:57.785827 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-76966f79-25ed-497d-affa-061bb2422196 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:09:57.786350 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-76966f79-25ed-497d-affa-061bb2422196 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:09:58.065605 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-76966f79-25ed-497d-affa-061bb2422196 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5292bc31784241c3abc2e2a1828ec3ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e98cd08ee22b4f0186fe5c62d611353d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:09:58.087831 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-76966f79-25ed-497d-affa-061bb2422196 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] 10.222.0.50 "GET /compute/v2.1/servers/87b2af3e-cb72-4986-a6f2-8c22ba3632cc" status: 200 len: 1270 microversion: 2.1 time: 0.349968 Aug 10 18:09:58.117374 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 1016/2056] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 18:09:57 2022] GET /compute/v2.1/servers/87b2af3e-cb72-4986-a6f2-8c22ba3632cc => generated 1270 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 18:09:59.115453 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-81caf172-d862-41ee-9cb7-a9afc429f19e tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:09:59.116071 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-81caf172-d862-41ee-9cb7-a9afc429f19e tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] [instance: 87b2af3e-cb72-4986-a6f2-8c22ba3632cc] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:09:59.133220 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-81caf172-d862-41ee-9cb7-a9afc429f19e tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:09:59.139777 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-81caf172-d862-41ee-9cb7-a9afc429f19e tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:09:59.139777 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-81caf172-d862-41ee-9cb7-a9afc429f19e tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:09:59.139777 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-81caf172-d862-41ee-9cb7-a9afc429f19e tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:09:59.139777 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-81caf172-d862-41ee-9cb7-a9afc429f19e tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:09:59.139777 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-81caf172-d862-41ee-9cb7-a9afc429f19e tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:09:59.945838 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-81caf172-d862-41ee-9cb7-a9afc429f19e tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5292bc31784241c3abc2e2a1828ec3ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e98cd08ee22b4f0186fe5c62d611353d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:09:59.957861 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-81caf172-d862-41ee-9cb7-a9afc429f19e tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] 10.222.0.50 "GET /compute/v2.1/servers/87b2af3e-cb72-4986-a6f2-8c22ba3632cc" status: 200 len: 1312 microversion: 2.1 time: 0.845109 Aug 10 18:09:59.962335 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1041/2057] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 18:09:59 2022] GET /compute/v2.1/servers/87b2af3e-cb72-4986-a6f2-8c22ba3632cc => generated 1312 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 18:10:00.983450 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-defeb79b-b2c4-4ee8-86a9-f609d8576e5d tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:10:00.984114 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-defeb79b-b2c4-4ee8-86a9-f609d8576e5d tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] [instance: 87b2af3e-cb72-4986-a6f2-8c22ba3632cc] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:10:00.986548 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_cell0:SELECT=2 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 18:10:00.987810 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_cell0:SELECT=8 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 18:10:01.000744 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-defeb79b-b2c4-4ee8-86a9-f609d8576e5d tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:10:01.007123 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-defeb79b-b2c4-4ee8-86a9-f609d8576e5d tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:10:01.007123 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-defeb79b-b2c4-4ee8-86a9-f609d8576e5d tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:10:01.007123 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-defeb79b-b2c4-4ee8-86a9-f609d8576e5d tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:10:01.007123 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-defeb79b-b2c4-4ee8-86a9-f609d8576e5d tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:10:01.007123 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-defeb79b-b2c4-4ee8-86a9-f609d8576e5d tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:10:01.870481 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-defeb79b-b2c4-4ee8-86a9-f609d8576e5d tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5292bc31784241c3abc2e2a1828ec3ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e98cd08ee22b4f0186fe5c62d611353d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:10:01.889332 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-defeb79b-b2c4-4ee8-86a9-f609d8576e5d tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] 10.222.0.50 "GET /compute/v2.1/servers/87b2af3e-cb72-4986-a6f2-8c22ba3632cc" status: 200 len: 1312 microversion: 2.1 time: 0.900517 Aug 10 18:10:01.889332 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 1017/2058] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 18:10:00 2022] GET /compute/v2.1/servers/87b2af3e-cb72-4986-a6f2-8c22ba3632cc => generated 1312 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 18:10:02.900605 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-ded63ea1-4b80-4033-ba13-70f2f60e380c tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:10:02.901710 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-ded63ea1-4b80-4033-ba13-70f2f60e380c tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] [instance: 87b2af3e-cb72-4986-a6f2-8c22ba3632cc] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:10:02.912345 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_cell0:SELECT=4 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 18:10:02.916898 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-ded63ea1-4b80-4033-ba13-70f2f60e380c tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:10:02.921689 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-ded63ea1-4b80-4033-ba13-70f2f60e380c tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:10:02.922307 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-ded63ea1-4b80-4033-ba13-70f2f60e380c tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:10:02.923233 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-ded63ea1-4b80-4033-ba13-70f2f60e380c tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:10:02.923845 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-ded63ea1-4b80-4033-ba13-70f2f60e380c tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:10:02.924491 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-ded63ea1-4b80-4033-ba13-70f2f60e380c tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:10:03.274776 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-ded63ea1-4b80-4033-ba13-70f2f60e380c tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5292bc31784241c3abc2e2a1828ec3ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e98cd08ee22b4f0186fe5c62d611353d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:10:03.298665 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-ded63ea1-4b80-4033-ba13-70f2f60e380c tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] 10.222.0.50 "GET /compute/v2.1/servers/87b2af3e-cb72-4986-a6f2-8c22ba3632cc" status: 200 len: 1312 microversion: 2.1 time: 0.389437 Aug 10 18:10:03.298665 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1042/2059] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 18:10:02 2022] GET /compute/v2.1/servers/87b2af3e-cb72-4986-a6f2-8c22ba3632cc => generated 1312 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 18:10:03.829160 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [req-4e34cc10-cd55-437c-85fa-c5c18d05a5c1 req-985feafd-856b-4614-9880-95e39955825e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87b2af3e-cb72-4986-a6f2-8c22ba3632cc", "tag": "745603b4-8173-4c83-8985-0742526bd438"}]} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 18:10:03.848623 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-4e34cc10-cd55-437c-85fa-c5c18d05a5c1 req-985feafd-856b-4614-9880-95e39955825e service nova] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:10:03.850027 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-4e34cc10-cd55-437c-85fa-c5c18d05a5c1 req-985feafd-856b-4614-9880-95e39955825e service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:10:03.853902 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-4e34cc10-cd55-437c-85fa-c5c18d05a5c1 req-985feafd-856b-4614-9880-95e39955825e service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:10:03.881361 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.compute.server_external_events [req-4e34cc10-cd55-437c-85fa-c5c18d05a5c1 req-985feafd-856b-4614-9880-95e39955825e service nova] Creating event network-changed:745603b4-8173-4c83-8985-0742526bd438 for instance 87b2af3e-cb72-4986-a6f2-8c22ba3632cc on n-h1-852296-2 Aug 10 18:10:03.894756 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [req-4e34cc10-cd55-437c-85fa-c5c18d05a5c1 req-985feafd-856b-4614-9880-95e39955825e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.560908 Aug 10 18:10:03.896694 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 1018/2060] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 10 18:10:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 18:10:04.308069 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-3c09e9ac-4f0c-471d-8ff8-89d2a9313f95 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:10:04.309491 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-3c09e9ac-4f0c-471d-8ff8-89d2a9313f95 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] [instance: 87b2af3e-cb72-4986-a6f2-8c22ba3632cc] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:10:04.321611 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-3c09e9ac-4f0c-471d-8ff8-89d2a9313f95 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:10:04.323663 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-3c09e9ac-4f0c-471d-8ff8-89d2a9313f95 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:10:04.326007 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-3c09e9ac-4f0c-471d-8ff8-89d2a9313f95 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:10:04.331065 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-3c09e9ac-4f0c-471d-8ff8-89d2a9313f95 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:10:04.331906 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-3c09e9ac-4f0c-471d-8ff8-89d2a9313f95 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:10:04.332670 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-3c09e9ac-4f0c-471d-8ff8-89d2a9313f95 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:10:04.754033 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-3c09e9ac-4f0c-471d-8ff8-89d2a9313f95 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5292bc31784241c3abc2e2a1828ec3ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e98cd08ee22b4f0186fe5c62d611353d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:10:04.763565 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-3c09e9ac-4f0c-471d-8ff8-89d2a9313f95 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] 10.222.0.50 "GET /compute/v2.1/servers/87b2af3e-cb72-4986-a6f2-8c22ba3632cc" status: 200 len: 1312 microversion: 2.1 time: 0.459628 Aug 10 18:10:04.764813 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1043/2061] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 18:10:04 2022] GET /compute/v2.1/servers/87b2af3e-cb72-4986-a6f2-8c22ba3632cc => generated 1312 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 18:10:05.786054 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-9ddb96bc-e5fa-49ab-b74e-c1fcf204fde7 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:10:05.786834 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-9ddb96bc-e5fa-49ab-b74e-c1fcf204fde7 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] [instance: 87b2af3e-cb72-4986-a6f2-8c22ba3632cc] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:10:05.815123 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-9ddb96bc-e5fa-49ab-b74e-c1fcf204fde7 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:10:05.820293 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-9ddb96bc-e5fa-49ab-b74e-c1fcf204fde7 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:10:05.824384 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-9ddb96bc-e5fa-49ab-b74e-c1fcf204fde7 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:10:05.825733 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-9ddb96bc-e5fa-49ab-b74e-c1fcf204fde7 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:10:05.834442 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-9ddb96bc-e5fa-49ab-b74e-c1fcf204fde7 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:10:05.836517 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-9ddb96bc-e5fa-49ab-b74e-c1fcf204fde7 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:10:06.719762 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-9ddb96bc-e5fa-49ab-b74e-c1fcf204fde7 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5292bc31784241c3abc2e2a1828ec3ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e98cd08ee22b4f0186fe5c62d611353d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:10:06.730279 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-9ddb96bc-e5fa-49ab-b74e-c1fcf204fde7 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] 10.222.0.50 "GET /compute/v2.1/servers/87b2af3e-cb72-4986-a6f2-8c22ba3632cc" status: 200 len: 1312 microversion: 2.1 time: 0.948286 Aug 10 18:10:06.731208 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 1019/2062] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 18:10:05 2022] GET /compute/v2.1/servers/87b2af3e-cb72-4986-a6f2-8c22ba3632cc => generated 1312 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 18:10:07.762250 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-bf013489-09cc-4850-8446-046e71dc6162 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:10:07.793755 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-bf013489-09cc-4850-8446-046e71dc6162 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] [instance: 87b2af3e-cb72-4986-a6f2-8c22ba3632cc] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:10:07.834392 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-bf013489-09cc-4850-8446-046e71dc6162 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:10:07.835627 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-bf013489-09cc-4850-8446-046e71dc6162 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:10:07.836662 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-bf013489-09cc-4850-8446-046e71dc6162 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:10:07.837394 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-bf013489-09cc-4850-8446-046e71dc6162 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:10:07.841751 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-bf013489-09cc-4850-8446-046e71dc6162 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:10:07.842638 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-bf013489-09cc-4850-8446-046e71dc6162 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:10:08.597359 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-bf013489-09cc-4850-8446-046e71dc6162 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5292bc31784241c3abc2e2a1828ec3ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e98cd08ee22b4f0186fe5c62d611353d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:10:08.610196 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-bf013489-09cc-4850-8446-046e71dc6162 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] 10.222.0.50 "GET /compute/v2.1/servers/87b2af3e-cb72-4986-a6f2-8c22ba3632cc" status: 200 len: 1312 microversion: 2.1 time: 0.855962 Aug 10 18:10:08.620278 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1044/2063] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 18:10:07 2022] GET /compute/v2.1/servers/87b2af3e-cb72-4986-a6f2-8c22ba3632cc => generated 1312 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 18:10:09.633819 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-7b084395-8ecf-4ae3-bfc1-9ce8719f9d67 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:10:09.634465 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-7b084395-8ecf-4ae3-bfc1-9ce8719f9d67 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] [instance: 87b2af3e-cb72-4986-a6f2-8c22ba3632cc] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:10:09.654985 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-7b084395-8ecf-4ae3-bfc1-9ce8719f9d67 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:10:09.655467 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-7b084395-8ecf-4ae3-bfc1-9ce8719f9d67 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:10:09.656109 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-7b084395-8ecf-4ae3-bfc1-9ce8719f9d67 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:10:09.657023 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-7b084395-8ecf-4ae3-bfc1-9ce8719f9d67 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:10:09.657717 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-7b084395-8ecf-4ae3-bfc1-9ce8719f9d67 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:10:09.658084 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-7b084395-8ecf-4ae3-bfc1-9ce8719f9d67 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:10:10.989846 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-7b084395-8ecf-4ae3-bfc1-9ce8719f9d67 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5292bc31784241c3abc2e2a1828ec3ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e98cd08ee22b4f0186fe5c62d611353d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:10:11.002655 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-7b084395-8ecf-4ae3-bfc1-9ce8719f9d67 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] 10.222.0.50 "GET /compute/v2.1/servers/87b2af3e-cb72-4986-a6f2-8c22ba3632cc" status: 200 len: 1312 microversion: 2.1 time: 1.369591 Aug 10 18:10:11.003483 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 1020/2064] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 18:10:09 2022] GET /compute/v2.1/servers/87b2af3e-cb72-4986-a6f2-8c22ba3632cc => generated 1312 bytes in 1374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 18:10:12.027695 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-4c9f40a1-ccc1-43fd-a420-e580860b09ef tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:10:12.029043 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-4c9f40a1-ccc1-43fd-a420-e580860b09ef tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] [instance: 87b2af3e-cb72-4986-a6f2-8c22ba3632cc] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:10:12.051782 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-4c9f40a1-ccc1-43fd-a420-e580860b09ef tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:10:12.053139 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-4c9f40a1-ccc1-43fd-a420-e580860b09ef tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:10:12.053828 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-4c9f40a1-ccc1-43fd-a420-e580860b09ef tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:10:12.055569 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-4c9f40a1-ccc1-43fd-a420-e580860b09ef tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:10:12.058255 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-4c9f40a1-ccc1-43fd-a420-e580860b09ef tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:10:12.059253 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-4c9f40a1-ccc1-43fd-a420-e580860b09ef tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:10:12.366458 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-4c9f40a1-ccc1-43fd-a420-e580860b09ef tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5292bc31784241c3abc2e2a1828ec3ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e98cd08ee22b4f0186fe5c62d611353d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:10:12.378820 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-4c9f40a1-ccc1-43fd-a420-e580860b09ef tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] 10.222.0.50 "GET /compute/v2.1/servers/87b2af3e-cb72-4986-a6f2-8c22ba3632cc" status: 200 len: 1312 microversion: 2.1 time: 0.356032 Aug 10 18:10:12.385451 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1045/2065] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 18:10:12 2022] GET /compute/v2.1/servers/87b2af3e-cb72-4986-a6f2-8c22ba3632cc => generated 1312 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 18:10:12.612427 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [req-593e5dfc-112a-441b-aa4f-9e50f88fe36f req-88e75d5b-6072-40f9-8766-497540b2d1f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87b2af3e-cb72-4986-a6f2-8c22ba3632cc", "name": "network-vif-plugged", "status": "completed", "tag": "745603b4-8173-4c83-8985-0742526bd438"}]} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 18:10:12.633703 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-593e5dfc-112a-441b-aa4f-9e50f88fe36f req-88e75d5b-6072-40f9-8766-497540b2d1f5 service nova] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:10:12.635853 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-593e5dfc-112a-441b-aa4f-9e50f88fe36f req-88e75d5b-6072-40f9-8766-497540b2d1f5 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:10:12.650025 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-593e5dfc-112a-441b-aa4f-9e50f88fe36f req-88e75d5b-6072-40f9-8766-497540b2d1f5 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:10:12.711724 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.compute.server_external_events [req-593e5dfc-112a-441b-aa4f-9e50f88fe36f req-88e75d5b-6072-40f9-8766-497540b2d1f5 service nova] Creating event network-vif-plugged:745603b4-8173-4c83-8985-0742526bd438 for instance 87b2af3e-cb72-4986-a6f2-8c22ba3632cc on n-h1-852296-2 Aug 10 18:10:12.726543 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [req-593e5dfc-112a-441b-aa4f-9e50f88fe36f req-88e75d5b-6072-40f9-8766-497540b2d1f5 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.278278 Aug 10 18:10:12.729321 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 1021/2066] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 10 18:10:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 18:10:13.417254 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-42471b9a-1ba6-436a-8002-670c6fa52ae2 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:10:13.417916 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-42471b9a-1ba6-436a-8002-670c6fa52ae2 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] [instance: 87b2af3e-cb72-4986-a6f2-8c22ba3632cc] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:10:13.432871 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-42471b9a-1ba6-436a-8002-670c6fa52ae2 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:10:13.433373 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-42471b9a-1ba6-436a-8002-670c6fa52ae2 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:10:13.443535 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-42471b9a-1ba6-436a-8002-670c6fa52ae2 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:10:13.445586 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-42471b9a-1ba6-436a-8002-670c6fa52ae2 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:10:13.446255 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-42471b9a-1ba6-436a-8002-670c6fa52ae2 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:10:13.446885 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-42471b9a-1ba6-436a-8002-670c6fa52ae2 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:10:13.770585 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-42471b9a-1ba6-436a-8002-670c6fa52ae2 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5292bc31784241c3abc2e2a1828ec3ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e98cd08ee22b4f0186fe5c62d611353d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:10:13.782531 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-42471b9a-1ba6-436a-8002-670c6fa52ae2 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] 10.222.0.50 "GET /compute/v2.1/servers/87b2af3e-cb72-4986-a6f2-8c22ba3632cc" status: 200 len: 1312 microversion: 2.1 time: 0.374999 Aug 10 18:10:13.783792 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1046/2067] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 18:10:13 2022] GET /compute/v2.1/servers/87b2af3e-cb72-4986-a6f2-8c22ba3632cc => generated 1312 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 18:10:14.806831 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-34fd2175-2744-413a-a33e-491d82da8499 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:10:14.808185 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-34fd2175-2744-413a-a33e-491d82da8499 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] [instance: 87b2af3e-cb72-4986-a6f2-8c22ba3632cc] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:10:14.818570 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-34fd2175-2744-413a-a33e-491d82da8499 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:10:14.819394 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-34fd2175-2744-413a-a33e-491d82da8499 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:10:14.820104 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-34fd2175-2744-413a-a33e-491d82da8499 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:10:14.821043 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-34fd2175-2744-413a-a33e-491d82da8499 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:10:14.821718 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-34fd2175-2744-413a-a33e-491d82da8499 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:10:14.822312 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-34fd2175-2744-413a-a33e-491d82da8499 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:10:15.163779 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-34fd2175-2744-413a-a33e-491d82da8499 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5292bc31784241c3abc2e2a1828ec3ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e98cd08ee22b4f0186fe5c62d611353d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:10:15.173752 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-34fd2175-2744-413a-a33e-491d82da8499 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] 10.222.0.50 "GET /compute/v2.1/servers/87b2af3e-cb72-4986-a6f2-8c22ba3632cc" status: 200 len: 1312 microversion: 2.1 time: 0.371313 Aug 10 18:10:15.174344 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 1022/2068] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 18:10:14 2022] GET /compute/v2.1/servers/87b2af3e-cb72-4986-a6f2-8c22ba3632cc => generated 1312 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 18:10:16.197900 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-9242c51e-3ff9-4a25-89b4-9db5c6c018a4 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:10:16.199176 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-9242c51e-3ff9-4a25-89b4-9db5c6c018a4 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] [instance: 87b2af3e-cb72-4986-a6f2-8c22ba3632cc] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:10:16.207971 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-9242c51e-3ff9-4a25-89b4-9db5c6c018a4 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:10:16.208523 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-9242c51e-3ff9-4a25-89b4-9db5c6c018a4 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:10:16.209226 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-9242c51e-3ff9-4a25-89b4-9db5c6c018a4 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:10:16.210124 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-9242c51e-3ff9-4a25-89b4-9db5c6c018a4 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:10:16.210987 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-9242c51e-3ff9-4a25-89b4-9db5c6c018a4 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:10:16.211582 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-9242c51e-3ff9-4a25-89b4-9db5c6c018a4 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:10:16.645715 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-9242c51e-3ff9-4a25-89b4-9db5c6c018a4 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5292bc31784241c3abc2e2a1828ec3ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e98cd08ee22b4f0186fe5c62d611353d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:10:16.662177 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-9242c51e-3ff9-4a25-89b4-9db5c6c018a4 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] 10.222.0.50 "GET /compute/v2.1/servers/87b2af3e-cb72-4986-a6f2-8c22ba3632cc" status: 200 len: 1461 microversion: 2.1 time: 0.469680 Aug 10 18:10:16.680635 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1047/2069] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 18:10:16 2022] GET /compute/v2.1/servers/87b2af3e-cb72-4986-a6f2-8c22ba3632cc => generated 1461 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 18:10:16.691631 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-48098fc5-c348-43e9-b7ab-575ca1717fad tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4f744ed4-fd8a-4714-82b9-c24b316816b6", "device": "/dev/sdb"}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 18:10:16.714145 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-48098fc5-c348-43e9-b7ab-575ca1717fad tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] [instance: 87b2af3e-cb72-4986-a6f2-8c22ba3632cc] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:10:16.714145 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-48098fc5-c348-43e9-b7ab-575ca1717fad tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:10:16.714145 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-48098fc5-c348-43e9-b7ab-575ca1717fad tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:10:16.714145 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-48098fc5-c348-43e9-b7ab-575ca1717fad tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:10:16.714145 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-48098fc5-c348-43e9-b7ab-575ca1717fad tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:10:16.714145 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-48098fc5-c348-43e9-b7ab-575ca1717fad tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:10:16.716482 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-48098fc5-c348-43e9-b7ab-575ca1717fad tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:10:17.123742 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_cell1:SELECT=55 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 18:10:18.320067 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-48098fc5-c348-43e9-b7ab-575ca1717fad tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] 10.222.0.50 "POST /compute/v2.1/servers/87b2af3e-cb72-4986-a6f2-8c22ba3632cc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.632944 Aug 10 18:10:18.326244 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 1023/2070] 10.222.0.50 () {60 vars in 1323 bytes} [Wed Aug 10 18:10:16 2022] POST /compute/v2.1/servers/87b2af3e-cb72-4986-a6f2-8c22ba3632cc/os-volume_attachments => generated 194 bytes in 1635 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 18:10:36.189431 n-d-852296-2 devstack@n-api.service[129409]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 18:10:36.189928 n-d-852296-2 devstack@n-api.service[129409]: Wed Aug 10 18:10:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 18:10:53.582117 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_api:SELECT=26 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 18:10:53.583553 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_cell1:SELECT=54 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 18:10:53.764414 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-fbe0b4c2-9106-414b-bd82-02032f1ca344 tempest-TestAggregatesBasicOps-719417382 tempest-TestAggregatesBasicOps-719417382-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-1335064639", "availability_zone": "foo_zone"}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 18:10:53.767932 n-d-852296-2 devstack@n-api.service[129409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 18:10:53.767932 n-d-852296-2 devstack@n-api.service[129409]: warnings.warn(msg) Aug 10 18:10:53.769428 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.objects.aggregate [None req-fbe0b4c2-9106-414b-bd82-02032f1ca344 tempest-TestAggregatesBasicOps-719417382 tempest-TestAggregatesBasicOps-719417382-project-admin] Generated uuid 330d946b-ab8f-4b53-85c9-edc0ae58a522 for aggregate {{(pid=129409) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 10 18:10:54.061936 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-fbe0b4c2-9106-414b-bd82-02032f1ca344 tempest-TestAggregatesBasicOps-719417382 tempest-TestAggregatesBasicOps-719417382-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 200 len: 209 microversion: 2.1 time: 0.484671 Aug 10 18:10:54.067068 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1048/2071] 10.222.0.50 () {60 vars in 1164 bytes} [Wed Aug 10 18:10:53 2022] POST /compute/v2.1/os-aggregates => generated 209 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 18:10:54.073784 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 18:10:54.082032 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-8c5702c2-1676-4315-a82d-a52c433de330 tempest-TestAggregatesBasicOps-719417382 tempest-TestAggregatesBasicOps-719417382-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 18:10:54.088582 n-d-852296-2 devstack@n-api.service[129410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 18:10:54.088582 n-d-852296-2 devstack@n-api.service[129410]: warnings.warn(msg) Aug 10 18:10:54.337296 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-8c5702c2-1676-4315-a82d-a52c433de330 tempest-TestAggregatesBasicOps-719417382 tempest-TestAggregatesBasicOps-719417382-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 319 microversion: 2.1 time: 0.266551 Aug 10 18:10:54.342292 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 1024/2072] 10.222.0.50 () {60 vars in 1194 bytes} [Wed Aug 10 18:10:54 2022] POST /compute/v2.1/os-aggregates/19/action => generated 319 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 18:10:54.352686 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-c7b1e3db-600c-4607-96ea-434118681f49 tempest-TestAggregatesBasicOps-719417382 tempest-TestAggregatesBasicOps-719417382-project-admin] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:10:54.355553 n-d-852296-2 devstack@n-api.service[129409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 18:10:54.355553 n-d-852296-2 devstack@n-api.service[129409]: warnings.warn(msg) Aug 10 18:10:54.356795 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c7b1e3db-600c-4607-96ea-434118681f49 tempest-TestAggregatesBasicOps-719417382 tempest-TestAggregatesBasicOps-719417382-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:10:54.357504 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c7b1e3db-600c-4607-96ea-434118681f49 tempest-TestAggregatesBasicOps-719417382 tempest-TestAggregatesBasicOps-719417382-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:10:54.358104 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c7b1e3db-600c-4607-96ea-434118681f49 tempest-TestAggregatesBasicOps-719417382 tempest-TestAggregatesBasicOps-719417382-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:10:54.358999 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c7b1e3db-600c-4607-96ea-434118681f49 tempest-TestAggregatesBasicOps-719417382 tempest-TestAggregatesBasicOps-719417382-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:10:54.359537 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c7b1e3db-600c-4607-96ea-434118681f49 tempest-TestAggregatesBasicOps-719417382 tempest-TestAggregatesBasicOps-719417382-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:10:54.360093 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-c7b1e3db-600c-4607-96ea-434118681f49 tempest-TestAggregatesBasicOps-719417382 tempest-TestAggregatesBasicOps-719417382-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:10:54.388913 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-c7b1e3db-600c-4607-96ea-434118681f49 tempest-TestAggregatesBasicOps-719417382 tempest-TestAggregatesBasicOps-719417382-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.039803 Aug 10 18:10:54.389935 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1049/2073] 10.222.0.50 () {58 vars in 1176 bytes} [Wed Aug 10 18:10:54 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 18:10:54.404464 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-f95817b8-db26-4614-8b67-ad64aacb9baf tempest-TestAggregatesBasicOps-719417382 tempest-TestAggregatesBasicOps-719417382-project-admin] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:10:54.405419 n-d-852296-2 devstack@n-api.service[129410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 18:10:54.405419 n-d-852296-2 devstack@n-api.service[129410]: warnings.warn(msg) Aug 10 18:10:54.425265 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-f95817b8-db26-4614-8b67-ad64aacb9baf tempest-TestAggregatesBasicOps-719417382 tempest-TestAggregatesBasicOps-719417382-project-admin] 10.222.0.50 "GET /compute/v2.1/os-aggregates" status: 200 len: 298 microversion: 2.1 time: 0.016357 Aug 10 18:10:54.425265 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 1025/2074] 10.222.0.50 () {58 vars in 1143 bytes} [Wed Aug 10 18:10:54 2022] GET /compute/v2.1/os-aggregates => generated 298 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 18:10:54.435040 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-18473e21-8a81-454c-b889-3ec509888b93 tempest-TestAggregatesBasicOps-719417382 tempest-TestAggregatesBasicOps-719417382-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-852296-2"}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 18:10:54.439852 n-d-852296-2 devstack@n-api.service[129409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 18:10:54.439852 n-d-852296-2 devstack@n-api.service[129409]: warnings.warn(msg) Aug 10 18:10:54.451340 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-18473e21-8a81-454c-b889-3ec509888b93 tempest-TestAggregatesBasicOps-719417382 tempest-TestAggregatesBasicOps-719417382-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:10:54.451615 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-18473e21-8a81-454c-b889-3ec509888b93 tempest-TestAggregatesBasicOps-719417382 tempest-TestAggregatesBasicOps-719417382-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:10:54.452040 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-18473e21-8a81-454c-b889-3ec509888b93 tempest-TestAggregatesBasicOps-719417382 tempest-TestAggregatesBasicOps-719417382-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:10:55.637565 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-18473e21-8a81-454c-b889-3ec509888b93 tempest-TestAggregatesBasicOps-719417382 tempest-TestAggregatesBasicOps-719417382-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 310 microversion: 2.1 time: 1.207409 Aug 10 18:10:55.638216 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1050/2075] 10.222.0.50 () {60 vars in 1194 bytes} [Wed Aug 10 18:10:54 2022] POST /compute/v2.1/os-aggregates/19/action => generated 310 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 18:10:55.651387 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-e66a4fec-f7e8-40bb-a494-8e6ed2b46c61 tempest-TestAggregatesBasicOps-719417382 tempest-TestAggregatesBasicOps-719417382-project-admin] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:10:55.654575 n-d-852296-2 devstack@n-api.service[129410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 18:10:55.654575 n-d-852296-2 devstack@n-api.service[129410]: warnings.warn(msg) Aug 10 18:10:55.677001 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-e66a4fec-f7e8-40bb-a494-8e6ed2b46c61 tempest-TestAggregatesBasicOps-719417382 tempest-TestAggregatesBasicOps-719417382-project-admin] 10.222.0.50 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 310 microversion: 2.1 time: 0.030196 Aug 10 18:10:55.679806 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 1026/2076] 10.222.0.50 () {58 vars in 1152 bytes} [Wed Aug 10 18:10:55 2022] GET /compute/v2.1/os-aggregates/19 => generated 310 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 18:10:55.694070 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-f50448e8-da6e-4748-b162-ee6f05dfd163 tempest-TestAggregatesBasicOps-719417382 tempest-TestAggregatesBasicOps-719417382-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-1871042750", "availability_zone": "foo_zone"}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 18:10:55.697327 n-d-852296-2 devstack@n-api.service[129409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 18:10:55.697327 n-d-852296-2 devstack@n-api.service[129409]: warnings.warn(msg) Aug 10 18:10:55.989339 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-f50448e8-da6e-4748-b162-ee6f05dfd163 tempest-TestAggregatesBasicOps-719417382 tempest-TestAggregatesBasicOps-719417382-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 342 microversion: 2.1 time: 0.300751 Aug 10 18:10:55.990773 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1051/2077] 10.222.0.50 () {60 vars in 1173 bytes} [Wed Aug 10 18:10:55 2022] PUT /compute/v2.1/os-aggregates/19 => generated 342 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 18:10:56.003380 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-518dd803-17a4-4f83-8ae8-ec2c09dd32de tempest-TestAggregatesBasicOps-719417382 tempest-TestAggregatesBasicOps-719417382-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 18:10:56.006391 n-d-852296-2 devstack@n-api.service[129410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 18:10:56.006391 n-d-852296-2 devstack@n-api.service[129410]: warnings.warn(msg) Aug 10 18:10:56.192754 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-518dd803-17a4-4f83-8ae8-ec2c09dd32de tempest-TestAggregatesBasicOps-719417382 tempest-TestAggregatesBasicOps-719417382-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 356 microversion: 2.1 time: 0.193277 Aug 10 18:10:56.195341 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 1027/2078] 10.222.0.50 () {60 vars in 1194 bytes} [Wed Aug 10 18:10:55 2022] POST /compute/v2.1/os-aggregates/19/action => generated 356 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 18:10:56.213023 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-7f1787f4-a02d-402d-a91c-df253d696ccf tempest-TestAggregatesBasicOps-719417382 tempest-TestAggregatesBasicOps-719417382-project-admin] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:10:56.214852 n-d-852296-2 devstack@n-api.service[129409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 18:10:56.214852 n-d-852296-2 devstack@n-api.service[129409]: warnings.warn(msg) Aug 10 18:10:56.223891 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-7f1787f4-a02d-402d-a91c-df253d696ccf tempest-TestAggregatesBasicOps-719417382 tempest-TestAggregatesBasicOps-719417382-project-admin] 10.222.0.50 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 356 microversion: 2.1 time: 0.015941 Aug 10 18:10:56.224968 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1052/2079] 10.222.0.50 () {58 vars in 1152 bytes} [Wed Aug 10 18:10:56 2022] GET /compute/v2.1/os-aggregates/19 => generated 356 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 18:10:56.244450 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-916a925f-6a05-4c9f-ae86-e1069036e128 tempest-TestAggregatesBasicOps-719417382 tempest-TestAggregatesBasicOps-719417382-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-852296-2"}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 18:10:56.250235 n-d-852296-2 devstack@n-api.service[129410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 18:10:56.250235 n-d-852296-2 devstack@n-api.service[129410]: warnings.warn(msg) Aug 10 18:10:56.263420 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-916a925f-6a05-4c9f-ae86-e1069036e128 tempest-TestAggregatesBasicOps-719417382 tempest-TestAggregatesBasicOps-719417382-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:10:56.264216 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-916a925f-6a05-4c9f-ae86-e1069036e128 tempest-TestAggregatesBasicOps-719417382 tempest-TestAggregatesBasicOps-719417382-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:10:56.264701 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-916a925f-6a05-4c9f-ae86-e1069036e128 tempest-TestAggregatesBasicOps-719417382 tempest-TestAggregatesBasicOps-719417382-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:10:57.191609 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-916a925f-6a05-4c9f-ae86-e1069036e128 tempest-TestAggregatesBasicOps-719417382 tempest-TestAggregatesBasicOps-719417382-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 341 microversion: 2.1 time: 0.956273 Aug 10 18:10:57.192687 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 1028/2080] 10.222.0.50 () {60 vars in 1194 bytes} [Wed Aug 10 18:10:56 2022] POST /compute/v2.1/os-aggregates/19/action => generated 341 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 18:10:57.204958 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-5d64ce71-e1af-41e4-b398-b0e001be08a1 tempest-TestAggregatesBasicOps-719417382 tempest-TestAggregatesBasicOps-719417382-project-admin] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:10:57.208283 n-d-852296-2 devstack@n-api.service[129409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 18:10:57.208283 n-d-852296-2 devstack@n-api.service[129409]: warnings.warn(msg) Aug 10 18:10:57.383658 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-5d64ce71-e1af-41e4-b398-b0e001be08a1 tempest-TestAggregatesBasicOps-719417382 tempest-TestAggregatesBasicOps-719417382-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.137124 Aug 10 18:10:57.383658 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1053/2081] 10.222.0.50 () {58 vars in 1155 bytes} [Wed Aug 10 18:10:57 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 10 18:11:03.882687 n-d-852296-2 devstack@n-api.service[129409]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 18:11:03.884458 n-d-852296-2 devstack@n-api.service[129409]: Wed Aug 10 18:11:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 18:11:23.184336 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=8,nova_cell1:INSERT=1 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 18:11:23.185523 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_api:SELECT=20,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 18:11:23.440828 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-90bdfeb4-4068-47e7-b602-9d45ebcc1d3b tempest-TestNetworkAdvancedServerOps-1711933537 tempest-TestNetworkAdvancedServerOps-1711933537-project] Action: 'create', calling method: .version_select at 0x7fb3466320d0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1502214796", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLm9QG3qCPncFQ2r45vickxN6q47lUALYs0Cmg4rq8Vw/TW76/Sjc3Ch7dcBSqMIF+VINTIExetvUAprRR5aK20b9fQwxUkU0wTYe9vQON5voYBfzPcuE0oFC6vzC7aERA=="}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 18:11:23.457318 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.quota [None req-90bdfeb4-4068-47e7-b602-9d45ebcc1d3b tempest-TestNetworkAdvancedServerOps-1711933537 tempest-TestNetworkAdvancedServerOps-1711933537-project] Getting quotas for project 0b0bb49e6c854cca93601d0aaf5a72bd. Resources: {'key_pairs'} {{(pid=129410) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 18:11:23.463041 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.quota [None req-90bdfeb4-4068-47e7-b602-9d45ebcc1d3b tempest-TestNetworkAdvancedServerOps-1711933537 tempest-TestNetworkAdvancedServerOps-1711933537-project] Getting quotas for user a7cea04ea8854688aff3083e2e16fc23 and project 0b0bb49e6c854cca93601d0aaf5a72bd. Resources: {'key_pairs'} {{(pid=129410) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 18:11:23.620940 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-90bdfeb4-4068-47e7-b602-9d45ebcc1d3b tempest-TestNetworkAdvancedServerOps-1711933537 tempest-TestNetworkAdvancedServerOps-1711933537-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.446101 Aug 10 18:11:23.621584 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 1029/2082] 10.222.0.50 () {60 vars in 1159 bytes} [Wed Aug 10 18:11:23 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 18:11:45.484844 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_cell0:SELECT=2 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 18:11:45.485650 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_cell1:SELECT=6 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 18:11:45.486625 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 18:11:45.490937 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-aac62fea-b2b7-4fec-9b7c-0e7786212fb4 tempest-TestNetworkAdvancedServerOps-1711933537 tempest-TestNetworkAdvancedServerOps-1711933537-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1122871539", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "a4557894-1b94-42da-81ee-8938c728d74d"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1502214796", "security_groups": [{"name": "tempest-secgroup-smoke-1087998658"}]}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 18:11:46.324330 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.network.neutron [None req-aac62fea-b2b7-4fec-9b7c-0e7786212fb4 tempest-TestNetworkAdvancedServerOps-1711933537 tempest-TestNetworkAdvancedServerOps-1711933537-project] validate_networks() for [('a4557894-1b94-42da-81ee-8938c728d74d', None, None, None, None, None)] {{(pid=129409) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 18:11:46.741370 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [None req-aac62fea-b2b7-4fec-9b7c-0e7786212fb4 tempest-TestNetworkAdvancedServerOps-1711933537 tempest-TestNetworkAdvancedServerOps-1711933537-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-c10ac692-6329-4a13-b8af-67e49741a682) Aug 10 18:11:46.741370 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:11:46.741370 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:11:46.741370 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:11:46.741370 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:11:46.741370 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:11:46.741370 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:11:46.741370 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:11:46.741370 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:11:46.741370 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:11:46.741370 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 18:11:46.741370 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 18:11:46.741370 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 18:11:46.741370 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 18:11:46.741370 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 18:11:46.741370 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 18:11:46.741370 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 18:11:46.741370 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 18:11:46.741370 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 18:11:46.741370 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 18:11:46.741370 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 18:11:46.741370 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 18:11:46.741370 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 18:11:46.741370 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 18:11:46.741370 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 18:11:46.741370 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 18:11:46.741370 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 18:11:46.741370 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:11:46.741370 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:11:46.741370 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 18:11:46.741370 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 18:11:46.741370 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:11:46.741370 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:11:46.741370 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 18:11:46.741370 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 18:11:46.741370 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:11:46.741370 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:11:46.741370 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:11:46.741370 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:11:46.741370 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:11:46.741370 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:11:46.741370 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 18:11:46.741370 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 18:11:46.741370 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 18:11:46.741370 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 18:11:46.741370 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 18:11:46.741370 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 18:11:46.741370 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 18:11:46.741370 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 18:11:46.741370 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 18:11:46.741370 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 18:11:46.741370 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 18:11:46.751701 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 18:11:46.751701 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 18:11:46.751701 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 18:11:46.751701 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 18:11:46.751701 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 18:11:46.751701 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 18:11:46.751701 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 18:11:46.751701 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 18:11:46.751701 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 18:11:46.751701 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 18:11:46.751701 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 18:11:46.751701 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 18:11:46.751701 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 18:11:46.751701 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 18:11:46.751701 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 18:11:46.751701 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-c10ac692-6329-4a13-b8af-67e49741a682) Aug 10 18:11:46.751701 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:11:46.751701 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-aac62fea-b2b7-4fec-9b7c-0e7786212fb4 tempest-TestNetworkAdvancedServerOps-1711933537 tempest-TestNetworkAdvancedServerOps-1711933537-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:11:46.751701 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 18:11:46.751701 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-aac62fea-b2b7-4fec-9b7c-0e7786212fb4 tempest-TestNetworkAdvancedServerOps-1711933537 tempest-TestNetworkAdvancedServerOps-1711933537-project] Request method failure captured: Aug 10 18:11:46.751701 n-d-852296-2 devstack@n-api.service[129409]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 18:11:46.751701 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 18:11:46.751701 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 18:11:46.751701 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 18:11:46.751701 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 345 Aug 10 18:11:46.751701 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 18:11:46.751701 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 18:11:46.751701 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 18:11:46.751701 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 18:11:46.751701 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8_TJHZMmsZI5mwQHzHMdMvFHDzbHLSVzuLUOZgGAc0ZvIiaaNaIq-mrKiFqIexLzkUI0ib9FtCUGgTKkZdR14FvSWS4_pRV9UfYTpzZO0sxu4Q13aoKIhuMhRxHg30qZmCV1-2RiEkAwWA6zjBqLBoXQQZD7su7Z2aSFp-IaQLsMOfc Aug 10 18:11:46.751701 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 18:11:46.751701 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 18:11:46.751701 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 18:11:46.751701 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 18:11:46.751701 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 18:11:46.751701 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 18:11:46.751701 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: 0b0bb49e6c854cca93601d0aaf5a72bd Aug 10 18:11:46.751701 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1711933537 Aug 10 18:11:46.751701 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 18:11:46.751701 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 18:11:46.751701 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0b0bb49e6c854cca93601d0aaf5a72bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/0b0bb49e6c854cca93601d0aaf5a72bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0b0bb49e6c854cca93601d0aaf5a72bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_0b0bb49e6c854cca93601d0aaf5a72bd", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 18:11:46.751701 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1711933537 Aug 10 18:11:46.751701 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: 0b0bb49e6c854cca93601d0aaf5a72bd Aug 10 18:11:46.751701 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1711933537 Aug 10 18:11:46.751701 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-TestNetworkAdvancedServerOps-1711933537-project Aug 10 18:11:46.751701 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 18:11:46.751701 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 18:11:46.751701 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: a7cea04ea8854688aff3083e2e16fc23 Aug 10 18:11:46.751701 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1711933537-project Aug 10 18:11:46.751701 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 18:11:46.751701 n-d-852296-2 devstack@n-api.service[129409]: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1122871539", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "a4557894-1b94-42da-81ee-8938c728d74d"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1502214796", "security_groups": [{"name": "tempest-secgroup-smoke-1087998658"}]}} Aug 10 18:11:46.751701 n-d-852296-2 devstack@n-api.service[129409]: method: > Aug 10 18:11:46.751701 n-d-852296-2 devstack@n-api.service[129409]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:11:46.751701 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 18:11:46.760881 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'body': {'server': {'name': 'tempest-TestNetworkAdvancedServerOps-server-1122871539', 'imageRef': 'a735ff26-463a-4ffe-a981-ab9d9baa494f', 'flavorRef': '452', 'networks': [{'uuid': 'a4557894-1b94-42da-81ee-8938c728d74d'}], 'key_name': 'tempest-TestNetworkAdvancedServerOps-1502214796', 'security_groups': [{'name': 'tempest-secgroup-smoke-1087998658'}]}}} Aug 10 18:11:46.760881 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 18:11:46.760881 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:11:46.760881 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:11:46.760881 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:11:46.760881 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:11:46.760881 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:11:46.760881 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:11:46.760881 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:11:46.760881 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:11:46.760881 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:11:46.760881 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 18:11:46.760881 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 18:11:46.760881 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 18:11:46.760881 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 18:11:46.760881 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 18:11:46.760881 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 18:11:46.760881 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 18:11:46.760881 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 18:11:46.760881 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 18:11:46.760881 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 18:11:46.760881 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 18:11:46.760881 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 18:11:46.760881 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 18:11:46.760881 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 18:11:46.760881 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 18:11:46.760881 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 18:11:46.760881 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 18:11:46.760881 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:11:46.760881 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:11:46.760881 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 18:11:46.760881 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 18:11:46.760881 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:11:46.760881 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:11:46.760881 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 18:11:46.760881 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 18:11:46.760881 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:11:46.760881 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:11:46.760881 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:11:46.760881 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:11:46.760881 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:11:46.760881 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:11:46.760881 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 18:11:46.760881 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 18:11:46.760881 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 18:11:46.760881 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 18:11:46.760881 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 18:11:46.760881 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 18:11:46.760881 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 18:11:46.760881 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 18:11:46.760881 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 18:11:46.760881 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 18:11:46.760881 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 18:11:46.760881 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 18:11:46.768428 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 18:11:46.768428 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 18:11:46.768428 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 18:11:46.768428 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 18:11:46.768428 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 18:11:46.768428 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 18:11:46.768428 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 18:11:46.768428 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 18:11:46.768428 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 18:11:46.768428 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 18:11:46.768428 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 18:11:46.768428 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 18:11:46.768428 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 18:11:46.768428 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 18:11:46.768428 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-c10ac692-6329-4a13-b8af-67e49741a682) Aug 10 18:11:46.768428 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:11:46.768428 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:11:46.768428 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:11:46.768428 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:11:46.768428 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:11:46.768428 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:11:46.768428 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 18:11:46.768428 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 18:11:46.768428 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 10 18:11:46.768428 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 10 18:11:46.768428 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:11:46.768428 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:11:46.768428 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:11:46.768428 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:11:46.768428 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:11:46.768428 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:11:46.768428 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:11:46.768428 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:11:46.768428 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 18:11:46.768428 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 18:11:46.768428 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:11:46.768428 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:11:46.768428 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:11:46.768428 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-aac62fea-b2b7-4fec-9b7c-0e7786212fb4 tempest-TestNetworkAdvancedServerOps-1711933537 tempest-TestNetworkAdvancedServerOps-1711933537-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:11:46.768428 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 18:11:46.768428 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-aac62fea-b2b7-4fec-9b7c-0e7786212fb4 tempest-TestNetworkAdvancedServerOps-1711933537 tempest-TestNetworkAdvancedServerOps-1711933537-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.262217 Aug 10 18:11:46.768428 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1054/2083] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 18:11:45 2022] POST /compute/v2.1/servers => generated 214 bytes in 1263 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 10 18:11:54.481346 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_cell0:SELECT=4 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 18:11:54.485472 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-63db1b6c-e433-4edc-a539-12fe08e44538 tempest-TestNetworkAdvancedServerOps-1711933537 tempest-TestNetworkAdvancedServerOps-1711933537-project] Calling method '.version_select at 0x7fb346562a60>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:11:54.665070 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-63db1b6c-e433-4edc-a539-12fe08e44538 tempest-TestNetworkAdvancedServerOps-1711933537 tempest-TestNetworkAdvancedServerOps-1711933537-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1502214796" status: 202 len: 0 microversion: 2.1 time: 0.178403 Aug 10 18:11:54.665070 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 1030/2084] 10.222.0.50 () {58 vars in 1284 bytes} [Wed Aug 10 18:11:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1502214796 => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 18:11:54.677144 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-818dba32-c48d-4ee3-8de6-fbf6f5e3139f tempest-TestNetworkAdvancedServerOps-1711933537 tempest-TestNetworkAdvancedServerOps-1711933537-project] Action: 'create', calling method: .version_select at 0x7fb346015ca0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2104921685", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBjv9oZuesAQTRqxUV+NPWJ2Jm6yJ6//vwYnQHTykKsKblBgQavrjWrcBn43gGo85cXpuMPRF9Matf6h4P9SNWoE1dZO5DPTa/+2+R7PDAoaPHXKhkWrVw0D1Mjv6Z271Q=="}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 18:11:54.701710 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-818dba32-c48d-4ee3-8de6-fbf6f5e3139f tempest-TestNetworkAdvancedServerOps-1711933537 tempest-TestNetworkAdvancedServerOps-1711933537-project] Getting quotas for project 0b0bb49e6c854cca93601d0aaf5a72bd. Resources: {'key_pairs'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 18:11:54.709984 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-818dba32-c48d-4ee3-8de6-fbf6f5e3139f tempest-TestNetworkAdvancedServerOps-1711933537 tempest-TestNetworkAdvancedServerOps-1711933537-project] Getting quotas for user a7cea04ea8854688aff3083e2e16fc23 and project 0b0bb49e6c854cca93601d0aaf5a72bd. Resources: {'key_pairs'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 18:11:54.888830 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-818dba32-c48d-4ee3-8de6-fbf6f5e3139f tempest-TestNetworkAdvancedServerOps-1711933537 tempest-TestNetworkAdvancedServerOps-1711933537-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.216633 Aug 10 18:11:54.888830 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1055/2085] 10.222.0.50 () {60 vars in 1159 bytes} [Wed Aug 10 18:11:54 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 18:12:13.726639 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-db624535-cc16-482b-8209-6adf074846f6 tempest-TestNetworkAdvancedServerOps-1711933537 tempest-TestNetworkAdvancedServerOps-1711933537-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1746923003", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "f6932a1f-384a-4fa1-8878-76503c40d70e"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2104921685", "security_groups": [{"name": "tempest-secgroup-smoke-950563535"}]}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 18:12:14.006755 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.network.neutron [None req-db624535-cc16-482b-8209-6adf074846f6 tempest-TestNetworkAdvancedServerOps-1711933537 tempest-TestNetworkAdvancedServerOps-1711933537-project] validate_networks() for [('f6932a1f-384a-4fa1-8878-76503c40d70e', None, None, None, None, None)] {{(pid=129410) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 18:12:14.389739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [None req-db624535-cc16-482b-8209-6adf074846f6 tempest-TestNetworkAdvancedServerOps-1711933537 tempest-TestNetworkAdvancedServerOps-1711933537-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-722436e6-948b-4a55-9e38-e3c8ea82599a) Aug 10 18:12:14.389739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:12:14.389739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:12:14.389739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:12:14.389739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:12:14.389739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:12:14.389739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:12:14.389739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:12:14.389739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:12:14.389739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:12:14.389739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 18:12:14.389739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 18:12:14.389739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 18:12:14.389739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 18:12:14.389739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 18:12:14.389739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 18:12:14.389739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 18:12:14.389739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 18:12:14.389739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 18:12:14.389739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 18:12:14.389739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 18:12:14.389739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 18:12:14.389739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 18:12:14.389739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 18:12:14.389739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 18:12:14.389739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 18:12:14.389739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 18:12:14.389739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:12:14.389739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:12:14.389739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 18:12:14.389739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 18:12:14.389739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:12:14.389739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:12:14.389739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 18:12:14.389739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 18:12:14.389739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:12:14.389739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:12:14.389739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:12:14.389739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:12:14.389739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:12:14.389739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:12:14.389739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 18:12:14.389739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 18:12:14.389739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 18:12:14.389739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 18:12:14.389739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 18:12:14.389739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 18:12:14.389739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 18:12:14.389739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 18:12:14.389739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 18:12:14.389739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 18:12:14.389739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 18:12:14.394578 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 18:12:14.394578 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 18:12:14.394578 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 18:12:14.394578 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 18:12:14.394578 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 18:12:14.394578 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 18:12:14.394578 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 18:12:14.394578 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 18:12:14.394578 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 18:12:14.394578 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 18:12:14.394578 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 18:12:14.394578 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 18:12:14.394578 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 18:12:14.394578 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 18:12:14.394578 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 18:12:14.394578 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-722436e6-948b-4a55-9e38-e3c8ea82599a) Aug 10 18:12:14.394578 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:12:14.394578 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-db624535-cc16-482b-8209-6adf074846f6 tempest-TestNetworkAdvancedServerOps-1711933537 tempest-TestNetworkAdvancedServerOps-1711933537-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:12:14.394578 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 18:12:14.394578 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-db624535-cc16-482b-8209-6adf074846f6 tempest-TestNetworkAdvancedServerOps-1711933537 tempest-TestNetworkAdvancedServerOps-1711933537-project] Request method failure captured: Aug 10 18:12:14.394578 n-d-852296-2 devstack@n-api.service[129410]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 18:12:14.394578 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 18:12:14.394578 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 18:12:14.394578 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 18:12:14.394578 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 344 Aug 10 18:12:14.394578 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 18:12:14.394578 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 18:12:14.394578 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 18:12:14.394578 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 18:12:14.394578 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8_TJHZMmsZI5mwQHzHMdMvFHDzbHLSVzuLUOZgGAc0ZvIiaaNaIq-mrKiFqIexLzkUI0ib9FtCUGgTKkZdR14FvSWS4_pRV9UfYTpzZO0sxu4Q13aoKIhuMhRxHg30qZmCV1-2RiEkAwWA6zjBqLBoXQQZD7su7Z2aSFp-IaQLsMOfc Aug 10 18:12:14.394578 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 18:12:14.394578 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 18:12:14.394578 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 18:12:14.394578 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 18:12:14.394578 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 18:12:14.394578 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 18:12:14.394578 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: 0b0bb49e6c854cca93601d0aaf5a72bd Aug 10 18:12:14.394578 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1711933537 Aug 10 18:12:14.394578 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 18:12:14.394578 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 18:12:14.394578 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0b0bb49e6c854cca93601d0aaf5a72bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/0b0bb49e6c854cca93601d0aaf5a72bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0b0bb49e6c854cca93601d0aaf5a72bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_0b0bb49e6c854cca93601d0aaf5a72bd", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 18:12:14.394578 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1711933537 Aug 10 18:12:14.394578 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: 0b0bb49e6c854cca93601d0aaf5a72bd Aug 10 18:12:14.394578 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1711933537 Aug 10 18:12:14.394578 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-TestNetworkAdvancedServerOps-1711933537-project Aug 10 18:12:14.394578 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 18:12:14.394578 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 18:12:14.394578 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: a7cea04ea8854688aff3083e2e16fc23 Aug 10 18:12:14.394578 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1711933537-project Aug 10 18:12:14.394578 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 18:12:14.394578 n-d-852296-2 devstack@n-api.service[129410]: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1746923003", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "f6932a1f-384a-4fa1-8878-76503c40d70e"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2104921685", "security_groups": [{"name": "tempest-secgroup-smoke-950563535"}]}} Aug 10 18:12:14.394578 n-d-852296-2 devstack@n-api.service[129410]: method: > Aug 10 18:12:14.394578 n-d-852296-2 devstack@n-api.service[129410]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:12:14.394578 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 18:12:14.408192 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'body': {'server': {'name': 'tempest-TestNetworkAdvancedServerOps-server-1746923003', 'imageRef': 'a735ff26-463a-4ffe-a981-ab9d9baa494f', 'flavorRef': '452', 'networks': [{'uuid': 'f6932a1f-384a-4fa1-8878-76503c40d70e'}], 'key_name': 'tempest-TestNetworkAdvancedServerOps-2104921685', 'security_groups': [{'name': 'tempest-secgroup-smoke-950563535'}]}}} Aug 10 18:12:14.408192 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 18:12:14.408192 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:12:14.408192 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:12:14.408192 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:12:14.408192 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:12:14.408192 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:12:14.408192 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:12:14.408192 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:12:14.408192 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:12:14.408192 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:12:14.408192 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 18:12:14.408192 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 18:12:14.408192 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 18:12:14.408192 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 18:12:14.408192 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 18:12:14.408192 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 18:12:14.408192 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 18:12:14.408192 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 18:12:14.408192 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 18:12:14.408192 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 18:12:14.408192 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 18:12:14.408192 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 18:12:14.408192 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 18:12:14.408192 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 18:12:14.408192 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 18:12:14.408192 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 18:12:14.408192 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 18:12:14.408192 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:12:14.408192 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:12:14.408192 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 18:12:14.408192 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 18:12:14.408192 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:12:14.408192 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:12:14.408192 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 18:12:14.408192 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 18:12:14.408192 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:12:14.408192 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:12:14.408192 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:12:14.408192 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:12:14.408192 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:12:14.408192 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:12:14.408192 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 18:12:14.408192 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 18:12:14.408192 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 18:12:14.408192 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 18:12:14.408192 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 18:12:14.408192 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 18:12:14.408192 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 18:12:14.408192 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 18:12:14.408192 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 18:12:14.408192 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 18:12:14.408192 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 18:12:14.408192 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 18:12:14.413182 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 18:12:14.413182 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 18:12:14.413182 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 18:12:14.413182 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 18:12:14.413182 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 18:12:14.413182 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 18:12:14.413182 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 18:12:14.413182 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 18:12:14.413182 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 18:12:14.413182 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 18:12:14.413182 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 18:12:14.413182 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 18:12:14.413182 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 18:12:14.413182 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 18:12:14.413182 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-722436e6-948b-4a55-9e38-e3c8ea82599a) Aug 10 18:12:14.413182 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:12:14.413182 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:12:14.413182 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:12:14.413182 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:12:14.413182 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:12:14.413182 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:12:14.413182 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 18:12:14.413182 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 18:12:14.413182 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 10 18:12:14.413182 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 10 18:12:14.413182 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:12:14.413182 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:12:14.413182 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:12:14.413182 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:12:14.413182 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:12:14.413182 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:12:14.413182 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:12:14.413182 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:12:14.413182 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 18:12:14.413182 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 18:12:14.413182 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:12:14.413182 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:12:14.413182 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:12:14.413182 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-db624535-cc16-482b-8209-6adf074846f6 tempest-TestNetworkAdvancedServerOps-1711933537 tempest-TestNetworkAdvancedServerOps-1711933537-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:12:14.413182 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 18:12:14.413182 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-db624535-cc16-482b-8209-6adf074846f6 tempest-TestNetworkAdvancedServerOps-1711933537 tempest-TestNetworkAdvancedServerOps-1711933537-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.684430 Aug 10 18:12:14.413182 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 1031/2086] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 18:12:13 2022] POST /compute/v2.1/servers => generated 214 bytes in 687 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 10 18:12:24.139738 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-39b9bfa5-220b-42ba-b048-6354ef76aa8c tempest-TestNetworkAdvancedServerOps-1711933537 tempest-TestNetworkAdvancedServerOps-1711933537-project] Calling method '.version_select at 0x7fb346015670>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:12:24.145062 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_cell0:SELECT=4 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 18:12:24.326326 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-39b9bfa5-220b-42ba-b048-6354ef76aa8c tempest-TestNetworkAdvancedServerOps-1711933537 tempest-TestNetworkAdvancedServerOps-1711933537-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2104921685" status: 202 len: 0 microversion: 2.1 time: 0.190377 Aug 10 18:12:24.326907 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1056/2087] 10.222.0.50 () {58 vars in 1284 bytes} [Wed Aug 10 18:12:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2104921685 => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 18:12:24.341985 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-723dfe1d-0a3a-4cb5-8c2b-94c3c06811e5 tempest-TestNetworkAdvancedServerOps-1711933537 tempest-TestNetworkAdvancedServerOps-1711933537-project] Action: 'create', calling method: .version_select at 0x7fb3463cb820>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-677930761", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDb/T+Fcxtb4rXKdv8nQ3n78ZfpnSKcSQpEwPh+3OPF5HFHb3l05GTJ+62mbQjb60dlpCtYTb6mncMfOKHR2Q2M9jmHADhdWfodbqH96Yqq0a3nkZeoo+MfQeSzetxeY/w=="}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 18:12:24.377121 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.quota [None req-723dfe1d-0a3a-4cb5-8c2b-94c3c06811e5 tempest-TestNetworkAdvancedServerOps-1711933537 tempest-TestNetworkAdvancedServerOps-1711933537-project] Getting quotas for project 0b0bb49e6c854cca93601d0aaf5a72bd. Resources: {'key_pairs'} {{(pid=129410) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 18:12:24.386981 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.quota [None req-723dfe1d-0a3a-4cb5-8c2b-94c3c06811e5 tempest-TestNetworkAdvancedServerOps-1711933537 tempest-TestNetworkAdvancedServerOps-1711933537-project] Getting quotas for user a7cea04ea8854688aff3083e2e16fc23 and project 0b0bb49e6c854cca93601d0aaf5a72bd. Resources: {'key_pairs'} {{(pid=129410) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 18:12:24.633491 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-723dfe1d-0a3a-4cb5-8c2b-94c3c06811e5 tempest-TestNetworkAdvancedServerOps-1711933537 tempest-TestNetworkAdvancedServerOps-1711933537-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.297060 Aug 10 18:12:24.634266 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 1032/2088] 10.222.0.50 () {60 vars in 1159 bytes} [Wed Aug 10 18:12:24 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 18:12:37.111501 n-d-852296-2 devstack@n-api.service[129410]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 18:12:37.112173 n-d-852296-2 devstack@n-api.service[129410]: Wed Aug 10 18:12:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 18:12:39.961073 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-c393d688-237e-4fab-8abd-0820f7eefcf6 tempest-TestNetworkAdvancedServerOps-1711933537 tempest-TestNetworkAdvancedServerOps-1711933537-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1566938907", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "68de5975-aade-496b-b882-b376b1c38137"}], "key_name": "tempest-TestNetworkAdvancedServerOps-677930761", "security_groups": [{"name": "tempest-secgroup-smoke-1453751476"}]}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 18:12:40.248826 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.network.neutron [None req-c393d688-237e-4fab-8abd-0820f7eefcf6 tempest-TestNetworkAdvancedServerOps-1711933537 tempest-TestNetworkAdvancedServerOps-1711933537-project] validate_networks() for [('68de5975-aade-496b-b882-b376b1c38137', None, None, None, None, None)] {{(pid=129409) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 18:12:40.879430 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [None req-c393d688-237e-4fab-8abd-0820f7eefcf6 tempest-TestNetworkAdvancedServerOps-1711933537 tempest-TestNetworkAdvancedServerOps-1711933537-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-da395a9b-a267-4032-b35d-bb713a99e758) Aug 10 18:12:40.879430 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:12:40.879430 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:12:40.879430 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:12:40.879430 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:12:40.879430 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:12:40.879430 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:12:40.879430 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:12:40.879430 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:12:40.879430 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:12:40.879430 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 18:12:40.879430 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 18:12:40.879430 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 18:12:40.879430 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 18:12:40.879430 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 18:12:40.879430 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 18:12:40.879430 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 18:12:40.879430 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 18:12:40.879430 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 18:12:40.879430 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 18:12:40.879430 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 18:12:40.879430 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 18:12:40.879430 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 18:12:40.879430 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 18:12:40.879430 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 18:12:40.879430 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 18:12:40.879430 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 18:12:40.879430 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:12:40.879430 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:12:40.879430 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 18:12:40.879430 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 18:12:40.879430 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:12:40.879430 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:12:40.879430 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 18:12:40.879430 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 18:12:40.879430 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:12:40.879430 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:12:40.879430 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:12:40.879430 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:12:40.879430 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:12:40.879430 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:12:40.879430 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 18:12:40.879430 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 18:12:40.879430 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 18:12:40.879430 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 18:12:40.879430 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 18:12:40.879430 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 18:12:40.879430 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 18:12:40.879430 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 18:12:40.879430 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 18:12:40.879430 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 18:12:40.879430 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 18:12:40.884432 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 18:12:40.884432 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 18:12:40.884432 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 18:12:40.884432 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 18:12:40.884432 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 18:12:40.884432 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 18:12:40.884432 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 18:12:40.884432 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 18:12:40.884432 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 18:12:40.884432 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 18:12:40.884432 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 18:12:40.884432 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 18:12:40.884432 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 18:12:40.884432 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 18:12:40.884432 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 18:12:40.884432 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-da395a9b-a267-4032-b35d-bb713a99e758) Aug 10 18:12:40.884432 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:12:40.884432 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-c393d688-237e-4fab-8abd-0820f7eefcf6 tempest-TestNetworkAdvancedServerOps-1711933537 tempest-TestNetworkAdvancedServerOps-1711933537-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:12:40.884432 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 18:12:40.884432 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-c393d688-237e-4fab-8abd-0820f7eefcf6 tempest-TestNetworkAdvancedServerOps-1711933537 tempest-TestNetworkAdvancedServerOps-1711933537-project] Request method failure captured: Aug 10 18:12:40.884432 n-d-852296-2 devstack@n-api.service[129409]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 18:12:40.884432 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 18:12:40.884432 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 18:12:40.884432 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 18:12:40.884432 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 344 Aug 10 18:12:40.884432 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 18:12:40.884432 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 18:12:40.884432 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 18:12:40.884432 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 18:12:40.884432 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8_TJHZMmsZI5mwQHzHMdMvFHDzbHLSVzuLUOZgGAc0ZvIiaaNaIq-mrKiFqIexLzkUI0ib9FtCUGgTKkZdR14FvSWS4_pRV9UfYTpzZO0sxu4Q13aoKIhuMhRxHg30qZmCV1-2RiEkAwWA6zjBqLBoXQQZD7su7Z2aSFp-IaQLsMOfc Aug 10 18:12:40.884432 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 18:12:40.884432 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 18:12:40.884432 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 18:12:40.884432 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 18:12:40.884432 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 18:12:40.884432 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 18:12:40.884432 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: 0b0bb49e6c854cca93601d0aaf5a72bd Aug 10 18:12:40.884432 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1711933537 Aug 10 18:12:40.884432 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 18:12:40.884432 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 18:12:40.884432 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0b0bb49e6c854cca93601d0aaf5a72bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/0b0bb49e6c854cca93601d0aaf5a72bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0b0bb49e6c854cca93601d0aaf5a72bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_0b0bb49e6c854cca93601d0aaf5a72bd", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 18:12:40.884432 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1711933537 Aug 10 18:12:40.884432 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: 0b0bb49e6c854cca93601d0aaf5a72bd Aug 10 18:12:40.884432 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1711933537 Aug 10 18:12:40.884432 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-TestNetworkAdvancedServerOps-1711933537-project Aug 10 18:12:40.884432 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 18:12:40.884432 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 18:12:40.884432 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: a7cea04ea8854688aff3083e2e16fc23 Aug 10 18:12:40.884432 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1711933537-project Aug 10 18:12:40.884432 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 18:12:40.884432 n-d-852296-2 devstack@n-api.service[129409]: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1566938907", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "68de5975-aade-496b-b882-b376b1c38137"}], "key_name": "tempest-TestNetworkAdvancedServerOps-677930761", "security_groups": [{"name": "tempest-secgroup-smoke-1453751476"}]}} Aug 10 18:12:40.884432 n-d-852296-2 devstack@n-api.service[129409]: method: > Aug 10 18:12:40.884432 n-d-852296-2 devstack@n-api.service[129409]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:12:40.884432 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 18:12:40.891363 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'body': {'server': {'name': 'tempest-TestNetworkAdvancedServerOps-server-1566938907', 'imageRef': 'a735ff26-463a-4ffe-a981-ab9d9baa494f', 'flavorRef': '452', 'networks': [{'uuid': '68de5975-aade-496b-b882-b376b1c38137'}], 'key_name': 'tempest-TestNetworkAdvancedServerOps-677930761', 'security_groups': [{'name': 'tempest-secgroup-smoke-1453751476'}]}}} Aug 10 18:12:40.891363 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 18:12:40.891363 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:12:40.891363 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:12:40.891363 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:12:40.891363 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:12:40.891363 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:12:40.891363 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:12:40.891363 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:12:40.891363 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:12:40.891363 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:12:40.891363 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 18:12:40.891363 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 18:12:40.891363 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 18:12:40.891363 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 18:12:40.891363 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 18:12:40.891363 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 18:12:40.891363 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 18:12:40.891363 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 18:12:40.891363 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 18:12:40.891363 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 18:12:40.891363 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 18:12:40.891363 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 18:12:40.891363 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 18:12:40.891363 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 18:12:40.891363 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 18:12:40.891363 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 18:12:40.891363 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 18:12:40.891363 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:12:40.891363 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:12:40.891363 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 18:12:40.891363 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 18:12:40.891363 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:12:40.891363 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:12:40.891363 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 18:12:40.891363 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 18:12:40.891363 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:12:40.891363 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:12:40.891363 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:12:40.891363 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:12:40.891363 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:12:40.891363 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:12:40.891363 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 18:12:40.891363 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 18:12:40.891363 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 18:12:40.891363 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 18:12:40.891363 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 18:12:40.891363 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 18:12:40.891363 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 18:12:40.891363 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 18:12:40.891363 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 18:12:40.891363 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 18:12:40.891363 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 18:12:40.891363 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 18:12:40.900306 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 18:12:40.900306 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 18:12:40.900306 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 18:12:40.900306 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 18:12:40.900306 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 18:12:40.900306 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 18:12:40.900306 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 18:12:40.900306 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 18:12:40.900306 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 18:12:40.900306 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 18:12:40.900306 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 18:12:40.900306 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 18:12:40.900306 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 18:12:40.900306 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 18:12:40.900306 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-da395a9b-a267-4032-b35d-bb713a99e758) Aug 10 18:12:40.900306 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:12:40.900306 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:12:40.900306 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:12:40.900306 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:12:40.900306 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:12:40.900306 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:12:40.900306 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 18:12:40.900306 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 18:12:40.900306 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 10 18:12:40.900306 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 10 18:12:40.900306 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:12:40.900306 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:12:40.900306 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:12:40.900306 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:12:40.900306 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:12:40.900306 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:12:40.900306 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:12:40.900306 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:12:40.900306 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 18:12:40.900306 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 18:12:40.900306 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:12:40.900306 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:12:40.900306 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:12:40.900306 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-c393d688-237e-4fab-8abd-0820f7eefcf6 tempest-TestNetworkAdvancedServerOps-1711933537 tempest-TestNetworkAdvancedServerOps-1711933537-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:12:40.900306 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 18:12:40.900306 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-c393d688-237e-4fab-8abd-0820f7eefcf6 tempest-TestNetworkAdvancedServerOps-1711933537 tempest-TestNetworkAdvancedServerOps-1711933537-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.926602 Aug 10 18:12:40.900306 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1057/2089] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 18:12:39 2022] POST /compute/v2.1/servers => generated 214 bytes in 928 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 10 18:12:49.412757 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_cell0:SELECT=4 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 18:12:49.414105 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 18:12:49.426635 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-c902d9ba-0b95-46a3-8f47-4d312dbddc77 tempest-TestNetworkAdvancedServerOps-1711933537 tempest-TestNetworkAdvancedServerOps-1711933537-project] Calling method '.version_select at 0x7fb346562a60>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:12:49.633098 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-c902d9ba-0b95-46a3-8f47-4d312dbddc77 tempest-TestNetworkAdvancedServerOps-1711933537 tempest-TestNetworkAdvancedServerOps-1711933537-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-677930761" status: 202 len: 0 microversion: 2.1 time: 0.222848 Aug 10 18:12:49.634429 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 1033/2090] 10.222.0.50 () {58 vars in 1281 bytes} [Wed Aug 10 18:12:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-677930761 => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 18:12:49.650025 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-1aa077f1-28eb-4e66-b333-1cb335eec8c3 tempest-TestNetworkAdvancedServerOps-1711933537 tempest-TestNetworkAdvancedServerOps-1711933537-project] Action: 'create', calling method: .version_select at 0x7fb345ebe5e0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-837898589", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIc7ktZG13TOPnpdZtVjTIj34fK7EDebxkPxYYtLzI6Dmj8z9pDPQok5kP0576zS6mJIAtX97EobKC4G2eo92TqhHfsAKgNNFUJkNUN2+YkOAQws8KMXk8S78lTHI6i/YA=="}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 18:12:49.668806 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-1aa077f1-28eb-4e66-b333-1cb335eec8c3 tempest-TestNetworkAdvancedServerOps-1711933537 tempest-TestNetworkAdvancedServerOps-1711933537-project] Getting quotas for project 0b0bb49e6c854cca93601d0aaf5a72bd. Resources: {'key_pairs'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 18:12:49.675359 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-1aa077f1-28eb-4e66-b333-1cb335eec8c3 tempest-TestNetworkAdvancedServerOps-1711933537 tempest-TestNetworkAdvancedServerOps-1711933537-project] Getting quotas for user a7cea04ea8854688aff3083e2e16fc23 and project 0b0bb49e6c854cca93601d0aaf5a72bd. Resources: {'key_pairs'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 18:12:49.800995 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-1aa077f1-28eb-4e66-b333-1cb335eec8c3 tempest-TestNetworkAdvancedServerOps-1711933537 tempest-TestNetworkAdvancedServerOps-1711933537-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.155372 Aug 10 18:12:49.802856 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1058/2091] 10.222.0.50 () {60 vars in 1159 bytes} [Wed Aug 10 18:12:49 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 18:13:10.931110 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-2098c35f-a81e-470f-bd54-8ac034854501 tempest-TestNetworkAdvancedServerOps-1711933537 tempest-TestNetworkAdvancedServerOps-1711933537-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1771506375", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "329489a9-ce21-4815-a0f0-32968b2a5ce4"}], "key_name": "tempest-TestNetworkAdvancedServerOps-837898589", "security_groups": [{"name": "tempest-secgroup-smoke-923430129"}]}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 18:13:11.191253 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.network.neutron [None req-2098c35f-a81e-470f-bd54-8ac034854501 tempest-TestNetworkAdvancedServerOps-1711933537 tempest-TestNetworkAdvancedServerOps-1711933537-project] validate_networks() for [('329489a9-ce21-4815-a0f0-32968b2a5ce4', None, None, None, None, None)] {{(pid=129410) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 18:13:11.625065 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [None req-2098c35f-a81e-470f-bd54-8ac034854501 tempest-TestNetworkAdvancedServerOps-1711933537 tempest-TestNetworkAdvancedServerOps-1711933537-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-0b11304f-2559-41c6-8f22-219b50e0dd5d) Aug 10 18:13:11.625065 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:13:11.625065 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:13:11.625065 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:13:11.625065 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:13:11.625065 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:13:11.625065 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:13:11.625065 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:13:11.625065 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:13:11.625065 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:13:11.625065 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 18:13:11.625065 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 18:13:11.625065 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 18:13:11.625065 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 18:13:11.625065 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 18:13:11.625065 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 18:13:11.625065 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 18:13:11.625065 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 18:13:11.625065 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 18:13:11.625065 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 18:13:11.625065 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 18:13:11.625065 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 18:13:11.625065 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 18:13:11.625065 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 18:13:11.625065 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 18:13:11.625065 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 18:13:11.625065 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 18:13:11.625065 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:13:11.625065 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:13:11.625065 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 18:13:11.625065 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 18:13:11.625065 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:13:11.625065 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:13:11.625065 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 18:13:11.625065 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 18:13:11.625065 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:13:11.625065 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:13:11.625065 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:13:11.625065 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:13:11.625065 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:13:11.625065 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:13:11.625065 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 18:13:11.625065 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 18:13:11.625065 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 18:13:11.625065 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 18:13:11.625065 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 18:13:11.625065 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 18:13:11.625065 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 18:13:11.625065 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 18:13:11.625065 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 18:13:11.625065 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 18:13:11.625065 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 18:13:11.629495 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 18:13:11.629495 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 18:13:11.629495 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 18:13:11.629495 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 18:13:11.629495 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 18:13:11.629495 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 18:13:11.629495 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 18:13:11.629495 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 18:13:11.629495 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 18:13:11.629495 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 18:13:11.629495 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 18:13:11.629495 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 18:13:11.629495 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 18:13:11.629495 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 18:13:11.629495 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 18:13:11.629495 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-0b11304f-2559-41c6-8f22-219b50e0dd5d) Aug 10 18:13:11.629495 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:13:11.629495 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-2098c35f-a81e-470f-bd54-8ac034854501 tempest-TestNetworkAdvancedServerOps-1711933537 tempest-TestNetworkAdvancedServerOps-1711933537-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:13:11.629495 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 18:13:11.629495 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-2098c35f-a81e-470f-bd54-8ac034854501 tempest-TestNetworkAdvancedServerOps-1711933537 tempest-TestNetworkAdvancedServerOps-1711933537-project] Request method failure captured: Aug 10 18:13:11.629495 n-d-852296-2 devstack@n-api.service[129410]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 18:13:11.629495 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 18:13:11.629495 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 18:13:11.629495 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 18:13:11.629495 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 343 Aug 10 18:13:11.629495 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 18:13:11.629495 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 18:13:11.629495 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 18:13:11.629495 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 18:13:11.629495 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8_TJHZMmsZI5mwQHzHMdMvFHDzbHLSVzuLUOZgGAc0ZvIiaaNaIq-mrKiFqIexLzkUI0ib9FtCUGgTKkZdR14FvSWS4_pRV9UfYTpzZO0sxu4Q13aoKIhuMhRxHg30qZmCV1-2RiEkAwWA6zjBqLBoXQQZD7su7Z2aSFp-IaQLsMOfc Aug 10 18:13:11.629495 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 18:13:11.629495 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 18:13:11.629495 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 18:13:11.629495 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 18:13:11.629495 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 18:13:11.629495 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 18:13:11.629495 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: 0b0bb49e6c854cca93601d0aaf5a72bd Aug 10 18:13:11.629495 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1711933537 Aug 10 18:13:11.629495 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 18:13:11.629495 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 18:13:11.629495 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0b0bb49e6c854cca93601d0aaf5a72bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/0b0bb49e6c854cca93601d0aaf5a72bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0b0bb49e6c854cca93601d0aaf5a72bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_0b0bb49e6c854cca93601d0aaf5a72bd", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 18:13:11.629495 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1711933537 Aug 10 18:13:11.629495 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: 0b0bb49e6c854cca93601d0aaf5a72bd Aug 10 18:13:11.629495 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1711933537 Aug 10 18:13:11.629495 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-TestNetworkAdvancedServerOps-1711933537-project Aug 10 18:13:11.629495 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 18:13:11.629495 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 18:13:11.629495 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: a7cea04ea8854688aff3083e2e16fc23 Aug 10 18:13:11.629495 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1711933537-project Aug 10 18:13:11.629495 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 18:13:11.629495 n-d-852296-2 devstack@n-api.service[129410]: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1771506375", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "329489a9-ce21-4815-a0f0-32968b2a5ce4"}], "key_name": "tempest-TestNetworkAdvancedServerOps-837898589", "security_groups": [{"name": "tempest-secgroup-smoke-923430129"}]}} Aug 10 18:13:11.629495 n-d-852296-2 devstack@n-api.service[129410]: method: > Aug 10 18:13:11.629495 n-d-852296-2 devstack@n-api.service[129410]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:13:11.629495 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 18:13:11.639443 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'body': {'server': {'name': 'tempest-TestNetworkAdvancedServerOps-server-1771506375', 'imageRef': 'a735ff26-463a-4ffe-a981-ab9d9baa494f', 'flavorRef': '452', 'networks': [{'uuid': '329489a9-ce21-4815-a0f0-32968b2a5ce4'}], 'key_name': 'tempest-TestNetworkAdvancedServerOps-837898589', 'security_groups': [{'name': 'tempest-secgroup-smoke-923430129'}]}}} Aug 10 18:13:11.639443 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 18:13:11.639443 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:13:11.639443 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:13:11.639443 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:13:11.639443 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:13:11.639443 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:13:11.639443 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:13:11.639443 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:13:11.639443 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:13:11.639443 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:13:11.639443 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 18:13:11.639443 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 18:13:11.639443 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 18:13:11.639443 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 18:13:11.639443 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 18:13:11.639443 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 18:13:11.639443 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 18:13:11.639443 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 18:13:11.639443 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 18:13:11.639443 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 18:13:11.639443 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 18:13:11.639443 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 18:13:11.639443 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 18:13:11.639443 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 18:13:11.639443 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 18:13:11.639443 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 18:13:11.639443 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 18:13:11.639443 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:13:11.639443 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:13:11.639443 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 18:13:11.639443 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 18:13:11.639443 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:13:11.639443 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:13:11.639443 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 18:13:11.639443 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 18:13:11.639443 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:13:11.639443 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:13:11.639443 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:13:11.639443 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:13:11.639443 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:13:11.639443 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:13:11.639443 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 18:13:11.639443 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 18:13:11.639443 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 18:13:11.639443 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 18:13:11.639443 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 18:13:11.639443 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 18:13:11.639443 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 18:13:11.639443 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 18:13:11.639443 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 18:13:11.639443 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 18:13:11.639443 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 18:13:11.639443 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 18:13:11.643801 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 18:13:11.643801 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 18:13:11.643801 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 18:13:11.643801 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 18:13:11.643801 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 18:13:11.643801 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 18:13:11.643801 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 18:13:11.643801 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 18:13:11.643801 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 18:13:11.643801 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 18:13:11.643801 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 18:13:11.643801 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 18:13:11.643801 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 18:13:11.643801 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 18:13:11.643801 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-0b11304f-2559-41c6-8f22-219b50e0dd5d) Aug 10 18:13:11.643801 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:13:11.643801 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:13:11.643801 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:13:11.643801 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:13:11.643801 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:13:11.643801 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:13:11.643801 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 18:13:11.643801 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 18:13:11.643801 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 10 18:13:11.643801 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 10 18:13:11.643801 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:13:11.643801 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:13:11.643801 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:13:11.643801 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:13:11.643801 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:13:11.643801 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:13:11.643801 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:13:11.643801 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:13:11.643801 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 18:13:11.643801 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 18:13:11.643801 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:13:11.643801 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:13:11.643801 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:13:11.643801 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-2098c35f-a81e-470f-bd54-8ac034854501 tempest-TestNetworkAdvancedServerOps-1711933537 tempest-TestNetworkAdvancedServerOps-1711933537-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:13:11.643801 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 18:13:11.643801 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-2098c35f-a81e-470f-bd54-8ac034854501 tempest-TestNetworkAdvancedServerOps-1711933537 tempest-TestNetworkAdvancedServerOps-1711933537-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.714927 Aug 10 18:13:11.643801 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 1034/2092] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 18:13:10 2022] POST /compute/v2.1/servers => generated 214 bytes in 716 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 10 18:13:19.911068 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_cell0:SELECT=4 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 18:13:19.915717 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 18:13:19.916341 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-a77f89db-5899-4091-9e34-d96989c01d3e tempest-TestNetworkAdvancedServerOps-1711933537 tempest-TestNetworkAdvancedServerOps-1711933537-project] Calling method '.version_select at 0x7fb345ebec10>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:13:20.039417 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-a77f89db-5899-4091-9e34-d96989c01d3e tempest-TestNetworkAdvancedServerOps-1711933537 tempest-TestNetworkAdvancedServerOps-1711933537-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-837898589" status: 202 len: 0 microversion: 2.1 time: 0.128990 Aug 10 18:13:20.039993 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1059/2093] 10.222.0.50 () {58 vars in 1281 bytes} [Wed Aug 10 18:13:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-837898589 => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 18:13:25.267332 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-3c67bf2a-4bec-4878-bed8-e3ae3f98cb5e tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:13:25.268524 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-3c67bf2a-4bec-4878-bed8-e3ae3f98cb5e tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] [instance: 87b2af3e-cb72-4986-a6f2-8c22ba3632cc] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:13:25.286830 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-3c67bf2a-4bec-4878-bed8-e3ae3f98cb5e tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:13:25.287732 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-3c67bf2a-4bec-4878-bed8-e3ae3f98cb5e tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:13:25.292705 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-3c67bf2a-4bec-4878-bed8-e3ae3f98cb5e tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:13:25.294304 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-3c67bf2a-4bec-4878-bed8-e3ae3f98cb5e tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:13:25.294884 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-3c67bf2a-4bec-4878-bed8-e3ae3f98cb5e tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:13:25.295495 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-3c67bf2a-4bec-4878-bed8-e3ae3f98cb5e tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:13:25.469161 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.objects.instance [None req-3c67bf2a-4bec-4878-bed8-e3ae3f98cb5e tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Lazy-loading 'services' on Instance uuid 87b2af3e-cb72-4986-a6f2-8c22ba3632cc {{(pid=129410) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 18:13:25.936775 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-3c67bf2a-4bec-4878-bed8-e3ae3f98cb5e tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] 10.222.0.50 "DELETE /compute/v2.1/servers/87b2af3e-cb72-4986-a6f2-8c22ba3632cc/os-volume_attachments/4f744ed4-fd8a-4714-82b9-c24b316816b6" status: 202 len: 0 microversion: 2.1 time: 0.673434 Aug 10 18:13:25.937660 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 1035/2094] 10.222.0.50 () {58 vars in 1416 bytes} [Wed Aug 10 18:13:25 2022] DELETE /compute/v2.1/servers/87b2af3e-cb72-4986-a6f2-8c22ba3632cc/os-volume_attachments/4f744ed4-fd8a-4714-82b9-c24b316816b6 => generated 0 bytes in 675 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 18:13:37.115431 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-2b19b731-27a7-4a01-9b36-a8227f695bc5 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:13:37.115975 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-2b19b731-27a7-4a01-9b36-a8227f695bc5 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] [instance: 87b2af3e-cb72-4986-a6f2-8c22ba3632cc] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:13:37.123589 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-2b19b731-27a7-4a01-9b36-a8227f695bc5 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:13:37.124168 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-2b19b731-27a7-4a01-9b36-a8227f695bc5 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:13:37.124751 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-2b19b731-27a7-4a01-9b36-a8227f695bc5 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:13:37.125514 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-2b19b731-27a7-4a01-9b36-a8227f695bc5 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:13:37.126040 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-2b19b731-27a7-4a01-9b36-a8227f695bc5 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:13:37.126565 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-2b19b731-27a7-4a01-9b36-a8227f695bc5 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:13:37.154810 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-2b19b731-27a7-4a01-9b36-a8227f695bc5 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] [instance: 87b2af3e-cb72-4986-a6f2-8c22ba3632cc] Going to try to terminate instance {{(pid=129409) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 18:13:37.863573 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-2b19b731-27a7-4a01-9b36-a8227f695bc5 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] 10.222.0.50 "DELETE /compute/v2.1/servers/87b2af3e-cb72-4986-a6f2-8c22ba3632cc" status: 204 len: 0 microversion: 2.1 time: 0.751782 Aug 10 18:13:37.864734 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1060/2095] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 10 18:13:37 2022] DELETE /compute/v2.1/servers/87b2af3e-cb72-4986-a6f2-8c22ba3632cc => generated 0 bytes in 755 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 18:13:37.875230 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-5b5385a1-2d15-40fc-86cc-426457fab6cf tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:13:37.877444 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-5b5385a1-2d15-40fc-86cc-426457fab6cf tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] [instance: 87b2af3e-cb72-4986-a6f2-8c22ba3632cc] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:13:37.882029 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 18:13:37.903750 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-5b5385a1-2d15-40fc-86cc-426457fab6cf tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:13:37.904183 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-5b5385a1-2d15-40fc-86cc-426457fab6cf tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:13:37.904790 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-5b5385a1-2d15-40fc-86cc-426457fab6cf tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:13:37.905530 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-5b5385a1-2d15-40fc-86cc-426457fab6cf tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:13:37.905985 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-5b5385a1-2d15-40fc-86cc-426457fab6cf tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:13:37.906410 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-5b5385a1-2d15-40fc-86cc-426457fab6cf tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:13:38.659902 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-5b5385a1-2d15-40fc-86cc-426457fab6cf tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5292bc31784241c3abc2e2a1828ec3ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e98cd08ee22b4f0186fe5c62d611353d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:13:38.679754 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-5b5385a1-2d15-40fc-86cc-426457fab6cf tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] 10.222.0.50 "GET /compute/v2.1/servers/87b2af3e-cb72-4986-a6f2-8c22ba3632cc" status: 200 len: 1467 microversion: 2.1 time: 0.810205 Aug 10 18:13:38.689548 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 1036/2096] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 18:13:37 2022] GET /compute/v2.1/servers/87b2af3e-cb72-4986-a6f2-8c22ba3632cc => generated 1467 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 18:13:39.704210 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-e3081554-f5db-4294-a91a-a2b9cfa7c0dd tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:13:39.705170 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-e3081554-f5db-4294-a91a-a2b9cfa7c0dd tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] [instance: 87b2af3e-cb72-4986-a6f2-8c22ba3632cc] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:13:39.714677 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e3081554-f5db-4294-a91a-a2b9cfa7c0dd tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:13:39.715636 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e3081554-f5db-4294-a91a-a2b9cfa7c0dd tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:13:39.720848 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e3081554-f5db-4294-a91a-a2b9cfa7c0dd tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:13:39.721856 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e3081554-f5db-4294-a91a-a2b9cfa7c0dd tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:13:39.724230 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e3081554-f5db-4294-a91a-a2b9cfa7c0dd tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:13:39.724873 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-e3081554-f5db-4294-a91a-a2b9cfa7c0dd tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:13:40.070750 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-e3081554-f5db-4294-a91a-a2b9cfa7c0dd tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5292bc31784241c3abc2e2a1828ec3ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e98cd08ee22b4f0186fe5c62d611353d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:13:40.081198 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-e3081554-f5db-4294-a91a-a2b9cfa7c0dd tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] 10.222.0.50 "GET /compute/v2.1/servers/87b2af3e-cb72-4986-a6f2-8c22ba3632cc" status: 200 len: 1467 microversion: 2.1 time: 0.384542 Aug 10 18:13:40.081989 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1061/2097] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 18:13:39 2022] GET /compute/v2.1/servers/87b2af3e-cb72-4986-a6f2-8c22ba3632cc => generated 1467 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 18:13:40.831333 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [req-819c4b14-7fef-4349-ba5f-aacc2c209b9f req-49b1a5aa-ffdb-4c91-9be9-faa039d2e381 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87b2af3e-cb72-4986-a6f2-8c22ba3632cc", "name": "network-vif-deleted", "tag": "745603b4-8173-4c83-8985-0742526bd438"}]} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 18:13:40.843403 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-819c4b14-7fef-4349-ba5f-aacc2c209b9f req-49b1a5aa-ffdb-4c91-9be9-faa039d2e381 service nova] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:13:40.844119 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-819c4b14-7fef-4349-ba5f-aacc2c209b9f req-49b1a5aa-ffdb-4c91-9be9-faa039d2e381 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:13:40.844902 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-819c4b14-7fef-4349-ba5f-aacc2c209b9f req-49b1a5aa-ffdb-4c91-9be9-faa039d2e381 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:13:40.865552 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.compute.server_external_events [req-819c4b14-7fef-4349-ba5f-aacc2c209b9f req-49b1a5aa-ffdb-4c91-9be9-faa039d2e381 service nova] Creating event network-vif-deleted:745603b4-8173-4c83-8985-0742526bd438 for instance 87b2af3e-cb72-4986-a6f2-8c22ba3632cc on n-h1-852296-2 Aug 10 18:13:40.870991 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [req-819c4b14-7fef-4349-ba5f-aacc2c209b9f req-49b1a5aa-ffdb-4c91-9be9-faa039d2e381 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043855 Aug 10 18:13:40.872082 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 1037/2098] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 10 18:13:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 18:13:41.103726 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-d2cd3295-4cd7-4d0f-a728-05ad6f171d64 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:13:41.105119 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-d2cd3295-4cd7-4d0f-a728-05ad6f171d64 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] [instance: 87b2af3e-cb72-4986-a6f2-8c22ba3632cc] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:13:41.115429 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-d2cd3295-4cd7-4d0f-a728-05ad6f171d64 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:13:41.126083 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-d2cd3295-4cd7-4d0f-a728-05ad6f171d64 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:13:41.127013 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-d2cd3295-4cd7-4d0f-a728-05ad6f171d64 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:13:41.130626 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-d2cd3295-4cd7-4d0f-a728-05ad6f171d64 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:13:41.130626 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-d2cd3295-4cd7-4d0f-a728-05ad6f171d64 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:13:41.130626 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-d2cd3295-4cd7-4d0f-a728-05ad6f171d64 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:13:41.411088 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-d2cd3295-4cd7-4d0f-a728-05ad6f171d64 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5292bc31784241c3abc2e2a1828ec3ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e98cd08ee22b4f0186fe5c62d611353d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:13:41.444159 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-d2cd3295-4cd7-4d0f-a728-05ad6f171d64 tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] 10.222.0.50 "GET /compute/v2.1/servers/87b2af3e-cb72-4986-a6f2-8c22ba3632cc" status: 200 len: 1297 microversion: 2.1 time: 0.344876 Aug 10 18:13:41.445023 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1062/2099] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 18:13:41 2022] GET /compute/v2.1/servers/87b2af3e-cb72-4986-a6f2-8c22ba3632cc => generated 1297 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 18:13:42.465999 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-33dbf905-6516-4009-b515-66beb558adfd tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:13:42.468283 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-33dbf905-6516-4009-b515-66beb558adfd tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] [instance: 87b2af3e-cb72-4986-a6f2-8c22ba3632cc] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:13:42.481690 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-33dbf905-6516-4009-b515-66beb558adfd tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:13:42.504639 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-33dbf905-6516-4009-b515-66beb558adfd tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:13:42.504639 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-33dbf905-6516-4009-b515-66beb558adfd tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:13:42.504639 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-33dbf905-6516-4009-b515-66beb558adfd tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:13:42.504639 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-33dbf905-6516-4009-b515-66beb558adfd tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:13:42.504639 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-33dbf905-6516-4009-b515-66beb558adfd tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:13:42.582575 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-33dbf905-6516-4009-b515-66beb558adfd tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:13:42.583080 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-33dbf905-6516-4009-b515-66beb558adfd tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:13:42.587965 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-33dbf905-6516-4009-b515-66beb558adfd tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:13:42.588532 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.objects.instance [None req-33dbf905-6516-4009-b515-66beb558adfd tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Lazy-loading 'fault' on Instance uuid 87b2af3e-cb72-4986-a6f2-8c22ba3632cc {{(pid=129410) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 18:13:42.716135 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-33dbf905-6516-4009-b515-66beb558adfd tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5292bc31784241c3abc2e2a1828ec3ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e98cd08ee22b4f0186fe5c62d611353d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:13:42.724804 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-33dbf905-6516-4009-b515-66beb558adfd tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] 10.222.0.50 "GET /compute/v2.1/servers/87b2af3e-cb72-4986-a6f2-8c22ba3632cc" status: 200 len: 1302 microversion: 2.1 time: 0.263358 Aug 10 18:13:42.741880 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 1038/2100] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 18:13:42 2022] GET /compute/v2.1/servers/87b2af3e-cb72-4986-a6f2-8c22ba3632cc => generated 1302 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 18:13:43.781064 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-66888c06-b47f-48a9-b8ba-a087bc87faaa tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:13:43.783980 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-66888c06-b47f-48a9-b8ba-a087bc87faaa tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] [instance: 87b2af3e-cb72-4986-a6f2-8c22ba3632cc] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:13:43.795745 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-66888c06-b47f-48a9-b8ba-a087bc87faaa tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:13:43.796541 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-66888c06-b47f-48a9-b8ba-a087bc87faaa tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:13:43.797193 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-66888c06-b47f-48a9-b8ba-a087bc87faaa tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:13:43.798224 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-66888c06-b47f-48a9-b8ba-a087bc87faaa tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:13:43.799027 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-66888c06-b47f-48a9-b8ba-a087bc87faaa tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:13:43.801600 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-66888c06-b47f-48a9-b8ba-a087bc87faaa tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:13:43.839481 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-66888c06-b47f-48a9-b8ba-a087bc87faaa tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] HTTP exception thrown: Instance 87b2af3e-cb72-4986-a6f2-8c22ba3632cc could not be found. Aug 10 18:13:43.841519 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-66888c06-b47f-48a9-b8ba-a087bc87faaa tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Request method failure captured: Aug 10 18:13:43.841519 n-d-852296-2 devstack@n-api.service[129409]: request: GET /compute/v2.1/servers/87b2af3e-cb72-4986-a6f2-8c22ba3632cc HTTP/1.1 Aug 10 18:13:43.841519 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 18:13:43.841519 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 18:13:43.841519 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 18:13:43.841519 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 0 Aug 10 18:13:43.841519 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 18:13:43.841519 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 18:13:43.841519 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 18:13:43.841519 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 18:13:43.841519 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8_RlUYIW5KFdMX_dZ1dpUhNomY0vobnSnU6EmdI9K_Keliow9tDVcjtlLIf14_ggpPZ76hSYCM_TNVmUqCIn7lMzt3FjWpkzfuLpdCzKZpQO--sPnJN5x-WpBvRhWsV1QPil4kzaUxZfARlWMR6TEr7s4Mol2TR6YQUB-OcpA1qococ Aug 10 18:13:43.841519 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 18:13:43.841519 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 18:13:43.841519 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 18:13:43.841519 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 18:13:43.841519 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 18:13:43.841519 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 18:13:43.841519 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: e98cd08ee22b4f0186fe5c62d611353d Aug 10 18:13:43.841519 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-VolumesBackupsTest-1751328319 Aug 10 18:13:43.841519 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 18:13:43.841519 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 18:13:43.841519 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e98cd08ee22b4f0186fe5c62d611353d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/e98cd08ee22b4f0186fe5c62d611353d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e98cd08ee22b4f0186fe5c62d611353d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_e98cd08ee22b4f0186fe5c62d611353d", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 18:13:43.841519 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-VolumesBackupsTest-1751328319 Aug 10 18:13:43.841519 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: e98cd08ee22b4f0186fe5c62d611353d Aug 10 18:13:43.841519 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-VolumesBackupsTest-1751328319 Aug 10 18:13:43.841519 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-VolumesBackupsTest-1751328319-project Aug 10 18:13:43.841519 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 18:13:43.841519 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 18:13:43.841519 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: 5292bc31784241c3abc2e2a1828ec3ca Aug 10 18:13:43.841519 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-VolumesBackupsTest-1751328319-project Aug 10 18:13:43.841519 n-d-852296-2 devstack@n-api.service[129409]: method: > Aug 10 18:13:43.841519 n-d-852296-2 devstack@n-api.service[129409]: exception: Instance 87b2af3e-cb72-4986-a6f2-8c22ba3632cc could not be found. Aug 10 18:13:43.841519 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'id': '87b2af3e-cb72-4986-a6f2-8c22ba3632cc'} Aug 10 18:13:43.841519 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 18:13:43.841519 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:13:43.841519 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 18:13:43.841519 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 18:13:43.841519 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 18:13:43.841519 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 18:13:43.841519 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 18:13:43.841519 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 18:13:43.841519 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 18:13:43.841519 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 18:13:43.841519 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87b2af3e-cb72-4986-a6f2-8c22ba3632cc could not be found. Aug 10 18:13:43.841519 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:13:43.841519 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:13:43.841519 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:13:43.841519 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:13:43.841519 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:13:43.841519 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:13:43.841519 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 18:13:43.841519 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 18:13:43.841519 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:13:43.841519 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:13:43.841519 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 18:13:43.841519 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 18:13:43.841519 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 18:13:43.841519 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 18:13:43.841519 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 18:13:43.841519 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 18:13:43.841519 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87b2af3e-cb72-4986-a6f2-8c22ba3632cc could not be found. Aug 10 18:13:43.841519 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:13:43.841519 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:13:43.841519 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:13:43.844868 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:13:43.844868 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:13:43.844868 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:13:43.844868 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 18:13:43.844868 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 18:13:43.844868 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87b2af3e-cb72-4986-a6f2-8c22ba3632cc could not be found. Aug 10 18:13:43.844868 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:13:43.846982 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-66888c06-b47f-48a9-b8ba-a087bc87faaa tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] Returning 404 to user: Instance 87b2af3e-cb72-4986-a6f2-8c22ba3632cc could not be found. {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 18:13:43.848094 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-66888c06-b47f-48a9-b8ba-a087bc87faaa tempest-VolumesBackupsTest-1751328319 tempest-VolumesBackupsTest-1751328319-project] 10.222.0.50 "GET /compute/v2.1/servers/87b2af3e-cb72-4986-a6f2-8c22ba3632cc" status: 404 len: 111 microversion: 2.1 time: 0.083177 Aug 10 18:13:43.849592 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1063/2101] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 18:13:43 2022] GET /compute/v2.1/servers/87b2af3e-cb72-4986-a6f2-8c22ba3632cc => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 18:13:45.933284 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-a3343f3a-d951-4463-9e35-0ed730f13b8d tempest-VolumesSnapshotTestJSON-1516371753 tempest-VolumesSnapshotTestJSON-1516371753-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1602960619", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "19c5089f-72aa-4065-9c7d-7f4d88c1967d"}]}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 18:13:46.039592 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.network.neutron [None req-a3343f3a-d951-4463-9e35-0ed730f13b8d tempest-VolumesSnapshotTestJSON-1516371753 tempest-VolumesSnapshotTestJSON-1516371753-project] validate_networks() for [('19c5089f-72aa-4065-9c7d-7f4d88c1967d', None, None, None, None, None)] {{(pid=129410) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 18:13:46.711537 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [None req-a3343f3a-d951-4463-9e35-0ed730f13b8d tempest-VolumesSnapshotTestJSON-1516371753 tempest-VolumesSnapshotTestJSON-1516371753-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-9c4db8d0-c055-41f9-8232-a0962504897f) Aug 10 18:13:46.711537 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:13:46.711537 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:13:46.711537 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:13:46.711537 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:13:46.711537 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:13:46.711537 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:13:46.711537 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:13:46.711537 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:13:46.711537 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:13:46.711537 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 18:13:46.711537 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 18:13:46.711537 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 18:13:46.711537 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 18:13:46.711537 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 18:13:46.711537 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 18:13:46.711537 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 18:13:46.711537 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 18:13:46.711537 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 18:13:46.711537 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 18:13:46.711537 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 18:13:46.711537 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 18:13:46.711537 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 18:13:46.711537 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 18:13:46.711537 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 18:13:46.711537 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 18:13:46.711537 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 18:13:46.711537 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:13:46.711537 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:13:46.711537 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 18:13:46.711537 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 18:13:46.711537 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:13:46.711537 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:13:46.711537 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 18:13:46.711537 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 18:13:46.711537 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:13:46.711537 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:13:46.711537 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:13:46.711537 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:13:46.711537 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:13:46.711537 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:13:46.711537 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 18:13:46.711537 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 18:13:46.711537 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 18:13:46.711537 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 18:13:46.711537 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 18:13:46.711537 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 18:13:46.711537 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 18:13:46.711537 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 18:13:46.711537 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 18:13:46.711537 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 18:13:46.711537 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 18:13:46.714910 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 18:13:46.714910 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 18:13:46.714910 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 18:13:46.714910 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 18:13:46.714910 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 18:13:46.714910 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 18:13:46.714910 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 18:13:46.714910 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 18:13:46.714910 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 18:13:46.714910 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 18:13:46.714910 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 18:13:46.714910 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 18:13:46.714910 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 18:13:46.714910 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 18:13:46.714910 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 18:13:46.714910 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-9c4db8d0-c055-41f9-8232-a0962504897f) Aug 10 18:13:46.714910 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:13:46.714910 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-a3343f3a-d951-4463-9e35-0ed730f13b8d tempest-VolumesSnapshotTestJSON-1516371753 tempest-VolumesSnapshotTestJSON-1516371753-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:13:46.714910 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 18:13:46.714910 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-a3343f3a-d951-4463-9e35-0ed730f13b8d tempest-VolumesSnapshotTestJSON-1516371753 tempest-VolumesSnapshotTestJSON-1516371753-project] Request method failure captured: Aug 10 18:13:46.714910 n-d-852296-2 devstack@n-api.service[129410]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 18:13:46.714910 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 18:13:46.714910 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 18:13:46.714910 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 18:13:46.714910 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 211 Aug 10 18:13:46.714910 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 18:13:46.714910 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 18:13:46.714910 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 18:13:46.714910 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 18:13:46.714910 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8_SwmhwVCMd1THjpCf3RJyL7tgyj6YBGPkv-gK5JnqtuUcLI0QpCx6W-QJ53yJKWDK1W2DVef3lc8QV0bjG5tn0J3lQRpokR9CQQFKCNxrjDja4lIaX-Wn1frQAUkpGIu1kegs3I3uR1TV1YD44zGY2zxuZ4t8n6PjHYRfKvUoSBQsc Aug 10 18:13:46.714910 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 18:13:46.714910 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 18:13:46.714910 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 18:13:46.714910 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 18:13:46.714910 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 18:13:46.714910 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 18:13:46.714910 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: 16fe972d5ea2467b8b21230df70bb5d1 Aug 10 18:13:46.714910 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1516371753 Aug 10 18:13:46.714910 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 18:13:46.714910 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 18:13:46.714910 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/16fe972d5ea2467b8b21230df70bb5d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/16fe972d5ea2467b8b21230df70bb5d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/16fe972d5ea2467b8b21230df70bb5d1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_16fe972d5ea2467b8b21230df70bb5d1", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 18:13:46.714910 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-VolumesSnapshotTestJSON-1516371753 Aug 10 18:13:46.714910 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: 16fe972d5ea2467b8b21230df70bb5d1 Aug 10 18:13:46.714910 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1516371753 Aug 10 18:13:46.714910 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-VolumesSnapshotTestJSON-1516371753-project Aug 10 18:13:46.714910 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 18:13:46.714910 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 18:13:46.714910 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: 3474cb390bb243079512ab06ae02f0fa Aug 10 18:13:46.714910 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-VolumesSnapshotTestJSON-1516371753-project Aug 10 18:13:46.714910 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 18:13:46.714910 n-d-852296-2 devstack@n-api.service[129410]: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1602960619", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "19c5089f-72aa-4065-9c7d-7f4d88c1967d"}]}} Aug 10 18:13:46.714910 n-d-852296-2 devstack@n-api.service[129410]: method: > Aug 10 18:13:46.714910 n-d-852296-2 devstack@n-api.service[129410]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:13:46.714910 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 18:13:46.714910 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'body': {'server': {'name': 'tempest-VolumesSnapshotTestJSON-instance-1602960619', 'imageRef': 'a735ff26-463a-4ffe-a981-ab9d9baa494f', 'flavorRef': '452', 'networks': [{'uuid': '19c5089f-72aa-4065-9c7d-7f4d88c1967d'}]}}} Aug 10 18:13:46.721524 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 18:13:46.721524 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:13:46.721524 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:13:46.721524 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:13:46.721524 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:13:46.721524 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:13:46.721524 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:13:46.721524 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:13:46.721524 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:13:46.721524 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:13:46.721524 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 18:13:46.721524 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 18:13:46.721524 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 18:13:46.721524 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 18:13:46.721524 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 18:13:46.721524 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 18:13:46.721524 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 18:13:46.721524 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 18:13:46.721524 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 18:13:46.721524 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 18:13:46.721524 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 18:13:46.721524 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 18:13:46.721524 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 18:13:46.721524 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 18:13:46.721524 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 18:13:46.721524 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 18:13:46.721524 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 18:13:46.721524 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:13:46.721524 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:13:46.721524 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 18:13:46.721524 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 18:13:46.721524 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:13:46.721524 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:13:46.721524 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 18:13:46.721524 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 18:13:46.721524 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:13:46.721524 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:13:46.721524 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:13:46.721524 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:13:46.721524 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:13:46.721524 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:13:46.721524 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 18:13:46.721524 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 18:13:46.721524 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 18:13:46.721524 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 18:13:46.721524 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 18:13:46.721524 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 18:13:46.721524 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 18:13:46.721524 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 18:13:46.721524 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 18:13:46.721524 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 18:13:46.721524 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 18:13:46.721524 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 18:13:46.721524 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 18:13:46.721524 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 18:13:46.721524 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 18:13:46.738201 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 18:13:46.738201 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 18:13:46.738201 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 18:13:46.738201 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 18:13:46.738201 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 18:13:46.738201 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 18:13:46.738201 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 18:13:46.738201 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 18:13:46.738201 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 18:13:46.738201 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 18:13:46.738201 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 18:13:46.738201 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-9c4db8d0-c055-41f9-8232-a0962504897f) Aug 10 18:13:46.738201 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:13:46.738201 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:13:46.738201 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:13:46.738201 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:13:46.738201 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:13:46.738201 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:13:46.738201 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 18:13:46.738201 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 18:13:46.738201 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 10 18:13:46.738201 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 10 18:13:46.738201 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:13:46.738201 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:13:46.738201 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:13:46.738201 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:13:46.738201 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:13:46.738201 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:13:46.738201 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:13:46.738201 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:13:46.738201 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 18:13:46.738201 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 18:13:46.738201 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:13:46.738201 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:13:46.738201 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:13:46.738201 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-a3343f3a-d951-4463-9e35-0ed730f13b8d tempest-VolumesSnapshotTestJSON-1516371753 tempest-VolumesSnapshotTestJSON-1516371753-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:13:46.738201 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 18:13:46.738201 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-a3343f3a-d951-4463-9e35-0ed730f13b8d tempest-VolumesSnapshotTestJSON-1516371753 tempest-VolumesSnapshotTestJSON-1516371753-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.789081 Aug 10 18:13:46.738201 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 1039/2102] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 18:13:45 2022] POST /compute/v2.1/servers => generated 214 bytes in 804 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 10 18:13:49.909872 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-b80a7360-156f-42a1-89ec-9739f0f04b80 tempest-TestServerMultinode-354500374 tempest-TestServerMultinode-354500374-project-admin] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:13:49.911712 n-d-852296-2 devstack@n-api.service[129409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 18:13:49.911712 n-d-852296-2 devstack@n-api.service[129409]: warnings.warn(msg) Aug 10 18:13:49.911933 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-b80a7360-156f-42a1-89ec-9739f0f04b80 tempest-TestServerMultinode-354500374 tempest-TestServerMultinode-354500374-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:13:49.912620 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-b80a7360-156f-42a1-89ec-9739f0f04b80 tempest-TestServerMultinode-354500374 tempest-TestServerMultinode-354500374-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:13:49.913468 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-b80a7360-156f-42a1-89ec-9739f0f04b80 tempest-TestServerMultinode-354500374 tempest-TestServerMultinode-354500374-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:13:49.914938 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-b80a7360-156f-42a1-89ec-9739f0f04b80 tempest-TestServerMultinode-354500374 tempest-TestServerMultinode-354500374-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:13:49.921666 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-b80a7360-156f-42a1-89ec-9739f0f04b80 tempest-TestServerMultinode-354500374 tempest-TestServerMultinode-354500374-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:13:49.922295 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-b80a7360-156f-42a1-89ec-9739f0f04b80 tempest-TestServerMultinode-354500374 tempest-TestServerMultinode-354500374-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:13:50.001697 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-b80a7360-156f-42a1-89ec-9739f0f04b80 tempest-TestServerMultinode-354500374 tempest-TestServerMultinode-354500374-project-admin] 10.222.0.50 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.485108 Aug 10 18:13:50.034062 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1064/2103] 10.222.0.50 () {58 vars in 1185 bytes} [Wed Aug 10 18:13:49 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 18:13:50.176058 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-9bfd2a43-537c-4d4c-8d89-84f65def68b2 tempest-TestServerMultinode-354500374 tempest-TestServerMultinode-354500374-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-25023119", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "availability_zone": "nova:n-h1-852296-2", "networks": [{"uuid": "cd9b48d8-a63b-4ec2-b79c-7dfa760d24b1"}]}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 18:13:50.333225 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.network.neutron [None req-9bfd2a43-537c-4d4c-8d89-84f65def68b2 tempest-TestServerMultinode-354500374 tempest-TestServerMultinode-354500374-project-admin] validate_networks() for [('cd9b48d8-a63b-4ec2-b79c-7dfa760d24b1', None, None, None, None, None)] {{(pid=129410) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 18:13:51.459487 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [None req-9bfd2a43-537c-4d4c-8d89-84f65def68b2 tempest-TestServerMultinode-354500374 tempest-TestServerMultinode-354500374-project-admin] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-4c3d3e37-b6c1-41a5-b227-c5f900bee9f3) Aug 10 18:13:51.459487 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:13:51.459487 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:13:51.459487 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:13:51.459487 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:13:51.459487 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:13:51.459487 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:13:51.459487 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:13:51.459487 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:13:51.459487 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:13:51.459487 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 18:13:51.459487 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 18:13:51.459487 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 18:13:51.459487 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 18:13:51.459487 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 18:13:51.459487 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 18:13:51.459487 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 18:13:51.459487 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 18:13:51.459487 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 18:13:51.459487 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 18:13:51.459487 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 18:13:51.459487 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 18:13:51.459487 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 18:13:51.459487 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 18:13:51.459487 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 18:13:51.459487 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 18:13:51.459487 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 18:13:51.459487 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:13:51.459487 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:13:51.459487 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 18:13:51.459487 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 18:13:51.459487 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:13:51.459487 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:13:51.459487 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 18:13:51.459487 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 18:13:51.459487 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:13:51.459487 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:13:51.459487 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:13:51.459487 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:13:51.459487 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:13:51.459487 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:13:51.459487 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 18:13:51.459487 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 18:13:51.459487 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 18:13:51.459487 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 18:13:51.459487 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 18:13:51.459487 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 18:13:51.459487 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 18:13:51.459487 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 18:13:51.459487 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 18:13:51.459487 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 18:13:51.459487 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 18:13:51.459487 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 18:13:51.463511 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 18:13:51.463511 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 18:13:51.463511 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 18:13:51.463511 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 18:13:51.463511 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 18:13:51.463511 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 18:13:51.463511 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 18:13:51.463511 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 18:13:51.463511 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 18:13:51.463511 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 18:13:51.463511 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 18:13:51.463511 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 18:13:51.463511 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 18:13:51.463511 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 18:13:51.463511 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-4c3d3e37-b6c1-41a5-b227-c5f900bee9f3) Aug 10 18:13:51.463511 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:13:51.463511 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-9bfd2a43-537c-4d4c-8d89-84f65def68b2 tempest-TestServerMultinode-354500374 tempest-TestServerMultinode-354500374-project-admin] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:13:51.463511 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 18:13:51.463511 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-9bfd2a43-537c-4d4c-8d89-84f65def68b2 tempest-TestServerMultinode-354500374 tempest-TestServerMultinode-354500374-project-admin] Request method failure captured: Aug 10 18:13:51.463511 n-d-852296-2 devstack@n-api.service[129410]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 18:13:51.463511 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 18:13:51.463511 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 18:13:51.463511 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 18:13:51.463511 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 246 Aug 10 18:13:51.463511 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 18:13:51.463511 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 18:13:51.463511 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 18:13:51.463511 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 18:13:51.463511 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8_VdkbsB7DFlnqlZcw2hepyEMlc1QCTeBzVy_AKkiUnV5FH9ESkB1lNVCU6ehCNFwYLw1lg2ykFnEj1LdV6lmLM5jI25VyI2xpBusltDTi5Kdt3sJYukWRuYj6FlL76feOWu3aCRWlFvl-TpoqI_yT5ltO8S2xpe3q9isYKDnNHXycI Aug 10 18:13:51.463511 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 18:13:51.463511 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 18:13:51.463511 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 18:13:51.463511 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 18:13:51.463511 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 18:13:51.463511 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 18:13:51.463511 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: b8e46655e53c408c8005ec3e503c288d Aug 10 18:13:51.463511 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-TestServerMultinode-354500374 Aug 10 18:13:51.463511 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member,admin Aug 10 18:13:51.463511 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member,admin Aug 10 18:13:51.463511 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b8e46655e53c408c8005ec3e503c288d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/b8e46655e53c408c8005ec3e503c288d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b8e46655e53c408c8005ec3e503c288d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_b8e46655e53c408c8005ec3e503c288d", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 18:13:51.463511 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-TestServerMultinode-354500374 Aug 10 18:13:51.463511 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: b8e46655e53c408c8005ec3e503c288d Aug 10 18:13:51.463511 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-TestServerMultinode-354500374 Aug 10 18:13:51.463511 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-TestServerMultinode-354500374-project-admin Aug 10 18:13:51.463511 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 18:13:51.463511 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 18:13:51.463511 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: d471af4991454abdbc37d1ab4ec80628 Aug 10 18:13:51.463511 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-TestServerMultinode-354500374-project-admin Aug 10 18:13:51.463511 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 18:13:51.463511 n-d-852296-2 devstack@n-api.service[129410]: {"server": {"name": "tempest-TestServerMultinode-server-25023119", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "availability_zone": "nova:n-h1-852296-2", "networks": [{"uuid": "cd9b48d8-a63b-4ec2-b79c-7dfa760d24b1"}]}} Aug 10 18:13:51.463511 n-d-852296-2 devstack@n-api.service[129410]: method: > Aug 10 18:13:51.463511 n-d-852296-2 devstack@n-api.service[129410]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:13:51.463511 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 18:13:51.463511 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'body': {'server': {'name': 'tempest-TestServerMultinode-server-25023119', 'imageRef': 'a735ff26-463a-4ffe-a981-ab9d9baa494f', 'flavorRef': '452', 'networks': [{'uuid': 'cd9b48d8-a63b-4ec2-b79c-7dfa760d24b1'}]}}} Aug 10 18:13:51.463511 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 18:13:51.467405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:13:51.467405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:13:51.467405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:13:51.467405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:13:51.467405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:13:51.467405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:13:51.467405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:13:51.467405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:13:51.467405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:13:51.467405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 18:13:51.467405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 18:13:51.467405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 18:13:51.467405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 18:13:51.467405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 18:13:51.467405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 18:13:51.467405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 18:13:51.467405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 18:13:51.467405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 18:13:51.467405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 18:13:51.467405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 18:13:51.467405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 18:13:51.467405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 18:13:51.467405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 18:13:51.467405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 18:13:51.467405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 18:13:51.467405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 18:13:51.467405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:13:51.467405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:13:51.467405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 18:13:51.467405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 18:13:51.467405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:13:51.467405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:13:51.467405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 18:13:51.467405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 18:13:51.467405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:13:51.467405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:13:51.467405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:13:51.467405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:13:51.467405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:13:51.467405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:13:51.467405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 18:13:51.467405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 18:13:51.467405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 18:13:51.467405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 18:13:51.467405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 18:13:51.467405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 18:13:51.467405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 18:13:51.467405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 18:13:51.467405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 18:13:51.467405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 18:13:51.467405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 18:13:51.467405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 18:13:51.467405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 18:13:51.467405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 18:13:51.467405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 18:13:51.467405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 18:13:51.473026 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 18:13:51.473026 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 18:13:51.473026 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 18:13:51.473026 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 18:13:51.473026 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 18:13:51.473026 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 18:13:51.473026 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 18:13:51.473026 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 18:13:51.473026 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 18:13:51.473026 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 18:13:51.473026 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-4c3d3e37-b6c1-41a5-b227-c5f900bee9f3) Aug 10 18:13:51.473026 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:13:51.473026 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:13:51.473026 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:13:51.473026 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:13:51.473026 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:13:51.473026 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:13:51.473026 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 18:13:51.473026 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 18:13:51.473026 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 10 18:13:51.473026 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 10 18:13:51.473026 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:13:51.473026 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:13:51.473026 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:13:51.473026 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:13:51.473026 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:13:51.473026 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:13:51.473026 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:13:51.473026 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:13:51.473026 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 18:13:51.473026 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 18:13:51.473026 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:13:51.473026 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:13:51.473026 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:13:51.473026 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-9bfd2a43-537c-4d4c-8d89-84f65def68b2 tempest-TestServerMultinode-354500374 tempest-TestServerMultinode-354500374-project-admin] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:13:51.473026 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 18:13:51.473026 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-9bfd2a43-537c-4d4c-8d89-84f65def68b2 tempest-TestServerMultinode-354500374 tempest-TestServerMultinode-354500374-project-admin] 10.222.0.50 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.290395 Aug 10 18:13:51.473026 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 1040/2104] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 18:13:50 2022] POST /compute/v2.1/servers => generated 214 bytes in 1294 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 10 18:13:55.253189 n-d-852296-2 devstack@n-api.service[129410]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 18:13:55.254102 n-d-852296-2 devstack@n-api.service[129410]: Wed Aug 10 18:13:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 18:13:56.222177 n-d-852296-2 devstack@n-api.service[129409]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 18:13:56.222177 n-d-852296-2 devstack@n-api.service[129409]: Wed Aug 10 18:13:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 18:14:01.292269 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-4448df59-1471-4c3c-9d29-758b537a10ba tempest-TestNetworkBasicOps-740532818 tempest-TestNetworkBasicOps-740532818-project] Action: 'create', calling method: .version_select at 0x7fb345d9b160>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1159850951", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBODxs9BcPGzU2LwNr1lFNK+T8Lg8/MHLHar7T4BeDh9pXsULXfvTqaoNf7PT/gfSeEpmveltaVv8E6McKwVatXTNLzhiBHddS7yNEaL+2uqITzUTy22BcKDh+rgrF2zE1g=="}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 18:14:01.320356 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_cell0:SELECT=2 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 18:14:01.331696 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 18:14:01.335811 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_api:SELECT=20,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 18:14:01.363070 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-4448df59-1471-4c3c-9d29-758b537a10ba tempest-TestNetworkBasicOps-740532818 tempest-TestNetworkBasicOps-740532818-project] Getting quotas for project 1696e6ac46a44a5eb47eb2e91a852b88. Resources: {'key_pairs'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 18:14:01.406562 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-4448df59-1471-4c3c-9d29-758b537a10ba tempest-TestNetworkBasicOps-740532818 tempest-TestNetworkBasicOps-740532818-project] Getting quotas for user b00e6e3170564fad826409314067a8d5 and project 1696e6ac46a44a5eb47eb2e91a852b88. Resources: {'key_pairs'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 18:14:01.581209 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-4448df59-1471-4c3c-9d29-758b537a10ba tempest-TestNetworkBasicOps-740532818 tempest-TestNetworkBasicOps-740532818-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.293017 Aug 10 18:14:01.582062 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1065/2105] 10.222.0.50 () {60 vars in 1159 bytes} [Wed Aug 10 18:14:01 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 18:14:04.764534 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_cell1:SELECT=16 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 18:14:04.764534 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_api:SELECT=23,nova_api:DELETE=1 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 18:14:04.766752 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-c7d7110e-ac40-401b-9fff-7de5f104b080 tempest-VolumesSnapshotTestJSON-1516371753 tempest-VolumesSnapshotTestJSON-1516371753-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1729882045", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "19c5089f-72aa-4065-9c7d-7f4d88c1967d"}]}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 18:14:04.917059 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.network.neutron [None req-c7d7110e-ac40-401b-9fff-7de5f104b080 tempest-VolumesSnapshotTestJSON-1516371753 tempest-VolumesSnapshotTestJSON-1516371753-project] validate_networks() for [('19c5089f-72aa-4065-9c7d-7f4d88c1967d', None, None, None, None, None)] {{(pid=129410) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 18:14:05.378557 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [None req-c7d7110e-ac40-401b-9fff-7de5f104b080 tempest-VolumesSnapshotTestJSON-1516371753 tempest-VolumesSnapshotTestJSON-1516371753-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-98bf9886-2eec-48fa-98ec-f75bfbc94b8f) Aug 10 18:14:05.378557 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:14:05.378557 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:14:05.378557 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:14:05.378557 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:14:05.378557 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:14:05.378557 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:14:05.378557 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:14:05.378557 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:14:05.378557 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:14:05.378557 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 18:14:05.378557 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 18:14:05.378557 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 18:14:05.378557 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 18:14:05.378557 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 18:14:05.378557 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 18:14:05.378557 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 18:14:05.378557 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 18:14:05.378557 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 18:14:05.378557 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 18:14:05.378557 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 18:14:05.378557 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 18:14:05.378557 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 18:14:05.378557 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 18:14:05.378557 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 18:14:05.378557 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 18:14:05.378557 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 18:14:05.378557 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:14:05.378557 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:14:05.378557 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 18:14:05.378557 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 18:14:05.378557 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:14:05.378557 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:14:05.378557 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 18:14:05.378557 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 18:14:05.378557 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:14:05.378557 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:14:05.378557 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:14:05.378557 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:14:05.378557 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:14:05.378557 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:14:05.378557 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 18:14:05.378557 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 18:14:05.378557 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 18:14:05.378557 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 18:14:05.378557 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 18:14:05.378557 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 18:14:05.378557 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 18:14:05.378557 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 18:14:05.378557 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 18:14:05.378557 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 18:14:05.378557 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 18:14:05.382153 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 18:14:05.382153 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 18:14:05.382153 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 18:14:05.382153 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 18:14:05.382153 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 18:14:05.382153 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 18:14:05.382153 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 18:14:05.382153 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 18:14:05.382153 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 18:14:05.382153 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 18:14:05.382153 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 18:14:05.382153 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 18:14:05.382153 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 18:14:05.382153 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 18:14:05.382153 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 18:14:05.382153 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-98bf9886-2eec-48fa-98ec-f75bfbc94b8f) Aug 10 18:14:05.382153 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:14:05.385410 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-c7d7110e-ac40-401b-9fff-7de5f104b080 tempest-VolumesSnapshotTestJSON-1516371753 tempest-VolumesSnapshotTestJSON-1516371753-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:14:05.385410 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 18:14:05.388763 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-c7d7110e-ac40-401b-9fff-7de5f104b080 tempest-VolumesSnapshotTestJSON-1516371753 tempest-VolumesSnapshotTestJSON-1516371753-project] Request method failure captured: Aug 10 18:14:05.388763 n-d-852296-2 devstack@n-api.service[129410]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 18:14:05.388763 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 18:14:05.388763 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 18:14:05.388763 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 18:14:05.388763 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 211 Aug 10 18:14:05.388763 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 18:14:05.388763 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 18:14:05.388763 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 18:14:05.388763 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 18:14:05.388763 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8_SwmhwVCMd1THjpCf3RJyL7tgyj6YBGPkv-gK5JnqtuUcLI0QpCx6W-QJ53yJKWDK1W2DVef3lc8QV0bjG5tn0J3lQRpokR9CQQFKCNxrjDja4lIaX-Wn1frQAUkpGIu1kegs3I3uR1TV1YD44zGY2zxuZ4t8n6PjHYRfKvUoSBQsc Aug 10 18:14:05.388763 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 18:14:05.388763 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 18:14:05.388763 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 18:14:05.388763 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 18:14:05.388763 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 18:14:05.388763 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 18:14:05.388763 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: 16fe972d5ea2467b8b21230df70bb5d1 Aug 10 18:14:05.388763 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1516371753 Aug 10 18:14:05.388763 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 18:14:05.388763 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 18:14:05.388763 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/16fe972d5ea2467b8b21230df70bb5d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/16fe972d5ea2467b8b21230df70bb5d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/16fe972d5ea2467b8b21230df70bb5d1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_16fe972d5ea2467b8b21230df70bb5d1", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 18:14:05.388763 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-VolumesSnapshotTestJSON-1516371753 Aug 10 18:14:05.388763 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: 16fe972d5ea2467b8b21230df70bb5d1 Aug 10 18:14:05.388763 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1516371753 Aug 10 18:14:05.388763 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-VolumesSnapshotTestJSON-1516371753-project Aug 10 18:14:05.388763 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 18:14:05.388763 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 18:14:05.388763 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: 3474cb390bb243079512ab06ae02f0fa Aug 10 18:14:05.388763 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-VolumesSnapshotTestJSON-1516371753-project Aug 10 18:14:05.388763 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 18:14:05.388763 n-d-852296-2 devstack@n-api.service[129410]: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1729882045", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "19c5089f-72aa-4065-9c7d-7f4d88c1967d"}]}} Aug 10 18:14:05.388763 n-d-852296-2 devstack@n-api.service[129410]: method: > Aug 10 18:14:05.388763 n-d-852296-2 devstack@n-api.service[129410]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:14:05.388763 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 18:14:05.388763 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'body': {'server': {'name': 'tempest-VolumesSnapshotTestJSON-instance-1729882045', 'imageRef': 'a735ff26-463a-4ffe-a981-ab9d9baa494f', 'flavorRef': '452', 'networks': [{'uuid': '19c5089f-72aa-4065-9c7d-7f4d88c1967d'}]}}} Aug 10 18:14:05.388763 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 18:14:05.388763 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:14:05.388763 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:14:05.388763 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:14:05.388763 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:14:05.388763 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:14:05.388763 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:14:05.388763 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:14:05.388763 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:14:05.388763 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:14:05.388763 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 18:14:05.388763 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 18:14:05.388763 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 18:14:05.388763 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 18:14:05.388763 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 18:14:05.388763 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 18:14:05.388763 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 18:14:05.388763 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 18:14:05.388763 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 18:14:05.388763 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 18:14:05.388763 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 18:14:05.388763 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 18:14:05.388763 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 18:14:05.388763 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 18:14:05.388763 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 18:14:05.393933 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 18:14:05.393933 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 18:14:05.393933 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:14:05.393933 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:14:05.393933 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 18:14:05.393933 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 18:14:05.393933 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:14:05.393933 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:14:05.393933 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 18:14:05.393933 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 18:14:05.393933 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:14:05.393933 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:14:05.393933 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:14:05.393933 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:14:05.393933 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:14:05.393933 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:14:05.393933 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 18:14:05.393933 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 18:14:05.393933 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 18:14:05.393933 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 18:14:05.393933 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 18:14:05.393933 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 18:14:05.393933 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 18:14:05.393933 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 18:14:05.393933 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 18:14:05.393933 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 18:14:05.393933 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 18:14:05.393933 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 18:14:05.393933 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 18:14:05.393933 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 18:14:05.393933 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 18:14:05.393933 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 18:14:05.393933 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 18:14:05.393933 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 18:14:05.393933 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 18:14:05.393933 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 18:14:05.393933 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 18:14:05.393933 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 18:14:05.393933 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 18:14:05.393933 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 18:14:05.393933 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 18:14:05.393933 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 18:14:05.393933 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-98bf9886-2eec-48fa-98ec-f75bfbc94b8f) Aug 10 18:14:05.393933 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:14:05.393933 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:14:05.393933 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:14:05.393933 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:14:05.393933 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:14:05.393933 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:14:05.393933 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 18:14:05.393933 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 18:14:05.393933 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 10 18:14:05.393933 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 10 18:14:05.398227 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:14:05.398227 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:14:05.398227 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:14:05.398227 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:14:05.398227 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:14:05.398227 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:14:05.398227 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:14:05.398227 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:14:05.398227 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 18:14:05.398227 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 18:14:05.398227 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:14:05.398227 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:14:05.398227 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:14:05.413441 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-c7d7110e-ac40-401b-9fff-7de5f104b080 tempest-VolumesSnapshotTestJSON-1516371753 tempest-VolumesSnapshotTestJSON-1516371753-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:14:05.413441 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 18:14:05.414764 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-c7d7110e-ac40-401b-9fff-7de5f104b080 tempest-VolumesSnapshotTestJSON-1516371753 tempest-VolumesSnapshotTestJSON-1516371753-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.655098 Aug 10 18:14:05.416021 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 1041/2106] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 18:14:04 2022] POST /compute/v2.1/servers => generated 214 bytes in 657 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 10 18:14:08.220990 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-9141285c-b41d-417f-946d-142d90712d79 tempest-TestNetworkBasicOps-740532818 tempest-TestNetworkBasicOps-740532818-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-320526564", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "e375c94c-0778-4f97-9c8d-4237faec7f6f"}], "key_name": "tempest-TestNetworkBasicOps-1159850951", "security_groups": [{"name": "tempest-secgroup-smoke-11224775"}]}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 18:14:08.530544 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.network.neutron [None req-9141285c-b41d-417f-946d-142d90712d79 tempest-TestNetworkBasicOps-740532818 tempest-TestNetworkBasicOps-740532818-project] validate_networks() for [('e375c94c-0778-4f97-9c8d-4237faec7f6f', None, None, None, None, None)] {{(pid=129409) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 18:14:08.821226 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [None req-9141285c-b41d-417f-946d-142d90712d79 tempest-TestNetworkBasicOps-740532818 tempest-TestNetworkBasicOps-740532818-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-96fa83cf-8644-4790-80b0-c7d139fb4ef6) Aug 10 18:14:08.821226 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:14:08.821226 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:14:08.821226 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:14:08.821226 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:14:08.821226 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:14:08.821226 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:14:08.821226 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:14:08.821226 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:14:08.821226 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:14:08.821226 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 18:14:08.821226 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 18:14:08.821226 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 18:14:08.821226 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 18:14:08.821226 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 18:14:08.821226 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 18:14:08.821226 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 18:14:08.821226 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 18:14:08.821226 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 18:14:08.821226 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 18:14:08.821226 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 18:14:08.821226 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 18:14:08.821226 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 18:14:08.821226 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 18:14:08.821226 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 18:14:08.821226 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 18:14:08.821226 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 18:14:08.821226 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:14:08.821226 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:14:08.821226 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 18:14:08.821226 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 18:14:08.821226 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:14:08.821226 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:14:08.821226 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 18:14:08.821226 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 18:14:08.821226 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:14:08.821226 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:14:08.821226 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:14:08.821226 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:14:08.821226 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:14:08.821226 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:14:08.821226 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 18:14:08.821226 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 18:14:08.821226 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 18:14:08.821226 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 18:14:08.821226 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 18:14:08.821226 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 18:14:08.821226 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 18:14:08.821226 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 18:14:08.821226 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 18:14:08.821226 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 18:14:08.821226 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 18:14:08.821226 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 18:14:08.824912 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 18:14:08.824912 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 18:14:08.824912 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 18:14:08.824912 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 18:14:08.824912 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 18:14:08.824912 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 18:14:08.824912 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 18:14:08.824912 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 18:14:08.824912 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 18:14:08.824912 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 18:14:08.824912 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 18:14:08.824912 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 18:14:08.824912 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 18:14:08.824912 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 18:14:08.824912 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-96fa83cf-8644-4790-80b0-c7d139fb4ef6) Aug 10 18:14:08.824912 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:14:08.824912 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-9141285c-b41d-417f-946d-142d90712d79 tempest-TestNetworkBasicOps-740532818 tempest-TestNetworkBasicOps-740532818-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:14:08.824912 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 18:14:08.824912 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-9141285c-b41d-417f-946d-142d90712d79 tempest-TestNetworkBasicOps-740532818 tempest-TestNetworkBasicOps-740532818-project] Request method failure captured: Aug 10 18:14:08.824912 n-d-852296-2 devstack@n-api.service[129409]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 18:14:08.824912 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 18:14:08.824912 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 18:14:08.824912 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 18:14:08.824912 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 324 Aug 10 18:14:08.824912 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 18:14:08.824912 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 18:14:08.824912 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 18:14:08.824912 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 18:14:08.824912 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8_VVXrJjMwkSvxEKJLg_yLPdexRQTz-2cN7O1df4pjdWGEC0Wyq9fnyyM_affkBVWBqfxD_hc4fuQlhJ5kBi1IFc42Euvw5YgdDV3sI5Qd5anebxwXR720DEHYzCnDQbezsA13vHjlRYuYpNNAzR3NsSzYOK7cXEaXuHZAaHdgTVbvI Aug 10 18:14:08.824912 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 18:14:08.824912 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 18:14:08.824912 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 18:14:08.824912 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 18:14:08.824912 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 18:14:08.824912 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 18:14:08.824912 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: 1696e6ac46a44a5eb47eb2e91a852b88 Aug 10 18:14:08.824912 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-TestNetworkBasicOps-740532818 Aug 10 18:14:08.824912 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 18:14:08.824912 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 18:14:08.824912 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/1696e6ac46a44a5eb47eb2e91a852b88"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/1696e6ac46a44a5eb47eb2e91a852b88"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/1696e6ac46a44a5eb47eb2e91a852b88"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_1696e6ac46a44a5eb47eb2e91a852b88", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 18:14:08.824912 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-TestNetworkBasicOps-740532818 Aug 10 18:14:08.824912 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: 1696e6ac46a44a5eb47eb2e91a852b88 Aug 10 18:14:08.824912 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-TestNetworkBasicOps-740532818 Aug 10 18:14:08.824912 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-TestNetworkBasicOps-740532818-project Aug 10 18:14:08.824912 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 18:14:08.824912 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 18:14:08.824912 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: b00e6e3170564fad826409314067a8d5 Aug 10 18:14:08.824912 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-TestNetworkBasicOps-740532818-project Aug 10 18:14:08.824912 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 18:14:08.824912 n-d-852296-2 devstack@n-api.service[129409]: {"server": {"name": "tempest-TestNetworkBasicOps-server-320526564", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "e375c94c-0778-4f97-9c8d-4237faec7f6f"}], "key_name": "tempest-TestNetworkBasicOps-1159850951", "security_groups": [{"name": "tempest-secgroup-smoke-11224775"}]}} Aug 10 18:14:08.824912 n-d-852296-2 devstack@n-api.service[129409]: method: > Aug 10 18:14:08.824912 n-d-852296-2 devstack@n-api.service[129409]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:14:08.824912 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 18:14:08.828610 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'body': {'server': {'name': 'tempest-TestNetworkBasicOps-server-320526564', 'imageRef': 'a735ff26-463a-4ffe-a981-ab9d9baa494f', 'flavorRef': '452', 'networks': [{'uuid': 'e375c94c-0778-4f97-9c8d-4237faec7f6f'}], 'key_name': 'tempest-TestNetworkBasicOps-1159850951', 'security_groups': [{'name': 'tempest-secgroup-smoke-11224775'}]}}} Aug 10 18:14:08.828610 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 18:14:08.828610 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:14:08.828610 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:14:08.828610 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:14:08.828610 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:14:08.828610 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:14:08.828610 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:14:08.828610 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:14:08.828610 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:14:08.828610 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:14:08.828610 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 18:14:08.828610 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 18:14:08.828610 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 18:14:08.828610 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 18:14:08.828610 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 18:14:08.828610 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 18:14:08.828610 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 18:14:08.828610 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 18:14:08.828610 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 18:14:08.828610 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 18:14:08.828610 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 18:14:08.828610 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 18:14:08.828610 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 18:14:08.828610 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 18:14:08.828610 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 18:14:08.828610 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 18:14:08.828610 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 18:14:08.828610 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:14:08.828610 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:14:08.828610 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 18:14:08.828610 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 18:14:08.828610 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:14:08.828610 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:14:08.828610 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 18:14:08.828610 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 18:14:08.828610 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:14:08.828610 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:14:08.828610 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:14:08.828610 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:14:08.828610 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:14:08.828610 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:14:08.828610 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 18:14:08.828610 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 18:14:08.828610 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 18:14:08.828610 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 18:14:08.828610 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 18:14:08.828610 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 18:14:08.828610 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 18:14:08.828610 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 18:14:08.828610 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 18:14:08.828610 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 18:14:08.828610 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 18:14:08.828610 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 18:14:08.832106 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 18:14:08.832106 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 18:14:08.832106 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 18:14:08.832106 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 18:14:08.832106 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 18:14:08.832106 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 18:14:08.832106 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 18:14:08.832106 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 18:14:08.832106 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 18:14:08.832106 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 18:14:08.832106 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 18:14:08.832106 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 18:14:08.832106 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 18:14:08.832106 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 18:14:08.832106 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-96fa83cf-8644-4790-80b0-c7d139fb4ef6) Aug 10 18:14:08.832106 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:14:08.832106 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:14:08.832106 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:14:08.832106 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:14:08.832106 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:14:08.832106 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:14:08.832106 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 18:14:08.832106 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 18:14:08.832106 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 10 18:14:08.832106 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 10 18:14:08.832106 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:14:08.832106 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:14:08.832106 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:14:08.832106 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:14:08.832106 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:14:08.832106 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:14:08.832106 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:14:08.832106 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:14:08.832106 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 18:14:08.832106 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 18:14:08.832106 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:14:08.832106 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:14:08.832106 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:14:08.832106 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-9141285c-b41d-417f-946d-142d90712d79 tempest-TestNetworkBasicOps-740532818 tempest-TestNetworkBasicOps-740532818-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:14:08.832106 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 18:14:08.832106 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-9141285c-b41d-417f-946d-142d90712d79 tempest-TestNetworkBasicOps-740532818 tempest-TestNetworkBasicOps-740532818-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.615168 Aug 10 18:14:08.832106 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1066/2107] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 18:14:08 2022] POST /compute/v2.1/servers => generated 214 bytes in 618 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 10 18:14:09.406954 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-79d35537-075c-4769-838a-7951b2ed1f36 tempest-TestNetworkBasicOps-740532818 tempest-TestNetworkBasicOps-740532818-project] Calling method '.version_select at 0x7fb345dbf430>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:14:09.617629 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-79d35537-075c-4769-838a-7951b2ed1f36 tempest-TestNetworkBasicOps-740532818 tempest-TestNetworkBasicOps-740532818-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1159850951" status: 202 len: 0 microversion: 2.1 time: 0.223166 Aug 10 18:14:09.630363 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 1042/2108] 10.222.0.50 () {58 vars in 1257 bytes} [Wed Aug 10 18:14:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1159850951 => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 18:14:29.656816 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-a4721303-9c05-4fcb-8570-8202aec5574d tempest-TestNetworkBasicOps-740532818 tempest-TestNetworkBasicOps-740532818-project] Action: 'create', calling method: .version_select at 0x7fb345ebe5e0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1855392684", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP/YuK6eatfxtlvhi+O6818jV5TCknZ43wW8LmfD7H+kkYqUJbiz5nPPFkLVzmw6rVVzfvKQz7aU5i3N5zRSruoKATKWPDN92OcEhURDu3vHULsc1M4cb9ZoabOtyWeTtw=="}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 18:14:29.668797 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_cell0:SELECT=4 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 18:14:29.691863 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-a4721303-9c05-4fcb-8570-8202aec5574d tempest-TestNetworkBasicOps-740532818 tempest-TestNetworkBasicOps-740532818-project] Getting quotas for project 1696e6ac46a44a5eb47eb2e91a852b88. Resources: {'key_pairs'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 18:14:29.702737 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-a4721303-9c05-4fcb-8570-8202aec5574d tempest-TestNetworkBasicOps-740532818 tempest-TestNetworkBasicOps-740532818-project] Getting quotas for user b00e6e3170564fad826409314067a8d5 and project 1696e6ac46a44a5eb47eb2e91a852b88. Resources: {'key_pairs'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 18:14:29.973529 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-a4721303-9c05-4fcb-8570-8202aec5574d tempest-TestNetworkBasicOps-740532818 tempest-TestNetworkBasicOps-740532818-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.327369 Aug 10 18:14:29.980489 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1067/2109] 10.222.0.50 () {60 vars in 1159 bytes} [Wed Aug 10 18:14:29 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 18:14:35.713100 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-663d68f8-6767-4de6-95f4-3be230fb756a tempest-TestNetworkBasicOps-740532818 tempest-TestNetworkBasicOps-740532818-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-656244382", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "db7bea04-cff4-4048-a0b8-a5acedff0941"}], "key_name": "tempest-TestNetworkBasicOps-1855392684", "security_groups": [{"name": "tempest-secgroup-smoke-962571008"}]}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 18:14:35.856205 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.network.neutron [None req-663d68f8-6767-4de6-95f4-3be230fb756a tempest-TestNetworkBasicOps-740532818 tempest-TestNetworkBasicOps-740532818-project] validate_networks() for [('db7bea04-cff4-4048-a0b8-a5acedff0941', None, None, None, None, None)] {{(pid=129410) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 18:14:36.180224 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [None req-663d68f8-6767-4de6-95f4-3be230fb756a tempest-TestNetworkBasicOps-740532818 tempest-TestNetworkBasicOps-740532818-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-e4563f26-450e-4c88-9522-f22d055ac6a7) Aug 10 18:14:36.180224 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:14:36.180224 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:14:36.180224 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:14:36.180224 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:14:36.180224 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:14:36.180224 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:14:36.180224 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:14:36.180224 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:14:36.180224 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:14:36.180224 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 18:14:36.180224 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 18:14:36.180224 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 18:14:36.180224 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 18:14:36.180224 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 18:14:36.180224 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 18:14:36.180224 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 18:14:36.180224 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 18:14:36.180224 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 18:14:36.180224 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 18:14:36.180224 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 18:14:36.180224 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 18:14:36.180224 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 18:14:36.180224 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 18:14:36.180224 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 18:14:36.180224 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 18:14:36.180224 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 18:14:36.180224 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:14:36.180224 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:14:36.180224 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 18:14:36.180224 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 18:14:36.180224 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:14:36.180224 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:14:36.180224 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 18:14:36.180224 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 18:14:36.180224 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:14:36.180224 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:14:36.180224 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:14:36.180224 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:14:36.180224 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:14:36.180224 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:14:36.180224 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 18:14:36.180224 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 18:14:36.180224 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 18:14:36.180224 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 18:14:36.180224 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 18:14:36.180224 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 18:14:36.180224 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 18:14:36.180224 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 18:14:36.180224 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 18:14:36.180224 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 18:14:36.180224 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 18:14:36.180224 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 18:14:36.184030 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 18:14:36.184030 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 18:14:36.184030 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 18:14:36.184030 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 18:14:36.184030 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 18:14:36.184030 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 18:14:36.184030 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 18:14:36.184030 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 18:14:36.184030 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 18:14:36.184030 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 18:14:36.184030 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 18:14:36.184030 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 18:14:36.184030 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 18:14:36.184030 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 18:14:36.184030 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-e4563f26-450e-4c88-9522-f22d055ac6a7) Aug 10 18:14:36.184030 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:14:36.184030 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-663d68f8-6767-4de6-95f4-3be230fb756a tempest-TestNetworkBasicOps-740532818 tempest-TestNetworkBasicOps-740532818-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:14:36.184030 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 18:14:36.187454 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-663d68f8-6767-4de6-95f4-3be230fb756a tempest-TestNetworkBasicOps-740532818 tempest-TestNetworkBasicOps-740532818-project] Request method failure captured: Aug 10 18:14:36.187454 n-d-852296-2 devstack@n-api.service[129410]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 18:14:36.187454 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 18:14:36.187454 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 18:14:36.187454 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 18:14:36.187454 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 325 Aug 10 18:14:36.187454 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 18:14:36.187454 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 18:14:36.187454 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 18:14:36.187454 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 18:14:36.187454 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8_VVXrJjMwkSvxEKJLg_yLPdexRQTz-2cN7O1df4pjdWGEC0Wyq9fnyyM_affkBVWBqfxD_hc4fuQlhJ5kBi1IFc42Euvw5YgdDV3sI5Qd5anebxwXR720DEHYzCnDQbezsA13vHjlRYuYpNNAzR3NsSzYOK7cXEaXuHZAaHdgTVbvI Aug 10 18:14:36.187454 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 18:14:36.187454 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 18:14:36.187454 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 18:14:36.187454 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 18:14:36.187454 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 18:14:36.187454 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 18:14:36.187454 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: 1696e6ac46a44a5eb47eb2e91a852b88 Aug 10 18:14:36.187454 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-TestNetworkBasicOps-740532818 Aug 10 18:14:36.187454 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 18:14:36.187454 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 18:14:36.187454 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/1696e6ac46a44a5eb47eb2e91a852b88"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/1696e6ac46a44a5eb47eb2e91a852b88"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/1696e6ac46a44a5eb47eb2e91a852b88"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_1696e6ac46a44a5eb47eb2e91a852b88", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 18:14:36.187454 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-TestNetworkBasicOps-740532818 Aug 10 18:14:36.187454 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: 1696e6ac46a44a5eb47eb2e91a852b88 Aug 10 18:14:36.187454 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-TestNetworkBasicOps-740532818 Aug 10 18:14:36.187454 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-TestNetworkBasicOps-740532818-project Aug 10 18:14:36.187454 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 18:14:36.187454 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 18:14:36.187454 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: b00e6e3170564fad826409314067a8d5 Aug 10 18:14:36.187454 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-TestNetworkBasicOps-740532818-project Aug 10 18:14:36.187454 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 18:14:36.187454 n-d-852296-2 devstack@n-api.service[129410]: {"server": {"name": "tempest-TestNetworkBasicOps-server-656244382", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "db7bea04-cff4-4048-a0b8-a5acedff0941"}], "key_name": "tempest-TestNetworkBasicOps-1855392684", "security_groups": [{"name": "tempest-secgroup-smoke-962571008"}]}} Aug 10 18:14:36.187454 n-d-852296-2 devstack@n-api.service[129410]: method: > Aug 10 18:14:36.187454 n-d-852296-2 devstack@n-api.service[129410]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:14:36.187454 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 18:14:36.187454 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'body': {'server': {'name': 'tempest-TestNetworkBasicOps-server-656244382', 'imageRef': 'a735ff26-463a-4ffe-a981-ab9d9baa494f', 'flavorRef': '452', 'networks': [{'uuid': 'db7bea04-cff4-4048-a0b8-a5acedff0941'}], 'key_name': 'tempest-TestNetworkBasicOps-1855392684', 'security_groups': [{'name': 'tempest-secgroup-smoke-962571008'}]}}} Aug 10 18:14:36.187454 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 18:14:36.187454 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:14:36.187454 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:14:36.187454 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:14:36.187454 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:14:36.187454 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:14:36.187454 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:14:36.187454 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:14:36.187454 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:14:36.187454 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:14:36.187454 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 18:14:36.187454 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 18:14:36.187454 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 18:14:36.187454 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 18:14:36.187454 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 18:14:36.187454 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 18:14:36.187454 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 18:14:36.187454 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 18:14:36.187454 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 18:14:36.187454 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 18:14:36.187454 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 18:14:36.187454 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 18:14:36.187454 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 18:14:36.195113 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 18:14:36.195113 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 18:14:36.195113 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 18:14:36.195113 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 18:14:36.195113 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:14:36.195113 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:14:36.195113 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 18:14:36.195113 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 18:14:36.195113 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:14:36.195113 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:14:36.195113 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 18:14:36.195113 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 18:14:36.195113 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:14:36.195113 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:14:36.195113 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:14:36.195113 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:14:36.195113 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:14:36.195113 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:14:36.195113 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 18:14:36.195113 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 18:14:36.195113 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 18:14:36.195113 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 18:14:36.195113 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 18:14:36.195113 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 18:14:36.195113 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 18:14:36.195113 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 18:14:36.195113 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 18:14:36.195113 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 18:14:36.195113 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 18:14:36.195113 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 18:14:36.195113 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 18:14:36.195113 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 18:14:36.195113 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 18:14:36.195113 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 18:14:36.195113 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 18:14:36.195113 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 18:14:36.195113 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 18:14:36.195113 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 18:14:36.195113 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 18:14:36.195113 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 18:14:36.195113 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 18:14:36.195113 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 18:14:36.195113 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 18:14:36.195113 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 18:14:36.195113 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-e4563f26-450e-4c88-9522-f22d055ac6a7) Aug 10 18:14:36.195113 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:14:36.195113 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:14:36.195113 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:14:36.195113 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:14:36.195113 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:14:36.195113 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:14:36.195113 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 18:14:36.195113 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 18:14:36.198811 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 10 18:14:36.198811 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 10 18:14:36.198811 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:14:36.198811 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:14:36.198811 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:14:36.198811 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:14:36.198811 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:14:36.198811 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:14:36.198811 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:14:36.198811 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:14:36.198811 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 18:14:36.198811 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 18:14:36.198811 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:14:36.198811 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:14:36.198811 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:14:36.198811 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-663d68f8-6767-4de6-95f4-3be230fb756a tempest-TestNetworkBasicOps-740532818 tempest-TestNetworkBasicOps-740532818-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:14:36.198811 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 18:14:36.198811 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-663d68f8-6767-4de6-95f4-3be230fb756a tempest-TestNetworkBasicOps-740532818 tempest-TestNetworkBasicOps-740532818-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.481913 Aug 10 18:14:36.198811 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 1043/2110] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 18:14:35 2022] POST /compute/v2.1/servers => generated 214 bytes in 487 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 10 18:14:36.622054 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-fdd34477-f842-4fe6-a99b-556b4612855d tempest-TestNetworkBasicOps-740532818 tempest-TestNetworkBasicOps-740532818-project] Calling method '.version_select at 0x7fb34610c9d0>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:14:36.816947 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-fdd34477-f842-4fe6-a99b-556b4612855d tempest-TestNetworkBasicOps-740532818 tempest-TestNetworkBasicOps-740532818-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1855392684" status: 202 len: 0 microversion: 2.1 time: 0.202830 Aug 10 18:14:36.817541 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1068/2111] 10.222.0.50 () {58 vars in 1257 bytes} [Wed Aug 10 18:14:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1855392684 => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 18:15:12.143008 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 18:15:12.534919 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-bf278a87-ae9e-4e94-9747-8b5b4c8c1d64 tempest-TestServerBasicOps-402895626 tempest-TestServerBasicOps-402895626-project] Action: 'create', calling method: .version_select at 0x7fb345bd3d30>, body: {"keypair": {"name": "tempest-TestServerBasicOps-86043127", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBmdBNb33nBfUYNipoXSHj72Z95HhQ+fhd6HwAXCxTLSRTgiPH4ExbTNQPDLZDAOm3juTsRfjwuDt/Vu0aEP33wPN/KQD17qG1ffN518Q8npu/+GPBCoYRzDLAdG1h9L9Q=="}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 18:15:12.573433 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.quota [None req-bf278a87-ae9e-4e94-9747-8b5b4c8c1d64 tempest-TestServerBasicOps-402895626 tempest-TestServerBasicOps-402895626-project] Getting quotas for project f73bdc0a896e4204912e506db34a363b. Resources: {'key_pairs'} {{(pid=129410) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 18:15:12.588063 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.quota [None req-bf278a87-ae9e-4e94-9747-8b5b4c8c1d64 tempest-TestServerBasicOps-402895626 tempest-TestServerBasicOps-402895626-project] Getting quotas for user 7b1b76e3882a4d98a3e90f9fac293b25 and project f73bdc0a896e4204912e506db34a363b. Resources: {'key_pairs'} {{(pid=129410) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 18:15:12.752879 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-bf278a87-ae9e-4e94-9747-8b5b4c8c1d64 tempest-TestServerBasicOps-402895626 tempest-TestServerBasicOps-402895626-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 395 microversion: 2.1 time: 0.620361 Aug 10 18:15:12.759358 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 1044/2112] 10.222.0.50 () {60 vars in 1159 bytes} [Wed Aug 10 18:15:12 2022] POST /compute/v2.1/os-keypairs => generated 395 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 18:15:18.093166 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_cell0:SELECT=4 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 18:15:18.093166 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 18:15:18.099640 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-54f81b10-2255-43ad-899d-e6781a47faf9 tempest-TestServerBasicOps-402895626 tempest-TestServerBasicOps-402895626-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-1591381063", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-86043127", "security_groups": [{"name": "tempest-secgroup-smoke-1941739447"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "e5e69dfe-b868-4656-adf0-56d5f4e2cb6f"}]}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 18:15:18.322183 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.network.neutron [None req-54f81b10-2255-43ad-899d-e6781a47faf9 tempest-TestServerBasicOps-402895626 tempest-TestServerBasicOps-402895626-project] validate_networks() for [('e5e69dfe-b868-4656-adf0-56d5f4e2cb6f', None, None, None, None, None)] {{(pid=129409) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 18:15:18.762090 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [None req-54f81b10-2255-43ad-899d-e6781a47faf9 tempest-TestServerBasicOps-402895626 tempest-TestServerBasicOps-402895626-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-dc4d3f09-2f06-4580-9d95-da8e098f0d21) Aug 10 18:15:18.762090 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:15:18.762090 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:15:18.762090 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:15:18.762090 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:15:18.762090 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:15:18.762090 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:15:18.762090 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:15:18.762090 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:15:18.762090 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:15:18.762090 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 18:15:18.762090 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 18:15:18.762090 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 18:15:18.762090 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 18:15:18.762090 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 18:15:18.762090 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 18:15:18.762090 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 18:15:18.762090 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 18:15:18.762090 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 18:15:18.762090 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 18:15:18.762090 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 18:15:18.762090 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 18:15:18.762090 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 18:15:18.762090 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 18:15:18.762090 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 18:15:18.762090 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 18:15:18.762090 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 18:15:18.762090 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:15:18.762090 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:15:18.762090 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 18:15:18.762090 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 18:15:18.762090 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:15:18.762090 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:15:18.762090 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 18:15:18.762090 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 18:15:18.762090 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:15:18.762090 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:15:18.762090 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:15:18.762090 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:15:18.762090 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:15:18.762090 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:15:18.762090 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 18:15:18.762090 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 18:15:18.762090 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 18:15:18.762090 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 18:15:18.762090 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 18:15:18.762090 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 18:15:18.762090 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 18:15:18.762090 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 18:15:18.762090 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 18:15:18.762090 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 18:15:18.762090 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 18:15:18.762090 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 18:15:18.774372 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 18:15:18.774372 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 18:15:18.774372 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 18:15:18.774372 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 18:15:18.774372 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 18:15:18.774372 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 18:15:18.774372 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 18:15:18.774372 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 18:15:18.774372 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 18:15:18.774372 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 18:15:18.774372 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 18:15:18.774372 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 18:15:18.774372 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 18:15:18.774372 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 18:15:18.774372 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-dc4d3f09-2f06-4580-9d95-da8e098f0d21) Aug 10 18:15:18.774372 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:15:18.774372 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-54f81b10-2255-43ad-899d-e6781a47faf9 tempest-TestServerBasicOps-402895626 tempest-TestServerBasicOps-402895626-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:15:18.774372 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 18:15:18.774372 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-54f81b10-2255-43ad-899d-e6781a47faf9 tempest-TestServerBasicOps-402895626 tempest-TestServerBasicOps-402895626-project] Request method failure captured: Aug 10 18:15:18.774372 n-d-852296-2 devstack@n-api.service[129409]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 18:15:18.774372 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 18:15:18.774372 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 18:15:18.774372 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 18:15:18.774372 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 413 Aug 10 18:15:18.774372 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 18:15:18.774372 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 18:15:18.774372 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 18:15:18.774372 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 18:15:18.774372 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8_WibhYX0nJuLprahBP-rcaPq3dSisfeoJUW1PtWP-OR-h3tWCrd_mDKAfPHH6BzdE_5mDGsjMNZQKj08pS2O4884bbjarPNp-8MEQ3R8dJito7vfoVcdE7N3qZLpVqWSHm1AT1ux5GC50BK0JNh2kj_prcEV-LYml7qf4gtoGMRGhU Aug 10 18:15:18.774372 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 18:15:18.774372 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 18:15:18.774372 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 18:15:18.774372 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 18:15:18.774372 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 18:15:18.774372 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 18:15:18.774372 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: f73bdc0a896e4204912e506db34a363b Aug 10 18:15:18.774372 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-TestServerBasicOps-402895626 Aug 10 18:15:18.774372 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 18:15:18.774372 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 18:15:18.774372 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f73bdc0a896e4204912e506db34a363b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f73bdc0a896e4204912e506db34a363b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f73bdc0a896e4204912e506db34a363b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f73bdc0a896e4204912e506db34a363b", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 18:15:18.774372 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-TestServerBasicOps-402895626 Aug 10 18:15:18.774372 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: f73bdc0a896e4204912e506db34a363b Aug 10 18:15:18.774372 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-TestServerBasicOps-402895626 Aug 10 18:15:18.774372 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-TestServerBasicOps-402895626-project Aug 10 18:15:18.774372 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 18:15:18.774372 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 18:15:18.774372 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: 7b1b76e3882a4d98a3e90f9fac293b25 Aug 10 18:15:18.774372 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-TestServerBasicOps-402895626-project Aug 10 18:15:18.774372 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 18:15:18.774372 n-d-852296-2 devstack@n-api.service[129409]: {"server": {"name": "tempest-TestServerBasicOps-server-1591381063", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-86043127", "security_groups": [{"name": "tempest-secgroup-smoke-1941739447"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "e5e69dfe-b868-4656-adf0-56d5f4e2cb6f"}]}} Aug 10 18:15:18.774372 n-d-852296-2 devstack@n-api.service[129409]: method: > Aug 10 18:15:18.774372 n-d-852296-2 devstack@n-api.service[129409]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:15:18.774372 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 18:15:18.782200 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'body': {'server': {'name': 'tempest-TestServerBasicOps-server-1591381063', 'imageRef': 'a735ff26-463a-4ffe-a981-ab9d9baa494f', 'flavorRef': '452', 'key_name': 'tempest-TestServerBasicOps-86043127', 'security_groups': [{'name': 'tempest-secgroup-smoke-1941739447'}], 'config_drive': True, 'metadata': {'meta1': 'data1', 'meta2': 'data2', 'metaN': 'dataN'}, 'networks': [{'uuid': 'e5e69dfe-b868-4656-adf0-56d5f4e2cb6f'}]}}} Aug 10 18:15:18.782200 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 18:15:18.782200 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:15:18.782200 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:15:18.782200 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:15:18.782200 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:15:18.782200 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:15:18.782200 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:15:18.782200 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:15:18.782200 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:15:18.782200 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:15:18.782200 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 18:15:18.782200 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 18:15:18.782200 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 18:15:18.782200 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 18:15:18.782200 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 18:15:18.782200 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 18:15:18.782200 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 18:15:18.782200 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 18:15:18.782200 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 18:15:18.782200 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 18:15:18.782200 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 18:15:18.782200 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 18:15:18.782200 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 18:15:18.782200 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 18:15:18.782200 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 18:15:18.782200 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 18:15:18.782200 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 18:15:18.782200 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:15:18.782200 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:15:18.782200 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 18:15:18.782200 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 18:15:18.782200 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:15:18.782200 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:15:18.782200 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 18:15:18.782200 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 18:15:18.782200 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:15:18.782200 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:15:18.782200 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:15:18.782200 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:15:18.782200 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:15:18.782200 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:15:18.782200 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 18:15:18.782200 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 18:15:18.782200 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 18:15:18.782200 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 18:15:18.782200 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 18:15:18.782200 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 18:15:18.782200 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 18:15:18.782200 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 18:15:18.782200 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 18:15:18.782200 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 18:15:18.782200 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 18:15:18.782200 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 18:15:19.019164 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 18:15:19.019164 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 18:15:19.019164 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 18:15:19.019164 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 18:15:19.019164 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 18:15:19.019164 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 18:15:19.019164 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 18:15:19.019164 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 18:15:19.019164 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 18:15:19.019164 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 18:15:19.019164 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 18:15:19.019164 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 18:15:19.019164 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 18:15:19.019164 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 18:15:19.019164 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-dc4d3f09-2f06-4580-9d95-da8e098f0d21) Aug 10 18:15:19.019164 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:15:19.019164 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:15:19.019164 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:15:19.019164 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:15:19.019164 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:15:19.019164 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:15:19.019164 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 18:15:19.019164 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 18:15:19.019164 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 10 18:15:19.019164 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 10 18:15:19.019164 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:15:19.019164 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:15:19.019164 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:15:19.019164 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:15:19.019164 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:15:19.019164 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:15:19.019164 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:15:19.019164 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:15:19.019164 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 18:15:19.019164 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 18:15:19.019164 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:15:19.019164 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:15:19.019164 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:15:19.019164 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-54f81b10-2255-43ad-899d-e6781a47faf9 tempest-TestServerBasicOps-402895626 tempest-TestServerBasicOps-402895626-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:15:19.019164 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 18:15:19.019164 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-54f81b10-2255-43ad-899d-e6781a47faf9 tempest-TestServerBasicOps-402895626 tempest-TestServerBasicOps-402895626-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.675203 Aug 10 18:15:19.019164 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1069/2113] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 18:15:18 2022] POST /compute/v2.1/servers => generated 214 bytes in 681 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 10 18:15:19.500106 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-6ca605ba-5d45-402f-b9fe-fd5e504f71d1 tempest-TestServerBasicOps-402895626 tempest-TestServerBasicOps-402895626-project] Calling method '.version_select at 0x7fb345bd3c10>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:15:19.974793 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-6ca605ba-5d45-402f-b9fe-fd5e504f71d1 tempest-TestServerBasicOps-402895626 tempest-TestServerBasicOps-402895626-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-86043127" status: 202 len: 0 microversion: 2.1 time: 0.480224 Aug 10 18:15:19.976278 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 1045/2114] 10.222.0.50 () {58 vars in 1248 bytes} [Wed Aug 10 18:15:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-86043127 => generated 0 bytes in 482 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 18:15:41.855358 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-c1d1a919-44c9-4527-a32e-bf09b8f9eade tempest-TestSecurityGroupsBasicOps-1600343209 tempest-TestSecurityGroupsBasicOps-1600343209-project] Action: 'create', calling method: .version_select at 0x7fb346178c10>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-223469413", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI2WvK/GZhLDMGEPOiXs5y4IOuBeq2wCJcCz+h94KY14tK6gGdjY0nwlABGptruROKysCSVdiCrB0VWpt02gEyIMT2xFr+mJP15/wwbbZKMJmc9wWCR0xABIEC3Vjgb5hw=="}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 18:15:41.964140 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-c1d1a919-44c9-4527-a32e-bf09b8f9eade tempest-TestSecurityGroupsBasicOps-1600343209 tempest-TestSecurityGroupsBasicOps-1600343209-project] Getting quotas for project e0c9952567844c75b7652c5ff72c174b. Resources: {'key_pairs'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 18:15:41.997244 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-c1d1a919-44c9-4527-a32e-bf09b8f9eade tempest-TestSecurityGroupsBasicOps-1600343209 tempest-TestSecurityGroupsBasicOps-1600343209-project] Getting quotas for user 5442cc11419141aa8df4df5dc25d941e and project e0c9952567844c75b7652c5ff72c174b. Resources: {'key_pairs'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 18:15:42.080581 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-c1d1a919-44c9-4527-a32e-bf09b8f9eade tempest-TestSecurityGroupsBasicOps-1600343209 tempest-TestSecurityGroupsBasicOps-1600343209-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.571776 Aug 10 18:15:42.081585 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1070/2115] 10.222.0.50 () {60 vars in 1159 bytes} [Wed Aug 10 18:15:41 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 18:15:58.721971 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-efa986c7-a5bf-414e-b0c5-f8baee40908b tempest-TestSecurityGroupsBasicOps-1600343209 tempest-TestSecurityGroupsBasicOps-1600343209-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-1600343209-access_point-155598812", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "9d513d83-2933-403d-8a90-ce949b2dfd74"}], "key_name": "tempest-TestSecurityGroupsBasicOps-223469413", "security_groups": [{"name": "tempest-secgroup_access--1116700652"}, {"name": "tempest-secgroup_general--1714634861"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 18:15:58.748157 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_cell0:SELECT=4 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 18:15:58.753170 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_api:SELECT=14,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 18:15:59.929953 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.network.neutron [None req-efa986c7-a5bf-414e-b0c5-f8baee40908b tempest-TestSecurityGroupsBasicOps-1600343209 tempest-TestSecurityGroupsBasicOps-1600343209-project] validate_networks() for [('9d513d83-2933-403d-8a90-ce949b2dfd74', None, None, None, None, None)] {{(pid=129410) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 18:16:00.605324 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [None req-efa986c7-a5bf-414e-b0c5-f8baee40908b tempest-TestSecurityGroupsBasicOps-1600343209 tempest-TestSecurityGroupsBasicOps-1600343209-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-e4707c47-14d2-4354-a920-89f6f5f2b445) Aug 10 18:16:00.605324 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:16:00.605324 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:16:00.605324 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:16:00.605324 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:16:00.605324 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:16:00.605324 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:16:00.605324 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:16:00.605324 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:16:00.605324 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:16:00.605324 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 18:16:00.605324 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 18:16:00.605324 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 18:16:00.605324 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 18:16:00.605324 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 18:16:00.605324 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 18:16:00.605324 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 18:16:00.605324 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 18:16:00.605324 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 18:16:00.605324 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 18:16:00.605324 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 18:16:00.605324 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 18:16:00.605324 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 18:16:00.605324 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 18:16:00.605324 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 18:16:00.605324 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 18:16:00.605324 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 18:16:00.605324 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:16:00.605324 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:16:00.605324 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 18:16:00.605324 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 18:16:00.605324 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:16:00.605324 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:16:00.605324 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 18:16:00.605324 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 18:16:00.605324 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:16:00.605324 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:16:00.605324 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:16:00.605324 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:16:00.605324 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:16:00.605324 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:16:00.605324 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 18:16:00.605324 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 18:16:00.605324 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 18:16:00.605324 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 18:16:00.605324 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 18:16:00.605324 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 18:16:00.605324 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 18:16:00.605324 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 18:16:00.605324 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 18:16:00.605324 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 18:16:00.605324 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 18:16:00.612874 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 18:16:00.612874 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 18:16:00.612874 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 18:16:00.612874 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 18:16:00.612874 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 18:16:00.612874 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 18:16:00.612874 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 18:16:00.612874 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 18:16:00.612874 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 18:16:00.612874 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 18:16:00.612874 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 18:16:00.612874 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 18:16:00.612874 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 18:16:00.612874 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 18:16:00.612874 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 18:16:00.612874 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-e4707c47-14d2-4354-a920-89f6f5f2b445) Aug 10 18:16:00.612874 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:16:00.612874 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-efa986c7-a5bf-414e-b0c5-f8baee40908b tempest-TestSecurityGroupsBasicOps-1600343209 tempest-TestSecurityGroupsBasicOps-1600343209-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:16:00.612874 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 18:16:00.612874 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-efa986c7-a5bf-414e-b0c5-f8baee40908b tempest-TestSecurityGroupsBasicOps-1600343209 tempest-TestSecurityGroupsBasicOps-1600343209-project] Request method failure captured: Aug 10 18:16:00.612874 n-d-852296-2 devstack@n-api.service[129410]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 18:16:00.612874 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 18:16:00.612874 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 18:16:00.612874 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 18:16:00.612874 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 469 Aug 10 18:16:00.612874 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 18:16:00.612874 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 18:16:00.612874 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 18:16:00.612874 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 18:16:00.612874 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8_XLfuNIwRvvYo5cK0bZVQwLvzOTsx94-SmZrwNEuq4ZRFAA4Hqga44JMVwuOFq5KjMoC35LY8erZNCJdtzPS025DACsabdQt_w2EMfm7ljtuUqfQ-faLjk3OnPUTwuiWdY32mvxnU--lMNoKfIgq2y5dh6h26HAyg2ZUUXhWlL3dMc Aug 10 18:16:00.612874 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 18:16:00.612874 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 18:16:00.612874 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 18:16:00.612874 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 18:16:00.612874 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 18:16:00.612874 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 18:16:00.612874 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: e0c9952567844c75b7652c5ff72c174b Aug 10 18:16:00.612874 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1600343209 Aug 10 18:16:00.612874 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 18:16:00.612874 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 18:16:00.612874 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e0c9952567844c75b7652c5ff72c174b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/e0c9952567844c75b7652c5ff72c174b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e0c9952567844c75b7652c5ff72c174b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_e0c9952567844c75b7652c5ff72c174b", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 18:16:00.612874 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1600343209 Aug 10 18:16:00.612874 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: e0c9952567844c75b7652c5ff72c174b Aug 10 18:16:00.612874 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1600343209 Aug 10 18:16:00.612874 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-TestSecurityGroupsBasicOps-1600343209-project Aug 10 18:16:00.612874 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 18:16:00.612874 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 18:16:00.612874 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: 5442cc11419141aa8df4df5dc25d941e Aug 10 18:16:00.612874 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1600343209-project Aug 10 18:16:00.612874 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 18:16:00.612874 n-d-852296-2 devstack@n-api.service[129410]: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-1600343209-access_point-155598812", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "9d513d83-2933-403d-8a90-ce949b2dfd74"}], "key_name": "tempest-TestSecurityGroupsBasicOps-223469413", "security_groups": [{"name": "tempest-secgroup_access--1116700652"}, {"name": "tempest-secgroup_general--1714634861"}]}, "os:scheduler_hints": {"different_host": []}} Aug 10 18:16:00.612874 n-d-852296-2 devstack@n-api.service[129410]: method: > Aug 10 18:16:00.612874 n-d-852296-2 devstack@n-api.service[129410]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:16:00.612874 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 18:16:00.616198 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'body': {'server': {'name': 'tempest-server-tempest-TestSecurityGroupsBasicOps-1600343209-access_point-155598812', 'imageRef': 'a735ff26-463a-4ffe-a981-ab9d9baa494f', 'flavorRef': '452', 'networks': [{'uuid': '9d513d83-2933-403d-8a90-ce949b2dfd74'}], 'key_name': 'tempest-TestSecurityGroupsBasicOps-223469413', 'security_groups': [{'name': 'tempest-secgroup_access--1116700652'}, {'name': 'tempest-secgroup_general--1714634861'}]}, 'os:scheduler_hints': {'different_host': []}}} Aug 10 18:16:00.616198 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 18:16:00.616198 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:16:00.616198 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:16:00.616198 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:16:00.616198 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:16:00.616198 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:16:00.616198 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:16:00.616198 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:16:00.616198 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:16:00.616198 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:16:00.616198 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 18:16:00.616198 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 18:16:00.616198 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 18:16:00.616198 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 18:16:00.616198 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 18:16:00.616198 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 18:16:00.616198 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 18:16:00.616198 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 18:16:00.616198 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 18:16:00.616198 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 18:16:00.616198 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 18:16:00.616198 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 18:16:00.616198 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 18:16:00.616198 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 18:16:00.616198 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 18:16:00.616198 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 18:16:00.616198 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 18:16:00.616198 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:16:00.616198 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:16:00.616198 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 18:16:00.616198 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 18:16:00.616198 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:16:00.616198 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:16:00.616198 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 18:16:00.616198 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 18:16:00.616198 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:16:00.616198 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:16:00.616198 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:16:00.616198 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:16:00.616198 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:16:00.616198 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:16:00.616198 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 18:16:00.616198 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 18:16:00.616198 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 18:16:00.616198 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 18:16:00.616198 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 18:16:00.616198 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 18:16:00.616198 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 18:16:00.616198 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 18:16:00.616198 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 18:16:00.616198 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 18:16:00.616198 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 18:16:00.619402 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 18:16:00.619402 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 18:16:00.619402 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 18:16:00.619402 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 18:16:00.619402 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 18:16:00.619402 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 18:16:00.619402 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 18:16:00.619402 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 18:16:00.619402 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 18:16:00.619402 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 18:16:00.619402 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 18:16:00.619402 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 18:16:00.619402 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 18:16:00.619402 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 18:16:00.619402 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 18:16:00.619402 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-e4707c47-14d2-4354-a920-89f6f5f2b445) Aug 10 18:16:00.619402 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:16:00.619402 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:16:00.619402 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:16:00.619402 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:16:00.619402 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:16:00.619402 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:16:00.619402 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 18:16:00.619402 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 18:16:00.619402 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 10 18:16:00.619402 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 10 18:16:00.619402 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:16:00.619402 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:16:00.619402 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:16:00.619402 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:16:00.619402 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:16:00.619402 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:16:00.619402 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:16:00.619402 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:16:00.619402 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 18:16:00.619402 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 18:16:00.619402 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:16:00.619402 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:16:00.619402 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:16:00.619402 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-efa986c7-a5bf-414e-b0c5-f8baee40908b tempest-TestSecurityGroupsBasicOps-1600343209 tempest-TestSecurityGroupsBasicOps-1600343209-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:16:00.619402 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 18:16:00.628496 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-efa986c7-a5bf-414e-b0c5-f8baee40908b tempest-TestSecurityGroupsBasicOps-1600343209 tempest-TestSecurityGroupsBasicOps-1600343209-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.902044 Aug 10 18:16:00.628730 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 1046/2116] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 18:15:58 2022] POST /compute/v2.1/servers => generated 214 bytes in 1916 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 10 18:16:03.912546 n-d-852296-2 devstack@n-api.service[129409]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 18:16:03.912999 n-d-852296-2 devstack@n-api.service[129409]: Wed Aug 10 18:16:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 18:16:09.355197 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_cell0:SELECT=4 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 18:16:09.361412 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-27a31042-3890-4c68-b2c1-2784ac4689a6 tempest-TestSecurityGroupsBasicOps-1600343209 tempest-TestSecurityGroupsBasicOps-1600343209-project] Calling method '.version_select at 0x7fb346178b80>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:16:09.473353 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-27a31042-3890-4c68-b2c1-2784ac4689a6 tempest-TestSecurityGroupsBasicOps-1600343209 tempest-TestSecurityGroupsBasicOps-1600343209-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-223469413" status: 202 len: 0 microversion: 2.1 time: 0.119097 Aug 10 18:16:09.474020 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1071/2117] 10.222.0.50 () {58 vars in 1275 bytes} [Wed Aug 10 18:16:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-223469413 => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 18:16:44.937098 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-219700bf-e99f-4dbc-afb4-4297f1c68221 tempest-TestVolumeBootPattern-643594796 tempest-TestVolumeBootPattern-643594796-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1649542909", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "7036c788-8d10-43ea-a9de-d29b02d6dbbf", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "495f27ec-1384-4fe6-8f96-b830e27d049a"}]}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 18:16:45.021052 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.network.neutron [None req-219700bf-e99f-4dbc-afb4-4297f1c68221 tempest-TestVolumeBootPattern-643594796 tempest-TestVolumeBootPattern-643594796-project] validate_networks() for [('495f27ec-1384-4fe6-8f96-b830e27d049a', None, None, None, None, None)] {{(pid=129410) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 18:16:45.347220 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [None req-219700bf-e99f-4dbc-afb4-4297f1c68221 tempest-TestVolumeBootPattern-643594796 tempest-TestVolumeBootPattern-643594796-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-92ecb16c-344f-4f1f-ad6f-2e90463853de) Aug 10 18:16:45.347220 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:16:45.347220 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:16:45.347220 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:16:45.347220 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:16:45.347220 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:16:45.347220 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:16:45.347220 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:16:45.347220 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:16:45.347220 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:16:45.347220 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 18:16:45.347220 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 18:16:45.347220 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 18:16:45.347220 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 18:16:45.347220 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 18:16:45.347220 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 18:16:45.347220 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 18:16:45.347220 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 18:16:45.347220 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 18:16:45.347220 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 18:16:45.347220 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 18:16:45.347220 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 18:16:45.347220 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 18:16:45.347220 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 18:16:45.347220 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 18:16:45.347220 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 18:16:45.347220 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 18:16:45.347220 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:16:45.347220 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:16:45.347220 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 18:16:45.347220 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 18:16:45.347220 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:16:45.347220 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:16:45.347220 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 18:16:45.347220 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 18:16:45.347220 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:16:45.347220 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:16:45.347220 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:16:45.347220 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:16:45.347220 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:16:45.347220 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:16:45.347220 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 18:16:45.347220 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 18:16:45.347220 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 18:16:45.347220 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 18:16:45.347220 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 18:16:45.347220 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 18:16:45.347220 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 18:16:45.347220 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 18:16:45.347220 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 18:16:45.347220 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 18:16:45.347220 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 18:16:45.347220 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 18:16:45.351242 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 18:16:45.351242 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 18:16:45.351242 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 18:16:45.351242 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 18:16:45.351242 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 18:16:45.351242 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 18:16:45.351242 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 18:16:45.351242 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 18:16:45.351242 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 18:16:45.351242 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 18:16:45.351242 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 18:16:45.351242 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 18:16:45.351242 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 18:16:45.351242 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 18:16:45.351242 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-92ecb16c-344f-4f1f-ad6f-2e90463853de) Aug 10 18:16:45.351242 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:16:45.351242 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-219700bf-e99f-4dbc-afb4-4297f1c68221 tempest-TestVolumeBootPattern-643594796 tempest-TestVolumeBootPattern-643594796-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:16:45.351242 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 18:16:45.353739 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-219700bf-e99f-4dbc-afb4-4297f1c68221 tempest-TestVolumeBootPattern-643594796 tempest-TestVolumeBootPattern-643594796-project] Request method failure captured: Aug 10 18:16:45.353739 n-d-852296-2 devstack@n-api.service[129410]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 18:16:45.353739 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 18:16:45.353739 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 18:16:45.353739 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 18:16:45.353739 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 354 Aug 10 18:16:45.353739 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 18:16:45.353739 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 18:16:45.353739 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 18:16:45.353739 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 18:16:45.353739 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8_X6_Cd1R_YAkxcqY8aS9sKVlEHA1nkBOGiqWoNxiwA5OMdQulPHjpjWV_G5v5kdF8klxiJlPEyKVqMT4cgFCxHHVtjEpoaXcpXbblD17hZYy_ZP4wpw_OCo_tshb6UTZgOX38pWh-EnJBMLQvJjwgF-Gul05lzOuTqBbmH_KFAsOTE Aug 10 18:16:45.353739 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 18:16:45.353739 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 18:16:45.353739 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 18:16:45.353739 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 18:16:45.353739 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 18:16:45.353739 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 18:16:45.353739 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: 22d3725574964172b743b748cb00c039 Aug 10 18:16:45.353739 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-TestVolumeBootPattern-643594796 Aug 10 18:16:45.353739 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 18:16:45.353739 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 18:16:45.353739 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/22d3725574964172b743b748cb00c039"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/22d3725574964172b743b748cb00c039"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/22d3725574964172b743b748cb00c039"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_22d3725574964172b743b748cb00c039", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 18:16:45.353739 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-TestVolumeBootPattern-643594796 Aug 10 18:16:45.353739 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: 22d3725574964172b743b748cb00c039 Aug 10 18:16:45.353739 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-TestVolumeBootPattern-643594796 Aug 10 18:16:45.353739 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-TestVolumeBootPattern-643594796-project Aug 10 18:16:45.353739 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 18:16:45.353739 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 18:16:45.353739 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: abb93fabf84444c0974a197c6564a1fe Aug 10 18:16:45.353739 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-TestVolumeBootPattern-643594796-project Aug 10 18:16:45.353739 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 18:16:45.353739 n-d-852296-2 devstack@n-api.service[129410]: {"server": {"name": "tempest-TestVolumeBootPattern-server-1649542909", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "7036c788-8d10-43ea-a9de-d29b02d6dbbf", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "495f27ec-1384-4fe6-8f96-b830e27d049a"}]}} Aug 10 18:16:45.353739 n-d-852296-2 devstack@n-api.service[129410]: method: > Aug 10 18:16:45.353739 n-d-852296-2 devstack@n-api.service[129410]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:16:45.353739 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 18:16:45.353739 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'body': {'server': {'name': 'tempest-TestVolumeBootPattern-server-1649542909', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'volume', 'destination_type': 'volume', 'boot_index': 0, 'delete_on_termination': False, 'volume_id': '7036c788-8d10-43ea-a9de-d29b02d6dbbf'}], 'networks': [{'uuid': '495f27ec-1384-4fe6-8f96-b830e27d049a'}]}}} Aug 10 18:16:45.353739 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 18:16:45.353739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:16:45.353739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:16:45.353739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:16:45.353739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:16:45.353739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:16:45.353739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:16:45.353739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:16:45.353739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:16:45.353739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:16:45.353739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 18:16:45.353739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 18:16:45.353739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 18:16:45.353739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 18:16:45.353739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 18:16:45.353739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 18:16:45.353739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 18:16:45.353739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 18:16:45.353739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 18:16:45.353739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 18:16:45.353739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 18:16:45.353739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 18:16:45.353739 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 18:16:45.360103 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 18:16:45.360103 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 18:16:45.360103 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 18:16:45.360103 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 18:16:45.360103 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:16:45.360103 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:16:45.360103 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 18:16:45.360103 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 18:16:45.360103 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:16:45.360103 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:16:45.360103 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 18:16:45.360103 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 18:16:45.360103 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:16:45.360103 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:16:45.360103 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:16:45.360103 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:16:45.360103 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:16:45.360103 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:16:45.360103 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 18:16:45.360103 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 18:16:45.360103 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 18:16:45.360103 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 18:16:45.360103 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 18:16:45.360103 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 18:16:45.360103 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 18:16:45.360103 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 18:16:45.360103 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 18:16:45.360103 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 18:16:45.360103 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 18:16:45.360103 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 18:16:45.360103 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 18:16:45.360103 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 18:16:45.360103 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 18:16:45.360103 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 18:16:45.360103 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 18:16:45.360103 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 18:16:45.360103 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 18:16:45.360103 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 18:16:45.360103 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 18:16:45.360103 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 18:16:45.360103 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 18:16:45.360103 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 18:16:45.360103 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 18:16:45.360103 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 18:16:45.360103 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-92ecb16c-344f-4f1f-ad6f-2e90463853de) Aug 10 18:16:45.360103 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:16:45.360103 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:16:45.360103 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:16:45.360103 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:16:45.360103 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:16:45.360103 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:16:45.360103 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 18:16:45.360103 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 18:16:45.367748 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 10 18:16:45.367748 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 10 18:16:45.367748 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:16:45.367748 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:16:45.367748 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:16:45.367748 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:16:45.367748 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:16:45.367748 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:16:45.367748 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:16:45.367748 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:16:45.367748 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 18:16:45.367748 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 18:16:45.367748 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:16:45.367748 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:16:45.367748 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:16:45.367748 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-219700bf-e99f-4dbc-afb4-4297f1c68221 tempest-TestVolumeBootPattern-643594796 tempest-TestVolumeBootPattern-643594796-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:16:45.367748 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 18:16:45.367748 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-219700bf-e99f-4dbc-afb4-4297f1c68221 tempest-TestVolumeBootPattern-643594796 tempest-TestVolumeBootPattern-643594796-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.421349 Aug 10 18:16:45.367748 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 1047/2118] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 18:16:44 2022] POST /compute/v2.1/servers => generated 214 bytes in 423 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 10 18:16:54.750677 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-aeeda117-c7b8-49b6-b0e6-77633c15a1d9 tempest-TestVolumeBootPattern-643594796 tempest-TestVolumeBootPattern-643594796-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-467466994", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "8324ac7b-05c9-4eb3-aacc-84b66ad19bd2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "495f27ec-1384-4fe6-8f96-b830e27d049a"}]}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 18:16:55.027197 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.network.neutron [None req-aeeda117-c7b8-49b6-b0e6-77633c15a1d9 tempest-TestVolumeBootPattern-643594796 tempest-TestVolumeBootPattern-643594796-project] validate_networks() for [('495f27ec-1384-4fe6-8f96-b830e27d049a', None, None, None, None, None)] {{(pid=129409) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 18:16:55.294756 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [None req-aeeda117-c7b8-49b6-b0e6-77633c15a1d9 tempest-TestVolumeBootPattern-643594796 tempest-TestVolumeBootPattern-643594796-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-8f549c5f-e524-40cb-845d-d63faba2b835) Aug 10 18:16:55.294756 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:16:55.294756 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:16:55.294756 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:16:55.294756 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:16:55.294756 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:16:55.294756 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:16:55.294756 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:16:55.294756 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:16:55.294756 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:16:55.294756 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 18:16:55.294756 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 18:16:55.294756 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 18:16:55.294756 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 18:16:55.294756 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 18:16:55.294756 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 18:16:55.294756 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 18:16:55.294756 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 18:16:55.294756 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 18:16:55.294756 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 18:16:55.294756 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 18:16:55.294756 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 18:16:55.294756 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 18:16:55.294756 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 18:16:55.294756 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 18:16:55.294756 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 18:16:55.294756 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 18:16:55.294756 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:16:55.294756 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:16:55.294756 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 18:16:55.294756 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 18:16:55.294756 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:16:55.294756 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:16:55.294756 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 18:16:55.294756 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 18:16:55.294756 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:16:55.294756 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:16:55.294756 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:16:55.294756 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:16:55.294756 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:16:55.294756 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:16:55.294756 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 18:16:55.294756 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 18:16:55.294756 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 18:16:55.294756 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 18:16:55.294756 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 18:16:55.294756 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 18:16:55.294756 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 18:16:55.294756 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 18:16:55.294756 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 18:16:55.294756 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 18:16:55.294756 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 18:16:55.294756 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 18:16:55.298539 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 18:16:55.298539 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 18:16:55.298539 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 18:16:55.298539 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 18:16:55.298539 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 18:16:55.298539 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 18:16:55.298539 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 18:16:55.298539 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 18:16:55.298539 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 18:16:55.298539 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 18:16:55.298539 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 18:16:55.298539 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 18:16:55.298539 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 18:16:55.298539 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 18:16:55.298539 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-8f549c5f-e524-40cb-845d-d63faba2b835) Aug 10 18:16:55.298539 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:16:55.300402 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-aeeda117-c7b8-49b6-b0e6-77633c15a1d9 tempest-TestVolumeBootPattern-643594796 tempest-TestVolumeBootPattern-643594796-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:16:55.300402 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 18:16:55.303386 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-aeeda117-c7b8-49b6-b0e6-77633c15a1d9 tempest-TestVolumeBootPattern-643594796 tempest-TestVolumeBootPattern-643594796-project] Request method failure captured: Aug 10 18:16:55.303386 n-d-852296-2 devstack@n-api.service[129409]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 18:16:55.303386 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 18:16:55.303386 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 18:16:55.303386 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 18:16:55.303386 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 353 Aug 10 18:16:55.303386 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 18:16:55.303386 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 18:16:55.303386 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 18:16:55.303386 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 18:16:55.303386 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8_X6_Cd1R_YAkxcqY8aS9sKVlEHA1nkBOGiqWoNxiwA5OMdQulPHjpjWV_G5v5kdF8klxiJlPEyKVqMT4cgFCxHHVtjEpoaXcpXbblD17hZYy_ZP4wpw_OCo_tshb6UTZgOX38pWh-EnJBMLQvJjwgF-Gul05lzOuTqBbmH_KFAsOTE Aug 10 18:16:55.303386 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 18:16:55.303386 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 18:16:55.303386 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 18:16:55.303386 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 18:16:55.303386 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 18:16:55.303386 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 18:16:55.303386 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: 22d3725574964172b743b748cb00c039 Aug 10 18:16:55.303386 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-TestVolumeBootPattern-643594796 Aug 10 18:16:55.303386 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 18:16:55.303386 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 18:16:55.303386 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/22d3725574964172b743b748cb00c039"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/22d3725574964172b743b748cb00c039"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/22d3725574964172b743b748cb00c039"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_22d3725574964172b743b748cb00c039", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 18:16:55.303386 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-TestVolumeBootPattern-643594796 Aug 10 18:16:55.303386 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: 22d3725574964172b743b748cb00c039 Aug 10 18:16:55.303386 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-TestVolumeBootPattern-643594796 Aug 10 18:16:55.303386 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-TestVolumeBootPattern-643594796-project Aug 10 18:16:55.303386 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 18:16:55.303386 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 18:16:55.303386 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: abb93fabf84444c0974a197c6564a1fe Aug 10 18:16:55.303386 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-TestVolumeBootPattern-643594796-project Aug 10 18:16:55.303386 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 18:16:55.303386 n-d-852296-2 devstack@n-api.service[129409]: {"server": {"name": "tempest-TestVolumeBootPattern-server-467466994", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "8324ac7b-05c9-4eb3-aacc-84b66ad19bd2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "495f27ec-1384-4fe6-8f96-b830e27d049a"}]}} Aug 10 18:16:55.303386 n-d-852296-2 devstack@n-api.service[129409]: method: > Aug 10 18:16:55.303386 n-d-852296-2 devstack@n-api.service[129409]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:16:55.303386 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 18:16:55.303386 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'body': {'server': {'name': 'tempest-TestVolumeBootPattern-server-467466994', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'volume', 'destination_type': 'volume', 'boot_index': 0, 'delete_on_termination': False, 'volume_id': '8324ac7b-05c9-4eb3-aacc-84b66ad19bd2'}], 'networks': [{'uuid': '495f27ec-1384-4fe6-8f96-b830e27d049a'}]}}} Aug 10 18:16:55.303386 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 18:16:55.303386 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:16:55.303386 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:16:55.303386 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:16:55.303386 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:16:55.303386 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:16:55.303386 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:16:55.303386 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:16:55.303386 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:16:55.303386 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:16:55.303386 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 18:16:55.303386 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 18:16:55.303386 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 18:16:55.303386 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 18:16:55.303386 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 18:16:55.303386 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 18:16:55.303386 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 18:16:55.303386 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 18:16:55.303386 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 18:16:55.303386 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 18:16:55.303386 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 18:16:55.303386 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 18:16:55.303386 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 18:16:55.307596 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 18:16:55.307596 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 18:16:55.307596 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 18:16:55.307596 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 18:16:55.307596 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:16:55.307596 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:16:55.307596 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 18:16:55.307596 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 18:16:55.307596 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:16:55.307596 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:16:55.307596 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 18:16:55.307596 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 18:16:55.307596 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:16:55.307596 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:16:55.307596 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:16:55.307596 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:16:55.307596 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:16:55.307596 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:16:55.307596 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 18:16:55.307596 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 18:16:55.307596 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 18:16:55.307596 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 18:16:55.307596 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 18:16:55.307596 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 18:16:55.307596 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 18:16:55.307596 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 18:16:55.307596 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 18:16:55.307596 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 18:16:55.307596 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 18:16:55.307596 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 18:16:55.307596 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 18:16:55.307596 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 18:16:55.307596 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 18:16:55.307596 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 18:16:55.307596 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 18:16:55.307596 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 18:16:55.307596 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 18:16:55.307596 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 18:16:55.307596 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 18:16:55.307596 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 18:16:55.307596 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 18:16:55.307596 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 18:16:55.307596 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 18:16:55.307596 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 18:16:55.307596 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-8f549c5f-e524-40cb-845d-d63faba2b835) Aug 10 18:16:55.307596 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:16:55.307596 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:16:55.307596 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:16:55.307596 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:16:55.307596 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:16:55.307596 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:16:55.307596 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 18:16:55.307596 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 18:16:55.317101 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 10 18:16:55.317101 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 10 18:16:55.317101 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:16:55.317101 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:16:55.317101 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:16:55.317101 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:16:55.317101 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:16:55.317101 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:16:55.317101 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:16:55.317101 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:16:55.317101 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 18:16:55.317101 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 18:16:55.317101 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:16:55.317101 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:16:55.317101 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:16:55.317101 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-aeeda117-c7b8-49b6-b0e6-77633c15a1d9 tempest-TestVolumeBootPattern-643594796 tempest-TestVolumeBootPattern-643594796-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:16:55.317101 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 18:16:55.317101 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-aeeda117-c7b8-49b6-b0e6-77633c15a1d9 tempest-TestVolumeBootPattern-643594796 tempest-TestVolumeBootPattern-643594796-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.559385 Aug 10 18:16:55.317101 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1072/2119] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 18:16:54 2022] POST /compute/v2.1/servers => generated 214 bytes in 561 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 10 18:17:15.263907 n-d-852296-2 devstack@n-api.service[129410]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 18:17:15.264478 n-d-852296-2 devstack@n-api.service[129410]: Wed Aug 10 18:17:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 18:17:16.242402 n-d-852296-2 devstack@n-api.service[129409]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 18:17:16.242868 n-d-852296-2 devstack@n-api.service[129409]: Wed Aug 10 18:17:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 18:17:54.194627 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_api:SELECT=6 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 18:17:54.199109 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-9bbf6534-8e15-4afc-8f1b-11e0af352c49 tempest-TestVolumeBootPattern-643594796 tempest-TestVolumeBootPattern-643594796-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-730630751", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "cb7c972d-d522-47b0-bad6-0347918995bc", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "495f27ec-1384-4fe6-8f96-b830e27d049a"}]}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 18:17:54.288788 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.network.neutron [None req-9bbf6534-8e15-4afc-8f1b-11e0af352c49 tempest-TestVolumeBootPattern-643594796 tempest-TestVolumeBootPattern-643594796-project] validate_networks() for [('495f27ec-1384-4fe6-8f96-b830e27d049a', None, None, None, None, None)] {{(pid=129410) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 18:17:54.504817 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [None req-9bbf6534-8e15-4afc-8f1b-11e0af352c49 tempest-TestVolumeBootPattern-643594796 tempest-TestVolumeBootPattern-643594796-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-489b0ed3-ec40-447e-8782-1ff39f449033) Aug 10 18:17:54.504817 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:17:54.504817 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:17:54.504817 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:17:54.504817 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:17:54.504817 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:17:54.504817 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:17:54.504817 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:17:54.504817 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:17:54.504817 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:17:54.504817 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 18:17:54.504817 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 18:17:54.504817 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 18:17:54.504817 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 18:17:54.504817 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 18:17:54.504817 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 18:17:54.504817 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 18:17:54.504817 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 18:17:54.504817 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 18:17:54.504817 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 18:17:54.504817 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 18:17:54.504817 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 18:17:54.504817 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 18:17:54.504817 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 18:17:54.504817 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 18:17:54.504817 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 18:17:54.504817 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 18:17:54.504817 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:17:54.504817 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:17:54.504817 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 18:17:54.504817 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 18:17:54.504817 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:17:54.504817 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:17:54.504817 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 18:17:54.504817 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 18:17:54.504817 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:17:54.504817 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:17:54.504817 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:17:54.504817 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:17:54.504817 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:17:54.504817 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:17:54.504817 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 18:17:54.504817 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 18:17:54.504817 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 18:17:54.504817 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 18:17:54.504817 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 18:17:54.504817 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 18:17:54.504817 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 18:17:54.504817 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 18:17:54.504817 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 18:17:54.504817 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 18:17:54.504817 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 18:17:54.504817 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 18:17:54.514570 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 18:17:54.514570 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 18:17:54.514570 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 18:17:54.514570 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 18:17:54.514570 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 18:17:54.514570 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 18:17:54.514570 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 18:17:54.514570 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 18:17:54.514570 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 18:17:54.514570 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 18:17:54.514570 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 18:17:54.514570 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 18:17:54.514570 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 18:17:54.514570 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 18:17:54.514570 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-489b0ed3-ec40-447e-8782-1ff39f449033) Aug 10 18:17:54.514570 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:17:54.514570 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-9bbf6534-8e15-4afc-8f1b-11e0af352c49 tempest-TestVolumeBootPattern-643594796 tempest-TestVolumeBootPattern-643594796-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:17:54.514570 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 18:17:54.514570 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-9bbf6534-8e15-4afc-8f1b-11e0af352c49 tempest-TestVolumeBootPattern-643594796 tempest-TestVolumeBootPattern-643594796-project] Request method failure captured: Aug 10 18:17:54.514570 n-d-852296-2 devstack@n-api.service[129410]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 18:17:54.514570 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 18:17:54.514570 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 18:17:54.514570 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 18:17:54.514570 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 354 Aug 10 18:17:54.514570 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 18:17:54.514570 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 18:17:54.514570 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 18:17:54.514570 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 18:17:54.514570 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8_X6_Cd1R_YAkxcqY8aS9sKVlEHA1nkBOGiqWoNxiwA5OMdQulPHjpjWV_G5v5kdF8klxiJlPEyKVqMT4cgFCxHHVtjEpoaXcpXbblD17hZYy_ZP4wpw_OCo_tshb6UTZgOX38pWh-EnJBMLQvJjwgF-Gul05lzOuTqBbmH_KFAsOTE Aug 10 18:17:54.514570 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 18:17:54.514570 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 18:17:54.514570 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 18:17:54.514570 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 18:17:54.514570 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 18:17:54.514570 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 18:17:54.514570 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: 22d3725574964172b743b748cb00c039 Aug 10 18:17:54.514570 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-TestVolumeBootPattern-643594796 Aug 10 18:17:54.514570 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 18:17:54.514570 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 18:17:54.514570 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/22d3725574964172b743b748cb00c039"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/22d3725574964172b743b748cb00c039"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/22d3725574964172b743b748cb00c039"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_22d3725574964172b743b748cb00c039", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 18:17:54.514570 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-TestVolumeBootPattern-643594796 Aug 10 18:17:54.514570 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: 22d3725574964172b743b748cb00c039 Aug 10 18:17:54.514570 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-TestVolumeBootPattern-643594796 Aug 10 18:17:54.514570 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-TestVolumeBootPattern-643594796-project Aug 10 18:17:54.514570 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 18:17:54.514570 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 18:17:54.514570 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: abb93fabf84444c0974a197c6564a1fe Aug 10 18:17:54.514570 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-TestVolumeBootPattern-643594796-project Aug 10 18:17:54.514570 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 18:17:54.514570 n-d-852296-2 devstack@n-api.service[129410]: {"server": {"name": "tempest-TestVolumeBootPattern-server-730630751", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "cb7c972d-d522-47b0-bad6-0347918995bc", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "495f27ec-1384-4fe6-8f96-b830e27d049a"}]}} Aug 10 18:17:54.514570 n-d-852296-2 devstack@n-api.service[129410]: method: > Aug 10 18:17:54.514570 n-d-852296-2 devstack@n-api.service[129410]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:17:54.514570 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 18:17:54.520611 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'body': {'server': {'name': 'tempest-TestVolumeBootPattern-server-730630751', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'snapshot', 'destination_type': 'volume', 'boot_index': 0, 'delete_on_termination': True, 'snapshot_id': 'cb7c972d-d522-47b0-bad6-0347918995bc'}], 'networks': [{'uuid': '495f27ec-1384-4fe6-8f96-b830e27d049a'}]}}} Aug 10 18:17:54.520611 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 18:17:54.520611 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:17:54.520611 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:17:54.520611 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:17:54.520611 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:17:54.520611 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:17:54.520611 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:17:54.520611 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:17:54.520611 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:17:54.520611 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:17:54.520611 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 18:17:54.520611 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 18:17:54.520611 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 18:17:54.520611 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 18:17:54.520611 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 18:17:54.520611 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 18:17:54.520611 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 18:17:54.520611 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 18:17:54.520611 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 18:17:54.520611 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 18:17:54.520611 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 18:17:54.520611 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 18:17:54.520611 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 18:17:54.520611 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 18:17:54.520611 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 18:17:54.520611 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 18:17:54.520611 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 18:17:54.520611 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:17:54.520611 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:17:54.520611 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 18:17:54.520611 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 18:17:54.520611 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:17:54.520611 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:17:54.520611 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 18:17:54.520611 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 18:17:54.520611 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:17:54.520611 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:17:54.520611 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:17:54.520611 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:17:54.520611 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:17:54.520611 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:17:54.520611 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 18:17:54.520611 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 18:17:54.520611 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 18:17:54.520611 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 18:17:54.520611 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 18:17:54.520611 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 18:17:54.520611 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 18:17:54.520611 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 18:17:54.520611 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 18:17:54.520611 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 18:17:54.520611 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 18:17:54.520611 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 18:17:54.525514 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 18:17:54.525514 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 18:17:54.525514 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 18:17:54.525514 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 18:17:54.525514 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 18:17:54.525514 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 18:17:54.525514 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 18:17:54.525514 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 18:17:54.525514 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 18:17:54.525514 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 18:17:54.525514 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 18:17:54.525514 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 18:17:54.525514 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 18:17:54.525514 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 18:17:54.525514 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-489b0ed3-ec40-447e-8782-1ff39f449033) Aug 10 18:17:54.525514 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:17:54.525514 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:17:54.525514 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:17:54.525514 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:17:54.525514 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:17:54.525514 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:17:54.525514 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 18:17:54.525514 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 18:17:54.525514 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 10 18:17:54.525514 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 10 18:17:54.525514 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:17:54.525514 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:17:54.525514 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:17:54.525514 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:17:54.525514 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:17:54.525514 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:17:54.525514 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:17:54.525514 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:17:54.525514 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 18:17:54.525514 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 18:17:54.525514 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:17:54.525514 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:17:54.525514 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:17:54.525514 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-9bbf6534-8e15-4afc-8f1b-11e0af352c49 tempest-TestVolumeBootPattern-643594796 tempest-TestVolumeBootPattern-643594796-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:17:54.525514 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 18:17:54.525514 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-9bbf6534-8e15-4afc-8f1b-11e0af352c49 tempest-TestVolumeBootPattern-643594796 tempest-TestVolumeBootPattern-643594796-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.316889 Aug 10 18:17:54.525514 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 1048/2120] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 18:17:54 2022] POST /compute/v2.1/servers => generated 214 bytes in 319 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 10 18:18:08.749413 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_api:SELECT=20,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 18:18:08.757269 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-2cb9e8aa-1d75-423d-8752-a7106c03bfb7 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-637001952", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452"}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 18:18:08.840621 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.network.neutron [None req-2cb9e8aa-1d75-423d-8752-a7106c03bfb7 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] validate_networks() for None {{(pid=129409) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 18:18:09.188620 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.virt.hardware [None req-2cb9e8aa-1d75-423d-8752-a7106c03bfb7 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Flavor limits 0:0:0 {{(pid=129409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 18:18:09.193836 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.virt.hardware [None req-2cb9e8aa-1d75-423d-8752-a7106c03bfb7 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Image limits 0:0:0 {{(pid=129409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 18:18:09.194473 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.virt.hardware [None req-2cb9e8aa-1d75-423d-8752-a7106c03bfb7 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Flavor pref 0:0:0 {{(pid=129409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 18:18:09.194893 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.virt.hardware [None req-2cb9e8aa-1d75-423d-8752-a7106c03bfb7 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Image pref 0:0:0 {{(pid=129409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 18:18:09.195597 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.virt.hardware [None req-2cb9e8aa-1d75-423d-8752-a7106c03bfb7 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 18:18:09.206338 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-2cb9e8aa-1d75-423d-8752-a7106c03bfb7 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:18:09.207205 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-2cb9e8aa-1d75-423d-8752-a7106c03bfb7 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:18:09.207649 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-2cb9e8aa-1d75-423d-8752-a7106c03bfb7 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:18:09.208578 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-2cb9e8aa-1d75-423d-8752-a7106c03bfb7 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:18:09.209267 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-2cb9e8aa-1d75-423d-8752-a7106c03bfb7 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:18:09.209977 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-2cb9e8aa-1d75-423d-8752-a7106c03bfb7 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:18:09.237338 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-2cb9e8aa-1d75-423d-8752-a7106c03bfb7 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Getting quotas for project 6e41fefde7f54bb48362d6d171539114. Resources: {'instances', 'ram', 'cores'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 18:18:09.244226 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-2cb9e8aa-1d75-423d-8752-a7106c03bfb7 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Getting quotas for user 2fc780ad30504e1fa66a3be0cf7f2c37 and project 6e41fefde7f54bb48362d6d171539114. Resources: {'instances', 'ram', 'cores'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 18:18:09.262979 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-2cb9e8aa-1d75-423d-8752-a7106c03bfb7 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Going to run 1 instances... {{(pid=129409) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 18:18:09.267541 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-2cb9e8aa-1d75-423d-8752-a7106c03bfb7 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] [instance: db8c5bd8-e17b-4a51-9f14-7ab55193f642] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a735ff26-463a-4ffe-a981-ab9d9baa494f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 18:18:09.470590 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-2cb9e8aa-1d75-423d-8752-a7106c03bfb7 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.722333 Aug 10 18:18:09.478007 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1073/2121] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 18:18:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 725 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 18:18:09.483868 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-020d7587-5117-4f94-a3bb-657fa523b0f8 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:18:09.484499 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-020d7587-5117-4f94-a3bb-657fa523b0f8 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] [instance: db8c5bd8-e17b-4a51-9f14-7ab55193f642] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:18:09.546830 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-020d7587-5117-4f94-a3bb-657fa523b0f8 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc780ad30504e1fa66a3be0cf7f2c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41fefde7f54bb48362d6d171539114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:18:09.554452 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-020d7587-5117-4f94-a3bb-657fa523b0f8 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] 10.222.0.50 "GET /compute/v2.1/servers/db8c5bd8-e17b-4a51-9f14-7ab55193f642" status: 200 len: 1214 microversion: 2.1 time: 0.074999 Aug 10 18:18:09.556055 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 1049/2122] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 18:18:09 2022] GET /compute/v2.1/servers/db8c5bd8-e17b-4a51-9f14-7ab55193f642 => generated 1214 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 18:18:10.577795 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-30283b67-4ea6-487b-94e3-6985cafd7279 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:18:10.578494 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-30283b67-4ea6-487b-94e3-6985cafd7279 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] [instance: db8c5bd8-e17b-4a51-9f14-7ab55193f642] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:18:10.653346 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-30283b67-4ea6-487b-94e3-6985cafd7279 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc780ad30504e1fa66a3be0cf7f2c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41fefde7f54bb48362d6d171539114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:18:10.679987 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-30283b67-4ea6-487b-94e3-6985cafd7279 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] 10.222.0.50 "GET /compute/v2.1/servers/db8c5bd8-e17b-4a51-9f14-7ab55193f642" status: 200 len: 1214 microversion: 2.1 time: 0.106381 Aug 10 18:18:10.681417 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1074/2123] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 18:18:10 2022] GET /compute/v2.1/servers/db8c5bd8-e17b-4a51-9f14-7ab55193f642 => generated 1214 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 18:18:11.703597 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-179fd8b6-564e-4978-b858-ffcc8d6970df tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:18:11.704513 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-179fd8b6-564e-4978-b858-ffcc8d6970df tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] [instance: db8c5bd8-e17b-4a51-9f14-7ab55193f642] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:18:11.762760 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-179fd8b6-564e-4978-b858-ffcc8d6970df tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc780ad30504e1fa66a3be0cf7f2c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41fefde7f54bb48362d6d171539114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:18:11.772145 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-179fd8b6-564e-4978-b858-ffcc8d6970df tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] 10.222.0.50 "GET /compute/v2.1/servers/db8c5bd8-e17b-4a51-9f14-7ab55193f642" status: 200 len: 1214 microversion: 2.1 time: 0.073146 Aug 10 18:18:11.772826 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 1050/2124] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 18:18:11 2022] GET /compute/v2.1/servers/db8c5bd8-e17b-4a51-9f14-7ab55193f642 => generated 1214 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 18:18:12.793855 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-016fe81e-ad6b-44e7-8e2f-4cfeace669e8 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:18:12.795130 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-016fe81e-ad6b-44e7-8e2f-4cfeace669e8 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] [instance: db8c5bd8-e17b-4a51-9f14-7ab55193f642] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:18:12.803326 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-016fe81e-ad6b-44e7-8e2f-4cfeace669e8 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:18:12.804286 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-016fe81e-ad6b-44e7-8e2f-4cfeace669e8 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:18:12.804949 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-016fe81e-ad6b-44e7-8e2f-4cfeace669e8 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:18:12.806738 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-016fe81e-ad6b-44e7-8e2f-4cfeace669e8 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:18:12.807687 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-016fe81e-ad6b-44e7-8e2f-4cfeace669e8 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:18:12.808391 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-016fe81e-ad6b-44e7-8e2f-4cfeace669e8 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:18:12.910433 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-016fe81e-ad6b-44e7-8e2f-4cfeace669e8 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc780ad30504e1fa66a3be0cf7f2c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41fefde7f54bb48362d6d171539114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:18:12.919979 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-016fe81e-ad6b-44e7-8e2f-4cfeace669e8 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] 10.222.0.50 "GET /compute/v2.1/servers/db8c5bd8-e17b-4a51-9f14-7ab55193f642" status: 200 len: 1210 microversion: 2.1 time: 0.130051 Aug 10 18:18:12.921408 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1075/2125] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 18:18:12 2022] GET /compute/v2.1/servers/db8c5bd8-e17b-4a51-9f14-7ab55193f642 => generated 1210 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 18:18:13.944580 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-d03050dc-5800-4f4f-a167-5c620872ee0d tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:18:13.945864 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-d03050dc-5800-4f4f-a167-5c620872ee0d tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] [instance: db8c5bd8-e17b-4a51-9f14-7ab55193f642] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:18:13.964188 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d03050dc-5800-4f4f-a167-5c620872ee0d tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:18:13.964716 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d03050dc-5800-4f4f-a167-5c620872ee0d tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:18:13.968098 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d03050dc-5800-4f4f-a167-5c620872ee0d tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:18:13.973342 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d03050dc-5800-4f4f-a167-5c620872ee0d tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:18:13.974123 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d03050dc-5800-4f4f-a167-5c620872ee0d tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:18:13.974589 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-d03050dc-5800-4f4f-a167-5c620872ee0d tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:18:14.143444 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-d03050dc-5800-4f4f-a167-5c620872ee0d tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc780ad30504e1fa66a3be0cf7f2c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41fefde7f54bb48362d6d171539114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:18:14.152186 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-d03050dc-5800-4f4f-a167-5c620872ee0d tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] 10.222.0.50 "GET /compute/v2.1/servers/db8c5bd8-e17b-4a51-9f14-7ab55193f642" status: 200 len: 1274 microversion: 2.1 time: 0.213814 Aug 10 18:18:14.156055 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 1051/2126] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 18:18:13 2022] GET /compute/v2.1/servers/db8c5bd8-e17b-4a51-9f14-7ab55193f642 => generated 1274 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 18:18:15.191682 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-035f9135-d81e-4e12-8d4d-b0ebaded49ef tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:18:15.192360 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-035f9135-d81e-4e12-8d4d-b0ebaded49ef tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] [instance: db8c5bd8-e17b-4a51-9f14-7ab55193f642] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:18:15.209812 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-035f9135-d81e-4e12-8d4d-b0ebaded49ef tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:18:15.209812 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-035f9135-d81e-4e12-8d4d-b0ebaded49ef tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:18:15.209812 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-035f9135-d81e-4e12-8d4d-b0ebaded49ef tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:18:15.209812 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-035f9135-d81e-4e12-8d4d-b0ebaded49ef tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:18:15.209812 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-035f9135-d81e-4e12-8d4d-b0ebaded49ef tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:18:15.209812 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-035f9135-d81e-4e12-8d4d-b0ebaded49ef tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:18:15.395670 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-035f9135-d81e-4e12-8d4d-b0ebaded49ef tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc780ad30504e1fa66a3be0cf7f2c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41fefde7f54bb48362d6d171539114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:18:15.404948 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-035f9135-d81e-4e12-8d4d-b0ebaded49ef tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] 10.222.0.50 "GET /compute/v2.1/servers/db8c5bd8-e17b-4a51-9f14-7ab55193f642" status: 200 len: 1314 microversion: 2.1 time: 0.216752 Aug 10 18:18:15.420460 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1076/2127] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 18:18:15 2022] GET /compute/v2.1/servers/db8c5bd8-e17b-4a51-9f14-7ab55193f642 => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 18:18:16.435024 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-7ea2eadb-db2c-4028-adf1-82f8d19122a2 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:18:16.435580 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-7ea2eadb-db2c-4028-adf1-82f8d19122a2 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] [instance: db8c5bd8-e17b-4a51-9f14-7ab55193f642] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:18:16.442684 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-7ea2eadb-db2c-4028-adf1-82f8d19122a2 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:18:16.443165 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-7ea2eadb-db2c-4028-adf1-82f8d19122a2 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:18:16.443590 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-7ea2eadb-db2c-4028-adf1-82f8d19122a2 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:18:16.444295 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-7ea2eadb-db2c-4028-adf1-82f8d19122a2 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:18:16.444746 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-7ea2eadb-db2c-4028-adf1-82f8d19122a2 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:18:16.445162 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-7ea2eadb-db2c-4028-adf1-82f8d19122a2 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:18:16.664166 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-7ea2eadb-db2c-4028-adf1-82f8d19122a2 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc780ad30504e1fa66a3be0cf7f2c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41fefde7f54bb48362d6d171539114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:18:16.664166 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-7ea2eadb-db2c-4028-adf1-82f8d19122a2 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] 10.222.0.50 "GET /compute/v2.1/servers/db8c5bd8-e17b-4a51-9f14-7ab55193f642" status: 200 len: 1314 microversion: 2.1 time: 0.175670 Aug 10 18:18:16.664166 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 1052/2128] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 18:18:16 2022] GET /compute/v2.1/servers/db8c5bd8-e17b-4a51-9f14-7ab55193f642 => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 18:18:17.634936 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-102ea094-47d5-44ea-9d76-f881b22d2667 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:18:17.635546 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-102ea094-47d5-44ea-9d76-f881b22d2667 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] [instance: db8c5bd8-e17b-4a51-9f14-7ab55193f642] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:18:17.656086 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-102ea094-47d5-44ea-9d76-f881b22d2667 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:18:17.657087 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-102ea094-47d5-44ea-9d76-f881b22d2667 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:18:17.657087 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-102ea094-47d5-44ea-9d76-f881b22d2667 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:18:17.668098 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-102ea094-47d5-44ea-9d76-f881b22d2667 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:18:17.668098 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-102ea094-47d5-44ea-9d76-f881b22d2667 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:18:17.668098 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-102ea094-47d5-44ea-9d76-f881b22d2667 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:18:17.881353 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-102ea094-47d5-44ea-9d76-f881b22d2667 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc780ad30504e1fa66a3be0cf7f2c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41fefde7f54bb48362d6d171539114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:18:17.891560 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-102ea094-47d5-44ea-9d76-f881b22d2667 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] 10.222.0.50 "GET /compute/v2.1/servers/db8c5bd8-e17b-4a51-9f14-7ab55193f642" status: 200 len: 1314 microversion: 2.1 time: 0.260389 Aug 10 18:18:17.893574 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1077/2129] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 18:18:17 2022] GET /compute/v2.1/servers/db8c5bd8-e17b-4a51-9f14-7ab55193f642 => generated 1314 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 18:18:17.903996 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [req-e47cd780-fa44-4ed9-bc25-427c7d4d4624 req-9be6934b-7583-486d-a4f7-c36697393d83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db8c5bd8-e17b-4a51-9f14-7ab55193f642", "tag": "0ba368a2-976d-4ff5-bf7a-7117cdf57449"}]} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 18:18:17.909390 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-e47cd780-fa44-4ed9-bc25-427c7d4d4624 req-9be6934b-7583-486d-a4f7-c36697393d83 service nova] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:18:17.910608 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-e47cd780-fa44-4ed9-bc25-427c7d4d4624 req-9be6934b-7583-486d-a4f7-c36697393d83 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:18:17.911683 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-e47cd780-fa44-4ed9-bc25-427c7d4d4624 req-9be6934b-7583-486d-a4f7-c36697393d83 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:18:17.946989 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.compute.server_external_events [req-e47cd780-fa44-4ed9-bc25-427c7d4d4624 req-9be6934b-7583-486d-a4f7-c36697393d83 service nova] Creating event network-changed:0ba368a2-976d-4ff5-bf7a-7117cdf57449 for instance db8c5bd8-e17b-4a51-9f14-7ab55193f642 on n-h1-852296-2 Aug 10 18:18:17.946989 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [req-e47cd780-fa44-4ed9-bc25-427c7d4d4624 req-9be6934b-7583-486d-a4f7-c36697393d83 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.295025 Aug 10 18:18:17.946989 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 1053/2130] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 10 18:18:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 18:18:18.918418 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-dd7f4101-6756-4ebb-b582-02afb7ec30e6 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:18:18.919164 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-dd7f4101-6756-4ebb-b582-02afb7ec30e6 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] [instance: db8c5bd8-e17b-4a51-9f14-7ab55193f642] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:18:18.930216 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-dd7f4101-6756-4ebb-b582-02afb7ec30e6 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:18:18.930943 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-dd7f4101-6756-4ebb-b582-02afb7ec30e6 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:18:18.931491 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-dd7f4101-6756-4ebb-b582-02afb7ec30e6 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:18:18.932344 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-dd7f4101-6756-4ebb-b582-02afb7ec30e6 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:18:18.933071 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-dd7f4101-6756-4ebb-b582-02afb7ec30e6 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:18:18.933738 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-dd7f4101-6756-4ebb-b582-02afb7ec30e6 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:18:19.094860 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-dd7f4101-6756-4ebb-b582-02afb7ec30e6 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc780ad30504e1fa66a3be0cf7f2c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41fefde7f54bb48362d6d171539114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:18:19.103995 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-dd7f4101-6756-4ebb-b582-02afb7ec30e6 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] 10.222.0.50 "GET /compute/v2.1/servers/db8c5bd8-e17b-4a51-9f14-7ab55193f642" status: 200 len: 1314 microversion: 2.1 time: 0.189930 Aug 10 18:18:19.105952 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1078/2131] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 18:18:18 2022] GET /compute/v2.1/servers/db8c5bd8-e17b-4a51-9f14-7ab55193f642 => generated 1314 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 18:18:20.129238 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-b1d405eb-0efb-4eca-b1ca-e649dc31ccd4 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:18:20.130671 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-b1d405eb-0efb-4eca-b1ca-e649dc31ccd4 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] [instance: db8c5bd8-e17b-4a51-9f14-7ab55193f642] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:18:20.139012 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b1d405eb-0efb-4eca-b1ca-e649dc31ccd4 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:18:20.139751 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b1d405eb-0efb-4eca-b1ca-e649dc31ccd4 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:18:20.140483 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b1d405eb-0efb-4eca-b1ca-e649dc31ccd4 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:18:20.141449 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b1d405eb-0efb-4eca-b1ca-e649dc31ccd4 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:18:20.142174 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b1d405eb-0efb-4eca-b1ca-e649dc31ccd4 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:18:20.144044 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-b1d405eb-0efb-4eca-b1ca-e649dc31ccd4 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:18:20.297299 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-b1d405eb-0efb-4eca-b1ca-e649dc31ccd4 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc780ad30504e1fa66a3be0cf7f2c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41fefde7f54bb48362d6d171539114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:18:20.305895 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-b1d405eb-0efb-4eca-b1ca-e649dc31ccd4 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] 10.222.0.50 "GET /compute/v2.1/servers/db8c5bd8-e17b-4a51-9f14-7ab55193f642" status: 200 len: 1314 microversion: 2.1 time: 0.183411 Aug 10 18:18:20.306465 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 1054/2132] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 18:18:20 2022] GET /compute/v2.1/servers/db8c5bd8-e17b-4a51-9f14-7ab55193f642 => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 18:18:21.327163 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-2a0f914d-6ca0-42db-ace3-246804830041 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:18:21.328009 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-2a0f914d-6ca0-42db-ace3-246804830041 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] [instance: db8c5bd8-e17b-4a51-9f14-7ab55193f642] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:18:21.334331 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_cell0:SELECT=2 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 18:18:21.335161 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_cell0:SELECT=8 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 18:18:21.336775 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-2a0f914d-6ca0-42db-ace3-246804830041 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:18:21.337267 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-2a0f914d-6ca0-42db-ace3-246804830041 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:18:21.337713 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-2a0f914d-6ca0-42db-ace3-246804830041 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:18:21.338671 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-2a0f914d-6ca0-42db-ace3-246804830041 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:18:21.339371 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-2a0f914d-6ca0-42db-ace3-246804830041 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:18:21.339810 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-2a0f914d-6ca0-42db-ace3-246804830041 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:18:21.506124 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-2a0f914d-6ca0-42db-ace3-246804830041 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc780ad30504e1fa66a3be0cf7f2c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41fefde7f54bb48362d6d171539114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:18:21.514831 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-2a0f914d-6ca0-42db-ace3-246804830041 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] 10.222.0.50 "GET /compute/v2.1/servers/db8c5bd8-e17b-4a51-9f14-7ab55193f642" status: 200 len: 1314 microversion: 2.1 time: 0.192027 Aug 10 18:18:21.519877 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1079/2133] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 18:18:21 2022] GET /compute/v2.1/servers/db8c5bd8-e17b-4a51-9f14-7ab55193f642 => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 18:18:22.535274 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-8516f2e6-9f79-4cf9-91f6-71b6ccba132d tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:18:22.535976 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-8516f2e6-9f79-4cf9-91f6-71b6ccba132d tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] [instance: db8c5bd8-e17b-4a51-9f14-7ab55193f642] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:18:22.538740 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_cell0:SELECT=4 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 18:18:22.543723 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-8516f2e6-9f79-4cf9-91f6-71b6ccba132d tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:18:22.544210 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-8516f2e6-9f79-4cf9-91f6-71b6ccba132d tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:18:22.544891 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-8516f2e6-9f79-4cf9-91f6-71b6ccba132d tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:18:22.545638 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-8516f2e6-9f79-4cf9-91f6-71b6ccba132d tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:18:22.546150 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-8516f2e6-9f79-4cf9-91f6-71b6ccba132d tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:18:22.546628 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-8516f2e6-9f79-4cf9-91f6-71b6ccba132d tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:18:22.688106 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-8516f2e6-9f79-4cf9-91f6-71b6ccba132d tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc780ad30504e1fa66a3be0cf7f2c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41fefde7f54bb48362d6d171539114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:18:22.706063 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-8516f2e6-9f79-4cf9-91f6-71b6ccba132d tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] 10.222.0.50 "GET /compute/v2.1/servers/db8c5bd8-e17b-4a51-9f14-7ab55193f642" status: 200 len: 1314 microversion: 2.1 time: 0.173460 Aug 10 18:18:22.736202 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 1055/2134] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 18:18:22 2022] GET /compute/v2.1/servers/db8c5bd8-e17b-4a51-9f14-7ab55193f642 => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 18:18:23.727471 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-285efee6-d375-467e-8864-945b88f62bd8 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:18:23.728112 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-285efee6-d375-467e-8864-945b88f62bd8 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] [instance: db8c5bd8-e17b-4a51-9f14-7ab55193f642] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:18:23.735280 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-285efee6-d375-467e-8864-945b88f62bd8 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:18:23.736414 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-285efee6-d375-467e-8864-945b88f62bd8 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:18:23.737070 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-285efee6-d375-467e-8864-945b88f62bd8 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:18:23.737850 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-285efee6-d375-467e-8864-945b88f62bd8 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:18:23.738319 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-285efee6-d375-467e-8864-945b88f62bd8 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:18:23.738766 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-285efee6-d375-467e-8864-945b88f62bd8 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:18:23.897766 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-285efee6-d375-467e-8864-945b88f62bd8 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc780ad30504e1fa66a3be0cf7f2c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41fefde7f54bb48362d6d171539114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:18:23.918939 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-285efee6-d375-467e-8864-945b88f62bd8 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] 10.222.0.50 "GET /compute/v2.1/servers/db8c5bd8-e17b-4a51-9f14-7ab55193f642" status: 200 len: 1314 microversion: 2.1 time: 0.193118 Aug 10 18:18:23.920743 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1080/2135] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 18:18:23 2022] GET /compute/v2.1/servers/db8c5bd8-e17b-4a51-9f14-7ab55193f642 => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 18:18:24.567509 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [req-c97dc6be-41bb-4949-ab06-8c53b462105f req-68d00baa-ddc2-48ee-887f-80327180f36a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db8c5bd8-e17b-4a51-9f14-7ab55193f642", "name": "network-vif-plugged", "status": "completed", "tag": "0ba368a2-976d-4ff5-bf7a-7117cdf57449"}]} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 18:18:24.578725 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-c97dc6be-41bb-4949-ab06-8c53b462105f req-68d00baa-ddc2-48ee-887f-80327180f36a service nova] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:18:24.579198 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-c97dc6be-41bb-4949-ab06-8c53b462105f req-68d00baa-ddc2-48ee-887f-80327180f36a service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:18:24.579741 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [req-c97dc6be-41bb-4949-ab06-8c53b462105f req-68d00baa-ddc2-48ee-887f-80327180f36a service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:18:24.592377 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.compute.server_external_events [req-c97dc6be-41bb-4949-ab06-8c53b462105f req-68d00baa-ddc2-48ee-887f-80327180f36a service nova] Creating event network-vif-plugged:0ba368a2-976d-4ff5-bf7a-7117cdf57449 for instance db8c5bd8-e17b-4a51-9f14-7ab55193f642 on n-h1-852296-2 Aug 10 18:18:24.598630 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [req-c97dc6be-41bb-4949-ab06-8c53b462105f req-68d00baa-ddc2-48ee-887f-80327180f36a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114959 Aug 10 18:18:24.604016 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 1056/2136] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 10 18:18:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 18:18:24.941327 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-3c428350-7b53-4564-a24b-8c87eb8716f2 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:18:24.941951 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-3c428350-7b53-4564-a24b-8c87eb8716f2 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] [instance: db8c5bd8-e17b-4a51-9f14-7ab55193f642] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:18:24.948339 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-3c428350-7b53-4564-a24b-8c87eb8716f2 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:18:24.948833 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-3c428350-7b53-4564-a24b-8c87eb8716f2 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:18:24.949276 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-3c428350-7b53-4564-a24b-8c87eb8716f2 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:18:24.950019 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-3c428350-7b53-4564-a24b-8c87eb8716f2 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:18:24.950480 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-3c428350-7b53-4564-a24b-8c87eb8716f2 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:18:24.950912 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-3c428350-7b53-4564-a24b-8c87eb8716f2 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:18:25.109815 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-3c428350-7b53-4564-a24b-8c87eb8716f2 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc780ad30504e1fa66a3be0cf7f2c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41fefde7f54bb48362d6d171539114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:18:25.117941 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-3c428350-7b53-4564-a24b-8c87eb8716f2 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] 10.222.0.50 "GET /compute/v2.1/servers/db8c5bd8-e17b-4a51-9f14-7ab55193f642" status: 200 len: 1314 microversion: 2.1 time: 0.181592 Aug 10 18:18:25.118691 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1081/2137] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 18:18:24 2022] GET /compute/v2.1/servers/db8c5bd8-e17b-4a51-9f14-7ab55193f642 => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 18:18:26.140353 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-2ad1570c-e65d-4b6a-9866-dab3dc2e5c3a tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:18:26.141056 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-2ad1570c-e65d-4b6a-9866-dab3dc2e5c3a tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] [instance: db8c5bd8-e17b-4a51-9f14-7ab55193f642] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:18:26.147849 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2ad1570c-e65d-4b6a-9866-dab3dc2e5c3a tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:18:26.148761 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2ad1570c-e65d-4b6a-9866-dab3dc2e5c3a tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:18:26.149225 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2ad1570c-e65d-4b6a-9866-dab3dc2e5c3a tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:18:26.150224 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2ad1570c-e65d-4b6a-9866-dab3dc2e5c3a tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:18:26.150691 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2ad1570c-e65d-4b6a-9866-dab3dc2e5c3a tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:18:26.151117 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-2ad1570c-e65d-4b6a-9866-dab3dc2e5c3a tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:18:26.309490 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-2ad1570c-e65d-4b6a-9866-dab3dc2e5c3a tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc780ad30504e1fa66a3be0cf7f2c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41fefde7f54bb48362d6d171539114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:18:26.316972 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-2ad1570c-e65d-4b6a-9866-dab3dc2e5c3a tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] 10.222.0.50 "GET /compute/v2.1/servers/db8c5bd8-e17b-4a51-9f14-7ab55193f642" status: 200 len: 1314 microversion: 2.1 time: 0.181543 Aug 10 18:18:26.317550 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 1057/2138] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 18:18:26 2022] GET /compute/v2.1/servers/db8c5bd8-e17b-4a51-9f14-7ab55193f642 => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 18:18:27.338164 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-9f268996-76bf-4291-8ffe-80d99cc2cb61 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:18:27.338776 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-9f268996-76bf-4291-8ffe-80d99cc2cb61 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] [instance: db8c5bd8-e17b-4a51-9f14-7ab55193f642] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:18:27.345408 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-9f268996-76bf-4291-8ffe-80d99cc2cb61 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:18:27.346269 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-9f268996-76bf-4291-8ffe-80d99cc2cb61 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:18:27.346702 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-9f268996-76bf-4291-8ffe-80d99cc2cb61 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:18:27.347410 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-9f268996-76bf-4291-8ffe-80d99cc2cb61 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:18:27.347869 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-9f268996-76bf-4291-8ffe-80d99cc2cb61 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:18:27.348348 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-9f268996-76bf-4291-8ffe-80d99cc2cb61 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:18:27.482203 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-9f268996-76bf-4291-8ffe-80d99cc2cb61 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc780ad30504e1fa66a3be0cf7f2c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41fefde7f54bb48362d6d171539114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:18:27.490996 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-9f268996-76bf-4291-8ffe-80d99cc2cb61 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] 10.222.0.50 "GET /compute/v2.1/servers/db8c5bd8-e17b-4a51-9f14-7ab55193f642" status: 200 len: 1463 microversion: 2.1 time: 0.156336 Aug 10 18:18:27.491714 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1082/2139] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 18:18:27 2022] GET /compute/v2.1/servers/db8c5bd8-e17b-4a51-9f14-7ab55193f642 => generated 1463 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 18:18:27.551768 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-8289fd48-b6ff-4c6b-b32b-91a786729c23 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:18:27.552329 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-8289fd48-b6ff-4c6b-b32b-91a786729c23 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] [instance: db8c5bd8-e17b-4a51-9f14-7ab55193f642] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:18:27.558792 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-8289fd48-b6ff-4c6b-b32b-91a786729c23 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:18:27.560263 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-8289fd48-b6ff-4c6b-b32b-91a786729c23 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:18:27.560707 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-8289fd48-b6ff-4c6b-b32b-91a786729c23 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:18:27.561427 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-8289fd48-b6ff-4c6b-b32b-91a786729c23 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:18:27.561883 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-8289fd48-b6ff-4c6b-b32b-91a786729c23 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:18:27.562310 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-8289fd48-b6ff-4c6b-b32b-91a786729c23 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:18:27.589903 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-8289fd48-b6ff-4c6b-b32b-91a786729c23 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] [instance: db8c5bd8-e17b-4a51-9f14-7ab55193f642] Going to try to terminate instance {{(pid=129410) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 18:18:28.244427 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-8289fd48-b6ff-4c6b-b32b-91a786729c23 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] 10.222.0.50 "DELETE /compute/v2.1/servers/db8c5bd8-e17b-4a51-9f14-7ab55193f642" status: 204 len: 0 microversion: 2.1 time: 0.696927 Aug 10 18:18:28.245175 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 1058/2140] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 10 18:18:27 2022] DELETE /compute/v2.1/servers/db8c5bd8-e17b-4a51-9f14-7ab55193f642 => generated 0 bytes in 699 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 18:18:28.258694 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-ca116177-0d25-409e-a5fc-34218d630e51 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:18:28.259434 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-ca116177-0d25-409e-a5fc-34218d630e51 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] [instance: db8c5bd8-e17b-4a51-9f14-7ab55193f642] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:18:28.265726 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-ca116177-0d25-409e-a5fc-34218d630e51 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:18:28.266322 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-ca116177-0d25-409e-a5fc-34218d630e51 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:18:28.267530 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-ca116177-0d25-409e-a5fc-34218d630e51 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:18:28.268564 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-ca116177-0d25-409e-a5fc-34218d630e51 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:18:28.269252 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-ca116177-0d25-409e-a5fc-34218d630e51 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:18:28.269682 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-ca116177-0d25-409e-a5fc-34218d630e51 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:18:28.418280 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-ca116177-0d25-409e-a5fc-34218d630e51 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc780ad30504e1fa66a3be0cf7f2c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41fefde7f54bb48362d6d171539114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:18:28.427322 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-ca116177-0d25-409e-a5fc-34218d630e51 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] 10.222.0.50 "GET /compute/v2.1/servers/db8c5bd8-e17b-4a51-9f14-7ab55193f642" status: 200 len: 1469 microversion: 2.1 time: 0.172540 Aug 10 18:18:28.428160 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1083/2141] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 18:18:28 2022] GET /compute/v2.1/servers/db8c5bd8-e17b-4a51-9f14-7ab55193f642 => generated 1469 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 18:18:29.451099 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-fe47ef8d-dfc2-4b14-b6b2-9c1e1a63a96e tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:18:29.451921 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-fe47ef8d-dfc2-4b14-b6b2-9c1e1a63a96e tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] [instance: db8c5bd8-e17b-4a51-9f14-7ab55193f642] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:18:29.458745 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-fe47ef8d-dfc2-4b14-b6b2-9c1e1a63a96e tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:18:29.459299 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-fe47ef8d-dfc2-4b14-b6b2-9c1e1a63a96e tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:18:29.459840 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-fe47ef8d-dfc2-4b14-b6b2-9c1e1a63a96e tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:18:29.460741 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-fe47ef8d-dfc2-4b14-b6b2-9c1e1a63a96e tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:18:29.461260 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-fe47ef8d-dfc2-4b14-b6b2-9c1e1a63a96e tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:18:29.461750 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-fe47ef8d-dfc2-4b14-b6b2-9c1e1a63a96e tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:18:29.607295 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-fe47ef8d-dfc2-4b14-b6b2-9c1e1a63a96e tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc780ad30504e1fa66a3be0cf7f2c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41fefde7f54bb48362d6d171539114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:18:29.618464 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-fe47ef8d-dfc2-4b14-b6b2-9c1e1a63a96e tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] 10.222.0.50 "GET /compute/v2.1/servers/db8c5bd8-e17b-4a51-9f14-7ab55193f642" status: 200 len: 1469 microversion: 2.1 time: 0.171741 Aug 10 18:18:29.629019 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 1059/2142] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 18:18:29 2022] GET /compute/v2.1/servers/db8c5bd8-e17b-4a51-9f14-7ab55193f642 => generated 1469 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 18:18:30.565585 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [req-54fd5067-ae39-4545-8de1-11fb6d7edff2 req-628af6b5-b9aa-4cc2-9249-5b201957e9c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db8c5bd8-e17b-4a51-9f14-7ab55193f642", "name": "network-vif-deleted", "tag": "0ba368a2-976d-4ff5-bf7a-7117cdf57449"}]} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 18:18:30.580492 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-54fd5067-ae39-4545-8de1-11fb6d7edff2 req-628af6b5-b9aa-4cc2-9249-5b201957e9c9 service nova] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:18:30.581429 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-54fd5067-ae39-4545-8de1-11fb6d7edff2 req-628af6b5-b9aa-4cc2-9249-5b201957e9c9 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:18:30.582039 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-54fd5067-ae39-4545-8de1-11fb6d7edff2 req-628af6b5-b9aa-4cc2-9249-5b201957e9c9 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:18:30.602885 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.compute.server_external_events [req-54fd5067-ae39-4545-8de1-11fb6d7edff2 req-628af6b5-b9aa-4cc2-9249-5b201957e9c9 service nova] Creating event network-vif-deleted:0ba368a2-976d-4ff5-bf7a-7117cdf57449 for instance db8c5bd8-e17b-4a51-9f14-7ab55193f642 on n-h1-852296-2 Aug 10 18:18:30.613042 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [req-54fd5067-ae39-4545-8de1-11fb6d7edff2 req-628af6b5-b9aa-4cc2-9249-5b201957e9c9 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054142 Aug 10 18:18:30.617313 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1084/2143] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 10 18:18:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 18:18:30.648124 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-af5256d4-734f-4feb-a513-2a92bd6826bc tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:18:30.650349 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-af5256d4-734f-4feb-a513-2a92bd6826bc tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] [instance: db8c5bd8-e17b-4a51-9f14-7ab55193f642] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:18:30.663436 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-af5256d4-734f-4feb-a513-2a92bd6826bc tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:18:30.664225 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-af5256d4-734f-4feb-a513-2a92bd6826bc tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:18:30.664903 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-af5256d4-734f-4feb-a513-2a92bd6826bc tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:18:30.666265 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-af5256d4-734f-4feb-a513-2a92bd6826bc tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:18:30.666966 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-af5256d4-734f-4feb-a513-2a92bd6826bc tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:18:30.667636 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-af5256d4-734f-4feb-a513-2a92bd6826bc tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:18:30.793600 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-af5256d4-734f-4feb-a513-2a92bd6826bc tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc780ad30504e1fa66a3be0cf7f2c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41fefde7f54bb48362d6d171539114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:18:30.801753 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-af5256d4-734f-4feb-a513-2a92bd6826bc tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] 10.222.0.50 "GET /compute/v2.1/servers/db8c5bd8-e17b-4a51-9f14-7ab55193f642" status: 200 len: 1427 microversion: 2.1 time: 0.163932 Aug 10 18:18:30.804159 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 1060/2144] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 18:18:30 2022] GET /compute/v2.1/servers/db8c5bd8-e17b-4a51-9f14-7ab55193f642 => generated 1427 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 18:18:31.826937 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-f0a5aa2d-1b7a-4cf5-aae2-d9b762d5f3fa tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:18:31.827878 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-f0a5aa2d-1b7a-4cf5-aae2-d9b762d5f3fa tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] [instance: db8c5bd8-e17b-4a51-9f14-7ab55193f642] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:18:31.838022 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-f0a5aa2d-1b7a-4cf5-aae2-d9b762d5f3fa tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:18:31.838590 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-f0a5aa2d-1b7a-4cf5-aae2-d9b762d5f3fa tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:18:31.839131 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-f0a5aa2d-1b7a-4cf5-aae2-d9b762d5f3fa tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:18:31.839905 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-f0a5aa2d-1b7a-4cf5-aae2-d9b762d5f3fa tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:18:31.840455 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-f0a5aa2d-1b7a-4cf5-aae2-d9b762d5f3fa tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:18:31.840943 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-f0a5aa2d-1b7a-4cf5-aae2-d9b762d5f3fa tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:18:31.899222 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-f0a5aa2d-1b7a-4cf5-aae2-d9b762d5f3fa tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:18:31.899731 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-f0a5aa2d-1b7a-4cf5-aae2-d9b762d5f3fa tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:18:31.900169 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-f0a5aa2d-1b7a-4cf5-aae2-d9b762d5f3fa tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:18:31.900830 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.objects.instance [None req-f0a5aa2d-1b7a-4cf5-aae2-d9b762d5f3fa tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Lazy-loading 'fault' on Instance uuid db8c5bd8-e17b-4a51-9f14-7ab55193f642 {{(pid=129409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 18:18:31.951791 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-f0a5aa2d-1b7a-4cf5-aae2-d9b762d5f3fa tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc780ad30504e1fa66a3be0cf7f2c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41fefde7f54bb48362d6d171539114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:18:31.964284 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-f0a5aa2d-1b7a-4cf5-aae2-d9b762d5f3fa tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] 10.222.0.50 "GET /compute/v2.1/servers/db8c5bd8-e17b-4a51-9f14-7ab55193f642" status: 200 len: 1304 microversion: 2.1 time: 0.143114 Aug 10 18:18:31.967905 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1085/2145] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 18:18:31 2022] GET /compute/v2.1/servers/db8c5bd8-e17b-4a51-9f14-7ab55193f642 => generated 1304 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 18:18:32.988793 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-451e77bf-5699-4751-97e9-13692f05c879 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:18:32.989539 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-451e77bf-5699-4751-97e9-13692f05c879 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] [instance: db8c5bd8-e17b-4a51-9f14-7ab55193f642] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:18:32.996747 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-451e77bf-5699-4751-97e9-13692f05c879 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:18:32.997226 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-451e77bf-5699-4751-97e9-13692f05c879 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:18:32.997778 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-451e77bf-5699-4751-97e9-13692f05c879 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:18:32.998468 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-451e77bf-5699-4751-97e9-13692f05c879 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:18:32.998922 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-451e77bf-5699-4751-97e9-13692f05c879 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:18:32.999341 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-451e77bf-5699-4751-97e9-13692f05c879 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:18:33.012893 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-451e77bf-5699-4751-97e9-13692f05c879 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] HTTP exception thrown: Instance db8c5bd8-e17b-4a51-9f14-7ab55193f642 could not be found. Aug 10 18:18:33.014559 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-451e77bf-5699-4751-97e9-13692f05c879 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Request method failure captured: Aug 10 18:18:33.014559 n-d-852296-2 devstack@n-api.service[129410]: request: GET /compute/v2.1/servers/db8c5bd8-e17b-4a51-9f14-7ab55193f642 HTTP/1.1 Aug 10 18:18:33.014559 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 18:18:33.014559 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 18:18:33.014559 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 18:18:33.014559 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 0 Aug 10 18:18:33.014559 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 18:18:33.014559 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 18:18:33.014559 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 18:18:33.014559 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 18:18:33.014559 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8_ZdSUoVBVcaHHQXMbCBIBjgPfK6_oaum6iTsSdOP-qVPTqsHJFnMX4nUcs28NsIBTTmnCOl64H6XkBjoBuxgnGwo7j1jJp0HCIvHSOyOMizhsddkyaAw7qoSc8QPuh4A4dIRYUa0lvrmaU5opdElY9Ez40OKTIwkGw7eBYJvPbmLQM Aug 10 18:18:33.014559 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 18:18:33.014559 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 18:18:33.014559 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 18:18:33.014559 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 18:18:33.014559 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 18:18:33.014559 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 18:18:33.014559 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: 6e41fefde7f54bb48362d6d171539114 Aug 10 18:18:33.014559 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-VolumesNegativeTest-214640687 Aug 10 18:18:33.014559 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 18:18:33.014559 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 18:18:33.014559 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6e41fefde7f54bb48362d6d171539114"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6e41fefde7f54bb48362d6d171539114"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6e41fefde7f54bb48362d6d171539114"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6e41fefde7f54bb48362d6d171539114", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 18:18:33.014559 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-VolumesNegativeTest-214640687 Aug 10 18:18:33.014559 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: 6e41fefde7f54bb48362d6d171539114 Aug 10 18:18:33.014559 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-VolumesNegativeTest-214640687 Aug 10 18:18:33.014559 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-VolumesNegativeTest-214640687-project Aug 10 18:18:33.014559 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 18:18:33.014559 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 18:18:33.014559 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: 2fc780ad30504e1fa66a3be0cf7f2c37 Aug 10 18:18:33.014559 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-VolumesNegativeTest-214640687-project Aug 10 18:18:33.014559 n-d-852296-2 devstack@n-api.service[129410]: method: > Aug 10 18:18:33.014559 n-d-852296-2 devstack@n-api.service[129410]: exception: Instance db8c5bd8-e17b-4a51-9f14-7ab55193f642 could not be found. Aug 10 18:18:33.014559 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'id': 'db8c5bd8-e17b-4a51-9f14-7ab55193f642'} Aug 10 18:18:33.014559 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 18:18:33.014559 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:18:33.014559 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 18:18:33.014559 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 18:18:33.014559 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 18:18:33.014559 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 18:18:33.014559 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 18:18:33.014559 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 18:18:33.014559 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 18:18:33.014559 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 18:18:33.014559 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db8c5bd8-e17b-4a51-9f14-7ab55193f642 could not be found. Aug 10 18:18:33.014559 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:18:33.014559 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:18:33.014559 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:18:33.014559 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:18:33.014559 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:18:33.014559 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:18:33.014559 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 18:18:33.014559 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 18:18:33.014559 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:18:33.014559 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:18:33.014559 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 18:18:33.014559 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 18:18:33.014559 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 18:18:33.014559 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 18:18:33.014559 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 18:18:33.014559 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 18:18:33.014559 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db8c5bd8-e17b-4a51-9f14-7ab55193f642 could not be found. Aug 10 18:18:33.014559 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:18:33.014559 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:18:33.014559 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:18:33.019838 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:18:33.019838 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:18:33.019838 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:18:33.019838 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 18:18:33.019838 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 18:18:33.019838 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db8c5bd8-e17b-4a51-9f14-7ab55193f642 could not be found. Aug 10 18:18:33.019838 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:18:33.019838 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-451e77bf-5699-4751-97e9-13692f05c879 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] Returning 404 to user: Instance db8c5bd8-e17b-4a51-9f14-7ab55193f642 could not be found. {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 18:18:33.019838 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-451e77bf-5699-4751-97e9-13692f05c879 tempest-VolumesNegativeTest-214640687 tempest-VolumesNegativeTest-214640687-project] 10.222.0.50 "GET /compute/v2.1/servers/db8c5bd8-e17b-4a51-9f14-7ab55193f642" status: 404 len: 111 microversion: 2.1 time: 0.031123 Aug 10 18:18:33.019838 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 1061/2146] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 18:18:32 2022] GET /compute/v2.1/servers/db8c5bd8-e17b-4a51-9f14-7ab55193f642 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 18:18:38.855489 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-af153bd7-0d26-40e0-b038-4011427a8864 tempest-TestVolumeBootPattern-643594796 tempest-TestVolumeBootPattern-643594796-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1858503799", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "fa374a62-9a96-42c8-8e5b-6189aa7c4f85", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "495f27ec-1384-4fe6-8f96-b830e27d049a"}]}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 18:18:38.930169 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.network.neutron [None req-af153bd7-0d26-40e0-b038-4011427a8864 tempest-TestVolumeBootPattern-643594796 tempest-TestVolumeBootPattern-643594796-project] validate_networks() for [('495f27ec-1384-4fe6-8f96-b830e27d049a', None, None, None, None, None)] {{(pid=129409) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 18:18:39.192663 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [None req-af153bd7-0d26-40e0-b038-4011427a8864 tempest-TestVolumeBootPattern-643594796 tempest-TestVolumeBootPattern-643594796-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-63f81d93-2bef-4147-baf7-fbdb48c4627c) Aug 10 18:18:39.192663 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:18:39.192663 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:18:39.192663 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:18:39.192663 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:18:39.192663 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:18:39.192663 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:18:39.192663 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:18:39.192663 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:18:39.192663 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:18:39.192663 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 18:18:39.192663 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 18:18:39.192663 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 18:18:39.192663 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 18:18:39.192663 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 18:18:39.192663 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 18:18:39.192663 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 18:18:39.192663 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 18:18:39.192663 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 18:18:39.192663 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 18:18:39.192663 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 18:18:39.192663 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 18:18:39.192663 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 18:18:39.192663 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 18:18:39.192663 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 18:18:39.192663 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 18:18:39.192663 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 18:18:39.192663 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:18:39.192663 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:18:39.192663 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 18:18:39.192663 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 18:18:39.192663 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:18:39.192663 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:18:39.192663 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 18:18:39.192663 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 18:18:39.192663 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:18:39.192663 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:18:39.192663 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:18:39.192663 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:18:39.192663 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:18:39.192663 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:18:39.192663 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 18:18:39.192663 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 18:18:39.192663 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 18:18:39.192663 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 18:18:39.192663 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 18:18:39.192663 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 18:18:39.192663 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 18:18:39.192663 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 18:18:39.192663 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 18:18:39.192663 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 18:18:39.192663 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 18:18:39.192663 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 18:18:39.196815 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 18:18:39.196815 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 18:18:39.196815 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 18:18:39.196815 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 18:18:39.196815 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 18:18:39.196815 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 18:18:39.196815 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 18:18:39.196815 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 18:18:39.196815 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 18:18:39.196815 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 18:18:39.196815 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 18:18:39.196815 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 18:18:39.196815 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 18:18:39.196815 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 18:18:39.196815 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-63f81d93-2bef-4147-baf7-fbdb48c4627c) Aug 10 18:18:39.196815 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:18:39.196815 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-af153bd7-0d26-40e0-b038-4011427a8864 tempest-TestVolumeBootPattern-643594796 tempest-TestVolumeBootPattern-643594796-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:18:39.196815 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 18:18:39.202852 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-af153bd7-0d26-40e0-b038-4011427a8864 tempest-TestVolumeBootPattern-643594796 tempest-TestVolumeBootPattern-643594796-project] Request method failure captured: Aug 10 18:18:39.202852 n-d-852296-2 devstack@n-api.service[129409]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 18:18:39.202852 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 18:18:39.202852 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 18:18:39.202852 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 18:18:39.202852 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 367 Aug 10 18:18:39.202852 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 18:18:39.202852 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 18:18:39.202852 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 18:18:39.202852 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 18:18:39.202852 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8_X6_Cd1R_YAkxcqY8aS9sKVlEHA1nkBOGiqWoNxiwA5OMdQulPHjpjWV_G5v5kdF8klxiJlPEyKVqMT4cgFCxHHVtjEpoaXcpXbblD17hZYy_ZP4wpw_OCo_tshb6UTZgOX38pWh-EnJBMLQvJjwgF-Gul05lzOuTqBbmH_KFAsOTE Aug 10 18:18:39.202852 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 18:18:39.202852 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 18:18:39.202852 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 18:18:39.202852 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 18:18:39.202852 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 18:18:39.202852 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 18:18:39.202852 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: 22d3725574964172b743b748cb00c039 Aug 10 18:18:39.202852 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-TestVolumeBootPattern-643594796 Aug 10 18:18:39.202852 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 18:18:39.202852 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 18:18:39.202852 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/22d3725574964172b743b748cb00c039"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/22d3725574964172b743b748cb00c039"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/22d3725574964172b743b748cb00c039"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_22d3725574964172b743b748cb00c039", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 18:18:39.202852 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-TestVolumeBootPattern-643594796 Aug 10 18:18:39.202852 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: 22d3725574964172b743b748cb00c039 Aug 10 18:18:39.202852 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-TestVolumeBootPattern-643594796 Aug 10 18:18:39.202852 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-TestVolumeBootPattern-643594796-project Aug 10 18:18:39.202852 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 18:18:39.202852 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 18:18:39.202852 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: abb93fabf84444c0974a197c6564a1fe Aug 10 18:18:39.202852 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-TestVolumeBootPattern-643594796-project Aug 10 18:18:39.202852 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 18:18:39.202852 n-d-852296-2 devstack@n-api.service[129409]: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1858503799", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "fa374a62-9a96-42c8-8e5b-6189aa7c4f85", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "495f27ec-1384-4fe6-8f96-b830e27d049a"}]}} Aug 10 18:18:39.202852 n-d-852296-2 devstack@n-api.service[129409]: method: > Aug 10 18:18:39.202852 n-d-852296-2 devstack@n-api.service[129409]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:18:39.202852 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 18:18:39.202852 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'body': {'server': {'name': 'tempest-TestVolumeBootPattern-volume-backed-server-1858503799', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'volume', 'destination_type': 'volume', 'boot_index': 0, 'delete_on_termination': True, 'volume_id': 'fa374a62-9a96-42c8-8e5b-6189aa7c4f85'}], 'networks': [{'uuid': '495f27ec-1384-4fe6-8f96-b830e27d049a'}]}}} Aug 10 18:18:39.202852 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 18:18:39.202852 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:18:39.202852 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:18:39.202852 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:18:39.202852 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:18:39.202852 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:18:39.202852 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:18:39.202852 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:18:39.202852 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:18:39.202852 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:18:39.202852 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 18:18:39.202852 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 18:18:39.202852 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 18:18:39.202852 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 18:18:39.202852 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 18:18:39.202852 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 18:18:39.202852 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 18:18:39.202852 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 18:18:39.202852 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 18:18:39.202852 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 18:18:39.202852 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 18:18:39.202852 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 18:18:39.207787 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 18:18:39.207787 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 18:18:39.207787 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 18:18:39.207787 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 18:18:39.207787 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 18:18:39.207787 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:18:39.207787 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:18:39.207787 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 18:18:39.207787 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 18:18:39.207787 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:18:39.207787 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:18:39.207787 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 18:18:39.207787 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 18:18:39.207787 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:18:39.207787 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:18:39.207787 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:18:39.207787 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:18:39.207787 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:18:39.207787 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:18:39.207787 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 18:18:39.207787 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 18:18:39.207787 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 18:18:39.207787 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 18:18:39.207787 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 18:18:39.207787 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 18:18:39.207787 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 18:18:39.207787 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 18:18:39.207787 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 18:18:39.207787 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 18:18:39.207787 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 18:18:39.207787 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 18:18:39.207787 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 18:18:39.207787 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 18:18:39.207787 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 18:18:39.207787 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 18:18:39.207787 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 18:18:39.207787 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 18:18:39.207787 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 18:18:39.207787 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 18:18:39.207787 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 18:18:39.207787 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 18:18:39.207787 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 18:18:39.207787 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 18:18:39.207787 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 18:18:39.207787 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 18:18:39.207787 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-63f81d93-2bef-4147-baf7-fbdb48c4627c) Aug 10 18:18:39.207787 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:18:39.207787 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:18:39.207787 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:18:39.207787 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:18:39.207787 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:18:39.207787 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:18:39.207787 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 18:18:39.212732 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 18:18:39.212732 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 10 18:18:39.212732 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 10 18:18:39.212732 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:18:39.212732 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:18:39.212732 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:18:39.212732 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:18:39.212732 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:18:39.212732 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:18:39.212732 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:18:39.212732 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:18:39.212732 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 18:18:39.212732 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 18:18:39.212732 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:18:39.212732 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:18:39.212732 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:18:39.216183 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-af153bd7-0d26-40e0-b038-4011427a8864 tempest-TestVolumeBootPattern-643594796 tempest-TestVolumeBootPattern-643594796-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:18:39.216183 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 18:18:39.219522 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-af153bd7-0d26-40e0-b038-4011427a8864 tempest-TestVolumeBootPattern-643594796 tempest-TestVolumeBootPattern-643594796-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.364035 Aug 10 18:18:39.224164 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1086/2147] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 18:18:38 2022] POST /compute/v2.1/servers => generated 214 bytes in 372 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 10 18:18:42.959736 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-a6881009-daed-4997-b895-9c966c64280f tempest-TestVolumeBootPattern-643594796 tempest-TestVolumeBootPattern-643594796-project] Action: 'create', calling method: .version_select at 0x7fb345ab59d0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-2074524763", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFGpd9OP+qULTR3zgkhCyBgDgFEm1u1a5q7Pr9iGJyiWwb/kgU4oPOMI3czl6QrpryLXBaSOsxWGmpjjSzjL/YQ6776/p8JZkSvgIWuVDLqYMzMnACJMEfhHKoMwCiMvaA=="}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 18:18:42.966807 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 18:18:42.983278 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.quota [None req-a6881009-daed-4997-b895-9c966c64280f tempest-TestVolumeBootPattern-643594796 tempest-TestVolumeBootPattern-643594796-project] Getting quotas for project 22d3725574964172b743b748cb00c039. Resources: {'key_pairs'} {{(pid=129410) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 18:18:42.990903 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.quota [None req-a6881009-daed-4997-b895-9c966c64280f tempest-TestVolumeBootPattern-643594796 tempest-TestVolumeBootPattern-643594796-project] Getting quotas for user abb93fabf84444c0974a197c6564a1fe and project 22d3725574964172b743b748cb00c039. Resources: {'key_pairs'} {{(pid=129410) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 18:18:43.005578 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 18:18:43.215255 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-a6881009-daed-4997-b895-9c966c64280f tempest-TestVolumeBootPattern-643594796 tempest-TestVolumeBootPattern-643594796-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.259023 Aug 10 18:18:43.221615 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 1062/2148] 10.222.0.50 () {60 vars in 1159 bytes} [Wed Aug 10 18:18:42 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 18:18:50.982947 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_cell1:SELECT=66 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 18:18:50.983828 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 18:18:51.157999 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-5ead44d1-4c2e-4cd3-b3a4-0947bbbaaa93 tempest-TestServerAdvancedOps-2094513390 tempest-TestServerAdvancedOps-2094513390-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-656670991", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "43f0be5c-77be-48e8-89b6-989e744cef32"}]}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 18:18:51.252380 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.network.neutron [None req-5ead44d1-4c2e-4cd3-b3a4-0947bbbaaa93 tempest-TestServerAdvancedOps-2094513390 tempest-TestServerAdvancedOps-2094513390-project] validate_networks() for [('43f0be5c-77be-48e8-89b6-989e744cef32', None, None, None, None, None)] {{(pid=129409) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 18:18:51.446637 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [None req-5ead44d1-4c2e-4cd3-b3a4-0947bbbaaa93 tempest-TestServerAdvancedOps-2094513390 tempest-TestServerAdvancedOps-2094513390-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-b6952cf9-aeda-4a91-ab66-c03f602b3ede) Aug 10 18:18:51.446637 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:18:51.446637 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:18:51.446637 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:18:51.446637 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:18:51.446637 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:18:51.446637 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:18:51.446637 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:18:51.446637 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:18:51.446637 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:18:51.446637 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 18:18:51.446637 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 18:18:51.446637 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 18:18:51.446637 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 18:18:51.446637 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 18:18:51.446637 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 18:18:51.446637 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 18:18:51.446637 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 18:18:51.446637 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 18:18:51.446637 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 18:18:51.446637 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 18:18:51.446637 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 18:18:51.446637 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 18:18:51.446637 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 18:18:51.446637 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 18:18:51.446637 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 18:18:51.446637 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 18:18:51.446637 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:18:51.446637 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:18:51.446637 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 18:18:51.446637 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 18:18:51.446637 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:18:51.446637 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:18:51.446637 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 18:18:51.446637 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 18:18:51.446637 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:18:51.446637 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:18:51.446637 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:18:51.446637 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:18:51.446637 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:18:51.446637 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:18:51.446637 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 18:18:51.446637 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 18:18:51.446637 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 18:18:51.446637 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 18:18:51.446637 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 18:18:51.446637 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 18:18:51.446637 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 18:18:51.446637 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 18:18:51.446637 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 18:18:51.446637 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 18:18:51.446637 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 18:18:51.446637 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 18:18:51.455579 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 18:18:51.455579 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 18:18:51.455579 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 18:18:51.455579 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 18:18:51.455579 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 18:18:51.455579 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 18:18:51.455579 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 18:18:51.455579 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 18:18:51.455579 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 18:18:51.455579 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 18:18:51.455579 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 18:18:51.455579 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 18:18:51.455579 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 18:18:51.455579 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 18:18:51.455579 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-b6952cf9-aeda-4a91-ab66-c03f602b3ede) Aug 10 18:18:51.455579 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:18:51.455579 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-5ead44d1-4c2e-4cd3-b3a4-0947bbbaaa93 tempest-TestServerAdvancedOps-2094513390 tempest-TestServerAdvancedOps-2094513390-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:18:51.455579 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 18:18:51.455579 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-5ead44d1-4c2e-4cd3-b3a4-0947bbbaaa93 tempest-TestServerAdvancedOps-2094513390 tempest-TestServerAdvancedOps-2094513390-project] Request method failure captured: Aug 10 18:18:51.455579 n-d-852296-2 devstack@n-api.service[129409]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 18:18:51.455579 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 18:18:51.455579 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 18:18:51.455579 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 18:18:51.455579 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 206 Aug 10 18:18:51.455579 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 18:18:51.455579 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 18:18:51.455579 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 18:18:51.455579 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 18:18:51.455579 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8_aIDPycQ8KVNzEEYzMksPoGDpAXDTSlsdoXOcxOsYVt3DqRqCbhS-DDF6fHpk8QLEjVME7cy-Fd6aQVBEh5hSS1qPw0Aj9e_Esxd1d5FQ2R8FvXvhH-1XpGsO6Q7R1XF0ytUfh4WpM8w6sLr9dBrej4eaBO4vYie83BFmKzS27FN4I Aug 10 18:18:51.455579 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 18:18:51.455579 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 18:18:51.455579 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 18:18:51.455579 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 18:18:51.455579 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 18:18:51.455579 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 18:18:51.455579 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: 31d2604a2acc4211bd66c9c18a9417ef Aug 10 18:18:51.455579 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-TestServerAdvancedOps-2094513390 Aug 10 18:18:51.455579 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 18:18:51.455579 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 18:18:51.455579 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/31d2604a2acc4211bd66c9c18a9417ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/31d2604a2acc4211bd66c9c18a9417ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/31d2604a2acc4211bd66c9c18a9417ef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_31d2604a2acc4211bd66c9c18a9417ef", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 18:18:51.455579 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-TestServerAdvancedOps-2094513390 Aug 10 18:18:51.455579 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: 31d2604a2acc4211bd66c9c18a9417ef Aug 10 18:18:51.455579 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-TestServerAdvancedOps-2094513390 Aug 10 18:18:51.455579 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-TestServerAdvancedOps-2094513390-project Aug 10 18:18:51.455579 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 18:18:51.455579 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 18:18:51.455579 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: c5570a63b958471db909ba54973dac66 Aug 10 18:18:51.455579 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-TestServerAdvancedOps-2094513390-project Aug 10 18:18:51.455579 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 18:18:51.455579 n-d-852296-2 devstack@n-api.service[129409]: {"server": {"name": "tempest-TestServerAdvancedOps-server-656670991", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "43f0be5c-77be-48e8-89b6-989e744cef32"}]}} Aug 10 18:18:51.455579 n-d-852296-2 devstack@n-api.service[129409]: method: > Aug 10 18:18:51.455579 n-d-852296-2 devstack@n-api.service[129409]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:18:51.455579 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 18:18:51.455579 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'body': {'server': {'name': 'tempest-TestServerAdvancedOps-server-656670991', 'imageRef': 'a735ff26-463a-4ffe-a981-ab9d9baa494f', 'flavorRef': '452', 'networks': [{'uuid': '43f0be5c-77be-48e8-89b6-989e744cef32'}]}}} Aug 10 18:18:51.455579 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 18:18:51.459824 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:18:51.459824 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:18:51.459824 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:18:51.459824 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:18:51.459824 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:18:51.459824 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:18:51.459824 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:18:51.459824 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:18:51.459824 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:18:51.459824 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 18:18:51.459824 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 18:18:51.459824 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 18:18:51.459824 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 18:18:51.459824 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 18:18:51.459824 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 18:18:51.459824 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 18:18:51.459824 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 18:18:51.459824 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 18:18:51.459824 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 18:18:51.459824 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 18:18:51.459824 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 18:18:51.459824 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 18:18:51.459824 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 18:18:51.459824 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 18:18:51.459824 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 18:18:51.459824 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 18:18:51.459824 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:18:51.459824 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:18:51.459824 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 18:18:51.459824 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 18:18:51.459824 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:18:51.459824 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:18:51.459824 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 18:18:51.459824 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 18:18:51.459824 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:18:51.459824 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:18:51.459824 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:18:51.459824 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:18:51.459824 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:18:51.459824 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:18:51.459824 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 18:18:51.459824 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 18:18:51.459824 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 18:18:51.459824 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 18:18:51.459824 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 18:18:51.459824 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 18:18:51.459824 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 18:18:51.459824 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 18:18:51.459824 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 18:18:51.459824 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 18:18:51.459824 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 18:18:51.459824 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 18:18:51.459824 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 18:18:51.459824 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 18:18:51.459824 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 18:18:51.459824 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 18:18:51.463840 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 18:18:51.463840 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 18:18:51.463840 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 18:18:51.463840 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 18:18:51.463840 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 18:18:51.463840 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 18:18:51.463840 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 18:18:51.463840 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 18:18:51.463840 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 18:18:51.463840 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 18:18:51.463840 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-b6952cf9-aeda-4a91-ab66-c03f602b3ede) Aug 10 18:18:51.463840 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:18:51.463840 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:18:51.463840 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:18:51.463840 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:18:51.463840 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:18:51.463840 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:18:51.463840 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 18:18:51.463840 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 18:18:51.463840 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 10 18:18:51.463840 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 10 18:18:51.463840 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:18:51.463840 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:18:51.463840 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:18:51.463840 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:18:51.463840 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:18:51.463840 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:18:51.463840 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:18:51.463840 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:18:51.463840 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 18:18:51.463840 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 18:18:51.463840 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:18:51.463840 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:18:51.463840 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:18:51.463840 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-5ead44d1-4c2e-4cd3-b3a4-0947bbbaaa93 tempest-TestServerAdvancedOps-2094513390 tempest-TestServerAdvancedOps-2094513390-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:18:51.463840 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 18:18:51.463840 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-5ead44d1-4c2e-4cd3-b3a4-0947bbbaaa93 tempest-TestServerAdvancedOps-2094513390 tempest-TestServerAdvancedOps-2094513390-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.469620 Aug 10 18:18:51.463840 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1087/2149] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 18:18:50 2022] POST /compute/v2.1/servers => generated 214 bytes in 471 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 10 18:18:56.072926 n-d-852296-2 devstack@n-api.service[129409]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 18:18:56.073532 n-d-852296-2 devstack@n-api.service[129409]: Wed Aug 10 18:18:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 18:19:20.209008 n-d-852296-2 devstack@n-api.service[129410]: ERROR oslo.messaging._drivers.impl_rabbit [-] [35b81453-3f0e-4fee-81d1-faab338f27f8] AMQP server on 10.222.0.50:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 10 18:19:20.209578 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_cell0:SELECT=4 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 18:19:20.213934 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-257a726c-4e84-4335-aec7-b7ce425299ff tempest-TestVolumeBootPattern-643594796 tempest-TestVolumeBootPattern-643594796-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-533497481", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2074524763", "security_groups": [{"name": "tempest-secgroup-smoke-1197860067"}], "block_device_mapping_v2": [{"uuid": "19ad496f-c785-45eb-824d-3153bb873570", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "495f27ec-1384-4fe6-8f96-b830e27d049a"}]}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 18:19:20.331046 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.network.neutron [None req-257a726c-4e84-4335-aec7-b7ce425299ff tempest-TestVolumeBootPattern-643594796 tempest-TestVolumeBootPattern-643594796-project] validate_networks() for [('495f27ec-1384-4fe6-8f96-b830e27d049a', None, None, None, None, None)] {{(pid=129410) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 18:19:20.540523 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [None req-257a726c-4e84-4335-aec7-b7ce425299ff tempest-TestVolumeBootPattern-643594796 tempest-TestVolumeBootPattern-643594796-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-a42a867a-7e45-418d-8f91-5991fc0e71cd) Aug 10 18:19:20.540523 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:19:20.540523 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:19:20.540523 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:19:20.540523 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:19:20.540523 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:19:20.540523 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:19:20.540523 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:19:20.540523 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:19:20.540523 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:19:20.540523 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 18:19:20.540523 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 18:19:20.540523 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 18:19:20.540523 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 18:19:20.540523 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 18:19:20.540523 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 18:19:20.540523 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 18:19:20.540523 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 18:19:20.540523 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 18:19:20.540523 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 18:19:20.540523 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 18:19:20.540523 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 18:19:20.540523 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 18:19:20.540523 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 18:19:20.540523 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 18:19:20.540523 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 18:19:20.540523 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 18:19:20.540523 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:19:20.540523 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:19:20.540523 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 18:19:20.540523 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 18:19:20.540523 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:19:20.540523 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:19:20.540523 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 18:19:20.540523 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 18:19:20.540523 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:19:20.540523 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:19:20.540523 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:19:20.540523 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:19:20.540523 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:19:20.540523 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:19:20.540523 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 18:19:20.540523 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 18:19:20.540523 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 18:19:20.540523 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 18:19:20.540523 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 18:19:20.540523 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 18:19:20.540523 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 18:19:20.540523 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 18:19:20.540523 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 18:19:20.540523 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 18:19:20.540523 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 18:19:20.540523 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 18:19:20.544033 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 18:19:20.544033 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 18:19:20.544033 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 18:19:20.544033 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 18:19:20.544033 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 18:19:20.544033 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 18:19:20.544033 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 18:19:20.544033 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 18:19:20.544033 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 18:19:20.544033 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 18:19:20.544033 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 18:19:20.544033 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 18:19:20.544033 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 18:19:20.544033 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 18:19:20.544033 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-a42a867a-7e45-418d-8f91-5991fc0e71cd) Aug 10 18:19:20.544033 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:19:20.544033 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-257a726c-4e84-4335-aec7-b7ce425299ff tempest-TestVolumeBootPattern-643594796 tempest-TestVolumeBootPattern-643594796-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:19:20.544033 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 18:19:20.544033 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-257a726c-4e84-4335-aec7-b7ce425299ff tempest-TestVolumeBootPattern-643594796 tempest-TestVolumeBootPattern-643594796-project] Request method failure captured: Aug 10 18:19:20.544033 n-d-852296-2 devstack@n-api.service[129410]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 18:19:20.544033 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 18:19:20.544033 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 18:19:20.544033 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 18:19:20.544033 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 477 Aug 10 18:19:20.544033 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 18:19:20.544033 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 18:19:20.544033 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 18:19:20.544033 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 18:19:20.544033 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8_X6_Cd1R_YAkxcqY8aS9sKVlEHA1nkBOGiqWoNxiwA5OMdQulPHjpjWV_G5v5kdF8klxiJlPEyKVqMT4cgFCxHHVtjEpoaXcpXbblD17hZYy_ZP4wpw_OCo_tshb6UTZgOX38pWh-EnJBMLQvJjwgF-Gul05lzOuTqBbmH_KFAsOTE Aug 10 18:19:20.544033 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 18:19:20.544033 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 18:19:20.544033 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 18:19:20.544033 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 18:19:20.544033 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 18:19:20.544033 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 18:19:20.544033 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: 22d3725574964172b743b748cb00c039 Aug 10 18:19:20.544033 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-TestVolumeBootPattern-643594796 Aug 10 18:19:20.544033 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 18:19:20.544033 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 18:19:20.544033 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/22d3725574964172b743b748cb00c039"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/22d3725574964172b743b748cb00c039"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/22d3725574964172b743b748cb00c039"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_22d3725574964172b743b748cb00c039", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 18:19:20.544033 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-TestVolumeBootPattern-643594796 Aug 10 18:19:20.544033 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: 22d3725574964172b743b748cb00c039 Aug 10 18:19:20.544033 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-TestVolumeBootPattern-643594796 Aug 10 18:19:20.544033 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-TestVolumeBootPattern-643594796-project Aug 10 18:19:20.544033 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 18:19:20.544033 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 18:19:20.544033 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: abb93fabf84444c0974a197c6564a1fe Aug 10 18:19:20.544033 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-TestVolumeBootPattern-643594796-project Aug 10 18:19:20.544033 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 18:19:20.544033 n-d-852296-2 devstack@n-api.service[129410]: {"server": {"name": "tempest-TestVolumeBootPattern-server-533497481", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2074524763", "security_groups": [{"name": "tempest-secgroup-smoke-1197860067"}], "block_device_mapping_v2": [{"uuid": "19ad496f-c785-45eb-824d-3153bb873570", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "495f27ec-1384-4fe6-8f96-b830e27d049a"}]}} Aug 10 18:19:20.544033 n-d-852296-2 devstack@n-api.service[129410]: method: > Aug 10 18:19:20.544033 n-d-852296-2 devstack@n-api.service[129410]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:19:20.544033 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 18:19:20.547480 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'body': {'server': {'name': 'tempest-TestVolumeBootPattern-server-533497481', 'imageRef': '', 'flavorRef': '452', 'key_name': 'tempest-TestVolumeBootPattern-2074524763', 'security_groups': [{'name': 'tempest-secgroup-smoke-1197860067'}], 'block_device_mapping_v2': [{'source_type': 'volume', 'destination_type': 'volume', 'boot_index': 0, 'delete_on_termination': False, 'volume_id': '19ad496f-c785-45eb-824d-3153bb873570'}], 'networks': [{'uuid': '495f27ec-1384-4fe6-8f96-b830e27d049a'}]}}} Aug 10 18:19:20.547480 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 18:19:20.547480 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:19:20.547480 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:19:20.547480 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:19:20.547480 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:19:20.547480 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:19:20.547480 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:19:20.547480 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:19:20.547480 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:19:20.547480 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:19:20.547480 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 18:19:20.547480 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 18:19:20.547480 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 18:19:20.547480 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 18:19:20.547480 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 18:19:20.547480 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 18:19:20.547480 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 18:19:20.547480 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 18:19:20.547480 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 18:19:20.547480 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 18:19:20.547480 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 18:19:20.547480 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 18:19:20.547480 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 18:19:20.547480 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 18:19:20.547480 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 18:19:20.547480 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 18:19:20.547480 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 18:19:20.547480 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:19:20.547480 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:19:20.547480 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 18:19:20.547480 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 18:19:20.547480 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:19:20.547480 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:19:20.547480 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 18:19:20.547480 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 18:19:20.547480 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:19:20.547480 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:19:20.547480 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:19:20.547480 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:19:20.547480 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:19:20.547480 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:19:20.547480 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 18:19:20.547480 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 18:19:20.547480 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 18:19:20.547480 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 18:19:20.547480 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 18:19:20.547480 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 18:19:20.547480 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 18:19:20.547480 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 18:19:20.547480 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 18:19:20.547480 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 18:19:20.547480 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 18:19:20.553671 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 18:19:20.553671 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 18:19:20.553671 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 18:19:20.553671 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 18:19:20.553671 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 18:19:20.553671 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 18:19:20.553671 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 18:19:20.553671 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 18:19:20.553671 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 18:19:20.553671 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 18:19:20.553671 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 18:19:20.553671 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 18:19:20.553671 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 18:19:20.553671 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 18:19:20.553671 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 18:19:20.553671 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-a42a867a-7e45-418d-8f91-5991fc0e71cd) Aug 10 18:19:20.553671 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:19:20.553671 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:19:20.553671 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:19:20.553671 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:19:20.553671 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:19:20.553671 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:19:20.553671 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 18:19:20.553671 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 18:19:20.553671 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 10 18:19:20.553671 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 10 18:19:20.553671 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:19:20.553671 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:19:20.553671 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:19:20.553671 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:19:20.553671 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:19:20.553671 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:19:20.553671 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:19:20.553671 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:19:20.553671 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 18:19:20.553671 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 18:19:20.553671 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:19:20.553671 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:19:20.553671 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:19:20.553671 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-257a726c-4e84-4335-aec7-b7ce425299ff tempest-TestVolumeBootPattern-643594796 tempest-TestVolumeBootPattern-643594796-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:19:20.553671 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 18:19:20.553671 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-257a726c-4e84-4335-aec7-b7ce425299ff tempest-TestVolumeBootPattern-643594796 tempest-TestVolumeBootPattern-643594796-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.337812 Aug 10 18:19:20.553671 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 1063/2150] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 18:19:20 2022] POST /compute/v2.1/servers => generated 214 bytes in 339 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 10 18:19:24.257229 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-44781ab3-3451-4593-aacb-90ddea148c6b tempest-TestVolumeBootPattern-643594796 tempest-TestVolumeBootPattern-643594796-project] Calling method '.version_select at 0x7fb345d328b0>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:19:24.351931 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-44781ab3-3451-4593-aacb-90ddea148c6b tempest-TestVolumeBootPattern-643594796 tempest-TestVolumeBootPattern-643594796-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2074524763" status: 202 len: 0 microversion: 2.1 time: 0.098623 Aug 10 18:19:24.352940 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1088/2151] 10.222.0.50 () {58 vars in 1263 bytes} [Wed Aug 10 18:19:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2074524763 => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 18:20:14.322135 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-50a11db4-e500-4236-80c6-0765c03449e9 tempest-TestVolumeBackupRestore-1934945487 tempest-TestVolumeBackupRestore-1934945487-project] Action: 'create', calling method: .version_select at 0x7fb345b44dc0>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-49495173", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDYYSwxHzm6U8EsswWoOcNtq8bYAtwaGQH/VyNXTnGZpPrcMCFHTN9Giw2oZGzXWhtQesg4d6fO6XY3GO1WANjCRSOeAvrwf7ELCBUtYWIfTkeq7igrNM83y3HG3Qfk8LQ=="}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 18:20:14.340705 n-d-852296-2 devstack@n-api.service[129410]: INFO oslo.messaging._drivers.impl_rabbit [-] [35b81453-3f0e-4fee-81d1-faab338f27f8] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 45048. Aug 10 18:20:14.348162 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.quota [None req-50a11db4-e500-4236-80c6-0765c03449e9 tempest-TestVolumeBackupRestore-1934945487 tempest-TestVolumeBackupRestore-1934945487-project] Getting quotas for project ddc9bc710015437795125f9d379c31b1. Resources: {'key_pairs'} {{(pid=129410) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 18:20:14.353199 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.quota [None req-50a11db4-e500-4236-80c6-0765c03449e9 tempest-TestVolumeBackupRestore-1934945487 tempest-TestVolumeBackupRestore-1934945487-project] Getting quotas for user 64c022be379c43f5a180002795e213b1 and project ddc9bc710015437795125f9d379c31b1. Resources: {'key_pairs'} {{(pid=129410) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 18:20:14.532904 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-50a11db4-e500-4236-80c6-0765c03449e9 tempest-TestVolumeBackupRestore-1934945487 tempest-TestVolumeBackupRestore-1934945487-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.216338 Aug 10 18:20:14.533498 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 1064/2152] 10.222.0.50 () {60 vars in 1159 bytes} [Wed Aug 10 18:20:14 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 18:20:17.848183 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-a5775974-b478-4986-bb96-9908d614663b tempest-TestVolumeBackupRestore-1934945487 tempest-TestVolumeBackupRestore-1934945487-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-131383778", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "014bbf23-8706-4675-a061-7d8faf24a80b", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-49495173", "security_groups": [{"name": "tempest-secgroup-smoke-471328915"}], "networks": [{"uuid": "a75ff153-d06d-4830-a8b2-9a0c28927353"}]}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 18:20:17.857863 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_api:SELECT=5,nova_api:DELETE=1 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 18:20:17.975808 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.network.neutron [None req-a5775974-b478-4986-bb96-9908d614663b tempest-TestVolumeBackupRestore-1934945487 tempest-TestVolumeBackupRestore-1934945487-project] validate_networks() for [('a75ff153-d06d-4830-a8b2-9a0c28927353', None, None, None, None, None)] {{(pid=129409) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 18:20:18.189392 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [None req-a5775974-b478-4986-bb96-9908d614663b tempest-TestVolumeBackupRestore-1934945487 tempest-TestVolumeBackupRestore-1934945487-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-939e791d-a2b2-49eb-af81-fd344af2b95f) Aug 10 18:20:18.189392 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:20:18.189392 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:20:18.189392 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:20:18.189392 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:20:18.189392 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:20:18.189392 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:20:18.189392 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:20:18.189392 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:20:18.189392 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:20:18.189392 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 18:20:18.189392 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 18:20:18.189392 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 18:20:18.189392 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 18:20:18.189392 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 18:20:18.189392 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 18:20:18.189392 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 18:20:18.189392 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 18:20:18.189392 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 18:20:18.189392 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 18:20:18.189392 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 18:20:18.189392 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 18:20:18.189392 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 18:20:18.189392 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 18:20:18.189392 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 18:20:18.189392 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 18:20:18.189392 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 18:20:18.189392 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:20:18.189392 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:20:18.189392 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 18:20:18.189392 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 18:20:18.189392 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:20:18.189392 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:20:18.189392 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 18:20:18.189392 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 18:20:18.189392 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:20:18.189392 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:20:18.189392 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:20:18.189392 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:20:18.189392 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:20:18.189392 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:20:18.189392 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 18:20:18.189392 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 18:20:18.189392 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 18:20:18.189392 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 18:20:18.189392 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 18:20:18.189392 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 18:20:18.189392 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 18:20:18.189392 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 18:20:18.189392 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 18:20:18.189392 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 18:20:18.189392 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 18:20:18.193964 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 18:20:18.193964 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 18:20:18.193964 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 18:20:18.193964 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 18:20:18.193964 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 18:20:18.193964 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 18:20:18.193964 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 18:20:18.193964 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 18:20:18.193964 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 18:20:18.193964 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 18:20:18.193964 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 18:20:18.193964 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 18:20:18.193964 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 18:20:18.193964 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 18:20:18.193964 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 18:20:18.193964 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-939e791d-a2b2-49eb-af81-fd344af2b95f) Aug 10 18:20:18.193964 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:20:18.193964 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-a5775974-b478-4986-bb96-9908d614663b tempest-TestVolumeBackupRestore-1934945487 tempest-TestVolumeBackupRestore-1934945487-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:20:18.193964 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 18:20:18.193964 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-a5775974-b478-4986-bb96-9908d614663b tempest-TestVolumeBackupRestore-1934945487 tempest-TestVolumeBackupRestore-1934945487-project] Request method failure captured: Aug 10 18:20:18.193964 n-d-852296-2 devstack@n-api.service[129409]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 18:20:18.193964 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 18:20:18.193964 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 18:20:18.193964 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 18:20:18.193964 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 446 Aug 10 18:20:18.193964 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 18:20:18.193964 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 18:20:18.193964 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 18:20:18.193964 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 18:20:18.193964 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8_X7_3Hap8SH6bJD7Bldqg3TtvzZyFifgs5X02LbSOccWYYHMAU3E0zrIdvwvOm282bJPTVLXw5JY5o49ZwOJesqbqvByFAR637il8yQ5WsYNvn9S9FkBPWT6qjuTU681obHQGvhxKwSIsOBn9NynGyKqRoYHyvFnQ8h8fiE_GQxWV0 Aug 10 18:20:18.193964 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 18:20:18.193964 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 18:20:18.193964 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 18:20:18.193964 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 18:20:18.193964 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 18:20:18.193964 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 18:20:18.193964 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: ddc9bc710015437795125f9d379c31b1 Aug 10 18:20:18.193964 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-TestVolumeBackupRestore-1934945487 Aug 10 18:20:18.193964 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 18:20:18.193964 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 18:20:18.193964 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ddc9bc710015437795125f9d379c31b1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/ddc9bc710015437795125f9d379c31b1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ddc9bc710015437795125f9d379c31b1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_ddc9bc710015437795125f9d379c31b1", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 18:20:18.193964 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-TestVolumeBackupRestore-1934945487 Aug 10 18:20:18.193964 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: ddc9bc710015437795125f9d379c31b1 Aug 10 18:20:18.193964 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-TestVolumeBackupRestore-1934945487 Aug 10 18:20:18.193964 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-TestVolumeBackupRestore-1934945487-project Aug 10 18:20:18.193964 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 18:20:18.193964 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 18:20:18.193964 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: 64c022be379c43f5a180002795e213b1 Aug 10 18:20:18.193964 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-TestVolumeBackupRestore-1934945487-project Aug 10 18:20:18.193964 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 18:20:18.193964 n-d-852296-2 devstack@n-api.service[129409]: {"server": {"name": "tempest-TestVolumeBackupRestore-server-131383778", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "014bbf23-8706-4675-a061-7d8faf24a80b", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-49495173", "security_groups": [{"name": "tempest-secgroup-smoke-471328915"}], "networks": [{"uuid": "a75ff153-d06d-4830-a8b2-9a0c28927353"}]}} Aug 10 18:20:18.193964 n-d-852296-2 devstack@n-api.service[129409]: method: > Aug 10 18:20:18.193964 n-d-852296-2 devstack@n-api.service[129409]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:20:18.193964 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 18:20:18.199381 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'body': {'server': {'name': 'tempest-TestVolumeBackupRestore-server-131383778', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'volume', 'destination_type': 'volume', 'boot_index': 0, 'volume_id': '014bbf23-8706-4675-a061-7d8faf24a80b', 'delete_on_termination': False}], 'key_name': 'tempest-TestVolumeBackupRestore-49495173', 'security_groups': [{'name': 'tempest-secgroup-smoke-471328915'}], 'networks': [{'uuid': 'a75ff153-d06d-4830-a8b2-9a0c28927353'}]}}} Aug 10 18:20:18.199381 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 18:20:18.199381 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:20:18.199381 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:20:18.199381 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:20:18.199381 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:20:18.199381 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:20:18.199381 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:20:18.199381 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:20:18.199381 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:20:18.199381 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:20:18.199381 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 18:20:18.199381 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 18:20:18.199381 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 18:20:18.199381 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 18:20:18.199381 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 18:20:18.199381 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 18:20:18.199381 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 18:20:18.199381 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 18:20:18.199381 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 18:20:18.199381 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 18:20:18.199381 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 18:20:18.199381 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 18:20:18.199381 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 18:20:18.199381 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 18:20:18.199381 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 18:20:18.199381 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 18:20:18.199381 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 18:20:18.199381 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:20:18.199381 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:20:18.199381 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 18:20:18.199381 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 18:20:18.199381 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:20:18.199381 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:20:18.199381 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 18:20:18.199381 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 18:20:18.199381 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:20:18.199381 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:20:18.199381 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:20:18.199381 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:20:18.199381 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:20:18.199381 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:20:18.199381 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 18:20:18.199381 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 18:20:18.199381 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 18:20:18.199381 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 18:20:18.199381 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 18:20:18.199381 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 18:20:18.199381 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 18:20:18.199381 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 18:20:18.199381 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 18:20:18.199381 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 18:20:18.199381 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 18:20:18.203579 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 18:20:18.203579 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 18:20:18.203579 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 18:20:18.203579 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 18:20:18.203579 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 18:20:18.203579 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 18:20:18.203579 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 18:20:18.203579 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 18:20:18.203579 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 18:20:18.203579 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 18:20:18.203579 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 18:20:18.203579 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 18:20:18.203579 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 18:20:18.203579 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 18:20:18.203579 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 18:20:18.203579 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-939e791d-a2b2-49eb-af81-fd344af2b95f) Aug 10 18:20:18.203579 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:20:18.203579 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:20:18.203579 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:20:18.203579 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:20:18.203579 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:20:18.203579 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:20:18.203579 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 18:20:18.203579 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 18:20:18.203579 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 10 18:20:18.203579 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 10 18:20:18.203579 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:20:18.203579 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:20:18.203579 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:20:18.203579 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:20:18.203579 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:20:18.203579 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:20:18.203579 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:20:18.203579 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:20:18.203579 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 18:20:18.203579 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 18:20:18.203579 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:20:18.203579 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:20:18.203579 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:20:18.203579 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-a5775974-b478-4986-bb96-9908d614663b tempest-TestVolumeBackupRestore-1934945487 tempest-TestVolumeBackupRestore-1934945487-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:20:18.203579 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 18:20:18.203579 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-a5775974-b478-4986-bb96-9908d614663b tempest-TestVolumeBackupRestore-1934945487 tempest-TestVolumeBackupRestore-1934945487-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.349427 Aug 10 18:20:18.203579 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1089/2153] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 18:20:17 2022] POST /compute/v2.1/servers => generated 214 bytes in 351 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 10 18:20:18.458281 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-c18716fb-7ed4-46db-a6a4-61194e6d319d tempest-TestVolumeBackupRestore-1934945487 tempest-TestVolumeBackupRestore-1934945487-project] Calling method '.version_select at 0x7fb345e6e3a0>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:20:18.610389 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-c18716fb-7ed4-46db-a6a4-61194e6d319d tempest-TestVolumeBackupRestore-1934945487 tempest-TestVolumeBackupRestore-1934945487-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-49495173" status: 202 len: 0 microversion: 2.1 time: 0.156469 Aug 10 18:20:18.611027 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 1065/2154] 10.222.0.50 () {58 vars in 1263 bytes} [Wed Aug 10 18:20:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-49495173 => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 18:20:35.273764 n-d-852296-2 devstack@n-api.service[129410]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 18:20:35.274473 n-d-852296-2 devstack@n-api.service[129410]: Wed Aug 10 18:20:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 18:20:36.253304 n-d-852296-2 devstack@n-api.service[129409]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 18:20:36.255061 n-d-852296-2 devstack@n-api.service[129409]: Wed Aug 10 18:20:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 18:20:57.128608 n-d-852296-2 devstack@n-api.service[129410]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 18:20:57.129204 n-d-852296-2 devstack@n-api.service[129410]: Wed Aug 10 18:20:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 18:21:30.196410 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-5eca913e-0d9e-4ec7-b255-f4a34a53d291 tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-53710679", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452"}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 18:21:30.250272 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.network.neutron [None req-5eca913e-0d9e-4ec7-b255-f4a34a53d291 tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] validate_networks() for None {{(pid=129409) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 18:21:30.444466 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.virt.hardware [None req-5eca913e-0d9e-4ec7-b255-f4a34a53d291 tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Flavor limits 0:0:0 {{(pid=129409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 18:21:30.444946 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.virt.hardware [None req-5eca913e-0d9e-4ec7-b255-f4a34a53d291 tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Image limits 0:0:0 {{(pid=129409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 18:21:30.445421 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.virt.hardware [None req-5eca913e-0d9e-4ec7-b255-f4a34a53d291 tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Flavor pref 0:0:0 {{(pid=129409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 18:21:30.445826 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.virt.hardware [None req-5eca913e-0d9e-4ec7-b255-f4a34a53d291 tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Image pref 0:0:0 {{(pid=129409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 18:21:30.446234 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.virt.hardware [None req-5eca913e-0d9e-4ec7-b255-f4a34a53d291 tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 18:21:30.454982 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-5eca913e-0d9e-4ec7-b255-f4a34a53d291 tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:21:30.455458 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-5eca913e-0d9e-4ec7-b255-f4a34a53d291 tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:21:30.455888 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-5eca913e-0d9e-4ec7-b255-f4a34a53d291 tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:21:30.456645 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-5eca913e-0d9e-4ec7-b255-f4a34a53d291 tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:21:30.457093 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-5eca913e-0d9e-4ec7-b255-f4a34a53d291 tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:21:30.457510 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-5eca913e-0d9e-4ec7-b255-f4a34a53d291 tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:21:30.474556 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-5eca913e-0d9e-4ec7-b255-f4a34a53d291 tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Getting quotas for project 4cd4ee74f9cf4919b6ec46192795f63c. Resources: {'instances', 'ram', 'cores'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 18:21:30.480507 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-5eca913e-0d9e-4ec7-b255-f4a34a53d291 tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Getting quotas for user c8f519c273ad42c48dcbf99ad28087c0 and project 4cd4ee74f9cf4919b6ec46192795f63c. Resources: {'instances', 'ram', 'cores'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 18:21:30.492740 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-5eca913e-0d9e-4ec7-b255-f4a34a53d291 tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Going to run 1 instances... {{(pid=129409) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 18:21:30.494911 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-5eca913e-0d9e-4ec7-b255-f4a34a53d291 tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] [instance: 9f8e5d7a-dbfe-424e-b825-aee6a93623ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a735ff26-463a-4ffe-a981-ab9d9baa494f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 18:21:30.621953 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-5eca913e-0d9e-4ec7-b255-f4a34a53d291 tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.556540 Aug 10 18:21:30.622587 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1090/2155] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 18:21:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 558 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 18:21:30.633673 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_cell0:SELECT=4 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 18:21:30.634582 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 18:21:30.639912 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-c0ef94cf-f5b1-45ba-8913-223e6345214a tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:21:30.640774 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-c0ef94cf-f5b1-45ba-8913-223e6345214a tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] [instance: 9f8e5d7a-dbfe-424e-b825-aee6a93623ce] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:21:30.811514 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-c0ef94cf-f5b1-45ba-8913-223e6345214a tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f519c273ad42c48dcbf99ad28087c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4ee74f9cf4919b6ec46192795f63c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:21:30.818424 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-c0ef94cf-f5b1-45ba-8913-223e6345214a tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] 10.222.0.50 "GET /compute/v2.1/servers/9f8e5d7a-dbfe-424e-b825-aee6a93623ce" status: 200 len: 1220 microversion: 2.1 time: 0.187341 Aug 10 18:21:30.819008 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 1066/2156] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 18:21:30 2022] GET /compute/v2.1/servers/9f8e5d7a-dbfe-424e-b825-aee6a93623ce => generated 1220 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 18:21:31.839668 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-fa2cd2a1-a644-48f0-b507-39b0e2d18eab tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:21:31.840298 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-fa2cd2a1-a644-48f0-b507-39b0e2d18eab tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] [instance: 9f8e5d7a-dbfe-424e-b825-aee6a93623ce] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:21:31.892913 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-fa2cd2a1-a644-48f0-b507-39b0e2d18eab tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f519c273ad42c48dcbf99ad28087c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4ee74f9cf4919b6ec46192795f63c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:21:31.901813 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-fa2cd2a1-a644-48f0-b507-39b0e2d18eab tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] 10.222.0.50 "GET /compute/v2.1/servers/9f8e5d7a-dbfe-424e-b825-aee6a93623ce" status: 200 len: 1220 microversion: 2.1 time: 0.065986 Aug 10 18:21:31.902529 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1091/2157] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 18:21:31 2022] GET /compute/v2.1/servers/9f8e5d7a-dbfe-424e-b825-aee6a93623ce => generated 1220 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 18:21:32.925186 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-a7aaf421-0c56-4f15-89af-3718c8df1302 tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:21:32.925797 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-a7aaf421-0c56-4f15-89af-3718c8df1302 tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] [instance: 9f8e5d7a-dbfe-424e-b825-aee6a93623ce] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:21:32.933089 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a7aaf421-0c56-4f15-89af-3718c8df1302 tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:21:32.933576 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a7aaf421-0c56-4f15-89af-3718c8df1302 tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:21:32.934015 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a7aaf421-0c56-4f15-89af-3718c8df1302 tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:21:32.934714 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a7aaf421-0c56-4f15-89af-3718c8df1302 tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:21:32.935165 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a7aaf421-0c56-4f15-89af-3718c8df1302 tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:21:32.935588 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-a7aaf421-0c56-4f15-89af-3718c8df1302 tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:21:33.002441 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-a7aaf421-0c56-4f15-89af-3718c8df1302 tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f519c273ad42c48dcbf99ad28087c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4ee74f9cf4919b6ec46192795f63c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:21:33.010736 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-a7aaf421-0c56-4f15-89af-3718c8df1302 tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] 10.222.0.50 "GET /compute/v2.1/servers/9f8e5d7a-dbfe-424e-b825-aee6a93623ce" status: 200 len: 1272 microversion: 2.1 time: 0.090120 Aug 10 18:21:33.013344 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 1067/2158] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 18:21:32 2022] GET /compute/v2.1/servers/9f8e5d7a-dbfe-424e-b825-aee6a93623ce => generated 1272 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 18:21:34.032645 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-a8b74894-83d1-4a40-801a-5d3ae6c23f4e tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:21:34.033904 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-a8b74894-83d1-4a40-801a-5d3ae6c23f4e tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] [instance: 9f8e5d7a-dbfe-424e-b825-aee6a93623ce] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:21:34.041043 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a8b74894-83d1-4a40-801a-5d3ae6c23f4e tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:21:34.041531 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a8b74894-83d1-4a40-801a-5d3ae6c23f4e tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:21:34.041979 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a8b74894-83d1-4a40-801a-5d3ae6c23f4e tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:21:34.042707 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a8b74894-83d1-4a40-801a-5d3ae6c23f4e tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:21:34.043151 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a8b74894-83d1-4a40-801a-5d3ae6c23f4e tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:21:34.043576 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a8b74894-83d1-4a40-801a-5d3ae6c23f4e tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:21:34.106865 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-a8b74894-83d1-4a40-801a-5d3ae6c23f4e tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f519c273ad42c48dcbf99ad28087c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4ee74f9cf4919b6ec46192795f63c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:21:34.114565 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-a8b74894-83d1-4a40-801a-5d3ae6c23f4e tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] 10.222.0.50 "GET /compute/v2.1/servers/9f8e5d7a-dbfe-424e-b825-aee6a93623ce" status: 200 len: 1278 microversion: 2.1 time: 0.085661 Aug 10 18:21:34.126298 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1092/2159] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 18:21:34 2022] GET /compute/v2.1/servers/9f8e5d7a-dbfe-424e-b825-aee6a93623ce => generated 1278 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 18:21:35.137016 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-23b02f62-21af-4e0c-b0bd-8b6546a3f3cf tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:21:35.137807 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-23b02f62-21af-4e0c-b0bd-8b6546a3f3cf tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] [instance: 9f8e5d7a-dbfe-424e-b825-aee6a93623ce] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:21:35.145044 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-23b02f62-21af-4e0c-b0bd-8b6546a3f3cf tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:21:35.145606 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-23b02f62-21af-4e0c-b0bd-8b6546a3f3cf tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:21:35.146122 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-23b02f62-21af-4e0c-b0bd-8b6546a3f3cf tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:21:35.147456 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-23b02f62-21af-4e0c-b0bd-8b6546a3f3cf tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:21:35.148100 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-23b02f62-21af-4e0c-b0bd-8b6546a3f3cf tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:21:35.148561 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-23b02f62-21af-4e0c-b0bd-8b6546a3f3cf tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:21:35.271615 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [req-effa96ca-7787-47b6-969f-2333edfa2620 req-e833570f-ca26-4798-b1f6-57d66561eb8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f8e5d7a-dbfe-424e-b825-aee6a93623ce", "tag": "de6e7086-fc56-4d8a-9939-90884ab1c639"}]} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 18:21:35.282393 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-effa96ca-7787-47b6-969f-2333edfa2620 req-e833570f-ca26-4798-b1f6-57d66561eb8d service nova] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:21:35.282867 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-effa96ca-7787-47b6-969f-2333edfa2620 req-e833570f-ca26-4798-b1f6-57d66561eb8d service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:21:35.283295 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-effa96ca-7787-47b6-969f-2333edfa2620 req-e833570f-ca26-4798-b1f6-57d66561eb8d service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:21:35.294834 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.compute.server_external_events [req-effa96ca-7787-47b6-969f-2333edfa2620 req-e833570f-ca26-4798-b1f6-57d66561eb8d service nova] Creating event network-changed:de6e7086-fc56-4d8a-9939-90884ab1c639 for instance 9f8e5d7a-dbfe-424e-b825-aee6a93623ce on n-h1-852296-2 Aug 10 18:21:35.299850 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [req-effa96ca-7787-47b6-969f-2333edfa2620 req-e833570f-ca26-4798-b1f6-57d66561eb8d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032112 Aug 10 18:21:35.300469 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1093/2160] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 10 18:21:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 18:21:35.335816 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-23b02f62-21af-4e0c-b0bd-8b6546a3f3cf tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f519c273ad42c48dcbf99ad28087c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4ee74f9cf4919b6ec46192795f63c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:21:35.344110 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-23b02f62-21af-4e0c-b0bd-8b6546a3f3cf tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] 10.222.0.50 "GET /compute/v2.1/servers/9f8e5d7a-dbfe-424e-b825-aee6a93623ce" status: 200 len: 1320 microversion: 2.1 time: 0.211053 Aug 10 18:21:35.344923 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 1068/2161] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 18:21:35 2022] GET /compute/v2.1/servers/9f8e5d7a-dbfe-424e-b825-aee6a93623ce => generated 1320 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 18:21:36.365950 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-55c06402-2da8-4575-a2a5-1e1572d6608a tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:21:36.366644 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-55c06402-2da8-4575-a2a5-1e1572d6608a tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] [instance: 9f8e5d7a-dbfe-424e-b825-aee6a93623ce] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:21:36.372849 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-55c06402-2da8-4575-a2a5-1e1572d6608a tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:21:36.373352 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-55c06402-2da8-4575-a2a5-1e1572d6608a tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:21:36.373785 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-55c06402-2da8-4575-a2a5-1e1572d6608a tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:21:36.374467 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-55c06402-2da8-4575-a2a5-1e1572d6608a tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:21:36.374919 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-55c06402-2da8-4575-a2a5-1e1572d6608a tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:21:36.375342 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-55c06402-2da8-4575-a2a5-1e1572d6608a tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:21:36.513289 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-55c06402-2da8-4575-a2a5-1e1572d6608a tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f519c273ad42c48dcbf99ad28087c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4ee74f9cf4919b6ec46192795f63c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:21:36.520772 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-55c06402-2da8-4575-a2a5-1e1572d6608a tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] 10.222.0.50 "GET /compute/v2.1/servers/9f8e5d7a-dbfe-424e-b825-aee6a93623ce" status: 200 len: 1320 microversion: 2.1 time: 0.159075 Aug 10 18:21:36.521358 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1094/2162] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 18:21:36 2022] GET /compute/v2.1/servers/9f8e5d7a-dbfe-424e-b825-aee6a93623ce => generated 1320 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 18:21:37.542099 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-5982bbf1-0463-415d-8a55-3932a9bd2700 tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:21:37.542721 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-5982bbf1-0463-415d-8a55-3932a9bd2700 tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] [instance: 9f8e5d7a-dbfe-424e-b825-aee6a93623ce] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:21:37.549724 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-5982bbf1-0463-415d-8a55-3932a9bd2700 tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:21:37.550198 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-5982bbf1-0463-415d-8a55-3932a9bd2700 tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:21:37.550631 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-5982bbf1-0463-415d-8a55-3932a9bd2700 tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:21:37.551731 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-5982bbf1-0463-415d-8a55-3932a9bd2700 tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:21:37.551843 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-5982bbf1-0463-415d-8a55-3932a9bd2700 tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:21:37.552221 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-5982bbf1-0463-415d-8a55-3932a9bd2700 tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:21:37.689600 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-5982bbf1-0463-415d-8a55-3932a9bd2700 tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f519c273ad42c48dcbf99ad28087c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4ee74f9cf4919b6ec46192795f63c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:21:37.697711 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-5982bbf1-0463-415d-8a55-3932a9bd2700 tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] 10.222.0.50 "GET /compute/v2.1/servers/9f8e5d7a-dbfe-424e-b825-aee6a93623ce" status: 200 len: 1320 microversion: 2.1 time: 0.159803 Aug 10 18:21:37.698270 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 1069/2163] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 18:21:37 2022] GET /compute/v2.1/servers/9f8e5d7a-dbfe-424e-b825-aee6a93623ce => generated 1320 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 18:21:38.719011 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-73f3940e-dbc9-4c44-972a-d76d653ad535 tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:21:38.719624 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-73f3940e-dbc9-4c44-972a-d76d653ad535 tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] [instance: 9f8e5d7a-dbfe-424e-b825-aee6a93623ce] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:21:38.726298 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-73f3940e-dbc9-4c44-972a-d76d653ad535 tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:21:38.726774 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-73f3940e-dbc9-4c44-972a-d76d653ad535 tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:21:38.727211 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-73f3940e-dbc9-4c44-972a-d76d653ad535 tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:21:38.727899 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-73f3940e-dbc9-4c44-972a-d76d653ad535 tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:21:38.728379 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-73f3940e-dbc9-4c44-972a-d76d653ad535 tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:21:38.728804 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-73f3940e-dbc9-4c44-972a-d76d653ad535 tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:21:38.854474 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-73f3940e-dbc9-4c44-972a-d76d653ad535 tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f519c273ad42c48dcbf99ad28087c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4ee74f9cf4919b6ec46192795f63c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:21:38.861967 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-73f3940e-dbc9-4c44-972a-d76d653ad535 tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] 10.222.0.50 "GET /compute/v2.1/servers/9f8e5d7a-dbfe-424e-b825-aee6a93623ce" status: 200 len: 1320 microversion: 2.1 time: 0.146887 Aug 10 18:21:38.862542 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1095/2164] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 18:21:38 2022] GET /compute/v2.1/servers/9f8e5d7a-dbfe-424e-b825-aee6a93623ce => generated 1320 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 18:21:39.882995 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-dad0f83d-9f48-4018-ae28-a3ef0411a6ae tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:21:39.883600 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-dad0f83d-9f48-4018-ae28-a3ef0411a6ae tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] [instance: 9f8e5d7a-dbfe-424e-b825-aee6a93623ce] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:21:39.890025 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-dad0f83d-9f48-4018-ae28-a3ef0411a6ae tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:21:39.890508 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-dad0f83d-9f48-4018-ae28-a3ef0411a6ae tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:21:39.890947 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-dad0f83d-9f48-4018-ae28-a3ef0411a6ae tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:21:39.891641 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-dad0f83d-9f48-4018-ae28-a3ef0411a6ae tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:21:39.892124 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-dad0f83d-9f48-4018-ae28-a3ef0411a6ae tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:21:39.892573 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-dad0f83d-9f48-4018-ae28-a3ef0411a6ae tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:21:40.024450 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-dad0f83d-9f48-4018-ae28-a3ef0411a6ae tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f519c273ad42c48dcbf99ad28087c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4ee74f9cf4919b6ec46192795f63c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:21:40.031871 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-dad0f83d-9f48-4018-ae28-a3ef0411a6ae tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] 10.222.0.50 "GET /compute/v2.1/servers/9f8e5d7a-dbfe-424e-b825-aee6a93623ce" status: 200 len: 1320 microversion: 2.1 time: 0.152863 Aug 10 18:21:40.032472 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 1070/2165] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 18:21:39 2022] GET /compute/v2.1/servers/9f8e5d7a-dbfe-424e-b825-aee6a93623ce => generated 1320 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 18:21:41.054195 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-879c3f92-5ed7-4321-96db-eaeb18dacd74 tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:21:41.054813 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-879c3f92-5ed7-4321-96db-eaeb18dacd74 tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] [instance: 9f8e5d7a-dbfe-424e-b825-aee6a93623ce] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:21:41.056907 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_cell0:SELECT=2 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 18:21:41.061777 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-879c3f92-5ed7-4321-96db-eaeb18dacd74 tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:21:41.062265 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-879c3f92-5ed7-4321-96db-eaeb18dacd74 tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:21:41.062715 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-879c3f92-5ed7-4321-96db-eaeb18dacd74 tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:21:41.063410 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-879c3f92-5ed7-4321-96db-eaeb18dacd74 tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:21:41.063872 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-879c3f92-5ed7-4321-96db-eaeb18dacd74 tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:21:41.064336 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-879c3f92-5ed7-4321-96db-eaeb18dacd74 tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:21:41.198341 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-879c3f92-5ed7-4321-96db-eaeb18dacd74 tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f519c273ad42c48dcbf99ad28087c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4ee74f9cf4919b6ec46192795f63c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:21:41.206207 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-879c3f92-5ed7-4321-96db-eaeb18dacd74 tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] 10.222.0.50 "GET /compute/v2.1/servers/9f8e5d7a-dbfe-424e-b825-aee6a93623ce" status: 200 len: 1320 microversion: 2.1 time: 0.156005 Aug 10 18:21:41.206804 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1096/2166] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 18:21:41 2022] GET /compute/v2.1/servers/9f8e5d7a-dbfe-424e-b825-aee6a93623ce => generated 1320 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 18:21:42.228032 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-c94152d8-7a3d-4174-8148-03c91074d0bb tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:21:42.228678 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-c94152d8-7a3d-4174-8148-03c91074d0bb tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] [instance: 9f8e5d7a-dbfe-424e-b825-aee6a93623ce] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:21:42.235210 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-c94152d8-7a3d-4174-8148-03c91074d0bb tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:21:42.235694 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-c94152d8-7a3d-4174-8148-03c91074d0bb tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:21:42.236135 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-c94152d8-7a3d-4174-8148-03c91074d0bb tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:21:42.236847 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-c94152d8-7a3d-4174-8148-03c91074d0bb tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:21:42.237300 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-c94152d8-7a3d-4174-8148-03c91074d0bb tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:21:42.237724 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-c94152d8-7a3d-4174-8148-03c91074d0bb tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:21:42.372931 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-c94152d8-7a3d-4174-8148-03c91074d0bb tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f519c273ad42c48dcbf99ad28087c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4ee74f9cf4919b6ec46192795f63c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:21:42.380352 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-c94152d8-7a3d-4174-8148-03c91074d0bb tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] 10.222.0.50 "GET /compute/v2.1/servers/9f8e5d7a-dbfe-424e-b825-aee6a93623ce" status: 200 len: 1320 microversion: 2.1 time: 0.157277 Aug 10 18:21:42.380949 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 1071/2167] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 18:21:42 2022] GET /compute/v2.1/servers/9f8e5d7a-dbfe-424e-b825-aee6a93623ce => generated 1320 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 18:21:43.347294 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [req-6feaec34-5d6a-4091-9ac8-172ed772892a req-501974bd-bad0-4255-95c6-beca72b9bc5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f8e5d7a-dbfe-424e-b825-aee6a93623ce", "name": "network-vif-plugged", "status": "completed", "tag": "de6e7086-fc56-4d8a-9939-90884ab1c639"}]} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 18:21:43.354631 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_cell0:SELECT=8 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 18:21:43.358859 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-6feaec34-5d6a-4091-9ac8-172ed772892a req-501974bd-bad0-4255-95c6-beca72b9bc5f service nova] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:21:43.359343 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-6feaec34-5d6a-4091-9ac8-172ed772892a req-501974bd-bad0-4255-95c6-beca72b9bc5f service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:21:43.359781 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-6feaec34-5d6a-4091-9ac8-172ed772892a req-501974bd-bad0-4255-95c6-beca72b9bc5f service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:21:43.371549 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.compute.server_external_events [req-6feaec34-5d6a-4091-9ac8-172ed772892a req-501974bd-bad0-4255-95c6-beca72b9bc5f service nova] Creating event network-vif-plugged:de6e7086-fc56-4d8a-9939-90884ab1c639 for instance 9f8e5d7a-dbfe-424e-b825-aee6a93623ce on n-h1-852296-2 Aug 10 18:21:43.376562 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [req-6feaec34-5d6a-4091-9ac8-172ed772892a req-501974bd-bad0-4255-95c6-beca72b9bc5f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032890 Aug 10 18:21:43.377202 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1097/2168] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 10 18:21:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 18:21:43.402282 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-e8875c63-2964-4229-b0d3-586186f5e134 tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:21:43.406418 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-e8875c63-2964-4229-b0d3-586186f5e134 tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] [instance: 9f8e5d7a-dbfe-424e-b825-aee6a93623ce] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:21:43.408274 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_cell0:SELECT=2 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 18:21:43.413953 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e8875c63-2964-4229-b0d3-586186f5e134 tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:21:43.414441 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e8875c63-2964-4229-b0d3-586186f5e134 tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:21:43.415591 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e8875c63-2964-4229-b0d3-586186f5e134 tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:21:43.416636 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e8875c63-2964-4229-b0d3-586186f5e134 tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:21:43.417260 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e8875c63-2964-4229-b0d3-586186f5e134 tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:21:43.419113 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-e8875c63-2964-4229-b0d3-586186f5e134 tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:21:43.617825 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-e8875c63-2964-4229-b0d3-586186f5e134 tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f519c273ad42c48dcbf99ad28087c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4ee74f9cf4919b6ec46192795f63c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:21:43.625266 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-e8875c63-2964-4229-b0d3-586186f5e134 tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] 10.222.0.50 "GET /compute/v2.1/servers/9f8e5d7a-dbfe-424e-b825-aee6a93623ce" status: 200 len: 1320 microversion: 2.1 time: 0.227069 Aug 10 18:21:43.625859 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 1072/2169] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 18:21:43 2022] GET /compute/v2.1/servers/9f8e5d7a-dbfe-424e-b825-aee6a93623ce => generated 1320 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 18:21:44.648263 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-b096a86c-f32d-41ca-842c-fd208ffa8408 tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:21:44.648972 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-b096a86c-f32d-41ca-842c-fd208ffa8408 tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] [instance: 9f8e5d7a-dbfe-424e-b825-aee6a93623ce] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:21:44.655322 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-b096a86c-f32d-41ca-842c-fd208ffa8408 tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:21:44.655807 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-b096a86c-f32d-41ca-842c-fd208ffa8408 tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:21:44.656271 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-b096a86c-f32d-41ca-842c-fd208ffa8408 tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:21:44.657106 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-b096a86c-f32d-41ca-842c-fd208ffa8408 tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:21:44.657618 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-b096a86c-f32d-41ca-842c-fd208ffa8408 tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:21:44.658050 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-b096a86c-f32d-41ca-842c-fd208ffa8408 tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:21:44.794847 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-b096a86c-f32d-41ca-842c-fd208ffa8408 tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f519c273ad42c48dcbf99ad28087c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4ee74f9cf4919b6ec46192795f63c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:21:44.802582 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-b096a86c-f32d-41ca-842c-fd208ffa8408 tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] 10.222.0.50 "GET /compute/v2.1/servers/9f8e5d7a-dbfe-424e-b825-aee6a93623ce" status: 200 len: 1320 microversion: 2.1 time: 0.159791 Aug 10 18:21:44.803308 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1098/2170] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 18:21:44 2022] GET /compute/v2.1/servers/9f8e5d7a-dbfe-424e-b825-aee6a93623ce => generated 1320 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 18:21:45.823254 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-76de45f3-7691-4653-83f1-34335640d890 tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:21:45.823853 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-76de45f3-7691-4653-83f1-34335640d890 tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] [instance: 9f8e5d7a-dbfe-424e-b825-aee6a93623ce] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:21:45.830325 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-76de45f3-7691-4653-83f1-34335640d890 tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:21:45.830801 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-76de45f3-7691-4653-83f1-34335640d890 tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:21:45.831232 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-76de45f3-7691-4653-83f1-34335640d890 tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:21:45.832215 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-76de45f3-7691-4653-83f1-34335640d890 tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:21:45.832855 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-76de45f3-7691-4653-83f1-34335640d890 tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:21:45.833820 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-76de45f3-7691-4653-83f1-34335640d890 tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:21:45.966669 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-76de45f3-7691-4653-83f1-34335640d890 tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f519c273ad42c48dcbf99ad28087c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4ee74f9cf4919b6ec46192795f63c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:21:45.975147 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-76de45f3-7691-4653-83f1-34335640d890 tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] 10.222.0.50 "GET /compute/v2.1/servers/9f8e5d7a-dbfe-424e-b825-aee6a93623ce" status: 200 len: 1470 microversion: 2.1 time: 0.155347 Aug 10 18:21:45.975713 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 1073/2171] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 18:21:45 2022] GET /compute/v2.1/servers/9f8e5d7a-dbfe-424e-b825-aee6a93623ce => generated 1470 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 18:21:46.046930 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-21fc9e2f-7900-4e22-bf73-480cdb5b7fbf tempest-ServersAdminNegativeTestJSON-2090812071 tempest-ServersAdminNegativeTestJSON-2090812071-project-admin] Calling method '.version_select at 0x7fb345f1b1f0>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:21:46.114601 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-21fc9e2f-7900-4e22-bf73-480cdb5b7fbf tempest-ServersAdminNegativeTestJSON-2090812071 tempest-ServersAdminNegativeTestJSON-2090812071-project-admin] 10.222.0.50 "GET /compute/v2.1/os-quota-sets/7eb56a62cec44ca59a1e86c603c02d80" status: 200 len: 371 microversion: 2.1 time: 0.120547 Aug 10 18:21:46.118567 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1099/2172] 10.222.0.50 () {58 vars in 1242 bytes} [Wed Aug 10 18:21:45 2022] GET /compute/v2.1/os-quota-sets/7eb56a62cec44ca59a1e86c603c02d80 => generated 371 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 18:21:46.126569 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-c50a14f8-f84d-46c8-8293-d04c0c9543cd tempest-ServersAdminNegativeTestJSON-2090812071 tempest-ServersAdminNegativeTestJSON-2090812071-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1178335764", "id": 1057956856, "os-flavor-access:is_public": "True"}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 18:21:46.129865 n-d-852296-2 devstack@n-api.service[129410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 18:21:46.129865 n-d-852296-2 devstack@n-api.service[129410]: warnings.warn(msg) Aug 10 18:21:46.259807 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-c50a14f8-f84d-46c8-8293-d04c0c9543cd tempest-ServersAdminNegativeTestJSON-2090812071 tempest-ServersAdminNegativeTestJSON-2090812071-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.136868 Aug 10 18:21:46.261816 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 1074/2173] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 18:21:46 2022] POST /compute/v2.1/flavors => generated 438 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 18:21:46.272929 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-3114f8f5-ab13-4b02-9270-a7f668b85ae5 tempest-ServersAdminNegativeTestJSON-2090812071 tempest-ServersAdminNegativeTestJSON-2090812071-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1057956856"}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 18:21:46.275179 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-3114f8f5-ab13-4b02-9270-a7f668b85ae5 tempest-ServersAdminNegativeTestJSON-2090812071 tempest-ServersAdminNegativeTestJSON-2090812071-project-admin] [instance: 9f8e5d7a-dbfe-424e-b825-aee6a93623ce] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:21:46.281260 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-3114f8f5-ab13-4b02-9270-a7f668b85ae5 tempest-ServersAdminNegativeTestJSON-2090812071 tempest-ServersAdminNegativeTestJSON-2090812071-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:21:46.281744 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-3114f8f5-ab13-4b02-9270-a7f668b85ae5 tempest-ServersAdminNegativeTestJSON-2090812071 tempest-ServersAdminNegativeTestJSON-2090812071-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:21:46.282181 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-3114f8f5-ab13-4b02-9270-a7f668b85ae5 tempest-ServersAdminNegativeTestJSON-2090812071 tempest-ServersAdminNegativeTestJSON-2090812071-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:21:46.282870 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-3114f8f5-ab13-4b02-9270-a7f668b85ae5 tempest-ServersAdminNegativeTestJSON-2090812071 tempest-ServersAdminNegativeTestJSON-2090812071-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:21:46.283325 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-3114f8f5-ab13-4b02-9270-a7f668b85ae5 tempest-ServersAdminNegativeTestJSON-2090812071 tempest-ServersAdminNegativeTestJSON-2090812071-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:21:46.283757 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-3114f8f5-ab13-4b02-9270-a7f668b85ae5 tempest-ServersAdminNegativeTestJSON-2090812071 tempest-ServersAdminNegativeTestJSON-2090812071-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:21:46.373630 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [None req-3114f8f5-ab13-4b02-9270-a7f668b85ae5 tempest-ServersAdminNegativeTestJSON-2090812071 tempest-ServersAdminNegativeTestJSON-2090812071-project-admin] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-cfe94b83-7eea-4016-83a7-218de1987cbd) Aug 10 18:21:46.373630 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:21:46.373630 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:21:46.373630 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:21:46.373630 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:21:46.373630 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:21:46.373630 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 10 18:21:46.373630 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 10 18:21:46.373630 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 10 18:21:46.373630 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 10 18:21:46.373630 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 368, in inner Aug 10 18:21:46.373630 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi if self.network_api.instance_has_extended_resource_request( Aug 10 18:21:46.373630 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1035, in instance_has_extended_resource_request Aug 10 18:21:46.373630 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi if not self.has_extended_resource_request_extension(admin_context): Aug 10 18:21:46.373630 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 18:21:46.373630 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 18:21:46.373630 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 18:21:46.373630 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 18:21:46.373630 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 18:21:46.373630 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 18:21:46.373630 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:21:46.373630 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:21:46.373630 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 18:21:46.373630 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 18:21:46.373630 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:21:46.373630 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:21:46.373630 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 18:21:46.373630 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 18:21:46.373630 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:21:46.373630 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:21:46.373630 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:21:46.373630 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:21:46.373630 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:21:46.373630 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:21:46.373630 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 18:21:46.373630 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 18:21:46.373630 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 18:21:46.373630 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 18:21:46.373630 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 18:21:46.373630 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 18:21:46.373630 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 18:21:46.373630 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 18:21:46.373630 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 18:21:46.373630 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 18:21:46.373630 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 18:21:46.373630 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 18:21:46.373630 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 18:21:46.373630 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 18:21:46.373630 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 18:21:46.373630 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 18:21:46.377928 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 18:21:46.377928 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 18:21:46.377928 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 18:21:46.377928 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 18:21:46.377928 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 18:21:46.377928 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 18:21:46.377928 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 18:21:46.377928 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 18:21:46.377928 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 18:21:46.377928 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 18:21:46.377928 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-cfe94b83-7eea-4016-83a7-218de1987cbd) Aug 10 18:21:46.377928 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:21:46.377928 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-3114f8f5-ab13-4b02-9270-a7f668b85ae5 tempest-ServersAdminNegativeTestJSON-2090812071 tempest-ServersAdminNegativeTestJSON-2090812071-project-admin] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:21:46.377928 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 18:21:46.377928 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-3114f8f5-ab13-4b02-9270-a7f668b85ae5 tempest-ServersAdminNegativeTestJSON-2090812071 tempest-ServersAdminNegativeTestJSON-2090812071-project-admin] Request method failure captured: Aug 10 18:21:46.377928 n-d-852296-2 devstack@n-api.service[129409]: request: POST /compute/v2.1/servers/9f8e5d7a-dbfe-424e-b825-aee6a93623ce/action HTTP/1.1 Aug 10 18:21:46.377928 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 18:21:46.377928 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 18:21:46.377928 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 18:21:46.377928 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 39 Aug 10 18:21:46.377928 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 18:21:46.377928 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 18:21:46.377928 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 18:21:46.377928 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 18:21:46.377928 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8_cprDPzoSI4BviKGe2U0pcI-95f5Dw-KL6sr-9V2_eqPVzL2zW6BuFFvIIfL4NbfqP3oYHvZ0E7M7RCEejAzuiKZMowE5RlKZHiTPT_kzCpxINbcnixXCyOSG5svc63pXT6YKL2F5oZE5miCEF_QBqQe6Nz7U981ubuDpPkdAj3yMY Aug 10 18:21:46.377928 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 18:21:46.377928 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 18:21:46.377928 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 18:21:46.377928 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 18:21:46.377928 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 18:21:46.377928 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 18:21:46.377928 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: 7eb56a62cec44ca59a1e86c603c02d80 Aug 10 18:21:46.377928 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2090812071 Aug 10 18:21:46.377928 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member,admin Aug 10 18:21:46.377928 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member,admin Aug 10 18:21:46.377928 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7eb56a62cec44ca59a1e86c603c02d80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/7eb56a62cec44ca59a1e86c603c02d80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7eb56a62cec44ca59a1e86c603c02d80"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_7eb56a62cec44ca59a1e86c603c02d80", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 18:21:46.377928 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2090812071 Aug 10 18:21:46.377928 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: 7eb56a62cec44ca59a1e86c603c02d80 Aug 10 18:21:46.377928 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2090812071 Aug 10 18:21:46.377928 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-ServersAdminNegativeTestJSON-2090812071-project-admin Aug 10 18:21:46.377928 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 18:21:46.377928 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 18:21:46.377928 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: 2bd3440299014412907ee9a0b9b4a36a Aug 10 18:21:46.377928 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2090812071-project-admin Aug 10 18:21:46.377928 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 18:21:46.377928 n-d-852296-2 devstack@n-api.service[129409]: {"resize": {"flavorRef": "1057956856"}} Aug 10 18:21:46.377928 n-d-852296-2 devstack@n-api.service[129409]: method: > Aug 10 18:21:46.377928 n-d-852296-2 devstack@n-api.service[129409]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:21:46.377928 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 18:21:46.377928 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'id': '9f8e5d7a-dbfe-424e-b825-aee6a93623ce', 'body': {'resize': {'flavorRef': '1057956856'}}} Aug 10 18:21:46.377928 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 18:21:46.377928 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:21:46.377928 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:21:46.377928 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:21:46.377928 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:21:46.377928 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:21:46.377928 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 10 18:21:46.377928 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 10 18:21:46.383649 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 10 18:21:46.383649 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 10 18:21:46.383649 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 368, in inner Aug 10 18:21:46.383649 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi if self.network_api.instance_has_extended_resource_request( Aug 10 18:21:46.383649 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1035, in instance_has_extended_resource_request Aug 10 18:21:46.383649 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi if not self.has_extended_resource_request_extension(admin_context): Aug 10 18:21:46.383649 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 18:21:46.383649 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 18:21:46.383649 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 18:21:46.383649 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 18:21:46.383649 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 18:21:46.383649 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 18:21:46.383649 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:21:46.383649 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:21:46.383649 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 18:21:46.383649 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 18:21:46.383649 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:21:46.383649 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:21:46.383649 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 18:21:46.383649 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 18:21:46.383649 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:21:46.383649 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:21:46.383649 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:21:46.383649 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:21:46.383649 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:21:46.383649 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:21:46.383649 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 18:21:46.383649 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 18:21:46.383649 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 18:21:46.383649 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 18:21:46.383649 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 18:21:46.383649 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 18:21:46.383649 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 18:21:46.383649 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 18:21:46.383649 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 18:21:46.383649 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 18:21:46.383649 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 18:21:46.383649 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 18:21:46.383649 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 18:21:46.383649 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 18:21:46.383649 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 18:21:46.383649 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 18:21:46.383649 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 18:21:46.383649 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 18:21:46.383649 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 18:21:46.383649 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 18:21:46.383649 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 18:21:46.383649 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 18:21:46.383649 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 18:21:46.383649 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 18:21:46.383649 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 18:21:46.383649 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 18:21:46.388061 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-cfe94b83-7eea-4016-83a7-218de1987cbd) Aug 10 18:21:46.388061 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:21:46.388061 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:21:46.388061 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:21:46.388061 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:21:46.388061 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:21:46.388061 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:21:46.388061 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 18:21:46.388061 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 18:21:46.388061 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 10 18:21:46.388061 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 10 18:21:46.388061 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:21:46.388061 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:21:46.388061 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:21:46.388061 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:21:46.388061 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:21:46.388061 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:21:46.388061 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:21:46.388061 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:21:46.388061 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 18:21:46.388061 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 18:21:46.388061 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:21:46.388061 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:21:46.388061 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:21:46.388061 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-3114f8f5-ab13-4b02-9270-a7f668b85ae5 tempest-ServersAdminNegativeTestJSON-2090812071 tempest-ServersAdminNegativeTestJSON-2090812071-project-admin] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:21:46.388061 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 18:21:46.388061 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-3114f8f5-ab13-4b02-9270-a7f668b85ae5 tempest-ServersAdminNegativeTestJSON-2090812071 tempest-ServersAdminNegativeTestJSON-2090812071-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/9f8e5d7a-dbfe-424e-b825-aee6a93623ce/action" status: 500 len: 214 microversion: 2.1 time: 0.109372 Aug 10 18:21:46.388061 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1100/2174] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 10 18:21:46 2022] POST /compute/v2.1/servers/9f8e5d7a-dbfe-424e-b825-aee6a93623ce/action => generated 214 bytes in 110 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 10 18:21:46.390483 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-0f074eba-4e99-4b50-afaf-20dfaf0dc331 tempest-ServersAdminNegativeTestJSON-2090812071 tempest-ServersAdminNegativeTestJSON-2090812071-project-admin] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:21:46.390483 n-d-852296-2 devstack@n-api.service[129410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 18:21:46.390483 n-d-852296-2 devstack@n-api.service[129410]: warnings.warn(msg) Aug 10 18:21:46.528176 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-0f074eba-4e99-4b50-afaf-20dfaf0dc331 tempest-ServersAdminNegativeTestJSON-2090812071 tempest-ServersAdminNegativeTestJSON-2090812071-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/1057956856" status: 202 len: 0 microversion: 2.1 time: 0.142426 Aug 10 18:21:46.528741 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 1075/2175] 10.222.0.50 () {58 vars in 1161 bytes} [Wed Aug 10 18:21:46 2022] DELETE /compute/v2.1/flavors/1057956856 => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 18:21:46.537526 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-4258ba3c-b582-40e1-bc14-265a0b1d2a85 tempest-ServersAdminNegativeTestJSON-2090812071 tempest-ServersAdminNegativeTestJSON-2090812071-project-admin] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:21:46.558101 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-4258ba3c-b582-40e1-bc14-265a0b1d2a85 tempest-ServersAdminNegativeTestJSON-2090812071 tempest-ServersAdminNegativeTestJSON-2090812071-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024841 Aug 10 18:21:46.558651 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1101/2176] 10.222.0.50 () {58 vars in 1146 bytes} [Wed Aug 10 18:21:46 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 18:21:46.587448 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-2f53bfb9-e000-4371-bf30-0276cc43545a tempest-ServersAdminNegativeTestJSON-2090812071 tempest-ServersAdminNegativeTestJSON-2090812071-project-admin] Calling method '.version_select at 0x7fb345b4b4c0>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:21:46.663653 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-2f53bfb9-e000-4371-bf30-0276cc43545a tempest-ServersAdminNegativeTestJSON-2090812071 tempest-ServersAdminNegativeTestJSON-2090812071-project-admin] 10.222.0.50 "GET /compute/v2.1/os-quota-sets/7eb56a62cec44ca59a1e86c603c02d80" status: 200 len: 371 microversion: 2.1 time: 0.081100 Aug 10 18:21:46.664220 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 1076/2177] 10.222.0.50 () {58 vars in 1242 bytes} [Wed Aug 10 18:21:46 2022] GET /compute/v2.1/os-quota-sets/7eb56a62cec44ca59a1e86c603c02d80 => generated 371 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 18:21:46.675629 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-eaca24a5-6430-4063-99d0-6cb06c59aa2a tempest-ServersAdminNegativeTestJSON-2090812071 tempest-ServersAdminNegativeTestJSON-2090812071-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1807237868", "id": 430855181, "os-flavor-access:is_public": "True"}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 18:21:46.679214 n-d-852296-2 devstack@n-api.service[129409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 18:21:46.679214 n-d-852296-2 devstack@n-api.service[129409]: warnings.warn(msg) Aug 10 18:21:46.813659 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-eaca24a5-6430-4063-99d0-6cb06c59aa2a tempest-ServersAdminNegativeTestJSON-2090812071 tempest-ServersAdminNegativeTestJSON-2090812071-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 434 microversion: 2.1 time: 0.141678 Aug 10 18:21:46.814171 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1102/2178] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 18:21:46 2022] POST /compute/v2.1/flavors => generated 434 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 18:21:46.826094 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-144e8a33-ace1-4677-b69e-d6fe2d1b9fc9 tempest-ServersAdminNegativeTestJSON-2090812071 tempest-ServersAdminNegativeTestJSON-2090812071-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "430855181"}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 18:21:46.828452 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-144e8a33-ace1-4677-b69e-d6fe2d1b9fc9 tempest-ServersAdminNegativeTestJSON-2090812071 tempest-ServersAdminNegativeTestJSON-2090812071-project-admin] [instance: 9f8e5d7a-dbfe-424e-b825-aee6a93623ce] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:21:46.835708 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-144e8a33-ace1-4677-b69e-d6fe2d1b9fc9 tempest-ServersAdminNegativeTestJSON-2090812071 tempest-ServersAdminNegativeTestJSON-2090812071-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:21:46.836195 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-144e8a33-ace1-4677-b69e-d6fe2d1b9fc9 tempest-ServersAdminNegativeTestJSON-2090812071 tempest-ServersAdminNegativeTestJSON-2090812071-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:21:46.836671 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-144e8a33-ace1-4677-b69e-d6fe2d1b9fc9 tempest-ServersAdminNegativeTestJSON-2090812071 tempest-ServersAdminNegativeTestJSON-2090812071-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:21:46.837368 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-144e8a33-ace1-4677-b69e-d6fe2d1b9fc9 tempest-ServersAdminNegativeTestJSON-2090812071 tempest-ServersAdminNegativeTestJSON-2090812071-project-admin] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:21:46.837820 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-144e8a33-ace1-4677-b69e-d6fe2d1b9fc9 tempest-ServersAdminNegativeTestJSON-2090812071 tempest-ServersAdminNegativeTestJSON-2090812071-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:21:46.838250 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-144e8a33-ace1-4677-b69e-d6fe2d1b9fc9 tempest-ServersAdminNegativeTestJSON-2090812071 tempest-ServersAdminNegativeTestJSON-2090812071-project-admin] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:21:46.928099 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [None req-144e8a33-ace1-4677-b69e-d6fe2d1b9fc9 tempest-ServersAdminNegativeTestJSON-2090812071 tempest-ServersAdminNegativeTestJSON-2090812071-project-admin] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-6511ded6-3e2e-435d-9213-978fc55e8fdb) Aug 10 18:21:46.928099 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:21:46.928099 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:21:46.928099 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:21:46.928099 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:21:46.928099 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:21:46.928099 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 10 18:21:46.928099 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 10 18:21:46.928099 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 10 18:21:46.928099 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 10 18:21:46.928099 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 368, in inner Aug 10 18:21:46.928099 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi if self.network_api.instance_has_extended_resource_request( Aug 10 18:21:46.928099 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1035, in instance_has_extended_resource_request Aug 10 18:21:46.928099 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi if not self.has_extended_resource_request_extension(admin_context): Aug 10 18:21:46.928099 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 18:21:46.928099 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 18:21:46.928099 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 18:21:46.928099 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 18:21:46.928099 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 18:21:46.928099 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 18:21:46.928099 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:21:46.928099 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:21:46.928099 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 18:21:46.928099 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 18:21:46.928099 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:21:46.928099 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:21:46.928099 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 18:21:46.928099 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 18:21:46.928099 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:21:46.928099 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:21:46.928099 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:21:46.928099 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:21:46.928099 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:21:46.928099 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:21:46.928099 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 18:21:46.928099 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 18:21:46.928099 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 18:21:46.928099 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 18:21:46.928099 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 18:21:46.928099 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 18:21:46.928099 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 18:21:46.928099 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 18:21:46.928099 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 18:21:46.928099 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 18:21:46.928099 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 18:21:46.928099 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 18:21:46.928099 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 18:21:46.928099 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 18:21:46.928099 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 18:21:46.928099 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 18:21:46.936348 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 18:21:46.936348 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 18:21:46.936348 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 18:21:46.936348 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 18:21:46.936348 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 18:21:46.936348 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 18:21:46.936348 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 18:21:46.936348 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 18:21:46.936348 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 18:21:46.936348 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 18:21:46.936348 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-6511ded6-3e2e-435d-9213-978fc55e8fdb) Aug 10 18:21:46.936348 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:21:46.936348 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-144e8a33-ace1-4677-b69e-d6fe2d1b9fc9 tempest-ServersAdminNegativeTestJSON-2090812071 tempest-ServersAdminNegativeTestJSON-2090812071-project-admin] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:21:46.936348 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 18:21:46.936348 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-144e8a33-ace1-4677-b69e-d6fe2d1b9fc9 tempest-ServersAdminNegativeTestJSON-2090812071 tempest-ServersAdminNegativeTestJSON-2090812071-project-admin] Request method failure captured: Aug 10 18:21:46.936348 n-d-852296-2 devstack@n-api.service[129410]: request: POST /compute/v2.1/servers/9f8e5d7a-dbfe-424e-b825-aee6a93623ce/action HTTP/1.1 Aug 10 18:21:46.936348 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 18:21:46.936348 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 18:21:46.936348 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 18:21:46.936348 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 38 Aug 10 18:21:46.936348 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 18:21:46.936348 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 18:21:46.936348 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 18:21:46.936348 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 18:21:46.936348 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8_cprDPzoSI4BviKGe2U0pcI-95f5Dw-KL6sr-9V2_eqPVzL2zW6BuFFvIIfL4NbfqP3oYHvZ0E7M7RCEejAzuiKZMowE5RlKZHiTPT_kzCpxINbcnixXCyOSG5svc63pXT6YKL2F5oZE5miCEF_QBqQe6Nz7U981ubuDpPkdAj3yMY Aug 10 18:21:46.936348 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 18:21:46.936348 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 18:21:46.936348 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 18:21:46.936348 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 18:21:46.936348 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 18:21:46.936348 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 18:21:46.936348 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: 7eb56a62cec44ca59a1e86c603c02d80 Aug 10 18:21:46.936348 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2090812071 Aug 10 18:21:46.936348 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member,admin Aug 10 18:21:46.936348 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member,admin Aug 10 18:21:46.936348 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7eb56a62cec44ca59a1e86c603c02d80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/7eb56a62cec44ca59a1e86c603c02d80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7eb56a62cec44ca59a1e86c603c02d80"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_7eb56a62cec44ca59a1e86c603c02d80", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 18:21:46.936348 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2090812071 Aug 10 18:21:46.936348 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: 7eb56a62cec44ca59a1e86c603c02d80 Aug 10 18:21:46.936348 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2090812071 Aug 10 18:21:46.936348 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-ServersAdminNegativeTestJSON-2090812071-project-admin Aug 10 18:21:46.936348 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 18:21:46.936348 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 18:21:46.936348 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: 2bd3440299014412907ee9a0b9b4a36a Aug 10 18:21:46.936348 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2090812071-project-admin Aug 10 18:21:46.936348 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 18:21:46.936348 n-d-852296-2 devstack@n-api.service[129410]: {"resize": {"flavorRef": "430855181"}} Aug 10 18:21:46.936348 n-d-852296-2 devstack@n-api.service[129410]: method: > Aug 10 18:21:46.936348 n-d-852296-2 devstack@n-api.service[129410]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:21:46.936348 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 18:21:46.936348 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'id': '9f8e5d7a-dbfe-424e-b825-aee6a93623ce', 'body': {'resize': {'flavorRef': '430855181'}}} Aug 10 18:21:46.936348 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 18:21:46.936348 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:21:46.936348 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:21:46.936348 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:21:46.936348 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:21:46.936348 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:21:46.936348 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 10 18:21:46.936348 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 10 18:21:46.941290 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 10 18:21:46.941290 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 10 18:21:46.941290 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 368, in inner Aug 10 18:21:46.941290 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi if self.network_api.instance_has_extended_resource_request( Aug 10 18:21:46.941290 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1035, in instance_has_extended_resource_request Aug 10 18:21:46.941290 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi if not self.has_extended_resource_request_extension(admin_context): Aug 10 18:21:46.941290 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 18:21:46.941290 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 18:21:46.941290 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 18:21:46.941290 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 18:21:46.941290 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 18:21:46.941290 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 18:21:46.941290 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:21:46.941290 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:21:46.941290 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 18:21:46.941290 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 18:21:46.941290 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:21:46.941290 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:21:46.941290 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 18:21:46.941290 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 18:21:46.941290 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:21:46.941290 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:21:46.941290 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:21:46.941290 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:21:46.941290 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:21:46.941290 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:21:46.941290 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 18:21:46.941290 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 18:21:46.941290 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 18:21:46.941290 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 18:21:46.941290 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 18:21:46.941290 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 18:21:46.941290 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 18:21:46.941290 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 18:21:46.941290 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 18:21:46.941290 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 18:21:46.941290 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 18:21:46.941290 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 18:21:46.941290 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 18:21:46.941290 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 18:21:46.941290 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 18:21:46.941290 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 18:21:46.941290 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 18:21:46.941290 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 18:21:46.941290 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 18:21:46.941290 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 18:21:46.941290 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 18:21:46.941290 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 18:21:46.941290 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 18:21:46.941290 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 18:21:46.941290 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 18:21:46.941290 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 18:21:46.945583 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-6511ded6-3e2e-435d-9213-978fc55e8fdb) Aug 10 18:21:46.945583 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:21:46.945583 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:21:46.945583 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:21:46.945583 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:21:46.945583 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:21:46.945583 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:21:46.945583 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 18:21:46.945583 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 18:21:46.945583 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 10 18:21:46.945583 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 10 18:21:46.945583 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:21:46.945583 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:21:46.945583 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:21:46.945583 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:21:46.945583 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:21:46.945583 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:21:46.945583 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:21:46.945583 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:21:46.945583 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 18:21:46.945583 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 18:21:46.945583 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:21:46.945583 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:21:46.945583 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:21:46.945583 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-144e8a33-ace1-4677-b69e-d6fe2d1b9fc9 tempest-ServersAdminNegativeTestJSON-2090812071 tempest-ServersAdminNegativeTestJSON-2090812071-project-admin] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:21:46.945583 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 18:21:46.945583 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-144e8a33-ace1-4677-b69e-d6fe2d1b9fc9 tempest-ServersAdminNegativeTestJSON-2090812071 tempest-ServersAdminNegativeTestJSON-2090812071-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/9f8e5d7a-dbfe-424e-b825-aee6a93623ce/action" status: 500 len: 214 microversion: 2.1 time: 0.109982 Aug 10 18:21:46.945583 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 1077/2179] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 10 18:21:46 2022] POST /compute/v2.1/servers/9f8e5d7a-dbfe-424e-b825-aee6a93623ce/action => generated 214 bytes in 111 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 10 18:21:46.947891 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-60d2809c-b908-459a-8597-5e70af77af23 tempest-ServersAdminNegativeTestJSON-2090812071 tempest-ServersAdminNegativeTestJSON-2090812071-project-admin] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:21:46.947891 n-d-852296-2 devstack@n-api.service[129409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 18:21:46.947891 n-d-852296-2 devstack@n-api.service[129409]: warnings.warn(msg) Aug 10 18:21:47.019532 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-60d2809c-b908-459a-8597-5e70af77af23 tempest-ServersAdminNegativeTestJSON-2090812071 tempest-ServersAdminNegativeTestJSON-2090812071-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/430855181" status: 202 len: 0 microversion: 2.1 time: 0.082065 Aug 10 18:21:47.020109 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1103/2180] 10.222.0.50 () {58 vars in 1158 bytes} [Wed Aug 10 18:21:46 2022] DELETE /compute/v2.1/flavors/430855181 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 18:21:47.034543 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-a7a48d11-9cbb-4bc1-affd-e3f0465ff851 tempest-ServersAdminNegativeTestJSON-2090812071 tempest-ServersAdminNegativeTestJSON-2090812071-project-admin] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:21:47.055757 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-a7a48d11-9cbb-4bc1-affd-e3f0465ff851 tempest-ServersAdminNegativeTestJSON-2090812071 tempest-ServersAdminNegativeTestJSON-2090812071-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024961 Aug 10 18:21:47.056547 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 1078/2181] 10.222.0.50 () {58 vars in 1146 bytes} [Wed Aug 10 18:21:47 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 18:21:47.078207 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-19e95590-6581-447b-bf95-3738a8851ec3 tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:21:47.078776 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-19e95590-6581-447b-bf95-3738a8851ec3 tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] [instance: 9f8e5d7a-dbfe-424e-b825-aee6a93623ce] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:21:47.085705 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-19e95590-6581-447b-bf95-3738a8851ec3 tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:21:47.086231 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-19e95590-6581-447b-bf95-3738a8851ec3 tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:21:47.086688 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-19e95590-6581-447b-bf95-3738a8851ec3 tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:21:47.087395 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-19e95590-6581-447b-bf95-3738a8851ec3 tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:21:47.087851 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-19e95590-6581-447b-bf95-3738a8851ec3 tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:21:47.088299 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-19e95590-6581-447b-bf95-3738a8851ec3 tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:21:47.114024 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-19e95590-6581-447b-bf95-3738a8851ec3 tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] [instance: 9f8e5d7a-dbfe-424e-b825-aee6a93623ce] Going to try to terminate instance {{(pid=129409) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 18:21:47.442456 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-19e95590-6581-447b-bf95-3738a8851ec3 tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] 10.222.0.50 "DELETE /compute/v2.1/servers/9f8e5d7a-dbfe-424e-b825-aee6a93623ce" status: 204 len: 0 microversion: 2.1 time: 0.368165 Aug 10 18:21:47.443555 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1104/2182] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 10 18:21:47 2022] DELETE /compute/v2.1/servers/9f8e5d7a-dbfe-424e-b825-aee6a93623ce => generated 0 bytes in 370 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 18:21:47.451775 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-34cf1394-3da1-473d-aaed-b6fc1c2213db tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:21:47.455861 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-34cf1394-3da1-473d-aaed-b6fc1c2213db tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] [instance: 9f8e5d7a-dbfe-424e-b825-aee6a93623ce] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:21:47.458418 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-34cf1394-3da1-473d-aaed-b6fc1c2213db tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:21:47.459736 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-34cf1394-3da1-473d-aaed-b6fc1c2213db tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:21:47.460177 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-34cf1394-3da1-473d-aaed-b6fc1c2213db tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:21:47.460897 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-34cf1394-3da1-473d-aaed-b6fc1c2213db tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:21:47.461349 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-34cf1394-3da1-473d-aaed-b6fc1c2213db tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:21:47.461804 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-34cf1394-3da1-473d-aaed-b6fc1c2213db tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:21:47.592166 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-34cf1394-3da1-473d-aaed-b6fc1c2213db tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f519c273ad42c48dcbf99ad28087c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4ee74f9cf4919b6ec46192795f63c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:21:47.600483 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-34cf1394-3da1-473d-aaed-b6fc1c2213db tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] 10.222.0.50 "GET /compute/v2.1/servers/9f8e5d7a-dbfe-424e-b825-aee6a93623ce" status: 200 len: 1476 microversion: 2.1 time: 0.152503 Aug 10 18:21:47.601046 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 1079/2183] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 18:21:47 2022] GET /compute/v2.1/servers/9f8e5d7a-dbfe-424e-b825-aee6a93623ce => generated 1476 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 18:21:48.622079 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-3092cd8a-76b7-4513-9e82-205445aa6f2b tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:21:48.622855 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-3092cd8a-76b7-4513-9e82-205445aa6f2b tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] [instance: 9f8e5d7a-dbfe-424e-b825-aee6a93623ce] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:21:48.628912 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-3092cd8a-76b7-4513-9e82-205445aa6f2b tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:21:48.629390 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-3092cd8a-76b7-4513-9e82-205445aa6f2b tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:21:48.629824 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-3092cd8a-76b7-4513-9e82-205445aa6f2b tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:21:48.631124 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-3092cd8a-76b7-4513-9e82-205445aa6f2b tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:21:48.631603 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-3092cd8a-76b7-4513-9e82-205445aa6f2b tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:21:48.632028 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-3092cd8a-76b7-4513-9e82-205445aa6f2b tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:21:48.765114 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.policy [None req-3092cd8a-76b7-4513-9e82-205445aa6f2b tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f519c273ad42c48dcbf99ad28087c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4ee74f9cf4919b6ec46192795f63c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:21:48.773380 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-3092cd8a-76b7-4513-9e82-205445aa6f2b tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] 10.222.0.50 "GET /compute/v2.1/servers/9f8e5d7a-dbfe-424e-b825-aee6a93623ce" status: 200 len: 1476 microversion: 2.1 time: 0.155511 Aug 10 18:21:48.773946 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1105/2184] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 18:21:48 2022] GET /compute/v2.1/servers/9f8e5d7a-dbfe-424e-b825-aee6a93623ce => generated 1476 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 18:21:49.794266 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-da63de92-21cb-424e-a1af-3264a377189e tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:21:49.794871 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-da63de92-21cb-424e-a1af-3264a377189e tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] [instance: 9f8e5d7a-dbfe-424e-b825-aee6a93623ce] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:21:49.805677 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-da63de92-21cb-424e-a1af-3264a377189e tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:21:49.805677 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-da63de92-21cb-424e-a1af-3264a377189e tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:21:49.805677 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-da63de92-21cb-424e-a1af-3264a377189e tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:21:49.805677 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-da63de92-21cb-424e-a1af-3264a377189e tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:21:49.805677 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-da63de92-21cb-424e-a1af-3264a377189e tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:21:49.805677 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-da63de92-21cb-424e-a1af-3264a377189e tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:21:49.935337 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-da63de92-21cb-424e-a1af-3264a377189e tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f519c273ad42c48dcbf99ad28087c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4ee74f9cf4919b6ec46192795f63c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:21:49.942804 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-da63de92-21cb-424e-a1af-3264a377189e tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] 10.222.0.50 "GET /compute/v2.1/servers/9f8e5d7a-dbfe-424e-b825-aee6a93623ce" status: 200 len: 1476 microversion: 2.1 time: 0.152492 Aug 10 18:21:49.943412 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 1080/2185] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 18:21:49 2022] GET /compute/v2.1/servers/9f8e5d7a-dbfe-424e-b825-aee6a93623ce => generated 1476 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 18:21:50.048119 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [req-4c3fa198-0131-4df7-b7af-32a5ff031bba req-fa9ce730-b5a1-4543-b6a3-d41197624f61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f8e5d7a-dbfe-424e-b825-aee6a93623ce", "name": "network-vif-deleted", "tag": "de6e7086-fc56-4d8a-9939-90884ab1c639"}]} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 18:21:50.058456 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-4c3fa198-0131-4df7-b7af-32a5ff031bba req-fa9ce730-b5a1-4543-b6a3-d41197624f61 service nova] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:21:50.058856 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-4c3fa198-0131-4df7-b7af-32a5ff031bba req-fa9ce730-b5a1-4543-b6a3-d41197624f61 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:21:50.059287 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [req-4c3fa198-0131-4df7-b7af-32a5ff031bba req-fa9ce730-b5a1-4543-b6a3-d41197624f61 service nova] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:21:50.071363 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.compute.server_external_events [req-4c3fa198-0131-4df7-b7af-32a5ff031bba req-fa9ce730-b5a1-4543-b6a3-d41197624f61 service nova] Creating event network-vif-deleted:de6e7086-fc56-4d8a-9939-90884ab1c639 for instance 9f8e5d7a-dbfe-424e-b825-aee6a93623ce on n-h1-852296-2 Aug 10 18:21:50.076594 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [req-4c3fa198-0131-4df7-b7af-32a5ff031bba req-fa9ce730-b5a1-4543-b6a3-d41197624f61 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033115 Aug 10 18:21:50.077637 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1106/2186] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 10 18:21:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 18:21:50.963119 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-94688ad5-f166-4536-8f09-39cc1f96b057 tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Calling method '>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:21:50.963763 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.compute.api [None req-94688ad5-f166-4536-8f09-39cc1f96b057 tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] [instance: 9f8e5d7a-dbfe-424e-b825-aee6a93623ce] Fetching instance by UUID {{(pid=129410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:21:50.970329 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-94688ad5-f166-4536-8f09-39cc1f96b057 tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:21:50.970811 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-94688ad5-f166-4536-8f09-39cc1f96b057 tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:21:50.971320 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-94688ad5-f166-4536-8f09-39cc1f96b057 tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:21:50.972104 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-94688ad5-f166-4536-8f09-39cc1f96b057 tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:21:50.972587 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-94688ad5-f166-4536-8f09-39cc1f96b057 tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:21:50.973016 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-94688ad5-f166-4536-8f09-39cc1f96b057 tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:21:51.005630 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-94688ad5-f166-4536-8f09-39cc1f96b057 tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:21:51.006145 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-94688ad5-f166-4536-8f09-39cc1f96b057 tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:21:51.006582 n-d-852296-2 devstack@n-api.service[129410]: DEBUG oslo_concurrency.lockutils [None req-94688ad5-f166-4536-8f09-39cc1f96b057 tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:21:51.007022 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.objects.instance [None req-94688ad5-f166-4536-8f09-39cc1f96b057 tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Lazy-loading 'fault' on Instance uuid 9f8e5d7a-dbfe-424e-b825-aee6a93623ce {{(pid=129410) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 18:21:51.048887 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.policy [None req-94688ad5-f166-4536-8f09-39cc1f96b057 tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f519c273ad42c48dcbf99ad28087c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4ee74f9cf4919b6ec46192795f63c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 18:21:51.057741 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-94688ad5-f166-4536-8f09-39cc1f96b057 tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] 10.222.0.50 "GET /compute/v2.1/servers/9f8e5d7a-dbfe-424e-b825-aee6a93623ce" status: 200 len: 1310 microversion: 2.1 time: 0.098660 Aug 10 18:21:51.058311 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 1081/2187] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 18:21:50 2022] GET /compute/v2.1/servers/9f8e5d7a-dbfe-424e-b825-aee6a93623ce => generated 1310 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 18:21:52.081883 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-a89ee4fe-538e-4eaa-8984-d2e1e36dba50 tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Calling method '>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:21:52.082592 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.compute.api [None req-a89ee4fe-538e-4eaa-8984-d2e1e36dba50 tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] [instance: 9f8e5d7a-dbfe-424e-b825-aee6a93623ce] Fetching instance by UUID {{(pid=129409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 18:21:52.089219 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a89ee4fe-538e-4eaa-8984-d2e1e36dba50 tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:21:52.089709 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a89ee4fe-538e-4eaa-8984-d2e1e36dba50 tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:21:52.090156 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a89ee4fe-538e-4eaa-8984-d2e1e36dba50 tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:21:52.090852 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a89ee4fe-538e-4eaa-8984-d2e1e36dba50 tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Acquiring lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 18:21:52.091312 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a89ee4fe-538e-4eaa-8984-d2e1e36dba50 tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 18:21:52.091745 n-d-852296-2 devstack@n-api.service[129409]: DEBUG oslo_concurrency.lockutils [None req-a89ee4fe-538e-4eaa-8984-d2e1e36dba50 tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Lock "eb80cdf1-5ac7-4611-abc6-59802fe86dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 18:21:52.105401 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-a89ee4fe-538e-4eaa-8984-d2e1e36dba50 tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] HTTP exception thrown: Instance 9f8e5d7a-dbfe-424e-b825-aee6a93623ce could not be found. Aug 10 18:21:52.107332 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-a89ee4fe-538e-4eaa-8984-d2e1e36dba50 tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Request method failure captured: Aug 10 18:21:52.107332 n-d-852296-2 devstack@n-api.service[129409]: request: GET /compute/v2.1/servers/9f8e5d7a-dbfe-424e-b825-aee6a93623ce HTTP/1.1 Aug 10 18:21:52.107332 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 18:21:52.107332 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 18:21:52.107332 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 18:21:52.107332 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 0 Aug 10 18:21:52.107332 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 18:21:52.107332 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 18:21:52.107332 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 18:21:52.107332 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 18:21:52.107332 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8_cp4BVU3wZuzFzMo9h-HSmYQ7K0uVQLEn-ovaEvUDtqV5Y82c77YvY7j36twjfBcrNoUJ5Jg9lxLsYNb7SV_hutk7i3TifMWeVCI0yk4Bejm2yzmfLIyibpsWWeXxjgLUa9tn_L5TPi9yb1bcdHwU9r87QsuiIOhUthZYBuX0q9ryg Aug 10 18:21:52.107332 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 18:21:52.107332 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 18:21:52.107332 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 18:21:52.107332 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 18:21:52.107332 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 18:21:52.107332 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 18:21:52.107332 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: 4cd4ee74f9cf4919b6ec46192795f63c Aug 10 18:21:52.107332 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-724863111 Aug 10 18:21:52.107332 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 18:21:52.107332 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 18:21:52.107332 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4cd4ee74f9cf4919b6ec46192795f63c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4cd4ee74f9cf4919b6ec46192795f63c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4cd4ee74f9cf4919b6ec46192795f63c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4cd4ee74f9cf4919b6ec46192795f63c", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 18:21:52.107332 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-ServersAdminNegativeTestJSON-724863111 Aug 10 18:21:52.107332 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: 4cd4ee74f9cf4919b6ec46192795f63c Aug 10 18:21:52.107332 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-724863111 Aug 10 18:21:52.107332 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-ServersAdminNegativeTestJSON-724863111-project Aug 10 18:21:52.107332 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 18:21:52.107332 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 18:21:52.107332 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: c8f519c273ad42c48dcbf99ad28087c0 Aug 10 18:21:52.107332 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-ServersAdminNegativeTestJSON-724863111-project Aug 10 18:21:52.107332 n-d-852296-2 devstack@n-api.service[129409]: method: > Aug 10 18:21:52.107332 n-d-852296-2 devstack@n-api.service[129409]: exception: Instance 9f8e5d7a-dbfe-424e-b825-aee6a93623ce could not be found. Aug 10 18:21:52.107332 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'id': '9f8e5d7a-dbfe-424e-b825-aee6a93623ce'} Aug 10 18:21:52.107332 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 18:21:52.107332 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:21:52.107332 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 18:21:52.107332 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 18:21:52.107332 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 18:21:52.107332 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 18:21:52.107332 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 18:21:52.107332 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 18:21:52.107332 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 18:21:52.107332 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 18:21:52.107332 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f8e5d7a-dbfe-424e-b825-aee6a93623ce could not be found. Aug 10 18:21:52.107332 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:21:52.107332 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:21:52.107332 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:21:52.107332 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:21:52.107332 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:21:52.107332 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:21:52.107332 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 18:21:52.107332 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 18:21:52.107332 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:21:52.107332 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:21:52.107332 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 18:21:52.107332 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 18:21:52.107332 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 18:21:52.107332 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 18:21:52.107332 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 18:21:52.107332 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 18:21:52.107332 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f8e5d7a-dbfe-424e-b825-aee6a93623ce could not be found. Aug 10 18:21:52.107332 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:21:52.107332 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:21:52.113017 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:21:52.113017 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:21:52.113017 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:21:52.113017 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:21:52.113017 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 18:21:52.113017 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 18:21:52.113017 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f8e5d7a-dbfe-424e-b825-aee6a93623ce could not be found. Aug 10 18:21:52.113017 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:21:52.113017 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-a89ee4fe-538e-4eaa-8984-d2e1e36dba50 tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] Returning 404 to user: Instance 9f8e5d7a-dbfe-424e-b825-aee6a93623ce could not be found. {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 18:21:52.113017 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-a89ee4fe-538e-4eaa-8984-d2e1e36dba50 tempest-ServersAdminNegativeTestJSON-724863111 tempest-ServersAdminNegativeTestJSON-724863111-project] 10.222.0.50 "GET /compute/v2.1/servers/9f8e5d7a-dbfe-424e-b825-aee6a93623ce" status: 404 len: 111 microversion: 2.1 time: 0.030844 Aug 10 18:21:52.113017 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1107/2188] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 10 18:21:52 2022] GET /compute/v2.1/servers/9f8e5d7a-dbfe-424e-b825-aee6a93623ce => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 18:22:01.533586 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_cell0:SELECT=2 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 18:22:01.534402 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1,nova_api:DELETE=3 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 18:22:01.535836 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_cell1:SELECT=66 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 18:22:01.658697 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-0cae1cff-da16-4331-84ee-61c1a09ed6bb tempest-DeleteServersTestJSON-1716889769 tempest-DeleteServersTestJSON-1716889769-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1253847662", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "5ffd08c9-ed27-46f5-b5fb-f3e543aa4d35"}]}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 18:22:01.715335 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.network.neutron [None req-0cae1cff-da16-4331-84ee-61c1a09ed6bb tempest-DeleteServersTestJSON-1716889769 tempest-DeleteServersTestJSON-1716889769-project] validate_networks() for [('5ffd08c9-ed27-46f5-b5fb-f3e543aa4d35', None, None, None, None, None)] {{(pid=129410) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 18:22:01.925454 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [None req-0cae1cff-da16-4331-84ee-61c1a09ed6bb tempest-DeleteServersTestJSON-1716889769 tempest-DeleteServersTestJSON-1716889769-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-48a73e2a-0939-4cf3-95d5-ff14b1e70f85) Aug 10 18:22:01.925454 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:22:01.925454 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:22:01.925454 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:22:01.925454 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:22:01.925454 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:22:01.925454 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:22:01.925454 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:22:01.925454 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:22:01.925454 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:22:01.925454 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 18:22:01.925454 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 18:22:01.925454 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 18:22:01.925454 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 18:22:01.925454 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 18:22:01.925454 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 18:22:01.925454 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 18:22:01.925454 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 18:22:01.925454 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 18:22:01.925454 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 18:22:01.925454 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 18:22:01.925454 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 18:22:01.925454 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 18:22:01.925454 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 18:22:01.925454 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 18:22:01.925454 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 18:22:01.925454 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 18:22:01.925454 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:22:01.925454 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:22:01.925454 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 18:22:01.925454 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 18:22:01.925454 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:22:01.925454 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:22:01.925454 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 18:22:01.925454 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 18:22:01.925454 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:22:01.925454 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:22:01.925454 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:22:01.925454 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:22:01.925454 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:22:01.925454 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:22:01.925454 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 18:22:01.925454 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 18:22:01.925454 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 18:22:01.925454 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 18:22:01.925454 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 18:22:01.925454 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 18:22:01.925454 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 18:22:01.925454 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 18:22:01.925454 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 18:22:01.925454 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 18:22:01.925454 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 18:22:01.925454 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 18:22:01.930405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 18:22:01.930405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 18:22:01.930405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 18:22:01.930405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 18:22:01.930405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 18:22:01.930405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 18:22:01.930405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 18:22:01.930405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 18:22:01.930405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 18:22:01.930405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 18:22:01.930405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 18:22:01.930405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 18:22:01.930405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 18:22:01.930405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 18:22:01.930405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-48a73e2a-0939-4cf3-95d5-ff14b1e70f85) Aug 10 18:22:01.930405 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:22:01.930405 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-0cae1cff-da16-4331-84ee-61c1a09ed6bb tempest-DeleteServersTestJSON-1716889769 tempest-DeleteServersTestJSON-1716889769-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:22:01.930405 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 18:22:01.930405 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-0cae1cff-da16-4331-84ee-61c1a09ed6bb tempest-DeleteServersTestJSON-1716889769 tempest-DeleteServersTestJSON-1716889769-project] Request method failure captured: Aug 10 18:22:01.930405 n-d-852296-2 devstack@n-api.service[129410]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 18:22:01.930405 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 18:22:01.930405 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 18:22:01.930405 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 18:22:01.930405 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 207 Aug 10 18:22:01.930405 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 18:22:01.930405 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 18:22:01.930405 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 18:22:01.930405 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 18:22:01.930405 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8_dJWOeEdrXZz5P8ymBm_j8KxO7uiBkSKXL15off1cSxz-3c85l3SkNsruGG0RkiyKhXz6DB8hGqJTIf7fN3x7mPtN5hql6AcqqO5PaObpjwGisorNTwSN85CDIYI82SUMZLg3zt8boh78ESG0soGCDFLXvACuQntkcd6cG4mez0tiE Aug 10 18:22:01.930405 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 18:22:01.930405 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 18:22:01.930405 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 18:22:01.930405 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 18:22:01.930405 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 18:22:01.930405 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 18:22:01.930405 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: f4e4c18989a34e6d810754f455d2fcdb Aug 10 18:22:01.930405 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-DeleteServersTestJSON-1716889769 Aug 10 18:22:01.930405 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 18:22:01.930405 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 18:22:01.930405 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f4e4c18989a34e6d810754f455d2fcdb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f4e4c18989a34e6d810754f455d2fcdb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f4e4c18989a34e6d810754f455d2fcdb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f4e4c18989a34e6d810754f455d2fcdb", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 18:22:01.930405 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-DeleteServersTestJSON-1716889769 Aug 10 18:22:01.930405 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: f4e4c18989a34e6d810754f455d2fcdb Aug 10 18:22:01.930405 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-DeleteServersTestJSON-1716889769 Aug 10 18:22:01.930405 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-DeleteServersTestJSON-1716889769-project Aug 10 18:22:01.930405 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 18:22:01.930405 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 18:22:01.930405 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: 90736175c4494ab59d6739850012f105 Aug 10 18:22:01.930405 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-DeleteServersTestJSON-1716889769-project Aug 10 18:22:01.930405 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 18:22:01.930405 n-d-852296-2 devstack@n-api.service[129410]: {"server": {"name": "tempest-DeleteServersTestJSON-server-1253847662", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "5ffd08c9-ed27-46f5-b5fb-f3e543aa4d35"}]}} Aug 10 18:22:01.930405 n-d-852296-2 devstack@n-api.service[129410]: method: > Aug 10 18:22:01.930405 n-d-852296-2 devstack@n-api.service[129410]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:22:01.930405 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 18:22:01.930405 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'body': {'server': {'name': 'tempest-DeleteServersTestJSON-server-1253847662', 'imageRef': 'a735ff26-463a-4ffe-a981-ab9d9baa494f', 'flavorRef': '452', 'networks': [{'uuid': '5ffd08c9-ed27-46f5-b5fb-f3e543aa4d35'}]}}} Aug 10 18:22:01.930405 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 18:22:01.936643 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:22:01.936643 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:22:01.936643 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:22:01.936643 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:22:01.936643 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:22:01.936643 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:22:01.936643 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:22:01.936643 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:22:01.936643 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:22:01.936643 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 18:22:01.936643 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 18:22:01.936643 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 18:22:01.936643 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 18:22:01.936643 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 18:22:01.936643 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 18:22:01.936643 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 18:22:01.936643 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 18:22:01.936643 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 18:22:01.936643 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 18:22:01.936643 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 18:22:01.936643 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 18:22:01.936643 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 18:22:01.936643 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 18:22:01.936643 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 18:22:01.936643 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 18:22:01.936643 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 18:22:01.936643 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:22:01.936643 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:22:01.936643 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 18:22:01.936643 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 18:22:01.936643 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:22:01.936643 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:22:01.936643 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 18:22:01.936643 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 18:22:01.936643 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:22:01.936643 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:22:01.936643 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:22:01.936643 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:22:01.936643 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:22:01.936643 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:22:01.936643 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 18:22:01.936643 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 18:22:01.936643 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 18:22:01.936643 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 18:22:01.936643 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 18:22:01.936643 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 18:22:01.936643 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 18:22:01.936643 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 18:22:01.936643 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 18:22:01.936643 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 18:22:01.936643 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 18:22:01.936643 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 18:22:01.936643 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 18:22:01.936643 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 18:22:01.936643 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 18:22:01.936643 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 18:22:01.947122 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 18:22:01.947122 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 18:22:01.947122 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 18:22:01.947122 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 18:22:01.947122 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 18:22:01.947122 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 18:22:01.947122 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 18:22:01.947122 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 18:22:01.947122 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 18:22:01.947122 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 18:22:01.947122 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-48a73e2a-0939-4cf3-95d5-ff14b1e70f85) Aug 10 18:22:01.947122 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:22:01.947122 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:22:01.947122 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:22:01.947122 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:22:01.947122 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:22:01.947122 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:22:01.947122 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 18:22:01.947122 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 18:22:01.947122 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 10 18:22:01.947122 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 10 18:22:01.947122 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:22:01.947122 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:22:01.947122 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:22:01.947122 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:22:01.947122 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:22:01.947122 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:22:01.947122 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:22:01.947122 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:22:01.947122 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 18:22:01.947122 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 18:22:01.947122 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:22:01.947122 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:22:01.947122 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:22:01.947122 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-0cae1cff-da16-4331-84ee-61c1a09ed6bb tempest-DeleteServersTestJSON-1716889769 tempest-DeleteServersTestJSON-1716889769-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:22:01.947122 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 18:22:01.947122 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-0cae1cff-da16-4331-84ee-61c1a09ed6bb tempest-DeleteServersTestJSON-1716889769 tempest-DeleteServersTestJSON-1716889769-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.401597 Aug 10 18:22:01.947122 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 1082/2189] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 18:22:01 2022] POST /compute/v2.1/servers => generated 214 bytes in 403 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 10 18:22:14.302307 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_cell0:SELECT=2 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 18:22:14.303167 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=4,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 18:22:14.303814 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 18:22:14.419086 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-e8e4c712-debb-4a1d-bc08-c0906ee96b92 tempest-ServerDiskConfigTestJSON-1989117421 tempest-ServerDiskConfigTestJSON-1989117421-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1038992259", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "86c44e63-80d9-411d-92fa-b12114b9ce79"}]}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 18:22:14.597953 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.network.neutron [None req-e8e4c712-debb-4a1d-bc08-c0906ee96b92 tempest-ServerDiskConfigTestJSON-1989117421 tempest-ServerDiskConfigTestJSON-1989117421-project] validate_networks() for [('86c44e63-80d9-411d-92fa-b12114b9ce79', None, None, None, None, None)] {{(pid=129409) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 18:22:14.799575 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [None req-e8e4c712-debb-4a1d-bc08-c0906ee96b92 tempest-ServerDiskConfigTestJSON-1989117421 tempest-ServerDiskConfigTestJSON-1989117421-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-821c1b97-5e7d-44d2-b101-1e3587d3a842) Aug 10 18:22:14.799575 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:22:14.799575 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:22:14.799575 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:22:14.799575 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:22:14.799575 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:22:14.799575 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:22:14.799575 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:22:14.799575 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:22:14.799575 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:22:14.799575 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 18:22:14.799575 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 18:22:14.799575 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 18:22:14.799575 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 18:22:14.799575 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 18:22:14.799575 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 18:22:14.799575 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 18:22:14.799575 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 18:22:14.799575 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 18:22:14.799575 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 18:22:14.799575 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 18:22:14.799575 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 18:22:14.799575 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 18:22:14.799575 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 18:22:14.799575 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 18:22:14.799575 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 18:22:14.799575 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 18:22:14.799575 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:22:14.799575 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:22:14.799575 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 18:22:14.799575 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 18:22:14.799575 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:22:14.799575 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:22:14.799575 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 18:22:14.799575 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 18:22:14.799575 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:22:14.799575 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:22:14.799575 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:22:14.799575 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:22:14.799575 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:22:14.799575 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:22:14.799575 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 18:22:14.799575 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 18:22:14.799575 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 18:22:14.799575 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 18:22:14.799575 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 18:22:14.799575 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 18:22:14.799575 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 18:22:14.799575 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 18:22:14.799575 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 18:22:14.799575 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 18:22:14.799575 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 18:22:14.804353 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 18:22:14.804353 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 18:22:14.804353 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 18:22:14.804353 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 18:22:14.804353 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 18:22:14.804353 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 18:22:14.804353 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 18:22:14.804353 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 18:22:14.804353 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 18:22:14.804353 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 18:22:14.804353 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 18:22:14.804353 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 18:22:14.804353 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 18:22:14.804353 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 18:22:14.804353 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 18:22:14.804353 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-821c1b97-5e7d-44d2-b101-1e3587d3a842) Aug 10 18:22:14.804353 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:22:14.804353 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-e8e4c712-debb-4a1d-bc08-c0906ee96b92 tempest-ServerDiskConfigTestJSON-1989117421 tempest-ServerDiskConfigTestJSON-1989117421-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:22:14.804353 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 18:22:14.804353 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-e8e4c712-debb-4a1d-bc08-c0906ee96b92 tempest-ServerDiskConfigTestJSON-1989117421 tempest-ServerDiskConfigTestJSON-1989117421-project] Request method failure captured: Aug 10 18:22:14.804353 n-d-852296-2 devstack@n-api.service[129409]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 18:22:14.804353 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 18:22:14.804353 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 18:22:14.804353 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 18:22:14.804353 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 210 Aug 10 18:22:14.804353 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 18:22:14.804353 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 18:22:14.804353 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 18:22:14.804353 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 18:22:14.804353 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8_dWabUTGaZndzFNaalFhz5nwHYnI6OfWL57BsalnDCIsw4lQ5CVMmFK8fCtvkw1y1_oUBFRB3b2OL_G8O6QPI9ewWtwiZU4A7l6FmYyohiVCWCh1SvYgnkehx5TETDqB_BF36yKPjX_8Iw5LQTMvxaYCi28Xb-KOB9my97D45prSdE Aug 10 18:22:14.804353 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 18:22:14.804353 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 18:22:14.804353 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 18:22:14.804353 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 18:22:14.804353 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 18:22:14.804353 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 18:22:14.804353 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: 209fe671a1a343d2a4879a75119c2c6f Aug 10 18:22:14.804353 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1989117421 Aug 10 18:22:14.804353 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 18:22:14.804353 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 18:22:14.804353 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/209fe671a1a343d2a4879a75119c2c6f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/209fe671a1a343d2a4879a75119c2c6f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/209fe671a1a343d2a4879a75119c2c6f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_209fe671a1a343d2a4879a75119c2c6f", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 18:22:14.804353 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-ServerDiskConfigTestJSON-1989117421 Aug 10 18:22:14.804353 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: 209fe671a1a343d2a4879a75119c2c6f Aug 10 18:22:14.804353 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1989117421 Aug 10 18:22:14.804353 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-ServerDiskConfigTestJSON-1989117421-project Aug 10 18:22:14.804353 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 18:22:14.804353 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 18:22:14.804353 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: 80e357010a6c42a39c8b90bc55fc8a17 Aug 10 18:22:14.804353 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-ServerDiskConfigTestJSON-1989117421-project Aug 10 18:22:14.804353 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 18:22:14.804353 n-d-852296-2 devstack@n-api.service[129409]: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1038992259", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "86c44e63-80d9-411d-92fa-b12114b9ce79"}]}} Aug 10 18:22:14.804353 n-d-852296-2 devstack@n-api.service[129409]: method: > Aug 10 18:22:14.804353 n-d-852296-2 devstack@n-api.service[129409]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:22:14.804353 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 18:22:14.804353 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'body': {'server': {'name': 'tempest-ServerDiskConfigTestJSON-server-1038992259', 'imageRef': 'a735ff26-463a-4ffe-a981-ab9d9baa494f', 'flavorRef': '452', 'networks': [{'uuid': '86c44e63-80d9-411d-92fa-b12114b9ce79'}]}}} Aug 10 18:22:14.809448 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 18:22:14.809448 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:22:14.809448 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:22:14.809448 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:22:14.809448 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:22:14.809448 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:22:14.809448 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:22:14.809448 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:22:14.809448 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:22:14.809448 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:22:14.809448 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 18:22:14.809448 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 18:22:14.809448 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 18:22:14.809448 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 18:22:14.809448 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 18:22:14.809448 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 18:22:14.809448 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 18:22:14.809448 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 18:22:14.809448 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 18:22:14.809448 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 18:22:14.809448 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 18:22:14.809448 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 18:22:14.809448 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 18:22:14.809448 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 18:22:14.809448 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 18:22:14.809448 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 18:22:14.809448 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 18:22:14.809448 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:22:14.809448 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:22:14.809448 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 18:22:14.809448 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 18:22:14.809448 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:22:14.809448 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:22:14.809448 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 18:22:14.809448 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 18:22:14.809448 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:22:14.809448 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:22:14.809448 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:22:14.809448 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:22:14.809448 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:22:14.809448 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:22:14.809448 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 18:22:14.809448 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 18:22:14.809448 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 18:22:14.809448 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 18:22:14.809448 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 18:22:14.809448 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 18:22:14.809448 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 18:22:14.809448 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 18:22:14.809448 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 18:22:14.809448 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 18:22:14.809448 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 18:22:14.809448 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 18:22:14.809448 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 18:22:14.809448 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 18:22:14.809448 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 18:22:14.813345 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 18:22:14.813345 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 18:22:14.813345 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 18:22:14.813345 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 18:22:14.813345 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 18:22:14.813345 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 18:22:14.813345 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 18:22:14.813345 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 18:22:14.813345 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 18:22:14.813345 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 18:22:14.813345 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 18:22:14.813345 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-821c1b97-5e7d-44d2-b101-1e3587d3a842) Aug 10 18:22:14.813345 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:22:14.813345 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:22:14.813345 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:22:14.813345 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:22:14.813345 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:22:14.813345 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:22:14.813345 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 18:22:14.813345 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 18:22:14.813345 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 10 18:22:14.813345 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 10 18:22:14.813345 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:22:14.813345 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:22:14.813345 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:22:14.813345 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:22:14.813345 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:22:14.813345 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:22:14.813345 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:22:14.813345 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:22:14.813345 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 18:22:14.813345 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 18:22:14.813345 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:22:14.813345 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:22:14.813345 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:22:14.813345 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-e8e4c712-debb-4a1d-bc08-c0906ee96b92 tempest-ServerDiskConfigTestJSON-1989117421 tempest-ServerDiskConfigTestJSON-1989117421-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:22:14.813345 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 18:22:14.813345 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-e8e4c712-debb-4a1d-bc08-c0906ee96b92 tempest-ServerDiskConfigTestJSON-1989117421 tempest-ServerDiskConfigTestJSON-1989117421-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.506303 Aug 10 18:22:14.813345 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1108/2190] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 18:22:14 2022] POST /compute/v2.1/servers => generated 214 bytes in 508 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 10 18:22:14.857843 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-268534ef-50b3-4ccd-8286-15f506808d13 tempest-ServerDiskConfigTestJSON-1989117421 tempest-ServerDiskConfigTestJSON-1989117421-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-366439139", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "86c44e63-80d9-411d-92fa-b12114b9ce79"}]}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 18:22:14.919550 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.network.neutron [None req-268534ef-50b3-4ccd-8286-15f506808d13 tempest-ServerDiskConfigTestJSON-1989117421 tempest-ServerDiskConfigTestJSON-1989117421-project] validate_networks() for [('86c44e63-80d9-411d-92fa-b12114b9ce79', None, None, None, None, None)] {{(pid=129410) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 18:22:15.121425 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [None req-268534ef-50b3-4ccd-8286-15f506808d13 tempest-ServerDiskConfigTestJSON-1989117421 tempest-ServerDiskConfigTestJSON-1989117421-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-5247f2a6-8a60-40d9-9294-5716c05c1715) Aug 10 18:22:15.121425 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:22:15.121425 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:22:15.121425 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:22:15.121425 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:22:15.121425 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:22:15.121425 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:22:15.121425 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:22:15.121425 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:22:15.121425 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:22:15.121425 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 18:22:15.121425 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 18:22:15.121425 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 18:22:15.121425 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 18:22:15.121425 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 18:22:15.121425 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 18:22:15.121425 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 18:22:15.121425 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 18:22:15.121425 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 18:22:15.121425 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 18:22:15.121425 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 18:22:15.121425 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 18:22:15.121425 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 18:22:15.121425 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 18:22:15.121425 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 18:22:15.121425 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 18:22:15.121425 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 18:22:15.121425 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:22:15.121425 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:22:15.121425 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 18:22:15.121425 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 18:22:15.121425 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:22:15.121425 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:22:15.121425 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 18:22:15.121425 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 18:22:15.121425 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:22:15.121425 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:22:15.121425 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:22:15.121425 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:22:15.121425 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:22:15.121425 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:22:15.121425 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 18:22:15.121425 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 18:22:15.121425 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 18:22:15.121425 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 18:22:15.121425 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 18:22:15.121425 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 18:22:15.121425 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 18:22:15.121425 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 18:22:15.121425 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 18:22:15.121425 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 18:22:15.121425 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 18:22:15.127161 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 18:22:15.127161 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 18:22:15.127161 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 18:22:15.127161 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 18:22:15.127161 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 18:22:15.127161 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 18:22:15.127161 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 18:22:15.127161 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 18:22:15.127161 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 18:22:15.127161 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 18:22:15.127161 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 18:22:15.127161 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 18:22:15.127161 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 18:22:15.127161 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 18:22:15.127161 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 18:22:15.127161 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-5247f2a6-8a60-40d9-9294-5716c05c1715) Aug 10 18:22:15.127161 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:22:15.127161 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-268534ef-50b3-4ccd-8286-15f506808d13 tempest-ServerDiskConfigTestJSON-1989117421 tempest-ServerDiskConfigTestJSON-1989117421-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:22:15.127161 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 18:22:15.127161 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-268534ef-50b3-4ccd-8286-15f506808d13 tempest-ServerDiskConfigTestJSON-1989117421 tempest-ServerDiskConfigTestJSON-1989117421-project] Request method failure captured: Aug 10 18:22:15.127161 n-d-852296-2 devstack@n-api.service[129410]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 18:22:15.127161 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 18:22:15.127161 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 18:22:15.127161 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 18:22:15.127161 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 209 Aug 10 18:22:15.127161 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 18:22:15.127161 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 18:22:15.127161 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 18:22:15.127161 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 18:22:15.127161 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8_dWabUTGaZndzFNaalFhz5nwHYnI6OfWL57BsalnDCIsw4lQ5CVMmFK8fCtvkw1y1_oUBFRB3b2OL_G8O6QPI9ewWtwiZU4A7l6FmYyohiVCWCh1SvYgnkehx5TETDqB_BF36yKPjX_8Iw5LQTMvxaYCi28Xb-KOB9my97D45prSdE Aug 10 18:22:15.127161 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 18:22:15.127161 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 18:22:15.127161 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 18:22:15.127161 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 18:22:15.127161 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 18:22:15.127161 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 18:22:15.127161 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: 209fe671a1a343d2a4879a75119c2c6f Aug 10 18:22:15.127161 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1989117421 Aug 10 18:22:15.127161 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 18:22:15.127161 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 18:22:15.127161 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/209fe671a1a343d2a4879a75119c2c6f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/209fe671a1a343d2a4879a75119c2c6f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/209fe671a1a343d2a4879a75119c2c6f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_209fe671a1a343d2a4879a75119c2c6f", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 18:22:15.127161 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-ServerDiskConfigTestJSON-1989117421 Aug 10 18:22:15.127161 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: 209fe671a1a343d2a4879a75119c2c6f Aug 10 18:22:15.127161 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1989117421 Aug 10 18:22:15.127161 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-ServerDiskConfigTestJSON-1989117421-project Aug 10 18:22:15.127161 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 18:22:15.127161 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 18:22:15.127161 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: 80e357010a6c42a39c8b90bc55fc8a17 Aug 10 18:22:15.127161 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-ServerDiskConfigTestJSON-1989117421-project Aug 10 18:22:15.127161 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 18:22:15.127161 n-d-852296-2 devstack@n-api.service[129410]: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-366439139", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "86c44e63-80d9-411d-92fa-b12114b9ce79"}]}} Aug 10 18:22:15.127161 n-d-852296-2 devstack@n-api.service[129410]: method: > Aug 10 18:22:15.127161 n-d-852296-2 devstack@n-api.service[129410]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:22:15.127161 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 18:22:15.127161 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'body': {'server': {'name': 'tempest-ServerDiskConfigTestJSON-server-366439139', 'imageRef': 'a735ff26-463a-4ffe-a981-ab9d9baa494f', 'flavorRef': '452', 'networks': [{'uuid': '86c44e63-80d9-411d-92fa-b12114b9ce79'}]}}} Aug 10 18:22:15.137267 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 18:22:15.137267 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:22:15.137267 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:22:15.137267 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:22:15.137267 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:22:15.137267 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:22:15.137267 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:22:15.137267 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:22:15.137267 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:22:15.137267 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:22:15.137267 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 18:22:15.137267 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 18:22:15.137267 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 18:22:15.137267 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 18:22:15.137267 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 18:22:15.137267 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 18:22:15.137267 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 18:22:15.137267 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 18:22:15.137267 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 18:22:15.137267 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 18:22:15.137267 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 18:22:15.137267 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 18:22:15.137267 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 18:22:15.137267 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 18:22:15.137267 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 18:22:15.137267 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 18:22:15.137267 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 18:22:15.137267 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:22:15.137267 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:22:15.137267 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 18:22:15.137267 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 18:22:15.137267 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:22:15.137267 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:22:15.137267 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 18:22:15.137267 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 18:22:15.137267 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:22:15.137267 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:22:15.137267 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:22:15.137267 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:22:15.137267 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:22:15.137267 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:22:15.137267 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 18:22:15.137267 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 18:22:15.137267 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 18:22:15.137267 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 18:22:15.137267 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 18:22:15.137267 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 18:22:15.137267 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 18:22:15.137267 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 18:22:15.137267 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 18:22:15.137267 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 18:22:15.137267 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 18:22:15.137267 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 18:22:15.137267 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 18:22:15.137267 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 18:22:15.137267 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 18:22:15.142247 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 18:22:15.142247 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 18:22:15.142247 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 18:22:15.142247 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 18:22:15.142247 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 18:22:15.142247 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 18:22:15.142247 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 18:22:15.142247 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 18:22:15.142247 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 18:22:15.142247 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 18:22:15.142247 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 18:22:15.142247 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-5247f2a6-8a60-40d9-9294-5716c05c1715) Aug 10 18:22:15.142247 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:22:15.142247 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:22:15.142247 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:22:15.142247 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:22:15.142247 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:22:15.142247 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:22:15.142247 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 18:22:15.142247 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 18:22:15.142247 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 10 18:22:15.142247 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 10 18:22:15.142247 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:22:15.142247 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:22:15.142247 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:22:15.142247 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:22:15.142247 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:22:15.142247 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:22:15.142247 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:22:15.142247 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:22:15.142247 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 18:22:15.142247 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 18:22:15.142247 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:22:15.142247 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:22:15.142247 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:22:15.142247 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-268534ef-50b3-4ccd-8286-15f506808d13 tempest-ServerDiskConfigTestJSON-1989117421 tempest-ServerDiskConfigTestJSON-1989117421-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:22:15.142247 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 18:22:15.142247 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-268534ef-50b3-4ccd-8286-15f506808d13 tempest-ServerDiskConfigTestJSON-1989117421 tempest-ServerDiskConfigTestJSON-1989117421-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.274016 Aug 10 18:22:15.142247 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 1083/2191] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 18:22:14 2022] POST /compute/v2.1/servers => generated 214 bytes in 275 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 10 18:22:16.108309 n-d-852296-2 devstack@n-api.service[129409]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 18:22:16.108846 n-d-852296-2 devstack@n-api.service[129409]: Wed Aug 10 18:22:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 18:22:26.407453 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-7450a676-75f0-419a-a3ec-81a9540917ce tempest-ServerActionsTestJSON-1597233884 tempest-ServerActionsTestJSON-1597233884-project] Action: 'create', calling method: .version_select at 0x7fb345d32dc0>, body: {"keypair": {"name": "tempest-keypair-1862497744", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIkqp9CwaL+6banjyv3D++0zzUKRPlbmlmzhYbKuIlXioFML9dNwjR+3XQwdVfW2uEQYT6ODTJ6MXUvdyIXRqzVXz0pJdz6nqAuTDTqDmrhI/zsRdj3KoS+22l0NHHRUfw=="}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 18:22:26.430713 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-7450a676-75f0-419a-a3ec-81a9540917ce tempest-ServerActionsTestJSON-1597233884 tempest-ServerActionsTestJSON-1597233884-project] Getting quotas for project ea90f5e7443b4fb48b382f3d8052b326. Resources: {'key_pairs'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 18:22:26.436806 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-7450a676-75f0-419a-a3ec-81a9540917ce tempest-ServerActionsTestJSON-1597233884 tempest-ServerActionsTestJSON-1597233884-project] Getting quotas for user 42b34b70cdff41e98790562b6d6e1c7e and project ea90f5e7443b4fb48b382f3d8052b326. Resources: {'key_pairs'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 18:22:26.517522 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-7450a676-75f0-419a-a3ec-81a9540917ce tempest-ServerActionsTestJSON-1597233884 tempest-ServerActionsTestJSON-1597233884-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.236925 Aug 10 18:22:26.518136 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1109/2192] 10.222.0.50 () {60 vars in 1159 bytes} [Wed Aug 10 18:22:26 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 18:22:28.966556 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-9b866e98-74e2-4727-9cf3-5abe33fd9240 tempest-ServerActionsTestJSON-1597233884 tempest-ServerActionsTestJSON-1597233884-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1234989355", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e73accdd-fac2-486c-aa41-3e8947796cc0"}], "security_groups": [{"name": "tempest-securitygroup--519403590"}], "key_name": "tempest-keypair-1862497744", "user_data": "}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 18:22:29.078165 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.network.neutron [None req-9b866e98-74e2-4727-9cf3-5abe33fd9240 tempest-ServerActionsTestJSON-1597233884 tempest-ServerActionsTestJSON-1597233884-project] validate_networks() for [('e73accdd-fac2-486c-aa41-3e8947796cc0', None, None, None, None, None)] {{(pid=129410) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 18:22:29.302701 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [None req-9b866e98-74e2-4727-9cf3-5abe33fd9240 tempest-ServerActionsTestJSON-1597233884 tempest-ServerActionsTestJSON-1597233884-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-944205b7-a5e2-438a-b461-9093e641d192) Aug 10 18:22:29.302701 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:22:29.302701 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:22:29.302701 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:22:29.302701 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:22:29.302701 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:22:29.302701 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:22:29.302701 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:22:29.302701 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:22:29.302701 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:22:29.302701 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 18:22:29.302701 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 18:22:29.302701 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 18:22:29.302701 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 18:22:29.302701 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 18:22:29.302701 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 18:22:29.302701 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 18:22:29.302701 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 18:22:29.302701 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 18:22:29.302701 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 18:22:29.302701 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 18:22:29.302701 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 18:22:29.302701 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 18:22:29.302701 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 18:22:29.302701 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 18:22:29.302701 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 18:22:29.302701 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 18:22:29.302701 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:22:29.302701 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:22:29.302701 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 18:22:29.302701 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 18:22:29.302701 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:22:29.302701 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:22:29.302701 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 18:22:29.302701 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 18:22:29.302701 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:22:29.302701 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:22:29.302701 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:22:29.302701 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:22:29.302701 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:22:29.302701 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:22:29.302701 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 18:22:29.302701 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 18:22:29.302701 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 18:22:29.302701 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 18:22:29.302701 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 18:22:29.302701 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 18:22:29.302701 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 18:22:29.302701 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 18:22:29.302701 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 18:22:29.302701 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 18:22:29.302701 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 18:22:29.302701 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 18:22:29.307767 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 18:22:29.307767 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 18:22:29.307767 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 18:22:29.307767 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 18:22:29.307767 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 18:22:29.307767 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 18:22:29.307767 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 18:22:29.307767 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 18:22:29.307767 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 18:22:29.307767 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 18:22:29.307767 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 18:22:29.307767 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 18:22:29.307767 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 18:22:29.307767 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 18:22:29.307767 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-944205b7-a5e2-438a-b461-9093e641d192) Aug 10 18:22:29.307767 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:22:29.307767 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-9b866e98-74e2-4727-9cf3-5abe33fd9240 tempest-ServerActionsTestJSON-1597233884 tempest-ServerActionsTestJSON-1597233884-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:22:29.307767 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 18:22:29.307767 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-9b866e98-74e2-4727-9cf3-5abe33fd9240 tempest-ServerActionsTestJSON-1597233884 tempest-ServerActionsTestJSON-1597233884-project] Request method failure captured: Aug 10 18:22:29.307767 n-d-852296-2 devstack@n-api.service[129410]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 18:22:29.307767 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 18:22:29.307767 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 18:22:29.307767 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 18:22:29.307767 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 493 Aug 10 18:22:29.307767 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 18:22:29.307767 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 18:22:29.307767 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 18:22:29.307767 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 18:22:29.307767 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8_dikmI49SCMUXFsNwZFvFvLk7uA7eAEs42V5C-EyDJ3Qff6AC-PBnS1C1hxHk17-_9svnymHacqmIcuajMmor4TewE_QKikOmv7CqrrvJ1xpsc4i5J5jdNOQjjAfmXawt3y6CgvqHmGo8ZmzRJ-CnkVYfRn90mAwqjM5KbMw4eyBDE Aug 10 18:22:29.307767 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 18:22:29.307767 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 18:22:29.307767 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 18:22:29.307767 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 18:22:29.307767 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 18:22:29.307767 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 18:22:29.307767 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: ea90f5e7443b4fb48b382f3d8052b326 Aug 10 18:22:29.307767 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-ServerActionsTestJSON-1597233884 Aug 10 18:22:29.307767 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 18:22:29.307767 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 18:22:29.307767 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ea90f5e7443b4fb48b382f3d8052b326"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/ea90f5e7443b4fb48b382f3d8052b326"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ea90f5e7443b4fb48b382f3d8052b326"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_ea90f5e7443b4fb48b382f3d8052b326", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 18:22:29.307767 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-ServerActionsTestJSON-1597233884 Aug 10 18:22:29.307767 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: ea90f5e7443b4fb48b382f3d8052b326 Aug 10 18:22:29.307767 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-ServerActionsTestJSON-1597233884 Aug 10 18:22:29.307767 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-ServerActionsTestJSON-1597233884-project Aug 10 18:22:29.307767 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 18:22:29.307767 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 18:22:29.307767 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: 42b34b70cdff41e98790562b6d6e1c7e Aug 10 18:22:29.307767 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-ServerActionsTestJSON-1597233884-project Aug 10 18:22:29.307767 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 18:22:29.307767 n-d-852296-2 devstack@n-api.service[129410]: {"server": {"name": "tempest-ServerActionsTestJSON-server-1234989355", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "adminPass": "E3_MMQPY77ypv8%", "networks": [{"uuid": "e73accdd-fac2-486c-aa41-3e8947796cc0"}], "security_groups": [{"name": "tempest-securitygroup--519403590"}], "key_name": "tempest-keypair-1862497744", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} Aug 10 18:22:29.307767 n-d-852296-2 devstack@n-api.service[129410]: method: > Aug 10 18:22:29.307767 n-d-852296-2 devstack@n-api.service[129410]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:22:29.307767 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 18:22:29.311936 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'body': {'server': {'name': 'tempest-ServerActionsTestJSON-server-1234989355', 'imageRef': 'a735ff26-463a-4ffe-a981-ab9d9baa494f', 'flavorRef': '452', 'adminPass': 'E3_MMQPY77ypv8%', 'networks': [{'uuid': 'e73accdd-fac2-486c-aa41-3e8947796cc0'}], 'security_groups': [{'name': 'tempest-securitygroup--519403590'}], 'key_name': 'tempest-keypair-1862497744', 'user_data': 'IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo='}}} Aug 10 18:22:29.311936 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 18:22:29.311936 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:22:29.311936 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:22:29.311936 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:22:29.311936 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:22:29.311936 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:22:29.311936 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:22:29.311936 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:22:29.311936 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:22:29.311936 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:22:29.311936 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 18:22:29.311936 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 18:22:29.311936 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 18:22:29.311936 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 18:22:29.311936 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 18:22:29.311936 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 18:22:29.311936 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 18:22:29.311936 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 18:22:29.311936 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 18:22:29.311936 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 18:22:29.311936 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 18:22:29.311936 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 18:22:29.311936 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 18:22:29.311936 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 18:22:29.311936 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 18:22:29.311936 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 18:22:29.311936 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 18:22:29.311936 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:22:29.311936 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:22:29.311936 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 18:22:29.311936 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 18:22:29.311936 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:22:29.311936 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:22:29.311936 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 18:22:29.311936 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 18:22:29.311936 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:22:29.311936 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:22:29.311936 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:22:29.311936 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:22:29.311936 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:22:29.311936 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:22:29.311936 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 18:22:29.311936 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 18:22:29.311936 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 18:22:29.311936 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 18:22:29.311936 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 18:22:29.311936 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 18:22:29.311936 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 18:22:29.311936 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 18:22:29.311936 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 18:22:29.311936 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 18:22:29.311936 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 18:22:29.316842 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 18:22:29.316842 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 18:22:29.316842 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 18:22:29.316842 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 18:22:29.316842 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 18:22:29.316842 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 18:22:29.316842 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 18:22:29.316842 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 18:22:29.316842 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 18:22:29.316842 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 18:22:29.316842 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 18:22:29.316842 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 18:22:29.316842 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 18:22:29.316842 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 18:22:29.316842 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 18:22:29.316842 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-944205b7-a5e2-438a-b461-9093e641d192) Aug 10 18:22:29.316842 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:22:29.316842 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:22:29.316842 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:22:29.316842 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:22:29.316842 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:22:29.316842 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:22:29.316842 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 18:22:29.316842 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 18:22:29.316842 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 10 18:22:29.316842 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 10 18:22:29.316842 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:22:29.316842 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:22:29.316842 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:22:29.316842 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:22:29.316842 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:22:29.316842 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:22:29.316842 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:22:29.316842 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:22:29.316842 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 18:22:29.316842 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 18:22:29.316842 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:22:29.316842 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:22:29.316842 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:22:29.316842 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-9b866e98-74e2-4727-9cf3-5abe33fd9240 tempest-ServerActionsTestJSON-1597233884 tempest-ServerActionsTestJSON-1597233884-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:22:29.316842 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 18:22:29.316842 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-9b866e98-74e2-4727-9cf3-5abe33fd9240 tempest-ServerActionsTestJSON-1597233884 tempest-ServerActionsTestJSON-1597233884-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.345756 Aug 10 18:22:29.316842 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 1084/2193] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 18:22:28 2022] POST /compute/v2.1/servers => generated 214 bytes in 347 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 10 18:22:29.325683 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-6c6c911a-f5cc-4309-8605-f5c20f908d8f tempest-ServerActionsTestJSON-1597233884 tempest-ServerActionsTestJSON-1597233884-project] Calling method '.version_select at 0x7fb3460b0af0>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:22:29.431152 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-6c6c911a-f5cc-4309-8605-f5c20f908d8f tempest-ServerActionsTestJSON-1597233884 tempest-ServerActionsTestJSON-1597233884-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1862497744" status: 202 len: 0 microversion: 2.1 time: 0.118810 Aug 10 18:22:29.431731 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1110/2194] 10.222.0.50 () {58 vars in 1221 bytes} [Wed Aug 10 18:22:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1862497744 => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 18:22:41.991049 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_api:SELECT=8 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 18:22:42.126444 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-678a63f9-9e65-40c0-b61d-93f3564b1f6c tempest-ServersNegativeTestJSON-1109868349 tempest-ServersNegativeTestJSON-1109868349-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1485586100", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "9cccda52-2c6a-4128-8fd8-5c3e29609598"}]}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 18:22:42.188286 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.network.neutron [None req-678a63f9-9e65-40c0-b61d-93f3564b1f6c tempest-ServersNegativeTestJSON-1109868349 tempest-ServersNegativeTestJSON-1109868349-project] validate_networks() for [('9cccda52-2c6a-4128-8fd8-5c3e29609598', None, None, None, None, None)] {{(pid=129410) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 18:22:42.400768 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [None req-678a63f9-9e65-40c0-b61d-93f3564b1f6c tempest-ServersNegativeTestJSON-1109868349 tempest-ServersNegativeTestJSON-1109868349-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-5a951f00-97b5-4a5a-a602-4fc7ddb1ac8d) Aug 10 18:22:42.400768 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:22:42.400768 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:22:42.400768 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:22:42.400768 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:22:42.400768 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:22:42.400768 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:22:42.400768 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:22:42.400768 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:22:42.400768 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:22:42.400768 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 18:22:42.400768 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 18:22:42.400768 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 18:22:42.400768 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 18:22:42.400768 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 18:22:42.400768 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 18:22:42.400768 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 18:22:42.400768 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 18:22:42.400768 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 18:22:42.400768 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 18:22:42.400768 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 18:22:42.400768 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 18:22:42.400768 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 18:22:42.400768 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 18:22:42.400768 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 18:22:42.400768 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 18:22:42.400768 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 18:22:42.400768 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:22:42.400768 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:22:42.400768 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 18:22:42.400768 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 18:22:42.400768 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:22:42.400768 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:22:42.400768 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 18:22:42.400768 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 18:22:42.400768 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:22:42.400768 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:22:42.400768 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:22:42.400768 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:22:42.400768 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:22:42.400768 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:22:42.400768 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 18:22:42.400768 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 18:22:42.400768 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 18:22:42.400768 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 18:22:42.400768 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 18:22:42.400768 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 18:22:42.400768 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 18:22:42.400768 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 18:22:42.400768 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 18:22:42.400768 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 18:22:42.400768 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 18:22:42.412537 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 18:22:42.412537 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 18:22:42.412537 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 18:22:42.412537 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 18:22:42.412537 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 18:22:42.412537 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 18:22:42.412537 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 18:22:42.412537 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 18:22:42.412537 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 18:22:42.412537 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 18:22:42.412537 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 18:22:42.412537 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 18:22:42.412537 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 18:22:42.412537 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 18:22:42.412537 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 18:22:42.412537 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-5a951f00-97b5-4a5a-a602-4fc7ddb1ac8d) Aug 10 18:22:42.412537 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:22:42.412537 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-678a63f9-9e65-40c0-b61d-93f3564b1f6c tempest-ServersNegativeTestJSON-1109868349 tempest-ServersNegativeTestJSON-1109868349-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:22:42.412537 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 18:22:42.412537 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-678a63f9-9e65-40c0-b61d-93f3564b1f6c tempest-ServersNegativeTestJSON-1109868349 tempest-ServersNegativeTestJSON-1109868349-project] Request method failure captured: Aug 10 18:22:42.412537 n-d-852296-2 devstack@n-api.service[129410]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 18:22:42.412537 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 18:22:42.412537 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 18:22:42.412537 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 18:22:42.412537 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 209 Aug 10 18:22:42.412537 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 18:22:42.412537 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 18:22:42.412537 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 18:22:42.412537 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 18:22:42.412537 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8_dxq_1ieLdzK0sJD9M8fAHJ65SP9Y1AZtmfXKoJX9CL2jn9eOqWhC8LkU3_Jke6pmWG1MX-NQDQMaFWh1p4AOCl_dyZz_JZDdc1655hlCbjy8Pj7O9vqVR1Jt2Oj6Hq6VPTQoVfWGPL3I-MxXGMcgstaBrSiUK54tRC2JLGYrJWroY Aug 10 18:22:42.412537 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 18:22:42.412537 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 18:22:42.412537 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 18:22:42.412537 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 18:22:42.412537 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 18:22:42.412537 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 18:22:42.412537 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: 6eceef90e9e94e6489583135ed150f97 Aug 10 18:22:42.412537 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-ServersNegativeTestJSON-1109868349 Aug 10 18:22:42.412537 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 18:22:42.412537 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 18:22:42.412537 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6eceef90e9e94e6489583135ed150f97"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6eceef90e9e94e6489583135ed150f97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6eceef90e9e94e6489583135ed150f97"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6eceef90e9e94e6489583135ed150f97", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 18:22:42.412537 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-ServersNegativeTestJSON-1109868349 Aug 10 18:22:42.412537 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: 6eceef90e9e94e6489583135ed150f97 Aug 10 18:22:42.412537 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1109868349 Aug 10 18:22:42.412537 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-ServersNegativeTestJSON-1109868349-project Aug 10 18:22:42.412537 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 18:22:42.412537 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 18:22:42.412537 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: c7dd0d1c59594857ae9d2f44e2b8d7eb Aug 10 18:22:42.412537 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-ServersNegativeTestJSON-1109868349-project Aug 10 18:22:42.412537 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 18:22:42.412537 n-d-852296-2 devstack@n-api.service[129410]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1485586100", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "9cccda52-2c6a-4128-8fd8-5c3e29609598"}]}} Aug 10 18:22:42.412537 n-d-852296-2 devstack@n-api.service[129410]: method: > Aug 10 18:22:42.412537 n-d-852296-2 devstack@n-api.service[129410]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:22:42.412537 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 18:22:42.412537 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1485586100', 'imageRef': 'a735ff26-463a-4ffe-a981-ab9d9baa494f', 'flavorRef': '452', 'networks': [{'uuid': '9cccda52-2c6a-4128-8fd8-5c3e29609598'}]}}} Aug 10 18:22:42.417989 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 18:22:42.417989 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:22:42.417989 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:22:42.417989 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:22:42.417989 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:22:42.417989 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:22:42.417989 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:22:42.417989 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:22:42.417989 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:22:42.417989 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:22:42.417989 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 18:22:42.417989 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 18:22:42.417989 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 18:22:42.417989 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 18:22:42.417989 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 18:22:42.417989 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 18:22:42.417989 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 18:22:42.417989 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 18:22:42.417989 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 18:22:42.417989 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 18:22:42.417989 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 18:22:42.417989 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 18:22:42.417989 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 18:22:42.417989 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 18:22:42.417989 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 18:22:42.417989 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 18:22:42.417989 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 18:22:42.417989 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:22:42.417989 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:22:42.417989 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 18:22:42.417989 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 18:22:42.417989 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:22:42.417989 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:22:42.417989 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 18:22:42.417989 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 18:22:42.417989 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:22:42.417989 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:22:42.417989 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:22:42.417989 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:22:42.417989 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:22:42.417989 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:22:42.417989 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 18:22:42.417989 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 18:22:42.417989 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 18:22:42.417989 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 18:22:42.417989 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 18:22:42.417989 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 18:22:42.417989 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 18:22:42.417989 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 18:22:42.417989 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 18:22:42.417989 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 18:22:42.417989 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 18:22:42.417989 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 18:22:42.417989 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 18:22:42.417989 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 18:22:42.417989 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 18:22:42.423827 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 18:22:42.423827 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 18:22:42.423827 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 18:22:42.423827 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 18:22:42.423827 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 18:22:42.423827 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 18:22:42.423827 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 18:22:42.423827 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 18:22:42.423827 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 18:22:42.423827 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 18:22:42.423827 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 18:22:42.423827 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-5a951f00-97b5-4a5a-a602-4fc7ddb1ac8d) Aug 10 18:22:42.423827 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:22:42.423827 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:22:42.423827 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:22:42.423827 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:22:42.423827 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:22:42.423827 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:22:42.423827 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 18:22:42.423827 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 18:22:42.423827 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 10 18:22:42.423827 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 10 18:22:42.423827 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:22:42.423827 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:22:42.423827 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:22:42.423827 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:22:42.423827 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:22:42.423827 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:22:42.423827 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:22:42.423827 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:22:42.423827 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 18:22:42.423827 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 18:22:42.423827 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:22:42.423827 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:22:42.423827 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:22:42.423827 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-678a63f9-9e65-40c0-b61d-93f3564b1f6c tempest-ServersNegativeTestJSON-1109868349 tempest-ServersNegativeTestJSON-1109868349-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:22:42.423827 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 18:22:42.423827 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-678a63f9-9e65-40c0-b61d-93f3564b1f6c tempest-ServersNegativeTestJSON-1109868349 tempest-ServersNegativeTestJSON-1109868349-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.415397 Aug 10 18:22:42.423827 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 1085/2195] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 18:22:41 2022] POST /compute/v2.1/servers => generated 214 bytes in 417 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 10 18:23:34.644546 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_cell0:SELECT=4 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 18:23:34.828836 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-7c68a94e-97b5-40e0-a9dd-b70483b18893 tempest-TestEncryptedCinderVolumes-50034681 tempest-TestEncryptedCinderVolumes-50034681-project] Action: 'create', calling method: .version_select at 0x7fb346321c10>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1802671814", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGQGII/lQjAa/bFZeh1eXMMkzqPUYTB9OKy1W8thSI2duenkzoNEkFsLgKKdRgIQI53LvyIbutJdsGzjQdZUEsuLlHTcEYjAF/RYQOYOQYK7cxjHbpCNRb1+gBzos9jvmg=="}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 18:23:34.845141 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-7c68a94e-97b5-40e0-a9dd-b70483b18893 tempest-TestEncryptedCinderVolumes-50034681 tempest-TestEncryptedCinderVolumes-50034681-project] Getting quotas for project 76311396a0f84b42bb6a56ebd53ac994. Resources: {'key_pairs'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 18:23:34.850391 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-7c68a94e-97b5-40e0-a9dd-b70483b18893 tempest-TestEncryptedCinderVolumes-50034681 tempest-TestEncryptedCinderVolumes-50034681-project] Getting quotas for user 2bd196922f884cadace79f2341995ba7 and project 76311396a0f84b42bb6a56ebd53ac994. Resources: {'key_pairs'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 18:23:35.001698 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-7c68a94e-97b5-40e0-a9dd-b70483b18893 tempest-TestEncryptedCinderVolumes-50034681 tempest-TestEncryptedCinderVolumes-50034681-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.358163 Aug 10 18:23:35.002579 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1111/2196] 10.222.0.50 () {60 vars in 1159 bytes} [Wed Aug 10 18:23:34 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 18:23:35.055513 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_api:SELECT=2 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 18:23:35.060129 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-1958c191-c74a-4ac8-a17a-d25ca415f91c tempest-TestEncryptedCinderVolumes-50034681 tempest-TestEncryptedCinderVolumes-50034681-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1042508935", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1802671814", "networks": [{"uuid": "5a58a33e-f9e9-4433-ae41-2400dab903ad"}]}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 18:23:35.114524 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.network.neutron [None req-1958c191-c74a-4ac8-a17a-d25ca415f91c tempest-TestEncryptedCinderVolumes-50034681 tempest-TestEncryptedCinderVolumes-50034681-project] validate_networks() for [('5a58a33e-f9e9-4433-ae41-2400dab903ad', None, None, None, None, None)] {{(pid=129410) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 18:23:35.330646 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [None req-1958c191-c74a-4ac8-a17a-d25ca415f91c tempest-TestEncryptedCinderVolumes-50034681 tempest-TestEncryptedCinderVolumes-50034681-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-e4ea8810-ce4b-4157-aa2b-7b5a90a951a6) Aug 10 18:23:35.330646 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:23:35.330646 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:23:35.330646 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:23:35.330646 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:23:35.330646 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:23:35.330646 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:23:35.330646 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:23:35.330646 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:23:35.330646 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:23:35.330646 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 18:23:35.330646 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 18:23:35.330646 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 18:23:35.330646 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 18:23:35.330646 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 18:23:35.330646 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 18:23:35.330646 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 18:23:35.330646 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 18:23:35.330646 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 18:23:35.330646 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 18:23:35.330646 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 18:23:35.330646 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 18:23:35.330646 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 18:23:35.330646 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 18:23:35.330646 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 18:23:35.330646 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 18:23:35.330646 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 18:23:35.330646 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:23:35.330646 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:23:35.330646 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 18:23:35.330646 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 18:23:35.330646 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:23:35.330646 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:23:35.330646 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 18:23:35.330646 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 18:23:35.330646 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:23:35.330646 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:23:35.330646 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:23:35.330646 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:23:35.330646 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:23:35.330646 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:23:35.330646 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 18:23:35.330646 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 18:23:35.330646 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 18:23:35.330646 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 18:23:35.330646 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 18:23:35.330646 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 18:23:35.330646 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 18:23:35.330646 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 18:23:35.330646 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 18:23:35.330646 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 18:23:35.330646 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 18:23:35.335343 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 18:23:35.335343 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 18:23:35.335343 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 18:23:35.335343 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 18:23:35.335343 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 18:23:35.335343 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 18:23:35.335343 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 18:23:35.335343 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 18:23:35.335343 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 18:23:35.335343 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 18:23:35.335343 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 18:23:35.335343 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 18:23:35.335343 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 18:23:35.335343 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 18:23:35.335343 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 18:23:35.335343 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-e4ea8810-ce4b-4157-aa2b-7b5a90a951a6) Aug 10 18:23:35.335343 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:23:35.335343 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-1958c191-c74a-4ac8-a17a-d25ca415f91c tempest-TestEncryptedCinderVolumes-50034681 tempest-TestEncryptedCinderVolumes-50034681-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:23:35.335343 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 18:23:35.335343 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-1958c191-c74a-4ac8-a17a-d25ca415f91c tempest-TestEncryptedCinderVolumes-50034681 tempest-TestEncryptedCinderVolumes-50034681-project] Request method failure captured: Aug 10 18:23:35.335343 n-d-852296-2 devstack@n-api.service[129410]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 18:23:35.335343 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 18:23:35.335343 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 18:23:35.335343 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 18:23:35.335343 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 273 Aug 10 18:23:35.335343 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 18:23:35.335343 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 18:23:35.335343 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 18:23:35.335343 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 18:23:35.335343 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8_efmAfHNyJvZKU-oLleN7yhatElXsML0i_jAlNbeg7wT83nYDzlcI_1Dwp_P0vLM0_u-eTXWuyfgEpZkASrfic0N3XLGAJkDWua2nbLCOyPiexr1uuuOPoWxA6wMeN_ToETBFgR9a0nM4PZ6wxHSDt6lhOJs3clMH6r8Z8PKMwQ8ZI Aug 10 18:23:35.335343 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 18:23:35.335343 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 18:23:35.335343 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 18:23:35.335343 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 18:23:35.335343 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 18:23:35.335343 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 18:23:35.335343 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: 76311396a0f84b42bb6a56ebd53ac994 Aug 10 18:23:35.335343 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-TestEncryptedCinderVolumes-50034681 Aug 10 18:23:35.335343 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 18:23:35.335343 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 18:23:35.335343 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/76311396a0f84b42bb6a56ebd53ac994"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/76311396a0f84b42bb6a56ebd53ac994"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/76311396a0f84b42bb6a56ebd53ac994"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_76311396a0f84b42bb6a56ebd53ac994", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 18:23:35.335343 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-TestEncryptedCinderVolumes-50034681 Aug 10 18:23:35.335343 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: 76311396a0f84b42bb6a56ebd53ac994 Aug 10 18:23:35.335343 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-50034681 Aug 10 18:23:35.335343 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-TestEncryptedCinderVolumes-50034681-project Aug 10 18:23:35.335343 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 18:23:35.335343 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 18:23:35.335343 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: 2bd196922f884cadace79f2341995ba7 Aug 10 18:23:35.335343 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-TestEncryptedCinderVolumes-50034681-project Aug 10 18:23:35.335343 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 18:23:35.335343 n-d-852296-2 devstack@n-api.service[129410]: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1042508935", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1802671814", "networks": [{"uuid": "5a58a33e-f9e9-4433-ae41-2400dab903ad"}]}} Aug 10 18:23:35.335343 n-d-852296-2 devstack@n-api.service[129410]: method: > Aug 10 18:23:35.335343 n-d-852296-2 devstack@n-api.service[129410]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:23:35.335343 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 18:23:35.340334 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'body': {'server': {'name': 'tempest-TestEncryptedCinderVolumes-server-1042508935', 'imageRef': 'a735ff26-463a-4ffe-a981-ab9d9baa494f', 'flavorRef': '452', 'key_name': 'tempest-TestEncryptedCinderVolumes-1802671814', 'networks': [{'uuid': '5a58a33e-f9e9-4433-ae41-2400dab903ad'}]}}} Aug 10 18:23:35.340334 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 18:23:35.340334 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:23:35.340334 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:23:35.340334 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:23:35.340334 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:23:35.340334 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:23:35.340334 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:23:35.340334 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:23:35.340334 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:23:35.340334 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:23:35.340334 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 18:23:35.340334 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 18:23:35.340334 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 18:23:35.340334 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 18:23:35.340334 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 18:23:35.340334 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 18:23:35.340334 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 18:23:35.340334 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 18:23:35.340334 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 18:23:35.340334 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 18:23:35.340334 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 18:23:35.340334 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 18:23:35.340334 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 18:23:35.340334 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 18:23:35.340334 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 18:23:35.340334 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 18:23:35.340334 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 18:23:35.340334 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:23:35.340334 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:23:35.340334 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 18:23:35.340334 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 18:23:35.340334 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:23:35.340334 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:23:35.340334 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 18:23:35.340334 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 18:23:35.340334 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:23:35.340334 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:23:35.340334 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:23:35.340334 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:23:35.340334 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:23:35.340334 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:23:35.340334 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 18:23:35.340334 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 18:23:35.340334 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 18:23:35.340334 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 18:23:35.340334 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 18:23:35.340334 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 18:23:35.340334 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 18:23:35.340334 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 18:23:35.340334 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 18:23:35.340334 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 18:23:35.340334 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 18:23:35.340334 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 18:23:35.345415 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 18:23:35.345415 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 18:23:35.345415 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 18:23:35.345415 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 18:23:35.345415 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 18:23:35.345415 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 18:23:35.345415 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 18:23:35.345415 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 18:23:35.345415 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 18:23:35.345415 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 18:23:35.345415 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 18:23:35.345415 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 18:23:35.345415 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 18:23:35.345415 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 18:23:35.345415 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-e4ea8810-ce4b-4157-aa2b-7b5a90a951a6) Aug 10 18:23:35.345415 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:23:35.345415 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:23:35.345415 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:23:35.345415 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:23:35.345415 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:23:35.345415 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:23:35.345415 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 18:23:35.345415 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 18:23:35.345415 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 10 18:23:35.345415 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 10 18:23:35.345415 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:23:35.345415 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:23:35.345415 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:23:35.345415 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:23:35.345415 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:23:35.345415 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:23:35.345415 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:23:35.345415 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:23:35.345415 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 18:23:35.345415 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 18:23:35.345415 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:23:35.345415 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:23:35.345415 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:23:35.345415 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-1958c191-c74a-4ac8-a17a-d25ca415f91c tempest-TestEncryptedCinderVolumes-50034681 tempest-TestEncryptedCinderVolumes-50034681-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:23:35.345415 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 18:23:35.345415 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-1958c191-c74a-4ac8-a17a-d25ca415f91c tempest-TestEncryptedCinderVolumes-50034681 tempest-TestEncryptedCinderVolumes-50034681-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.276785 Aug 10 18:23:35.345415 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 1086/2197] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 18:23:35 2022] POST /compute/v2.1/servers => generated 214 bytes in 278 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 10 18:23:35.357235 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-4946231c-8394-49a8-bdd1-b9257e8e6257 tempest-TestEncryptedCinderVolumes-50034681 tempest-TestEncryptedCinderVolumes-50034681-project] Calling method '.version_select at 0x7fb3465a1af0>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:23:35.589195 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-4946231c-8394-49a8-bdd1-b9257e8e6257 tempest-TestEncryptedCinderVolumes-50034681 tempest-TestEncryptedCinderVolumes-50034681-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1802671814" status: 202 len: 0 microversion: 2.1 time: 0.239596 Aug 10 18:23:35.595689 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1112/2198] 10.222.0.50 () {58 vars in 1278 bytes} [Wed Aug 10 18:23:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1802671814 => generated 0 bytes in 241 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 18:23:35.603235 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-46c1273e-4833-4b4d-8eab-cc2324e892a2 tempest-TestEncryptedCinderVolumes-50034681 tempest-TestEncryptedCinderVolumes-50034681-project] Action: 'create', calling method: .version_select at 0x7fb345abc040>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-976152776", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDhyR3WOPQhri/SAuMh3AjdljgzVvLPDimBfjjhb2KFP5qkj8oK/CEJpU78MWJqcT18K9HYQXw2QKKY6hhZ8SgrTVJo0ObINX4oxIAQPfDklGXTjsLJ6hIZtgk7zRiQXaQ=="}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 18:23:35.619277 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.quota [None req-46c1273e-4833-4b4d-8eab-cc2324e892a2 tempest-TestEncryptedCinderVolumes-50034681 tempest-TestEncryptedCinderVolumes-50034681-project] Getting quotas for project 76311396a0f84b42bb6a56ebd53ac994. Resources: {'key_pairs'} {{(pid=129410) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 18:23:35.624228 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.quota [None req-46c1273e-4833-4b4d-8eab-cc2324e892a2 tempest-TestEncryptedCinderVolumes-50034681 tempest-TestEncryptedCinderVolumes-50034681-project] Getting quotas for user 2bd196922f884cadace79f2341995ba7 and project 76311396a0f84b42bb6a56ebd53ac994. Resources: {'key_pairs'} {{(pid=129410) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 18:23:35.742930 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-46c1273e-4833-4b4d-8eab-cc2324e892a2 tempest-TestEncryptedCinderVolumes-50034681 tempest-TestEncryptedCinderVolumes-50034681-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.143653 Aug 10 18:23:35.743530 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 1087/2199] 10.222.0.50 () {60 vars in 1159 bytes} [Wed Aug 10 18:23:35 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 18:23:35.794383 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-3cc3fcbe-a4b3-4406-adb9-e8927fd513db tempest-TestEncryptedCinderVolumes-50034681 tempest-TestEncryptedCinderVolumes-50034681-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-262823880", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-976152776", "networks": [{"uuid": "5a58a33e-f9e9-4433-ae41-2400dab903ad"}]}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 18:23:35.846700 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.network.neutron [None req-3cc3fcbe-a4b3-4406-adb9-e8927fd513db tempest-TestEncryptedCinderVolumes-50034681 tempest-TestEncryptedCinderVolumes-50034681-project] validate_networks() for [('5a58a33e-f9e9-4433-ae41-2400dab903ad', None, None, None, None, None)] {{(pid=129409) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 18:23:36.060967 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [None req-3cc3fcbe-a4b3-4406-adb9-e8927fd513db tempest-TestEncryptedCinderVolumes-50034681 tempest-TestEncryptedCinderVolumes-50034681-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-57bebc78-c28d-48b0-ba7f-346dd7aba443) Aug 10 18:23:36.060967 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:23:36.060967 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:23:36.060967 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:23:36.060967 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:23:36.060967 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:23:36.060967 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:23:36.060967 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:23:36.060967 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:23:36.060967 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:23:36.060967 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 18:23:36.060967 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 18:23:36.060967 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 18:23:36.060967 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 18:23:36.060967 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 18:23:36.060967 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 18:23:36.060967 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 18:23:36.060967 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 18:23:36.060967 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 18:23:36.060967 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 18:23:36.060967 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 18:23:36.060967 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 18:23:36.060967 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 18:23:36.060967 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 18:23:36.060967 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 18:23:36.060967 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 18:23:36.060967 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 18:23:36.060967 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:23:36.060967 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:23:36.060967 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 18:23:36.060967 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 18:23:36.060967 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:23:36.060967 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:23:36.060967 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 18:23:36.060967 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 18:23:36.060967 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:23:36.060967 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:23:36.060967 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:23:36.060967 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:23:36.060967 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:23:36.060967 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:23:36.060967 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 18:23:36.060967 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 18:23:36.060967 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 18:23:36.060967 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 18:23:36.060967 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 18:23:36.060967 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 18:23:36.060967 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 18:23:36.060967 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 18:23:36.060967 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 18:23:36.060967 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 18:23:36.060967 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 18:23:36.065558 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 18:23:36.065558 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 18:23:36.065558 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 18:23:36.065558 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 18:23:36.065558 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 18:23:36.065558 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 18:23:36.065558 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 18:23:36.065558 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 18:23:36.065558 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 18:23:36.065558 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 18:23:36.065558 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 18:23:36.065558 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 18:23:36.065558 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 18:23:36.065558 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 18:23:36.065558 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 18:23:36.065558 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-57bebc78-c28d-48b0-ba7f-346dd7aba443) Aug 10 18:23:36.065558 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:23:36.065558 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-3cc3fcbe-a4b3-4406-adb9-e8927fd513db tempest-TestEncryptedCinderVolumes-50034681 tempest-TestEncryptedCinderVolumes-50034681-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:23:36.065558 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 18:23:36.065558 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-3cc3fcbe-a4b3-4406-adb9-e8927fd513db tempest-TestEncryptedCinderVolumes-50034681 tempest-TestEncryptedCinderVolumes-50034681-project] Request method failure captured: Aug 10 18:23:36.065558 n-d-852296-2 devstack@n-api.service[129409]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 18:23:36.065558 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 18:23:36.065558 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 18:23:36.065558 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 18:23:36.065558 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 271 Aug 10 18:23:36.065558 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 18:23:36.065558 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 18:23:36.065558 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 18:23:36.065558 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 18:23:36.065558 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8_efmAfHNyJvZKU-oLleN7yhatElXsML0i_jAlNbeg7wT83nYDzlcI_1Dwp_P0vLM0_u-eTXWuyfgEpZkASrfic0N3XLGAJkDWua2nbLCOyPiexr1uuuOPoWxA6wMeN_ToETBFgR9a0nM4PZ6wxHSDt6lhOJs3clMH6r8Z8PKMwQ8ZI Aug 10 18:23:36.065558 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 18:23:36.065558 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 18:23:36.065558 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 18:23:36.065558 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 18:23:36.065558 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 18:23:36.065558 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 18:23:36.065558 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: 76311396a0f84b42bb6a56ebd53ac994 Aug 10 18:23:36.065558 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-TestEncryptedCinderVolumes-50034681 Aug 10 18:23:36.065558 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 18:23:36.065558 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 18:23:36.065558 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/76311396a0f84b42bb6a56ebd53ac994"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/76311396a0f84b42bb6a56ebd53ac994"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/76311396a0f84b42bb6a56ebd53ac994"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_76311396a0f84b42bb6a56ebd53ac994", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 18:23:36.065558 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-TestEncryptedCinderVolumes-50034681 Aug 10 18:23:36.065558 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: 76311396a0f84b42bb6a56ebd53ac994 Aug 10 18:23:36.065558 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-50034681 Aug 10 18:23:36.065558 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-TestEncryptedCinderVolumes-50034681-project Aug 10 18:23:36.065558 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 18:23:36.065558 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 18:23:36.065558 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: 2bd196922f884cadace79f2341995ba7 Aug 10 18:23:36.065558 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-TestEncryptedCinderVolumes-50034681-project Aug 10 18:23:36.065558 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 18:23:36.065558 n-d-852296-2 devstack@n-api.service[129409]: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-262823880", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-976152776", "networks": [{"uuid": "5a58a33e-f9e9-4433-ae41-2400dab903ad"}]}} Aug 10 18:23:36.065558 n-d-852296-2 devstack@n-api.service[129409]: method: > Aug 10 18:23:36.065558 n-d-852296-2 devstack@n-api.service[129409]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:23:36.065558 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 18:23:36.071296 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'body': {'server': {'name': 'tempest-TestEncryptedCinderVolumes-server-262823880', 'imageRef': 'a735ff26-463a-4ffe-a981-ab9d9baa494f', 'flavorRef': '452', 'key_name': 'tempest-TestEncryptedCinderVolumes-976152776', 'networks': [{'uuid': '5a58a33e-f9e9-4433-ae41-2400dab903ad'}]}}} Aug 10 18:23:36.071296 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 18:23:36.071296 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:23:36.071296 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:23:36.071296 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:23:36.071296 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:23:36.071296 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:23:36.071296 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:23:36.071296 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:23:36.071296 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:23:36.071296 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:23:36.071296 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 18:23:36.071296 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 18:23:36.071296 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 18:23:36.071296 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 18:23:36.071296 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 18:23:36.071296 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 18:23:36.071296 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 18:23:36.071296 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 18:23:36.071296 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 18:23:36.071296 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 18:23:36.071296 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 18:23:36.071296 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 18:23:36.071296 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 18:23:36.071296 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 18:23:36.071296 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 18:23:36.071296 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 18:23:36.071296 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 18:23:36.071296 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:23:36.071296 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:23:36.071296 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 18:23:36.071296 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 18:23:36.071296 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:23:36.071296 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:23:36.071296 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 18:23:36.071296 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 18:23:36.071296 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:23:36.071296 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:23:36.071296 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:23:36.071296 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:23:36.071296 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:23:36.071296 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:23:36.071296 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 18:23:36.071296 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 18:23:36.071296 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 18:23:36.071296 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 18:23:36.071296 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 18:23:36.071296 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 18:23:36.071296 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 18:23:36.071296 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 18:23:36.071296 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 18:23:36.071296 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 18:23:36.071296 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 18:23:36.071296 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 18:23:36.075742 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 18:23:36.075742 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 18:23:36.075742 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 18:23:36.075742 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 18:23:36.075742 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 18:23:36.075742 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 18:23:36.075742 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 18:23:36.075742 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 18:23:36.075742 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 18:23:36.075742 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 18:23:36.075742 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 18:23:36.075742 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 18:23:36.075742 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 18:23:36.075742 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 18:23:36.075742 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-57bebc78-c28d-48b0-ba7f-346dd7aba443) Aug 10 18:23:36.075742 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:23:36.075742 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:23:36.075742 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:23:36.075742 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:23:36.075742 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:23:36.075742 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:23:36.075742 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 18:23:36.075742 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 18:23:36.075742 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 10 18:23:36.075742 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 10 18:23:36.075742 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:23:36.075742 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:23:36.075742 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:23:36.075742 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:23:36.075742 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:23:36.075742 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:23:36.075742 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:23:36.075742 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:23:36.075742 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 18:23:36.075742 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 18:23:36.075742 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:23:36.075742 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:23:36.075742 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:23:36.075742 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-3cc3fcbe-a4b3-4406-adb9-e8927fd513db tempest-TestEncryptedCinderVolumes-50034681 tempest-TestEncryptedCinderVolumes-50034681-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:23:36.075742 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 18:23:36.075742 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-3cc3fcbe-a4b3-4406-adb9-e8927fd513db tempest-TestEncryptedCinderVolumes-50034681 tempest-TestEncryptedCinderVolumes-50034681-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.274974 Aug 10 18:23:36.075742 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1113/2200] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 18:23:35 2022] POST /compute/v2.1/servers => generated 214 bytes in 276 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 10 18:23:36.079405 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-e449f9b0-9860-45d3-9947-54647c3a162b tempest-TestEncryptedCinderVolumes-50034681 tempest-TestEncryptedCinderVolumes-50034681-project] Calling method '.version_select at 0x7fb345e6e670>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:23:36.211318 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-e449f9b0-9860-45d3-9947-54647c3a162b tempest-TestEncryptedCinderVolumes-50034681 tempest-TestEncryptedCinderVolumes-50034681-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-976152776" status: 202 len: 0 microversion: 2.1 time: 0.138098 Aug 10 18:23:36.211896 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 1088/2201] 10.222.0.50 () {58 vars in 1275 bytes} [Wed Aug 10 18:23:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-976152776 => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 18:23:36.226476 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-dc529724-3a2f-4701-be14-474b32fc7c86 tempest-TestEncryptedCinderVolumes-50034681 tempest-TestEncryptedCinderVolumes-50034681-project] Action: 'create', calling method: .version_select at 0x7fb3466a5940>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-306112083", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGmj6E2e8XmYgYv2RCBrKSgXWo7976MND6XWpFvh9Qoljg1WFeQf8cIc5oS/zKjQU6CBgjHiQqTq1zjGnqA5RFox2Ck9S05OlMN3Q5bSL2xoooJOpK+0+qw5e+gbcUVdCw=="}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 18:23:36.243316 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-dc529724-3a2f-4701-be14-474b32fc7c86 tempest-TestEncryptedCinderVolumes-50034681 tempest-TestEncryptedCinderVolumes-50034681-project] Getting quotas for project 76311396a0f84b42bb6a56ebd53ac994. Resources: {'key_pairs'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 18:23:36.248962 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-dc529724-3a2f-4701-be14-474b32fc7c86 tempest-TestEncryptedCinderVolumes-50034681 tempest-TestEncryptedCinderVolumes-50034681-project] Getting quotas for user 2bd196922f884cadace79f2341995ba7 and project 76311396a0f84b42bb6a56ebd53ac994. Resources: {'key_pairs'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 18:23:36.406990 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-dc529724-3a2f-4701-be14-474b32fc7c86 tempest-TestEncryptedCinderVolumes-50034681 tempest-TestEncryptedCinderVolumes-50034681-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.185460 Aug 10 18:23:36.407584 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1114/2202] 10.222.0.50 () {60 vars in 1159 bytes} [Wed Aug 10 18:23:36 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 18:23:36.458823 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-e8ba5a08-d484-49d3-ae6b-33b1c53b8f4e tempest-TestEncryptedCinderVolumes-50034681 tempest-TestEncryptedCinderVolumes-50034681-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-372402891", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-306112083", "networks": [{"uuid": "5a58a33e-f9e9-4433-ae41-2400dab903ad"}]}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 18:23:36.511130 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.network.neutron [None req-e8ba5a08-d484-49d3-ae6b-33b1c53b8f4e tempest-TestEncryptedCinderVolumes-50034681 tempest-TestEncryptedCinderVolumes-50034681-project] validate_networks() for [('5a58a33e-f9e9-4433-ae41-2400dab903ad', None, None, None, None, None)] {{(pid=129410) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 18:23:36.715304 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [None req-e8ba5a08-d484-49d3-ae6b-33b1c53b8f4e tempest-TestEncryptedCinderVolumes-50034681 tempest-TestEncryptedCinderVolumes-50034681-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-4d2cf91d-1e34-4284-aed8-604838fe1da2) Aug 10 18:23:36.715304 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:23:36.715304 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:23:36.715304 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:23:36.715304 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:23:36.715304 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:23:36.715304 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:23:36.715304 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:23:36.715304 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:23:36.715304 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:23:36.715304 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 18:23:36.715304 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 18:23:36.715304 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 18:23:36.715304 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 18:23:36.715304 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 18:23:36.715304 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 18:23:36.715304 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 18:23:36.715304 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 18:23:36.715304 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 18:23:36.715304 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 18:23:36.715304 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 18:23:36.715304 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 18:23:36.715304 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 18:23:36.715304 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 18:23:36.715304 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 18:23:36.715304 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 18:23:36.715304 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 18:23:36.715304 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:23:36.715304 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:23:36.715304 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 18:23:36.715304 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 18:23:36.715304 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:23:36.715304 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:23:36.715304 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 18:23:36.715304 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 18:23:36.715304 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:23:36.715304 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:23:36.715304 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:23:36.715304 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:23:36.715304 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:23:36.715304 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:23:36.715304 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 18:23:36.715304 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 18:23:36.715304 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 18:23:36.715304 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 18:23:36.715304 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 18:23:36.715304 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 18:23:36.715304 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 18:23:36.715304 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 18:23:36.715304 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 18:23:36.715304 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 18:23:36.715304 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 18:23:36.720139 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 18:23:36.720139 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 18:23:36.720139 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 18:23:36.720139 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 18:23:36.720139 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 18:23:36.720139 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 18:23:36.720139 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 18:23:36.720139 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 18:23:36.720139 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 18:23:36.720139 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 18:23:36.720139 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 18:23:36.720139 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 18:23:36.720139 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 18:23:36.720139 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 18:23:36.720139 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 18:23:36.720139 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-4d2cf91d-1e34-4284-aed8-604838fe1da2) Aug 10 18:23:36.720139 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:23:36.720139 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-e8ba5a08-d484-49d3-ae6b-33b1c53b8f4e tempest-TestEncryptedCinderVolumes-50034681 tempest-TestEncryptedCinderVolumes-50034681-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:23:36.720139 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 18:23:36.720139 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-e8ba5a08-d484-49d3-ae6b-33b1c53b8f4e tempest-TestEncryptedCinderVolumes-50034681 tempest-TestEncryptedCinderVolumes-50034681-project] Request method failure captured: Aug 10 18:23:36.720139 n-d-852296-2 devstack@n-api.service[129410]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 18:23:36.720139 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 18:23:36.720139 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 18:23:36.720139 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 18:23:36.720139 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 271 Aug 10 18:23:36.720139 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 18:23:36.720139 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 18:23:36.720139 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 18:23:36.720139 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 18:23:36.720139 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8_efmAfHNyJvZKU-oLleN7yhatElXsML0i_jAlNbeg7wT83nYDzlcI_1Dwp_P0vLM0_u-eTXWuyfgEpZkASrfic0N3XLGAJkDWua2nbLCOyPiexr1uuuOPoWxA6wMeN_ToETBFgR9a0nM4PZ6wxHSDt6lhOJs3clMH6r8Z8PKMwQ8ZI Aug 10 18:23:36.720139 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 18:23:36.720139 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 18:23:36.720139 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 18:23:36.720139 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 18:23:36.720139 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 18:23:36.720139 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 18:23:36.720139 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: 76311396a0f84b42bb6a56ebd53ac994 Aug 10 18:23:36.720139 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-TestEncryptedCinderVolumes-50034681 Aug 10 18:23:36.720139 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 18:23:36.720139 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 18:23:36.720139 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/76311396a0f84b42bb6a56ebd53ac994"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/76311396a0f84b42bb6a56ebd53ac994"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/76311396a0f84b42bb6a56ebd53ac994"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_76311396a0f84b42bb6a56ebd53ac994", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 18:23:36.720139 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-TestEncryptedCinderVolumes-50034681 Aug 10 18:23:36.720139 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: 76311396a0f84b42bb6a56ebd53ac994 Aug 10 18:23:36.720139 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-50034681 Aug 10 18:23:36.720139 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-TestEncryptedCinderVolumes-50034681-project Aug 10 18:23:36.720139 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 18:23:36.720139 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 18:23:36.720139 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: 2bd196922f884cadace79f2341995ba7 Aug 10 18:23:36.720139 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-TestEncryptedCinderVolumes-50034681-project Aug 10 18:23:36.720139 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 18:23:36.720139 n-d-852296-2 devstack@n-api.service[129410]: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-372402891", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-306112083", "networks": [{"uuid": "5a58a33e-f9e9-4433-ae41-2400dab903ad"}]}} Aug 10 18:23:36.720139 n-d-852296-2 devstack@n-api.service[129410]: method: > Aug 10 18:23:36.720139 n-d-852296-2 devstack@n-api.service[129410]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:23:36.720139 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 18:23:36.725016 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'body': {'server': {'name': 'tempest-TestEncryptedCinderVolumes-server-372402891', 'imageRef': 'a735ff26-463a-4ffe-a981-ab9d9baa494f', 'flavorRef': '452', 'key_name': 'tempest-TestEncryptedCinderVolumes-306112083', 'networks': [{'uuid': '5a58a33e-f9e9-4433-ae41-2400dab903ad'}]}}} Aug 10 18:23:36.725016 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 18:23:36.725016 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:23:36.725016 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:23:36.725016 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:23:36.725016 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:23:36.725016 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:23:36.725016 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:23:36.725016 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:23:36.725016 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:23:36.725016 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:23:36.725016 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 18:23:36.725016 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 18:23:36.725016 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 18:23:36.725016 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 18:23:36.725016 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 18:23:36.725016 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 18:23:36.725016 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 18:23:36.725016 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 18:23:36.725016 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 18:23:36.725016 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 18:23:36.725016 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 18:23:36.725016 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 18:23:36.725016 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 18:23:36.725016 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 18:23:36.725016 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 18:23:36.725016 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 18:23:36.725016 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 18:23:36.725016 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:23:36.725016 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:23:36.725016 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 18:23:36.725016 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 18:23:36.725016 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:23:36.725016 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:23:36.725016 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 18:23:36.725016 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 18:23:36.725016 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:23:36.725016 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:23:36.725016 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:23:36.725016 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:23:36.725016 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:23:36.725016 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:23:36.725016 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 18:23:36.725016 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 18:23:36.725016 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 18:23:36.725016 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 18:23:36.725016 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 18:23:36.725016 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 18:23:36.725016 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 18:23:36.725016 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 18:23:36.725016 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 18:23:36.725016 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 18:23:36.725016 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 18:23:36.725016 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 18:23:36.729586 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 18:23:36.729586 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 18:23:36.729586 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 18:23:36.729586 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 18:23:36.729586 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 18:23:36.729586 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 18:23:36.729586 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 18:23:36.729586 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 18:23:36.729586 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 18:23:36.729586 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 18:23:36.729586 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 18:23:36.729586 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 18:23:36.729586 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 18:23:36.729586 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 18:23:36.729586 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-4d2cf91d-1e34-4284-aed8-604838fe1da2) Aug 10 18:23:36.729586 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:23:36.729586 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:23:36.729586 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:23:36.729586 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:23:36.729586 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:23:36.729586 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:23:36.729586 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 18:23:36.729586 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 18:23:36.729586 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 10 18:23:36.729586 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 10 18:23:36.729586 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:23:36.729586 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:23:36.729586 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:23:36.729586 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:23:36.729586 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:23:36.729586 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:23:36.729586 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:23:36.729586 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:23:36.729586 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 18:23:36.729586 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 18:23:36.729586 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:23:36.729586 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:23:36.729586 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:23:36.729586 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-e8ba5a08-d484-49d3-ae6b-33b1c53b8f4e tempest-TestEncryptedCinderVolumes-50034681 tempest-TestEncryptedCinderVolumes-50034681-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:23:36.729586 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 18:23:36.729586 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-e8ba5a08-d484-49d3-ae6b-33b1c53b8f4e tempest-TestEncryptedCinderVolumes-50034681 tempest-TestEncryptedCinderVolumes-50034681-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.264642 Aug 10 18:23:36.729586 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 1089/2203] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 18:23:36 2022] POST /compute/v2.1/servers => generated 214 bytes in 266 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 10 18:23:36.733209 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-bd6f9efe-c714-4d83-a7f8-622cd48be1d9 tempest-TestEncryptedCinderVolumes-50034681 tempest-TestEncryptedCinderVolumes-50034681-project] Calling method '.version_select at 0x7fb345e25e50>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:23:36.805249 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-bd6f9efe-c714-4d83-a7f8-622cd48be1d9 tempest-TestEncryptedCinderVolumes-50034681 tempest-TestEncryptedCinderVolumes-50034681-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-306112083" status: 202 len: 0 microversion: 2.1 time: 0.079683 Aug 10 18:23:36.805939 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1115/2204] 10.222.0.50 () {58 vars in 1275 bytes} [Wed Aug 10 18:23:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-306112083 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 18:23:55.287106 n-d-852296-2 devstack@n-api.service[129410]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 18:23:55.287882 n-d-852296-2 devstack@n-api.service[129410]: Wed Aug 10 18:23:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 18:23:56.263771 n-d-852296-2 devstack@n-api.service[129409]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 18:23:56.265231 n-d-852296-2 devstack@n-api.service[129409]: Wed Aug 10 18:23:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 18:24:13.347323 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_cell0:SELECT=4 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 18:24:13.348094 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_api:SELECT=22,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 18:24:13.352714 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-e7e96361-271b-48dd-913d-1e14b8804a25 tempest-TestMinimumBasicScenario-2073040444 tempest-TestMinimumBasicScenario-2073040444-project] Action: 'create', calling method: .version_select at 0x7fb3457b9d30>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1309053055", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAyFtfdju/p4WuVRUXMd2SJzsljupNvcENJeeKqVd8c3XK40I5Z4ptMUAr+mw2HjpFNzH97ybFcDCm0FDXtwqrc7Q2SywWwcodqKKXZew2N7S+K36QfSoA6yCVkhfHgGdg=="}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 18:24:13.368527 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.quota [None req-e7e96361-271b-48dd-913d-1e14b8804a25 tempest-TestMinimumBasicScenario-2073040444 tempest-TestMinimumBasicScenario-2073040444-project] Getting quotas for project e6f04710b2b04f1eb0fb95a272f2cf00. Resources: {'key_pairs'} {{(pid=129410) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 18:24:13.374227 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.quota [None req-e7e96361-271b-48dd-913d-1e14b8804a25 tempest-TestMinimumBasicScenario-2073040444 tempest-TestMinimumBasicScenario-2073040444-project] Getting quotas for user 031e57aa490346fb9564f8a5b8451415 and project e6f04710b2b04f1eb0fb95a272f2cf00. Resources: {'key_pairs'} {{(pid=129410) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 18:24:13.472646 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-e7e96361-271b-48dd-913d-1e14b8804a25 tempest-TestMinimumBasicScenario-2073040444 tempest-TestMinimumBasicScenario-2073040444-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.126680 Aug 10 18:24:13.473243 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 1090/2205] 10.222.0.50 () {60 vars in 1159 bytes} [Wed Aug 10 18:24:13 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 18:24:13.519948 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_cell0:SELECT=8 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 18:24:13.520816 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3,nova_api:DELETE=3 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 18:24:13.524836 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-f115ac53-8b12-467c-b2b2-b6126fb92854 tempest-TestMinimumBasicScenario-2073040444 tempest-TestMinimumBasicScenario-2073040444-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-413340611", "imageRef": "6683c2a2-474f-4d5e-9333-5654ebf22a07", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1309053055", "networks": [{"uuid": "b8c01b41-d857-477a-829f-f048837999ad"}]}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 18:24:13.575809 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.network.neutron [None req-f115ac53-8b12-467c-b2b2-b6126fb92854 tempest-TestMinimumBasicScenario-2073040444 tempest-TestMinimumBasicScenario-2073040444-project] validate_networks() for [('b8c01b41-d857-477a-829f-f048837999ad', None, None, None, None, None)] {{(pid=129409) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 18:24:13.778591 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [None req-f115ac53-8b12-467c-b2b2-b6126fb92854 tempest-TestMinimumBasicScenario-2073040444 tempest-TestMinimumBasicScenario-2073040444-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-620469d5-e264-4d49-9e0a-430250fa67f8) Aug 10 18:24:13.778591 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:24:13.778591 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:24:13.778591 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:24:13.778591 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:24:13.778591 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:24:13.778591 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:24:13.778591 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:24:13.778591 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:24:13.778591 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:24:13.778591 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 18:24:13.778591 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 18:24:13.778591 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 18:24:13.778591 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 18:24:13.778591 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 18:24:13.778591 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 18:24:13.778591 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 18:24:13.778591 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 18:24:13.778591 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 18:24:13.778591 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 18:24:13.778591 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 18:24:13.778591 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 18:24:13.778591 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 18:24:13.778591 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 18:24:13.778591 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 18:24:13.778591 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 18:24:13.778591 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 18:24:13.778591 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:24:13.778591 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:24:13.778591 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 18:24:13.778591 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 18:24:13.778591 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:24:13.778591 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:24:13.778591 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 18:24:13.778591 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 18:24:13.778591 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:24:13.778591 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:24:13.778591 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:24:13.778591 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:24:13.778591 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:24:13.778591 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:24:13.778591 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 18:24:13.778591 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 18:24:13.778591 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 18:24:13.778591 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 18:24:13.778591 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 18:24:13.778591 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 18:24:13.778591 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 18:24:13.778591 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 18:24:13.778591 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 18:24:13.778591 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 18:24:13.778591 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 18:24:13.784434 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 18:24:13.784434 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 18:24:13.784434 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 18:24:13.784434 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 18:24:13.784434 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 18:24:13.784434 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 18:24:13.784434 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 18:24:13.784434 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 18:24:13.784434 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 18:24:13.784434 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 18:24:13.784434 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 18:24:13.784434 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 18:24:13.784434 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 18:24:13.784434 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 18:24:13.784434 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 18:24:13.784434 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-620469d5-e264-4d49-9e0a-430250fa67f8) Aug 10 18:24:13.784434 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:24:13.784434 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-f115ac53-8b12-467c-b2b2-b6126fb92854 tempest-TestMinimumBasicScenario-2073040444 tempest-TestMinimumBasicScenario-2073040444-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:24:13.784434 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 18:24:13.784434 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-f115ac53-8b12-467c-b2b2-b6126fb92854 tempest-TestMinimumBasicScenario-2073040444 tempest-TestMinimumBasicScenario-2073040444-project] Request method failure captured: Aug 10 18:24:13.784434 n-d-852296-2 devstack@n-api.service[129409]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 18:24:13.784434 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 18:24:13.784434 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 18:24:13.784434 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 18:24:13.784434 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 268 Aug 10 18:24:13.784434 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 18:24:13.784434 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 18:24:13.784434 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 18:24:13.784434 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 18:24:13.784434 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8_e6IngvBB5RClCj69OBE7L2KVYoDHttcBO9c6cJTIm5wx04sUy9J7VqxDucnYSlr1TFhnGnXQI4oSdQZlsP1GJQQxz2svGz1tJtywRbNuaK0hB-dQJZ2Kh0ToR1MLo93Mys84U5VwMghqQNyWhd_veGpfVvcWTEuCiyYlvAqykozmM Aug 10 18:24:13.784434 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 18:24:13.784434 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 18:24:13.784434 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 18:24:13.784434 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 18:24:13.784434 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 18:24:13.784434 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 18:24:13.784434 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: e6f04710b2b04f1eb0fb95a272f2cf00 Aug 10 18:24:13.784434 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-TestMinimumBasicScenario-2073040444 Aug 10 18:24:13.784434 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 18:24:13.784434 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 18:24:13.784434 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e6f04710b2b04f1eb0fb95a272f2cf00"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/e6f04710b2b04f1eb0fb95a272f2cf00"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e6f04710b2b04f1eb0fb95a272f2cf00"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_e6f04710b2b04f1eb0fb95a272f2cf00", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 18:24:13.784434 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-TestMinimumBasicScenario-2073040444 Aug 10 18:24:13.784434 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: e6f04710b2b04f1eb0fb95a272f2cf00 Aug 10 18:24:13.784434 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2073040444 Aug 10 18:24:13.784434 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-TestMinimumBasicScenario-2073040444-project Aug 10 18:24:13.784434 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 18:24:13.784434 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 18:24:13.784434 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: 031e57aa490346fb9564f8a5b8451415 Aug 10 18:24:13.784434 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-TestMinimumBasicScenario-2073040444-project Aug 10 18:24:13.784434 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 18:24:13.784434 n-d-852296-2 devstack@n-api.service[129409]: {"server": {"name": "tempest-TestMinimumBasicScenario-server-413340611", "imageRef": "6683c2a2-474f-4d5e-9333-5654ebf22a07", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1309053055", "networks": [{"uuid": "b8c01b41-d857-477a-829f-f048837999ad"}]}} Aug 10 18:24:13.784434 n-d-852296-2 devstack@n-api.service[129409]: method: > Aug 10 18:24:13.784434 n-d-852296-2 devstack@n-api.service[129409]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:24:13.784434 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 18:24:13.789770 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'body': {'server': {'name': 'tempest-TestMinimumBasicScenario-server-413340611', 'imageRef': '6683c2a2-474f-4d5e-9333-5654ebf22a07', 'flavorRef': '452', 'key_name': 'tempest-TestMinimumBasicScenario-1309053055', 'networks': [{'uuid': 'b8c01b41-d857-477a-829f-f048837999ad'}]}}} Aug 10 18:24:13.789770 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 18:24:13.789770 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:24:13.789770 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:24:13.789770 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:24:13.789770 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:24:13.789770 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:24:13.789770 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:24:13.789770 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:24:13.789770 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:24:13.789770 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:24:13.789770 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 18:24:13.789770 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 18:24:13.789770 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 18:24:13.789770 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 18:24:13.789770 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 18:24:13.789770 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 18:24:13.789770 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 18:24:13.789770 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 18:24:13.789770 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 18:24:13.789770 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 18:24:13.789770 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 18:24:13.789770 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 18:24:13.789770 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 18:24:13.789770 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 18:24:13.789770 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 18:24:13.789770 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 18:24:13.789770 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 18:24:13.789770 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:24:13.789770 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:24:13.789770 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 18:24:13.789770 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 18:24:13.789770 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:24:13.789770 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:24:13.789770 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 18:24:13.789770 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 18:24:13.789770 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:24:13.789770 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:24:13.789770 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:24:13.789770 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:24:13.789770 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:24:13.789770 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:24:13.789770 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 18:24:13.789770 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 18:24:13.789770 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 18:24:13.789770 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 18:24:13.789770 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 18:24:13.789770 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 18:24:13.789770 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 18:24:13.789770 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 18:24:13.789770 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 18:24:13.789770 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 18:24:13.789770 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 18:24:13.789770 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 18:24:13.789770 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 18:24:13.796455 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 18:24:13.796455 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 18:24:13.796455 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 18:24:13.796455 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 18:24:13.796455 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 18:24:13.796455 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 18:24:13.796455 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 18:24:13.796455 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 18:24:13.796455 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 18:24:13.796455 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 18:24:13.796455 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 18:24:13.796455 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 18:24:13.796455 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 18:24:13.796455 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-620469d5-e264-4d49-9e0a-430250fa67f8) Aug 10 18:24:13.796455 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:24:13.796455 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:24:13.796455 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:24:13.796455 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:24:13.796455 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:24:13.796455 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:24:13.796455 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 18:24:13.796455 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 18:24:13.796455 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 10 18:24:13.796455 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 10 18:24:13.796455 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:24:13.796455 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:24:13.796455 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:24:13.796455 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:24:13.796455 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:24:13.796455 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:24:13.796455 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:24:13.796455 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:24:13.796455 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 18:24:13.796455 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 18:24:13.796455 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:24:13.796455 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:24:13.796455 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:24:13.796455 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-f115ac53-8b12-467c-b2b2-b6126fb92854 tempest-TestMinimumBasicScenario-2073040444 tempest-TestMinimumBasicScenario-2073040444-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:24:13.796455 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 18:24:13.796455 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-f115ac53-8b12-467c-b2b2-b6126fb92854 tempest-TestMinimumBasicScenario-2073040444 tempest-TestMinimumBasicScenario-2073040444-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.264391 Aug 10 18:24:13.796455 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1116/2206] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 18:24:13 2022] POST /compute/v2.1/servers => generated 214 bytes in 266 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 10 18:24:13.803274 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-72330eee-8a9d-41b7-9f4e-684e50a2c4cb tempest-TestMinimumBasicScenario-2073040444 tempest-TestMinimumBasicScenario-2073040444-project] Calling method '.version_select at 0x7fb3457be310>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:24:13.924872 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-72330eee-8a9d-41b7-9f4e-684e50a2c4cb tempest-TestMinimumBasicScenario-2073040444 tempest-TestMinimumBasicScenario-2073040444-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1309053055" status: 202 len: 0 microversion: 2.1 time: 0.125458 Aug 10 18:24:13.925453 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 1091/2207] 10.222.0.50 () {58 vars in 1272 bytes} [Wed Aug 10 18:24:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1309053055 => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 18:24:17.139820 n-d-852296-2 devstack@n-api.service[129410]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 18:24:17.139820 n-d-852296-2 devstack@n-api.service[129410]: Wed Aug 10 18:24:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 18:24:23.928196 n-d-852296-2 devstack@n-api.service[129409]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 18:24:23.928762 n-d-852296-2 devstack@n-api.service[129409]: Wed Aug 10 18:24:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 18:24:26.281122 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-2f4fe14b-155b-40ed-b907-1efb1b1d22b6 tempest-TestMinimumBasicScenario-2073040444 tempest-TestMinimumBasicScenario-2073040444-project] Action: 'create', calling method: .version_select at 0x7fb345ff2a60>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-2100695243", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBITNxvFWsPbJ70ONSzZP8+IpnHSuxoKwL21b6uZWbhm7o5xHT/bfNBbMy0Jra8ohZFglsXp42ptZYsDj1SnOYCyKf3q996KSe6BvyPhHwjT9eLrxWfN3HDvgAp39MdC7oQ=="}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 18:24:26.299035 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-2f4fe14b-155b-40ed-b907-1efb1b1d22b6 tempest-TestMinimumBasicScenario-2073040444 tempest-TestMinimumBasicScenario-2073040444-project] Getting quotas for project e6f04710b2b04f1eb0fb95a272f2cf00. Resources: {'key_pairs'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 18:24:26.304025 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-2f4fe14b-155b-40ed-b907-1efb1b1d22b6 tempest-TestMinimumBasicScenario-2073040444 tempest-TestMinimumBasicScenario-2073040444-project] Getting quotas for user 031e57aa490346fb9564f8a5b8451415 and project e6f04710b2b04f1eb0fb95a272f2cf00. Resources: {'key_pairs'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 18:24:26.421369 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-2f4fe14b-155b-40ed-b907-1efb1b1d22b6 tempest-TestMinimumBasicScenario-2073040444 tempest-TestMinimumBasicScenario-2073040444-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.144874 Aug 10 18:24:26.421888 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1117/2208] 10.222.0.50 () {60 vars in 1159 bytes} [Wed Aug 10 18:24:26 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 18:24:26.468206 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_cell0:SELECT=4 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 18:24:26.472462 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-18b28c32-2b8a-4165-9152-ce5286f253c7 tempest-TestMinimumBasicScenario-2073040444 tempest-TestMinimumBasicScenario-2073040444-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-459929013", "imageRef": "3e65d27c-6f29-4e80-b7d5-b7e4c0c41bf4", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-2100695243", "networks": [{"uuid": "b8c01b41-d857-477a-829f-f048837999ad"}]}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 18:24:26.523917 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.network.neutron [None req-18b28c32-2b8a-4165-9152-ce5286f253c7 tempest-TestMinimumBasicScenario-2073040444 tempest-TestMinimumBasicScenario-2073040444-project] validate_networks() for [('b8c01b41-d857-477a-829f-f048837999ad', None, None, None, None, None)] {{(pid=129410) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 18:24:26.723364 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [None req-18b28c32-2b8a-4165-9152-ce5286f253c7 tempest-TestMinimumBasicScenario-2073040444 tempest-TestMinimumBasicScenario-2073040444-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-df614891-f9a9-45a6-aa83-90bb64ac3abc) Aug 10 18:24:26.723364 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:24:26.723364 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:24:26.723364 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:24:26.723364 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:24:26.723364 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:24:26.723364 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:24:26.723364 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:24:26.723364 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:24:26.723364 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:24:26.723364 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 18:24:26.723364 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 18:24:26.723364 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 18:24:26.723364 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 18:24:26.723364 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 18:24:26.723364 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 18:24:26.723364 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 18:24:26.723364 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 18:24:26.723364 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 18:24:26.723364 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 18:24:26.723364 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 18:24:26.723364 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 18:24:26.723364 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 18:24:26.723364 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 18:24:26.723364 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 18:24:26.723364 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 18:24:26.723364 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 18:24:26.723364 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:24:26.723364 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:24:26.723364 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 18:24:26.723364 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 18:24:26.723364 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:24:26.723364 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:24:26.723364 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 18:24:26.723364 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 18:24:26.723364 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:24:26.723364 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:24:26.723364 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:24:26.723364 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:24:26.723364 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:24:26.723364 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:24:26.723364 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 18:24:26.723364 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 18:24:26.723364 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 18:24:26.723364 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 18:24:26.723364 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 18:24:26.723364 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 18:24:26.723364 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 18:24:26.723364 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 18:24:26.723364 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 18:24:26.723364 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 18:24:26.723364 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 18:24:26.728888 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 18:24:26.728888 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 18:24:26.728888 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 18:24:26.728888 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 18:24:26.728888 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 18:24:26.728888 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 18:24:26.728888 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 18:24:26.728888 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 18:24:26.728888 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 18:24:26.728888 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 18:24:26.728888 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 18:24:26.728888 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 18:24:26.728888 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 18:24:26.728888 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 18:24:26.728888 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 18:24:26.728888 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-df614891-f9a9-45a6-aa83-90bb64ac3abc) Aug 10 18:24:26.728888 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:24:26.728888 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-18b28c32-2b8a-4165-9152-ce5286f253c7 tempest-TestMinimumBasicScenario-2073040444 tempest-TestMinimumBasicScenario-2073040444-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:24:26.728888 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 18:24:26.728888 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-18b28c32-2b8a-4165-9152-ce5286f253c7 tempest-TestMinimumBasicScenario-2073040444 tempest-TestMinimumBasicScenario-2073040444-project] Request method failure captured: Aug 10 18:24:26.728888 n-d-852296-2 devstack@n-api.service[129410]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 18:24:26.728888 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 18:24:26.728888 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 18:24:26.728888 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 18:24:26.728888 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 268 Aug 10 18:24:26.728888 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 18:24:26.728888 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 18:24:26.728888 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 18:24:26.728888 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 18:24:26.728888 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8_e6IngvBB5RClCj69OBE7L2KVYoDHttcBO9c6cJTIm5wx04sUy9J7VqxDucnYSlr1TFhnGnXQI4oSdQZlsP1GJQQxz2svGz1tJtywRbNuaK0hB-dQJZ2Kh0ToR1MLo93Mys84U5VwMghqQNyWhd_veGpfVvcWTEuCiyYlvAqykozmM Aug 10 18:24:26.728888 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 18:24:26.728888 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 18:24:26.728888 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 18:24:26.728888 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 18:24:26.728888 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 18:24:26.728888 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 18:24:26.728888 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: e6f04710b2b04f1eb0fb95a272f2cf00 Aug 10 18:24:26.728888 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-TestMinimumBasicScenario-2073040444 Aug 10 18:24:26.728888 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 18:24:26.728888 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 18:24:26.728888 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e6f04710b2b04f1eb0fb95a272f2cf00"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/e6f04710b2b04f1eb0fb95a272f2cf00"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e6f04710b2b04f1eb0fb95a272f2cf00"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_e6f04710b2b04f1eb0fb95a272f2cf00", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 18:24:26.728888 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-TestMinimumBasicScenario-2073040444 Aug 10 18:24:26.728888 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: e6f04710b2b04f1eb0fb95a272f2cf00 Aug 10 18:24:26.728888 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2073040444 Aug 10 18:24:26.728888 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-TestMinimumBasicScenario-2073040444-project Aug 10 18:24:26.728888 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 18:24:26.728888 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 18:24:26.728888 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: 031e57aa490346fb9564f8a5b8451415 Aug 10 18:24:26.728888 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-TestMinimumBasicScenario-2073040444-project Aug 10 18:24:26.728888 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 18:24:26.728888 n-d-852296-2 devstack@n-api.service[129410]: {"server": {"name": "tempest-TestMinimumBasicScenario-server-459929013", "imageRef": "3e65d27c-6f29-4e80-b7d5-b7e4c0c41bf4", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-2100695243", "networks": [{"uuid": "b8c01b41-d857-477a-829f-f048837999ad"}]}} Aug 10 18:24:26.728888 n-d-852296-2 devstack@n-api.service[129410]: method: > Aug 10 18:24:26.728888 n-d-852296-2 devstack@n-api.service[129410]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:24:26.728888 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 18:24:26.739399 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'body': {'server': {'name': 'tempest-TestMinimumBasicScenario-server-459929013', 'imageRef': '3e65d27c-6f29-4e80-b7d5-b7e4c0c41bf4', 'flavorRef': '452', 'key_name': 'tempest-TestMinimumBasicScenario-2100695243', 'networks': [{'uuid': 'b8c01b41-d857-477a-829f-f048837999ad'}]}}} Aug 10 18:24:26.739399 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 18:24:26.739399 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:24:26.739399 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:24:26.739399 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:24:26.739399 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:24:26.739399 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:24:26.739399 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:24:26.739399 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:24:26.739399 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:24:26.739399 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:24:26.739399 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 18:24:26.739399 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 18:24:26.739399 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 18:24:26.739399 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 18:24:26.739399 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 18:24:26.739399 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 18:24:26.739399 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 18:24:26.739399 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 18:24:26.739399 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 18:24:26.739399 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 18:24:26.739399 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 18:24:26.739399 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 18:24:26.739399 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 18:24:26.739399 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 18:24:26.739399 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 18:24:26.739399 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 18:24:26.739399 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 18:24:26.739399 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:24:26.739399 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:24:26.739399 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 18:24:26.739399 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 18:24:26.739399 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:24:26.739399 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:24:26.739399 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 18:24:26.739399 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 18:24:26.739399 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:24:26.739399 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:24:26.739399 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:24:26.739399 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:24:26.739399 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:24:26.739399 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:24:26.739399 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 18:24:26.739399 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 18:24:26.739399 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 18:24:26.739399 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 18:24:26.739399 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 18:24:26.739399 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 18:24:26.739399 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 18:24:26.739399 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 18:24:26.739399 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 18:24:26.739399 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 18:24:26.739399 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 18:24:26.739399 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 18:24:26.739399 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 18:24:26.744321 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 18:24:26.744321 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 18:24:26.744321 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 18:24:26.744321 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 18:24:26.744321 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 18:24:26.744321 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 18:24:26.744321 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 18:24:26.744321 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 18:24:26.744321 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 18:24:26.744321 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 18:24:26.744321 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 18:24:26.744321 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 18:24:26.744321 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 18:24:26.744321 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-df614891-f9a9-45a6-aa83-90bb64ac3abc) Aug 10 18:24:26.744321 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:24:26.744321 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:24:26.744321 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:24:26.744321 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:24:26.744321 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:24:26.744321 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:24:26.744321 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 18:24:26.744321 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 18:24:26.744321 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 10 18:24:26.744321 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 10 18:24:26.744321 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:24:26.744321 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:24:26.744321 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:24:26.744321 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:24:26.744321 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:24:26.744321 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:24:26.744321 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:24:26.744321 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:24:26.744321 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 18:24:26.744321 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 18:24:26.744321 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:24:26.744321 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:24:26.744321 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:24:26.744321 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-18b28c32-2b8a-4165-9152-ce5286f253c7 tempest-TestMinimumBasicScenario-2073040444 tempest-TestMinimumBasicScenario-2073040444-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:24:26.744321 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 18:24:26.744321 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-18b28c32-2b8a-4165-9152-ce5286f253c7 tempest-TestMinimumBasicScenario-2073040444 tempest-TestMinimumBasicScenario-2073040444-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.261644 Aug 10 18:24:26.744321 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 1092/2209] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 18:24:26 2022] POST /compute/v2.1/servers => generated 214 bytes in 266 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 10 18:24:26.748144 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-6f049a2c-74d8-4552-9f87-a9beb19973c0 tempest-TestMinimumBasicScenario-2073040444 tempest-TestMinimumBasicScenario-2073040444-project] Calling method '.version_select at 0x7fb346321700>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:24:26.831504 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-6f049a2c-74d8-4552-9f87-a9beb19973c0 tempest-TestMinimumBasicScenario-2073040444 tempest-TestMinimumBasicScenario-2073040444-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2100695243" status: 202 len: 0 microversion: 2.1 time: 0.098361 Aug 10 18:24:26.832080 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1118/2210] 10.222.0.50 () {58 vars in 1272 bytes} [Wed Aug 10 18:24:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2100695243 => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 18:24:40.181999 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_api:SELECT=18,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 18:24:40.356950 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-9ad0a98d-20b5-4d73-a637-a8e787432500 tempest-TestNetworkAdvancedServerOps-2111337414 tempest-TestNetworkAdvancedServerOps-2111337414-project] Action: 'create', calling method: .version_select at 0x7fb345750310>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1256732350", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOFUKvRUIYTs0QheeH5nUkkbhpCZFtEPnf4MqS80NQF5MVdR5L6DKkFwRWknBd+ARQKQbnHx//juuqynsVe1EseBS5RKAuo3F7XZW8iwU74RWAJttrxL1XP5oHKmu201JA=="}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 18:24:40.373868 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.quota [None req-9ad0a98d-20b5-4d73-a637-a8e787432500 tempest-TestNetworkAdvancedServerOps-2111337414 tempest-TestNetworkAdvancedServerOps-2111337414-project] Getting quotas for project 3c05ca5310554ac4a1cf06c8dcaec96c. Resources: {'key_pairs'} {{(pid=129410) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 18:24:40.379391 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.quota [None req-9ad0a98d-20b5-4d73-a637-a8e787432500 tempest-TestNetworkAdvancedServerOps-2111337414 tempest-TestNetworkAdvancedServerOps-2111337414-project] Getting quotas for user 005d90286d1041f7b3f18f96849ed03e and project 3c05ca5310554ac4a1cf06c8dcaec96c. Resources: {'key_pairs'} {{(pid=129410) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 18:24:40.494797 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-9ad0a98d-20b5-4d73-a637-a8e787432500 tempest-TestNetworkAdvancedServerOps-2111337414 tempest-TestNetworkAdvancedServerOps-2111337414-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.314174 Aug 10 18:24:40.495331 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 1093/2211] 10.222.0.50 () {60 vars in 1159 bytes} [Wed Aug 10 18:24:40 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 18:24:49.830967 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_cell0:SELECT=4 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 18:24:49.831783 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_api:SELECT=18,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 18:24:49.836721 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-17c7e01d-d481-43ef-89d2-96259f491a95 tempest-TestNetworkAdvancedServerOps-2111337414 tempest-TestNetworkAdvancedServerOps-2111337414-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-525002229", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "efc43eed-dfe9-4649-8b11-847778e6207e"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1256732350", "security_groups": [{"name": "tempest-secgroup-smoke-597436620"}]}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 18:24:49.970763 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.network.neutron [None req-17c7e01d-d481-43ef-89d2-96259f491a95 tempest-TestNetworkAdvancedServerOps-2111337414 tempest-TestNetworkAdvancedServerOps-2111337414-project] validate_networks() for [('efc43eed-dfe9-4649-8b11-847778e6207e', None, None, None, None, None)] {{(pid=129409) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 18:24:50.218417 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [None req-17c7e01d-d481-43ef-89d2-96259f491a95 tempest-TestNetworkAdvancedServerOps-2111337414 tempest-TestNetworkAdvancedServerOps-2111337414-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-4e0d8890-dbd5-4dcf-9adb-7ce8e4fa4f9c) Aug 10 18:24:50.218417 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:24:50.218417 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:24:50.218417 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:24:50.218417 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:24:50.218417 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:24:50.218417 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:24:50.218417 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:24:50.218417 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:24:50.218417 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:24:50.218417 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 18:24:50.218417 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 18:24:50.218417 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 18:24:50.218417 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 18:24:50.218417 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 18:24:50.218417 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 18:24:50.218417 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 18:24:50.218417 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 18:24:50.218417 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 18:24:50.218417 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 18:24:50.218417 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 18:24:50.218417 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 18:24:50.218417 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 18:24:50.218417 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 18:24:50.218417 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 18:24:50.218417 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 18:24:50.218417 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 18:24:50.218417 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:24:50.218417 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:24:50.218417 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 18:24:50.218417 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 18:24:50.218417 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:24:50.218417 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:24:50.218417 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 18:24:50.218417 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 18:24:50.218417 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:24:50.218417 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:24:50.218417 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:24:50.218417 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:24:50.218417 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:24:50.218417 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:24:50.218417 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 18:24:50.218417 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 18:24:50.218417 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 18:24:50.218417 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 18:24:50.218417 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 18:24:50.218417 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 18:24:50.218417 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 18:24:50.218417 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 18:24:50.218417 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 18:24:50.218417 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 18:24:50.218417 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 18:24:50.222422 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 18:24:50.222422 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 18:24:50.222422 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 18:24:50.222422 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 18:24:50.222422 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 18:24:50.222422 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 18:24:50.222422 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 18:24:50.222422 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 18:24:50.222422 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 18:24:50.222422 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 18:24:50.222422 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 18:24:50.222422 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 18:24:50.222422 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 18:24:50.222422 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 18:24:50.222422 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 18:24:50.222422 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-4e0d8890-dbd5-4dcf-9adb-7ce8e4fa4f9c) Aug 10 18:24:50.222422 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:24:50.222422 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-17c7e01d-d481-43ef-89d2-96259f491a95 tempest-TestNetworkAdvancedServerOps-2111337414 tempest-TestNetworkAdvancedServerOps-2111337414-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:24:50.222422 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 18:24:50.225018 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-17c7e01d-d481-43ef-89d2-96259f491a95 tempest-TestNetworkAdvancedServerOps-2111337414 tempest-TestNetworkAdvancedServerOps-2111337414-project] Request method failure captured: Aug 10 18:24:50.225018 n-d-852296-2 devstack@n-api.service[129409]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 18:24:50.225018 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 18:24:50.225018 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 18:24:50.225018 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 18:24:50.225018 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 343 Aug 10 18:24:50.225018 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 18:24:50.225018 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 18:24:50.225018 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 18:24:50.225018 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 18:24:50.225018 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8_fnBKEwqMa97iaa6btfUgg_O5kSfbV1NVQJbz1U0l4v93ov3nBUWWDm8ENQtkSDX1RNRhmDBe0lDcZKr7xJtwpjyZiE8ZsaqWegCRHHAL9a5pCYn1BCs4eOtDqEvkn4qoqIayFrEDcdQsgWBVzY4rJPEoXcBsSFIGnTmyPxjiAKPzA Aug 10 18:24:50.225018 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 18:24:50.225018 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 18:24:50.225018 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 18:24:50.225018 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 18:24:50.225018 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 18:24:50.225018 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 18:24:50.225018 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: 3c05ca5310554ac4a1cf06c8dcaec96c Aug 10 18:24:50.225018 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2111337414 Aug 10 18:24:50.225018 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 18:24:50.225018 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 18:24:50.225018 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3c05ca5310554ac4a1cf06c8dcaec96c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3c05ca5310554ac4a1cf06c8dcaec96c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3c05ca5310554ac4a1cf06c8dcaec96c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3c05ca5310554ac4a1cf06c8dcaec96c", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 18:24:50.225018 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2111337414 Aug 10 18:24:50.225018 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: 3c05ca5310554ac4a1cf06c8dcaec96c Aug 10 18:24:50.225018 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2111337414 Aug 10 18:24:50.225018 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-TestNetworkAdvancedServerOps-2111337414-project Aug 10 18:24:50.225018 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 18:24:50.225018 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 18:24:50.225018 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: 005d90286d1041f7b3f18f96849ed03e Aug 10 18:24:50.225018 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2111337414-project Aug 10 18:24:50.225018 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 18:24:50.225018 n-d-852296-2 devstack@n-api.service[129409]: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-525002229", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "efc43eed-dfe9-4649-8b11-847778e6207e"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1256732350", "security_groups": [{"name": "tempest-secgroup-smoke-597436620"}]}} Aug 10 18:24:50.225018 n-d-852296-2 devstack@n-api.service[129409]: method: > Aug 10 18:24:50.225018 n-d-852296-2 devstack@n-api.service[129409]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:24:50.225018 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 18:24:50.225018 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'body': {'server': {'name': 'tempest-TestNetworkAdvancedServerOps-server-525002229', 'imageRef': 'a735ff26-463a-4ffe-a981-ab9d9baa494f', 'flavorRef': '452', 'networks': [{'uuid': 'efc43eed-dfe9-4649-8b11-847778e6207e'}], 'key_name': 'tempest-TestNetworkAdvancedServerOps-1256732350', 'security_groups': [{'name': 'tempest-secgroup-smoke-597436620'}]}}} Aug 10 18:24:50.225018 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 18:24:50.225018 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:24:50.225018 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:24:50.225018 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:24:50.225018 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:24:50.225018 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:24:50.225018 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:24:50.225018 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:24:50.225018 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:24:50.225018 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:24:50.225018 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 18:24:50.225018 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 18:24:50.225018 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 18:24:50.225018 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 18:24:50.225018 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 18:24:50.225018 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 18:24:50.225018 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 18:24:50.225018 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 18:24:50.225018 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 18:24:50.225018 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 18:24:50.225018 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 18:24:50.225018 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 18:24:50.239843 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 18:24:50.239843 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 18:24:50.239843 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 18:24:50.239843 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 18:24:50.239843 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 18:24:50.239843 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:24:50.239843 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:24:50.239843 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 18:24:50.239843 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 18:24:50.239843 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:24:50.239843 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:24:50.239843 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 18:24:50.239843 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 18:24:50.239843 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:24:50.239843 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:24:50.239843 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:24:50.239843 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:24:50.239843 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:24:50.239843 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:24:50.239843 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 18:24:50.239843 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 18:24:50.239843 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 18:24:50.239843 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 18:24:50.239843 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 18:24:50.239843 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 18:24:50.239843 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 18:24:50.239843 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 18:24:50.239843 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 18:24:50.239843 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 18:24:50.239843 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 18:24:50.239843 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 18:24:50.239843 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 18:24:50.239843 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 18:24:50.239843 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 18:24:50.239843 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 18:24:50.239843 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 18:24:50.239843 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 18:24:50.239843 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 18:24:50.239843 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 18:24:50.239843 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 18:24:50.239843 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 18:24:50.239843 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 18:24:50.239843 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 18:24:50.239843 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 18:24:50.239843 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 18:24:50.239843 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-4e0d8890-dbd5-4dcf-9adb-7ce8e4fa4f9c) Aug 10 18:24:50.239843 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:24:50.239843 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:24:50.239843 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:24:50.239843 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:24:50.239843 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:24:50.239843 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:24:50.239843 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 18:24:50.249902 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 18:24:50.249902 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 10 18:24:50.249902 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 10 18:24:50.249902 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:24:50.249902 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:24:50.249902 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:24:50.249902 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:24:50.249902 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:24:50.249902 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:24:50.249902 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:24:50.249902 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:24:50.249902 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 18:24:50.249902 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 18:24:50.249902 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:24:50.249902 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:24:50.249902 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:24:50.249902 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-17c7e01d-d481-43ef-89d2-96259f491a95 tempest-TestNetworkAdvancedServerOps-2111337414 tempest-TestNetworkAdvancedServerOps-2111337414-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:24:50.249902 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 18:24:50.249902 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-17c7e01d-d481-43ef-89d2-96259f491a95 tempest-TestNetworkAdvancedServerOps-2111337414 tempest-TestNetworkAdvancedServerOps-2111337414-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.397256 Aug 10 18:24:50.249902 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1119/2212] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 18:24:49 2022] POST /compute/v2.1/servers => generated 214 bytes in 399 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 10 18:24:54.467204 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_cell0:SELECT=4 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 18:24:54.468360 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 18:24:54.472518 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-ae7fadca-ae79-4baa-bd95-0d3c8e701b07 tempest-TestNetworkAdvancedServerOps-2111337414 tempest-TestNetworkAdvancedServerOps-2111337414-project] Calling method '.version_select at 0x7fb345841550>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:24:54.637843 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-ae7fadca-ae79-4baa-bd95-0d3c8e701b07 tempest-TestNetworkAdvancedServerOps-2111337414 tempest-TestNetworkAdvancedServerOps-2111337414-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1256732350" status: 202 len: 0 microversion: 2.1 time: 0.172003 Aug 10 18:24:54.647267 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 1094/2213] 10.222.0.50 () {58 vars in 1284 bytes} [Wed Aug 10 18:24:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1256732350 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 18:24:54.653112 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-0b8119e1-6b2f-488e-a885-e9879fcba6df tempest-TestNetworkAdvancedServerOps-2111337414 tempest-TestNetworkAdvancedServerOps-2111337414-project] Action: 'create', calling method: .version_select at 0x7fb3465a1ca0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1406838039", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGQrPXLJ0X7UyVAbdxgj5Xm3Mhhja1Fp2dbHqApGlot9za2x9bOacUBE2ym4quQF7OOhTVCk33bkojv8XKR0vgI/jeoQopT68JBXQU2/9HLUAft7HmH392ViI8IWEnzQKA=="}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 18:24:54.670912 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-0b8119e1-6b2f-488e-a885-e9879fcba6df tempest-TestNetworkAdvancedServerOps-2111337414 tempest-TestNetworkAdvancedServerOps-2111337414-project] Getting quotas for project 3c05ca5310554ac4a1cf06c8dcaec96c. Resources: {'key_pairs'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 18:24:54.676067 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-0b8119e1-6b2f-488e-a885-e9879fcba6df tempest-TestNetworkAdvancedServerOps-2111337414 tempest-TestNetworkAdvancedServerOps-2111337414-project] Getting quotas for user 005d90286d1041f7b3f18f96849ed03e and project 3c05ca5310554ac4a1cf06c8dcaec96c. Resources: {'key_pairs'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 18:24:54.802660 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-0b8119e1-6b2f-488e-a885-e9879fcba6df tempest-TestNetworkAdvancedServerOps-2111337414 tempest-TestNetworkAdvancedServerOps-2111337414-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.154593 Aug 10 18:24:54.803270 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1120/2214] 10.222.0.50 () {60 vars in 1159 bytes} [Wed Aug 10 18:24:54 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 18:25:04.562275 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-fc08bdd4-7ca2-4e4b-86ea-707849c79b6d tempest-TestNetworkAdvancedServerOps-2111337414 tempest-TestNetworkAdvancedServerOps-2111337414-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1432557468", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "856b05c7-02c6-4b90-9e17-3647e7369220"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1406838039", "security_groups": [{"name": "tempest-secgroup-smoke-1593687831"}]}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 18:25:04.696158 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.network.neutron [None req-fc08bdd4-7ca2-4e4b-86ea-707849c79b6d tempest-TestNetworkAdvancedServerOps-2111337414 tempest-TestNetworkAdvancedServerOps-2111337414-project] validate_networks() for [('856b05c7-02c6-4b90-9e17-3647e7369220', None, None, None, None, None)] {{(pid=129410) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 18:25:04.954795 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [None req-fc08bdd4-7ca2-4e4b-86ea-707849c79b6d tempest-TestNetworkAdvancedServerOps-2111337414 tempest-TestNetworkAdvancedServerOps-2111337414-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-1e5dffbc-2ba7-44e2-888e-81d44486ab4d) Aug 10 18:25:04.954795 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:25:04.954795 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:25:04.954795 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:25:04.954795 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:25:04.954795 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:25:04.954795 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:25:04.954795 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:25:04.954795 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:25:04.954795 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:25:04.954795 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 18:25:04.954795 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 18:25:04.954795 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 18:25:04.954795 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 18:25:04.954795 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 18:25:04.954795 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 18:25:04.954795 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 18:25:04.954795 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 18:25:04.954795 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 18:25:04.954795 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 18:25:04.954795 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 18:25:04.954795 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 18:25:04.954795 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 18:25:04.954795 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 18:25:04.954795 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 18:25:04.954795 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 18:25:04.954795 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 18:25:04.954795 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:25:04.954795 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:25:04.954795 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 18:25:04.954795 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 18:25:04.954795 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:25:04.954795 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:25:04.954795 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 18:25:04.954795 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 18:25:04.954795 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:25:04.954795 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:25:04.954795 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:25:04.954795 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:25:04.954795 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:25:04.954795 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:25:04.954795 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 18:25:04.954795 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 18:25:04.954795 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 18:25:04.954795 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 18:25:04.954795 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 18:25:04.954795 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 18:25:04.954795 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 18:25:04.954795 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 18:25:04.954795 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 18:25:04.954795 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 18:25:04.954795 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 18:25:04.960082 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 18:25:04.960082 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 18:25:04.960082 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 18:25:04.960082 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 18:25:04.960082 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 18:25:04.960082 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 18:25:04.960082 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 18:25:04.960082 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 18:25:04.960082 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 18:25:04.960082 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 18:25:04.960082 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 18:25:04.960082 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 18:25:04.960082 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 18:25:04.960082 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 18:25:04.960082 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 18:25:04.960082 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-1e5dffbc-2ba7-44e2-888e-81d44486ab4d) Aug 10 18:25:04.960082 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:25:04.963012 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-fc08bdd4-7ca2-4e4b-86ea-707849c79b6d tempest-TestNetworkAdvancedServerOps-2111337414 tempest-TestNetworkAdvancedServerOps-2111337414-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:25:04.963012 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 18:25:04.976610 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-fc08bdd4-7ca2-4e4b-86ea-707849c79b6d tempest-TestNetworkAdvancedServerOps-2111337414 tempest-TestNetworkAdvancedServerOps-2111337414-project] Request method failure captured: Aug 10 18:25:04.976610 n-d-852296-2 devstack@n-api.service[129410]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 18:25:04.976610 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 18:25:04.976610 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 18:25:04.976610 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 18:25:04.976610 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 345 Aug 10 18:25:04.976610 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 18:25:04.976610 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 18:25:04.976610 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 18:25:04.976610 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 18:25:04.976610 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8_fnBKEwqMa97iaa6btfUgg_O5kSfbV1NVQJbz1U0l4v93ov3nBUWWDm8ENQtkSDX1RNRhmDBe0lDcZKr7xJtwpjyZiE8ZsaqWegCRHHAL9a5pCYn1BCs4eOtDqEvkn4qoqIayFrEDcdQsgWBVzY4rJPEoXcBsSFIGnTmyPxjiAKPzA Aug 10 18:25:04.976610 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 18:25:04.976610 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 18:25:04.976610 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 18:25:04.976610 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 18:25:04.976610 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 18:25:04.976610 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 18:25:04.976610 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: 3c05ca5310554ac4a1cf06c8dcaec96c Aug 10 18:25:04.976610 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2111337414 Aug 10 18:25:04.976610 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 18:25:04.976610 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 18:25:04.976610 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3c05ca5310554ac4a1cf06c8dcaec96c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3c05ca5310554ac4a1cf06c8dcaec96c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3c05ca5310554ac4a1cf06c8dcaec96c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3c05ca5310554ac4a1cf06c8dcaec96c", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 18:25:04.976610 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2111337414 Aug 10 18:25:04.976610 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: 3c05ca5310554ac4a1cf06c8dcaec96c Aug 10 18:25:04.976610 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2111337414 Aug 10 18:25:04.976610 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-TestNetworkAdvancedServerOps-2111337414-project Aug 10 18:25:04.976610 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 18:25:04.976610 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 18:25:04.976610 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: 005d90286d1041f7b3f18f96849ed03e Aug 10 18:25:04.976610 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2111337414-project Aug 10 18:25:04.976610 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 18:25:04.976610 n-d-852296-2 devstack@n-api.service[129410]: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1432557468", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "856b05c7-02c6-4b90-9e17-3647e7369220"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1406838039", "security_groups": [{"name": "tempest-secgroup-smoke-1593687831"}]}} Aug 10 18:25:04.976610 n-d-852296-2 devstack@n-api.service[129410]: method: > Aug 10 18:25:04.976610 n-d-852296-2 devstack@n-api.service[129410]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:25:04.976610 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 18:25:04.976610 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'body': {'server': {'name': 'tempest-TestNetworkAdvancedServerOps-server-1432557468', 'imageRef': 'a735ff26-463a-4ffe-a981-ab9d9baa494f', 'flavorRef': '452', 'networks': [{'uuid': '856b05c7-02c6-4b90-9e17-3647e7369220'}], 'key_name': 'tempest-TestNetworkAdvancedServerOps-1406838039', 'security_groups': [{'name': 'tempest-secgroup-smoke-1593687831'}]}}} Aug 10 18:25:04.976610 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 18:25:04.976610 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:25:04.976610 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:25:04.976610 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:25:04.976610 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:25:04.976610 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:25:04.976610 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:25:04.976610 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:25:04.976610 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:25:04.976610 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:25:04.976610 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 18:25:04.976610 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 18:25:04.976610 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 18:25:04.976610 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 18:25:04.976610 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 18:25:04.976610 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 18:25:04.976610 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 18:25:04.976610 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 18:25:04.976610 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 18:25:04.976610 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 18:25:04.976610 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 18:25:04.976610 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 18:25:04.982321 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 18:25:04.982321 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 18:25:04.982321 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 18:25:04.982321 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 18:25:04.982321 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 18:25:04.982321 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:25:04.982321 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:25:04.982321 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 18:25:04.982321 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 18:25:04.982321 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:25:04.982321 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:25:04.982321 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 18:25:04.982321 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 18:25:04.982321 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:25:04.982321 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:25:04.982321 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:25:04.982321 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:25:04.982321 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:25:04.982321 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:25:04.982321 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 18:25:04.982321 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 18:25:04.982321 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 18:25:04.982321 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 18:25:04.982321 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 18:25:04.982321 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 18:25:04.982321 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 18:25:04.982321 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 18:25:04.982321 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 18:25:04.982321 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 18:25:04.982321 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 18:25:04.982321 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 18:25:04.982321 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 18:25:04.982321 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 18:25:04.982321 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 18:25:04.982321 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 18:25:04.982321 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 18:25:04.982321 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 18:25:04.982321 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 18:25:04.982321 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 18:25:04.982321 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 18:25:04.982321 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 18:25:04.982321 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 18:25:04.982321 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 18:25:04.982321 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 18:25:04.982321 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 18:25:04.982321 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-1e5dffbc-2ba7-44e2-888e-81d44486ab4d) Aug 10 18:25:04.982321 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:25:04.982321 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:25:04.982321 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:25:04.982321 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:25:04.982321 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:25:04.982321 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:25:04.982321 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 18:25:04.986874 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 18:25:04.986874 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 10 18:25:04.986874 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 10 18:25:04.986874 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:25:04.986874 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:25:04.986874 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:25:04.986874 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:25:04.986874 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:25:04.986874 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:25:04.986874 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:25:04.986874 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:25:04.986874 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 18:25:04.986874 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 18:25:04.986874 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:25:04.986874 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:25:04.986874 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:25:04.989798 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-fc08bdd4-7ca2-4e4b-86ea-707849c79b6d tempest-TestNetworkAdvancedServerOps-2111337414 tempest-TestNetworkAdvancedServerOps-2111337414-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:25:04.989798 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 18:25:04.990696 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-fc08bdd4-7ca2-4e4b-86ea-707849c79b6d tempest-TestNetworkAdvancedServerOps-2111337414 tempest-TestNetworkAdvancedServerOps-2111337414-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.432946 Aug 10 18:25:04.991293 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 1095/2215] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 18:25:04 2022] POST /compute/v2.1/servers => generated 214 bytes in 434 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 10 18:25:10.129498 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_cell0:SELECT=4 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 18:25:10.130379 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=1 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 18:25:10.134339 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-c13dbb35-ee98-43e4-b0ac-d3eaa21c0277 tempest-TestNetworkAdvancedServerOps-2111337414 tempest-TestNetworkAdvancedServerOps-2111337414-project] Calling method '.version_select at 0x7fb3464c71f0>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:25:10.340339 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-c13dbb35-ee98-43e4-b0ac-d3eaa21c0277 tempest-TestNetworkAdvancedServerOps-2111337414 tempest-TestNetworkAdvancedServerOps-2111337414-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1406838039" status: 202 len: 0 microversion: 2.1 time: 0.211744 Aug 10 18:25:10.340926 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1121/2216] 10.222.0.50 () {58 vars in 1284 bytes} [Wed Aug 10 18:25:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1406838039 => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 18:25:10.358186 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-02b2f2fc-ebf8-4250-9b6e-c117242f223d tempest-TestNetworkAdvancedServerOps-2111337414 tempest-TestNetworkAdvancedServerOps-2111337414-project] Action: 'create', calling method: .version_select at 0x7fb3458410d0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1512462646", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDQqP9iyRAXpNjtnvllGHe6lvaWKcat8pTnrdRZMEMXB7i9x90+2RIOLinhOZ7EtI+FIUqFCN0TPeyabZGhi0GeqFiz4tF+W+I0CrLtWayIvdtCLS1oLReP8TuH2kCNECA=="}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 18:25:10.375997 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.quota [None req-02b2f2fc-ebf8-4250-9b6e-c117242f223d tempest-TestNetworkAdvancedServerOps-2111337414 tempest-TestNetworkAdvancedServerOps-2111337414-project] Getting quotas for project 3c05ca5310554ac4a1cf06c8dcaec96c. Resources: {'key_pairs'} {{(pid=129410) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 18:25:10.381898 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.quota [None req-02b2f2fc-ebf8-4250-9b6e-c117242f223d tempest-TestNetworkAdvancedServerOps-2111337414 tempest-TestNetworkAdvancedServerOps-2111337414-project] Getting quotas for user 005d90286d1041f7b3f18f96849ed03e and project 3c05ca5310554ac4a1cf06c8dcaec96c. Resources: {'key_pairs'} {{(pid=129410) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 18:25:10.522827 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-02b2f2fc-ebf8-4250-9b6e-c117242f223d tempest-TestNetworkAdvancedServerOps-2111337414 tempest-TestNetworkAdvancedServerOps-2111337414-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.168944 Aug 10 18:25:10.523497 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 1096/2217] 10.222.0.50 () {60 vars in 1159 bytes} [Wed Aug 10 18:25:10 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 18:25:19.598651 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-2082d0a7-c47b-4b40-aa2b-0511807a17ec tempest-TestNetworkAdvancedServerOps-2111337414 tempest-TestNetworkAdvancedServerOps-2111337414-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1124428717", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "e1bb83ca-eb50-4e69-90d2-1cf80242e297"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1512462646", "security_groups": [{"name": "tempest-secgroup-smoke-293457112"}]}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 18:25:19.747109 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.network.neutron [None req-2082d0a7-c47b-4b40-aa2b-0511807a17ec tempest-TestNetworkAdvancedServerOps-2111337414 tempest-TestNetworkAdvancedServerOps-2111337414-project] validate_networks() for [('e1bb83ca-eb50-4e69-90d2-1cf80242e297', None, None, None, None, None)] {{(pid=129409) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 18:25:19.997673 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [None req-2082d0a7-c47b-4b40-aa2b-0511807a17ec tempest-TestNetworkAdvancedServerOps-2111337414 tempest-TestNetworkAdvancedServerOps-2111337414-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-46dcfbd4-14a4-4923-9c10-0177a3fb404c) Aug 10 18:25:19.997673 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:25:19.997673 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:25:19.997673 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:25:19.997673 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:25:19.997673 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:25:19.997673 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:25:19.997673 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:25:19.997673 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:25:19.997673 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:25:19.997673 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 18:25:19.997673 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 18:25:19.997673 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 18:25:19.997673 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 18:25:19.997673 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 18:25:19.997673 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 18:25:19.997673 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 18:25:19.997673 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 18:25:19.997673 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 18:25:19.997673 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 18:25:19.997673 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 18:25:19.997673 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 18:25:19.997673 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 18:25:19.997673 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 18:25:19.997673 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 18:25:19.997673 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 18:25:19.997673 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 18:25:19.997673 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:25:19.997673 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:25:19.997673 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 18:25:19.997673 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 18:25:19.997673 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:25:19.997673 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:25:19.997673 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 18:25:19.997673 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 18:25:19.997673 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:25:19.997673 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:25:19.997673 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:25:19.997673 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:25:19.997673 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:25:19.997673 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:25:19.997673 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 18:25:19.997673 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 18:25:19.997673 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 18:25:19.997673 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 18:25:19.997673 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 18:25:19.997673 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 18:25:19.997673 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 18:25:19.997673 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 18:25:19.997673 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 18:25:19.997673 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 18:25:19.997673 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 18:25:20.005246 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 18:25:20.005246 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 18:25:20.005246 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 18:25:20.005246 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 18:25:20.005246 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 18:25:20.005246 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 18:25:20.005246 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 18:25:20.005246 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 18:25:20.005246 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 18:25:20.005246 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 18:25:20.005246 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 18:25:20.005246 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 18:25:20.005246 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 18:25:20.005246 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 18:25:20.005246 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 18:25:20.005246 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-46dcfbd4-14a4-4923-9c10-0177a3fb404c) Aug 10 18:25:20.005246 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:25:20.005246 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-2082d0a7-c47b-4b40-aa2b-0511807a17ec tempest-TestNetworkAdvancedServerOps-2111337414 tempest-TestNetworkAdvancedServerOps-2111337414-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:25:20.005246 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 18:25:20.005246 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-2082d0a7-c47b-4b40-aa2b-0511807a17ec tempest-TestNetworkAdvancedServerOps-2111337414 tempest-TestNetworkAdvancedServerOps-2111337414-project] Request method failure captured: Aug 10 18:25:20.005246 n-d-852296-2 devstack@n-api.service[129409]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 18:25:20.005246 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 18:25:20.005246 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 18:25:20.005246 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 18:25:20.005246 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 344 Aug 10 18:25:20.005246 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 18:25:20.005246 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 18:25:20.005246 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 18:25:20.005246 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 18:25:20.005246 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8_fnBKEwqMa97iaa6btfUgg_O5kSfbV1NVQJbz1U0l4v93ov3nBUWWDm8ENQtkSDX1RNRhmDBe0lDcZKr7xJtwpjyZiE8ZsaqWegCRHHAL9a5pCYn1BCs4eOtDqEvkn4qoqIayFrEDcdQsgWBVzY4rJPEoXcBsSFIGnTmyPxjiAKPzA Aug 10 18:25:20.005246 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 18:25:20.005246 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 18:25:20.005246 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 18:25:20.005246 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 18:25:20.005246 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 18:25:20.005246 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 18:25:20.005246 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: 3c05ca5310554ac4a1cf06c8dcaec96c Aug 10 18:25:20.005246 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2111337414 Aug 10 18:25:20.005246 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 18:25:20.005246 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 18:25:20.005246 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3c05ca5310554ac4a1cf06c8dcaec96c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3c05ca5310554ac4a1cf06c8dcaec96c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3c05ca5310554ac4a1cf06c8dcaec96c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3c05ca5310554ac4a1cf06c8dcaec96c", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 18:25:20.005246 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2111337414 Aug 10 18:25:20.005246 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: 3c05ca5310554ac4a1cf06c8dcaec96c Aug 10 18:25:20.005246 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2111337414 Aug 10 18:25:20.005246 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-TestNetworkAdvancedServerOps-2111337414-project Aug 10 18:25:20.005246 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 18:25:20.005246 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 18:25:20.005246 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: 005d90286d1041f7b3f18f96849ed03e Aug 10 18:25:20.005246 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2111337414-project Aug 10 18:25:20.005246 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 18:25:20.005246 n-d-852296-2 devstack@n-api.service[129409]: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1124428717", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "e1bb83ca-eb50-4e69-90d2-1cf80242e297"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1512462646", "security_groups": [{"name": "tempest-secgroup-smoke-293457112"}]}} Aug 10 18:25:20.005246 n-d-852296-2 devstack@n-api.service[129409]: method: > Aug 10 18:25:20.005246 n-d-852296-2 devstack@n-api.service[129409]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:25:20.005246 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 18:25:20.013500 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'body': {'server': {'name': 'tempest-TestNetworkAdvancedServerOps-server-1124428717', 'imageRef': 'a735ff26-463a-4ffe-a981-ab9d9baa494f', 'flavorRef': '452', 'networks': [{'uuid': 'e1bb83ca-eb50-4e69-90d2-1cf80242e297'}], 'key_name': 'tempest-TestNetworkAdvancedServerOps-1512462646', 'security_groups': [{'name': 'tempest-secgroup-smoke-293457112'}]}}} Aug 10 18:25:20.013500 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 18:25:20.013500 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:25:20.013500 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:25:20.013500 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:25:20.013500 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:25:20.013500 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:25:20.013500 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:25:20.013500 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:25:20.013500 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:25:20.013500 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:25:20.013500 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 18:25:20.013500 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 18:25:20.013500 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 18:25:20.013500 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 18:25:20.013500 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 18:25:20.013500 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 18:25:20.013500 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 18:25:20.013500 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 18:25:20.013500 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 18:25:20.013500 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 18:25:20.013500 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 18:25:20.013500 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 18:25:20.013500 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 18:25:20.013500 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 18:25:20.013500 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 18:25:20.013500 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 18:25:20.013500 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 18:25:20.013500 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:25:20.013500 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:25:20.013500 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 18:25:20.013500 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 18:25:20.013500 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:25:20.013500 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:25:20.013500 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 18:25:20.013500 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 18:25:20.013500 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:25:20.013500 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:25:20.013500 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:25:20.013500 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:25:20.013500 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:25:20.013500 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:25:20.013500 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 18:25:20.013500 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 18:25:20.013500 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 18:25:20.013500 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 18:25:20.013500 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 18:25:20.013500 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 18:25:20.013500 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 18:25:20.013500 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 18:25:20.013500 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 18:25:20.013500 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 18:25:20.013500 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 18:25:20.013500 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 18:25:20.021509 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 18:25:20.021509 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 18:25:20.021509 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 18:25:20.021509 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 18:25:20.021509 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 18:25:20.021509 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 18:25:20.021509 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 18:25:20.021509 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 18:25:20.021509 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 18:25:20.021509 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 18:25:20.021509 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 18:25:20.021509 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 18:25:20.021509 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 18:25:20.021509 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 18:25:20.021509 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-46dcfbd4-14a4-4923-9c10-0177a3fb404c) Aug 10 18:25:20.021509 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:25:20.021509 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:25:20.021509 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:25:20.021509 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:25:20.021509 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:25:20.021509 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:25:20.021509 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 18:25:20.021509 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 18:25:20.021509 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 10 18:25:20.021509 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 10 18:25:20.021509 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:25:20.021509 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:25:20.021509 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:25:20.021509 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:25:20.021509 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:25:20.021509 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:25:20.021509 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:25:20.021509 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:25:20.021509 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 18:25:20.021509 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 18:25:20.021509 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:25:20.021509 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:25:20.021509 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:25:20.021509 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-2082d0a7-c47b-4b40-aa2b-0511807a17ec tempest-TestNetworkAdvancedServerOps-2111337414 tempest-TestNetworkAdvancedServerOps-2111337414-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:25:20.021509 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 18:25:20.021509 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-2082d0a7-c47b-4b40-aa2b-0511807a17ec tempest-TestNetworkAdvancedServerOps-2111337414 tempest-TestNetworkAdvancedServerOps-2111337414-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.409847 Aug 10 18:25:20.021509 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1122/2218] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 18:25:19 2022] POST /compute/v2.1/servers => generated 214 bytes in 412 msecs (HTTP/1.1 500) 9 headers in 391 bytes (2 switches on core 0) Aug 10 18:25:24.218459 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-510bdd9d-684a-45a1-ab6f-dd79c747bc15 tempest-TestNetworkAdvancedServerOps-2111337414 tempest-TestNetworkAdvancedServerOps-2111337414-project] Calling method '.version_select at 0x7fb34574bdc0>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:25:24.223635 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_cell0:SELECT=4 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 18:25:24.224443 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_api:SELECT=18,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 18:25:24.362320 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-510bdd9d-684a-45a1-ab6f-dd79c747bc15 tempest-TestNetworkAdvancedServerOps-2111337414 tempest-TestNetworkAdvancedServerOps-2111337414-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1512462646" status: 202 len: 0 microversion: 2.1 time: 0.148100 Aug 10 18:25:24.362859 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 1097/2219] 10.222.0.50 () {58 vars in 1284 bytes} [Wed Aug 10 18:25:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1512462646 => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 18:25:24.375992 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-24aaf0ec-dd26-4e1c-af53-42643d8f5f4f tempest-TestNetworkAdvancedServerOps-2111337414 tempest-TestNetworkAdvancedServerOps-2111337414-project] Action: 'create', calling method: .version_select at 0x7fb346621160>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1868642662", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNpprLNzxRo6FFWZJgI2zxxuQDQYfk8scz6Zh9yX4EeshB4UPKTJoc7rvIzjqosn4PJdO/GXo9sZQ1tu8FvzMRBRjb6uoUcK3usXOvcfQoJDVoL6Iker4bpvzJ+68dg6Rw=="}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 18:25:24.393500 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-24aaf0ec-dd26-4e1c-af53-42643d8f5f4f tempest-TestNetworkAdvancedServerOps-2111337414 tempest-TestNetworkAdvancedServerOps-2111337414-project] Getting quotas for project 3c05ca5310554ac4a1cf06c8dcaec96c. Resources: {'key_pairs'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 18:25:24.398663 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-24aaf0ec-dd26-4e1c-af53-42643d8f5f4f tempest-TestNetworkAdvancedServerOps-2111337414 tempest-TestNetworkAdvancedServerOps-2111337414-project] Getting quotas for user 005d90286d1041f7b3f18f96849ed03e and project 3c05ca5310554ac4a1cf06c8dcaec96c. Resources: {'key_pairs'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 18:25:24.534156 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-24aaf0ec-dd26-4e1c-af53-42643d8f5f4f tempest-TestNetworkAdvancedServerOps-2111337414 tempest-TestNetworkAdvancedServerOps-2111337414-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.161996 Aug 10 18:25:24.535424 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1123/2220] 10.222.0.50 () {60 vars in 1159 bytes} [Wed Aug 10 18:25:24 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 18:25:35.075388 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-ee925716-f48d-48ff-ad79-654885680102 tempest-TestNetworkAdvancedServerOps-2111337414 tempest-TestNetworkAdvancedServerOps-2111337414-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1613726364", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "071832a5-061c-4263-aa60-208738bab4cb"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1868642662", "security_groups": [{"name": "tempest-secgroup-smoke-641515717"}]}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 18:25:35.202893 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.network.neutron [None req-ee925716-f48d-48ff-ad79-654885680102 tempest-TestNetworkAdvancedServerOps-2111337414 tempest-TestNetworkAdvancedServerOps-2111337414-project] validate_networks() for [('071832a5-061c-4263-aa60-208738bab4cb', None, None, None, None, None)] {{(pid=129410) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 18:25:35.453481 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [None req-ee925716-f48d-48ff-ad79-654885680102 tempest-TestNetworkAdvancedServerOps-2111337414 tempest-TestNetworkAdvancedServerOps-2111337414-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-17f17140-5202-42ce-acbb-8bdea1879b8f) Aug 10 18:25:35.453481 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:25:35.453481 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:25:35.453481 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:25:35.453481 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:25:35.453481 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:25:35.453481 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:25:35.453481 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:25:35.453481 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:25:35.453481 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:25:35.453481 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 18:25:35.453481 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 18:25:35.453481 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 18:25:35.453481 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 18:25:35.453481 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 18:25:35.453481 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 18:25:35.453481 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 18:25:35.453481 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 18:25:35.453481 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 18:25:35.453481 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 18:25:35.453481 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 18:25:35.453481 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 18:25:35.453481 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 18:25:35.453481 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 18:25:35.453481 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 18:25:35.453481 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 18:25:35.453481 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 18:25:35.453481 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:25:35.453481 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:25:35.453481 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 18:25:35.453481 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 18:25:35.453481 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:25:35.453481 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:25:35.453481 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 18:25:35.453481 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 18:25:35.453481 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:25:35.453481 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:25:35.453481 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:25:35.453481 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:25:35.453481 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:25:35.453481 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:25:35.453481 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 18:25:35.453481 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 18:25:35.453481 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 18:25:35.453481 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 18:25:35.453481 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 18:25:35.453481 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 18:25:35.453481 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 18:25:35.453481 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 18:25:35.453481 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 18:25:35.453481 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 18:25:35.453481 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 18:25:35.458666 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 18:25:35.458666 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 18:25:35.458666 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 18:25:35.458666 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 18:25:35.458666 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 18:25:35.458666 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 18:25:35.458666 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 18:25:35.458666 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 18:25:35.458666 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 18:25:35.458666 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 18:25:35.458666 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 18:25:35.458666 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 18:25:35.458666 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 18:25:35.458666 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 18:25:35.458666 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 18:25:35.458666 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-17f17140-5202-42ce-acbb-8bdea1879b8f) Aug 10 18:25:35.458666 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:25:35.462714 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-ee925716-f48d-48ff-ad79-654885680102 tempest-TestNetworkAdvancedServerOps-2111337414 tempest-TestNetworkAdvancedServerOps-2111337414-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:25:35.462714 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 18:25:35.466863 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-ee925716-f48d-48ff-ad79-654885680102 tempest-TestNetworkAdvancedServerOps-2111337414 tempest-TestNetworkAdvancedServerOps-2111337414-project] Request method failure captured: Aug 10 18:25:35.466863 n-d-852296-2 devstack@n-api.service[129410]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 18:25:35.466863 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 18:25:35.466863 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 18:25:35.466863 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 18:25:35.466863 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 344 Aug 10 18:25:35.466863 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 18:25:35.466863 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 18:25:35.466863 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 18:25:35.466863 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 18:25:35.466863 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8_fnBKEwqMa97iaa6btfUgg_O5kSfbV1NVQJbz1U0l4v93ov3nBUWWDm8ENQtkSDX1RNRhmDBe0lDcZKr7xJtwpjyZiE8ZsaqWegCRHHAL9a5pCYn1BCs4eOtDqEvkn4qoqIayFrEDcdQsgWBVzY4rJPEoXcBsSFIGnTmyPxjiAKPzA Aug 10 18:25:35.466863 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 18:25:35.466863 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 18:25:35.466863 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 18:25:35.466863 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 18:25:35.466863 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 18:25:35.466863 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 18:25:35.466863 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: 3c05ca5310554ac4a1cf06c8dcaec96c Aug 10 18:25:35.466863 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2111337414 Aug 10 18:25:35.466863 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 18:25:35.466863 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 18:25:35.466863 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3c05ca5310554ac4a1cf06c8dcaec96c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3c05ca5310554ac4a1cf06c8dcaec96c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3c05ca5310554ac4a1cf06c8dcaec96c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3c05ca5310554ac4a1cf06c8dcaec96c", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 18:25:35.466863 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2111337414 Aug 10 18:25:35.466863 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: 3c05ca5310554ac4a1cf06c8dcaec96c Aug 10 18:25:35.466863 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2111337414 Aug 10 18:25:35.466863 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-TestNetworkAdvancedServerOps-2111337414-project Aug 10 18:25:35.466863 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 18:25:35.466863 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 18:25:35.466863 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: 005d90286d1041f7b3f18f96849ed03e Aug 10 18:25:35.466863 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2111337414-project Aug 10 18:25:35.466863 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 18:25:35.466863 n-d-852296-2 devstack@n-api.service[129410]: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1613726364", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "071832a5-061c-4263-aa60-208738bab4cb"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1868642662", "security_groups": [{"name": "tempest-secgroup-smoke-641515717"}]}} Aug 10 18:25:35.466863 n-d-852296-2 devstack@n-api.service[129410]: method: > Aug 10 18:25:35.466863 n-d-852296-2 devstack@n-api.service[129410]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:25:35.466863 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 18:25:35.466863 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'body': {'server': {'name': 'tempest-TestNetworkAdvancedServerOps-server-1613726364', 'imageRef': 'a735ff26-463a-4ffe-a981-ab9d9baa494f', 'flavorRef': '452', 'networks': [{'uuid': '071832a5-061c-4263-aa60-208738bab4cb'}], 'key_name': 'tempest-TestNetworkAdvancedServerOps-1868642662', 'security_groups': [{'name': 'tempest-secgroup-smoke-641515717'}]}}} Aug 10 18:25:35.466863 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 18:25:35.466863 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:25:35.466863 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:25:35.466863 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:25:35.466863 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:25:35.466863 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:25:35.466863 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:25:35.466863 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:25:35.466863 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:25:35.466863 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:25:35.466863 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 18:25:35.466863 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 18:25:35.466863 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 18:25:35.466863 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 18:25:35.466863 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 18:25:35.466863 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 18:25:35.466863 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 18:25:35.466863 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 18:25:35.466863 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 18:25:35.466863 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 18:25:35.466863 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 18:25:35.466863 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 18:25:35.471920 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 18:25:35.471920 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 18:25:35.471920 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 18:25:35.471920 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 18:25:35.471920 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 18:25:35.471920 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:25:35.471920 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:25:35.471920 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 18:25:35.471920 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 18:25:35.471920 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:25:35.471920 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:25:35.471920 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 18:25:35.471920 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 18:25:35.471920 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:25:35.471920 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:25:35.471920 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:25:35.471920 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:25:35.471920 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:25:35.471920 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:25:35.471920 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 18:25:35.471920 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 18:25:35.471920 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 18:25:35.471920 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 18:25:35.471920 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 18:25:35.471920 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 18:25:35.471920 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 18:25:35.471920 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 18:25:35.471920 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 18:25:35.471920 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 18:25:35.471920 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 18:25:35.471920 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 18:25:35.471920 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 18:25:35.471920 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 18:25:35.471920 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 18:25:35.471920 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 18:25:35.471920 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 18:25:35.471920 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 18:25:35.471920 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 18:25:35.471920 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 18:25:35.471920 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 18:25:35.471920 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 18:25:35.471920 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 18:25:35.471920 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 18:25:35.471920 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 18:25:35.471920 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 18:25:35.471920 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-17f17140-5202-42ce-acbb-8bdea1879b8f) Aug 10 18:25:35.471920 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:25:35.471920 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:25:35.471920 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:25:35.471920 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:25:35.471920 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:25:35.471920 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:25:35.471920 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 18:25:35.483923 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 18:25:35.483923 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 10 18:25:35.483923 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 10 18:25:35.483923 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:25:35.483923 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:25:35.483923 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:25:35.483923 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:25:35.483923 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:25:35.483923 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:25:35.483923 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:25:35.483923 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:25:35.483923 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 18:25:35.483923 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 18:25:35.483923 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:25:35.483923 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:25:35.483923 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:25:35.483923 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-ee925716-f48d-48ff-ad79-654885680102 tempest-TestNetworkAdvancedServerOps-2111337414 tempest-TestNetworkAdvancedServerOps-2111337414-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:25:35.483923 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 18:25:35.483923 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-ee925716-f48d-48ff-ad79-654885680102 tempest-TestNetworkAdvancedServerOps-2111337414 tempest-TestNetworkAdvancedServerOps-2111337414-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.398191 Aug 10 18:25:35.483923 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 1098/2221] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 18:25:35 2022] POST /compute/v2.1/servers => generated 214 bytes in 400 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 10 18:25:39.270263 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_cell0:SELECT=4 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 18:25:39.271047 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_api:SELECT=18,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 18:25:39.275049 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-b01e27b7-78ee-4d4d-8707-d655031ab5a4 tempest-TestNetworkAdvancedServerOps-2111337414 tempest-TestNetworkAdvancedServerOps-2111337414-project] Calling method '.version_select at 0x7fb346207af0>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:25:39.372700 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-b01e27b7-78ee-4d4d-8707-d655031ab5a4 tempest-TestNetworkAdvancedServerOps-2111337414 tempest-TestNetworkAdvancedServerOps-2111337414-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1868642662" status: 202 len: 0 microversion: 2.1 time: 0.103127 Aug 10 18:25:39.373351 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1124/2222] 10.222.0.50 () {58 vars in 1284 bytes} [Wed Aug 10 18:25:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1868642662 => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 18:25:39.387529 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-28be4a49-f2ee-4888-a787-d3902db3debb tempest-TestNetworkAdvancedServerOps-2111337414 tempest-TestNetworkAdvancedServerOps-2111337414-project] Action: 'create', calling method: .version_select at 0x7fb34574baf0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-170189210", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN2eFM9z6+5c4L04c9/NeZXwhT38yYrSjvOHg5OSt6vBWqG8YPPAeKsr5WSCTeU46BsyVH420BCEinOQYKGtkIOPrU6EW40nxXthz9aDpzxvFN1fLm0xazORhbr2L1E5FQ=="}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 18:25:39.405163 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.quota [None req-28be4a49-f2ee-4888-a787-d3902db3debb tempest-TestNetworkAdvancedServerOps-2111337414 tempest-TestNetworkAdvancedServerOps-2111337414-project] Getting quotas for project 3c05ca5310554ac4a1cf06c8dcaec96c. Resources: {'key_pairs'} {{(pid=129410) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 18:25:39.410656 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.quota [None req-28be4a49-f2ee-4888-a787-d3902db3debb tempest-TestNetworkAdvancedServerOps-2111337414 tempest-TestNetworkAdvancedServerOps-2111337414-project] Getting quotas for user 005d90286d1041f7b3f18f96849ed03e and project 3c05ca5310554ac4a1cf06c8dcaec96c. Resources: {'key_pairs'} {{(pid=129410) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 18:25:39.510457 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-28be4a49-f2ee-4888-a787-d3902db3debb tempest-TestNetworkAdvancedServerOps-2111337414 tempest-TestNetworkAdvancedServerOps-2111337414-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.127671 Aug 10 18:25:39.511068 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 1099/2223] 10.222.0.50 () {60 vars in 1159 bytes} [Wed Aug 10 18:25:39 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 18:25:48.557276 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-7c08e250-89b7-4942-8166-81e9921e4ad8 tempest-TestNetworkAdvancedServerOps-2111337414 tempest-TestNetworkAdvancedServerOps-2111337414-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-584517818", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "8de86607-1c90-4262-bd82-34c9f6d2ac83"}], "key_name": "tempest-TestNetworkAdvancedServerOps-170189210", "security_groups": [{"name": "tempest-secgroup-smoke-579481041"}]}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 18:25:48.684897 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.network.neutron [None req-7c08e250-89b7-4942-8166-81e9921e4ad8 tempest-TestNetworkAdvancedServerOps-2111337414 tempest-TestNetworkAdvancedServerOps-2111337414-project] validate_networks() for [('8de86607-1c90-4262-bd82-34c9f6d2ac83', None, None, None, None, None)] {{(pid=129409) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 18:25:48.897404 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [None req-7c08e250-89b7-4942-8166-81e9921e4ad8 tempest-TestNetworkAdvancedServerOps-2111337414 tempest-TestNetworkAdvancedServerOps-2111337414-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-9809eb0a-a3f4-4f19-b9a9-94d2602b3821) Aug 10 18:25:48.897404 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:25:48.897404 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:25:48.897404 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:25:48.897404 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:25:48.897404 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:25:48.897404 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:25:48.897404 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:25:48.897404 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:25:48.897404 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:25:48.897404 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 18:25:48.897404 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 18:25:48.897404 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 18:25:48.897404 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 18:25:48.897404 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 18:25:48.897404 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 18:25:48.897404 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 18:25:48.897404 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 18:25:48.897404 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 18:25:48.897404 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 18:25:48.897404 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 18:25:48.897404 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 18:25:48.897404 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 18:25:48.897404 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 18:25:48.897404 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 18:25:48.897404 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 18:25:48.897404 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 18:25:48.897404 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:25:48.897404 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:25:48.897404 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 18:25:48.897404 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 18:25:48.897404 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:25:48.897404 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:25:48.897404 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 18:25:48.897404 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 18:25:48.897404 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:25:48.897404 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:25:48.897404 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:25:48.897404 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:25:48.897404 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:25:48.897404 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:25:48.897404 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 18:25:48.897404 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 18:25:48.897404 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 18:25:48.897404 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 18:25:48.897404 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 18:25:48.897404 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 18:25:48.897404 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 18:25:48.897404 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 18:25:48.897404 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 18:25:48.897404 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 18:25:48.897404 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 18:25:48.902273 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 18:25:48.902273 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 18:25:48.902273 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 18:25:48.902273 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 18:25:48.902273 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 18:25:48.902273 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 18:25:48.902273 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 18:25:48.902273 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 18:25:48.902273 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 18:25:48.902273 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 18:25:48.902273 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 18:25:48.902273 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 18:25:48.902273 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 18:25:48.902273 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 18:25:48.902273 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 18:25:48.902273 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-9809eb0a-a3f4-4f19-b9a9-94d2602b3821) Aug 10 18:25:48.902273 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:25:48.902273 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-7c08e250-89b7-4942-8166-81e9921e4ad8 tempest-TestNetworkAdvancedServerOps-2111337414 tempest-TestNetworkAdvancedServerOps-2111337414-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:25:48.902273 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 18:25:48.913431 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-7c08e250-89b7-4942-8166-81e9921e4ad8 tempest-TestNetworkAdvancedServerOps-2111337414 tempest-TestNetworkAdvancedServerOps-2111337414-project] Request method failure captured: Aug 10 18:25:48.913431 n-d-852296-2 devstack@n-api.service[129409]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 18:25:48.913431 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 18:25:48.913431 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 18:25:48.913431 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 18:25:48.913431 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 342 Aug 10 18:25:48.913431 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 18:25:48.913431 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 18:25:48.913431 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 18:25:48.913431 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 18:25:48.913431 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8_fnBKEwqMa97iaa6btfUgg_O5kSfbV1NVQJbz1U0l4v93ov3nBUWWDm8ENQtkSDX1RNRhmDBe0lDcZKr7xJtwpjyZiE8ZsaqWegCRHHAL9a5pCYn1BCs4eOtDqEvkn4qoqIayFrEDcdQsgWBVzY4rJPEoXcBsSFIGnTmyPxjiAKPzA Aug 10 18:25:48.913431 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 18:25:48.913431 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 18:25:48.913431 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 18:25:48.913431 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 18:25:48.913431 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 18:25:48.913431 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 18:25:48.913431 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: 3c05ca5310554ac4a1cf06c8dcaec96c Aug 10 18:25:48.913431 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2111337414 Aug 10 18:25:48.913431 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 18:25:48.913431 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 18:25:48.913431 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3c05ca5310554ac4a1cf06c8dcaec96c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3c05ca5310554ac4a1cf06c8dcaec96c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3c05ca5310554ac4a1cf06c8dcaec96c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3c05ca5310554ac4a1cf06c8dcaec96c", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 18:25:48.913431 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2111337414 Aug 10 18:25:48.913431 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: 3c05ca5310554ac4a1cf06c8dcaec96c Aug 10 18:25:48.913431 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2111337414 Aug 10 18:25:48.913431 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-TestNetworkAdvancedServerOps-2111337414-project Aug 10 18:25:48.913431 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 18:25:48.913431 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 18:25:48.913431 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: 005d90286d1041f7b3f18f96849ed03e Aug 10 18:25:48.913431 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2111337414-project Aug 10 18:25:48.913431 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 18:25:48.913431 n-d-852296-2 devstack@n-api.service[129409]: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-584517818", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "networks": [{"uuid": "8de86607-1c90-4262-bd82-34c9f6d2ac83"}], "key_name": "tempest-TestNetworkAdvancedServerOps-170189210", "security_groups": [{"name": "tempest-secgroup-smoke-579481041"}]}} Aug 10 18:25:48.913431 n-d-852296-2 devstack@n-api.service[129409]: method: > Aug 10 18:25:48.913431 n-d-852296-2 devstack@n-api.service[129409]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:25:48.913431 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 18:25:48.913431 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'body': {'server': {'name': 'tempest-TestNetworkAdvancedServerOps-server-584517818', 'imageRef': 'a735ff26-463a-4ffe-a981-ab9d9baa494f', 'flavorRef': '452', 'networks': [{'uuid': '8de86607-1c90-4262-bd82-34c9f6d2ac83'}], 'key_name': 'tempest-TestNetworkAdvancedServerOps-170189210', 'security_groups': [{'name': 'tempest-secgroup-smoke-579481041'}]}}} Aug 10 18:25:48.913431 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 18:25:48.913431 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:25:48.913431 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:25:48.913431 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:25:48.913431 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:25:48.913431 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:25:48.913431 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:25:48.913431 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:25:48.913431 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:25:48.913431 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:25:48.913431 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 18:25:48.913431 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 18:25:48.913431 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 18:25:48.913431 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 18:25:48.913431 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 18:25:48.913431 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 18:25:48.913431 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 18:25:48.913431 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 18:25:48.913431 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 18:25:48.913431 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 18:25:48.913431 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 18:25:48.913431 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 18:25:48.923091 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 18:25:48.923091 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 18:25:48.923091 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 18:25:48.923091 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 18:25:48.923091 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 18:25:48.923091 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:25:48.923091 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:25:48.923091 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 18:25:48.923091 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 18:25:48.923091 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:25:48.923091 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:25:48.923091 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 18:25:48.923091 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 18:25:48.923091 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:25:48.923091 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:25:48.923091 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:25:48.923091 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:25:48.923091 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:25:48.923091 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:25:48.923091 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 18:25:48.923091 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 18:25:48.923091 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 18:25:48.923091 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 18:25:48.923091 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 18:25:48.923091 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 18:25:48.923091 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 18:25:48.923091 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 18:25:48.923091 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 18:25:48.923091 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 18:25:48.923091 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 18:25:48.923091 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 18:25:48.923091 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 18:25:48.923091 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 18:25:48.923091 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 18:25:48.923091 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 18:25:48.923091 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 18:25:48.923091 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 18:25:48.923091 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 18:25:48.923091 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 18:25:48.923091 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 18:25:48.923091 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 18:25:48.923091 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 18:25:48.923091 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 18:25:48.923091 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 18:25:48.923091 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 18:25:48.923091 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-9809eb0a-a3f4-4f19-b9a9-94d2602b3821) Aug 10 18:25:48.923091 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:25:48.923091 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:25:48.923091 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:25:48.923091 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:25:48.923091 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:25:48.923091 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:25:48.923091 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 18:25:48.947796 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 18:25:48.947796 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 10 18:25:48.947796 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 10 18:25:48.947796 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:25:48.947796 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:25:48.947796 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:25:48.947796 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:25:48.947796 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:25:48.947796 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:25:48.947796 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:25:48.947796 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:25:48.947796 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 18:25:48.947796 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 18:25:48.947796 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:25:48.947796 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:25:48.947796 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:25:48.947796 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-7c08e250-89b7-4942-8166-81e9921e4ad8 tempest-TestNetworkAdvancedServerOps-2111337414 tempest-TestNetworkAdvancedServerOps-2111337414-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:25:48.947796 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 18:25:48.947796 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-7c08e250-89b7-4942-8166-81e9921e4ad8 tempest-TestNetworkAdvancedServerOps-2111337414 tempest-TestNetworkAdvancedServerOps-2111337414-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.354699 Aug 10 18:25:48.947796 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1125/2224] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 18:25:48 2022] POST /compute/v2.1/servers => generated 214 bytes in 356 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 10 18:25:52.991609 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_cell0:SELECT=4 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 18:25:52.997887 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_api:SELECT=18,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 18:25:52.997887 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-d4f83266-d447-46de-9e7a-ffaf3ab7723e tempest-TestNetworkAdvancedServerOps-2111337414 tempest-TestNetworkAdvancedServerOps-2111337414-project] Calling method '.version_select at 0x7fb3457b94c0>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:25:53.098541 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-d4f83266-d447-46de-9e7a-ffaf3ab7723e tempest-TestNetworkAdvancedServerOps-2111337414 tempest-TestNetworkAdvancedServerOps-2111337414-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-170189210" status: 202 len: 0 microversion: 2.1 time: 0.108854 Aug 10 18:25:53.099045 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 1100/2225] 10.222.0.50 () {58 vars in 1281 bytes} [Wed Aug 10 18:25:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-170189210 => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 18:26:08.964187 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_api:SELECT=7,nova_api:DELETE=1 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 18:26:09.137053 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-dd8e81c1-29bf-493b-874f-9214c7a2577d tempest-TestShelveInstance-2037360915 tempest-TestShelveInstance-2037360915-project] Action: 'create', calling method: .version_select at 0x7fb3464c7a60>, body: {"keypair": {"name": "tempest-TestShelveInstance-1731931470", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJlOjsnJmlzNcUy4YtGMOi5OFM0Wvao8iq8X/sOnnJXcaDWtbbfBKFszUUemoyb88M1cXf72fzZTUHTzDPoiK3MdX6YEhnDx7AOsZEYPYk3bC93IewQ7fVch8PrQhwgv5w=="}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 18:26:09.155181 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-dd8e81c1-29bf-493b-874f-9214c7a2577d tempest-TestShelveInstance-2037360915 tempest-TestShelveInstance-2037360915-project] Getting quotas for project ce963faf7f38415794d145159899b46f. Resources: {'key_pairs'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 18:26:09.161039 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-dd8e81c1-29bf-493b-874f-9214c7a2577d tempest-TestShelveInstance-2037360915 tempest-TestShelveInstance-2037360915-project] Getting quotas for user 2690544389094ec181a81ca538b4029b and project ce963faf7f38415794d145159899b46f. Resources: {'key_pairs'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 18:26:09.269521 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-dd8e81c1-29bf-493b-874f-9214c7a2577d tempest-TestShelveInstance-2037360915 tempest-TestShelveInstance-2037360915-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.306059 Aug 10 18:26:09.270121 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1126/2226] 10.222.0.50 () {60 vars in 1159 bytes} [Wed Aug 10 18:26:08 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 18:26:12.144751 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-8db41a67-7f1b-4df7-b08f-a96636af05e2 tempest-TestShelveInstance-2037360915 tempest-TestShelveInstance-2037360915-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1751378657", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1731931470", "security_groups": [{"name": "tempest-secgroup-smoke-954611831"}], "networks": [{"uuid": "9809948a-025a-4141-9803-c9cce10814a1"}]}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 18:26:12.254784 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.network.neutron [None req-8db41a67-7f1b-4df7-b08f-a96636af05e2 tempest-TestShelveInstance-2037360915 tempest-TestShelveInstance-2037360915-project] validate_networks() for [('9809948a-025a-4141-9803-c9cce10814a1', None, None, None, None, None)] {{(pid=129410) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 18:26:12.460776 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [None req-8db41a67-7f1b-4df7-b08f-a96636af05e2 tempest-TestShelveInstance-2037360915 tempest-TestShelveInstance-2037360915-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-80aabcf4-7953-451c-a4d7-faca53f76da3) Aug 10 18:26:12.460776 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:26:12.460776 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:26:12.460776 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:26:12.460776 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:26:12.460776 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:26:12.460776 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:26:12.460776 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:26:12.460776 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:26:12.460776 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:26:12.460776 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 18:26:12.460776 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 18:26:12.460776 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 18:26:12.460776 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 18:26:12.460776 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 18:26:12.460776 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 18:26:12.460776 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 18:26:12.460776 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 18:26:12.460776 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 18:26:12.460776 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 18:26:12.460776 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 18:26:12.460776 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 18:26:12.460776 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 18:26:12.460776 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 18:26:12.460776 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 18:26:12.460776 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 18:26:12.460776 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 18:26:12.460776 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:26:12.460776 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:26:12.460776 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 18:26:12.460776 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 18:26:12.460776 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:26:12.460776 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:26:12.460776 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 18:26:12.460776 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 18:26:12.460776 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:26:12.460776 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:26:12.460776 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:26:12.460776 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:26:12.460776 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:26:12.460776 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:26:12.460776 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 18:26:12.460776 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 18:26:12.460776 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 18:26:12.460776 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 18:26:12.460776 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 18:26:12.460776 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 18:26:12.460776 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 18:26:12.460776 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 18:26:12.460776 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 18:26:12.460776 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 18:26:12.460776 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 18:26:12.460776 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 18:26:12.464998 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 18:26:12.464998 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 18:26:12.464998 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 18:26:12.464998 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 18:26:12.464998 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 18:26:12.464998 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 18:26:12.464998 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 18:26:12.464998 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 18:26:12.464998 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 18:26:12.464998 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 18:26:12.464998 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 18:26:12.464998 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 18:26:12.464998 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 18:26:12.464998 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 18:26:12.464998 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-80aabcf4-7953-451c-a4d7-faca53f76da3) Aug 10 18:26:12.464998 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:26:12.464998 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-8db41a67-7f1b-4df7-b08f-a96636af05e2 tempest-TestShelveInstance-2037360915 tempest-TestShelveInstance-2037360915-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:26:12.464998 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 18:26:12.464998 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-8db41a67-7f1b-4df7-b08f-a96636af05e2 tempest-TestShelveInstance-2037360915 tempest-TestShelveInstance-2037360915-project] Request method failure captured: Aug 10 18:26:12.464998 n-d-852296-2 devstack@n-api.service[129410]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 18:26:12.464998 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 18:26:12.464998 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 18:26:12.464998 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 18:26:12.464998 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 324 Aug 10 18:26:12.464998 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 18:26:12.464998 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 18:26:12.464998 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 18:26:12.464998 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 18:26:12.464998 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8_g6oWekHLauYSvITOPw8ZOat4HtwnMZ6uVX7MAS_5jeRxMP__sDBccza0pN50Bk2DLBkeJ0cVUtdTILT7CZq4T03A2TUSRO92pyHgIgSdxfxAE0DWPBUyCQTJ2tCupSYGieiLfql0IgPQnIdd_2iPkQ4TVxUK6J5d7vT7bEmVhX8kU Aug 10 18:26:12.464998 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 18:26:12.464998 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 18:26:12.464998 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 18:26:12.464998 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 18:26:12.464998 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 18:26:12.464998 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 18:26:12.464998 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: ce963faf7f38415794d145159899b46f Aug 10 18:26:12.464998 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-TestShelveInstance-2037360915 Aug 10 18:26:12.464998 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 18:26:12.464998 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 18:26:12.464998 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ce963faf7f38415794d145159899b46f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/ce963faf7f38415794d145159899b46f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ce963faf7f38415794d145159899b46f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_ce963faf7f38415794d145159899b46f", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 18:26:12.464998 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-TestShelveInstance-2037360915 Aug 10 18:26:12.464998 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: ce963faf7f38415794d145159899b46f Aug 10 18:26:12.464998 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-TestShelveInstance-2037360915 Aug 10 18:26:12.464998 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-TestShelveInstance-2037360915-project Aug 10 18:26:12.464998 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 18:26:12.464998 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 18:26:12.464998 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: 2690544389094ec181a81ca538b4029b Aug 10 18:26:12.464998 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-TestShelveInstance-2037360915-project Aug 10 18:26:12.464998 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 18:26:12.464998 n-d-852296-2 devstack@n-api.service[129410]: {"server": {"name": "tempest-TestShelveInstance-server-1751378657", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1731931470", "security_groups": [{"name": "tempest-secgroup-smoke-954611831"}], "networks": [{"uuid": "9809948a-025a-4141-9803-c9cce10814a1"}]}} Aug 10 18:26:12.464998 n-d-852296-2 devstack@n-api.service[129410]: method: > Aug 10 18:26:12.464998 n-d-852296-2 devstack@n-api.service[129410]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:26:12.464998 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 18:26:12.469318 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'body': {'server': {'name': 'tempest-TestShelveInstance-server-1751378657', 'imageRef': 'a735ff26-463a-4ffe-a981-ab9d9baa494f', 'flavorRef': '452', 'key_name': 'tempest-TestShelveInstance-1731931470', 'security_groups': [{'name': 'tempest-secgroup-smoke-954611831'}], 'networks': [{'uuid': '9809948a-025a-4141-9803-c9cce10814a1'}]}}} Aug 10 18:26:12.469318 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 18:26:12.469318 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:26:12.469318 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:26:12.469318 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:26:12.469318 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:26:12.469318 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:26:12.469318 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:26:12.469318 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:26:12.469318 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:26:12.469318 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:26:12.469318 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 18:26:12.469318 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 18:26:12.469318 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 18:26:12.469318 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 18:26:12.469318 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 18:26:12.469318 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 18:26:12.469318 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 18:26:12.469318 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 18:26:12.469318 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 18:26:12.469318 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 18:26:12.469318 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 18:26:12.469318 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 18:26:12.469318 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 18:26:12.469318 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 18:26:12.469318 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 18:26:12.469318 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 18:26:12.469318 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 18:26:12.469318 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:26:12.469318 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:26:12.469318 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 18:26:12.469318 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 18:26:12.469318 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:26:12.469318 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:26:12.469318 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 18:26:12.469318 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 18:26:12.469318 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:26:12.469318 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:26:12.469318 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:26:12.469318 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:26:12.469318 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:26:12.469318 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:26:12.469318 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 18:26:12.469318 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 18:26:12.469318 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 18:26:12.469318 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 18:26:12.469318 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 18:26:12.469318 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 18:26:12.469318 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 18:26:12.469318 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 18:26:12.469318 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 18:26:12.469318 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 18:26:12.469318 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 18:26:12.469318 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 18:26:12.473426 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 18:26:12.473426 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 18:26:12.473426 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 18:26:12.473426 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 18:26:12.473426 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 18:26:12.473426 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 18:26:12.473426 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 18:26:12.473426 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 18:26:12.473426 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 18:26:12.473426 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 18:26:12.473426 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 18:26:12.473426 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 18:26:12.473426 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 18:26:12.473426 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 18:26:12.473426 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-80aabcf4-7953-451c-a4d7-faca53f76da3) Aug 10 18:26:12.473426 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:26:12.473426 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:26:12.473426 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:26:12.473426 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:26:12.473426 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:26:12.473426 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:26:12.473426 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 18:26:12.473426 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 18:26:12.473426 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 10 18:26:12.473426 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 10 18:26:12.473426 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:26:12.473426 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:26:12.473426 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:26:12.473426 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:26:12.473426 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:26:12.473426 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:26:12.473426 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:26:12.473426 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:26:12.473426 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 18:26:12.473426 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 18:26:12.473426 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:26:12.473426 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:26:12.473426 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:26:12.473426 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-8db41a67-7f1b-4df7-b08f-a96636af05e2 tempest-TestShelveInstance-2037360915 tempest-TestShelveInstance-2037360915-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:26:12.473426 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 18:26:12.473426 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-8db41a67-7f1b-4df7-b08f-a96636af05e2 tempest-TestShelveInstance-2037360915 tempest-TestShelveInstance-2037360915-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.324895 Aug 10 18:26:12.473426 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 1101/2227] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 18:26:12 2022] POST /compute/v2.1/servers => generated 214 bytes in 326 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 10 18:26:12.758521 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-96bc40de-8662-4918-9609-20c3466a8586 tempest-TestShelveInstance-2037360915 tempest-TestShelveInstance-2037360915-project] Calling method '.version_select at 0x7fb34610c9d0>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:26:12.863363 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-96bc40de-8662-4918-9609-20c3466a8586 tempest-TestShelveInstance-2037360915 tempest-TestShelveInstance-2037360915-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1731931470" status: 202 len: 0 microversion: 2.1 time: 0.108833 Aug 10 18:26:12.864133 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1127/2228] 10.222.0.50 () {58 vars in 1254 bytes} [Wed Aug 10 18:26:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1731931470 => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 18:26:12.877078 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-60aebb53-8240-462d-8f34-2ea2b39e1294 tempest-TestShelveInstance-2037360915 tempest-TestShelveInstance-2037360915-project] Action: 'create', calling method: .version_select at 0x7fb34637b430>, body: {"keypair": {"name": "tempest-TestShelveInstance-115980879", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNsCV1bVjwwsjUgwi9b5DUnTyyrpUbvBICz5G8r3s/QzbVmAjFJ0Dx05K6KPX5SjUN9K2dxKeU2KUKXBDugMbnn5myHIdnXZQn9Dk28/w/ho3Tc89HR6NadcbF/EaZF0Fw=="}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 18:26:12.893181 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.quota [None req-60aebb53-8240-462d-8f34-2ea2b39e1294 tempest-TestShelveInstance-2037360915 tempest-TestShelveInstance-2037360915-project] Getting quotas for project ce963faf7f38415794d145159899b46f. Resources: {'key_pairs'} {{(pid=129410) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 18:26:12.899014 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.quota [None req-60aebb53-8240-462d-8f34-2ea2b39e1294 tempest-TestShelveInstance-2037360915 tempest-TestShelveInstance-2037360915-project] Getting quotas for user 2690544389094ec181a81ca538b4029b and project ce963faf7f38415794d145159899b46f. Resources: {'key_pairs'} {{(pid=129410) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 18:26:12.989700 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-60aebb53-8240-462d-8f34-2ea2b39e1294 tempest-TestShelveInstance-2037360915 tempest-TestShelveInstance-2037360915-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.116451 Aug 10 18:26:12.990292 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 1102/2229] 10.222.0.50 () {60 vars in 1159 bytes} [Wed Aug 10 18:26:12 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 18:26:37.621720 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_cell0:SELECT=4 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 18:26:37.622503 n-d-852296-2 devstack@n-api.service[129409]: DEBUG dbcounter [-] [129409] Writing DB stats nova_api:SELECT=14,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=129409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 18:26:37.626428 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-f9c6838b-d49c-42f6-be25-41032aa392a7 tempest-TestShelveInstance-2037360915 tempest-TestShelveInstance-2037360915-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-2061404447", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-115980879", "security_groups": [{"name": "tempest-secgroup-smoke-2102484438"}], "networks": [{"uuid": "9809948a-025a-4141-9803-c9cce10814a1"}], "block_device_mapping_v2": [{"uuid": "8f935e42-f801-44e1-b3e1-5086a6850afe", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 18:26:37.739293 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.network.neutron [None req-f9c6838b-d49c-42f6-be25-41032aa392a7 tempest-TestShelveInstance-2037360915 tempest-TestShelveInstance-2037360915-project] validate_networks() for [('9809948a-025a-4141-9803-c9cce10814a1', None, None, None, None, None)] {{(pid=129409) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 18:26:37.942206 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [None req-f9c6838b-d49c-42f6-be25-41032aa392a7 tempest-TestShelveInstance-2037360915 tempest-TestShelveInstance-2037360915-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-16809492-3cef-48b8-9445-a67bedb19416) Aug 10 18:26:37.942206 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:26:37.942206 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:26:37.942206 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:26:37.942206 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:26:37.942206 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:26:37.942206 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:26:37.942206 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:26:37.942206 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:26:37.942206 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:26:37.942206 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 18:26:37.942206 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 18:26:37.942206 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 18:26:37.942206 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 18:26:37.942206 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 18:26:37.942206 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 18:26:37.942206 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 18:26:37.942206 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 18:26:37.942206 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 18:26:37.942206 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 18:26:37.942206 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 18:26:37.942206 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 18:26:37.942206 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 18:26:37.942206 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 18:26:37.942206 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 18:26:37.942206 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 18:26:37.942206 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 18:26:37.942206 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:26:37.942206 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:26:37.942206 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 18:26:37.942206 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 18:26:37.942206 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:26:37.942206 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:26:37.942206 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 18:26:37.942206 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 18:26:37.942206 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:26:37.942206 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:26:37.942206 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:26:37.942206 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:26:37.942206 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:26:37.942206 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:26:37.942206 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 18:26:37.942206 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 18:26:37.942206 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 18:26:37.942206 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 18:26:37.942206 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 18:26:37.942206 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 18:26:37.942206 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 18:26:37.942206 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 18:26:37.942206 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 18:26:37.942206 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 18:26:37.942206 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 18:26:37.942206 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 18:26:37.948013 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 18:26:37.948013 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 18:26:37.948013 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 18:26:37.948013 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 18:26:37.948013 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 18:26:37.948013 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 18:26:37.948013 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 18:26:37.948013 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 18:26:37.948013 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 18:26:37.948013 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 18:26:37.948013 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 18:26:37.948013 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 18:26:37.948013 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 18:26:37.948013 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 18:26:37.948013 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-16809492-3cef-48b8-9445-a67bedb19416) Aug 10 18:26:37.948013 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:26:37.948013 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.wsgi [None req-f9c6838b-d49c-42f6-be25-41032aa392a7 tempest-TestShelveInstance-2037360915 tempest-TestShelveInstance-2037360915-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:26:37.948013 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 18:26:37.948013 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-f9c6838b-d49c-42f6-be25-41032aa392a7 tempest-TestShelveInstance-2037360915 tempest-TestShelveInstance-2037360915-project] Request method failure captured: Aug 10 18:26:37.948013 n-d-852296-2 devstack@n-api.service[129409]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 18:26:37.948013 n-d-852296-2 devstack@n-api.service[129409]: Accept: application/json Aug 10 18:26:37.948013 n-d-852296-2 devstack@n-api.service[129409]: Accept-Encoding: identity Aug 10 18:26:37.948013 n-d-852296-2 devstack@n-api.service[129409]: Connection: close Aug 10 18:26:37.948013 n-d-852296-2 devstack@n-api.service[129409]: Content-Length: 470 Aug 10 18:26:37.948013 n-d-852296-2 devstack@n-api.service[129409]: Content-Type: application/json Aug 10 18:26:37.948013 n-d-852296-2 devstack@n-api.service[129409]: Host: 10.222.0.50 Aug 10 18:26:37.948013 n-d-852296-2 devstack@n-api.service[129409]: Openstack-System-Scope: None Aug 10 18:26:37.948013 n-d-852296-2 devstack@n-api.service[129409]: User-Agent: python-urllib3/1.26.11 Aug 10 18:26:37.948013 n-d-852296-2 devstack@n-api.service[129409]: X-Auth-Token: gAAAAABi8_g6oWekHLauYSvITOPw8ZOat4HtwnMZ6uVX7MAS_5jeRxMP__sDBccza0pN50Bk2DLBkeJ0cVUtdTILT7CZq4T03A2TUSRO92pyHgIgSdxfxAE0DWPBUyCQTJ2tCupSYGieiLfql0IgPQnIdd_2iPkQ4TVxUK6J5d7vT7bEmVhX8kU Aug 10 18:26:37.948013 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Id: None Aug 10 18:26:37.948013 n-d-852296-2 devstack@n-api.service[129409]: X-Domain-Name: None Aug 10 18:26:37.948013 n-d-852296-2 devstack@n-api.service[129409]: X-Identity-Status: Confirmed Aug 10 18:26:37.948013 n-d-852296-2 devstack@n-api.service[129409]: X-Is-Admin-Project: True Aug 10 18:26:37.948013 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Id: default Aug 10 18:26:37.948013 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Domain-Name: Default Aug 10 18:26:37.948013 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Id: ce963faf7f38415794d145159899b46f Aug 10 18:26:37.948013 n-d-852296-2 devstack@n-api.service[129409]: X-Project-Name: tempest-TestShelveInstance-2037360915 Aug 10 18:26:37.948013 n-d-852296-2 devstack@n-api.service[129409]: X-Role: reader,member Aug 10 18:26:37.948013 n-d-852296-2 devstack@n-api.service[129409]: X-Roles: reader,member Aug 10 18:26:37.948013 n-d-852296-2 devstack@n-api.service[129409]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ce963faf7f38415794d145159899b46f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/ce963faf7f38415794d145159899b46f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ce963faf7f38415794d145159899b46f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_ce963faf7f38415794d145159899b46f", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 18:26:37.948013 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant: tempest-TestShelveInstance-2037360915 Aug 10 18:26:37.948013 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Id: ce963faf7f38415794d145159899b46f Aug 10 18:26:37.948013 n-d-852296-2 devstack@n-api.service[129409]: X-Tenant-Name: tempest-TestShelveInstance-2037360915 Aug 10 18:26:37.948013 n-d-852296-2 devstack@n-api.service[129409]: X-User: tempest-TestShelveInstance-2037360915-project Aug 10 18:26:37.948013 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Id: default Aug 10 18:26:37.948013 n-d-852296-2 devstack@n-api.service[129409]: X-User-Domain-Name: Default Aug 10 18:26:37.948013 n-d-852296-2 devstack@n-api.service[129409]: X-User-Id: 2690544389094ec181a81ca538b4029b Aug 10 18:26:37.948013 n-d-852296-2 devstack@n-api.service[129409]: X-User-Name: tempest-TestShelveInstance-2037360915-project Aug 10 18:26:37.948013 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 18:26:37.948013 n-d-852296-2 devstack@n-api.service[129409]: {"server": {"name": "tempest-TestShelveInstance-server-2061404447", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-115980879", "security_groups": [{"name": "tempest-secgroup-smoke-2102484438"}], "networks": [{"uuid": "9809948a-025a-4141-9803-c9cce10814a1"}], "block_device_mapping_v2": [{"uuid": "8f935e42-f801-44e1-b3e1-5086a6850afe", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} Aug 10 18:26:37.948013 n-d-852296-2 devstack@n-api.service[129409]: method: > Aug 10 18:26:37.948013 n-d-852296-2 devstack@n-api.service[129409]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:26:37.948013 n-d-852296-2 devstack@n-api.service[129409]: Aug 10 18:26:37.953247 n-d-852296-2 devstack@n-api.service[129409]: action_args: {'body': {'server': {'name': 'tempest-TestShelveInstance-server-2061404447', 'imageRef': '', 'flavorRef': '452', 'key_name': 'tempest-TestShelveInstance-115980879', 'security_groups': [{'name': 'tempest-secgroup-smoke-2102484438'}], 'networks': [{'uuid': '9809948a-025a-4141-9803-c9cce10814a1'}], 'block_device_mapping_v2': [{'source_type': 'volume', 'destination_type': 'volume', 'boot_index': 0, 'delete_on_termination': True, 'volume_id': '8f935e42-f801-44e1-b3e1-5086a6850afe'}]}}} Aug 10 18:26:37.953247 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 18:26:37.953247 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:26:37.953247 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:26:37.953247 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:26:37.953247 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:26:37.953247 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:26:37.953247 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:26:37.953247 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:26:37.953247 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:26:37.953247 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:26:37.953247 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 18:26:37.953247 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 18:26:37.953247 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 18:26:37.953247 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 18:26:37.953247 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 18:26:37.953247 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 18:26:37.953247 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 18:26:37.953247 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 18:26:37.953247 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 18:26:37.953247 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 18:26:37.953247 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 18:26:37.953247 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 18:26:37.953247 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 18:26:37.953247 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 18:26:37.953247 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 18:26:37.953247 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 18:26:37.953247 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 18:26:37.953247 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:26:37.953247 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:26:37.953247 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 18:26:37.953247 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 18:26:37.953247 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:26:37.953247 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:26:37.953247 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 18:26:37.953247 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 18:26:37.953247 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:26:37.953247 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:26:37.953247 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:26:37.953247 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:26:37.953247 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:26:37.953247 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:26:37.953247 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 18:26:37.953247 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 18:26:37.953247 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 18:26:37.953247 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 18:26:37.953247 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 18:26:37.953247 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 18:26:37.953247 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 18:26:37.953247 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 18:26:37.953247 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 18:26:37.953247 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 18:26:37.953247 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 18:26:37.958082 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 18:26:37.958082 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 18:26:37.958082 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 18:26:37.958082 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 18:26:37.958082 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 18:26:37.958082 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 18:26:37.958082 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 18:26:37.958082 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 18:26:37.958082 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 18:26:37.958082 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 18:26:37.958082 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 18:26:37.958082 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 18:26:37.958082 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 18:26:37.958082 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 18:26:37.958082 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 18:26:37.958082 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-16809492-3cef-48b8-9445-a67bedb19416) Aug 10 18:26:37.958082 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:26:37.958082 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:26:37.958082 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:26:37.958082 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:26:37.958082 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:26:37.958082 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:26:37.958082 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 18:26:37.958082 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 18:26:37.958082 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 10 18:26:37.958082 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 10 18:26:37.958082 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:26:37.958082 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:26:37.958082 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:26:37.958082 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:26:37.958082 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:26:37.958082 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:26:37.958082 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:26:37.958082 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:26:37.958082 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 18:26:37.958082 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 18:26:37.958082 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:26:37.958082 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:26:37.958082 n-d-852296-2 devstack@n-api.service[129409]: ERROR nova.api.openstack.wsgi Aug 10 18:26:37.958082 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-f9c6838b-d49c-42f6-be25-41032aa392a7 tempest-TestShelveInstance-2037360915 tempest-TestShelveInstance-2037360915-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:26:37.958082 n-d-852296-2 devstack@n-api.service[129409]: {{(pid=129409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 18:26:37.958082 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-f9c6838b-d49c-42f6-be25-41032aa392a7 tempest-TestShelveInstance-2037360915 tempest-TestShelveInstance-2037360915-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.326278 Aug 10 18:26:37.958082 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1128/2230] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 18:26:37 2022] POST /compute/v2.1/servers => generated 214 bytes in 327 msecs (HTTP/1.1 500) 9 headers in 391 bytes (2 switches on core 0) Aug 10 18:26:38.203306 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-e2a60ed8-fc4f-49cb-9601-77d8231c89e2 tempest-TestShelveInstance-2037360915 tempest-TestShelveInstance-2037360915-project] Calling method '.version_select at 0x7fb345b4bb80>' {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:26:38.208126 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_cell0:SELECT=4 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 18:26:38.208911 n-d-852296-2 devstack@n-api.service[129410]: DEBUG dbcounter [-] [129410] Writing DB stats nova_api:SELECT=18,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=129410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 18:26:38.393912 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-e2a60ed8-fc4f-49cb-9601-77d8231c89e2 tempest-TestShelveInstance-2037360915 tempest-TestShelveInstance-2037360915-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-115980879" status: 202 len: 0 microversion: 2.1 time: 0.194369 Aug 10 18:26:38.394432 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 1103/2231] 10.222.0.50 () {58 vars in 1251 bytes} [Wed Aug 10 18:26:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-115980879 => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 18:27:02.446004 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-663dc637-6b4c-497e-8ef4-0da249a4d257 tempest-TestSnapshotPattern-1024670208 tempest-TestSnapshotPattern-1024670208-project] Action: 'create', calling method: .version_select at 0x7fb345e25310>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-237787074", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHVDJ2xfRzBOBd9ee3sXF3CNxjRLnwEcJJbJsvxaWnXJCauYWVCxJZl8qkI5x7bfqvMXlp7iTNaMTy0zFE7klEChnua8nm5Sau6+Vkd6kq0j8b43i60GphFNyhKjyFlGCw=="}} {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 18:27:02.463431 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-663dc637-6b4c-497e-8ef4-0da249a4d257 tempest-TestSnapshotPattern-1024670208 tempest-TestSnapshotPattern-1024670208-project] Getting quotas for project 51150c9dba1c4e74a45e3511c60faab0. Resources: {'key_pairs'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 18:27:02.468396 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.quota [None req-663dc637-6b4c-497e-8ef4-0da249a4d257 tempest-TestSnapshotPattern-1024670208 tempest-TestSnapshotPattern-1024670208-project] Getting quotas for user 32636c6df9914bc9ab07a6f939e7b059 and project 51150c9dba1c4e74a45e3511c60faab0. Resources: {'key_pairs'} {{(pid=129409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 18:27:02.594149 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-663dc637-6b4c-497e-8ef4-0da249a4d257 tempest-TestSnapshotPattern-1024670208 tempest-TestSnapshotPattern-1024670208-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.338231 Aug 10 18:27:02.595393 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1129/2232] 10.222.0.50 () {60 vars in 1159 bytes} [Wed Aug 10 18:27:02 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 18:27:05.347471 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-85b2dd58-3992-4b90-bbe3-17597ffa0a34 tempest-TestSnapshotPattern-1024670208 tempest-TestSnapshotPattern-1024670208-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1215130162", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-237787074", "security_groups": [{"name": "tempest-secgroup-smoke-1850929000"}], "networks": [{"uuid": "bacf35e0-ee99-473e-801f-81026ae815a8"}]}} {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 18:27:05.618152 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.network.neutron [None req-85b2dd58-3992-4b90-bbe3-17597ffa0a34 tempest-TestSnapshotPattern-1024670208 tempest-TestSnapshotPattern-1024670208-project] validate_networks() for [('bacf35e0-ee99-473e-801f-81026ae815a8', None, None, None, None, None)] {{(pid=129410) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 18:27:05.826606 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [None req-85b2dd58-3992-4b90-bbe3-17597ffa0a34 tempest-TestSnapshotPattern-1024670208 tempest-TestSnapshotPattern-1024670208-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-56b380e5-1da2-4bdc-9fcd-7daa2b163ceb) Aug 10 18:27:05.826606 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:27:05.826606 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:27:05.826606 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:27:05.826606 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:27:05.826606 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:27:05.826606 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:27:05.826606 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:27:05.826606 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:27:05.826606 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:27:05.826606 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 18:27:05.826606 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 18:27:05.826606 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 18:27:05.826606 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 18:27:05.826606 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 18:27:05.826606 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 18:27:05.826606 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 18:27:05.826606 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 18:27:05.826606 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 18:27:05.826606 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 18:27:05.826606 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 18:27:05.826606 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 18:27:05.826606 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 18:27:05.826606 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 18:27:05.826606 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 18:27:05.826606 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 18:27:05.826606 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 18:27:05.826606 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:27:05.826606 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:27:05.826606 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 18:27:05.826606 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 18:27:05.826606 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:27:05.826606 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:27:05.826606 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 18:27:05.826606 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 18:27:05.826606 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:27:05.826606 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:27:05.826606 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:27:05.826606 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:27:05.826606 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:27:05.826606 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:27:05.826606 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 18:27:05.826606 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 18:27:05.826606 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 18:27:05.826606 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 18:27:05.826606 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 18:27:05.826606 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 18:27:05.826606 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 18:27:05.826606 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 18:27:05.826606 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 18:27:05.826606 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 18:27:05.826606 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 18:27:05.826606 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 18:27:05.830544 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 18:27:05.830544 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 18:27:05.830544 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 18:27:05.830544 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 18:27:05.830544 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 18:27:05.830544 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 18:27:05.830544 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 18:27:05.830544 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 18:27:05.830544 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 18:27:05.830544 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 18:27:05.830544 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 18:27:05.830544 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 18:27:05.830544 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 18:27:05.830544 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 18:27:05.830544 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-56b380e5-1da2-4bdc-9fcd-7daa2b163ceb) Aug 10 18:27:05.830544 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:27:05.830544 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.wsgi [None req-85b2dd58-3992-4b90-bbe3-17597ffa0a34 tempest-TestSnapshotPattern-1024670208 tempest-TestSnapshotPattern-1024670208-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:27:05.830544 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 18:27:05.830544 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-85b2dd58-3992-4b90-bbe3-17597ffa0a34 tempest-TestSnapshotPattern-1024670208 tempest-TestSnapshotPattern-1024670208-project] Request method failure captured: Aug 10 18:27:05.830544 n-d-852296-2 devstack@n-api.service[129410]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 18:27:05.830544 n-d-852296-2 devstack@n-api.service[129410]: Accept: application/json Aug 10 18:27:05.830544 n-d-852296-2 devstack@n-api.service[129410]: Accept-Encoding: identity Aug 10 18:27:05.830544 n-d-852296-2 devstack@n-api.service[129410]: Connection: close Aug 10 18:27:05.830544 n-d-852296-2 devstack@n-api.service[129410]: Content-Length: 326 Aug 10 18:27:05.830544 n-d-852296-2 devstack@n-api.service[129410]: Content-Type: application/json Aug 10 18:27:05.830544 n-d-852296-2 devstack@n-api.service[129410]: Host: 10.222.0.50 Aug 10 18:27:05.830544 n-d-852296-2 devstack@n-api.service[129410]: Openstack-System-Scope: None Aug 10 18:27:05.830544 n-d-852296-2 devstack@n-api.service[129410]: User-Agent: python-urllib3/1.26.11 Aug 10 18:27:05.830544 n-d-852296-2 devstack@n-api.service[129410]: X-Auth-Token: gAAAAABi8_hvIhFARuBAfr8lvQDc4gDwFic-5oo_PlXrVoh2bc4xD22bHRXTkC5i7GjXSPR_fkLU3dDdsHjyGRhv2Fg3YFf3EvGdIt9tj7-EHz1OwvoXUbLMyTRbNx7a9JvPlsexsQ93uoI_uOIiBWG-rED0P5Z_uE4B_6IQYvzokeeaGnzhdjk Aug 10 18:27:05.830544 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Id: None Aug 10 18:27:05.830544 n-d-852296-2 devstack@n-api.service[129410]: X-Domain-Name: None Aug 10 18:27:05.830544 n-d-852296-2 devstack@n-api.service[129410]: X-Identity-Status: Confirmed Aug 10 18:27:05.830544 n-d-852296-2 devstack@n-api.service[129410]: X-Is-Admin-Project: True Aug 10 18:27:05.830544 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Id: default Aug 10 18:27:05.830544 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Domain-Name: Default Aug 10 18:27:05.830544 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Id: 51150c9dba1c4e74a45e3511c60faab0 Aug 10 18:27:05.830544 n-d-852296-2 devstack@n-api.service[129410]: X-Project-Name: tempest-TestSnapshotPattern-1024670208 Aug 10 18:27:05.830544 n-d-852296-2 devstack@n-api.service[129410]: X-Role: reader,member Aug 10 18:27:05.830544 n-d-852296-2 devstack@n-api.service[129410]: X-Roles: reader,member Aug 10 18:27:05.830544 n-d-852296-2 devstack@n-api.service[129410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/51150c9dba1c4e74a45e3511c60faab0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/51150c9dba1c4e74a45e3511c60faab0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/51150c9dba1c4e74a45e3511c60faab0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_51150c9dba1c4e74a45e3511c60faab0", "adminURL": "http://10.222.0.50:8080"}]}] Aug 10 18:27:05.830544 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant: tempest-TestSnapshotPattern-1024670208 Aug 10 18:27:05.830544 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Id: 51150c9dba1c4e74a45e3511c60faab0 Aug 10 18:27:05.830544 n-d-852296-2 devstack@n-api.service[129410]: X-Tenant-Name: tempest-TestSnapshotPattern-1024670208 Aug 10 18:27:05.830544 n-d-852296-2 devstack@n-api.service[129410]: X-User: tempest-TestSnapshotPattern-1024670208-project Aug 10 18:27:05.830544 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Id: default Aug 10 18:27:05.830544 n-d-852296-2 devstack@n-api.service[129410]: X-User-Domain-Name: Default Aug 10 18:27:05.830544 n-d-852296-2 devstack@n-api.service[129410]: X-User-Id: 32636c6df9914bc9ab07a6f939e7b059 Aug 10 18:27:05.830544 n-d-852296-2 devstack@n-api.service[129410]: X-User-Name: tempest-TestSnapshotPattern-1024670208-project Aug 10 18:27:05.830544 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 18:27:05.830544 n-d-852296-2 devstack@n-api.service[129410]: {"server": {"name": "tempest-TestSnapshotPattern-server-1215130162", "imageRef": "a735ff26-463a-4ffe-a981-ab9d9baa494f", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-237787074", "security_groups": [{"name": "tempest-secgroup-smoke-1850929000"}], "networks": [{"uuid": "bacf35e0-ee99-473e-801f-81026ae815a8"}]}} Aug 10 18:27:05.830544 n-d-852296-2 devstack@n-api.service[129410]: method: > Aug 10 18:27:05.830544 n-d-852296-2 devstack@n-api.service[129410]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:27:05.830544 n-d-852296-2 devstack@n-api.service[129410]: Aug 10 18:27:05.834771 n-d-852296-2 devstack@n-api.service[129410]: action_args: {'body': {'server': {'name': 'tempest-TestSnapshotPattern-server-1215130162', 'imageRef': 'a735ff26-463a-4ffe-a981-ab9d9baa494f', 'flavorRef': '452', 'key_name': 'tempest-TestSnapshotPattern-237787074', 'security_groups': [{'name': 'tempest-secgroup-smoke-1850929000'}], 'networks': [{'uuid': 'bacf35e0-ee99-473e-801f-81026ae815a8'}]}}} Aug 10 18:27:05.834771 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 18:27:05.834771 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:27:05.834771 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 18:27:05.834771 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 18:27:05.834771 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:27:05.834771 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:27:05.834771 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:27:05.834771 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:27:05.834771 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 18:27:05.834771 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 18:27:05.834771 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 18:27:05.834771 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 18:27:05.834771 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 18:27:05.834771 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 18:27:05.834771 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 18:27:05.834771 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 18:27:05.834771 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 18:27:05.834771 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1104, in _validate_and_build_base_options Aug 10 18:27:05.834771 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 10 18:27:05.834771 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 10 18:27:05.834771 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 10 18:27:05.834771 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 10 18:27:05.834771 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 10 18:27:05.834771 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 10 18:27:05.834771 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 10 18:27:05.834771 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 10 18:27:05.834771 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 10 18:27:05.834771 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:27:05.834771 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:27:05.834771 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 10 18:27:05.834771 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 10 18:27:05.834771 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:27:05.834771 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:27:05.834771 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 18:27:05.834771 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 18:27:05.834771 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:27:05.834771 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:27:05.834771 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 18:27:05.834771 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 18:27:05.834771 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 18:27:05.834771 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 18:27:05.834771 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 10 18:27:05.834771 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 10 18:27:05.834771 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 10 18:27:05.834771 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 10 18:27:05.834771 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 10 18:27:05.834771 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 10 18:27:05.834771 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 10 18:27:05.834771 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 10 18:27:05.834771 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 10 18:27:05.834771 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 10 18:27:05.834771 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 10 18:27:05.834771 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 10 18:27:05.844376 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 10 18:27:05.844376 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 10 18:27:05.844376 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 10 18:27:05.844376 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 10 18:27:05.844376 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 10 18:27:05.844376 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 10 18:27:05.844376 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 10 18:27:05.844376 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 10 18:27:05.844376 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 10 18:27:05.844376 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 10 18:27:05.844376 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 10 18:27:05.844376 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 10 18:27:05.844376 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 10 18:27:05.844376 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 10 18:27:05.844376 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-56b380e5-1da2-4bdc-9fcd-7daa2b163ceb) Aug 10 18:27:05.844376 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:27:05.844376 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:27:05.844376 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:27:05.844376 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:27:05.844376 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:27:05.844376 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:27:05.844376 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 18:27:05.844376 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 18:27:05.844376 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 10 18:27:05.844376 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 10 18:27:05.844376 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:27:05.844376 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:27:05.844376 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:27:05.844376 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 18:27:05.844376 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:27:05.844376 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 18:27:05.844376 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 18:27:05.844376 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 18:27:05.844376 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 18:27:05.844376 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 18:27:05.844376 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:27:05.844376 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:27:05.844376 n-d-852296-2 devstack@n-api.service[129410]: ERROR nova.api.openstack.wsgi Aug 10 18:27:05.844376 n-d-852296-2 devstack@n-api.service[129410]: DEBUG nova.api.openstack.wsgi [None req-85b2dd58-3992-4b90-bbe3-17597ffa0a34 tempest-TestSnapshotPattern-1024670208 tempest-TestSnapshotPattern-1024670208-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 10 18:27:05.844376 n-d-852296-2 devstack@n-api.service[129410]: {{(pid=129410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 18:27:05.844376 n-d-852296-2 devstack@n-api.service[129410]: INFO nova.api.openstack.requestlog [None req-85b2dd58-3992-4b90-bbe3-17597ffa0a34 tempest-TestSnapshotPattern-1024670208 tempest-TestSnapshotPattern-1024670208-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.488746 Aug 10 18:27:05.844376 n-d-852296-2 devstack@n-api.service[129410]: [pid: 129410|app: 0|req: 1104/2233] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 10 18:27:05 2022] POST /compute/v2.1/servers => generated 214 bytes in 490 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 10 18:27:06.100086 n-d-852296-2 devstack@n-api.service[129409]: DEBUG nova.api.openstack.wsgi [None req-71b15627-8a4f-4d14-b78c-5f0988305afe tempest-TestSnapshotPattern-1024670208 tempest-TestSnapshotPattern-1024670208-project] Calling method '.version_select at 0x7fb346207e50>' {{(pid=129409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 18:27:06.211430 n-d-852296-2 devstack@n-api.service[129409]: INFO nova.api.openstack.requestlog [None req-71b15627-8a4f-4d14-b78c-5f0988305afe tempest-TestSnapshotPattern-1024670208 tempest-TestSnapshotPattern-1024670208-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-237787074" status: 202 len: 0 microversion: 2.1 time: 0.115791 Aug 10 18:27:06.212078 n-d-852296-2 devstack@n-api.service[129409]: [pid: 129409|app: 0|req: 1130/2234] 10.222.0.50 () {58 vars in 1254 bytes} [Wed Aug 10 18:27:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-237787074 => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 18:27:15.296779 n-d-852296-2 devstack@n-api.service[129410]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 18:27:15.297330 n-d-852296-2 devstack@n-api.service[129410]: Wed Aug 10 18:27:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 18:27:16.274657 n-d-852296-2 devstack@n-api.service[129409]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 18:27:16.275228 n-d-852296-2 devstack@n-api.service[129409]: Wed Aug 10 18:27:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 18:27:37.150289 n-d-852296-2 devstack@n-api.service[129410]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 18:27:37.150771 n-d-852296-2 devstack@n-api.service[129410]: Wed Aug 10 18:27:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 18:27:43.939716 n-d-852296-2 devstack@n-api.service[129409]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 18:27:43.940234 n-d-852296-2 devstack@n-api.service[129409]: Wed Aug 10 18:27:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 18:30:35.305339 n-d-852296-2 devstack@n-api.service[129410]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 18:30:35.305883 n-d-852296-2 devstack@n-api.service[129410]: Wed Aug 10 18:30:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 18:30:36.283444 n-d-852296-2 devstack@n-api.service[129409]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 18:30:36.283982 n-d-852296-2 devstack@n-api.service[129409]: Wed Aug 10 18:30:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 18:30:57.160113 n-d-852296-2 devstack@n-api.service[129410]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 18:30:57.160679 n-d-852296-2 devstack@n-api.service[129410]: Wed Aug 10 18:30:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 18:31:03.948328 n-d-852296-2 devstack@n-api.service[129409]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 18:31:03.948790 n-d-852296-2 devstack@n-api.service[129409]: Wed Aug 10 18:31:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 18:32:15.103494 n-d-852296-2 devstack@n-api.service[129410]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 18:32:15.104098 n-d-852296-2 devstack@n-api.service[129410]: Wed Aug 10 18:32:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 18:32:16.125184 n-d-852296-2 devstack@n-api.service[129409]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 18:32:16.125732 n-d-852296-2 devstack@n-api.service[129409]: Wed Aug 10 18:32:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!